jarradh
/

llama2_70b_chat_uncensored

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

YokaiKoibito commited on Aug 12, 2023

Commit

619280d

•

1 Parent(s): 8d04aec

Update README.md

Corrected description to fp32

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ Uncensored refers to the [ehartford/wizard_vicuna_70k_unfiltered](https://huggin
 Special thanks to [George Sung](https://huggingface.co/georgesung) for creating [llama2_7b_chat_uncensored](https://huggingface.co/georgesung/llama2_7b_chat_uncensored), and to [Eric Hartford](https://huggingface.co/ehartford/) for creating [ehartford/wizard_vicuna_70k_unfiltered](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered)
-The version here is the fp16 HuggingFace model.
 In 8 bit mode, the model fits into 84% of A100 80GB (67.2GB) 68747MiB
 In 4 bit mode, the model fits into 51% of A100 80GB (40.8GB) 41559MiB

 Special thanks to [George Sung](https://huggingface.co/georgesung) for creating [llama2_7b_chat_uncensored](https://huggingface.co/georgesung/llama2_7b_chat_uncensored), and to [Eric Hartford](https://huggingface.co/ehartford/) for creating [ehartford/wizard_vicuna_70k_unfiltered](https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered)
+The version here is the fp32 HuggingFace model.
 In 8 bit mode, the model fits into 84% of A100 80GB (67.2GB) 68747MiB
 In 4 bit mode, the model fits into 51% of A100 80GB (40.8GB) 41559MiB