Hugging Face's logo

harmtech
/
Stheno-1.10-L2-13B-GPTQ

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Inference Endpoints
4-bit precision
Model card Files Community
1
harmtech commited on
Commit
cf09ee5
•
1 Parent(s): c93c8d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -7
README.md CHANGED
@@ -3,17 +3,15 @@ license: llama2
3
  language:
4
  - en
5
  ---
6
- ### Daddy Dave's stamp of approval 👍
7
 
8
- 4-bit GPTQ quants of the 1.10 version of [Sao10K](https://huggingface.co/Sao10K)'s fantastic [Stheno (collection link)](https://huggingface.co/collections/Sao10K/stheno-6536a20823c9d18c09288fb1) model.
9
 
10
- The main branch contains 4-bit groupsize of 128 and no act order.
11
 
12
- The other branches contain groupsizes of 128, 64, and 32 with act order.
13
 
14
- Original card below!
15
-
16
- ***
17
 
18
  My GGUF Quants: https://huggingface.co/Sao10K/Stheno-1.10-L2-13B-GGUF
19
 
 
3
  language:
4
  - en
5
  ---
6
+ # Daddy Dave's stamp of approval 👍
7
 
8
+ 4-bit GPTQ quants of the writer version of [Sao10K](https://huggingface.co/Sao10K)'s fantastic [Stheno model (Stheno model collection link)](https://huggingface.co/collections/Sao10K/stheno-6536a20823c9d18c09288fb1) model.
9
 
10
+ The main branch contains 4-bit groupsize of 128 and no act_order.
11
 
12
+ The other branches contain groupsizes of 128, 64, and 32 all with act_order.
13
 
14
+ ## **⬇︎** Original card **⬇︎**
 
 
15
 
16
  My GGUF Quants: https://huggingface.co/Sao10K/Stheno-1.10-L2-13B-GGUF
17