Green-Sky
/

euclaise-Memphis-scribe-3B-GGUF-iMatrix

supertrainer2000

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Green-Sky commited on Feb 8

Commit

fbf35f6

•

1 Parent(s): 530637a

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -29,6 +29,7 @@ except for f16 and q8_0, every quant is using the imatrix from wiki-train
 | q8_0          | 9.9474 +/- 0.07022 |
 | q5_k_m        | 10.0347 +/- 0.07091 |
 | q4_k_m        | 10.1192 +/- 0.07152 |
 | q2_k          | 13.0623 +/- 0.09548 |
 | iq2_xs        | 16.6174 +/- 0.11807 |
 | iq2_xxs       | 22.6462 +/- 0.16226 |

 | q8_0          | 9.9474 +/- 0.07022 |
 | q5_k_m        | 10.0347 +/- 0.07091 |
 | q4_k_m        | 10.1192 +/- 0.07152 |
+| iq3_xxs       | 11.5266 +/- 0.08157 |
 | q2_k          | 13.0623 +/- 0.09548 |
 | iq2_xs        | 16.6174 +/- 0.11807 |
 | iq2_xxs       | 22.6462 +/- 0.16226 |