Green-Sky
/

euclaise-Memphis-scribe-3B-GGUF-iMatrix

supertrainer2000

Not-For-All-Audiences

Inference Endpoints

Model card Files Files and versions Community

Green-Sky commited on Feb 8

Commit

8a4451f

•

1 Parent(s): a09e84a

Update README.md

Files changed (1) hide show

README.md +4 -1

README.md CHANGED Viewed

@@ -17,6 +17,7 @@ language:
 ---
 llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
 ### ppl (512 wiki.test)
@@ -25,4 +26,6 @@ llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
 | f16(baseline) | 9.9437 +/- 0.07019 |
 | q8_0          | 9.9474 +/- 0.07022 |
 | q5_k_m        | 10.0347 +/- 0.07091 |
-| q4_k_m        | 10.1192 +/- 0.07152 |

 ---
 llama.cpp conversion of https://huggingface.co/euclaise/Memphis-scribe-3B
+except for f16 and q8_0, every quant is using the imatrix from wiki-train
 ### ppl (512 wiki.test)
 | f16(baseline) | 9.9437 +/- 0.07019 |
 | q8_0          | 9.9474 +/- 0.07022 |
 | q5_k_m        | 10.0347 +/- 0.07091 |
+| q4_k_m        | 10.1192 +/- 0.07152 |
+| iq2_xs        | 16.6174 +/- 0.11807 |
+| iq2_xxs       | 22.6462 +/- 0.16226 |