Update README.md
Browse files
README.md
CHANGED
|
@@ -19,19 +19,19 @@ Further details (performance, usage, etc.) should refer to GitHub project page:
|
|
| 19 |
|
| 20 |
## Performance
|
| 21 |
|
| 22 |
-
Metric: PPL, lower is better
|
| 23 |
|
| 24 |
| Quant | Size | PPL |
|
| 25 |
| :---: | -------: | ---: |
|
| 26 |
-
| Q2_K | 2.96 GB |
|
| 27 |
-
| Q3_K | 3.74 GB |
|
| 28 |
-
| Q4_0 | 4.34 GB |
|
| 29 |
-
| Q4_K | 4.58 GB |
|
| 30 |
-
| Q5_0 | 5.21 GB |
|
| 31 |
-
| Q5_K | 5.34 GB |
|
| 32 |
-
| Q6_K | 6.14 GB |
|
| 33 |
-
| Q8_0 | 7.95 GB |
|
| 34 |
-
| F16 | 14.97 GB |
|
| 35 |
|
| 36 |
## Others
|
| 37 |
|
|
|
|
| 19 |
|
| 20 |
## Performance
|
| 21 |
|
| 22 |
+
Metric: PPL, **lower is better**
|
| 23 |
|
| 24 |
| Quant | Size | PPL |
|
| 25 |
| :---: | -------: | ---: |
|
| 26 |
+
| Q2_K | 2.96 GB | 17.7212 +/- 0.59814 |
|
| 27 |
+
| Q3_K | 3.74 GB | 8.6303 +/- 0.28481 |
|
| 28 |
+
| Q4_0 | 4.34 GB | 8.2513 +/- 0.27102 |
|
| 29 |
+
| Q4_K | 4.58 GB | 7.8897 +/- 0.25830 |
|
| 30 |
+
| Q5_0 | 5.21 GB | 7.7975 +/- 0.25639 |
|
| 31 |
+
| Q5_K | 5.34 GB | 7.7062 +/- 0.25218 |
|
| 32 |
+
| Q6_K | 6.14 GB | 7.6600 +/- 0.25043 |
|
| 33 |
+
| Q8_0 | 7.95 GB | 7.6512 +/- 0.25064 |
|
| 34 |
+
| F16 | 14.97 GB | 7.6389 +/- 0.25001 |
|
| 35 |
|
| 36 |
## Others
|
| 37 |
|