Commit
•
1865b32
1
Parent(s):
afce615
add info
Browse files
README.md
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
|
| 2 |
+
|
| 3 |
+
wikitext2 3.650667667388916 (65b 16g)
|
| 4 |
+
|
| 5 |
+
wikitext2 3.610668182373047 (65b 32g)
|
| 6 |
+
|
| 7 |
+
ptb-new 7.829207897186279 (65b 16g)
|
| 8 |
+
|
| 9 |
+
ptb-new 7.71506929397583 (65b 32g)
|
| 10 |
+
|
| 11 |
+
c4-new 5.929086208343506 (65b 16g)
|
| 12 |
+
|
| 13 |
+
c4-new 5.859227657318115 (65b 32g)
|