Neko-Institute-of-Science commited on
Commit
de47017
1 Parent(s): 57ca3de

update eval

Browse files
Files changed (1) hide show
  1. README.md +15 -11
README.md CHANGED
@@ -1,13 +1,17 @@
1
  I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
2
 
3
- wikitext2 3.650667667388916 (65b 16g)
4
-
5
- wikitext2 3.610668182373047 (65b 32g)
6
-
7
- ptb-new 7.829207897186279 (65b 16g)
8
-
9
- ptb-new 7.71506929397583 (65b 32g)
10
-
11
- c4-new 5.929086208343506 (65b 16g)
12
-
13
- c4-new 5.859227657318115 (65b 32g)
 
 
 
 
 
1
  I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
2
 
3
+ ```
4
+ 65B
5
+ wikitext2 3.5319948196411133 (stock 16bit)
6
+ wikitext2 3.610668182373047 (32g)
7
+ wikitext2 3.650667667388916 (16g)
8
+ wikitext2 3.6660284996032715 (128)
9
+ ptb-new 7.66942024230957 (stock 16bit)
10
+ ptb-new 7.71506929397583 (32g)
11
+ ptb-new 7.762592792510986 (128)
12
+ ptb-new 7.829207897186279 (16g)
13
+ c4-new 5.8114824295043945 (stock 16bit)
14
+ c4-new 5.859227657318115 (32g)
15
+ c4-new 5.893154144287109 (128)
16
+ c4-new 5.929086208343506 (16g)
17
+ ```