Neko-Institute-of-Science
commited on
Commit
·
de47017
1
Parent(s):
57ca3de
update eval
Browse files
README.md
CHANGED
@@ -1,13 +1,17 @@
|
|
1 |
I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
|
2 |
|
3 |
-
|
4 |
-
|
5 |
-
wikitext2 3.
|
6 |
-
|
7 |
-
|
8 |
-
|
9 |
-
ptb-new 7.
|
10 |
-
|
11 |
-
|
12 |
-
|
13 |
-
c4-new 5.
|
|
|
|
|
|
|
|
|
|
1 |
I tried making groupsize 16 but that did not end well so I went with 32g. FYI I can run this with full context on my A6000.
|
2 |
|
3 |
+
```
|
4 |
+
65B
|
5 |
+
wikitext2 3.5319948196411133 (stock 16bit)
|
6 |
+
wikitext2 3.610668182373047 (32g)
|
7 |
+
wikitext2 3.650667667388916 (16g)
|
8 |
+
wikitext2 3.6660284996032715 (128)
|
9 |
+
ptb-new 7.66942024230957 (stock 16bit)
|
10 |
+
ptb-new 7.71506929397583 (32g)
|
11 |
+
ptb-new 7.762592792510986 (128)
|
12 |
+
ptb-new 7.829207897186279 (16g)
|
13 |
+
c4-new 5.8114824295043945 (stock 16bit)
|
14 |
+
c4-new 5.859227657318115 (32g)
|
15 |
+
c4-new 5.893154144287109 (128)
|
16 |
+
c4-new 5.929086208343506 (16g)
|
17 |
+
```
|