Hugging Face's logo

Monero
/
Pygmalion-Metharme-7b-4bit-TopScore

Text Generation
Transformers
English
llama
text generation
instruct
Model card Files Community
4
Monero commited on
Commit
f4610d5
·
1 Parent(s): 4609ffc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +94 -56
README.md CHANGED
@@ -94,59 +94,97 @@ As such, it was **not** fine-tuned to be safe and harmless: the base model _and_
94
 
95
  <strong>C4-New</strong>: 7.906069755554199
96
  <hr>
97
- <p><strong><font size="4">4 Bit --True-Sequential --Groupsize 32</font></strong></p>
98
- <strong>Wikitext2</strong>: 6.424218654632568
99
-
100
- <strong>Ptb-New</strong>: 48.48588943481445
101
-
102
- <strong>C4-New</strong>: 8.089512825012207
103
- <hr>
104
- <p><strong><font size="4">4 Bit --Groupsize 32</font></strong></p>
105
- <strong>Wikitext2</strong>: 6.902080535888672
106
-
107
- <strong>Ptb-New</strong>: 50.237754821777344
108
-
109
- <strong>C4-New</strong>: 8.081602096557617
110
- <hr>
111
- <p><strong><font size="4">4 Bit --Groupsize 128</font></strong></p>
112
- <strong>Wikitext2</strong>: 10.206376075744629
113
-
114
- <strong>Ptb-New</strong>: 49.00401306152344
115
-
116
- <strong>C4-New</strong>: 8.198845863342285
117
- <hr>
118
- <p><strong><font size="4">4 Bit --True-Sequential --Groupsize 128</font></strong></p>
119
- <strong>Wikitext2</strong>: 9.475017547607422
120
-
121
- <strong>Ptb-New</strong>: 52.358829498291016
122
-
123
- <strong>C4-New</strong>: 8.340700149536133
124
- <hr>
125
- <p><strong><font size="4">4 Bit</font></strong></p>
126
- <strong>Wikitext2</strong>: 6.997134685516357
127
-
128
- <strong>Ptb-New</strong>: 58.87525177001953
129
-
130
- <strong>C4-New</strong>: 8.824191093444824
131
- <hr>
132
- <p><strong><font size="4">4 Bit --True Sequential</font></strong></p>
133
- <strong>Wikitext2</strong>: 7.735969543457031
134
-
135
- <strong>Ptb-New</strong>: 62.92238235473633
136
-
137
- <strong>C4-New</strong>: 8.913650512695312
138
- <hr>
139
- <p><strong><font size="4">4 Bit --act-order --groupsize 32</font></strong></p>
140
- <strong>Wikitext2</strong>: 275425.5
141
-
142
- <strong>Ptb-New</strong>: 267733.25
143
-
144
- <strong>C4-New</strong>: 254506.71875
145
- <hr>
146
- <p><strong><font size="4">4 Bit --act-order --groupsize 32</font></strong></p>
147
- <strong>Wikitext2</strong>: 251321.265625
148
-
149
- <strong>Ptb-New</strong>: 250117.859375
150
-
151
- <strong>C4-New</strong>: 232929.234375
152
- <hr>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
94
 
95
  <strong>C4-New</strong>: 7.906069755554199
96
  <hr>
97
+ <!DOCTYPE html>
98
+ <html>
99
+ <head>
100
+ <title>HTML Table Generator</title>
101
+ <style>
102
+ table {
103
+ border:1px solid #b3adad;
104
+ border-collapse:collapse;
105
+ padding:5px;
106
+ }
107
+ table th {
108
+ border:1px solid #b3adad;
109
+ padding:5px;
110
+ background: #f0f0f0;
111
+ color: #313030;
112
+ }
113
+ table td {
114
+ border:1px solid #b3adad;
115
+ text-align:center;
116
+ padding:5px;
117
+ background: #ffffff;
118
+ color: #313030;
119
+ }
120
+ </style>
121
+ </head>
122
+ <body>
123
+ <table>
124
+ <thead>
125
+ <tr>
126
+ <th>GPTQ Variation:</th>
127
+ <th>Wikitext2</th>
128
+ <th>Ptb-New</th>
129
+ <th>C4-New</th>
130
+ </tr>
131
+ </thead>
132
+ <tbody>
133
+ <tr>
134
+ <td>nothing</td>
135
+ <td>6.997134685516357&nbsp;</td>
136
+ <td>&nbsp;58.87525177001953</td>
137
+ <td>&nbsp;8.824191093444824</td>
138
+ </tr>
139
+ <tr>
140
+ <td>--act-order</td>
141
+ <td>6.281311511993408&nbsp;</td>
142
+ <td>46.79158401489258&nbsp;</td>
143
+ <td>7.906069755554199&nbsp;</td>
144
+ </tr>
145
+ <tr>
146
+ <td>--groupsize 32</td>
147
+ <td>6.902080535888672&nbsp;</td>
148
+ <td>50.237754821777344&nbsp;</td>
149
+ <td>8.081602096557617&nbsp;</td>
150
+ </tr>
151
+ <tr>
152
+ <td>--groupsize 128</td>
153
+ <td>&nbsp;10.206376075744629</td>
154
+ <td>49.00401306152344&nbsp;</td>
155
+ <td>&nbsp;8.198845863342285</td>
156
+ </tr>
157
+ <tr>
158
+ <td>&nbsp;--true-sequential</td>
159
+ <td>7.735969543457031&nbsp;</td>
160
+ <td>62.92238235473633&nbsp;</td>
161
+ <td>&nbsp;8.913650512695312</td>
162
+ </tr>
163
+ <tr>
164
+ <td>--true-sequential --groupsize 32</td>
165
+ <td>&nbsp;6.424218654632568</td>
166
+ <td>&nbsp;48.48588943481445</td>
167
+ <td>&nbsp;8.089512825012207</td>
168
+ </tr>
169
+ <tr>
170
+ <td>&nbsp;--true-sequential --groupsize 128</td>
171
+ <td>&nbsp;9.475017547607422</td>
172
+ <td>&nbsp;52.358829498291016</td>
173
+ <td>&nbsp;8.340700149536133</td>
174
+ </tr>
175
+ <tr>
176
+ <td>&nbsp;--act-order --groupsize 32</td>
177
+ <td>&nbsp;275425.5</td>
178
+ <td>267733.25&nbsp;</td>
179
+ <td>&nbsp;254506.71875</td>
180
+ </tr>
181
+ <tr>
182
+ <td>&nbsp;--act-order --groupsize 128</td>
183
+ <td>&nbsp;251321.265625</td>
184
+ <td>&nbsp;250117.859375</td>
185
+ <td>&nbsp;232929.234375</td>
186
+ </tr>
187
+ </tbody>
188
+ </table>
189
+ </body>
190
+ </html>