Dustin
commited on
Commit
·
8018735
1
Parent(s):
dbaf742
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,4 +11,4 @@ Trained with residual dropout 0.1
|
|
| 11 |
|
| 12 |
This is the dvruette_llama-13b-pretrained-dropout model quantized to int4, groupsize 128.
|
| 13 |
|
| 14 |
-
Run in
|
|
|
|
| 11 |
|
| 12 |
This is the dvruette_llama-13b-pretrained-dropout model quantized to int4, groupsize 128.
|
| 13 |
|
| 14 |
+
Run in text-generation-webui with --wbits 4 and --groupsize 128.
|