Update README.md
Browse files
README.md
CHANGED
@@ -17,9 +17,9 @@ main : 8bpw h8
|
|
17 |
|
18 |
Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset
|
19 |
|
20 |
-
Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-
|
21 |
-
```python convert.py -i models/maywell_PiVoT-0.1-
|
22 |
-
```python convert.py -i models/maywell_PiVoT-0.1-
|
23 |
|
24 |
### below this line is original readme
|
25 |
|
|
|
17 |
|
18 |
Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset
|
19 |
|
20 |
+
Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp -cf PiVoT-0.1-early-8bpw-h8-exl2 -c 0000.parquet -l 4096 -b 8 -hb 8```
|
21 |
+
```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp2 -cf PiVoT-0.1-early-6bpw-h8-exl22 -c 0000.parquet -l 4096 -b 6 -hb 8 -m PiVoT-0.1-early-temp/measurement.json```
|
22 |
+
```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp3 -cf PiVoT-0.1-early-4bpw-h8-exl2 -c 0000.parquet -l 4096 -b 4 -hb 8 -m PiVoT-0.1-early-temp/measurement.json```
|
23 |
|
24 |
### below this line is original readme
|
25 |
|