Update README.md
Browse files
README.md
CHANGED
|
@@ -189,7 +189,7 @@ auto-round --model "OPEA/QwQ-32B-int4-AutoRound-awq-asym" --eval --eval_bs 16 -
|
|
| 189 |
|
| 190 |
### Generate the model
|
| 191 |
|
| 192 |
-
Here is a sample command to generate the model. We found that this model is prone to overflow with int4 kernel. Please use the following command:
|
| 193 |
|
| 194 |
```bash
|
| 195 |
auto-round \
|
|
|
|
| 189 |
|
| 190 |
### Generate the model
|
| 191 |
|
| 192 |
+
Here is a sample command to generate the model. We found that this model is prone to overflow with int4 fp16 kernel. Please use the following command:
|
| 193 |
|
| 194 |
```bash
|
| 195 |
auto-round \
|