| license: apache-2.0 | |
| language: | |
| - ja | |
| - en | |
| base_model: | |
| - cyberagent/Mistral-Nemo-Japanese-Instruct-2408 | |
| tags: | |
| - gptq | |
| W4A16 gs128 GPTQ quant w/ [GPTQModel](https://github.com/ModelCloud/GPTQModel) 1.7.2 using [augmxnt/ultra-orca-boros-en-ja-v1](https://huggingface.co/datasets/augmxnt/ultra-orca-boros-en-ja-v1) as calibration set | |