| base_model: | |
| - DreadPoor/Irix-12B-Model_Stock | |
| base_model_relation: quantized | |
| tags: | |
| - exl3 | |
| ## Quantized using the default exllamav3 (0.0.4) quantization process. | |
| - Original model: [`DreadPoor/Irix-12B-Model_Stock`](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock) - refer for more details on the model. | |
| - exllamav3: https://github.com/turboderp-org/exllamav3 | |
| --- | |
| EXL3 quants available: | |
| - 4bpw, 5bpw | |
| - Go to "Files and versions", then click on "Main" to choose your quant |