Hugging Face's logo

s1arsky
/
Irix-12B-Model_Stock-EXL3

exl3
Model card Files
xet
Community
s1arsky commited on
Commit
c34a402
·
verified ·
1 Parent(s): b0910dc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -7
README.md CHANGED
@@ -1,10 +1,17 @@
1
- # s1arsky/Irix-12B-Model_Stock-EXL3
2
- This model was converted to GGUF format from [`DreadPoor/Irix-12B-Model_Stock`](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock) using 3090RTX.
3
- Refer to the [original model card](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock) for more details on the model.
 
 
 
 
 
4
 
5
- EXL3 Quants of [https://huggingface.co/DreadPoor/Irix-12B-Model_Stock](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock)
6
- - exl3, 4bpw
7
- - exl3, 5bpw
8
 
9
- Quants locations:
 
 
 
 
10
  - Go to "Files and versions", then click on "Main" to choose your quant
 
1
+ ---
2
+ license: other
3
+ base_model:
4
+ - DreadPoor/Irix-12B-Model_Stock
5
+ base_model_relation: quantized
6
+ tags:
7
+ - exl3
8
+ ---
9
 
10
+ ## Quantized using the default exllamav3 (0.0.4) quantization process.
 
 
11
 
12
+ - Original model: [`DreadPoor/Irix-12B-Model_Stock`](https://huggingface.co/DreadPoor/Irix-12B-Model_Stock) - refer for more details on the model.
13
+ - exllamav3: https://github.com/turboderp-org/exllamav3
14
+ ---
15
+ EXL3 quants available:
16
+ - 4bpw, 5bpw
17
  - Go to "Files and versions", then click on "Main" to choose your quant