irish-quant/01-ai-Yi-1.5-6B-3bit
1B
•
Updated
•
2
Yi-1.5
This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models.
-
-
irish-quant/01-ai-Yi-1.5-6B-2bit
0.9B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-6B-4bit
1B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-6B-8bit
2B • Updated • 1 -
irish-quant/01-ai-Yi-1.5-6B-Chat-4bit
1B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-6B-Chat-2bit
0.9B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-6B-Chat-3bit
1B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-6B-Chat-8bit
2B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-2bit
1B • Updated • 3 -
irish-quant/01-ai-Yi-1.5-9B-3bit
1B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-4bit
2B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-8bit
3B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-Chat-2bit
1B • Updated • 1 -
irish-quant/01-ai-Yi-1.5-9B-Chat-3bit
1B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-Chat-4bit
2B • Updated • 2 -
irish-quant/01-ai-Yi-1.5-9B-Chat-8bit
3B • Updated • 3