4-bit quantization
#1
by
msmilauer
- opened
Hi, is this model available in 4-bit quantization?
Is this model suitable for multi-turn discussion?
Sorry for the noob questions.
Yes, linked in the README :)
Hi, is this model available in 4-bit quantization?
Is this model suitable for multi-turn discussion?
Sorry for the noob questions.
Yes, linked in the README :)