About Quantized Models
#8
pinned
by
infgrad
- opened
Recently, I am too busy to focus on the Quantized Models.
If you have a requirement for the speed, you can try the 400M model
If any one can provide the quantized models, you can send a PR or just create a new model on HF! Thank you for your contribution!
infgrad
pinned discussion