Can you add quant version?
#2
by
fuckfuckyou11
- opened
Any chance to get quants? At least Q8?
The community has created a few versions:
https://huggingface.co/legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Thank you for very useful models - Fin and Med - from your company. Any plans to make them multi-modal, at least to understand pictures?
Yes, our plans include a few more domain-specific models and definitely a multimodal component.