exl2 quant (measurement.json in main branch)
check revisions for quants
SFT on 1/4th the data. More converstional and usable even in SFT stage.
It uses chatML format and must use "<|im_start|>user", "<|im_start|>assistant", and "<|im_start|>system"
No further support will be provided for the use of this model, your milage may vary.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.