YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
https://github.com/ggerganov/llama.cpp/pull/9141
PR to get long context support for this model in llama.cpp has been merged, so those quants no longer need to be used provided you have a newly compiled llama.cpp build. You can find official long ctx quants here
- Downloads last month
- 49
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.