Orpheus-3b-0.1-pretrained in GGUF format.
This model had some problems with the tokenizer, so I removed the last audio token (which doesn't seem to be used here) from the vocabulary to get llama.cpp to stop complaining about token_embd.weight size mismatch. It still seems to work fine.
- Downloads last month
- 110
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Zuellni/orpheus-3b-0.1-pt-GGUF
Base model
meta-llama/Llama-3.2-3B-Instruct
Finetuned
canopylabs/orpheus-3b-0.1-pretrained