#roleplay
GGUF-IQ-Imatrix quants for cgato/L3-TheSpice-8b-v0.1.3.
These quants have been done after the fixes from llama.cpp/pull/6920.
Use KoboldCpp version 1.64 or higher.
Prompt formatting...
Prompt format is relatively simple, author seems to recommend the Default context preset and Instruct Mode - Disabled.
I recommend reading original model card page information.
- Downloads last month
- 51
Hardware compatibility
Log In
to view the estimation
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.