#roleplay
GGUF-IQ-Imatrix quants for cgato/L3-TheSpice-8b-v0.1.3.
These quants have been done after the fixes from llama.cpp/pull/6920.
Use KoboldCpp version 1.64 or higher.
Prompt formatting...
Prompt format is relatively simple, author seems to recommend the Default context preset and Instruct Mode - Disabled.
I recommend reading original model card page information.
- Downloads last month
- 148
Hardware compatibility
Log In
to view the estimation
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support