OpenDolphinMaid-4x7b 4bpw

Exllama quant of Undi95/OpenDolphinMaid-4x7b

Other quants:

EXL2: 6bpw, 5bpw, 4bpw

Prompt template: Chatml

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Contact

Kooten on discord

Downloads last month: 5

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.