omost-dolphin-2.9-llama3-8b-4bits is Omost's llama3-8b model with dolphin-2.9 instruct pretraining in nf4.

Downloads last month
177
Safetensors
Model size
4.65B params
Tensor type
BF16
F32
U8
Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for lllyasviel/omost-dolphin-2.9-llama3-8b-4bits

Quantizations
2 models