dataplayer12
/

Mistral-Small-24B-Instruct-Q4_K_M-GGUF

Model card Files Files and versions Community

Q4_K_M quantization for Mistral-Small-Instruct-2501 model

Downloads last month: -

GGUF

Model size

23.6B params

Architecture

llama

Hardware compatibility

Log In to view the estimation

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for dataplayer12/Mistral-Small-24B-Instruct-Q4_K_M-GGUF

Base model

mistralai/Mistral-Small-24B-Base-2501

Finetuned

mistralai/Mistral-Small-24B-Instruct-2501

Quantized

(117)

this model