Hugging Face's logo

afrideva
/
LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Text Generation
GGUF
ggml
quantized
q2_k
q3_k_xs
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
Edit model card

NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Quantized GGUF model files for LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3 from NickyNicky

Name Quant method Size
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.fp16.gguf fp16 496.82 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q2_k.gguf q2_k 105.46 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_xs.gguf q3_k_xs 115.32 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_m.gguf q3_k_m 129.03 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q4_k_m.gguf q4_k_m 155.67 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q5_k_m.gguf q5_k_m 179.23 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q6_k.gguf q6_k 204.26 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q8_0.gguf q8_0 264.33 MB

Original Model Card:

Downloads last month
22
GGUF
Model size
248M params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

View +1 file
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Model tree for afrideva/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Base model

NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3
Quantized
this model