Hugging Face's logo

nikravan
/
Marco_o1_q4

Text Generation
Transformers
Safetensors
qwen2
conversational
text-generation-inference
Inference Endpoints
4-bit precision
bitsandbytes
Model card Files Community

Model Card for Macro_o1_q4

This is 4bit quantizedd model of Macro-o1.

Downloads last month
248
Safetensors
Model size
4.45B params
Tensor type
FP16
·
F32
·
U8
·
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Spaces using nikravan/Marco_o1_q4 3