rdsm/openhands-lm-32b-v0.1-mlx-6bit

The Model rdsm/openhands-lm-32b-v0.1-mlx-6bit was converted to MLX format from all-hands/openhands-lm-32b-v0.1 using mlx-lm version 0.22.2.

Note: Qwen 2.5 0.5b / 1.5b Instruct seems to work fine as draft models.

Downloads last month
11
Safetensors
Model size
7.17B params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for rdsm/openhands-lm-32b-v0.1-mlx-6bit

Base model

Qwen/Qwen2.5-32B
Quantized
(16)
this model