Models

Qwen/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 5.94k • 41

unsloth/Qwen2.5-Coder-3B-Instruct-128K-GGUF

3B • Updated Nov 15, 2024 • 1.23k • 14

Mungert/Arch-Agent-3B-GGUF

Text Generation • 3B • Updated Jun 26 • 447 • 1

QuantFactory/Arch-Function-3B-GGUF

Text Generation • 3B • Updated Jan 5 • 230 • 2

bartowski/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 9, 2024 • 1.16k • 15

lmstudio-community/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 409 • 6

Qwen/Qwen2.5-Coder-3B-Instruct-GPTQ-Int8

Text Generation • 1B • Updated Nov 18, 2024 • 26 • 1

Qwen/Qwen2.5-Coder-3B-Instruct-GPTQ-Int4

Text Generation • 0.7B • Updated Nov 18, 2024 • 904 • 1

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • 1.0B • Updated Nov 18, 2024 • 32k • 4

second-state/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 927

gaianet/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 11, 2024 • 1.06k • 2

mlx-community/Qwen2.5-Coder-3B-Instruct-8bit

Text Generation • 0.9B • Updated Nov 11, 2024 • 17

mlx-community/Qwen2.5-Coder-3B-Instruct-4bit

Text Generation • 0.5B • Updated Nov 11, 2024 • 1.37k • 1

lmstudio-community/Qwen2.5-Coder-3B-Instruct-MLX-4bit

Text Generation • 0.5B • Updated Nov 13, 2024 • 327

lmstudio-community/Qwen2.5-Coder-3B-Instruct-MLX-8bit

Text Generation • 0.9B • Updated Nov 13, 2024 • 196

unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit

Text Generation • 2B • Updated Nov 12, 2024 • 2.79k • 4

mradermacher/Qwen2.5-Coder-3B-Instruct-GGUF

3B • Updated Nov 12, 2024 • 202

unsloth/Qwen2.5-Coder-3B-Instruct-GGUF

3B • Updated Nov 15, 2024 • 221 • 6

mradermacher/Qwen2.5-Coder-3B-Instruct-i1-GGUF

3B • Updated Nov 12, 2024 • 361 • 2

mlc-ai/Qwen2.5-Coder-3B-Instruct-q4f32_1-MLC

Updated Nov 13, 2024 • 367

mlc-ai/Qwen2.5-Coder-3B-Instruct-q0f16-MLC

Updated Nov 13, 2024 • 2

mlc-ai/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC

Updated Nov 13, 2024 • 15

prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 13, 2024 • 63 • 5

onnx-community/Qwen2.5-Coder-3B-Instruct

Text Generation • Updated Nov 13, 2024 • 14 • 7

danielhanchen/Qwen2.5-Coder-3B-Instruct-Q2_K-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 5

Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_S-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 11

Triangle104/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Nov 20, 2024 • 11

Triangle104/Qwen2.5-Coder-3B-Instruct-Q5_K_S-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 14

Triangle104/Qwen2.5-Coder-3B-Instruct-Q5_K_M-GGUF

Text Generation • 3B • Updated Nov 19, 2024 • 5

Triangle104/Qwen2.5-Coder-3B-Instruct-Q6_K-GGUF

Text Generation • 3B • Updated Jan 10 • 7