QuantFactory/OpenCoder-8B-Instruct-GGUF
Text Generation
•
Updated
•
125
•
6
Ollama-ready Coding Models
For inference. CPU is enough for both quantization and inference.
-
-
QuantFactory/OpenCoder-8B-Base-GGUF
Text Generation • Updated • 94 • 3 -
bartowski/starcoder2-15b-instruct-GGUF
Text Generation • Updated • 410 • 2 -
QuantFactory/starcoder2-15b-GGUF
Text Generation • Updated • 143 • 2 -
bartowski/starcoder2-15b-instruct-v0.1-GGUF
Text Generation • Updated • 259 • 6 -
QuantFactory/starcoder2-7b-instruct-GGUF
Text Generation • Updated • 122 • 1 -
QuantFactory/starcoder2-7b-GGUF
Text Generation • Updated • 120 • 2 -
QuantFactory/starcoder2-3b-instruct-v0.1-GGUF
Updated • 152 • 1 -
QuantFactory/starcoder2-3b-instruct-GGUF
Text Generation • Updated • 56 • 1 -
QuantFactory/starcoder2-3b-GGUF
Text Generation • Updated • 451 • 3 -
Qwen/Qwen2.5-Coder-32B-Instruct-GGUF
Text Generation • Updated • 63.4k • 117 -
bartowski/Qwen2.5-Coder-32B-GGUF
Text Generation • Updated • 2.07k • 11 -
Qwen/Qwen2.5-Coder-14B-Instruct-GGUF
Text Generation • Updated • 37k • 34 -
mradermacher/Qwen2.5-14B-Coder-Merge-GGUF
Updated • 314 • 1 -
Qwen/Qwen2.5-7B-Instruct-GGUF
Text Generation • Updated • 15.8k • 47 -
QuantFactory/Qwen2.5-Coder-7B-GGUF
Text Generation • Updated • 466 • 2 -
Qwen/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • Updated • 38.9k • 27 -
QuantFactory/Qwen2.5-Coder-1.5B-GGUF
Text Generation • Updated • 304 • 2 -
bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF
Text Generation • Updated • 18.2k • 92 -
QuantFactory/DeepSeek-Coder-V2-Lite-Base-GGUF
Text Generation • Updated • 193 • 1 -
ibm-granite/granite-34b-code-instruct-8k-GGUF
Text Generation • Updated • 40 • 1 -
ibm-granite/granite-34b-code-base-8k-GGUF
Text Generation • Updated • 19 • 3 -
ibm-granite/granite-20b-code-instruct-8k-GGUF
Text Generation • Updated • 47 • 4 -
ibm-granite/granite-20b-code-base-8k-GGUF
Text Generation • Updated • 22 • 4 -
QuantFactory/granite-8b-code-instruct-128k-GGUF
Text Generation • Updated • 173 • 3 -
RichardErkhov/ibm-granite_-_granite-8b-code-base-128k-gguf
Updated • 58 -
ibm-granite/granite-8b-code-instruct-4k-GGUF
Text Generation • Updated • 289 • 10 -
ibm-granite/granite-8b-code-base-4k-GGUF
Text Generation • Updated • 11 • 2 -
mradermacher/granite-3b-code-instruct-128k-GGUF
Updated • 253 -
QuantFactory/granite-3b-code-base-128k-GGUF
Text Generation • Updated • 138 • 2 -
ibm-granite/granite-3b-code-instruct-2k-GGUF
Text Generation • Updated • 80 • 5 -
ibm-granite/granite-3b-code-base-2k-GGUF
Text Generation • Updated • 19 • 2