Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Carbon Emissions

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

284

Full-text search

Active filters: ggml

afrideva/Qwen2-0.5B-GGUF

Text Generation • Updated Jun 6 • 155 • 1

afrideva/Qwen2-0.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 158 • 1

afrideva/Qwen2-1.5B-GGUF

Text Generation • Updated Jun 6 • 147

afrideva/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 113 • 2

afrideva/dolphin-2.9.3-qwen2-0.5b-GGUF

Text Generation • Updated Jun 17 • 136 • 1

ytu-ce-cosmos/Turkish-Llama-8b-Instruct-v0.1-GGUF

Updated Aug 14 • 2.01k • 10

ruslanmv/instructLab-granite-7b-lab-text-to-sql

Updated Jul 19 • 90

ruslanmv/instructLab-granite-7b-lab-text-to-sql-4bits

Updated Jul 19 • 15

leafspark/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Jul 24 • 4

leafspark/L3.1-70B-Celeste-v0.1-GGUF

Text Generation • Updated Aug 8 • 34 • 1

hassu619/Llama-2-7b-chat-finetune_UNI-GGML

Question Answering • Updated Aug 20 • 4

leafspark/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated Sep 10 • 1.02k • 28

jhofseth/Reflection-Llama-3.1-70B-GGUF

Text Generation • Updated Sep 13 • 818 • 2

royshilkrot/whisper-medium-korean-ggml

Automatic Speech Recognition • Updated 10 days ago • 17