Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

8-bit precision

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

149

Full-text search

Active filters: 8bit

legraphista/datagemma-rag-27b-it-IMat-GGUF

Text Generation • Updated Sep 13, 2024 • 456

legraphista/datagemma-rig-27b-it-IMat-GGUF

Text Generation • Updated Sep 13, 2024 • 101

legraphista/Mistral-Small-Instruct-2409-IMat-GGUF

Text Generation • Updated Sep 18, 2024 • 195

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.11k

legraphista/Qwen2.5-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 238

legraphista/Qwen2.5-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 290

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 95

legraphista/Qwen2.5-14B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 457

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 855

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.24k

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 2.21k

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.75k

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 1.68k

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20, 2024 • 439

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 1.7k

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 2.06k • 1

adriabama06/Llama-3.2-1B-Instruct-GPTQ-8bit-128g

Text Generation • Updated Jan 2 • 14 • 1

sunilrufus/Mistral_Instruct_Nemo_12B_quantized_w8a8

Text Generation • Updated Jan 2 • 5 • 1

trucnhi160703/ft-phi3-4k-8bit

Text Generation • Updated Oct 3, 2024

NaomiBTW/L3-8B-Lunaris-v1-GPTQ

Text Generation • Updated Nov 11, 2024

danlou/relay-v0.1-Mistral-Nemo-2407-8bit

Text Generation • Updated Dec 14, 2024 • 7

John6666/lilly-pixel-v10-sdxl

Text-to-Image • Updated Dec 23, 2024 • 9

vitekkor/T-pro-it-1.0-bnb-8bit

Updated Dec 16, 2024 • 51 • 1

mlx-community/Qwen2.5-7B-Instruct-kowiki-qa-8bit

Text Generation • Updated Dec 20, 2024 • 11

adricohen/mistral-7B-medqa-lora-8bit-v1

Lowkey-Loki/OlympicCoder-7B-mlx-8bit

Updated 22 days ago • 8

Tonic/c4ai-command-a-03-2025-4bit_nf4_double

Text Generation • Updated 21 days ago • 63

Tonic/c4ai-command-a-03-2025-4bit_fp4

Text Generation • Updated 21 days ago • 128

Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double

Text Generation • Updated 21 days ago • 19