Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

261

Full-text search

Active filters: quantization

exxocism/featherless-ai_Qwerky-72B-GGUF

Text Generation • Updated Apr 1 • 2

skatardude10/SnowDrogito-RpR-32B_IQ4-XS

Updated 15 days ago • 491 • 1

DhulipallaGopiChandu/wav2vec2-lora-quantized

Updated Apr 19 • 1

itlwas/Hiber-Multi-10B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Apr 19 • 53 • 1

Uninformed/QwQ-32B-abliterated-exl2-5bpw-h8

Text Generation • Updated Apr 20 • 7

NoorNizar/Llama-3.2-3B-Instruct-WINT8

Text Generation • Updated about 1 month ago • 128

NoorNizar/Meta-Llama-3-8B-Instruct-WFP8

Text Generation • Updated Apr 21 • 72

NoorNizar/Meta-Llama-3-8B-Instruct-WINT8

Text Generation • Updated Apr 21 • 73

btaskel/Illustrious-XL-v2.0-GGUF

Text-to-Image • Updated Apr 21 • 349 • 3

agoor97/onnx-models

Updated 25 days ago

TechyCode/tinyllama-sciq-lora

Text Generation • Updated about 1 month ago

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated 28 days ago • 51

Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit

Updated 29 days ago • 61

NoorNizar/Phi-4-mini-instruct-WINT4

Text Generation • Updated 21 days ago • 24

NoorNizar/Meta-Llama-3-8B-Instruct-WINT4

Text Generation • Updated 21 days ago • 38

NoorNizar/Llama-3.2-3B-Instruct-WINT4

Text Generation • Updated 21 days ago • 27

mengqin1/RedidreamNSFWI1-bnb-4bit

Updated 14 days ago

abdou-u/MNLP_M2_quantized_model

Text Generation • Updated 4 days ago • 9

diffusers/FLUX.1-dev-bnb-4bit

Text-to-Image • Updated 4 days ago • 16

diffusers/FLUX.1-dev-torchao-int8

Text-to-Image • Updated 3 days ago • 22

diffusers/FLUX.1-dev-torchao-fp8

Text-to-Image • Updated 3 days ago • 2