Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

Edit Models filters

Apps
Backyard AI
Jan
Jellybox
llama.cpp
LM Studio
LocalAI
MLX LM
Msty
node-llama-cpp
Ollama
RecurseChat
Sanctum
TGI
vLLM

Apps with no match

Draw Things
DiffusionBee
Invoke
JoyFusion
Inference Providers

Inference Providers with no match

Fireworks
Novita
Nebius AI
Together AI
Cerebras
Featherless AI
Nscale
fal
Hyperbolic
SambaNova
Groq
Replicate
Cohere
HF Inference API
Misc
4bit
4-bit precision
Inference Endpoints
text-generation-inference
custom_code
8-bit precision
Eval Results
Mixture of Experts
Merge

Misc with no match

text-embeddings-inference
Carbon Emissions

Models

276
Full-text search
Active filters: 4bit

tarun7r/sarvam-m-bnb-4bit

Text Generation • 13B • Updated 19 days ago • 45 • 1

ayureasehealthcare/ayurezeastraai

Text Generation • Updated 14 days ago

Renugadevi82/cisco-nx-ai-4bit

1B • Updated 12 days ago • 3

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 1B • Updated 10 days ago • 66

btbtyler09/Kimi-Dev-72B-GPTQ-4bit

Text Generation • 14B • Updated 8 days ago • 317 • 2

riddhimanrana/fastvlm-0.5b-captions

Image-Text-to-Text • 0.1B • Updated 5 days ago • 41
  • Previous
  • 1
  • ...
  • 8
  • 9
  • 10
  • Next
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs