Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

37,005

Full-text search

Active filters: bitsandbytes

fantos/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 20 • 385 • 17

ginipick/QwQ-32B-NF4

Text Generation • Updated Mar 21 • 83 • 21

unsloth/Qwen3-14B-unsloth-bnb-4bit

Text Generation • Updated 14 days ago • 41.7k • 5

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Feb 27 • 106k • 81

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated Jan 13 • 53.9k • 56

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 5 • 172 • 2

unsloth/Qwen3-30B-A3B-bnb-4bit

Updated 11 days ago • 8.32k • 7

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 41 • 30

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 33 • 1

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 58k • 11

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 623 • 5

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 9 • 2

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22, 2024 • 127 • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 603 • 37

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated Feb 28 • 23 • 1

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 89 • 7

mistral-community/Mixtral-8x22B-v0.1-4bit

Text Generation • Updated Apr 10, 2024 • 32 • 55

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 28 • 11

ruslanmv/llama3-8B-medical

Text Generation • Updated May 15, 2024 • 84 • 11

hoang1123/llam3-8b-4bit-unsloth

Text Generation • Updated Apr 25, 2024 • 53 • 1

Ostixe360/Qwen-Audio-nf4

Text Generation • Updated Apr 25, 2024 • 137 • 1

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 12 • 3

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 194 • 26

totally-not-an-llm/babelfish-1.1b-v0.1-qlora

Updated Apr 30, 2024 • 1 • 1

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3, 2024 • 19 • 9

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 29.1k • 75

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.8k • 6

nassersala/axolotl-olama3b-gpt4-cleaned

Updated May 24, 2024 • 6 • 1

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 1.23k • 21

lllyasviel/omost-dolphin-2.9-llama3-8b-4bits

Text Generation • Updated May 29, 2024 • 120 • 6