Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
Backyard AI
DiffusionBee
Draw Things
Invoke
Jan
Jellybox
llama.cpp
LM Studio
LocalAI
MLX LM
Msty
node-llama-cpp
Ollama
RecurseChat
Sanctum
TGI
vLLM
Apps with no match
JoyFusion
Inference Providers
Inference Providers with no match
Fireworks
Novita
Nebius AI
Together AI
Cerebras
Featherless AI
Nscale
fal
Hyperbolic
SambaNova
Groq
Replicate
Cohere
HF Inference API
Misc
Reset Misc
4-bit precision
text-generation-inference
Inference Endpoints
custom_code
8-bit precision
Merge
Eval Results
Mixture of Experts
text-embeddings-inference
Carbon Emissions
Apply filters
Models
36,156
Full-text search
Edit filters
Sort: Trending
Active filters:
4-bit
Clear all
TheBloke/deita-7B-v1.0-sft-GPTQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
36
•
1
TheBloke/deita-7B-v1.0-sft-AWQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
17
•
1
TheBloke/trinity-v1.2-x8-MoE-GPTQ
Text Generation
•
6B
•
Updated
Dec 31, 2023
•
24
•
2
Enno-Ai/Hodeva-qlora-awq-v1
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
14
TheBloke/CarbonVillain-en-10.7B-v4-AWQ
Text Generation
•
2B
•
Updated
Dec 31, 2023
•
17
•
1
TheBloke/Sonya-7B-AWQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
14
•
4
TheBloke/toxicqa-Llama2-13B-AWQ
2B
•
Updated
Dec 31, 2023
•
1
TheBloke/toxicqa-Llama2-7B-AWQ
1B
•
Updated
Dec 31, 2023
•
2
TheBloke/CarbonVillain-en-10.7B-v4-GPTQ
Text Generation
•
2B
•
Updated
Dec 31, 2023
•
17
•
2
TheBloke/dolphin-2.6-mistral-7B-dpo-AWQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
22
•
2
TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ
Text Generation
•
0.3B
•
Updated
Dec 31, 2023
•
2.58k
•
6
TheBloke/dolphin-2.6-mistral-7B-dpo-GPTQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
33
•
9
TheBloke/TinyLlama-1.1B-Chat-v1.0-GPTQ
Text Generation
•
0.3B
•
Updated
Dec 31, 2023
•
32.4k
•
13
TheBloke/Sonya-7B-GPTQ
Text Generation
•
1B
•
Updated
Dec 31, 2023
•
37
•
2
TheBloke/toxicqa-Llama2-13B-GPTQ
2B
•
Updated
Dec 31, 2023
•
6
TheBloke/toxicqa-Llama2-7B-GPTQ
1B
•
Updated
Dec 31, 2023
•
5
unsloth/tinyllama-bnb-4bit
Text Generation
•
0.6B
•
Updated
Sep 3, 2024
•
31.3k
•
11
TheBloke/dolphin-2.7-mixtral-8x7b-GPTQ
Text Generation
•
6B
•
Updated
Jan 1, 2024
•
65
•
19
TheBloke/dolphin-2.7-mixtral-8x7b-AWQ
Text Generation
•
6B
•
Updated
Jan 1, 2024
•
6.62k
•
23
TheBloke/yayi2-30B-llama-GPTQ
Text Generation
•
5B
•
Updated
Jan 1, 2024
•
37
•
2
MasihMoloodian/zephyr-7b-beta-4-bit
Text Generation
•
4B
•
Updated
Jan 1, 2024
•
16
TheBloke/sonya-7B-x8-MoE-GPTQ
Text Generation
•
6B
•
Updated
Jan 1, 2024
•
16
•
2
TheBloke/medicine-LLM-13B-AWQ
Text Generation
•
2B
•
Updated
Jan 1, 2024
•
24
•
6
TheBloke/medicine-LLM-13B-GPTQ
Text Generation
•
2B
•
Updated
Jan 1, 2024
•
62
•
3
NobodyExistsOnTheInternet/GiftedMistralSysmsgTest
Updated
Jan 3, 2024
•
31
TheBloke/Nous-Hermes-2-SOLAR-10.7B-GPTQ
Text Generation
•
2B
•
Updated
Jan 2, 2024
•
21
•
15
TheBloke/Nous-Hermes-2-SOLAR-10.7B-AWQ
Text Generation
•
2B
•
Updated
Jan 2, 2024
•
67
•
10
TheBloke/bagel-34b-v0.2-AWQ
Text Generation
•
5B
•
Updated
Jan 2, 2024
•
175
•
2
TheBloke/bagel-34b-v0.2-GPTQ
Text Generation
•
5B
•
Updated
Jan 2, 2024
•
70
•
2
TheBloke/bagel-dpo-34b-v0.2-GPTQ
Text Generation
•
5B
•
Updated
Jan 2, 2024
•
73
•
2
Previous
1
...
95
96
97
98
99
100
Next