Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,589

Full-text search

Active filters: awq

TheBloke/CodeLlama-70B-Instruct-AWQ

Text Generation • Updated Jan 30 • 96 • 13

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 789 • 21

wasertech/assistant-dolphin-2.2.1-mistral-7b-e1-awq

Text Generation • Updated 12 days ago • 11 • 2

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Apr 16 • 367 • 12

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 16.3k • 66

solidrust/Einstein-v6.1-Llama3-8B-AWQ

Text Generation • Updated Sep 3 • 15 • 4

NexaAIDev/Octopus-v2-gguf-awq

Text Generation • Updated Jun 23 • 1.41k • 7

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 2 • 1

hdadlani/Llama-3-128k-70B-Instruct-awq

Text Generation • Updated May 29 • 16 • 1

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26 • 1.97k • 3

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27 • 13 • 1

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4 • 202 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 3.98k • 37

Ichigo2899/mistralai-Mistral-Nemo-Instruct-2407-AWQ

Text Generation • Updated Jul 18 • 103 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 393k • 60

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 226k • 7

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated 30 days ago • 6.97k • 9

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 620 • 4

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 205 • 3

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • Updated Sep 3 • 127 • 3

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 7 • 6

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 1.1k • 2

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 147 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 170k • 37

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 8.06k • 15

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 504 • 1

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 52 • 3

solidrust/gemma-2-9b-it-AWQ

Text Generation • Updated Sep 3 • 2.08k • 2

solidrust/Hermes-3-Llama-3.1-8B-AWQ

Text Generation • Updated Sep 3 • 532 • 3

solidrust/Llama-3.1-8B-Lexi-Uncensored-V2-AWQ

Text Generation • Updated Sep 3 • 269 • 1