Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,197

Full-text search

Active filters: awq

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 22.8k • 57

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 342k • 77

adamo1139/DeepSeek-R1-0528-AWQ

Text Generation • Updated 23 days ago • 164 • 3

abhishekchohan/Magistral-Small-2506-AWQ

Updated 16 days ago • 380 • 2

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 2.46k • 39

TheBloke/Karen_TheEditor_V2_STRICT_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 35 • 2

MaziyarPanahi/WizardLM-2-8x22B-AWQ

Text Generation • Updated Feb 25 • 37 • 13

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 16.4k • 25

Weni/Llama-Guard-3-8B-AWQ

Updated Aug 16, 2024 • 23.1k • 1

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 2.35k • 26

casperhansen/deepseek-r1-distill-llama-8b-awq

Updated Feb 8 • 2.59k • 3

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated Mar 29 • 3.42k • 83

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 21.2k • 41

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 4.46k • 13

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 8.03k • 25

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated Mar 29 • 3.92k • 22

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated Apr 6 • 54.1k • 49

kishizaki-sci/Llama-4-Scout-17B-16E-Instruct-AWQ

Updated May 4 • 28.6k • 4

Qwen/Qwen3-32B-AWQ

Text Generation • Updated May 21 • 127k • 73

cognitivecomputations/Qwen3-235B-A22B-AWQ

Text Generation • Updated May 4 • 6.11k • 11

cognitivecomputations/DeepSeek-R1-0528-AWQ

Text Generation • Updated 26 days ago • 14.3k • 15

Sinensis/L3.3-Electra-R1-70b-AWQ

Text Generation • Updated 23 days ago • 58 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 17 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 42 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 29 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 13 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 15

casperhansen/opt-125m-awq

Text Generation • Updated Oct 31, 2023 • 1.94k • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 4.47k

Bomml/Llama-2-70B-chat-w4-g128-awq

Text Generation • Updated Sep 16, 2023