Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,571

Full-text search

Active filters: awq

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated about 23 hours ago • 1.64k • 17

cognitivecomputations/DeepSeek-V3-0324-AWQ

Text Generation • Updated 2 days ago • 748 • 8

gaunernst/gemma-3-27b-it-int4-awq

Image-Text-to-Text • Updated 6 days ago • 1.74k • 6

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 2 days ago • 55.2k • 74

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 21 days ago • 195k • 44

Qwen/QwQ-32B-AWQ

Text Generation • Updated 17 days ago • 202k • 102

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • Updated 9 days ago • 1.44k • 14

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • Updated 6 days ago • 621 • 3

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 88.2k • 99

casperhansen/deepseek-r1-distill-qwen-7b-awq

Updated Feb 8 • 9.31k • 7

vital-ai/watt-tool-70B-awq

Updated Jan 24 • 117 • 2

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 9 days ago • 44.4k • 17

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 17 • 60.4k • 26

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 7.71k • 21

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 71 • 1

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 31 • 13

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 57 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 2.64k • 30

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.43k • 38

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • Updated Nov 9, 2023 • 118 • 18

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 105 • 35

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 840 • 72

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 848 • 36

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 375 • 16

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 341 • 9

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 39 • 2

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 27 • 3

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 180 • 1

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • Updated Nov 29, 2023 • 183 • 2