Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,905

Full-text search

Active filters: gptq

Qwen/Qwen3-235B-A22B-GPTQ-Int4

Text Generation • Updated 1 day ago • 1 • 4

JunHowie/Qwen3-30B-A3B-GPTQ-Int8

Text Generation • Updated 13 days ago • 301 • 2

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • Updated 1 day ago • 19 • 2

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 71 • 40

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 646 • 195

TheBloke/GPT4All-13B-snoozy-GPTQ

Text Generation • Updated Aug 21, 2023 • 159 • 33

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.43k • 320

elinas/chronos-13b-4bit

Text Generation • Updated Jun 23, 2023 • 23 • 23

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 295 • 66

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 367 • 580

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 115 • 87

TheBloke/chronos-hermes-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 154 • 33

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 17.9k • 265

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.34k • 364

TheBloke/llama2_7b_chat_uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 154 • 69

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.36k • 204

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25, 2024 • 2.27k • 91

TheBloke/Baichuan2-13B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 68 • 21

TheBloke/Falcon-180B-GPTQ

Text Generation • Updated Sep 27, 2023 • 61 • 9

TheBloke/airoboros-l2-13B-2.2.1-GPTQ

Text Generation • Updated Sep 27, 2023 • 9 • 2

TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Sep 29, 2023 • 8.31k • 81

TheBloke/deepseek-coder-6.7B-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 281 • 25

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 99 • 112

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 72 • 5

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 13 • 10

thesven/Mistral-7B-Instruct-v0.3-GPTQ

Text Generation • Updated Sep 11, 2024 • 6.15k • 1

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21, 2024 • 277 • 4

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9, 2024 • 301 • 27

shuyuej/Mixtral-8x22B-Instruct-v0.1-GPTQ

Text Generation • Updated Jul 25, 2024 • 34 • 1

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ

Text Generation • Updated Jul 25, 2024 • 790 • 6