-
-
-
-
-
-
Inference Providers
Active filters:
gptq
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
2B
•
Updated
•
31.7k
•
36
baichuan-inc/Baichuan-M2-32B-GPTQ-Int4
Text Generation
•
6B
•
Updated
•
153
•
3
Qwen/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
•
5B
•
Updated
•
29.1k
•
22
tencent/Hunyuan-7B-Instruct-GPTQ-Int4
Text Generation
•
1B
•
Updated
•
190
•
4
TheBloke/MythoMax-L2-13B-GPTQ
Text Generation
•
2B
•
Updated
•
5.75k
•
212
Qwen/Qwen-7B-Chat-Int4
Text Generation
•
2B
•
Updated
•
1.82k
•
75
TheBloke/EstopianMaid-13B-GPTQ
Text Generation
•
2B
•
Updated
•
36
•
18
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
•
3B
•
Updated
•
1.75k
•
3
Qwen/Qwen3-1.7B-GPTQ-Int8
Text Generation
•
0.7B
•
Updated
•
2.03k
•
3
Qwen/Qwen3-235B-A22B-GPTQ-Int4
Text Generation
•
Updated
•
12.7k
•
21
Hariprasath28/orpheus-3b-8bit-gptq
Text Generation
•
Updated
•
440
•
1
btbtyler09/Qwen3-30B-A3B-Instruct-2507-gptq-4bit
Text Generation
•
5B
•
Updated
•
1.34k
•
3
jart25/Qwen3-30B-A3B-Thinking-2507-Autoround-Int-4bit-gptq
0.6B
•
Updated
•
21
•
1
QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8
Text Generation
•
8B
•
Updated
•
763
•
1
Dinith132/first_lora
xiangxinai/Xiangxin-Guardrails-Text
Text Classification
•
3B
•
Updated
•
9
•
1
TheBloke/Loyal-Macaroni-Maid-7B-GPTQ
Text Generation
•
1B
•
Updated
•
81
•
13
elinas/alpaca-13b-lora-int4
Text Generation
•
Updated
•
18
•
41
elinas/alpaca-30b-lora-int4
Text Generation
•
Updated
•
17
•
68
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
61
•
40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
23
•
120
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
18
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
17
•
2
elinas/vicuna-13b-4bit
Text Generation
•
Updated
•
21
•
45
TheBloke/koala-7B-GPTQ
Text Generation
•
1B
•
Updated
•
49
•
31
TheBloke/koala-7B-HF
Text Generation
•
Updated
•
2.07k
•
21
TheBloke/koala-13B-HF
Text Generation
•
Updated
•
2.24k
•
41
TheBloke/koala-13B-GPTQ
Text Generation
•
2B
•
Updated
•
21
•
38
TheBloke/galpaca-30B-GPTQ
Text Generation
•
Updated
•
19
•
48
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
18
•
5