Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

137

Full-text search

Active filters: torchao

medmekk/Llama-3.2-1B-ao-autoquant-1

Text Generation • Updated Apr 22 • 10

medmekk/Llama-3.2-1B-ao-float8wo-2

Text Generation • Updated Apr 22 • 7

medmekk/Llama-3.2-1B-ao-float8wo-3

Text Generation • Updated Apr 22 • 7

medmekk/Llama-3.2-1B-ao-int8wo-gs256

Text Generation • Updated Apr 22 • 6

medmekk/Llama-3.2-1B-ao-int4wo-gs128

Text Generation • Updated Apr 22 • 7

medmekk/Qwen2.5-0.5B-Instruct-ao-float8wo

Text Generation • Updated Apr 22 • 8

medmekk/Llama-3.2-1B-ao-int4wo-gs256

Text Generation • Updated Apr 22 • 8

mobicham/llama3.1_8b_instruct_torchao_gemlite_4bitgs64

Text Generation • Updated Apr 23 • 13

mobicham/Llama-3.2-3B-Instruct_torchao_gemlite_4bitgs64

Text Generation • Updated about 1 month ago • 28

mobicham/Phi-4-mini-instruct_torchao_gemlite_4bitgs64

Text Generation • Updated about 1 month ago • 23

medmekk/Qwen2.5-VL-7B-Instruct-ao-float8wo

Updated about 1 month ago • 5

medmekk/Qwen2.5-VL-7B-Instruct-ao-int8wo

Updated about 1 month ago • 10

medmekk/Llama-3.1-8B-Instruct-ao-int8wo

Text Generation • Updated about 1 month ago • 8

medmekk/Qwen2.5-VL-7B-Instruct-ao-int8da8w8

Updated about 1 month ago • 6

medmekk/Llama-3.1-8B-Instruct-ao-autoquant

Text Generation • Updated about 1 month ago • 3

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs128

Text Generation • Updated about 1 month ago • 6

medmekk/Llama-3.1-8B-Instruct-ao-float8wo

Text Generation • Updated about 1 month ago • 7

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8

Text Generation • Updated about 1 month ago • 8

medmekk/Llama-3.1-8B-Instruct-ao-int8da8w8

Text Generation • Updated 30 days ago • 6

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8-2

Text Generation • Updated 30 days ago • 6

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs32

Text Generation • Updated 30 days ago • 8

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs16

Text Generation • Updated 30 days ago • 6

Erland/vanilla-340M-4096-model-AO-W4

Text Generation • Updated 3 days ago • 31

irresistiblegrace97/TinyLlama-1.1B-Chat-v1.0-torchao-int4_weight_only-gs_4096

Updated 30 days ago • 5

Erland/softpick-340M-4096-model-AO-W4

Text Generation • Updated 3 days ago • 24

Erland/softpick-340M-4096-model-AO-W4A4

Text Generation • Updated 3 days ago • 24

Erland/vanilla-340M-4096-model-AO-W4A4

Text Generation • Updated 3 days ago • 25

irresistiblegrace97/tinyllama.gguf

Updated 30 days ago • 9

jerryzh168/opt-125m-int4wo

Text Generation • Updated 29 days ago • 104

jerryzh168/opt-125m-int4wo-per-module

Text Generation • Updated 17 days ago • 33