Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

intel-autoround

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Misc with no match

Inference Endpoints

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

447

Full-text search

Active filters: intel-autoround

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autogptq-int4-gs128-sym

Text Generation • Updated 10 days ago • 3

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoawq-int4-gs128-asym

Text Generation • Updated 10 days ago • 19

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoawq-int4-gs128-sym

Text Generation • Updated 10 days ago • 1

fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-asym

Text Generation • Updated 5 days ago • 3

fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-sym

Text Generation • Updated 5 days ago • 1

fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-asym

Text Generation • Updated 5 days ago • 1

fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-sym

Text Generation • Updated 5 days ago • 1

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoround-int8-gs128-asym

Text Generation • Updated 5 days ago • 3

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoround-int8-gs128-sym

Text Generation • Updated 5 days ago • 3

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autogptq-int8-gs128-asym

Text Generation • Updated 5 days ago • 3

fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autogptq-int8-gs128-sym

Text Generation • Updated 5 days ago • 3

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs128-asym

Text Generation • Updated about 10 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs128-sym

Text Generation • Updated about 10 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs128-asym

Text Generation • Updated about 10 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs128-sym

Text Generation • Updated about 10 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autoround-int4-gs128-asym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autoround-int4-gs128-sym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int4-gs128-asym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int4-gs128-sym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-asym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-sym

Text Generation • Updated about 9 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs64-asym

Text Generation • Updated about 8 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs64-sym

Text Generation • Updated about 8 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs64-asym

Text Generation • Updated about 8 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs64-sym

Text Generation • Updated about 8 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-asym

Text Generation • Updated about 8 hours ago

fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-sym

Text Generation • Updated about 8 hours ago