Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

Misc with no match

Inference Endpoints

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

345

Full-text search

Active filters: auto-round

fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs64-sym

Text Generation • Updated 9 days ago • 5

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int8-gs128-asym

Text Generation • Updated 9 days ago • 7

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int8-gs128-sym

Text Generation • Updated 9 days ago • 4

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs128-asym

Text Generation • Updated 9 days ago • 5

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs128-sym

Text Generation • Updated 9 days ago • 6

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int8-gs64-asym

Text Generation • Updated 6 days ago • 6

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int8-gs64-sym

Text Generation • Updated 6 days ago • 5

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs64-asym

Text Generation • Updated 5 days ago • 4

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int8-gs64-sym

Text Generation • Updated 5 days ago • 5

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoround-int4-gs128-asym

Text Generation • Updated 4 days ago • 4

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoround-int4-gs128-sym

Text Generation • Updated 4 days ago • 4

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autogptq-int4-gs128-asym

Text Generation • Updated 3 days ago • 6

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autogptq-int4-gs128-sym

Text Generation • Updated 2 days ago • 6

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoawq-int4-gs128-asym

Text Generation • Updated 2 days ago • 6

fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoawq-int4-gs128-sym

Text Generation • Updated about 4 hours ago