Models

fbaldassarri/meta-llama_Llama-3.1-8B-auto_gptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 18 • 9

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int8-gs128-asym

Text Generation • 3B • Updated Feb 18 • 10

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 18 • 11

fbaldassarri/tiiuae_Falcon3-7B-Base-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Feb 20 • 8

fbaldassarri/tiiuae_Falcon3-7B-Base-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 20 • 8

fbaldassarri/tiiuae_Falcon3-7B-Instruct-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-7B-Instruct-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-3B-Base-autogptq-int8-gs128-asym

Text Generation • 1B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-3B-Base-autogptq-int8-gs128-sym

Text Generation • 1B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-3B-Instruct-autogptq-int8-gs128-asym

Text Generation • 1B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-3B-Instruct-autogptq-int8-gs128-sym

Text Generation • 1B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-1B-Base-autogptq-int8-gs128-asym

Text Generation • 0.8B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-1B-Base-autogptq-int8-gs128-sym

Text Generation • 0.8B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-1B-Instruct-autogptq-int8-gs128-asym

Text Generation • 0.8B • Updated Feb 20 • 7

fbaldassarri/tiiuae_Falcon3-1B-Instruct-autogptq-int8-gs128-sym

Text Generation • 0.8B • Updated Feb 20 • 7

fbaldassarri/microsoft_phi-4-autogptq-int8-gs128-asym

Text Generation • 5B • Updated Feb 23 • 7

fbaldassarri/microsoft_phi-4-autogptq-int8-gs128-sym

Text Generation • 5B • Updated Feb 23 • 7

fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int8-gs128-asym

Text Generation • 2B • Updated Feb 23 • 6

fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int8-gs128-sym

Text Generation • 2B • Updated Feb 23 • 7

kaitchup/Phi-4-mini-instruct-AutoRoundGPTQ-8bit

Text Generation • 1B • Updated Feb 28 • 97

kaitchup/Phi-4-mini-instruct-AutoRoundGPTQ-4bit

Text Generation • 1B • Updated Feb 28 • 25

kaitchup/Phi-4-mini-instruct-AutoRoundGPTQ-3bit

Text Generation • 0.9B • Updated Feb 28 • 6

kaitchup/Phi-4-mini-instruct-AutoRoundGPTQ-2bit

Text Generation • 0.9B • Updated Feb 28 • 10

fbaldassarri/allenai_OLMo-2-1124-7B-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Feb 28 • 7

fbaldassarri/allenai_OLMo-2-1124-7B-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 28 • 7

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Feb 28 • 7

fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Feb 28 • 7

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autogptq-int8-gs128-asym

Text Generation • 2B • Updated Feb 28 • 7

fbaldassarri/mistralai_Mistral-7B-Instruct-v0.3-autogptq-int8-gs128-sym

Text Generation • 2B • Updated Feb 28 • 7

fbaldassarri/allenai_OLMo-2-1124-13B-Instruct-autogptq-int8-gs128-asym

Text Generation • 4B • Updated Feb 28 • 7