Quantized LLMs with GPTQ - a iproskurina Collection

iproskurina 's Collections

Quantized LLMs with GPTQ

LMs + Topological Data Analysis🌌

LMs for French 🥐

Quantized LLMs with GPTQ

updated 18 days ago

LLMs quantized with GPTQ

iproskurina/Mistral-7B-v0.3-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29 • 27
iproskurina/bloom-7b1-GPTQ-4bit-g128

Text Generation • 3B • Updated Mar 29 • 10 • 2
iproskurina/bloom-1b7-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29 • 13
iproskurina/bloom-3b-GPTQ-4bit-g128

Text Generation • 2B • Updated Mar 29 • 13
iproskurina/bloom-560m-GPTQ-4bit-g128

Text Generation • 0.6B • Updated Mar 29 • 20
iproskurina/bloom-1b1-GPTQ-4bit-g128

Text Generation • 0.9B • Updated Mar 29 • 7
iproskurina/opt-2.7b-GPTQ-4bit-g128

Text Generation • 0.6B • Updated Mar 29 • 6
iproskurina/opt-13b-GPTQ-4bit-g128

Text Generation • 2B • Updated Mar 29 • 11
iproskurina/opt-6.7b-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29 • 30
iproskurina/opt-125m-GPTQ-4bit-g128

Text Generation • Updated Mar 29 • 19
iproskurina/opt-350m-GPTQ-4bit-g128

Text Generation • 0.1B • Updated Mar 29 • 10
iproskurina/opt-1.3b-GPTQ-4bit-g128

Text Generation • 0.4B • Updated Mar 29 • 9
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g128

Text Generation • 2B • Updated Mar 29 • 7
iproskurina/Mistral-7B-v0.3-GPTQ-8bit-g128

Text Generation • 2B • Updated Mar 29 • 124
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g64

Text Generation • 1B • Updated Mar 29 • 7
iproskurina/Mistral-7B-v0.1-GPTQ-8bit-g64

Text Generation • 2B • Updated Mar 29 • 9
iproskurina/Mistral-7B-v0.1-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29 • 6
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g128

Text Generation • 1.0B • Updated Mar 29 • 7
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Sep 29, 2023 • 11.1k • 84
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Dec 11, 2023 • 93.2k • 52
TheBloke/bloomz-176B-GPTQ

Text Generation • Updated Jul 7, 2023 • 13 • 20
TheBloke/BLOOMChat-176B-v1-GPTQ

Text Generation • Updated Jul 7, 2023 • 10 • 31
TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • 2B • Updated Sep 27, 2023 • 5.04k • 365
When Quantization Affects Confidence of Large Language Models?

Paper • 2405.00632 • Published May 1, 2024