Peter Kis's picture

Peter Kis

NePe

·

AI & ML interests

None yet

Recent Activity

updated a model about 15 hours ago

NePe/Qwen3-30B-A3B-GPTQ

published a model about 15 hours ago

NePe/Qwen3-30B-A3B-GPTQ

new activity 1 day ago

JunHowie/Qwen3-30B-A3B-GPTQ-Int4:Slow GPTQ inference

View all activity

Organizations

NePe's activity

New activity in JunHowie/Qwen3-30B-A3B-GPTQ-Int4 1 day ago

Slow GPTQ inference

#2 opened 2 days ago by

New activity in AlphaGaO/Qwen3-30B-A3B-GPTQ 1 day ago

Slow GPTQ inference

#1 opened 2 days ago by

New activity in moonshotai/Moonlight-16B-A3B-Instruct 9 days ago

PEFT finetuning support

#14 opened 9 days ago by

New activity in mistralai/Mistral-Small-3.1-24B-Instruct-2503 about 1 month ago

Can't determine properly which is greater between 9.9 and 9.11

#38 opened about 1 month ago by

New activity in google/gemma-2-27b-it 10 months ago

with load_in_4bit it just generates <pad> tokens

#16 opened 10 months ago by

New activity in rainjay/gemma-2-27b-it-4bit 10 months ago

it just keeps generating <pad> tokens

#1 opened 10 months ago by

New activity in TheBlokeAI/Mixtral-tiny-GPTQ over 1 year ago

Seems like the GPTQ versions are broken

#2 opened over 1 year ago by

What is this model?

#1 opened over 1 year ago by

New activity in TheBloke/Mixtral-8x7B-v0.1-GPTQ over 1 year ago

Build AutoGPTQ from source

#1 opened over 1 year ago by

New activity in open-llm-leaderboard/open_llm_leaderboard over 1 year ago

Impossible to search/filter for 13B GPTQ models.

#293 opened over 1 year ago by

New activity in elinas/alpaca-30b-lora-int4 about 2 years ago

How to do inferance?

#2 opened about 2 years ago by

How to do inferance?

#2 opened about 2 years ago by

How to do inferance?

#2 opened about 2 years ago by