cicdatopea's picture

cicdatopea

cicdatopea

·

cicdatopea

AI & ML interests

None yet

Recent Activity

updated a model 4 minutes ago

OPEA/Molmo-7B-D-0924-int4-sym-inc

updated a model 4 minutes ago

OPEA/cogvlm2-llama3-chat-19B-qvision-int4-sym-inc

updated a model 5 minutes ago

OPEA/cogvlm2-llama3-chat-19B-int4-sym-inc

View all activity

Organizations

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 8 days ago

ImportError

#5 opened 8 days ago by

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 9 days ago

How did you use auto-round to quantize?

#4 opened 13 days ago by

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 2 months ago

params.json missing?

#2 opened 2 months ago by

New activity in OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc 2 months ago

Unknown quantization type:

#1 opened 2 months ago by

New activity in OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 3 months ago

Improve language tag

#2 opened 3 months ago by

New activity in OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in OPEA/Qwen2.5-14B-Instruct-int4-sym-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 3 months ago

Improve language tag

#1 opened 3 months ago by

New activity in huggingface/documentation-images 3 months ago

auto-round

#481 opened 3 months ago by

New activity in OPEA/gemma-3-27b-it-int4-AutoRound 3 months ago

so consider build a model for GPU?

#1 opened 4 months ago by

New activity in OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 3 months ago

Update config.json

#1 opened 3 months ago by

New activity in OPEA/QwQ-32B-int4-AutoRound-awq-asym 3 months ago

它是否正常工作,或是我的情况是否正常

#1 opened 3 months ago by

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 3 months ago

Chat Template needs fixed

#1 opened 3 months ago by

New activity in OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 3 months ago

Qwen2.5-VL-72B-Instruct quant?

#1 opened 4 months ago by

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc 3 months ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened 5 months ago by

New activity in OPEA/DeepSeek-R1-int2-gptq-sym-inc 4 months ago

Could we get a int3 version of gptq please?

#1 opened 4 months ago by

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 4 months ago

Qwen-32B overflow issue

#1 opened 4 months ago by