cicdatopea's picture

cicdatopea

cicdatopea

·

cicdatopea

AI & ML interests

None yet

Recent Activity

updated a model 3 days ago

OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc

updated a model 3 days ago

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

updated a model 3 days ago

OPEA/SmolVLM-Instruct-int4-sym-inc

View all activity

Organizations

cicdatopea's activity

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 24 days ago

params.json missing?

#2 opened 25 days ago by

New activity in OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc 24 days ago

Unknown quantization type:

#1 opened 24 days ago by

New activity in OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in OPEA/Qwen2.5-3B-Instruct-int4-sym-inc about 1 month ago

Improve language tag

#2 opened about 1 month ago by

New activity in OPEA/Qwen2.5-7B-Instruct-int4-sym-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in OPEA/Qwen2.5-14B-Instruct-int4-sym-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in OPEA/Qwen2.5-72B-Instruct-int2-sym-inc about 1 month ago

Improve language tag

#1 opened about 1 month ago by

New activity in huggingface/documentation-images about 1 month ago

auto-round

#481 opened about 1 month ago by

New activity in OPEA/gemma-3-27b-it-int4-AutoRound about 1 month ago

so consider build a model for GPU?

#1 opened 3 months ago by

New activity in OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc about 2 months ago

Update config.json

#1 opened about 2 months ago by

New activity in OPEA/QwQ-32B-int4-AutoRound-awq-asym about 2 months ago

它是否正常工作,或是我的情况是否正常

#1 opened about 2 months ago by

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym about 2 months ago

Chat Template needs fixed

#1 opened about 2 months ago by

New activity in OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 2 months ago

Qwen2.5-VL-72B-Instruct quant?

#1 opened 2 months ago by

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc 2 months ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened 4 months ago by

New activity in OPEA/DeepSeek-R1-int2-gptq-sym-inc 2 months ago

Could we get a int3 version of gptq please?

#1 opened 2 months ago by

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit 2 months ago

Qwen-32B overflow issue

#1 opened 3 months ago by

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit 2 months ago

how to run this model

#1 opened 2 months ago by

New activity in deepseek-ai/DeepSeek-V3-0324 3 months ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened 3 months ago by