cicdatopea's picture

cicdatopea

cicdatopea

·

cicdatopea

AI & ML interests

None yet

Recent Activity

updated a model 5 days ago

OPEA/QwQ-32B-Preview-int4-sym-mixed-inc

updated a model 5 days ago

OPEA/OLMo-2-1124-13B-Instruct-int4-sym-inc

updated a model 5 days ago

OPEA/Falcon3-7B-Base-int4-sym-inc

View all activity

Organizations

cicdatopea's activity

New activity in OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc 6 days ago

Improve language tag

#1 opened 7 days ago by

New activity in OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc 6 days ago

Improve language tag

#1 opened 7 days ago by

New activity in OPEA/Qwen2.5-3B-Instruct-int4-sym-inc 6 days ago

Improve language tag

#2 opened 7 days ago by

New activity in OPEA/Qwen2.5-7B-Instruct-int4-sym-inc 7 days ago

Improve language tag

#1 opened 7 days ago by

New activity in OPEA/Qwen2.5-14B-Instruct-int4-sym-inc 7 days ago

Improve language tag

#1 opened 7 days ago by

New activity in OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc 7 days ago

Improve language tag

#1 opened 7 days ago by

New activity in OPEA/Qwen2.5-72B-Instruct-int2-sym-inc 7 days ago

Improve language tag

#1 opened 7 days ago by

New activity in huggingface/documentation-images 10 days ago

auto-round

#481 opened 10 days ago by

New activity in OPEA/gemma-3-27b-it-int4-AutoRound 11 days ago

so consider build a model for GPU?

#1 opened about 2 months ago by

New activity in OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc 11 days ago

Update config.json

#1 opened 11 days ago by

New activity in OPEA/QwQ-32B-int4-AutoRound-awq-asym 14 days ago

它是否正常工作,或是我的情况是否正常

#1 opened 16 days ago by

New activity in OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym 20 days ago

Chat Template needs fixed

#1 opened 24 days ago by

New activity in OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc 28 days ago

Qwen2.5-VL-72B-Instruct quant?

#1 opened about 1 month ago by

New activity in OPEA/DeepSeek-R1-int4-gptq-sym-inc 28 days ago

VLLM 0.7.2 can start the model normally, but there is no output when simulating a request using Curl, it blocks!

#2 opened 3 months ago by

New activity in OPEA/DeepSeek-R1-int2-gptq-sym-inc about 1 month ago

Could we get a int3 version of gptq please?

#1 opened about 1 month ago by

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit about 1 month ago

Qwen-32B overflow issue

#1 opened about 2 months ago by

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit about 1 month ago

how to run this model

#1 opened about 1 month ago by

New activity in deepseek-ai/DeepSeek-V3-0324 about 1 month ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

#19 opened about 1 month ago by

New activity in OPEA/DeepSeek-V3-int4-sym-awq-inc about 1 month ago

without licence

#2 opened about 1 month ago by

New activity in OPEA/DeepSeek-R1-fp8-static-w8a8-inc about 2 months ago

how to inference this model?

#1 opened about 2 months ago by