Hugging Face's logo
OpenSourceRonin's picture
26 4 7

OpenSourceRonin PRO

OpenSourceRonin
Rexschwert's profile picture John6666's profile picture dark-pen's profile picture
·

AI & ML interests

None yet

Organizations

OpenSourceRonin-Community's profile picture VPTQ-community's profile picture LoongLlama's profile picture VPTQ's profile picture opensourcerelease's profile picture

OpenSourceRonin's activity

New activity in deepseek-ai/DeepSeek-V3-0324 2 months ago

Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

10
#19 opened 2 months ago by
xueshuai
New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft 2 months ago

Use aphrodite-engine to infer this model error

5
#2 opened 3 months ago by
zanepoe
New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256_mp4 3 months ago

Create README.md
#1 opened 3 months ago by
yangwang92
New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256 3 months ago

Create README.md
#1 opened 3 months ago by
yangwang92
New activity in VPTQ-community/deepseek-r1_v8_k_65536_mp4 3 months ago

Create README.md
#1 opened 3 months ago by
yangwang92
New activity in VPTQ-community/deepseek-r1_v_8_k_65536_mixed_mp4 3 months ago

Create README.md
#1 opened 3 months ago by
yangwang92
New activity in VPTQ-community/deepseek-r1_v_8_k_65536 3 months ago

Create README.md
#1 opened 3 months ago by
yangwang92
New activity in VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-32768-woft 3 months ago

not run

4
#1 opened 7 months ago by
sdyy
New activity in opensourcerelease/DeepSeek-V3-bf16 4 months ago

Please do R1

2
#7 opened 4 months ago by
ChuckMcSneed
New activity in OpenSourceRonin/VPTQ_demo 5 months ago

ghg
#1 opened 6 months ago by
hereoncollab
New activity in opensourcerelease/DeepSeek-V3-bf16 5 months ago

Remove quantization from config.json

1
#4 opened 5 months ago by
AdjectiveAllison

Tokenizer config?

2
#2 opened 5 months ago by
OllieCentral

some configs is miss

2
#1 opened 5 months ago by
HeNa111
New activity in deepseek-ai/DeepSeek-V3 5 months ago

Bug in fp8_cast_bf16.py

1
#4 opened 5 months ago by
dzhulgakov
New activity in opensourcerelease/DeepSeek-V3-Base-bf16 5 months ago

Files?

1
#1 opened 5 months ago by
hashedviking
New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft 7 months ago

not run

3
#1 opened 7 months ago by
sdyy
New activity in VPTQ-community/Mistral-Large-Instruct-2407-v16-k65536-65536-woft 7 months ago

How do you use / load these models?

1
#1 opened 7 months ago by
Arya123456
New activity in VPTQ-community/README 8 months ago

Can you start a Space with Qwen2.5 14b?

2
#2 opened 8 months ago by
Regrin
New activity in VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft 8 months ago

V8 vs V16?

1
#1 opened 8 months ago by
AIGUYCONTENT
New activity in VPTQ-community/README 8 months ago

Will this method of quantization appear in Ollama?

7
#1 opened 8 months ago by
Regrin