NIkita Balakin's picture

NIkita Balakin

Kotokin

·

AI & ML interests

None yet

Recent Activity

liked a model about 1 month ago

Tarek07/Legion-V2.1-LLaMa-70B

reacted to csabakecskemeti's post with 👍 about 2 months ago

-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.

replied to csabakecskemeti's post about 2 months ago

-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.

View all activity

Organizations

None yet

Kotokin's activity

New activity in ArliAI/Llama-3.1-70B-ArliAI-RPMax-v1.3 5 months ago

The question of training the model.

#2 opened 5 months ago by

New activity in MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.0bpw-h6-exl2 5 months ago

Request for a 3.5 bpw

#1 opened 5 months ago by

New activity in mistralai/Mistral-Large-Instruct-2411 5 months ago

Where config.json?

#1 opened 5 months ago by

New activity in sophosympatheia/New-Dawn-Llama-3-70B-32K-v1.0 9 months ago

The question is about the next model.

#8 opened 10 months ago by

New activity in ParasiticRogue/Merged-RP-Stew-V2-34B about 1 year ago

frankenmerge

#4 opened about 1 year ago by

New activity in LoneStriker/M7-7b-8.0bpw-h8-exl2 about 1 year ago

A request for quantization.

#1 opened about 1 year ago by

New activity in NexesQuants/Senku-70b-iMat.GGUF about 1 year ago

A request for quantization.

#1 opened about 1 year ago by

New activity in wolfram/miquliz-120b-v2.0-GGUF about 1 year ago

iMatrix, IQ2_XS & IQ2_XXS

#2 opened about 1 year ago by

New activity in Kooten/MiquMaid-v1-70B-3bpw-exl2 about 1 year ago

More quant?

#1 opened about 1 year ago by

New activity in Kotokin/Mistral-7B-NSFWSTORY-lora about 1 year ago

A problem with this lore

#1 opened about 1 year ago by

New activity in LoneStriker/Air-Striker-Mixtral-8x7B-Instruct-ZLoss-AWQ about 1 year ago

Request for quantization

#1 opened over 1 year ago by

New activity in AzureBlack/airoboros-l2-70b-2.2.1-5bpw-6h-exl2 over 1 year ago

Can you please create a 3 bit?

#1 opened over 1 year ago by

New activity in Undi95/MLewd-L2-13B-v2-1 over 1 year ago

GPTQ Please?

#1 opened over 1 year ago by

GPTQ Please?

#1 opened over 1 year ago by