NIkita Balakin's picture

NIkita Balakin

Kotokin

·

AI & ML interests

None yet

Recent Activity

liked a model about 1 month ago

Tarek07/Legion-V2.1-LLaMa-70B

reacted to csabakecskemeti's post with 👍 about 2 months ago

-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.

replied to csabakecskemeti's post about 2 months ago

-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.

View all activity

Organizations

None yet

Kotokin's activity

liked a model about 1 month ago

Tarek07/Legion-V2.1-LLaMa-70B

Text Generation • Updated 12 days ago • 256 • 13

liked a model 4 months ago

Konnect1221/The-Inception-Presets-Methception-LLamaception-Qwenception

Updated Feb 3 • 101

liked a model 5 months ago

MikeRoz/mistralai_Mistral-Large-Instruct-2411-4.0bpw-h6-exl2

Updated Nov 19, 2024 • 3 • 2

liked a model 6 months ago

TheDrummer/Behemoth-123B-v1.1

Updated Oct 26, 2024 • 279 • 23

liked a model 9 months ago

ChenMnZ/Mistral-Large-Instruct-2407-EfficientQAT-w2g64-GPTQ

Updated Aug 6, 2024 • 1 • 25

liked a model 10 months ago

Qwen/Qwen2-72B-Instruct

Text Generation • Updated Oct 8, 2024 • 29k • • 715

liked a model 11 months ago

abacusai/Smaug-Llama-3-70B-Instruct-32K

Text Generation • Updated Aug 6, 2024 • 89 • 21

liked 2 models 12 months ago

Virt-io/SillyTavern-Presets

Updated Sep 25, 2024 • 316

abacusai/Llama-3-Giraffe-70B-Instruct

Text Generation • Updated May 4, 2024 • 15 • 12

liked 2 models about 1 year ago

sophosympatheia/Midnight-Miqu-70B-v1.5

Text Generation • Updated Dec 10, 2024 • 734 • 199

KnutJaegersberg/2-bit-LLMs

Text Generation • Updated Mar 8, 2024 • 1.46k • 90

liked 9 models over 1 year ago

BlinkDL/rwkv-5-world

Text Generation • Updated Apr 3, 2024 • 269

BlinkDL/temp-latest-training-models

Updated 3 days ago • 61

Kotokin/Mistral-7B-NSFWSTORY-lora

Updated Oct 31, 2023 • 42

hrtdind/Mistral-7B-NSFWSTORY-lora-GGUF

Updated Oct 30, 2023 • 87 • 8

LoneStriker/Euryale-1.3-L2-70B-3.0bpw-h6-exl2

Text Generation • Updated Oct 19, 2023 • 2 • 1

LoneStriker/Xwin-LM-70B-V0.1-3.0bpw-h6-exl2

Text Generation • Updated Sep 30, 2023 • 2 • 1

AzureBlack/airoboros-l2-70b-2.2.1-3bpw-6h-exl2

Text Generation • Updated Oct 25, 2023 • 10 • 1

AzureBlack/airoboros-l2-70b-2.2.1-5bpw-6h-exl2

Text Generation • Updated Oct 25, 2023 • 2 • 1

Undi95/MLewd-L2-13B-v2-1

Text Generation • Updated Sep 9, 2023 • 13 • 9