Hugging Face's logo
NIkita Balakin's picture
25 2 20

NIkita Balakin

Kotokin
oversizedhauler's profile picture jokemodel1710's profile picture 000ELYSIAN000's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model about 1 month ago
Tarek07/Legion-V2.1-LLaMa-70B
reacted to csabakecskemeti's post with 👍 about 2 months ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
replied to csabakecskemeti's post about 2 months ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
View all activity

Organizations

None yet