Hugging Face's logo
NIkita Balakin's picture
25 2 20

NIkita Balakin

Kotokin
paulpierre's profile picture Epiculous's profile picture vfrome's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model 5 days ago
Tarek07/Legion-V2.1-LLaMa-70B
reacted to csabakecskemeti's post with 👍 about 1 month ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
replied to csabakecskemeti's post about 1 month ago
-UPDATED- 4bit inference is working! The blogpost is updated with code snippet and requirements.txt https://devquasar.com/uncategorized/all-about-amd-and-rocm/ -UPDATED- I've played around with an MI100 and ROCm and collected my experience in a blogpost: https://devquasar.com/uncategorized/all-about-amd-and-rocm/ Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
View all activity

Organizations

None yet