Kotokin/artisticBIG
Viewer
•
Updated
•
8.32M
•
12
NIkita Balakin
Kotokin
AI & ML interests
None yet
Recent Activity
upvoted
a
collection
about 1 month ago
TheDrummer_Valkyrie-49B-v1 - EXL3
liked
a model
3 months ago
Tarek07/Legion-V2.1-LLaMa-70B
reacted
to
csabakecskemeti's
post
with 👍
4 months ago
-UPDATED-
4bit inference is working! The blogpost is updated with code snippet and requirements.txt
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
-UPDATED-
I've played around with an MI100 and ROCm and collected my experience in a blogpost:
https://devquasar.com/uncategorized/all-about-amd-and-rocm/
Unfortunately I've could not make inference or training work with model loaded in 8bit or use BnB, but did everything else and documented my findings.
Organizations
None yet