content.raw: small but mighty 🔥
content.type: text
content.value: small but mighty 🔥
content.type: new_line
content.raw: you can fine-tune SmolVLM on an L4 with batch size of 4 and it will only take 16.4 GB VRAM 🫰🏻 also with gradient accumulation simulated batch size is 16 ✨
content.type: text
content.value: you can fine-tune SmolVLM on an L4 with batch size of 4 and it will only take 16.4 GB VRAM 🫰🏻 also with gradient accumulation simulated batch size is 16 ✨
content.type: new_line
content.raw: I made a notebook that includes all the goodies: QLoRA, gradient accumulation, gradient checkpointing with explanations on how they work 💝 
content.type: text
content.value: I made a notebook that includes all the goodies: QLoRA, gradient accumulation, gradient checkpointing with explanations on how they work 💝 
content.href: https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
content.raw: https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
content.type: link
rawContent: small but mighty 🔥
  you can fine-tune SmolVLM on an L4 with batch size of 4 and it will only take 16.4 GB VRAM 🫰🏻 also with gradient accumulation simulated batch size is 16 ✨
  I made a notebook that includes all the goodies: QLoRA, gradient accumulation, gradient checkpointing with explanations on how they work 💝 https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
reactions.reaction: 😎
reactions.users: ariG23498 AtAndDev John6666 sergiopaniego Taylor658 linoyts BrigitteTousi Glider95 xi0v ivelin
reactions.reaction: 🔥
reactions.users: ariG23498 AtAndDev BrigitteTousi theprint adarksky xi0v tbkhori nara-simba
reactions.reaction: 🚀
reactions.users: ariG23498 AtAndDev sergiopaniego BrigitteTousi mkurman byoussef xi0v aidystark