content.raw: Finally here it is: a faster, custom, scalable GRPO trainer for smaller models with < 500M params, can train on 8gb ram cpu,  also supports gpu for sanity sake (includes support for vllm + flash attention). Using smolLM2-135M/360M-instructs as ref & base models. Experience your own “aha” moment 🐳 on 8gb ram.
content.type: text
content.value: Finally here it is: a faster, custom, scalable GRPO trainer for smaller models with < 500M params, can train on 8gb ram cpu,  also supports gpu for sanity sake (includes support for vllm + flash attention). Using smolLM2-135M/360M-instructs as ref & base models. Experience your own “aha” moment 🐳 on 8gb ram.
content.type: new_line
content.raw: Code: 
content.type: text
content.value: Code: 
content.href: https://github.com/Jaykef/ai-algorithms/blob/main/smollm2_360M_135M_grpo_gsm8k.ipynb
content.raw: https://github.com/Jaykef/ai-algorithms/blob/main/smollm2_360M_135M_grpo_gsm8k.ipynb
content.type: link
rawContent: Finally here it is: a faster, custom, scalable GRPO trainer for smaller models with < 500M params, can train on 8gb ram cpu,  also supports gpu for sanity sake (includes support for vllm + flash attention). Using smolLM2-135M/360M-instructs as ref & base models. Experience your own “aha” moment 🐳 on 8gb ram.
  Code: https://github.com/Jaykef/ai-algorithms/blob/main/smollm2_360M_135M_grpo_gsm8k.ipynb
reactions.reaction: 👀
reactions.users: John6666 Jukka-Sun victor bmoir Boqua carlfm01 LeroyDyer Fishtiks dantezxcd
reactions.reaction: 🔥
reactions.users: Quazim0t0 NickyNicky carlfm01 Alfaxad mrs83 Fishtiks mbiswas
reactions.reaction: 👍
reactions.users: krinal Flagpoles00 dantezxcd
reactions.reaction: ❤️
reactions.users: Alfaxad iniversity mbiswas
reactions.reaction: 🧠
reactions.users: Alfaxad Novaciano
commentators._id: 65d883893a52cd9bcd8ab7cf
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65d883893a52cd9bcd8ab7cf/tRsCJlHNZo1D02kBTmfy9.jpeg
commentators.fullname: leroy Samuel Dyer
commentators.name: LeroyDyer
commentators.type: user
commentators._id: 6438a9027de34e8ea7e4b257
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6438a9027de34e8ea7e4b257/vib8QSd1AWMr_bR9ig_xJ.jpeg
commentators.fullname: Jaward Sesay
commentators.name: Jaward
commentators.type: user