𝗜 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝗮 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝘁𝗼 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗲𝘃𝗲𝗻𝘁𝘀 𝘄𝗶𝘁𝗵 𝗚𝗥𝗣𝗢! 👑 🗓️
text
𝗜 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝗮 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝘁𝗼 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗲𝘃𝗲𝗻𝘁𝘀 𝘄𝗶𝘁𝗵 𝗚𝗥𝗣𝗢! 👑 🗓️
new_line
new_line
✍️ Blog post: 
text
✍️ Blog post: 
https://huggingface.co/blog/anakin87/qwen-scheduler-grpo
https://huggingface.co/blog/anakin87/qwen-scheduler-grpo
link
new_line
new_line
I experimented with GRPO lately.
text
I experimented with GRPO lately.
new_line
new_line
I am fascinated by models learning from prompts and rewards - no example answers needed like in Supervised Fine-Tuning.
text
I am fascinated by models learning from prompts and rewards - no example answers needed like in Supervised Fine-Tuning.
new_line
new_line
After the DeepSeek boom, everyone is trying GRPO with GSM8K or the Countdown Game...
text
After the DeepSeek boom, everyone is trying GRPO with GSM8K or the Countdown Game...
new_line
new_line
I wanted a different challenge, like 𝘁𝗲𝗮𝗰𝗵𝗶𝗻𝗴 𝗮 𝗺𝗼𝗱𝗲𝗹 𝘁𝗼 𝗰𝗿𝗲𝗮𝘁𝗲 𝗮 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗳𝗿𝗼𝗺 𝗮 𝗹𝗶𝘀𝘁 𝗼𝗳 𝗲𝘃𝗲𝗻𝘁𝘀 𝗮𝗻𝗱 𝗽𝗿𝗶𝗼𝗿𝗶𝘁𝗶𝗲𝘀.
text
I wanted a different challenge, like 𝘁𝗲𝗮𝗰𝗵𝗶𝗻𝗴 𝗮 𝗺𝗼𝗱𝗲𝗹 𝘁𝗼 𝗰𝗿𝗲𝗮𝘁𝗲 𝗮 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗳𝗿𝗼𝗺 𝗮 𝗹𝗶𝘀𝘁 𝗼𝗳 𝗲𝘃𝗲𝗻𝘁𝘀 𝗮𝗻𝗱 𝗽𝗿𝗶𝗼𝗿𝗶𝘁𝗶𝗲𝘀.
new_line
new_line
Choosing an original problem forced me to:
text
Choosing an original problem forced me to:
new_line
🤔 Think about the problem setting
text
🤔 Think about the problem setting
new_line
🧬 Generate data 
text
🧬 Generate data 
new_line
🤏 Choose the right base model
text
🤏 Choose the right base model
new_line
🏆 Design reward functions (and experiencing reward hacking) 
text
🏆 Design reward functions (and experiencing reward hacking) 
new_line
🔄 Run multiple rounds of training, hoping that my model would learn something.
text
🔄 Run multiple rounds of training, hoping that my model would learn something.
new_line
new_line
A fun and rewarding 😄 experience.
text
A fun and rewarding 😄 experience.
new_line
new_line
new_line
I learned a lot of things, that I want to share with you. 👇
text
I learned a lot of things, that I want to share with you. 👇
new_line
✍️ Blog post: 
text
✍️ Blog post: 
https://huggingface.co/blog/anakin87/qwen-scheduler-grpo
https://huggingface.co/blog/anakin87/qwen-scheduler-grpo
link
new_line
💻 Code: 
text
💻 Code: 
https://github.com/anakin87/qwen-scheduler-grpo
https://github.com/anakin87/qwen-scheduler-grpo
link
new_line
🤗 Hugging Face collection (dataset and model): 
text
🤗 Hugging Face collection (dataset and model): 
https://huggingface.co/collections/anakin87/qwen-scheduler-grpo-680bcc583e817390525a8837
anakin87/qwen-scheduler-grpo-680bcc583e817390525a8837
collection
resource
https://huggingface.co/collections/anakin87/qwen-scheduler-grpo-680bcc583e817390525a8837
new_line
𝗜 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝗮 𝗟𝗮𝗻𝗴𝘂𝗮𝗴𝗲 𝗠𝗼𝗱𝗲𝗹 𝘁𝗼 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗲𝘃𝗲𝗻𝘁𝘀 𝘄𝗶𝘁𝗵 𝗚𝗥𝗣𝗢! 👑 🗓️

✍️ Blog post: https://huggingface.co/blog/anakin87/qwen-scheduler-grpo

I experimented with GRPO lately.

I am fascinated by models learning from prompts and rewards - no example answers needed like in Supervised Fine-Tuning.

After the DeepSeek boom, everyone is trying GRPO with GSM8K or the Countdown Game...

I wanted a different challenge, like 𝘁𝗲𝗮𝗰𝗵𝗶𝗻𝗴 𝗮 𝗺𝗼𝗱𝗲𝗹 𝘁𝗼 𝗰𝗿𝗲𝗮𝘁𝗲 𝗮 𝘀𝗰𝗵𝗲𝗱𝘂𝗹𝗲 𝗳𝗿𝗼𝗺 𝗮 𝗹𝗶𝘀𝘁 𝗼𝗳 𝗲𝘃𝗲𝗻𝘁𝘀 𝗮𝗻𝗱 𝗽𝗿𝗶𝗼𝗿𝗶𝘁𝗶𝗲𝘀.

Choosing an original problem forced me to:
🤔 Think about the problem setting
🧬 Generate data 
🤏 Choose the right base model
🏆 Design reward functions (and experiencing reward hacking) 
🔄 Run multiple rounds of training, hoping that my model would learn something.

A fun and rewarding 😄 experience.


I learned a lot of things, that I want to share with you. 👇
✍️ Blog post: https://huggingface.co/blog/anakin87/qwen-scheduler-grpo
💻 Code: https://github.com/anakin87/qwen-scheduler-grpo
🤗 Hugging Face collection (dataset and model): https://huggingface.co/collections/anakin87/qwen-scheduler-grpo-680bcc583e817390525a8837

👍
John6666 kristaller486 h34v7 lunarflu stefan-it nellaivijay onekq alielfilali01 mexicanamerican
64cbe492dc4e838857ee42ec
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/Er5cEeXMGurO96VZLCrE_.png
alwadifa
vnrom
user
68021edbd9e5afab54c0d5df
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/kX9Pwgx4dZyJfEdCb3I7g.png
kyatham Karthik
Karthik64
user