Just included example scripts for aligning models using GSPO (including VLM example) 🙆‍♂️🙆‍♂️
text
Just included example scripts for aligning models using GSPO (including VLM example) 🙆‍♂️🙆‍♂️
new_line
new_line
GSPO is the latest RL alignment algo by @Alibaba_Qwen and it's already supported in the latest TRL v0.20 release.
text
GSPO is the latest RL alignment algo by @Alibaba_Qwen and it's already supported in the latest TRL v0.20 release.
new_line
new_line
Super-easy-to-get-started example scripts below, GO run them!👩‍💻👩‍💻 
text
Super-easy-to-get-started example scripts below, GO run them!👩‍💻👩‍💻 
new_line
new_line
🧑‍🎨 Script: 
text
🧑‍🎨 Script: 
https://github.com/huggingface/trl/blob/main/examples/scripts/gspo.py
https://github.com/huggingface/trl/blob/main/examples/scripts/gspo.py
link
new_line
🦄 VLM script: 
text
🦄 VLM script: 
https://github.com/huggingface/trl/blob/main/examples/scripts/gspo_vlm.py
https://github.com/huggingface/trl/blob/main/examples/scripts/gspo_vlm.py
link
new_line
🧩 More TRL examples: 
text
🧩 More TRL examples: 
https://huggingface.co/docs/trl/main/en/example_overview
https://huggingface.co/docs/trl/main/en/example_overview
link
new_line
🧙‍♂️ GSPO paper: 
text
🧙‍♂️ GSPO paper: 
Group Sequence Policy Optimization (2507.18071)
https://huggingface.co/papers/2507.18071
2507.18071
paper
resource
https://huggingface.co/papers/2507.18071
Just included example scripts for aligning models using GSPO (including VLM example) 🙆‍♂️🙆‍♂️

GSPO is the latest RL alignment algo by @Alibaba_Qwen and it's already supported in the latest TRL v0.20 release.

Super-easy-to-get-started example scripts below, GO run them!👩‍💻👩‍💻 

🧑‍🎨 Script: https://github.com/huggingface/trl/blob/main/examples/scripts/gspo.py
🦄 VLM script: https://github.com/huggingface/trl/blob/main/examples/scripts/gspo_vlm.py
🧩 More TRL examples: https://huggingface.co/docs/trl/main/en/example_overview
🧙‍♂️ GSPO paper: https://huggingface.co/papers/2507.18071
👍
IDODesigns MohammedEltoum alibidaran Hale-Sage John6666