Deriving DPO's Loss
•
15
Haitham Bou Ammar PRO
hba123
AI & ML interests
LLMs, VLMs, Robotics, Reinforcement Learning, Bayesian Optimisation
Recent Activity
reacted
to
their
post
with 🚀
1 day ago
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
posted
an
update
1 day ago
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
commented
a paper
1 day ago
ROS-LLM: A ROS framework for embodied AI with task feedback and
structured reasoning
Articles
Organizations
None yet
hba123's activity
reacted to
their
post with 🚀
1 day ago
Post
919
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
posted
an
update
1 day ago
Post
919
Blindly applying algorithms without understanding the math behind them is not a good idea frmpv. So, I am on a quest to fix this!
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
I wrote my first hugging face article on how you would derive closed-form solutions for KL-regularised reinforcement learning problems - what is used for DPO.
Check it out: https://huggingface.co/blog/hba123/derivingdpo
commented
a
paper
1 day ago
upvoted
an
article
1 day ago
Article
Deriving DPO's Loss
By
•
•
15
commented
a
paper
19 days ago
upvoted
a
paper
about 2 months ago
commented
a
paper
about 2 months ago
authored
2
papers
3 months ago
upvoted
a
paper
4 months ago
commented
a
paper
4 months ago
upvoted
2
papers
5 months ago
commented
a
paper
5 months ago
upvoted
3
collections
5 months ago
upvoted
a
paper
5 months ago
authored
a
paper
6 months ago
upvoted
a
paper
6 months ago