SamPO - a jiazhengli Collection

jiazhengli 's Collections

RoleMRC

MCTS with Preference Optimisation

SamPO

AERA

SamPO

updated Oct 14, 2024

Resources for EMNLP 2024 Paper: Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

jiazhengli/Pythia-2.8B-HH-RLHF-Iterative-SamPO

Text Generation • 3B • Updated Jun 17, 2024 • 9
jiazhengli/Pythia-2.8B-TLDR-Iterative-SamPO

Text Generation • 3B • Updated Jun 17, 2024 • 7
Junrulu/Llama-3-8B-Instruct-Iterative-SamPO

Text Generation • 8B • Updated Jun 14, 2024 • 16 • 1
Eliminating Biased Length Reliance of Direct Preference Optimization via Down-Sampled KL Divergence

Paper • 2406.10957 • Published Jun 16, 2024 • 1