If you're using ORPO, you need a column that's called chosen and one called rejected. and you can set your max prompt length. And then the beta, the beta basically weighs how much of the preference fine-tuning, what's the importance of that loss relative to the standard SFT loss. Remember, ORPL does two things in one. It does SFT and it does preference fine-tuning in one. So if you have this at 0.2, it's kind of the importance of the odds ratio is about 0.2 relative to the SFT loss.