Last of all, my tip number 10 is to do preference fine-tuning. This is where you have a data set with chosen, which are better or preferred responses, and rejected, which are the responses to the same prompts but are of lower quality. You might have a set of data like this if you have production data from customers or from a chatbot. You may have some conversational data that you consider of good quality. You may even have corrected or annotated versions of those conversations where you've improved the assistance responses.