Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
length, reward model predictions, and SentenceBERT KNN distances are pretty predictive. Finetuning LLaMA-7B using samples that their linear model suggests are good seems to do better than using random samples, as evaluated by GPT-3.5 and GPT-4. Another example of machine learning improving machine