Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
these features to predict the eval loss (observed by finetuning using random subsets of samples), and then Take samples with features that correlate with lower loss. Here are the features they extracted, the datasets they pulled samples from, and the learned coefficients for the features. Text