Artificial Intelligence, Machine Learning, Deep Learning, Technology, Google.
example where all four scaling behaviours can be observed and understood: linear, random-feature teacher-student models. Empirically investigate the dependence of the scaling exponent on changes in architecture and data. In essence, the variance-limited regime can be series-expanded in either