Machine Learning, AI, Autonomous Driving.
of parameters D — Training dataset size: number of samples S — Number of training iterations C — Training budget in FLOPs: L(N,D)- Training or eval loss metrics, we assume the loss is a function of N, and D We model the performance scaling as a power law w.r.t. N and D[1] where E,A, B, 𝛼, 𝛽 are