Machine Learning, AI, Autonomous Driving.
to 32X, and the training data from 1X to 7X. For a fair comparison, we trained all models with Nvidia 40GB A100 GPUs with the same optimizer and configuration. The training time varied from 1 day to 14 days. Model Performance Scaling Laws Fig. 1 shows the evaluation loss scaling law w.r.t. model