Example
Find an optimizer for a ResNet on ImageNet dataset.
Optimizer: {Adam, SGD}; Learning rate: [10−6, 0.1].
2-layer ResNet with SGD optimizer using LR 10−3.
SGD with lr 0.024 achieves 76.2% accuracy for
ResNet on ImageNet.

yield better ﬁnal result.
Table 1: Terminologies used throughout this paper.
MLCopilot- Unleashing the Power of Large Language Models in Solving Machine Learning Tasks