Machine Learning, Software Development, Artificial Intelligence, Technology, Data Science.
training step slower look better when you only report step count, but not when you look at wall time. You also have to make sure you compare results at the end of training when the learning rate is fully decayed, as opposed to comparing partially-trained models to fully-trained ones. I just wanna 💯