Machine Learning, Artificial Intelligence, Technology, Google Brain, Neural Networks.
optimization process, it is very challenging to describe the gradient-based dynamics of these models during training. A new Google Brain paper shows that characterizing these gradient-based dynamics can be relatively easy while the learning dynamics of wide neural networks are under gradient