Machine Learning, Neural Network Algorithm, Differential Equations.
backpropagation algorithm on such a deep network incurs a high memory cost to store intermediate values. ResNets are thus frustrating to train on moderate machines. Differential Equations & Euler’s Method The rich connection between ResNets and ODEs is best demonstrated by the equation h(t+1) =