Machine Learning, Neural Network Algorithm, Differential Equations.
ordinary ResNet. For example, a ResNet getting ~0.4 test error on MNIST used 0.6 million parameters while an ODENet with the same accuracy used 0.2 million parameters! In the ODENet structure, we propagate the hidden state forward in time using Euler’s method on the ODE defined by f(z, t, 𝛳).