Machine Learning, Deep Learning, Molecular Dynamics, Modeling, Modelling.
that they are nonlinear. A simple often used example is the ReLU, which is 0 if its input is negative, and otherwise just passes on the input unchanged. The effect of adding just one of these hidden layers is profound. In a sense, this immediately fixes the problem with the previous model. That is,