Machine Learning, Scientific Method, Numerical Methods, Numerical Analysis, Neural Networks.
X(u); the difference is that the input of the neural network is u instead of x. It is convenient to compute X′(u) with automatic differentiation. If we had used piecewise linear functions, it is only possible to compute the gradients in the weak sense; but this is not a problem for neural networks