Hi Martijn!



 Martijn:

So in general, if one suspects that the data contains a certain relation/function, would you add said function to the input instead of letting the Neural Network try to find it?


I’d go further:  If I suspected that a dataset contained a certain
relation, I would try to model that relation directly, and not use
a neural network.
Things like performing linear regressions and fitting polynomials
with neural networks are nice toy problems to explore how neural
networks and gradient-descent optimization work, but if I were
doing it for real, I would avoid the complication of a neural network,
and just perform the regression or fit the polynomial.
Best.
K. Frank