Machine Learning, Neural Networks, Statistics, Data Science, AI.
depends on (at least) the depth of the network and the activation functions used. We also know that with at least one hidden layer followed by an activation layer using a “squashing”¹ function, this space is very large, and that it grows exponentially with the depth of the network (see the