Machine Learning, Artificial Intelligence, Neural Networks, Data Science, Towards Data Science.
the initialization, convergence is guaranteed (although may be slow). However, in the non-convex regime initialization is much more important. Some parameter initializations can be unstable and may not converge. Neural networks are not well understood to have principled, mathematically nice