Machine Learning, Neural Networks, Optimization, Mathematics.
Gradient descent for this problem would follow a characteristic zig-zag path: There’s a quantity that measures how hard such a problem is for gradient descent — “condition number.” It is the ratio of largest diameter to smallest diameter and it is 10 for the problem above. The number of steps