Deep Learning, Optimization, Neural Networks, Convex Optimization, Trends.
image below, that are far from convex. Loss surface of VGG-56 (source) But convex optimization is faster, simpler and less computationally intensive, so it is often easier to “convexify” a problem. However, Neural Network is also known as Differentiable Problems. When it can be differentiable,