Your statement is true-ish, but not true enough.<p>It is true there are more local minima, but they&#x27;re generally pretty equivalent. In fact, in high dimensions, saddle points are a much bigger problem than local minima. [0] The fact that optimization works on these large, non-convex problems is kind of a marvel, and raises really interesting questions. (mostly &quot;this shouldn&#x27;t work this well unless there&#x27;s some kind of regularity to these problems that makes them nicely behaved&quot;). What this says about evolution I neither know nor care to speculate (above my pay grade).<p>[0] <a href="http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1406.2572" rel="nofollow">http:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1406.2572</a><p>Yes, the backpropaganda can get annoying.