Indeed, the old local maxima problem.  Why doesn&#x27;t evolution get stuck in local maxima; what pushes it out of those valleys and into the mountains?  Why have all our evolution simulations gotten stuck?<p>Luckily machine learning came along and has shown empirically that the solution is to increase the number of dimensions.  Our tiny neural nets of the 90s also got stuck in local maxima.  But when we could finally make huge and deep networks, the problem more or less disappeared.<p>I believe this is the real solution to the local maxima problem in evolution.  Real evolution works with a massive number of parameters, which means exploration of the problem space doesn&#x27;t get stuck in local maxima, just as it doesn&#x27;t in Deep Learning.  When the number of tweakable parameters outstrips the dimensionality of the problem space then there is always some angle pointing up out of the valleys.<p>This is a different, and I think more general way of expressing the typical counterargument which you explained.  &quot;There is always some angle pointing up&quot; is a more general way of saying &quot;just one mutation is usually enough to create a functional prototype&quot;.