It seems that the local minima aren&#x27;t actually a problem in these high dimensional spaces because most of them are either very close to the global minima or are saddle points, which can be escaped. There was a lot of work on this out of Bengio&#x27;s lab. One such paper was Dauphin&#x27;s &quot;Identifying and attacking the saddle point...&quot;