Im not advocating GP &gt; nn+grad. I&#x27;m just saying nobody knows why nn+grad performs better on practical problems. Also nn+grad methods were essentially complete failures for the first 3-4 decades of their existence (invented in 60s, legit results like Lecun or Hinton in like 90s&#x2F;00s).