The problem I worry about with the neuroscience narrative is that it seems easy to justify everything. As I understand it, we don&#x27;t understand the brain very well, and there&#x27;s lots of different theories.<p>A fair number of neural net papers will make appeals to neuroscience to motivate something. Whenever I read these, I wonder to what extent neuroscience could be cited to argue the opposite.<p>There&#x27;s a lot of ex-neuroscientists in deep learning. Amusingly, my experience has been that they&#x27;re generally the most skeptical of the neuroscience narrative.<p>Of course, some amazing researchers seem to really like the neuroscience narrative -- this is obviously a strong point in its favor. I don&#x27;t mean to dismiss it. I just think that one wants to be kind of careful when using it as a vantage for thinking.