Yann LeCun's comment on AlphaGo and true AI
Preface: AlphaGo is an amazing achievement and does show an interesting advancement in the field.<p>Yet ... it really doesn&#x27;t mean almost anything that people are predicting it to mean. Slashdot went so far as to say that &quot;We know now that we don&#x27;t need any big new breakthroughs to get to true AI&quot;.
The field of ML&#x2F;AI is in a fight where people want more science fiction than scientific reality. Science fiction is sexy, sells well, and doesn&#x27;t require the specifics.<p>Some of the limitations preventing AlphaGo from being general:<p>+ Monte Carlo tree search (MCTS) is really effective at Go but not applicable to many other domains we care about. If your problem is in terms of {state, action} pairs and you&#x27;re able to run simulations to predict outcomes, great, but otherwise, not so much. Go also has the advantage of perfect information (you know the full state of the board) and deterministic simulation (you know with certainty what the state is after action A).<p>+ The neural networks (NN) were bootstrapped by predicting the next moves in more matches than any individual human has ever seen, let alone played. It then played more against itself (cool!) to improve - but it didn&#x27;t learn that from scratch. They&#x27;re aiming to learn this step without the human database but it&#x27;ll still be very different (read: inefficient) compared to the type of learning a human does.<p>+ The hardware requirements were stunning (280 GPUs and 1920 CPUs for the largest variant) and were an integral part to how well AlphaGo performed - yet adding hardware won&#x27;t &quot;solve&quot; most other ML tasks. The computational power primarily helped improve MCTS which roughly equates to &quot;more simulations gets a better solution&quot; (though with NNs to guesstimate an end state instead of having to simulate all the way to an end state themselves)<p>Again, amazing, interesting, stunning, but not an indication we&#x27;ve reached a key AI milestone.<p>For a brilliant overview: <a href="http:&#x2F;&#x2F;www.milesbrundage.com&#x2F;blog-posts&#x2F;alphago-and-ai-progress" rel="nofollow">http:&#x2F;&#x2F;www.milesbrundage.com&#x2F;blog-posts&#x2F;alphago-and-ai-progr...</a><p>John Langford also put his opinion up at: <a href="http:&#x2F;&#x2F;hunch.net&#x2F;?p=3692542" rel="nofollow">http:&#x2F;&#x2F;hunch.net&#x2F;?p=3692542</a><p>(note: copied from my Facebook mini-rant inspired by Langford, LeCun, and discussions with ML colleagues in recent days)