Answers.Body: <p>Page 5 in the paper has your answer:</p>
  
  <blockquote>
    <p>... AlphaZero compensates for the lower number of evaluations by using its deep neural network to costs much more selectively on the most promising variations - arguably a more "human-like" approach to chess ...</p>
  </blockquote>
  
  <p>"selectively" is the key word. What does that mean? Let's use this following position for our example:</p>
  
  <blockquote>
    <p><a href="https://chess24.com/en/read/news/london-classic-5-caruana-shows-how-it-s-done" rel="noreferrer">https://chess24.com/en/read/news/london-classic-5-caruana-shows-how-it-s-done</a></p>
  </blockquote>
  
  <p><a href="https://i.sstatic.net/cABLy.jpg" rel="noreferrer"><img src="https://i.sstatic.net/cABLy.jpg" alt="Moves"></a></p>
  
  <p>This is a recent game won by Caruana in 2017 London Chess Classic. The White bishop is under attacked, and you know you have to move it. But <strong>where?</strong></p>
  
  <p>Possibilities (not losing a piece):</p>
  
  <ul>
  <li>Bh4</li>
  <li>Be3</li>
  <li>Bd2</li>
  <li>Bc1</li>
  </ul>
  
  <p>What was Caruana thinking?</p>
  
  <blockquote>
    <p>I felt like I would lose at some point, but when I saw, 25.Bc1 I suddenly 
    started to get a bit more optimistic about my chances. I realised my 
    position is bad, but at least I had a plan and that was really all I needed 
    for some confidence in this position. When I saw this b3, c4 the position is
    double edged and I have some chances.</p>
  </blockquote>
  
  <p>This is <strong>human thinking</strong>, and a "human move". Caruana <strong>hadn't</strong> considered Bh4, Be3 and Bd2 because they "looked" bad. He had been focusing <strong>only</strong> and <strong>only</strong> on the Bc1 move.</p>
  
  <p>Humans play chess very <strong>selectively</strong>, we discard unreasonable moves because we don't have time to examine all possibilities equally. </p>
  
  <ul>
  <li>We discard Bh4 because it release the tension on the h6 pawn</li>
  <li>We discard Be3 because it blocks the two white rooks on the third rank</li>
  <li>We discard Bd2 because it blocks the White queen to the king side</li>
  </ul>
  
  <p>That's what AlphaZero trying to claim in the paper. They claim their algorithm, although slower than Stockfish, is able to <strong>selectively pick better</strong> moves than Stockfish in the search. While Stockfish is faster, it wastes time on bad moves. AlphaZero is slower, but it's more precise (like what Caruana was doing).</p>
  
  <p>For example, AlphaZero might spent 80% resources on Bc1, and 20% on all other bishop moves. Stockfish might give 25% for each move (Bh4, Be3, Bd2, Bc1).</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T07:21:56.620Z
Answers.Text: Basically, if a line is +0.32 and the other is +0.13, AlphaZero will spend time on the former.
Answers.UserDisplayName: Jossie Calderon
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T07:30:23.657Z
Answers.Text: @JossieCalderon I'm not sure. +0.32 is not probability.
Answers.UserDisplayName: SmallChess
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T07:32:55.673Z
Answers.Text: @SmallChess Yes, you are right. So AlphaZero will spend time on the former.
Answers.UserDisplayName: Jossie Calderon
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T08:58:38.500Z
Answers.Text: Why is H4 not considered a possibility? As far as I can tell, it moves the bishop to safety.
Answers.UserDisplayName: Nzall
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T08:59:38.593Z
Answers.Text: @Nzall Bh4 released the tension on the h6 pawn. I'm not a chess GM. If you have further question on the move, please start a new question.
Answers.UserDisplayName: SmallChess
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T09:49:35.147Z
Answers.Text: @SmallChess oh, right. I misread the list of allowed moves and mistook h4 for f4.
Answers.UserDisplayName: Nzall
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T12:49:13.527Z
Answers.Text: @IAPetrHarasimovic Alpha zero does not use alpha-beta search, that alone makes it more human. It looks not only at the top-best moves, but also at the few weird ones, which are ignored by most alpha-beta engines. It's the old AI dilemma explore x exploit.
Answers.UserDisplayName: Fernando
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T11:37:06.567Z
Answers.Text: So, basically, the play style is not necessarily more human, but the approach to finding what next move to play is. At least according to the paper. Also, I can't edit it, but your Caruana quote has a pretty big typo: "When I saw his b3, c4" should be "When I saw this b3, c4"
Answers.UserDisplayName: Arthur
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T11:51:36.657Z
Answers.Text: @Arthur According to the paper (and only the paper), the play style is not necessarily more human. I'm not saying NO, but nothing in the paper says that.
Answers.UserDisplayName: SmallChess
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T14:21:30.800Z
Answers.Text: Monte Carlo algorithms have a parameter to control explore x exploit, so moves that alpha-beta would never consider (due to time), alpha zero does.
Answers.UserDisplayName: Fernando
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T15:02:33.343Z
Answers.Text: @Fernando Can you explain what you respond to? I struggle to see the point. Also I am confused by 'never consider due to time'. Alpha-beta search disregards branches that are clearly worse than some other already explored branches. I don't see what this has to do with time.
Answers.UserDisplayName: IA Petr Harasimovic
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T03:33:04.427Z
Answers.LastActivityDate: 2017-12-08T11:50:45.367Z
Answers.LastEditDate: 2017-12-08T11:50:45.367Z
Answers.UserDisplayName: SmallChess
Answers.Body: <p>Most strong engines emphasize looking very deeply, at the expense of having a superficial evaluation function. In the AlphaZero paper, they say that Stockfish looks at 70 million positions per second.</p>
  
  <p>Human grandmasters look at very few positions indeed compared to engines, but they have a better feeling who is better in a given position.</p>
  
  <p>AlphaZero looked at only 80,000 positions per second, so it spends much more time in its evaluation function.</p>
  
  <p>That's the sense in which they meant "more human like", nothing more.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T12:03:55.823Z
Answers.LastActivityDate: 2017-12-08T12:03:55.823Z
Answers.UserDisplayName: RemcoGerlich
Answers.Body: <p>AlphaZero already seems to play like a regular "centaur" -> correspodence GM with an engine assistance.</p>
  
  <p>As an FM I'd get much more enjoyment of playing AlphaZero vs a regular engine.</p>
  
  <p>One comparison would be it plays like Karpov would with perfect tactics.  (Game 9 AlphaZero plays a piece down for 15moves which is very Tal like). </p>
  
  <p>It is not just style, AlphaZero gives an impression of understanding positions better than Stockfish.</p>
  
  <p>AlphaZero also does not suffer from Horizon Effect that ALL chess engines had suffered from until now.
  Time and again it is able to correctly evaluate a position more moves down than Stockfish does.</p>
  
  <p>Here's an example:</p>
  
  <pre><code>[FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
  [White "AlphaZero"]
  [Black "Stockfish"]
  [Date "2017.12.05"]
  [Result "1-0"]
  [Event "Alphazero vs Stockfish: AlphaZero - Stockfish"]
  [Site "https://lichess.org/study/EOddRjJ8"]
  [UTCDate "2017.12.06"]
  [UTCTime "05:53:49"]
  [Variant "Standard"]
  [ECO "C11"]
  [Opening "French Defense: Steinitz Variation #2"]
  [Annotator "https://lichess.org/@/Spreek"]
  
  1. d4 e6 2. e4 d5 3. Nc3 Nf6 4. e5 Nfd7 5. f4 c5 6. Nf3 cxd4 7. Nb5 Bb4+ 8. Bd2 Bc5 9. b4 Be7 10. Nbxd4 Nc6 11. c3 a5 12. b5 Nxd4 13. cxd4 Nb6 14. a4 Nc4 15. Bd3 Nxd2 16. Kxd2 Bd7 17. Ke3 b6 18. g4 h5 19. Qg1 hxg4 20. Qxg4 Bf8 21. h4 Qe7 22. Rhc1 g6 23. Rc2 Kd8 24. Rac1 Qe8 25. Rc7 Rc8 26. Rxc8+ Bxc8 27. Rc6 Bb7 28. Rc2 Kd7 29. Ng5 Be7 30. Bxg6 Bxg5 31. Qxg5 fxg6 32. f5 Rg8 33. Qh6 Qf7 34. f6 Kd8 35. Kd2 Kd7 36. Rc1 Kd8 37. Qe3 Qf8 38. Qc3 Qb4 39. Qxb4 axb4 40. Rg1 b3 41. Kc3 Bc8 42. Kxb3 Bd7 43. Kb4 Be8 44. Ra1 Kc7 45. a5 Bd7 46. axb6+ Kxb6 47. Ra6+ Kb7 48. Kc5 Rd8 49. Ra2 Rc8+ 50. Kd6 Be8 51. Ke7 g5 52. hxg5 { 1-0 Black resigns. } 1-0
  </code></pre>
  
  <p>AlphaZero plays the king to center 16. Kxd2! in a middle game correctly judging that Black will not be able to take an advantage of it.</p>
  
  <p>It is able to correctly evaluate a piece sacrifice 30. Bxg6! while regular engines are unable to see that they are lost for a number of moves.</p>
  
  <ol start="32">
  <li>f5 is quite nice too.</li>
  </ol>
  
  <p>There are other examples such as exchange Sacrifice in Game 3.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T12:26:14.720Z
Answers.LastActivityDate: 2017-12-08T12:26:14.720Z
Answers.UserDisplayName: Sint
Answers.Body: <p>It is as easy to jump on a bandwagon saying Alpha-Zero's play is 'more' human than previous computer chess programs as it is to jump on the opposite wagon and say Alpha-Zero's play is entirely 'alien'.  It's not clear that Alpha-zero's play is 'more human' especially given our human tendency towards anthropomorphism.</p>
  
  <p><strong><em>Chess as a Struggle of the (human) Mind</em></strong></p>
  
  <p>But in chess is this tendency true?  Magnus Carlsen <a href="https://www.quora.com/Why-does-Magnus-Carlsen-think-computers-are-boring-to-play-chess-against" rel="nofollow noreferrer">once spoke</a> about how 'traditional' computers in general lack human creativity saying:</p>
  
  <blockquote>
    <p>"Chess is all about the struggle between human minds. That’s what makes it exciting. Computer chess is mechanical, dry and bland. The moves are very strong, of course, but there is no style. If you try to play against a chess computer, not only will you lose with a very high certainty, but you will also be bored in the process.</p>
  </blockquote>
  
  <p>Magnus Carlsen didn't see evidence of human styles of play in traditional chess computers. So lets examine if Alpha-Zero's recent accomplishment has undone this perspective and moved us towards something more reminiscent of ourselves.</p>
  
  <blockquote>
    <p>If by 'human-like' you mean play 'exhibiting behavior more likely to appeal to our sense of anthropomorphism' does Alpha-zero's style seem more human?  How do we really test this subjective myopic humans like to project upon non-human things?  Lets ask - does the algorithm 'selectively pick better' or exhibit 'more human creative choice' in its style of play?</p>
  </blockquote>
  
  <p>The algorithm's creators indicate that unlike Stockfish which uses an Alpha-Beta search algorithm, Alpha-Zero employs a Monte-Carlo tree search (MCTS) algorithm which accepts as input a weighted parameters θ built up from previous outcomes ~ <a href="https://arxiv.org/pdf/1712.01815.pdf" rel="nofollow noreferrer">Page 3. Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm</a>).</p>
  
  <p>So the algorithm doesn't exhibit choice at all.  It actually engages in a random but probabilistic Monty-carlo search where the possible search paths available to it are increasingly prejudiced by previous outcomes.  Did Alpha-zero choose to optimize its style of play this way or was that the choice of its programmers?</p>
  
  <blockquote>
    <p>Does Alpha-zero always have all possible moves available to it for consideration or are some moves prejudiced algorithmically in a way that mimics experience which can be interpreted by humans anthropomorphically? </p>
  </blockquote>
  
  <p>Initially it had all moves available to it so its 'style' was entirely random.  However as it's search is increasingly and optimally constrained by previous success or failure its style is actually changing towards the mode its programmers have shackled it with.  Is this 'more human' though?  Compare this to Magnus Carlesen who will sometimes <a href="https://www.chess.com/news/view/magnus-carlsen-i-appreciate-creating-something-unique" rel="nofollow noreferrer">choose less optimal moves because they are more creative</a>:</p>
  
  <blockquote>
    <p>Magnus Carlsen: “I appreciate creating something unique”</p>
  </blockquote>
  
  <p><strong><em>Chess as a Struggle of the (alien) Mind</em></strong></p>
  
  <p>Humans can chose the criteria that drives their own style of play (for example I often chose impulse and error in my own style).  Many see Alpha-zero's play in both chess and <a href="https://www.theatlantic.com/technology/archive/2017/10/alphago-zero-the-ai-that-taught-itself-go/543450/" rel="nofollow noreferrer">go</a> as decidedly <a href="http://www.bbc.com/news/technology-41668701" rel="nofollow noreferrer">Alien</a>.  Nick Hynes, a grad student at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) observes:</p>
  
  <blockquote>
    <p>“What we’re seeing here is a model free from human bias and presuppositions: It can learn whatever it determines is optimal, which may indeed be more nuanced that our own conceptions of the same.  It’s like an alien civilization inventing its own mathematics which allows it to do things like time travel...”</p>
  </blockquote>
  
  <p>Likewise GM Peter Heine Nielsen <a href="https://www.chess.com/news/view/google-s-alphazero-destroys-stockfish-in-100-game-match" rel="nofollow noreferrer">told Chess.com</a>:</p>
  
  <blockquote>
    <p>"After reading the paper but especially seeing the games I thought, well, I always wondered how it would be if a superior species landed on earth and showed us how they play chess. I feel now I know."</p>
  </blockquote>
  
  <p>It seems that most react to Alpha-zero's emergent style of play as 'alien play', and not as 'more human'.</p>
  
  <blockquote>
    <p>Therefore there's reason to disagree with the answers above that say 'yes'.</p>
  </blockquote>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T15:12:31.377Z
Answers.Text: Your answer is quite misleading and inaccurate in places. The use of MCTS is not the crucial difference, this is not why it beat Stockfish. They could use alpha-beta search too, they just felt MCTS worked better for them. The main elements of the AlphaZero algorithm are a very deep convolutional neural network, reinforcement learning (i.e. the network is tuned by self-play), and a tree search (which happens to be MCTS but that is not necessary). There is nothing handcrafted in it thus saying " its style is actually changing towards the mode its programmers have shackled it with" is incorrect.
Answers.UserDisplayName: IA Petr Harasimovic
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T23:41:31.790Z
Answers.Text: If you believe my point was that MCTS is the  crucial difference (between Alpha-zero and Stockfish) - you're missing my point.  My point was that humans, not algorithms decided Alpha-zero's play style, decided Alpha-zero's decision.   My point was that these very human choices seem to impart a play style that strikes GMs and amateurs alike as decidedly not human.
Answers.UserDisplayName: user34445
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T23:42:07.610Z
Answers.Text: Dr Eval check out - https://cs.stackexchange.com/questions/68249/qualification-or-disqualification-of-machine-intelligence-test-as-turing-test
Answers.UserDisplayName: user34445
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T01:21:15.127Z
Answers.Text: @user34445 Actually, I think that paragraph has no point at all, I was just trying to rationalize it. Humans did not decide AlphaZero's play style, they decided its learning style. They did not certainly impose on it their view of how to play chess.
Answers.UserDisplayName: IA Petr Harasimovic
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T11:36:25.957Z
Answers.Text: @IAPetrHarasimovic To nitpick *"The use of MCTS is not the crucial difference"* well, it is at least *as crucial* as all the other components of the eventual algorithm. You can use however deep convolutional network but if you don't have a good way to select and tune the initial data, they won't get you anwyhere. Also, your next statement *"They could use alpha-beta search too, they just felt MCTS worked better for them."* contradicts your first: if X works better than Y, then using X is, by definition, crucial.
Answers.UserDisplayName: gented
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-13T07:33:32.257Z
Answers.Text: "Chess is all about the struggle between human minds. That’s what makes it exciting." - You attributed that to Magnus, but the page says it was spoken by Håkon Hapnes ...
Answers.UserDisplayName: Nicholas Petersen
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-15T16:21:46.913Z
Answers.Text: @GennaroTedesco That is not the definition of crucial, it is the definition of better. I think it is quite clear what I wanted to say. I was commenting on most people thinking AlphaZero=MCTS.
Answers.UserDisplayName: IA Petr Harasimovic
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-18T13:31:07.700Z
Answers.Text: Most people think AlphaZero's play represents an advanced alien civilization.  I'd argue that's decidedly 'not human'.
Answers.UserDisplayName: user34445
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-08T23:24:53.110Z
Answers.LastActivityDate: 2017-12-18T13:34:21.200Z
Answers.LastEditDate: 2017-12-18T13:34:21.200Z
Answers.UserDisplayName: user34445
Answers.Body: <h2>This is an incredibly interesting time to be alive.</h2>
  
  <p>Chess computers starting from the 1970s have been minimax-tree based search algorithms using alpha-beta pruning.  These programs got stronger and stronger both because of advances in computer speed and parallelism and because of improvements in the heuristic eval function used to prune branches and select leaf nodes.  But people have long noticed how materialistic and boring computer play is, and many people (myself included) thought it was impossible to encode "human" intuition into software.</p>
  
  <p><em>But have you seen these games?</em></p>
  
  <p>AlphaZero is exhibiting incredibly beautiful play, including several examples of material sacrifice for long-term positional advantage.  This is reminiscent of some of the most beautiful games from human masters, but with unrivaled technical accuracy as well.  This is the first example I've seen in my life of something that's <strong>computer-generated and also has deep beauty</strong>.</p>
  
  <hr>
  
  <p><strong><em>The Centaur Claim:</em></strong></p>
  
  <p>I've heard Garry say this many times, but it's just not true.  Or at least, it won't be true any longer with AlphaZero on the scene.</p>
  
  <p>Imagine this: there is a piece sac that has 10,000 relevant continuations, where 5,000 of them are purely tactical (yet mostly unrelated to one another) and another 5,000 that are mostly positional (yet mostly unrelated).  How could a human sift through all of these variations without making a mistake?  If AlphaZero can now look at these highly creative moves, what contribution could a human possibly make?</p>
  
  <hr>
  
  <p><strong><em>The Last Frontier:</em></strong></p>
  
  <p>There is one place left where brute-calculation will still beat deep neural nets: endgames.  There is no amount of intuition that will beat a tablebase.  But the endings that require a tablebase (because a search tree can't go deep enough to just calculate the right move) are pretty rare.  And you could just plug a tablebase into AlphaZero, but that would destroy the purity of a "self-taught" engine, right?</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T17:39:56.347Z
Answers.LastActivityDate: 2017-12-10T17:39:56.347Z
Answers.UserDisplayName: Fixee
Answers.Body: <p>Since humans lack ability to search deep, like traditional computer chess programs (fritz, stockfish et al), they create 'strategic principles' or thumb rules (center control, development, king safety) and concepts or tricks that are applicable in vast variety of situations in different ways, such as sacrifice, rooks connected, bishop pair, specific endings e.g how to corner the king with a rook and a pawn.</p>
  
  <p>I think that alpha zero has independently reinvented many such concepts (percepts and concepts) and has also learnt tons of new ones - because its knowledge was not required to be built upon human evaluation functions and the strong minmax search which always assumes the opponent is a genius.</p>
  
  <p>Of course, such principles themselves conflict in some situations, that is why various opening plays and pitfalls are carefully studied - eg don't develop queen too soon.</p>
  
  <p>On the other hand, humans also notice that once you lose one piece (without exchange) you weaken your forces so they are extremely careful not to lose a piece without a compensation.</p>
  
  <p>I think that Alphazero's play has liberated computer chess (and human chess) from the slavish fear of losing small material and overreliance on  opening books and piece values.</p>
  
  <p>Alphazero games show things like the 'strategic principles' like center control, development, space, initiative are far more important if your opponent is sloppy. In other words, 'sacrifice' is not really sacrifice but trading off a piece for gain in initiative, position, directed move.</p>
  
  <p>Alphago (not the zero) relied on human evaluation, but alphazero sets up the entire chain of evaluation to 'search or simulation' as a single end to end process and comes up with totally new way of playing.</p>
  
  <p>If you think about it, great masters of the past like Morphy, Fischer, Kasparov have been applauded for typically this kind of -counter-intuitive- play where they are not bounded by written-on-stone evaluation by take advantage of special situations that emerge. I think alpha zero's games have such 'wow' factor to it.</p>
  
  <p>Why neural networks. While computer programs that use symbolic representation and discrete search can only use 'one' way of thinking, neural networks can parallelly process situations with alternate, conflicting evaluations and flip to the more valuable view in later layers.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-11T19:50:29.487Z
Answers.LastActivityDate: 2017-12-11T19:50:29.487Z
Answers.UserDisplayName: Ravi Annaswamy
Answers.Body: <p>More human in the sense that the moves it plays seem to coincide more or less with an human approach : play for long-term advantage, positional sacrifices, piece activity. There is an apparent convergence with human chess knowledge and accepted strategic principles refined over the centuries (e.g. it "discovered" many same openings). This is remarkable given the fact that AlphaZero has not been seeded with human-constructed chess knowledge.</p>
  
  <p>But the similarities end here. AlphaZero takes it to the next level and does it better, and in ways humans have never conceived. AlphaZero possesses "superhuman" capabilities to quote the paper : "AlphaZero achieved a superhuman level of play [...]" (<a href="https://arxiv.org/pdf/1712.01815.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/1712.01815.pdf</a>). In addition it doesn't have the weaknesses inherents to humans beings: concentration issues, fear, tiredness, feelings, intuition, etc. that limit humans. And its silicon brain allows for tactical combinations beyond human capabilities when necessary.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-01-12T00:58:42.607Z
Answers.Text: Then there is a paradox.
  Stockfish benefits from human experience; Alphazero does not. But Alpha zero seems more human. Meaning, perhaps, that we did not do,  with the Stackfish generation, a very good job of distilling our thoughts
Answers.UserDisplayName: Philip Roe
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-01-11T19:51:23.807Z
Answers.LastActivityDate: 2018-01-11T20:37:18.130Z
Answers.LastEditDate: 2018-01-11T20:37:18.130Z
Answers.UserDisplayName: AdamL
Answers.Body: <p>I want to say thank you to all who have responded to this question, often with subtlety and insight. The chief difference in the responses, it seems to me, is in the interpretation of the word human.</p>
  
  <p>AlphaZero does not play human chess in the sense of oversights and miscalculations, but its "thought" process seem to correspond, in a heightened form, to how I think that most strong players think. You draw up, fairly quickly, a list of "candidate moves" that you would like to play, and for the strongest players this list is amazingly accurate, even playing something like a recognizably sensible game in one minute. The rest of the time is spent on asking, which of the moves on that list really work? Petrosian said that he felt most on form when the move he eventually played was the one he first thought of. We all know how satisfying it is when the move we most wanted to play turns out to be tactically playable. I can relate to the AlphaZero algorithm much more easily than I can to AlphaBeta search, which does not at all resemble what goes on in my head.</p>
  
  <p>What seems most interesting is how the machine was able, by self-play, to 
  recognize the promising candidates. That is where the potential lies for real revolution. I wonder whether this is only possible for domains like chess and go, where the objectives can be clearly defined. But I find it striking that AlphaZero seems to display purposeful play, but Stockfish has no idea what is going on.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T16:42:13.710Z
Answers.LastActivityDate: 2017-12-10T16:42:13.710Z
Answers.UserDisplayName: Philip Roe
Answers.Body: <p>The way I understand neural networks, A0's real advantage is its superior evaluation of board positions. This evaluation incorporates both short term tactical knowledge (which in a sense serves as a multiplier of the number of positions examined) and a superior evaluation of strategic value.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T15:29:52.493Z
Answers.Text: Welcome to Chess SE! Could you please provide a reference for the reasons why you think neural networks work that way?
Answers.UserDisplayName: Pablo S. Ocal
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T15:02:07.820Z
Answers.LastActivityDate: 2017-12-10T15:02:07.820Z
Answers.UserDisplayName: Steinar Vatne
Answers.Body: <p>One thing I feel the whole discussion has missed is that A0 can play chess, shogi and go, all very well and all from self-training. This is much more human. Furthermore, in go it has revealed deeply new ideas to the top players (as I understand it). Other engines are very task-specific, A0 seems otherwise. I'd like to see it play chess960.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-14T03:48:13.673Z
Answers.Text: I don't see how this answers the question.
Answers.UserDisplayName: SmallChess
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-14T03:05:07.500Z
Answers.LastActivityDate: 2017-12-14T03:05:07.500Z
Answers.UserDisplayName: fidge
Answers.Body: <p>I don't think there is anything 'human' about Alpha.
  It just used much stronger hardware and played higher quality chess.
  The good opening moves it finds(for example, to fianchetto king side with Bg2) are fully due to its simulated opening book. Concepts that impressed me and that I have formulated in 'The Secret of Chess': <a href="http://davidsmerdon.com/?p=1970" rel="nofollow noreferrer">http://davidsmerdon.com/?p=1970</a> , which Alpha uses for the first time among top engines, are advanced longer chains, for example the d4-e5-f6 chain that trumped a whole piece in the Bg6 sacrifice game, and central backward-makers, as seen in the French Defence games between both engines.
  Both concepts involve searching to great depths, and probably here Alpha was helped by its tremendous hardware.
  Otherwise, I see nothing human about its play. Many of the games were, admittedly, beautiful.</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T13:37:24.870Z
Answers.Text: It is precisely this that makes the difference: the exponentially bigger Alpha hardware. Every chess tester knows doubling of speed increases chess strength by around 70 elos or so, depending on the software. The difference between 32 cores and 4TPUs, 1000-2000 cores, is 6 doublings or so. That would make for 420 elos. So, actually, while it performed 100 elos stronger on that hardware, on equal conditions Alpha is around 300 elos weaker.
Answers.UserDisplayName: Lyudmil Tsvetkov
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-10T13:41:03.343Z
Answers.Text: It uses an opening book, of course, no matter what they claim. Alpha has been trained on top GM winning games. That traspires very clearly, if one sees Alpha's opening selection: precisely the openings modern theory recommends and precisely those, where winning chances are best. You don't fianchetto with Bg2 just like that.
Answers.UserDisplayName: Lyudmil Tsvetkov
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-13T07:43:32.607Z
Answers.Text: @Lyudmil, Google has achieved something astonishing in Alpha Zero. It taught itself these moves by playing against itself knowing only the rules of the game! Accusing the Alpha Zero team of cheating shows you haven't understood their achievement or their mission at all - they are pushing the frontiers of AI forward and as one small gesture along the way beat all existing chess engines and human talent in an afternoon's work!
Answers.UserDisplayName: saille
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2018-01-12T02:42:01.033Z
Answers.Text: @LyudmilTsvetkov You are completely incorrect. Alpha Zero (and this is the point of it) is trained *wtihout* any human games. It's told the rules and then invented every aspect of its play in four hours of playing by itself without *any* new outside data.
Answers.UserDisplayName: Maverick
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T15:07:20.170Z
Answers.Text: These two statements of yours are incorrect: 1) "It just used much stronger hardware" - Yes, it used much stronger hardware than Stockfish but this is not what makes the difference. It is the very different software that requires the strong hardware. 2) "The good opening moves it finds are fully due to its simulated opening book." - It does not use any openings book.
Answers.UserDisplayName: IA Petr Harasimovic
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-12-09T13:34:38.130Z
Answers.LastActivityDate: 2017-12-09T13:34:38.130Z
Answers.UserDisplayName: Lyudmil Tsvetkov
Body: <p>I have a possibly naive question about AlphaZero. I have seen it described as playing in a "more human" style than other computers, but whatever it does, it gains about 100 ELO points by doing it. Kasparov, and many others, have claimed that a strong human in collaboration with a computer will beat a strong computer (perhaps by about 100 ELO??). So an obvious question is, how would AlphaZero compare with a "centaur" combination?</p>
  
  <p>Having only looked at a few games, what I notice is that most computers play wide open games that maximize their own mobility, but AlphaZero seems very concerned to limit the opponents mobility. In a human player I would describe this as a matter of style, not more or less human.</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-12-08T19:44:43.533Z
Comments.Text: For what it's worth, that claim from Kasparov is very dated. A human and computer in collaboration ("advanced chess" or "centaur chess") can no longer outperform a computer on its own — computers are just too good — Stockfish 8 is rated somewhere around ~3400 IIRC, compared to ~2825 for Magnus Carlsen.
Comments.UserDisplayName: Stephen Touset
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-12-08T20:19:26.933Z
Comments.Text: @StephenTouset Just a caution to be careful with Elo ratings for engines. The ones I've most commonly seen are from engine vs engine comparisons that haven't been standardized to a real human. Relevant [Wikipedia](https://en.wikipedia.org/wiki/Chess_engine) quote: "These ratings, [...] have no direct relation to FIDE Elo ratings or to other chess federation ratings of human players. Except for some man versus machine games which the SSDF had organized many years ago (which were far from today's level), there is no calibration between any of these rating lists and player pools. "
Comments.UserDisplayName: mbrig
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-12-09T12:37:23.360Z
Comments.Text: I think humans could but not in standard time controls. Long correspondence games should be ok.
Comments.UserDisplayName: SmallChess
Tags: <engines><stockfish><elo><alphazero>
Title: How is Alpha Zero "more human"?
ThreadText: # How is Alpha Zero "more human"?
  
  (Asked by: username_0 on 2017-12-08)
  
  I have a possibly naive question about AlphaZero. I have seen it described as playing in a "more human" style than other computers, but whatever it does, it gains about 100 ELO points by doing it. Kasparov, and many others, have claimed that a strong human in collaboration with a computer will beat a strong computer (perhaps by about 100 ELO??). So an obvious question is, how would AlphaZero compare with a "centaur" combination?
  
  Having only looked at a few games, what I notice is that most computers play wide open games that maximize their own mobility, but AlphaZero seems very concerned to limit the opponents mobility. In a human player I would describe this as a matter of style, not more or less human.
  
  **Tags:** engines, stockfish, elo, alphazero
  
  > **Comments:**
  > **username_1**: For what it's worth, that claim from Kasparov is very dated. A human and computer in collaboration ("advanced chess" or "centaur chess") can no longer outperform a computer on its own — computers are just too good — Stockfish 8 is rated somewhere around ~3400 IIRC, compared to ~2825 for Magnus Carlsen.  
  > **username_2**: @StephenTouset Just a caution to be careful with Elo ratings for engines. The ones I've most commonly seen are from engine vs engine comparisons that haven't been standardized to a real human. Relevant [Wikipedia](https://en.wikipedia.org/wiki/Chess_engine) quote: "These ratings, [...] have no direct relation to FIDE Elo ratings or to other chess federation ratings of human players. Except for some man versus machine games which the SSDF had organized many years ago (which were far from today's level), there is no calibration between any of these rating lists and player pools. "  
  > **username_3**: I think humans could but not in standard time controls. Long correspondence games should be ok.  
  
  ---
  
  ## 11 answers
  
  ### Answer by username_3 on 2017-12-08. Score: 37
  
  Page 5 in the paper has your answer:
  
  > ... AlphaZero compensates for the lower number of evaluations by using its deep neural network to costs much more selectively on the most promising variations - arguably a more "human-like" approach to chess ...
  
  "selectively" is the key word. What does that mean? Let's use this following position for our example:
  
  > <https://chess24.com/en/read/news/london-classic-5-caruana-shows-how-it-s-done>
  
  [![Moves](https://i.sstatic.net/cABLy.jpg)](https://i.sstatic.net/cABLy.jpg)
  
  This is a recent game won by Caruana in 2017 London Chess Classic. The White bishop is under attacked, and you know you have to move it. But **where?**
  
  Possibilities (not losing a piece):
  
  * Bh4
  * Be3
  * Bd2
  * Bc1
  
  What was Caruana thinking?
  
  > I felt like I would lose at some point, but when I saw, 25.Bc1 I suddenly
  > started to get a bit more optimistic about my chances. I realised my
  > position is bad, but at least I had a plan and that was really all I needed
  > for some confidence in this position. When I saw this b3, c4 the position is
  > double edged and I have some chances.
  
  This is **human thinking**, and a "human move". Caruana **hadn't** considered Bh4, Be3 and Bd2 because they "looked" bad. He had been focusing **only** and **only** on the Bc1 move.
  
  Humans play chess very **selectively**, we discard unreasonable moves because we don't have time to examine all possibilities equally.
  
  * We discard Bh4 because it release the tension on the h6 pawn
  * We discard Be3 because it blocks the two white rooks on the third rank
  * We discard Bd2 because it blocks the White queen to the king side
  
  That's what AlphaZero trying to claim in the paper. They claim their algorithm, although slower than Stockfish, is able to **selectively pick better** moves than Stockfish in the search. While Stockfish is faster, it wastes time on bad moves. AlphaZero is slower, but it's more precise (like what Caruana was doing).
  
  For example, AlphaZero might spent 80% resources on Bc1, and 20% on all other bishop moves. Stockfish might give 25% for each move (Bh4, Be3, Bd2, Bc1).
  
  > **Comments:**
  > **username_7**: So, basically, the play style is not necessarily more human, but the approach to finding what next move to play is. At least according to the paper. Also, I can't edit it, but your Caruana quote has a pretty big typo: "When I saw his b3, c4" should be "When I saw this b3, c4"  
  > **username_3**: @username_7 According to the paper (and only the paper), the play style is not necessarily more human. I'm not saying NO, but nothing in the paper says that.  
  > **username_6**: Monte Carlo algorithms have a parameter to control explore x exploit, so moves that alpha-beta would never consider (due to time), alpha zero does.  
  > **username_8**: @username_6 Can you explain what you respond to? I struggle to see the point. Also I am confused by 'never consider due to time'. Alpha-beta search disregards branches that are clearly worse than some other already explored branches. I don't see what this has to do with time.  
  > **username_4**: Basically, if a line is +0.32 and the other is +0.13, AlphaZero will spend time on the former.  
  > **username_3**: @JossieCalderon I'm not sure. +0.32 is not probability.  
  > **username_4**: @username_3 Yes, you are right. So AlphaZero will spend time on the former.  
  > **username_5**: Why is H4 not considered a possibility? As far as I can tell, it moves the bishop to safety.  
  > **username_3**: @username_5 Bh4 released the tension on the h6 pawn. I'm not a chess GM. If you have further question on the move, please start a new question.  
  > **username_5**: @username_3 oh, right. I misread the list of allowed moves and mistook h4 for f4.  
  > **username_6**: @IAPetrHarasimovic Alpha zero does not use alpha-beta search, that alone makes it more human. It looks not only at the top-best moves, but also at the few weird ones, which are ignored by most alpha-beta engines. It's the old AI dilemma explore x exploit.  
  
  ---
  
  ### Answer by username_9 on 2017-12-08. Score: 19
  
  Most strong engines emphasize looking very deeply, at the expense of having a superficial evaluation function. In the AlphaZero paper, they say that Stockfish looks at 70 million positions per second.
  
  Human grandmasters look at very few positions indeed compared to engines, but they have a better feeling who is better in a given position.
  
  AlphaZero looked at only 80,000 positions per second, so it spends much more time in its evaluation function.
  
  That's the sense in which they meant "more human like", nothing more.
  
  
  ---
  
  ### Answer by username_10 on 2017-12-08. Score: 13
  
  AlphaZero already seems to play like a regular "centaur" -> correspodence GM with an engine assistance.
  As an FM I'd get much more enjoyment of playing AlphaZero vs a regular engine.
  One comparison would be it plays like Karpov would with perfect tactics.  (Game 9 AlphaZero plays a piece down for 15moves which is very Tal like). 
  It is not just style, AlphaZero gives an impression of understanding positions better than Stockfish.
  AlphaZero also does not suffer from Horizon Effect that ALL chess engines had suffered from until now.
  Time and again it is able to correctly evaluate a position more moves down than Stockfish does.
  Here's an example:
  [FEN "rnbqkbnr/pppppppp/8/8/8/8/PPPPPPPP/RNBQKBNR w KQkq - 0 1"]
  [White "AlphaZero"]
  [Black "Stockfish"]
  [Date "2017.12.05"]
  [Result "1-0"]
  [Event "Alphazero vs Stockfish: AlphaZero - Stockfish"]
  [Site "https://lichess.org/study/EOddRjJ8"]
  [UTCDate "2017.12.06"]
  [UTCTime "05:53:49"]
  [Variant "Standard"]
  [ECO "C11"]
  [Opening "French Defense: Steinitz Variation #2"]
  [Annotator "https://lichess.org/@/Spreek"]
  
  1. d4 e6 2. e4 d5 3. Nc3 Nf6 4. e5 Nfd7 5. f4 c5 6. Nf3 cxd4 7. Nb5 Bb4+ 8. Bd2 Bc5 9. b4 Be7 10. Nbxd4 Nc6 11. c3 a5 12. b5 Nxd4 13. cxd4 Nb6 14. a4 Nc4 15. Bd3 Nxd2 16. Kxd2 Bd7 17. Ke3 b6 18. g4 h5 19. Qg1 hxg4 20. Qxg4 Bf8 21. h4 Qe7 22. Rhc1 g6 23. Rc2 Kd8 24. Rac1 Qe8 25. Rc7 Rc8 26. Rxc8+ Bxc8 27. Rc6 Bb7 28. Rc2 Kd7 29. Ng5 Be7 30. Bxg6 Bxg5 31. Qxg5 fxg6 32. f5 Rg8 33. Qh6 Qf7 34. f6 Kd8 35. Kd2 Kd7 36. Rc1 Kd8 37. Qe3 Qf8 38. Qc3 Qb4 39. Qxb4 axb4 40. Rg1 b3 41. Kc3 Bc8 42. Kxb3 Bd7 43. Kb4 Be8 44. Ra1 Kc7 45. a5 Bd7 46. axb6+ Kxb6 47. Ra6+ Kb7 48. Kc5 Rd8 49. Ra2 Rc8+ 50. Kd6 Be8 51. Ke7 g5 52. hxg5 { 1-0 Black resigns. } 1-0
  
  AlphaZero plays the king to center 16. Kxd2! in a middle game correctly judging that Black will not be able to take an advantage of it.
  It is able to correctly evaluate a piece sacrifice 30. Bxg6! while regular engines are unable to see that they are lost for a number of moves.
  
  f5 is quite nice too.
  
  There are other examples such as exchange Sacrifice in Game 3.
  
  
  ---
  
  ### Answer by username_11 on 2017-12-08. Score: 9
  
  It is as easy to jump on a bandwagon saying Alpha-Zero's play is 'more' human than previous computer chess programs as it is to jump on the opposite wagon and say Alpha-Zero's play is entirely 'alien'. It's not clear that Alpha-zero's play is 'more human' especially given our human tendency towards anthropomorphism.
  
  ***Chess as a Struggle of the (human) Mind***
  
  But in chess is this tendency true? Magnus Carlsen [once spoke](https://www.quora.com/Why-does-Magnus-Carlsen-think-computers-are-boring-to-play-chess-against) about how 'traditional' computers in general lack human creativity saying:
  
  > "Chess is all about the struggle between human minds. That’s what makes it exciting. Computer chess is mechanical, dry and bland. The moves are very strong, of course, but there is no style. If you try to play against a chess computer, not only will you lose with a very high certainty, but you will also be bored in the process.
  
  Magnus Carlsen didn't see evidence of human styles of play in traditional chess computers. So lets examine if Alpha-Zero's recent accomplishment has undone this perspective and moved us towards something more reminiscent of ourselves.
  
  > If by 'human-like' you mean play 'exhibiting behavior more likely to appeal to our sense of anthropomorphism' does Alpha-zero's style seem more human? How do we really test this subjective myopic humans like to project upon non-human things? Lets ask - does the algorithm 'selectively pick better' or exhibit 'more human creative choice' in its style of play?
  
  The algorithm's creators indicate that unlike Stockfish which uses an Alpha-Beta search algorithm, Alpha-Zero employs a Monte-Carlo tree search (MCTS) algorithm which accepts as input a weighted parameters θ built up from previous outcomes ~ [Page 3. Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm](https://arxiv.org/pdf/1712.01815.pdf)).
  
  So the algorithm doesn't exhibit choice at all. It actually engages in a random but probabilistic Monty-carlo search where the possible search paths available to it are increasingly prejudiced by previous outcomes. Did Alpha-zero choose to optimize its style of play this way or was that the choice of its programmers?
  
  > Does Alpha-zero always have all possible moves available to it for consideration or are some moves prejudiced algorithmically in a way that mimics experience which can be interpreted by humans anthropomorphically?
  
  Initially it had all moves available to it so its 'style' was entirely random. However as it's search is increasingly and optimally constrained by previous success or failure its style is actually changing towards the mode its programmers have shackled it with. Is this 'more human' though? Compare this to Magnus Carlesen who will sometimes [choose less optimal moves because they are more creative](https://www.chess.com/news/view/magnus-carlsen-i-appreciate-creating-something-unique):
  
  > Magnus Carlsen: “I appreciate creating something unique”
  
  ***Chess as a Struggle of the (alien) Mind***
  
  Humans can chose the criteria that drives their own style of play (for example I often chose impulse and error in my own style). Many see Alpha-zero's play in both chess and [go](https://www.theatlantic.com/technology/archive/2017/10/alphago-zero-the-ai-that-taught-itself-go/543450/) as decidedly [Alien](http://www.bbc.com/news/technology-41668701). Nick Hynes, a grad student at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) observes:
  
  > “What we’re seeing here is a model free from human bias and presuppositions: It can learn whatever it determines is optimal, which may indeed be more nuanced that our own conceptions of the same. It’s like an alien civilization inventing its own mathematics which allows it to do things like time travel...”
  
  Likewise GM Peter Heine Nielsen [told Chess.com](https://www.chess.com/news/view/google-s-alphazero-destroys-stockfish-in-100-game-match):
  
  > "After reading the paper but especially seeing the games I thought, well, I always wondered how it would be if a superior species landed on earth and showed us how they play chess. I feel now I know."
  
  It seems that most react to Alpha-zero's emergent style of play as 'alien play', and not as 'more human'.
  
  > Therefore there's reason to disagree with the answers above that say 'yes'.
  
  > **Comments:**
  > **username_8**: Your answer is quite misleading and inaccurate in places. The use of MCTS is not the crucial difference, this is not why it beat Stockfish. They could use alpha-beta search too, they just felt MCTS worked better for them. The main elements of the AlphaZero algorithm are a very deep convolutional neural network, reinforcement learning (i.e. the network is tuned by self-play), and a tree search (which happens to be MCTS but that is not necessary). There is nothing handcrafted in it thus saying " its style is actually changing towards the mode its programmers have shackled it with" is incorrect.  
  > **username_11**: If you believe my point was that MCTS is the  crucial difference (between Alpha-zero and Stockfish) - you're missing my point.  My point was that humans, not algorithms decided Alpha-zero's play style, decided Alpha-zero's decision.   My point was that these very human choices seem to impart a play style that strikes GMs and amateurs alike as decidedly not human.  
  > **username_11**: Dr Eval check out - https://cs.stackexchange.com/questions/68249/qualification-or-disqualification-of-machine-intelligence-test-as-turing-test  
  > **username_8**: @username_11 Actually, I think that paragraph has no point at all, I was just trying to rationalize it. Humans did not decide AlphaZero's play style, they decided its learning style. They did not certainly impose on it their view of how to play chess.  
  > **username_12**: @IAPetrHarasimovic To nitpick *"The use of MCTS is not the crucial difference"* well, it is at least *as crucial* as all the other components of the eventual algorithm. You can use however deep convolutional network but if you don't have a good way to select and tune the initial data, they won't get you anwyhere. Also, your next statement *"They could use alpha-beta search too, they just felt MCTS worked better for them."* contradicts your first: if X works better than Y, then using X is, by definition, crucial.  
  > **username_13**: "Chess is all about the struggle between human minds. That’s what makes it exciting." - You attributed that to Magnus, but the page says it was spoken by Håkon Hapnes ...  
  > **username_8**: @GennaroTedesco That is not the definition of crucial, it is the definition of better. I think it is quite clear what I wanted to say. I was commenting on most people thinking AlphaZero=MCTS.  
  > **username_11**: Most people think AlphaZero's play represents an advanced alien civilization.  I'd argue that's decidedly 'not human'.  
  
  ---
  
  ### Answer by username_14 on 2017-12-10. Score: 6
  
  ## This is an incredibly interesting time to be alive.
  
  Chess computers starting from the 1970s have been minimax-tree based search algorithms using alpha-beta pruning. These programs got stronger and stronger both because of advances in computer speed and parallelism and because of improvements in the heuristic eval function used to prune branches and select leaf nodes. But people have long noticed how materialistic and boring computer play is, and many people (myself included) thought it was impossible to encode "human" intuition into software.
  
  *But have you seen these games?*
  
  AlphaZero is exhibiting incredibly beautiful play, including several examples of material sacrifice for long-term positional advantage. This is reminiscent of some of the most beautiful games from human masters, but with unrivaled technical accuracy as well. This is the first example I've seen in my life of something that's **computer-generated and also has deep beauty**.
  
  ---
  
  ***The Centaur Claim:***
  
  I've heard Garry say this many times, but it's just not true. Or at least, it won't be true any longer with AlphaZero on the scene.
  
  Imagine this: there is a piece sac that has 10,000 relevant continuations, where 5,000 of them are purely tactical (yet mostly unrelated to one another) and another 5,000 that are mostly positional (yet mostly unrelated). How could a human sift through all of these variations without making a mistake? If AlphaZero can now look at these highly creative moves, what contribution could a human possibly make?
  
  ---
  
  ***The Last Frontier:***
  
  There is one place left where brute-calculation will still beat deep neural nets: endgames. There is no amount of intuition that will beat a tablebase. But the endings that require a tablebase (because a search tree can't go deep enough to just calculate the right move) are pretty rare. And you could just plug a tablebase into AlphaZero, but that would destroy the purity of a "self-taught" engine, right?
  
  
  ---
  
  ### Answer by username_15 on 2017-12-11. Score: 3
  
  Since humans lack ability to search deep, like traditional computer chess programs (fritz, stockfish et al), they create 'strategic principles' or thumb rules (center control, development, king safety) and concepts or tricks that are applicable in vast variety of situations in different ways, such as sacrifice, rooks connected, bishop pair, specific endings e.g how to corner the king with a rook and a pawn.
  
  I think that alpha zero has independently reinvented many such concepts (percepts and concepts) and has also learnt tons of new ones - because its knowledge was not required to be built upon human evaluation functions and the strong minmax search which always assumes the opponent is a genius.
  
  Of course, such principles themselves conflict in some situations, that is why various opening plays and pitfalls are carefully studied - eg don't develop queen too soon.
  
  On the other hand, humans also notice that once you lose one piece (without exchange) you weaken your forces so they are extremely careful not to lose a piece without a compensation.
  
  I think that Alphazero's play has liberated computer chess (and human chess) from the slavish fear of losing small material and overreliance on opening books and piece values.
  
  Alphazero games show things like the 'strategic principles' like center control, development, space, initiative are far more important if your opponent is sloppy. In other words, 'sacrifice' is not really sacrifice but trading off a piece for gain in initiative, position, directed move.
  
  Alphago (not the zero) relied on human evaluation, but alphazero sets up the entire chain of evaluation to 'search or simulation' as a single end to end process and comes up with totally new way of playing.
  
  If you think about it, great masters of the past like Morphy, Fischer, Kasparov have been applauded for typically this kind of -counter-intuitive- play where they are not bounded by written-on-stone evaluation by take advantage of special situations that emerge. I think alpha zero's games have such 'wow' factor to it.
  
  Why neural networks. While computer programs that use symbolic representation and discrete search can only use 'one' way of thinking, neural networks can parallelly process situations with alternate, conflicting evaluations and flip to the more valuable view in later layers.
  
  
  ---
  
  ### Answer by username_16 on 2018-01-11. Score: 3
  
  More human in the sense that the moves it plays seem to coincide more or less with an human approach : play for long-term advantage, positional sacrifices, piece activity. There is an apparent convergence with human chess knowledge and accepted strategic principles refined over the centuries (e.g. it "discovered" many same openings). This is remarkable given the fact that AlphaZero has not been seeded with human-constructed chess knowledge.
  
  But the similarities end here. AlphaZero takes it to the next level and does it better, and in ways humans have never conceived. AlphaZero possesses "superhuman" capabilities to quote the paper : "AlphaZero achieved a superhuman level of play [...]" (<https://arxiv.org/pdf/1712.01815.pdf>). In addition it doesn't have the weaknesses inherents to humans beings: concentration issues, fear, tiredness, feelings, intuition, etc. that limit humans. And its silicon brain allows for tactical combinations beyond human capabilities when necessary.
  
  > **Comments:**
  > **username_0**: Then there is a paradox. Stockfish benefits from human experience; Alphazero does not. But Alpha zero seems more human. Meaning, perhaps, that we did not do,  with the Stackfish generation, a very good job of distilling our thoughts  
  
  ---
  
  ### Answer by username_0 on 2017-12-10. Score: 1
  
  I want to say thank you to all who have responded to this question, often with subtlety and insight. The chief difference in the responses, it seems to me, is in the interpretation of the word human.
  
  AlphaZero does not play human chess in the sense of oversights and miscalculations, but its "thought" process seem to correspond, in a heightened form, to how I think that most strong players think. You draw up, fairly quickly, a list of "candidate moves" that you would like to play, and for the strongest players this list is amazingly accurate, even playing something like a recognizably sensible game in one minute. The rest of the time is spent on asking, which of the moves on that list really work? Petrosian said that he felt most on form when the move he eventually played was the one he first thought of. We all know how satisfying it is when the move we most wanted to play turns out to be tactically playable. I can relate to the AlphaZero algorithm much more easily than I can to AlphaBeta search, which does not at all resemble what goes on in my head.
  
  What seems most interesting is how the machine was able, by self-play, to
  recognize the promising candidates. That is where the potential lies for real revolution. I wonder whether this is only possible for domains like chess and go, where the objectives can be clearly defined. But I find it striking that AlphaZero seems to display purposeful play, but Stockfish has no idea what is going on.
  
  
  ---
  
  ### Answer by username_17 on 2017-12-10. Score: 0
  
  The way I understand neural networks, A0's real advantage is its superior evaluation of board positions. This evaluation incorporates both short term tactical knowledge (which in a sense serves as a multiplier of the number of positions examined) and a superior evaluation of strategic value.
  
  > **Comments:**
  > **username_18**: Welcome to Chess SE! Could you please provide a reference for the reasons why you think neural networks work that way?  
  
  ---
  
  ### Answer by username_19 on 2017-12-14. Score: 0
  
  One thing I feel the whole discussion has missed is that A0 can play chess, shogi and go, all very well and all from self-training. This is much more human. Furthermore, in go it has revealed deeply new ideas to the top players (as I understand it). Other engines are very task-specific, A0 seems otherwise. I'd like to see it play chess960.
  
  > **Comments:**
  > **username_3**: I don't see how this answers the question.  
  
  ---
  
  ### Answer by username_20 on 2017-12-09. Score: -2
  
  I don't think there is anything 'human' about Alpha.
  It just used much stronger hardware and played higher quality chess.
  The good opening moves it finds(for example, to fianchetto king side with Bg2) are fully due to its simulated opening book. Concepts that impressed me and that I have formulated in 'The Secret of Chess': <http://davidsmerdon.com/?p=1970> , which Alpha uses for the first time among top engines, are advanced longer chains, for example the d4-e5-f6 chain that trumped a whole piece in the Bg6 sacrifice game, and central backward-makers, as seen in the French Defence games between both engines.
  Both concepts involve searching to great depths, and probably here Alpha was helped by its tremendous hardware.
  Otherwise, I see nothing human about its play. Many of the games were, admittedly, beautiful.
  
  > **Comments:**
  > **username_8**: These two statements of yours are incorrect: 1) "It just used much stronger hardware" - Yes, it used much stronger hardware than Stockfish but this is not what makes the difference. It is the very different software that requires the strong hardware. 2) "The good opening moves it finds are fully due to its simulated opening book." - It does not use any openings book.  
  > **username_20**: It is precisely this that makes the difference: the exponentially bigger Alpha hardware. Every chess tester knows doubling of speed increases chess strength by around 70 elos or so, depending on the software. The difference between 32 cores and 4TPUs, 1000-2000 cores, is 6 doublings or so. That would make for 420 elos. So, actually, while it performed 100 elos stronger on that hardware, on equal conditions Alpha is around 300 elos weaker.  
  > **username_20**: It uses an opening book, of course, no matter what they claim. Alpha has been trained on top GM winning games. That traspires very clearly, if one sees Alpha's opening selection: precisely the openings modern theory recommends and precisely those, where winning chances are best. You don't fianchetto with Bg2 just like that.  
  > **username_21**: @Lyudmil, Google has achieved something astonishing in Alpha Zero. It taught itself these moves by playing against itself knowing only the rules of the game! Accusing the Alpha Zero team of cheating shows you haven't understood their achievement or their mission at all - they are pushing the frontiers of AI forward and as one small gesture along the way beat all existing chess engines and human talent in an afternoon's work!  
  > **username_22**: @LyudmilTsvetkov You are completely incorrect. Alpha Zero (and this is the point of it) is trained *wtihout* any human games. It's told the rules and then invented every aspect of its play in four hours of playing by itself without *any* new outside data.  
  
  ---
  
  