Answers.Body: <p>Chess isn't really a benchmark per say.</p>
  <p>The method developed in AlphaGo to play Go should in principle generalize quite nicely to other games of this sort, such as chess. Since Stockfish is quite dominantly the strongest Chess AI, the natural question would be to see how well AlphaGo's method compares to Stockfish.</p>
  <p>Being one of the most well developed AI agents of all time, the situation concerning the defeat of Stockfish (AlphaZero was trained for only 4 hours entirely via self-play, without access to historical data) signifies the complete dominance of modern neural-network methods over classic methods (hard coded evaluation functions).</p>
  <p>Also as @DukeZhou♦ mentioned in the comments, while Chess bots can regularly beat human players, it's still a useful metric to evaluate bots against each other via &quot;games&quot; of this sort.</p>
  <p>edit: But as the more recent results of Stockfish 13 versus Lc0 (an open source AlphaZero clone) show, handcrafted/traditional algorithms (search in particular), paired with neural network techniques, can still outmatch pure neural networks. This perhaps highlights the value of classical techniques in the face of more modern approaches.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-12-15T21:17:40.370Z
Answers.LastActivityDate: 2021-09-13T21:26:29.843Z
Answers.LastEditDate: 2021-09-13T21:26:29.843Z
Answers.UserDisplayName: k.c. sayz 'k.c sayz'
Body: <p>Even though modern chess playing programs have demonstrated themselves to be as strong (or stronger) than even the best human players for nearly 20 years now (1997 when IBM's Deep Blue defeated the world chess champion Gary Kasparov), why would a game like chess still be considered a valuable research subject in Artificial Intelligence?  In other words, what can be gained by continuing to advance AI in areas that have already surpassed human capabilities?</p>
  <p>For instance, as recently as November 2017, Google successfully challenged its deep learning technology against one of the world's strongest <a href="https://arxiv.org/pdf/1712.01815.pdf" rel="nofollow noreferrer">chess-playing programs</a>.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2021-09-13T22:13:05.553Z
Comments.Text: So once you get -just- past human abilities, do you just sort of stop bothering anymore?
Comments.UserDisplayName: Mitch
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-12-15T20:43:49.477Z
Comments.Text: My high-level answer would be that Chess is still presumed to be unsolvable, the gametree is quite complex, and it's useful to validate algorithms against other algorithms in multiple contexts.  Go may be the most complex "game people play", but based on a recent, reliable poll by yougov, Chess has about 10x the casual player base, and, until recently, was much more famous than Go in the west.  (In tv and movies, Go is starting to replace Chess as the signifier of a character's intelligence or strategic acumen, no doubt a function of AlphaGo, though  the movie π utilized Go in 1998.)
Comments.UserDisplayName: DukeZhou
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-12-15T20:47:31.117Z
Comments.Text: Thus, Chess still has high PR value, in addition to "complexity akin to nature".
Comments.UserDisplayName: DukeZhou
Tags: <chess><intelligence-testing><alphago><benchmarks>
Title: Why is chess still a benchmark for Artificial Intelligence?
UserDisplayName: DJ2
ThreadText: # Why is chess still a benchmark for Artificial Intelligence?
  
  (Asked by: username_0 on 2017-12-15)
  
  Even though modern chess playing programs have demonstrated themselves to be as strong (or stronger) than even the best human players for nearly 20 years now (1997 when IBM's Deep Blue defeated the world chess champion Gary Kasparov), why would a game like chess still be considered a valuable research subject in Artificial Intelligence? In other words, what can be gained by continuing to advance AI in areas that have already surpassed human capabilities?
  
  For instance, as recently as November 2017, Google successfully challenged its deep learning technology against one of the world's strongest [chess-playing programs](https://arxiv.org/pdf/1712.01815.pdf).
  
  **Tags:** chess, intelligence-testing, alphago, benchmarks
  
  > **Comments:**
  > **username_2**: My high-level answer would be that Chess is still presumed to be unsolvable, the gametree is quite complex, and it's useful to validate algorithms against other algorithms in multiple contexts.  Go may be the most complex "game people play", but based on a recent, reliable poll by yougov, Chess has about 10x the casual player base, and, until recently, was much more famous than Go in the west.  (In tv and movies, Go is starting to replace Chess as the signifier of a character's intelligence or strategic acumen, no doubt a function of AlphaGo, though  the movie π utilized Go in 1998.)  
  > **username_2**: Thus, Chess still has high PR value, in addition to "complexity akin to nature".  
  > **username_1**: So once you get -just- past human abilities, do you just sort of stop bothering anymore?  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_3 on 2017-12-15. Score: 6 | Accepted answer
  
  Chess isn't really a benchmark per say.
  
  The method developed in AlphaGo to play Go should in principle generalize quite nicely to other games of this sort, such as chess. Since Stockfish is quite dominantly the strongest Chess AI, the natural question would be to see how well AlphaGo's method compares to Stockfish.
  
  Being one of the most well developed AI agents of all time, the situation concerning the defeat of Stockfish (AlphaZero was trained for only 4 hours entirely via self-play, without access to historical data) signifies the complete dominance of modern neural-network methods over classic methods (hard coded evaluation functions).
  
  Also as @username_2♦ mentioned in the comments, while Chess bots can regularly beat human players, it's still a useful metric to evaluate bots against each other via "games" of this sort.
  
  edit: But as the more recent results of Stockfish 13 versus Lc0 (an open source AlphaZero clone) show, handcrafted/traditional algorithms (search in particular), paired with neural network techniques, can still outmatch pure neural networks. This perhaps highlights the value of classical techniques in the face of more modern approaches.
  
  
  ---
  
  