Answers.Body: <blockquote>
  <p><em>Could a model be trained in the same way as AlphaZero, but with an additional component that measures the beauty/interestingness of its play</em></p>
  </blockquote>
  <p>Yes, as long as I can give you a game and you return me a scalar value representing how much &quot;beauty&quot; correspond to that game (you are free to calculate it however you want, even with a personal criterion)</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-03-28T23:46:29.523Z
Answers.LastActivityDate: 2024-03-28T23:46:29.523Z
Answers.UserDisplayName: Alberto
Body: <p>Could a version of AlphaZero be trained that learned not only how to win, but how to win in a &quot;beautiful&quot; way?</p>
  <p>Jurgen Schmidhuber wrote a <a href="https://arxiv.org/pdf/0812.4360.pdf" rel="nofollow noreferrer">paper</a> in 2008, which basically models &quot;beauty&quot; as the level of compressibility of the data, relative to the observer. Too much, and the data is boring; too little and the data appears too random and so is also boring. Somewhere in between, means there is some interesting structure that we partially understand, but not fully, and that is what appeals to our sense of curiosity</p>
  <p>Could a model be trained in the same way as AlphaZero, but with an additional component that measures the beauty/interestingness of its play. As it learns to play better, it develops a better understanding of the game, and in parallel it learns to compress the board state and history at each move, and then somehow uses that to reward more beautiful play?</p>
  <p>I think this is a logical direction to go in now. Maybe an approach like this could help ATPs and AI for maths research, since beauty is a key quality of good/interesting mathematics.</p>
  <p>We know AI can thrash the best humans at Go, so its no longer interesting. We want to see more crazy stuff like move 37. Maybe we can compare it to watching a great football match. We love the 1970s Brazil team, because of their outrageous style and flair not because they won every single match.</p>
  
Tags: <math><alphazero><artificial-curiosity>
Title: Could AlphaZero be trained to prefer "beautiful" games?
UserDisplayName: swami
ThreadText: # Could AlphaZero be trained to prefer "beautiful" games?
  
  (Asked by: username_0 on 2024-03-28)
  
  Could a version of AlphaZero be trained that learned not only how to win, but how to win in a "beautiful" way?
  
  Jurgen Schmidhuber wrote a [paper](https://arxiv.org/pdf/0812.4360.pdf) in 2008, which basically models "beauty" as the level of compressibility of the data, relative to the observer. Too much, and the data is boring; too little and the data appears too random and so is also boring. Somewhere in between, means there is some interesting structure that we partially understand, but not fully, and that is what appeals to our sense of curiosity
  
  Could a model be trained in the same way as AlphaZero, but with an additional component that measures the beauty/interestingness of its play. As it learns to play better, it develops a better understanding of the game, and in parallel it learns to compress the board state and history at each move, and then somehow uses that to reward more beautiful play?
  
  I think this is a logical direction to go in now. Maybe an approach like this could help ATPs and AI for maths research, since beauty is a key quality of good/interesting mathematics.
  
  We know AI can thrash the best humans at Go, so its no longer interesting. We want to see more crazy stuff like move 37. Maybe we can compare it to watching a great football match. We love the 1970s Brazil team, because of their outrageous style and flair not because they won every single match.
  
  **Tags:** math, alphazero, artificial-curiosity
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2024-03-28. Score: 1
  
  > *Could a model be trained in the same way as AlphaZero, but with an additional component that measures the beauty/interestingness of its play*
  
  Yes, as long as I can give you a game and you return me a scalar value representing how much "beauty" correspond to that game (you are free to calculate it however you want, even with a personal criterion)
  
  
  ---
  
  