Answers.Body: <p>People (other than Grand Masters) play unpredictably and make more &quot;novel&quot; errors than bots. Bots, unlike a person, will never miss an error you make.</p>
  <p>A person's rating is different depending on who they play as each of us is more likely to win against a different playing style.  Hence it is sometimes claimed you need to play 30 different people within 200 of your level so as to get a highly predictive rating.</p>
  <p>So a bot that on average scores zero against a correctly rated 1600 person will often lose against some lower rated people and win against some higher rated people.</p>
  <p>We also have the interesting problem that a person who have played against a bot a few times is likely to do better then a person who is playing against the bot for the 1st time, even when the too people have the same correct rating.  So should a bot be rated based on the results of only the 1st game each person have with it, or based on the results against the players who have the most games with it?</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-09-16T08:56:46.723Z
Answers.LastActivityDate: 2024-09-17T12:10:53.223Z
Answers.LastEditDate: 2024-09-17T12:10:53.223Z
Answers.UserDisplayName: Ian Ringrose
Body: <p>I’m a 1200 rapid rated online Chess.com player. When I play Chess.com bots, I can usually beat bots as high as 1600.</p>
  <p>Does this mean that the bots are inaccurately rated or that I’m underrated?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-09-16T15:23:35.677Z
Comments.Text: Ian's answer below is detailed and nuanced, but the answer to your question is that the bot is inaccurately rated. Bot ratings are either highly subjective (in this case) or not comparable to human rating.
Comments.UserDisplayName: Awalrod
Tags: <engines><online-chess><elo>
Title: Do engines accurately represent their skill level?
ThreadText: # Do engines accurately represent their skill level?
  
  (Asked by: username_0 on 2024-09-15)
  
  I’m a 1200 rapid rated online Chess.com player. When I play Chess.com bots, I can usually beat bots as high as 1600.
  
  Does this mean that the bots are inaccurately rated or that I’m underrated?
  
  **Tags:** engines, online-chess, elo
  
  > **Comments:**
  > **username_1**: Ian's answer below is detailed and nuanced, but the answer to your question is that the bot is inaccurately rated. Bot ratings are either highly subjective (in this case) or not comparable to human rating.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_2 on 2024-09-16. Score: 0 | Accepted answer
  
  People (other than Grand Masters) play unpredictably and make more "novel" errors than bots. Bots, unlike a person, will never miss an error you make.
  
  A person's rating is different depending on who they play as each of us is more likely to win against a different playing style. Hence it is sometimes claimed you need to play 30 different people within 200 of your level so as to get a highly predictive rating.
  
  So a bot that on average scores zero against a correctly rated 1600 person will often lose against some lower rated people and win against some higher rated people.
  
  We also have the interesting problem that a person who have played against a bot a few times is likely to do better then a person who is playing against the bot for the 1st time, even when the too people have the same correct rating. So should a bot be rated based on the results of only the 1st game each person have with it, or based on the results against the players who have the most games with it?
  
  
  ---
  
  