Answers.Body: <p>How many games did you play? Unless your tournament had enough games, your conclusion wasn't statistically significant.</p>
  
  <p>It's common misconception that Stockfish would play better chess than weaker engines in a short computer chess tournament. This is wrong and wrong. Stockfish's higher ELO means it's <strong>expected</strong> to play better chess. Anything could happen in a short match or tournament.</p>
  
  <p>Magnus Carlsen has the highest FIDE ELO, but that doesn't mean he wins everything. He'd lost to Bu in the 2017 World Cup in a <strong>2-games</strong> mini-match, but do you really think Bu is a stronger chess player than the World Champion?</p>
  
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-10-11T23:24:06.197Z
Answers.Text: I always have 40 to 1000 games depending on number of engine. In best case there is 2 games with white and 2 games with black. You are completely right about GMs and normal players. For chess engines they almost choose the same opening against each other, which makes the results so consistent. To avoid that I make them to start with certain openings and even in that case again they have same moves at least for most of the game. For example rybka vs. boot looses with black and has a draw with white all the time or at least 90% of the games even I make them to have more and more games.
Answers.UserDisplayName: Farhad
Answers.ContentLicense: CC BY-SA 3.0
Answers.CreationDate: 2017-10-11T23:28:32.667Z
Answers.Text: However as I explained it already, when I change the computers which have huge CPU clock difference with same architecture the results start to vary. I don't know is it something related to programming or compilation of programs under windows or etc...
Answers.UserDisplayName: Farhad
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2017-10-11T23:01:09.463Z
Answers.LastActivityDate: 2020-03-04T18:33:50.027Z
Answers.LastEditDate: 2020-03-04T18:33:50.027Z
Answers.UserDisplayName: SmallChess
Answers.Body: <p>Briefly looking at the source code on <a href="https://github.com/booot76/Booot-chess-engine" rel="nofollow noreferrer">https://github.com/booot76/Booot-chess-engine</a>, this engine uses the walltime a lot. Lines like</p>
  <pre><code>If (game.time&lt;&gt;game.rezerv) and ((MilliSecondsBetween(game.StartTime,now))&gt;(0.7*game.time)) then break;
  </code></pre>
  <p>suggests the walltime is not just tracked for verbose output but to make decisions. Presumably, this is to make the engine a good opponent for human players but makes its behaviour depend on CPU speed.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2023-10-22T13:26:12.403Z
Answers.LastActivityDate: 2023-10-22T13:26:12.403Z
Answers.UserDisplayName: Joachim Wagner
Body: <p>I use Arena for tournaments between chess engines.</p>
  
  <p>The interesting thing is that in different 64-bit multi-processor computers ranking is slightly different. I was expecting that they should be the same.</p>
  
  <p>Do you have any idea why this happens?</p>
  
  <p>As an example Booot 6.2 64-bit loses most of the games on a low end new PC.
  However in a stronger PC with newer 'Core i7' CPU it can even have the same score as Stockfish 8 (which most of the time is in top of tables).</p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-10-11T22:14:02.920Z
Comments.Text: How many games did you have?
Comments.UserDisplayName: SmallChess
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2017-10-11T23:16:01.190Z
Comments.Text: Most of the time 4 games for each engine vs. All other engines. Like if I have 10 engines it sums up to 180 games. With time control of 2m+2s
Comments.UserDisplayName: Farhad
Tags: <engines><stockfish><arena>
Title: Difference in chess engine strength for ''high end 64-bit multicore PCs'' vs. ''low end multicore 64-bit PCs''
ThreadText: # Difference in chess engine strength for ''high end 64-bit multicore PCs'' vs. ''low end multicore 64-bit PCs''
  
  (Asked by: username_0 on 2017-10-11)
  
  I use Arena for tournaments between chess engines.
  
  The interesting thing is that in different 64-bit multi-processor computers ranking is slightly different. I was expecting that they should be the same.
  
  Do you have any idea why this happens?
  
  As an example Booot 6.2 64-bit loses most of the games on a low end new PC.
  However in a stronger PC with newer 'Core i7' CPU it can even have the same score as Stockfish 8 (which most of the time is in top of tables).
  
  **Tags:** engines, stockfish, arena
  
  > **Comments:**
  > **username_1**: How many games did you have?  
  > **username_0**: Most of the time 4 games for each engine vs. All other engines. Like if I have 10 engines it sums up to 180 games. With time control of 2m+2s  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2017-10-11. Score: 2
  
  How many games did you play? Unless your tournament had enough games, your conclusion wasn't statistically significant.
  
  It's common misconception that Stockfish would play better chess than weaker engines in a short computer chess tournament. This is wrong and wrong. Stockfish's higher ELO means it's **expected** to play better chess. Anything could happen in a short match or tournament.
  
  Magnus Carlsen has the highest FIDE ELO, but that doesn't mean he wins everything. He'd lost to Bu in the 2017 World Cup in a **2-games** mini-match, but do you really think Bu is a stronger chess player than the World Champion?
  
  > **Comments:**
  > **username_0**: I always have 40 to 1000 games depending on number of engine. In best case there is 2 games with white and 2 games with black. You are completely right about GMs and normal players. For chess engines they almost choose the same opening against each other, which makes the results so consistent. To avoid that I make them to start with certain openings and even in that case again they have same moves at least for most of the game. For example rybka vs. boot looses with black and has a draw with white all the time or at least 90% of the games even I make them to have more and more games.  
  > **username_0**: However as I explained it already, when I change the computers which have huge CPU clock difference with same architecture the results start to vary. I don't know is it something related to programming or compilation of programs under windows or etc...  
  
  ---
  
  ### Answer by username_2 on 2023-10-22. Score: 0
  
  Briefly looking at the source code on <https://github.com/booot76/Booot-chess-engine>, this engine uses the walltime a lot. Lines like
  
  ```
  If (game.time<>game.rezerv) and ((MilliSecondsBetween(game.StartTime,now))>(0.7*game.time)) then break;
  
  ```
  
  suggests the walltime is not just tracked for verbose output but to make decisions. Presumably, this is to make the engine a good opponent for human players but makes its behaviour depend on CPU speed.
  
  
  ---
  
  