Answers.Body: <blockquote>
  <p>Is there a data file somewhere containing every single (FIDE) rated
  game?</p>
  </blockquote>
  <p>As an arbiter I can tell you definitively that the answer is &quot;No&quot;. However you don't need to be an arbiter to know that. You just need to have played in a FIDE rated blitz tournament. Nobody is writing the moves down in those tournaments.</p>
  <p>In FIDE rapid tournaments you do get a few players who start out recording but many of them stop when they get short of time and those games don't end up in databases.</p>
  <p>Even when it comes to standard time control FIDE rated games only those games played in norm events have to be sent to FIDE (to make sure there is no cheating to get titles like GM and IM). So, all games played in norm events should be recorded and sent to FIDE. For each such tournament the games should be available for download from the FIDE site and those games will be picked up by the spiders / web-crawlers used by the big database providers.</p>
  <p>However the large majority of FIDE rated standard games are not played in norm events and so there is no requirement for arbiters and organizers to send those games to FIDE. Doing so is hard (unpaid) work and so most arbiters and organizers are not going to do it.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-05T13:01:54.540Z
Answers.LastActivityDate: 2020-12-05T13:01:54.540Z
Answers.UserDisplayName: Brian Towers
Answers.Body: <p>It would be fun to create a decission tree based on all those games, however, I don´t think there´s anything like that, at least publicly. Besides, you´re probably making an understimation, as right now there are 360,000 fide rated players.</p>
  <p>The biggest public chessdatabases are</p>
  <ul>
  <li>Chess Microbase</li>
  <li>Chess Tempo</li>
  <li>Chess-DB (and I think this latter was closed)</li>
  </ul>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2020-12-05T10:01:37.617Z
Answers.LastActivityDate: 2020-12-05T10:16:01.960Z
Answers.LastEditDate: 2020-12-05T10:16:01.960Z
Answers.UserDisplayName: SharkCaller
Body: <h3>Question</h3>
  <p>Is there a data file somewhere containing every single (FIDE) rated game?</p>
  <h3>What I found out so far</h3>
  <p>I see many websites with some limited database search capability, or summary statistics, but I couldn't find anywhere to simply download a complete dataset of FIDE games.</p>
  <p>Such a dataset would have each row being a new game, and would hopefully also contain who played, who won, when it was played, and other info.</p>
  <h3>(Very) Rough size estimate</h3>
  <p>I estimate such a file would be quite large, which I base of some extremely rough estimates</p>
  <ul>
  <li>How many FIDE players? (probably) tens of thousands</li>
  <li>How many games on average per year? Probably hundreds</li>
  <li>Therefore 10000 * 500 = 5m games per year</li>
  <li>5m games per year * <a href="https://www.google.com/search?q=when+was+fide+formed" rel="nofollow noreferrer">about 100 years</a> comes to about 500m rows</li>
  </ul>
  <p>If each row is approximately 1kb, the total file size (uncompressed) would be: half a terabyte!</p>
  <p>But still, tools like spark or bigquery could easily handle this, and it would be fun to analyse if it is available somewhere in its entirety.</p>
  
Tags: <fide><database><statistics>
Title: Is there a data file available (e.g. a .csv) containing every single rated game?
ThreadText: # Is there a data file available (e.g. a .csv) containing every single rated game?
  
  (Asked by: username_0 on 2020-12-05)
  
  ### Question
  
  Is there a data file somewhere containing every single (FIDE) rated game?
  
  ### What I found out so far
  
  I see many websites with some limited database search capability, or summary statistics, but I couldn't find anywhere to simply download a complete dataset of FIDE games.
  
  Such a dataset would have each row being a new game, and would hopefully also contain who played, who won, when it was played, and other info.
  
  ### (Very) Rough size estimate
  
  I estimate such a file would be quite large, which I base of some extremely rough estimates
  
  * How many FIDE players? (probably) tens of thousands
  * How many games on average per year? Probably hundreds
  * Therefore 10000 \* 500 = 5m games per year
  * 5m games per year \* [about 100 years](https://www.google.com/search?q=when+was+fide+formed) comes to about 500m rows
  
  If each row is approximately 1kb, the total file size (uncompressed) would be: half a terabyte!
  
  But still, tools like spark or bigquery could easily handle this, and it would be fun to analyse if it is available somewhere in its entirety.
  
  **Tags:** fide, database, statistics
  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_1 on 2020-12-05. Score: 4
  
  > Is there a data file somewhere containing every single (FIDE) rated
  > game?
  
  As an arbiter I can tell you definitively that the answer is "No". However you don't need to be an arbiter to know that. You just need to have played in a FIDE rated blitz tournament. Nobody is writing the moves down in those tournaments.
  
  In FIDE rapid tournaments you do get a few players who start out recording but many of them stop when they get short of time and those games don't end up in databases.
  
  Even when it comes to standard time control FIDE rated games only those games played in norm events have to be sent to FIDE (to make sure there is no cheating to get titles like GM and IM). So, all games played in norm events should be recorded and sent to FIDE. For each such tournament the games should be available for download from the FIDE site and those games will be picked up by the spiders / web-crawlers used by the big database providers.
  
  However the large majority of FIDE rated standard games are not played in norm events and so there is no requirement for arbiters and organizers to send those games to FIDE. Doing so is hard (unpaid) work and so most arbiters and organizers are not going to do it.
  
  
  ---
  
  ### Answer by username_2 on 2020-12-05. Score: 2
  
  It would be fun to create a decission tree based on all those games, however, I don´t think there´s anything like that, at least publicly. Besides, you´re probably making an understimation, as right now there are 360,000 fide rated players.
  
  The biggest public chessdatabases are
  
  * Chess Microbase
  * Chess Tempo
  * Chess-DB (and I think this latter was closed)
  
  
  ---
  
  