Title: https:&#x2F;&#x2F;bigquery.cloud.google.com&#x2F;table&#x2F;fh-bigquery:hackernews.comments<p>The dataset is up-to-date for October 2015 and uses the official HN API as a data source. (Unfortuntely, this includes the HTML formatting in the comments) Dataset is about 4GB total; since BigQuery allows for 1000GB processing for free each month, it is effectively no cost to analyze.<p>Felipe Hoffa (who uploaded the dataset) has links to the dataset along with some sample Python code for analysis: https:&#x2F;&#x2F;github.com&#x2F;fhoffa&#x2F;notebooks&#x2F;blob&#x2F;master&#x2F;analyzing%20hacker%20news.ipynb<p>I have a few scripts for downloading all the data manually (https:&#x2F;&#x2F;github.com&#x2F;minimaxir&#x2F;get-all-hacker-news-submissions-comments ), but the BigQuery table may be more pragmatic. I can do some more sample queries if requested. (See my BigQuery tutorial for Reddit data: http:&#x2F;&#x2F;minimaxir.com&#x2F;2015&#x2F;10&#x2F;reddit-bigquery&#x2F; )
Upvote: