Answers.Body: <p>Related questions:</p>
  
  <ul>
  <li><a href="https://cseducators.stackexchange.com/q/1394/2068">Good datasets for intro CS courses?</a></li>
  <li><a href="https://cseducators.stackexchange.com/q/3962/2068">Toy Databases for Class Examples/Homeworks</a></li>
  </ul>
  
  <p>There are a few Stack Exchange sites you might want to check out:</p>
  
  <ul>
  <li><p><a href="https://opendata.stackexchange.com/">Open Data</a>: Open Data Stack Exchange is a question and answer site for developers and researchers interested in open data.</p></li>
  <li><p><a href="https://datascience.stackexchange.com/">Data Science</a>: Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field.</p></li>
  <li><p><a href="https://stats.stackexchange.com/">Cross Validated</a>: Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.</p></li>
  </ul>
  
  <p><a href="https://www.kaggle.com/" rel="nofollow noreferrer">Kaggle</a> also offers a bunch of example datasets and a bunch of real-world problems that can be used in a class.</p>
  
  <p>But taking a step back, you might want to teach the meta-lesson of finding data in the real world. There are a ton of APIs and open-source data repos out there, and finding them is a very important skill by itself- plus it give students a way to actually use their skills after the class ends.</p>
  
  <p>So instead of just giving your students a flat file, have them come up with their own. Maybe they use an API from a product they use, like <a href="https://dev.twitter.com/rest/public" rel="nofollow noreferrer">Twitter</a>, <a href="https://developer.spotify.com/web-api/" rel="nofollow noreferrer">Spotify</a>, or <a href="https://developers.google.com/youtube/" rel="nofollow noreferrer">YouTube</a>. If that's too advanced for the students to do, then maybe you spend a class coming up with the dataset together, with you writing the code and the students talking about what would be interesting to see.</p>
  
  <p>Or just searching for "XYZ datasets" returns a ton of results. Have the students come up with datasets related to stuff they're interested in.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2018-06-18T21:39:23.707Z
Answers.LastActivityDate: 2018-06-18T21:39:23.707Z
Answers.UserDisplayName: Kevin Workman
Body: <p>I currently utilize Cloudera’s QuickStart VM and for Talend’s Big Data Sandbox as part of my big data classes. These touch on frameworks, storage / data access options, data integration, data quality, data governance, and search.</p>
  
  <p><strong>What resources do you use and would suggest for hands on big data labs?</strong> Perhaps something for Snowflake, AWS, or Azure to catch cloud aspects of big data? Or some compelling big data tutorials for an analytics tool? <strong>Are there curated big data sets especially appropriate for educational use?</strong></p>
  
  <p>I work for a Talend; but also teach big data classes at Washington University in St. Louis. </p>
  
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-11T08:05:13.963Z
Comments.Text: On why you may have been voted down (you seem to have been voted down, why I think this is): This question seems more about training than education. Computer science is about enduring principles, not fad of the month, and products. Though every fad will contain many enduring principles (for they are enduring).
Comments.UserDisplayName: ctrl-alt-delor
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-12T00:25:04.160Z
Comments.Text: The intent is for course development, or really course improvement since I have taught the class a few times. Given I teach professional, just theory doesn’t meet their needs. That said, I can see the point of responses being ephemeral.
Comments.UserDisplayName: Christopher Klaus
Comments.ContentLicense: CC BY-SA 3.0
Comments.CreationDate: 2018-04-12T17:26:20.517Z
Comments.Text: This seems like a fine question to me.  I don't personally have an answer, but it certainly seems within scope.  I hope you get some great answers.
Comments.UserDisplayName: Ben I.
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-06-16T10:05:16.130Z
Comments.Text: Are you asking for big data sets, or for the tools. I heard of some organisation that has collected some big data sets for educators. Can't remember who. I am in UK, I was at a CAS meeting in Guildford (that may be where I heard it, maybe).
Comments.UserDisplayName: ctrl-alt-delor
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2018-06-16T16:57:42.600Z
Comments.Text: Revised to include big data sets for education.
Comments.UserDisplayName: Christopher Klaus
Tags: <labs>
Title: What resources and data sets are available for teaching big data courses?
ThreadText: # What resources and data sets are available for teaching big data courses?
  
  (Asked by: username_0 on 2018-04-11)
  
  I currently utilize Cloudera’s QuickStart VM and for Talend’s Big Data Sandbox as part of my big data classes. These touch on frameworks, storage / data access options, data integration, data quality, data governance, and search.
  
  **What resources do you use and would suggest for hands on big data labs?** Perhaps something for Snowflake, AWS, or Azure to catch cloud aspects of big data? Or some compelling big data tutorials for an analytics tool? **Are there curated big data sets especially appropriate for educational use?**
  
  I work for a Talend; but also teach big data classes at Washington University in St. Louis.
  
  **Tags:** labs
  
  > **Comments:**
  > **username_1**: On why you may have been voted down (you seem to have been voted down, why I think this is): This question seems more about training than education. Computer science is about enduring principles, not fad of the month, and products. Though every fad will contain many enduring principles (for they are enduring).  
  > **username_0**: The intent is for course development, or really course improvement since I have taught the class a few times. Given I teach professional, just theory doesn’t meet their needs. That said, I can see the point of responses being ephemeral.  
  > **username_2**: This seems like a fine question to me.  I don't personally have an answer, but it certainly seems within scope.  I hope you get some great answers.  
  > **username_1**: Are you asking for big data sets, or for the tools. I heard of some organisation that has collected some big data sets for educators. Can't remember who. I am in UK, I was at a CAS meeting in Guildford (that may be where I heard it, maybe).  
  > **username_0**: Revised to include big data sets for education.  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_3 on 2018-06-18. Score: 1
  
  Related questions:
  
  * [Good datasets for intro CS courses?](https://cseducators.stackexchange.com/q/1394/2068)
  * [Toy Databases for Class Examples/Homeworks](https://cseducators.stackexchange.com/q/3962/2068)
  
  There are a few Stack Exchange sites you might want to check out:
  
  * [Open Data](https://opendata.stackexchange.com/): Open Data Stack Exchange is a question and answer site for developers and researchers interested in open data.
  * [Data Science](https://datascience.stackexchange.com/): Data Science Stack Exchange is a question and answer site for Data science professionals, Machine Learning specialists, and those interested in learning more about the field.
  * [Cross Validated](https://stats.stackexchange.com/): Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization.
  
  [Kaggle](https://www.kaggle.com/) also offers a bunch of example datasets and a bunch of real-world problems that can be used in a class.
  
  But taking a step back, you might want to teach the meta-lesson of finding data in the real world. There are a ton of APIs and open-source data repos out there, and finding them is a very important skill by itself- plus it give students a way to actually use their skills after the class ends.
  
  So instead of just giving your students a flat file, have them come up with their own. Maybe they use an API from a product they use, like [Twitter](https://dev.twitter.com/rest/public), [Spotify](https://developer.spotify.com/web-api/), or [YouTube](https://developers.google.com/youtube/). If that's too advanced for the students to do, then maybe you spend a class coming up with the dataset together, with you writing the code and the students talking about what would be interesting to see.
  
  Or just searching for "XYZ datasets" returns a ton of results. Have the students come up with datasets related to stuff they're interested in.
  
  
  ---
  
  