Title: I have been web scraping for several months and am starting to teach it at Meetups. I&#x27;m lucky enough to work for a company that has a few pre-crawled copies of the web that I can query against and a distributed processing platform to speed up any scraping I do.<p>I&#x27;m running out of ideas of what to build though. I build scrapers to produce content for the company based on the data and insights I find. They are usually marketing verticals though, such as finding all websites using feedback tools (I search based on their javascript widgets), and do analysis on that info.<p>So if you had these resources, what would you be looking for? I love building tools that help people so any feedback&#x2F;ideas would be great!<p>I&#x27;m also open to hearing what you would scrape for on the live web.  I find that if I&#x27;m doing broad analysis then the pre-crawled copies are best, and for specific sites&#x2F;information I use the live web.
Upvote: