Web Scraping in 2016
And from the trenches:<p>- rails application<p>- scraping with nokogiri gem on Ruby<p>- simple models doing the scraping in rails app<p>- some scraping is parsed with CSS selectors - nokogiri<p>- some scraping is parsed with regex - nokogiri<p>- persisting to DB, Text, even Google docs<p>- presentation on web, text, pdf, xls<p>Boom