Difference between BeautifulSoup and Scrapy crawler?
Beautifulsoup is web scraping small library. it does your job but sometime it does not satisfy your needs.i mean if you scrape  websites in large amount of data  so here in this case beautifulsoup fails.
In this case  you should use Scrapy which is  a complete  scraping framework  which will do you job.
Also scrapy has support for databases(all kind of databases) so it is a huge
of scrapy over other web  scraping libraries.
I want to make a website that shows the comparison between amazon and e-bay product price.
Which of these will work better and why? I am somewhat familiar with BeautifulSoup but not so much with Scrapy crawler.