Is there a way to have more than 2 spiders crawling different websites in one project using Scrapy?
If you can share any code between spiders (item base class, middleware, etc.), I would go for a single project.
If you have spider-specific items, pipelines or middleware, you can always define those on the spider Python files themselves.
I have around 10 websites I need to scrape some data off from. I'm using Scrapy, and I need to know if I have to make 10 separate projects (one for each website) or 10 spiders in a single project?