Order of crawling in Scrapy
I wrote a basic CrawlSpider in scrapy but I want to understand what is the order in which the urls are crawled - FIFO / LIFO?

I want that the crawler should crawl all the links in the start url page and then move on to other URLs which does not seem to be the order.

How can I do this?
Order of crawling in Scrapy
===

I wrote a basic CrawlSpider in scrapy but I want to understand what is the order in which the urls are crawled - FIFO / LIFO?

I want that the crawler should crawl all the links in the start url page and then move on to other URLs which does not seem to be the order.

How can I do this?