I've got an issue with scrapy and python.
I have several links. I crawl data from each of them in one script with the use of loop. But the order of crawled data is random or at least doesn't match to the link.
So I can't match url of each subpage with the outputed data.
Like: crawled url, data1, data2, data3.
Data 1, data2, data3 => It's ok, because it comes from one loop, but how can I add to the loop current url or can I set the order of link's list? Like first from the list is crawled as first, second is crawled as second...
Ok, It seems that the solution is in settings.py file in scrapy.
DOWNLOAD_DELAY = 3   
Between requests.
It should be uncommented. Defaultly it's commented.
Scrapy - order of crawled urls