title: Giving a list as an argument to a Scrapy scraper
body: <p>I want to be able to give a list of urls as an argument to my scrapy scraper so that I can iterate on it at regular intervals to avoid 403 errors. For the moment I don't think Scrapy allows me to do this.</p>
  <pre><code>scrapy crawl nosetime -o results.jl ['/pinpai/10036120-yuguoboshi-hugo-boss.html', '/pinpai/10094164-kedi-coty.html', '/pinpai/10021965-gaotiye-jean-paul-gaultier.html', '/pinpai/10088596-laerfu-laolun-ralph-lauren.html']
  </code></pre>
  <p>Or else a file of urls.</p>
  <p>For the moment these urls are hard written in my spider:</p>
  <pre><code>import scrapy
  from ..pipelines import NosetimeScraperPipeline
  import time
  
  headers = {'User-Agent':'Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0; TencentTraveler 4.0; Trident/4.0; SLCC1; Media Center PC 5.0; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30618)'}
  base_url = 'https://www.nosetime.com'
  
  class NosetimeScraper(scrapy.Spider):
      name = &quot;nosetime&quot;
  
      urls = ['/pinpai/10036120-yuguoboshi-hugo-boss.html', # I want to get rid of this
              '/pinpai/10094164-kedi-coty.html',            # unless I can use something like time.sleep(12*60*60)
              '/pinpai/10021965-gaotiye-jean-paul-gaultier.html', # for each before being taken as argument
              '/pinpai/10088596-laerfu-laolun-ralph-lauren.html']
  
      start_urls = ['https://www.nosetime.com' + url for url in urls]
      base_url = 'https://www.nosetime.com'
  
      def parse(self, response):
          # proceed to other pages of the listings
          urls = response.css('a.imgborder::attr(href)').getall()
          for url in urls:
              print(&quot;url: &quot;, url)
              yield scrapy.Request(url=base_url + url, callback=self.parse)
  
          # now that we have the urls we need to know if the dire are the things we can scrape
          pipeline = NosetimeScraperPipeline()
          perfume = pipeline.process_response(response)
          try:
              if perfume['enname']:
                  print(&quot;Finally are going to store: &quot;, perfume['enname'])
                  pipeline.save_in_mongo(perfume)
          except KeyError:
              pass
  </code></pre>