title: How to scrape dynamic content from a website?
body: <p>So I'm using scrapy to scrape a data from Amazon books section. But somehow I got to know that it has some dynamic data. I want to know how dynamic data can be extracted from the website. Here's something I've tried so far:</p>
  
  <pre><code>import scrapy
  from ..items import AmazonsItem
  
  class AmazonSpiderSpider(scrapy.Spider):
      name = 'amazon_spider'
      start_urls = ['https://www.amazon.in/s?k=agatha+christie+books&amp;crid=3MWRDVZPSKVG0&amp;sprefix=agatha%2Caps%2C269&amp;ref=nb_sb_ss_i_1_6']
  
      def parse(self, response):
          items =  AmazonsItem()
          products_name = response.css('.s-access-title::attr("data-attribute")').extract()
          for product_name in products_name:
              print(product_name)
          next_page = response.css('li.a-last a::attr(href)').get()
              if next_page is not None:
                  next_page = response.urljoin(next_page)
                  yield scrapy.Request(next_page, callback=self.parse)
  </code></pre>
  
  <p>Now I was using SelectorGadget to select a class which I have to scrape but in case of a dynamic website, it doesn't work.</p>
  
  <ol>
  <li>So how do I scrape a website which has dynamic content?</li>
  <li>what exactly is the difference between dynamic and static content?</li>
  <li>How do I extract other information like price and image from the website? and how to get particular classes for example like a price?  </li>
  <li>how would I know that data is dynamically created?</li>
  </ol>