title: ssl handshake failure error in scrapy python
body: <p>Presently i am working on scrapy and following is my spider.py code</p>
  
  <pre><code>class Example(BaseSpider):
      name = "example"
      allowed_domains = {"http://www.example.com"}
  
  
      start_urls = [
          "https://www.example.com/rwjhamilton/index.cfm?&amp;ijobcatid=100&amp;ijobrowset=1&amp;cjobattr1=All&amp;template=dsp_job_list.cfm"
      ]
  
  
      def parse(self, response):
          hxs = HtmlXPathSelector(response)
          href_tags = hxs.select('//font[@class="bannertext"]/u/a/@href').extract()
          print href_tags,"&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;&gt;"
  </code></pre>
  
  <p><strong>Result :</strong></p>
  
  <pre><code>2012-07-19 17:32:20+0530 [example] ERROR: Error downloading &lt;GET https://www.example.com/rwjhamilton/index.cfm?&amp;ijobcatid=100&amp;ijobrowset=1&amp;cjobattr1=All&amp;template=dsp_job_list.cfm&gt;: [('SSL routines', 'SSL23_READ', 'ssl handshake failure')]
  </code></pre>
  
  <p>This error seems very new to scrapy and really i don't know how to solve this, can anyone let me know why this error came and how to solve it.
  Actually i am trying to collect the href tags in the above url and it seems there totally 40 href tags</p>
  
  <p>Also sometimes the response is downloading and sometimes it is displaying </p>
  
  <pre><code>2012-07-19 17:39:15+0530 [example] DEBUG: Retrying &lt;GET https://www.example.com/rwjhamilton/index.cfm?&amp;ijobcatid=100&amp;ijobrowset=1&amp;cjobattr1=All&amp;template=dsp_job_list.cfm&gt; (failed 1 times): Connection to the other side was lost in a non-clean fashion
  </code></pre>
  
  <p>Please let me know how to solve this.
  Thanks in advance.....</p>