I do a lot of scraping specific pages and often have to auth, form-fill, refresh, recurse, use a custom SSL&#x2F;TLS adapter, etc., in order to get what I&#x27;m after. I&#x27;m sure Scrapy would be great if I just had a giant queue of GET requests. Also, don&#x27;t get me started on the Reactor.