I've started to learn python the past couple of days. I want to know the equivalent way of writing crawlers in python.
so In ruby I use:

nokogiri for crawling html and getting content through css tags
Net::HTTP and Net::HTTP::Get.new(uri.request_uri).body for getting JSON data from a url

what are equivalents of these in python?
Between lxml and beautiful soup, lxml is more equivalent to nokogiri
because it is based on libxml2 and it has xpath/css support.
The equivalent of net/http is urllib2
Going from Ruby to Python : Crawlers