Title: Hello HN!<p>As part of my learning in data science, I need&#x2F;want to gather data. One relatively easy way to do that is web scraping.<p>However I&#x27;d like to do that in a respectful way. Here are three things I can think of:<p>1. Identify my bot with a user agent&#x2F;info URL, and provide a way to contact me
2. Don&#x27;t DoS websites with tons of request.
3. Respect the robots.txt<p>What else would be considered good practice when it comes to web scraping?
Upvote: