I am using Python Beautiful Soup for website Scrapping. My program hits different urls of a website more than thousand times. I don not wish to get banned. As a first step, I would like to introduce IPmasking in my project.
Is there any possible way to hit different urls of a website from a pool of rotating IPs with the help of Python modules like ipaddress, socket etc?
The problem is your public IP address. What you can do is use a list of proxy's and rotate through them.
IP masking with Python