I was trying to scrape data from a website.
The code is working but the site blocks my IP address when I was trying to scrape all scrolling pages. Please let me know if there is any suggestions on how to solve this problem. Thanks
You could use proxies.
Ip-addresses can be bought very cheaply then you can iterate through a list of IP-addresses while simultaneously varying your browser and other user agent parameters.
How to prevent IP blocking while scraping data