I'm looking for ways to scrape all tables on a certain website. The tables are formatted exactly the same in all subpages. The problem is, the urls of those subpages are in this way:
url1 = 'http.../Tom',
url2 = 'http.../Mary',
url3 = 'http.../Jason', such that I cannot set a loop by altering the url incrementally. Are there any possible ways to solve this by pandas?
Another idea would be to use BeautifulSoup library first and get all the table elements from a webpage and then apply pd.read_html()
Is it possible to use pandas to scrape html tables over multiple web pages?