I am scraping a webpage. The webpage consists of 50 entries. After 50 entries it gives a 
Load more reults button. I need to automatically select it. How can I do it. For scraping I am using Python, Lxml.
You can't do that. The functionality is provided by javascript, which lxml will not execute.
How to select "Load more results" button when scraping using Python & lxml