title: implementation of selenium as webCrawler
body: <p>I am writing a web crawler via Selenium in java. Previously I used libraries like jsoup and HtmlUnit to make them but recently I ran into trouble with javascript and ajax dependent pages.<br/><br/>After doing some google I think Selenium is a good option in the sense it perfectly  loads the page I want. But I am worried it will become too slow. <br/><br/>Was Selenium a good choice for spiders ?? and are there examples of Spiders based on Selenium I can refer to ???</p>