title: How to make a web crawler which visits the links obtained as search results on user queried information?
body: <p>How to make a web crawler which visits the links obtained as search results on user queried information ? Say,if user gives some query about some subject,crawler must visits some of the top links only.Can anyone tell me how to accomplish that ?</p>