Focused crawlers are considered as a promising way to tackle the scalability problem of topic-oriented or personalized search engines. To design a focused crawler, the choice of strategy for prioritizing unvisited URLs is crucial. In this paper, we propose a method using a decision tree on anchor texts of hyperlinks. We conducted experiments on the real data sets of four Japanese universities and verified our approach.
['Jun Li', 'Kazutaka Furuse', 'Kazunori Yamaguchi']
Focused crawling by exploiting anchor text using decision tree