Topical crawler the hits algorithm

Mathematical Modelling: Methods, algorithms, technologies
Authors:
Abstract:

The paper presents the functional principles of operation of a focused Web-crawler, its algorithm of traversal of Web-space, based on a modified version of Kleinberg's HITS algorithm. Examples and estimations of the new Web-crawler performance over both local (within a domain) and regional (Russian) Web-spaces are given along with a detailed comparison with the standard Web-crawler results.