The construction of the focused web–crawler using the universal kernel

Infocommunication Technologies

The paper presents the universal kernel architecture of the web-crawler (created by the authors for the webometric research of information sources in the web-space and the construction of the focused web-crawlers), the quality indicators of different types of the web-crawlers and the main problems of foreign analogues. It also describes an experiment where compared the performance of the web-crawlers, based on universal kernel, with its foreign analogues.