A reliability based approach for securing migrating crawlers

Abstract

Using migrating crawling agents (migrants) based methods, selection and filtration of web documents can be done at web servers rather than search engine side. It helps in reducing the network load significantly, caused by the web crawlers. Since a migrant roams around the web and executes on remote platform, the security problems have become hindrance for development and maintenance of mobile agent technology. So, there is a need to develop secured migrating agents and to fix issues like maintaining security and integrity of the agent, data it carries and the remote platform on which it executes. This paper presents a remote platform oriented reliability based approach that is helpful in maintaining security and integrity of migrants as well as for data it carries and the remote platform.