Automatic construction and management of large open webs

Abstract

Many researchers have noted the problems associated with manually created or maintained hyperdocument links, and the consequent need for automated methods. A number of techniques have been applied to the problem, including pattern-matching, information retrieval, and natural language processing. This paper describes a system for the automatic detection and management of structural and referential links. The paper also addresses the issues of link-set soundness and completeness, open link management, and the particular problems engendered by large volatile hyperbases.