Text understanding using a two‐dimensional spatial imagery

Abstract

AbstractThis paper describes the framework of a system that can understand a textbook for machine operation, based on the model of an object world that can retain informations not only by symbolic representation but also by image. In any understanding of the description for machine operation, spatial information is important, and there must be a model that can retain the informations with natural reflection of the continuity and relative location, independently of the particular point of observation. Such a representation is difficult, dealing only with the symbolic knowledge representation used in the conventional language understanding system. From such a viewpoint, this paper notes the usefulness of the representation by the image and proposes the imagery object world model, which can utilize partially the properties of the image, using mathematical expressions in a two‐dimensional real coordinate system. Mechanisms both to execute the simulation on the proposed model and to read the text using the simulation mechanism, are investigated. A system is constructed experimentally based on the proposed idea, which can construct the model for the input sentence, while executing a simulation and generating symbolic recognition expressions. With those functions, the identity or the similarity of the language expressions derived from the same object or event from different viewpoints, can adequately be decided.