Abstract
Mental image directed semantic theory (MIDST) has proposed an omnisensory mental image model and its description languageLmd. This language is designed to represent and compute human intuitive knowledge of space and can provide multimedia expressions with intermediate semantic descriptions in predicate logic. It is hypothesized that such knowledge and semantic descriptions are controlled by human attention toward the world and therefore subjective to each human individual. This paper describesLmdexpression of human subjective knowledge of space and its application to aware computing in cross-media operation between linguistic and pictorial expressions as spatial language understanding.
Highlights
The serious need for more human-friendly intelligent systems has been brought by rapid increase of aged societies, floods of multimedia information over the WWW, development of robots for practical use, and so on
The author has confirmed that the hybrid program in Python employing Lmd expression mainly and partially symbolized direct knowledge of space (PSDKS) auxiliarly as shown in Figure 11 is much more flexible and efficient than the previous one [4] in PROLOG for solving problems expressed in spatial language
mental image directed semantic theory (MIDST) is still under development and intended to provide a formal system, represented in Lmd, for natural semantics of space and time. This formal system is one kind of applied predicate logic consisting of axioms and postulates subject to human perceptive processes of space and time, while the other similar systems in Artificial Intelligence [17,18,19] are objective, namely, independent of human perception and do not necessarily keep tight correspondences with natural language
Summary
The serious need for more human-friendly intelligent systems has been brought by rapid increase of aged societies, floods of multimedia information over the WWW, development of robots for practical use, and so on. In order to systematize cross-media operation, it is needed to develop such a computable knowledge representation language for multimedia contents that should have at least a good capability of representing spatiotemporal events perceived by people in the real world. For this purpose, mental image directed semantic theory (MIDST) has proposed a model of human mental image and its description language Lmd (Language for mental-image description) [4]. This paper focuses as well on the hybrid computation guided by Lmd expression and 3D map data, here so-called partially symbolized direct knowledge of space (PSDKS), in crossmedia operation between linguistic and pictorial expressions as spatial language understanding. Some discussion and conclusion are given in the final section
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
