Abstract
This paper describes a methodology to provide robots with capability of integrative multimedia understanding centered in natural language understanding (NLU) and its recent application to cross-media operation between linguistic and pictorial representations such as town maps and animations of robotic action. The core of the methodology is based on the mental image directed semantic theory (MIDST). MIDST is intended to simulate omnisensory mental imagery in human and to afford a knowledge representation system in order for integrative management of knowledge subjective to cognitive mechanisms of intelligent entities such as humans and robots based on a mental image model and its representation in the formal language Lmd. At present stage, the developed NLU system is still experimental with a small vocabulary (about 100 words) but can perform human-like cross-media operation as well as expected.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
