Understanding the Semantics of a Mixed Reality Environment

Abstract

Objectives: The objective of this paper is to explore how mixed reality can be enhanced with actual understanding of the recognized objects. Methods: This paper will conceptually utilize a method called MEASUR semantic analysis and explain how it can improve the semantic understanding of the environment. The paper explains how a MEASUR Ontology Chart, that captures the semantics of a mixed reality environment can be generated and how it can increase the user interaction with the mixed environment. Findings: Mixed reality is a new field of research that aims to enhance our reality with computer generated 3D graphics, also known as holograms. Additionally, it allows the user to interact with virtual and real objects. Even though we are still at the beginning of exploring its potentials, mixed reality is expected to be a game changer in most aspects of our everyday life. A major problem with the current state of art mixed reality applications is that they have very limited understanding about the real-world environment. They are utilizing computer vision approaches for identifying objects from the real world but yet again there is no real association between the various objects and limited or no understanding of their semantics. This limits the supported interaction between the users and mixed reality environment. Application/Improvements: This paper will conceptually utilize a method called MEASUR semantic analysis and explain how it can improve the semantic understanding of the environment. The paper explains how a MEASUR Ontology Chart, that captures the semantics of a mixed reality environment can be generated and how it can increase the user interaction with the mixed environment.