Composition of virtual-real worlds and intelligence integration ofhuman-computer in mixed reality

Abstract

Recent rapid developments in mixed reality and virtual reality have attracted worldwide attention. This technology has prospective uses in education, medicine, video games and other fields. Mixed reality is the composite of a virtual world and the real world, typically with virtual objects incorporated into a view-dependent visual scene. A wearable head-mounted display provides a basic tool for immersion in mixed reality scenes, and a computer provides virtual scenes that coordinate with the real world. The composition of virtual and real scenes is essentially the inter-embedding of different temporal and spatial scenes, and depends on interactions with spatial geometry and illumination of the environment, namely geometrical consistency and illumination consistency. In the sociological sense, the composition must also follow the law of human sociology and psychology, that is, behavioral consistency. Mixed reality provides a natural and intuitive interface between users and real and virtual worlds. Mixed reality, through the understanding of human action and behavior, intuitively connects the virtual and real world. Humans can understand the world through the observation of the composition of the virtual and real scenes, and immediately influence the virtual world through natural interaction, receiving intelligent feedback from the computer. Thus, immersive interaction and deep interaction between humans and computers can be realized. Technological improvements from non-wearable to wearable devices have allowed mixed reality to gain immersion; in advancing from static scenes to dynamic scenes, mixed reality gained social attributes; and progressing from specific virtual scenes to semantic analysis and visualization of big data, mixed reality becomes a platform for the integration of human and computer intelligence.