A mixed reality platform based on Linux X -Windowing system

Abstract

Mixed reality platform is the mixing of real and virtual world where objects from both worlds co-exist and are able to interact with each other. The goal is to design a Linux based Mixed Reality Platform with the capability to place X Windows and three dimensional virtual objects in the Virtual/Augmented environment. This means that, unlike some of the mixed reality platforms existing in the current generation of Mixed Reality devices, any application program that draws its GUI on the X-Windowing System can be viewed and interacted with in mixed reality. This can be achieved without making any changes to the source code by the third-party developer. The platform will also allow special “3D Applications” (applications with actual three dimensional representation) to be made and run using a new Application Programming Interface. The platform will mainly consist of a Window Manager and a Mixed Reality Compositing Manager alongside other programs to form a desktop environment. This environment will universally enable Linux GUI applications to work in mixed reality. A major contribution of this concept is towards extending a user's computing environment so that the user can interact with the applications beyond the bounds of a physical screen. An adaptive Linux based platform is to be constructed which can run on a variety of hardware form factors like phones, personal computers and mixed reality headsets.