Virtual Display Research Articles

Research on Virtual Reality Head-Mounted Displays based on MEMS Technology

In order to render the gaze area and increase the pixels per degree of the area, this virtual reality head-mounted display device adds two MEMS 2D miniature scanning mirrors to the main display imaging, with a laser diode as the projection light source and the main display as the projection receiving screen. The light emitted by the laser lamp is projected onto the main display through multiple reflections. Through pre-processing of the image of the main display and the projected display, the image of the main display is combined with the projected image to achieve the rendering effect. It is integrated with an eye tracking system that allows the projected image to be consistently projected on the human eye area. The projection image is projected over the entire imaging area of the main display by resonant rotation of two MEMS 2D microscope mirrors.

RESEARCH ON THE DIGITAL EXHIBITION OF CULTURAL RELICS FOR CROSS-CULTURE COMMUNICATION: CASE STUDY ON CHINA-GREECE COOPERATION ON TERRACOTTA WARRIORS

Abstract. With epidemics blocking offline interactions, it is difficult to organise events such as tours of major heritage sites and outbound exhibitions of cultural relics, and new paths need to be expanded for the presentation of cultural heritage and intercultural education efforts. With the booming development of digital technology, the integration of online virtual presentation and interactive technology and the innovative design of 3D scenes provide new solutions for the intercultural communication of these precious and immovable cultural relics (e.g. archaeological sites), etc. This project is based on the Sino-Greek cooperation around the online presentation of heritage items such as the Terracotta Warriors and Horses of China and the precious collection of the National Archaeological Museum of Greece, in order to present and On the basis of communicating the value of heritage and the connection between Chinese and Greek civilisations, the project explores the development of a virtual space that integrates the Terracotta Warriors and Horses pits, the interactive virtual display of cultural relics, and the display of the achievements of scientific and technological conservation of cultural relics, so as to realise the cross-cultural exchange between China and Greece and fulfil the educational function of heritage.

Inducing Perceptual Dominance with Binocular Rivalry in a Virtual Reality Head-Mounted Display

Binocular rivalry is the perceptual dominance of one visual stimulus over another. Conventionally, binocular rivalry is induced using a mirror-stereoscope—a setup involving mirrors oriented at an angle to a display. The respective mirror planes fuse competing visual stimuli in the observer’s visual field by projecting the stimuli through the stereoscope to the observed visual field. Since virtual-reality head-mounted displays fuse dichoptic vision in a similar way, and since virtual-reality head-mounted displays are more versatile and more readily available than mirror stereoscopes, this study investigated the efficacy of using a virtual-reality headset (Oculus Rift-S) as an alternative to using a mirror stereoscope to study binocular rivalry. To evaluate the validity of using virtual-reality headsets to induce visual dominance/suppression, two identical experimental sequences—one using a conventional mirror stereoscope and one using a virtual-reality headset—were compared and evaluated. The study used Gabor patches at different orientations to induce binocular rivalry and to evaluate the efficacy of the two experiments. Participants were asked to record all instances of perceptual dominance (complete suppression) and non-dominance (incomplete suppression). Independent sample t-tests confirmed that binocular rivalry with stable vergence was successfully induced for the mirror-stereoscope experiment (t = −4.86; p ≤ 0.0001) and the virtual-reality experiment (t = −9.41; p ≤ 0.0001). Using ANOVA to compare Gabor patch pairs of gratings at +45°/−45° orientations presented in both visual fields, gratings at 0°/90° orientations presented in both visual fields, and mixed gratings (i.e., unconventional grating pairs) presented in both visual fields, the performance of the two experiments was evaluated by comparing observation duration in seconds (F = 0.12; p = 0.91) and the alternation rate per trial (F = 8.1; p = 0.0005). The differences between the stimulus groups were not statistically significant for the observation duration but were significantly different based on the alternation rates per trial. Moreover, ANOVA also showed that the dominance durations (F = 114.1; p < 0.0001) and the alternation rates (F = 91.6; p < 0.0001) per trial were significantly different between the mirror-stereoscope and the virtual-reality experiments, with the virtual-reality experiment showing an increase in alternation rate and a decrease in observation duration. The study was able to show that a virtual-reality head-mounted display can be used as an effective and novel alternative to induce binocular rivalry, but there were some differences in visual bi-stability between the two methods. This paper discusses the experimental measures taken to minimise piecemeal rivalry and to evaluate perceptual dominance between the two experimental designs.

Frequency dependence of coordinated pupil and eye movements for binocular disparity tracking.

Coordinated alignment of the eyes during gaze fixation and eye movements are an important component of normal visual function. We have previously described the coordinated behavior of convergence eye movements and pupillary responses using a 0.1 Hz binocular disparity-driven sine profile and a step profile. The goal of this publication is to further characterize ocular vergence-pupil size coordination over a wider range of frequencies of ocular disparity stimulation in normal subjects. Binocular disparity stimulation is generated by presentation of independent targets to each eye on a virtual reality display, while eye movements and pupil size are measured by an embedded video-oculography system. This design allows us to study two complimentary analyses of this motion relationship. First, a macroscale analysis describes the vergence angle of the eyes in response to binocular disparity target movement and pupil area as a function of the observed vergence response. Second, a microscale analysis performs a piecewise linear decomposition of the vergence angle and pupil relationship to permit more nuanced findings. These analyses identified three main features of controlled coupling of pupil and convergence eye movements. First, a near response relationship operates with increasing prevalence during convergence (relative to the "baseline" angle); the coupling is higher with increased convergence in this range. Second, the prevalence of "near response"-type coupling decreases monotonically in the diverging direction; the decrease persists after the targets move (converge back) from maximum divergence toward the baseline positions, with a minimum prevalence of near response segments near the baseline target position. Third, an opposite polarity pupil response is infrequent, but tends to be more prevalent when the vergence angles are at maximum convergence or divergence for a sinusoidal binocular disparity task. We suggest that the latter response is an exploratory "range-validation" when binocular disparity is relatively constant. In a broader sense, these findings describe operating characteristics of the near response in normal subjects and form a basis for quantitative assessments of function in conditions such as convergence insufficiency and mild traumatic brain injury.

The development of training platform for CiADS using cave automatic virtual environment

The project of China initiative Accelerator Driven Subcritical (CiADS) system has been started to construct in southeast China's Guangdong province since 2019, which is expected to be checked and accepted in the year 2025. In order to make the students in University of Chinese Academy of Sciences (UCAS) better understand the main characteristic and the operation condition in the subcritical nuclear facility, the training platform for CiADS has been developed based on the Cave Automatic Virtual Environment (CAVE) in the Institute of Modern Physics Chinese Academy of Sciences (IMPCAS). The CAVE platform is a kind of non-head mounted virtual reality display system, which can provide the immersive experience and the alternative training platform to substitute the dangerous operation experiments with strong radioactivity. In this paper, the CAVE platform for the training scenarios in CiADS system has been presented with real-time simulation feature, where the required devices to generate the auditory and visual senses with the interactive mode have been detailed. Moreover, the three dimensional modeling database has been created for the different operation conditions, which can bring more freedom for the teachers to generate the appropriate training courses for the students. All the user-friendly features will offer a deep realistic impression to the students for the purpose of getting the required knowledge and experience without the large costs in the traditional experimental nuclear reactor.

Using Virtual Reality Head-Mounted Displays to Assess Skills in Emergency Medicine: Validity Study.

Many junior doctors must prepare to manage acutely ill patients in the emergency department. The setting is often stressful, and urgent treatment decisions are needed. Overlooking symptoms and making wrong choices may lead to substantial patient morbidity or death, and it is essential to ensure that junior doctors are competent. Virtual reality (VR) software can provide standardized and unbiased assessment, but solid validity evidence is necessary before implementation. This study aimed to gather validity evidence for using 360-degree VR videos with integrated multiple-choice questions (MCQs) to assess emergency medicine skills. Five full-scale emergency medicine scenarios were recorded with a 360-degree video camera, and MCQs were integrated into the scenarios to be played in a head-mounted display. We invited 3 groups of medical students with different experience levels to participate: first- to third-year medical students (novice group), last-year medical students without emergency medicine training (intermediate group), and last-year medical students with completed emergency medicine training (experienced group). Each participant's total test score was calculated based on the number of correct MCQ answers (maximum score of 28), and the groups' mean scores were compared. The participants rated their experienced presence in emergency scenarios using the Igroup Presence Questionnaire (IPQ) and their cognitive workload with the National Aeronautics and Space Administration Task Load Index (NASA-TLX). We included 61 medical students from December 2020 to December 2021. The experienced group had significantly higher mean scores than the intermediate group (23 vs 20; P=.04), and the intermediate group had significantly higher scores than the novice group (20 vs 14; P<.001). The contrasting groups' standard-setting method established a pass-or-fail score of 19 points (68% of the maximum possible score of 28). Interscenario reliability was high, with a Cronbach α of 0.82. The participants experienced the VR scenarios with a high degree of presence with an IPQ score of 5.83 (on a scale from 1-7), and the task was shown to be mentally demanding with a NASA-TLX score of 13.30 (on a scale from 1-21). This study provides validity evidence to support using 360-degree VR scenarios to assess emergency medicine skills. The students evaluated the VR experience as mentally demanding with a high degree of presence, suggesting that VR is a promising new technology for emergency medicine skills assessment.

P‐126: An Introduction to GGRB Virtual Pixel Technology

The constructions of the GGRB virtual pixel and the effect on the display performance are introduced by comparing with that of the Diamond RGBG virtual pixel, a typical virtual pixel technology applied to active matrix organic light‐emitting diode (AMOLED) display. Because of the characteristic structure of GGRB sub‐ pixel arrangement, the occurrence of perceptible artificial color discontinuity is reduced in the GGRB virtual pixel display. The distribution uniformity of pixel luminance centroids is important for the display of pattern details. In the GGRB virtual pixel display, the distribution uniformity of pixel luminance centroids is achieved via a non‐uniformly distributed green sub‐pixel array of which the luminance profile is properly modulated by the red and blue sub‐pixels with lower spatial frequency distribution. The results of subjective evaluation and comparison suggest that the performance improvement of the GGRB virtual pixel display is consistent with the conceptual expectation. Some of the essential characteristics is superior to those of the reference technology.

9‐4: Late‐News Paper: Full Color Organic Light Emitting Diodes on Silicon Micro‐display with Ultra‐high Luminescence and High Resolution

In order to satisfy the special demand of AR products for ultra‐high luminescence and high resolution full‐color silicon‐based OLED micro displays, a silicon‐based OLED micro display with resolution of more than 4000 ppi (0.36 inch with 1280×720) and a luminescence of more than 5000 nit is investigated. First, the design scheme of high‐resolution silicon‐based OLED driver is introduced. Based on the scheme of strong microcavity effect OLED device, the structure of red, green and blue monochrome luminescence enhancement is verified, and the current efficiency reaches 60 cd A‐1, 95 cd A‐1 and 6 cd A‐1, respectively. Finally, the development of HD036 chip is finished, and the high luminescence full‐color silicon‐based OLED micro display device with ppi more than 4000, luminescence more than 5000 nit, and color gamut more than 85% is achieved. The effect of virtual reality overlay display is achieved by the verification of AR machine.

P‐50: Virtual Reality System Based on Field Sequence Display

Virtual Reality display system demands for extremely high definition, PPI and brightness, which may cause huge power consumption and affect system performance negatively based on traditional LCD. Relatively, RGB field sequence display provides an implementable method for LCD modules to achieve a better light transmittance by removing the color film and a higher aperture ratio by setting the RGB LED as backlight, which can lead to higher PPI, light efficiency and lower power consumption. To this end, we proposed a VR system based on field sequences display, in which the System Driving Unit, Display Module Unit, and Media Processing Unit were designed and implemented completely. As a result, an exquisite virtual reality world can be presented to its user smoothly, with the appropriate driving strategy and effective RGB field sequence display module.

Design of freeform surface optical component in helmet mounted display

Helmet display (HMD) is the core hardware of virtual display technology. It is a small display device mounted on the helmet to produce visual images for the user. The MHD system mainly consists of an image source, optical, and support system. Still, the traditional optical subsystem cannot achieve the functions of the ideal optical system, such as being light-weight, small in size, and having an extensive field angle. This paper established the proper initial model, and the optimal control conditions and surface upgrade strategy were determined. Herein, the design scheme of the free-form prism with good performance was obtained. We solve the feature of large volume and complicated structure of optical components of helmet display and describe the design idea of free-form prism in detail. In this paper, the system resolution we designed is 800 × 600, the Modulation transfer function (MTF) value of the prism is more significant than 0.1 at the spatial resolution of 30lp/mm, and the distortion is less than 5%. The exit pupil diameter of the system is 8mm, and the field angle is 26°×20°.

Development and Evaluation of an Enhanced Virtual Reality Flight Simulation Tool for Airships

A real-time flight simulation tool is proposed using a virtual reality head-mounted display (VR-HMD) for remotely piloted airships operating in beyond-line-of-sight (BLOS) conditions. In particular, the VR-HMD was developed for stratospheric airships flying at low/high altitudes. The proposed flight simulation tool uses the corresponding aerodynamics characteristics of the airship, the buoyancy effect, mass balance, added mass, propulsion contributions and ground reactions in the FlightGear Flight Simulator (FGFS). The VR headset was connected to the FGFS along with the radio controller containing the real-time orientation/state of each button, which is also simulated to provide better situational awareness, and a head-up display (HUD) that was developed to provide the required flight data. In this work, a system was developed to connect the FGFS and the VR-capable graphics engine Unity to a PC and a wireless VR-HMD in real time with minimal lag between data transmission. A balance was found for FGFS to write to a CSV file at a period of 0.01 s. For Unity, the file was read every frame, which translates to around 0.0167 s (60 Hz). A test procedure was also conducted with a similar rating technique based on the NASA TLX questionnaire, which identifies the pilot’s available mental capacity when completing an assigned task to assure the comfortability of the proposed VR-HMD. Accordingly, a comparison was made for the aircraft control using the desktop simulator and the VR-HMD tool. The results showed that the current iteration of the system is ideal to train pilots on using similar systems in a safe and immersive environment. Furthermore, such an advanced portable system may even increase the situational awareness of pilots and allow them to complete a sizeable portion of actual flight tests with the same data transmission procedures in simulation. The VR-HMD flight simulator was also conceived to express the ground control station (GCS) concept and transmit flight information as well as the point of view (POV) visuals in real-time using the real environment broadcast using an onboard camera.

Immersive Multimedia Art Design Based on Deep Learning Intelligent VR Technology

The rapid development of computer science has led to the rapid development of new media technology. Among them, VR technology is sought after by the vast market for its multidimensional experience and immersive model. VR technology plays an important role in today’s art exhibition and presentation. However, in the process of transforming 2D images into 3D models, traditional VR technology has some problems, such as long loading time, low model decision-making efficiency, and chaotic operation process, which often lead to visual interference when viewers watch art. Based on this background and the interactive page algorithm based on traditional VR technology, this paper studies and improves the visual interference in immersive multimedia art design by using task technology perception matching model (TTF). The results show that the improved task technology perception matching model reduces the visual and auditory interference by 10% in the process of virtual reality art display and viewing, and the model layout is more reasonable, and the utilization rate is higher.

Advanced Study of Optical Imaging Systems for Virtual Reality Head-Mounted Displays

Driven by the rapid innovation of science and technology and industrial manufacturing technology, virtual reality display technology has developed rapidly. At present, the application of virtual reality display technology is expanding in many fields such as military, medical, aviation and education. This paper analyzes the imaging principle of the human vision system and the optical performance requirements of VR heads-up display, summarizes the current design scheme of VR heads-up optical imaging system, focuses on the principle and index parameters of each optical system, and compares the advantages and disadvantages of different schemes. The development prospects and directions of virtual reality headset displays are also prospected.

Add-on Occlusion: Turning Off-the-Shelf Optical See-through Head-mounted Displays Occlusion-capable.

The occlusion-capable optical see-through head-mounted display (OC-OSTHMD) is actively developed in recent years since it allows mutual occlusion between virtual objects and the physical world to be correctly presented in augmented reality (AR). However, implementing occlusion with the special type of OSTHMDs prevents the appealing feature from the wide application. In this paper, a novel approach for realizing mutual occlusion for common OSTHMDs is proposed. A wearable device with per-pixel occlusion capability is designed. OSTHMD devices are upgraded to be occlusion-capable by attaching the device before optical combiners. A prototype with HoloLens 1 is built. The virtual display with mutual occlusion is demonstrated in real-time. A color correction algorithm is proposed to mitigate the color aberration caused by the occlusion device. Potential applications, including the texture replacement of real objects and the more realistic semi-transparent objects display, are demonstrated. The proposed system is expected to realize a universal implementation of mutual occlusion in AR.

Texture mapping-based virtual simulation of striped jacquard fabrics

Fabric computer-aided design has become a hot research topic in recent years. The main objective of this research is to innovate a method of design, simulation and virtual display for weft-knitted striped jacquard fabrics. Preferentially, the fabric design and simulation models were established and the virtual yarns are intermeshed by connecting each control point of the loops to generate the structural simulation. The simulated image was captured as the texture image. The virtual display method of the garment based on texture mapping was mainly studied and innovated. Texture matching was realized based on the two-dimensional garment piece models and the vertices texture coordinates of the three-dimensional garment models were reset, then the three-dimensional garment virtual display was realized according to the mapping relationship between the triangles. During this process, the position of the texture can be dynamically designed and adjusted to achieve the desired effect. This research introduced the design of four kinds of striped fabrics and illustrated the corresponding simulation and virtual display effect to verify the feasibility of the method. The analysis of simulation efficiency reveals that the method responds quickly and has favorable adaptability to diverse patterns and models. The research provides a new idea for the computer-aided design of knitted fabrics and promotes the development of personalized garment customization.

Three-Dimensional Printing and 3D Scanning: Emerging Technologies Exhibiting High Potential in the Field of Cultural Heritage

Three-dimensional scanning and 3D printing have become increasingly important tools in the field of cultural heritage. Three-dimensional scanning is used to create detailed digital models of cultural heritage sites, artifacts, and monuments, which can be used for research, restoration, and virtual display. Three-dimensional printing, on the other hand, allows for the creation of physical copies of cultural heritage objects, which can be used for education, exhibition, and preservation. The use of these technologies has many advantages, including the ability to document and preserve cultural heritage sites, artifacts, and monuments in a non-invasive manner, as well as the ability to create digital and physical replicas that can be used for education and exhibition purposes. However, there are also challenges, such as the need for specialized equipment and expertise, as well as concerns about the preservation of the original objects. Despite these challenges, 3D scanning and 3D printing have proven to be valuable tools in the field of cultural heritage preservation and their use is expected to continue to grow in the future.

Emotion regulation and virtual nature: cognitive reappraisal as an individual-level moderator for impacts on subjective vitality

People who make habitual use of an emotion regulation strategy such as cognitive reappraisal may be more sensitive to the emotion cues coming from a surrounding natural environment and, thus, get more benefits from virtual nature exposure such as enhanced subjective vitality. However, no previous study investigated the moderating role of cognitive reappraisal in the relationship between exposure to different types of natural environments (a national park, a lacustrine environment, and an arctic environment vs. an urban environment) and subjective vitality. We designed a between-subject design (four conditions, one per type of environment) with a sample of 187 university students (Mage = 21.17, SD = 2.55). Participants were exposed to four 360° panoramic photos of the environment for one minute each with a virtual reality head-mounted display. The results of a multicategorical moderation analysis attested that there were two significant interactions, respectively between lacustrine and arctic environments and cognitive reappraisal. More specifically, for participants with low levels of habitual use of cognitive reappraisal, the effects of virtual nature (vs. urban) exposure on subjective vitality were not significant, while for participants with high levels, the effects were significant and positive. Findings show how the potential of virtual nature may be boosted with training aimed at increasing the general use of cognitive reappraisal, supports enhancing the applications of virtual nature, and demonstrates the need to take individual differences into account when determining the benefits of these applications.

The Difference of Museum Costume Display in the Interaction Experience

The museum is gradually deepening the &amp;quot;people-oriented&amp;quot; design concept, and the interaction between the audience and the exhibits has attracted wide attention. This article classifies the physical display and virtual display of museum costumes, expounds the visual style of costume display from the perspective of the physical field, and then uses the Shanghai Textile and Clothing Museum as the experimental base to extract the factors that affect the audience&amp;#39;s interactive experience through interviews, and construct an evaluation of the interactive experience Indicators, using T test to obtain experimental results, and comparing and analyzing the difference between physical display and virtual display of clothing under interactive experience from the perspective of psychological field, and then discussing the design principles of museum clothing display.

EyeGlove for Inspection and Measurement in Confined Environments

A novel wearable vision system is proposed in this article. The wearable system contains a vision glove (EyeGlove) and a wearable display unit, which assists operators with inspection and measurement in confined environments. Three microcameras and an artificial fiducial marker are integrated on the index and middle fingers of the EyeGlove with disjointed camera configurations. Operators can achieve complex camera configurations and movements by using their dexterous hands while wearing the EyeGlove. The wearable vision system distinguishes itself by having two different functions, of which the inspection function uses one or two cameras to inspect in confined environments. For the measurement function, all three cameras and the artificial marker are used to identify object dimensions. Two of the three cameras form a stereovision system with disjointed camera configurations and variable baselines. The third camera and the artificial marker are used to determine the variable baseline in real-time. Inspection and measurement results are presented by the wearable display unit onto a virtual display. To make the wearable vision system adapt to dark environments, three auxiliary LED lights are integrated adjoining the three cameras. Experiments are conducted in both bright and dark environments to verify the measurement accuracy with an average relative error ≤ 5.0%. Furthermore, experiments are also conducted in the confined turbine engine combustor to verify its potential application in industrial environments.

Action recognition based on multimode fusion for VR online platform.

The current popular online communication platforms can convey information only in the form of text, voice, pictures, and other electronic means. The richness and reliability of information is not comparable to traditional face-to-face communication. The use of virtual reality (VR) technology for online communication is a viable alternative to face-to-face communication. In the current VR online communication platform, users are in a virtual world in the form of avatars, which can achieve "face-to-face" communication to a certain extent. However, the actions of the avatar do not follow the user, which makes the communication process less realistic. Decision-makers need to make decisions based on the behavior of VR users, but there are no effective methods for action data collection in VR environments. In our work, three modalities of nine actions from VR users are collected using a virtual reality head-mounted display (VR HMD) built-in sensors, RGB cameras and human pose estimation. Using these data and advanced multimodal fusion action recognition networks, we obtained a high accuracy action recognition model. In addition, we take advantage of the VR HMD to collect 3D position data and design a 2D key point augmentation scheme for VR users. Using the augmented 2D key point data and VR HMD sensor data, we can train action recognition models with high accuracy and strong stability. In data collection and experimental work, we focus our research on classroom scenes, and the results can be extended to other scenes.