Interactive Virtual Reality Research Articles

SlowR50-SA: A Self-Attention Enhanced Dynamic Facial Expression Recognition Model for Tactile Internet Applications

Emotion recognition from facial expressions is a challenging task due to the subtle and nuanced nature of facial expressions. Within the framework of Tactile Internet (TI), the integration of this technology has the capacity to completely transform real-time user interactions, by delivering customized emotional input. The influence of this technology is far-reaching, as it may be used in immersive virtual reality interactions and remote tele-care applications to identify emotional states in patients. In this paper, a novel emotion recognition algorithm is presented that integrates a Self-Attention (SA) module into the SlowR50 backbone (SlowR50-SA). The experiments on the DFEW and FERV39K datasets demonstrate that the proposed model achieves good performance in terms of both Unweighted Average Recall (UAR) and Weighted Average Recall (WAR) metrics, achieving a UAR (WAR) of 57.09% (69.87%) on the DFEW dataset, and UAR (WAR) of 39.48% (49.34%) on the FERV39K dataset. Notably, SlowR50-SA operates with only eight frames of input at low temporal resolution, highlighting its efficiency. Furthermore, the algorithm has the potential to be integrated into Tactile Internet applications, where it can be used to enhance the user experience by providing real-time emotion feedback. SlowR50-SA can also be used to enhance virtual reality experiences by providing personalized haptic feedback based on the user’s emotional state. It can also be used in remote tele-care applications to detect signs of stress, anxiety, or depression in patients.

Decoding Realism of Virtual Objects: Exploring Behavioral and Ocular Reactions to Inaccurate Interaction Feedback

Achieving temporal synchrony between sensory modalities is crucial for natural perception of object interaction in virtual reality. While subjective questionnaires are currently used to evaluate users’ VR experiences, leveraging behavior and psychophysiological responses can provide additional insights. We investigated motion and ocular behavior as discriminators between realistic and unrealistic object interactions. Participants grasped and placed a virtual object while experiencing sensory feedback that either matched their expectations or occurred too early. We also explored visual-only feedback vs. combined visual and haptic feedback. Due to technological limitations, a condition with delayed feedback was added post-hoc. Gaze-based metrics revealed discrimination between high and low feedback realism. Increased interaction uncertainty was associated with longer fixations on the avatar hand and temporal shifts in the gaze-action relationship. Our findings enable real-time evaluation of users’ perception of realism in interactions. They facilitate the optimization of interaction realism in virtual environments and beyond.

Evaluations of Virtual and Augmented Reality Technology-Enhanced Learning for Higher Education

Virtual reality (VR) has good potential to promote technology-enhanced learning. Students can benefit from immersive visualization and intuitive interaction in their learning of abstract concepts, complex structures, and dynamic processes. This paper is interested in evaluating the effects of VR learning games in a Virtual and Augmented Reality Technology-Enhanced Learning (VARTeL) environment within an engineering education setting. A VARTeL flipped classroom is established in the HIVE learning hub at Nanyang Technological University (NTU) Singapore for the immersive and interactive learning. Experiments are designed for the university students conducting the learning, with three interactive and immersive VR games related to science, technology, engineering and mathematics (STEM), i.e., virtual cells, a virtual F1 racing car, and vector geometry. These VR games are a part of the VARTeL apps designed in-house at NTU for STEM education. Quantitative and qualitative analyses are performed. A total of 156 students from Mechanical Engineering participated in the experiment. There are 15 participants selected for an interview after the experiment. Pre-tests and post-tests are performed using two different models, the developed VARTeL and the modified Technology-Rich Outcome-Focused Learning Environment Inventory (TROFLEI), in order to measure the efficiency of the VARTeL environment in Higher Education. Significant improvements of about 24.8% are observed for the post-tests over the pre-tests, which illustrate the effectiveness of the VARTeL for Engineering education. Details of the VR simulation games, methods of data collection, data analyses, as well as the experiment results are discussed. It is observed from the results that all the underlying scales of the modified TROFLEI are above the threshold for the ‘Good’ category, indicating that a very reliable questionnaire is designed in this research. The mean ‘Ideal’ values are about 0.7–2.6% higher than the mean ‘Actual’ values. The limitations of the experiment and future works with recommendations are also presented in this paper.

Immersive presentations of real-world medical equipment through interactive VR environment populated with the high-fidelity 3D model of mobile MRI unit

The primary goal behind the system presented in this paper is to investigate the efficacy of using virtual reality (VR) for showcasing sizable medical equipment. Specifically, we focused on a mobile magnetic resonance imaging (MRI) scanner mounted on a truck trailer. The latter is integral to the mobile MRI setup and must be presented as part of the immersive experience. Therefore, we not only have to depict the medical apparatus but also provide the means of understanding its surroundings. This is especially important to radiologists and other medical personnel to ascertain if a given mobile medical facility fulfills their needs and wants. Furthermore, despite such MRI devices being designed for mobility, their long-distance transportation can be time-consuming, troublesome and expensive. Therefore, we can observe the need for showcasing such mobile MRI units without additional cost and burden related to transportation. To achieve this, we designed an immersive environment in which the users can interact with the real-life scale 3D model of a mobile MRI. In addition, we also verified the usability and expressiveness of our system using established heuristical approaches.

Revolutionizing construction safety: introducing a cutting-edge virtual reality interactive system for training US construction workers to mitigate fall hazards

The construction industry is fraught with hazards, chief among them being the risk of falls from elevated positions, which are a leading cause of both fatalities and injuries among workers. Despite the prevalence of traditional safety training methods, their effectiveness in reducing fall risks remains limited. To solve this issue, this study proposes the adoption of interactive VR technologies to provide construction workers with immersive training experiences in the critical domain of fall safety. This approach not only ensures adherence to the Occupational Safety and Health Administration (OSHA) requirements but also leverages VR’s immersive capabilities to create a comprehensive and effective learning tool. To evaluate the proposed system’s efficacy, the researchers conducted an empirical assessment involving eighty-two construction workers from two small enterprises. Participants were divided into two groups: one receiving traditional training and the other undergoing VR-based instruction. Both groups underwent pre- and post-training evaluations comprising six targeted questions designed to measure the impact of each training method on their understanding and awareness of fall safety practices. The comparative analysis revealed no significant differences in baseline knowledge between the two groups prior to the training interventions. However, post-training evaluations demonstrated a notable improvement in the VR group, with a significant decrease in the number of incorrect responses, in stark contrast to the group subjected to traditional training methods. Statistical analysis further confirmed the superiority of VR training in enhancing participants’ knowledge. This was quantified by a p-value of 0.0016, indicating a high level of statistical significance well below the conventional threshold of 0.05. This study highlights the significant advantages of VR technology in construction safety training, demonstrating its superiority over traditional training methods in terms of knowledge retention and practical application. The results strongly support the wider adoption of VR in safety training, indicating its potential to enhance safety outcomes in the construction sector.

Action capture and VR interactive system for online experimental teaching

The development of technology has intensified people’s interest in virtual reality technology. Virtual reality technology is also widely used in fields such as teaching and healthcare. To improve the real-time and operability of virtual reality interaction systems, a motion capture and virtual reality interaction system design for online experimental teaching is proposed. The active apparent model is used for facial feature point localization, and the joint capture method is improved by combining threshold segmentation and forward kinematics algorithms. Experimental data confirms that compared to Kinect method, the improved hand joint detection method has higher joint positioning accuracy, with a loss rate of less than 40 % for hand joints. The average judgment accuracy of the six facial expression tests is 82 %, 81 %, 79 %, 78 %, 80 %, and 81 %, respectively. The comprehensive recognition accuracy of facial expression recognition is 80.17 %. The read, write, and update times for each frame of the virtual reality interaction system are 102.6 ms and 427 ms, respectively. The system memory usage is 920.5 M, and the CPU and GPU usage rates are 25.2 % and 4.4 %, respectively. The system can run smoothly. The virtual reality system can run continuously for 24 h, with strong operability and low difficulty in expanding system functions, achieving design goals.

A Wearable Haptic Device for the Hand With Interchangeable End-Effectors.

This article presents a 4-degrees-of-freedom (4-DoF) hand wearable haptic device for Virtual Reality (VR). It is designed to support different end-effectors, that can be easily exchanged so as to provide a wide range of haptic sensations. The device is composed of a static upper body, secured to the back of the hand, and the (changeable) end-effector, placed in contact with the palm. The two parts of the device are connected by two articulated arms, actuated by four servo motors housed on the upper body and along the arms. The article summarizes the design and kinematics of the wearable haptic device and presents a position control scheme able to actuate a broad range of end-effectors. As a proof of concept, we present and evaluate three representative end-effectors during interactions in VR, rendering the sensation of interacting (E1) with rigid slanted surfaces and sharp edges having different orientations, (E2) with curved surfaces having different curvatures, and (E3) with soft surfaces having different stiffness characteristics. A few additional end-effector designs are discussed. A human-subjects evaluation in immersive VR shows the broad applicability of the device, able to render rich interactions with a diverse set of virtual objects.

Perceived Realism of Virtual Textures Rendered by a Vibrotactile Wearable Ring Display.

Wearable haptic displays that relocate feedback away from the fingertip provide a much-needed sense of touch to interactions in virtual reality, while also leaving the fingertip free from occlusion for augmented reality tasks. However, the impact of relocation on perceptual sensitivity to dynamic changes in actuation during active movement remains unclear. In this work, we investigate the perceived realism of virtual textures rendered via vibrations relocated to the base of the index finger and compare three different methods of modulating vibrations with active finger speed. For the first two methods, changing finger speed induced proportional changes in either frequency or amplitude of vibration, and for the third method did not modulate vibration. In psychophysical experiments, participants compared different types of modulation to each other, as well as to real 3D-printed textured surfaces. Results suggest that frequency modulation results in more realistic sensations for coarser textures, whereas participants were less discerning of modulation type for finer textures. Additionally, we presented virtual textures either fully virtually in midair or under augmented reality in which the finger contacted a flat surface; while we found no difference in experimental performance, participants were divided by a strong preference for either the contact or non-contact condition.

Psychiatryai.com: Real-Time AI Scoping Review (RAISR 4D) in Psychiatry and Mental Health with Live Real-World Evidence and CPD/CME for Psychiatrists

IntroductionPsychiatryai.com was launched in 2021 and initial findings were published at EPA 2023. The portal is an advanced computing science project in Applied Data Science and Evidence-Based Healthcare for my MSc studies at the University of Oxford (Kellogg College). Artificial Intelligence (AI) and Data Science (DS) technology are utilised to analyse live Real-World Evidence (RWE) in Psychiatry and Mental Health from PubMed to provide CPD/CME online. A two-year review of the site and its performance will be presented to EPA 2024.ObjectivesTo develop and study an experimental real-time AI and DS platform in Global Mental Health and Psychiatry, to provide the latest RWE from PubMed for online education and training, and to report findings to EPA 2024 for peer review in Budapest. AI and misinformation are newly identified risks in healthcare (AI Safety Summit 2023). The site also aims to raise awareness about “Aiatrogenesis” to address this problem, with RWE and CPD/CME utilising AI and DS technology for the categorisation and meta-analysis of evidence, rather than the production of possibly misleading or false Generative AI evidence (Monteith et al. BJP 2023; 1-3).MethodsAs reported to EPA 2023 in Paris, a free open-code WordPress site was launched on the 22nd of November 2021 (Psychiatryai.com). The portal has been further developed and now features over 90k pages comprising 7GB of data with Cloudflare security and speed. Live evidence is collected into an open database and research articles are categorised into evidence nodes with AI. The results are presented in a real-time Evidence Matrix and Blueprint, creating 15-minute CPD/CME reflection modules. Data analytics from Psychiatryai.com with Google Analytics (G4A) along with platform insights from two years of development and research will be presented to EPA 2024. The site is conceptualised and designed to be viewed in an interactive VR headset.ResultsLive Citations380000+PubMed Articles Analysed with AI92142CPD/CME23002 hoursAlgorithms/Topics in Psychiatry291Open Data7 GBImage:Image 2:Image 3:ConclusionsPsychiatryai.com has successfully developed a novel AI and DS platform that incorporates the latest research in mental health and psychiatry, providing real-world evidence (RWE) for psychiatrists and healthcare professionals worldwide, along with CPD/CME online. This enhances hypothesis testing in research by presenting a related Evidence Matrix and Blueprint (from the last 365 days) for each evidence node on the site (RAISR 4D). These matrices provide a real-time visual table (8 x 8 / 64) of global research related to the evidence node in the preceding year. The site is VR-ready and has a special focus on AI and Psychiatry, Disaster and Traumatology Sciences, and Youth Mental Health. This project is dedicated to the memory of Dr Denis O’Leary and Dr Navin Venkatraman.Disclosure of InterestNone Declared

Human-computer interaction in virtual reality environments for educational and business purposes

This paper examines the integration of Human-Computer Interaction (HCI) in Virtual Reality (VR) environments, with a focus on its application in educational and business domains. It explores the transformative potential of VR in enhancing user interface design, optimizing user experience, and integrating advanced technologies like natural language processing and gesture recognition. The research highlights VR's efficacy in improving learning outcomes and operational efficiencies, demonstrating significant advancements in immersive and intuitive interaction within virtual settings. The study underscores the critical role of user-centered design in VR systems and the impact of integrating natural language processing and gesture recognition technologies in creating more natural and intuitive user interactions. Through comprehensive analysis and case studies, the paper presents the latest developments in VR technology and its application, offering insights into the future of immersive digital environments in education and business sectors.

Thelxinoë: Recognizing Human Emotions Using Pupillometry and Machine Learning

In this study, we present a method for emotion recognition in Virtual Reality (VR) using pupillometry. We analyze pupil diameter responses to both visual and auditory stimuli via a VR headset and focus on extracting key features in the time-domain, frequency-domain, and time-frequency domain from VR-generated data. Our approach utilizes feature selection to identify the most impactful features using Maximum Relevance Minimum Redundancy (mRMR). By applying a Gradient Boosting model, an ensemble learning technique using stacked decision trees, we achieve an accuracy of 98.8% with feature engineering, compared to 84.9% without it. This research contributes significantly to the Thelxinoë framework, aiming to enhance VR experiences by integrating multiple sensor data for realistic and emotionally resonant touch interactions. Our findings open new avenues for developing more immersive and interactive VR environments, paving the way for future advancements in virtual touch technology.

Adaptation to Simulated Hypergravity in a Virtual Reality Throwing Task

According to previous research, humans are generally poor at adapting to earth-discrepant gravity, especially in Virtual Reality (VR), which cannot simulate the effects of gravity on the physical body. Most of the previous VR research on gravity adaptation has used perceptual or interception tasks, although adaptation to these tasks seems to be especially challenging compared to tasks with a more pronounced motor component. This article describes the results of two between-subjects studies ( n = 60 and n = 42) that investigated adaptation to increased gravity simulated by an interactive VR experience. The experimental procedure was identical in both studies: In the adaptation phase, one group was trained to throw a ball at a target using Valve Index motion controllers in gravity that was simulated at five times of earth’s gravity (hypergravity group), whereas another group threw at a longer-distance target under normal gravity (normal gravity group) so both groups had to exert the same amount of force when throwing (approximated manually in Study 1 and mathematically in Study 2). Then, in the measurement phase, both groups repeatedly threw a virtual ball at targets in normal gravity. In this phase, the trajectory of the ball was hidden at the moment of release so that the participants had to rely on their internal model of gravity to hit the targets rather than on visual feedback. Target distances were placed within the same range for both groups in the measurement phase. According to our preregistered hypotheses, we predicted that the hypergravity group would display worse overall throwing accuracy and would specifically overshoot the target more often than the normal gravity group. Our experimental data supported both hypotheses in both studies. The findings indicate that training an interactive task in higher simulated gravity led participants in both studies to update their internal gravity models, and therefore, some adaptation to higher gravity did indeed occur. However, our exploratory analysis also indicates that the participants in the hypergravity group began to gradually regain their throwing accuracy throughout the course of the measurement phase.

Glove versus controller: the effect of VR gloves and controllers on presence, embodiment, and cognitive absorption

Introduction: Using our own hands allows humans to interact with the real world, as we learn from an early age. Virtual reality (VR) gloves allow a similar interaction in VR by transferring hand movements through natural mapping. Research outside the VR domain has already shown that this process creates a high level of presence and perceived naturalness. Research in the VR context, on the other hand, is still in an early stage and lacks explorative qualitative research following a human-centered approach and including the direct perceptions of users on mapped controls in system design. Against that background, this research investigates natural mapping in the VR context qualitatively. The study examines how participants experience VR input devices with different degrees of natural mapping (VR gloves, a Valve index controller, and an HTC Vive controller) on perceived naturalness, spatial presence, embodiment, and cognitive absorption.Methods: A focus group (N = 20 aged 22–36) did the VR experience with the devices and was asked about their experience in semi-structured interviews. Questions focused on perceived naturalness, spatial presence, cognitive absorption, and embodiment with the three devices. Data were analyzed using qualitative content analysis.Results: Feedback on spatial presence was widely positive for the VR glove due to the highly natural perceived movement capabilities. Mapping with the partly mapped index controller was also seen as natural and immersing if the movement matched the operated actions in the system. Participants mainly perceived the highest degree of cognitive absorption and embodiment while doing the task with the VR glove.Discussion: The findings indicate that the natural mapping capabilities of VR input devices strongly influence spatial presence. The VR glove stands out while being able to induce a feeling of embodiment in most cases. Furthermore, participants reported a connection between natural mapping and perceived cognitive absorption in the task.

Virtual space experience design of grand canal cultural heritage landscape: Panoramic interaction and guided tour algorithm

<h3>This work presents the application of interactive virtual reality (IVR) technology in the preservation and presentation of cultural heritage (CH) for China’s Grand Canal. The Grand Canal is a historical engineering marvel and an icon in Chinese cultural and economic development. This work addresses the need for the enhancement of traditional methods for CH education and preservation through immersive and interactive experiences. In this study, an IVR system is developed that is tailored to represent China’s Grand Canal with the objective of providing users with historical accuracy and better engagement. The IVR experience is designed based on core user experience (UX) principles to maintain usability, accessibility, and engagement. Key features of the model include panoramic interactions, higher participation, and realistic representations through better graphic rendering and 3-D modelling. A guided tour algorithm was employed for personalized and adaptive UX to increase user satisfaction. The findings found after the IVR implementation through the sourced feedback reveal that the IVR system has improved user engagement, comprehension, satisfaction, and immersion compared to traditional touring methods. The statistical analysis, including comparative analysis, cross-tabulation, and correlation tests, supported these conclusions.</h3>

Classrooms in the metaverse: educational applications and levels of learner interaction in virtual reality

Classrooms in the metaverse: educational applications and levels of learner interaction in virtual reality

Teaching empathy: comparison of a virtual reality experience using head-mounted display versus group streaming

ABSTRACT Empathy, an integral component of bedside manners, correlates with good healthcare provision. Training physician assistant (PA) students using Head-Mounted Display (HMD) virtual reality (VR) contributed to significant empathy increases. This pilot study, which relied on a retrospective analysis, compared a VR experience using HMD to a streamed modality (due to COVID safety) with PA students to measure empathy. We hypothesized that fully immersive and interactive HMD VR would lead to a statistically significant increase in empathy versus the streaming modality. The “Alfred Lab” VR allows viewers to “embody” a 74-year-old African American man with vision and hearing loss. The University of New England PA class of 2021 (n = 47) completed the HMD lab while the class of 2022 (n = 50) viewed the streaming modality as a group. Identical pre/post surveys were completed by each cohort. The analysis utilized paired sample t-tests, ANOVA, frequency analysis (quantitative), and content analysis with thematic coding (qualitative). The results for each cohort revealed a statistically significant increase in empathy (p < 0.05) after completing the VR lab (pre- to post-test results). The comparison of both cohorts (HMD versus group streaming) revealed no noteworthy difference. Streaming VR could improve access to PA programs unable to acquire expensive VR equipment yet still allow for the development of empathy.

Virtual Reality Planning of Microvascular Decompression in Trigeminal Neuralgia: Technique and Clinical Outcome.

A neurovascular conflict (NVC) is considered the cause of trigeminal neuralgia (TN) in 75% of cases, and if so, a microvascular decompression (MVD) can lead to significant pain relief. A reliable preoperative detection of NVC is essential for clinical decision-making and surgical planning, making detailed neuroradiologic imaging an important component. We present our experiences and clinical outcomes with preoperative planning of the MVD procedure in a virtual reality (VR) environment, based on magnetic resonance imaging (MRI) including magnetic resonance angiography (MRA) and magnetic resonance venography (MRV) sequences. We analyzed the data of 30 consecutive MVDs in patients treated for TN, in a retrospective single-surgeon (R.A. Kockro) study. Out of the 30 cases, 26 were included. Preoperatively, MRA/MRV and MRI series were fused and three dimensionally reconstructed in a VR environment. All critical structures such as the trigeminal nerve as well as the arteries and veins of the cerebellopontine angle, the brainstem, the neighboring cranial nerves, and the transverse and sigmoid sinus were segmented. The NVC was visualized and a simulation of a retrosigmoid approach, with varying trajectories, to the NVC was performed. The intraoperative findings were then compared with the data of the simulation. The clinical outcome was assessed by a detailed review of medical reports, and follow-up-interviews were conducted in all available patients (20/26). The VR planning was well integrated into the clinical workflow, and imaging processing time was 30 to 40 minutes. There was a sole arterial conflict in 13 patients, a venous conflict in 4 patients, and a combined arteriovenous conflict in 9 patients. The preoperative simulations provided a precise visualization of the anatomical relationships of the offending vessels and the trigeminal nerves as well as the surrounding structures. For each case, the approach along the most suitable surgical corridor was simulated and the exact steps of the decompression were planned. The NVC and the anatomy of the cerebellopontine angle as seen intraoperatively matched with the preoperative simulations in all cases and the MVC could be performed as planned. At follow-up, 92.3% (24/26) of patients were pain free and all the patients who completed the questionnaire would undergo the surgery again (20/20). The surgical complication rate was zero. Current imaging technology allows detailed preoperative visualization of the pathoanatomical spatial relationships in cases of TN. 3D interactive VR technology allows establishing a clear dissection and decompression strategy, resulting in safe vascular microsurgery and excellent clinical results.

Digital twin method and application practice of spacecraft system driven by mechanism data

Spacecrafts are large-scale systems characterized by various on-orbit configurations, multi-disciplinary coupling, and complex mission modes. Research and exploration on the data-driven spacecraft digital twins development methods must be carried out to satisfy various requirements such as spacecraft on-orbit condition monitoring and risk warning, fast flight conditions predictions, intelligent failure location, and virtual verification of failure. In this paper, significant progress is made in multiple key technologies, such as cyber-physical system modeling and simulation, hybrid modeling and model evolution through mechanism-data fusion, and interactive virtual-reality perception and mapping. The spacecraft digital twins’ model is constructed, and the spacecraft digital twin’s platform is designed and developed. Multiple digital twins’ application scenarios, such as on-orbit mission simulation and emulation, real-time interactive monitoring, and fast operating condition prediction, are supported. The research results are applied to the key on-orbit operation tasks, such as entering orbit, rendezvous and docking, position conversion, and astronaut exiting, enabling system-level digital operation for the sub-systems of spacecraft such as energy, power, control, and communication sub-systems.

The Perceived Complexity of Learning Tasks Influences Students’ Collaborative Interactions in Immersive Virtual Reality

This study investigated how different learning tasks influence students’ collaborative interactions in immersive Virtual Reality (iVR). A set of chemistry learning activities was designed with iVR, and 35 pairs of undergraduate students went through the activities. Videos of students’ interactions were analysed to identify patterns in students’ physical, conceptual, and social interactions. When students were manipulating conceptually familiar virtual objects (several water molecules), they perceived the tasks as a simple extension of prior knowledge and did not attempt to explore the 3D visualisation much. They did not move around to take different perspectives, and conceptual discussions were brief. Their prior power relations (leader–follower) carried over in iVR environments. In contrast, when conceptually unfamiliar chemical structures (protein enzyme) were displayed, students perceived the tasks as complex, demanding a new mode of learning. They spontaneously moved around to explore and appreciate the 3D visualisation of iVR. Walking to different positions to observe the virtual objects from multiple angles, students engaged in more collaborative, exploratory conceptual discussions. As the perceived complexity of learning tasks or virtual objects triggers different collaborative interactions amongst students, careful considerations need to be placed on the design of iVR tasks to encourage productive collaborative learning.

Aberration pre-correction for a simple optical system of HMDs.

Head-mounted displays (HMDs) are becoming increasingly popular as a crucial component of virtual reality (VR). However, contemporary HMDs enforce a simple optical structure due to their constrained form factor, which impedes the use of multiple lens elements that can reduce aberrations in general. As a result, they introduce severe aberrations and imperfections in optical imagery, causing visual fatigue and degrading the immersive experience of being present in VR. To address this issue without modifying the hardware system, we present a novel, to the best of our knowledge, software-driven approach that compensates for the aberrations in HMDs in real time. Our approach involves pre-correction that deconvolves an input image to minimize the difference between its after-lens image and the ideal image. We characterize the specific wavefront aberration and point spread function (PSF) of the optical system using Zernike polynomials. To achieve higher computational efficiency, we improve the conventional deconvolution based on hyper-Laplacian prior by adopting a regularization constraint term based on L2 optimization and the input-image gradient. Furthermore, we implement our solution entirely on a graphics processing unit (GPU) to ensure constant and scalable real-time performance for interactive VR. Our experiments evaluating our algorithm demonstrate that our solution can reliably reduce the aberration of the after-lens images in real time.