Virtual Reality Headset Research Articles

TouchView: Mid-Air Touch on Zoomable 2D View for Distant Freehand Selection on a Virtual Reality User Interface

Selection is a fundamental interaction element in virtual reality (VR) and 3D user interfaces (UIs). Raycasting, one of the most common object selection techniques, is known to have difficulties in selecting small or distant objects. Meanwhile, recent advancements in computer vision technology have enabled seamless vision-based hand tracking in consumer VR headsets, enhancing accessibility to freehand mid-air interaction and highlighting the need for further research in this area. This study proposes a new technique called TouchView, which utilizes a virtual panel with a modern adaptation of the Through-the-Lens metaphor to improve freehand selection for VR UIs. TouchView enables faster and less demanding target selection by allowing direct touch interaction with the magnified object proxies reflected on the panel view. A repeated-measures ANOVA on the results of a follow-up experiment on multitarget selection with 23 participants showed that TouchView outperformed the current market-dominating freehand raycasting technique, Hybrid Ray, in terms of task performance, perceived workload, and preference. User behavior was also analyzed to understand the underlying reasons for these improvements. The proposed technique can be used in VR UI applications to enhance the selection of distant objects, especially for cases with frequent view shifts.

Adaptive 360° video timeline exploration in VR environment

Timeline control is a crucial interaction during video viewing, aiding users in quickly locating or jumping to specific points in the video playback, especially when dealing with lengthy content. 360°videos, with their ability to offer an all-encompassing view, have gradually gained popularity, providing a more immersive experience compared to videos with a single perspective. While most 360°videos are currently displayed on two-dimensional screens, the timeline design has largely remained similar to that of conventional videos. However, virtual reality (VR) headsets provide a more immersive viewing experience for 360°videos and offer additional dimensions for timeline design. In this paper, we initially explored 6 timeline design styles by varying the shape and interaction distance of the timeline, aiming to discover designs more suitable for the VR environment of 360°videos. Subsequently, we introduced an adaptive timeline display mechanism based on eye gaze sequences to optimize the timeline, addressing issues like obstructing the view and causing distractions when the timeline is consistently visible. Through two studies, we first demonstrated that in the 360°space, the three-dimensional timeline performs better in terms of usability than the two-dimensional one, and the reachable timeline has advantages in performance and experience over the distant one. Secondly, we verified that, without compromising interaction efficiency and system usability, the adaptive display timeline gained more user preference due to its accurate prediction of user timeline needs.

Tasks Reflected in the Eyes: Egocentric Gaze-Aware Visual Task Type Recognition in Virtual Reality.

With eye tracking finding widespread utility in augmented reality and virtual reality headsets, eye gaze has the potential to recognize users' visual tasks and adaptively adjust virtual content displays, thereby enhancing the intelligence of these headsets. However, current studies on visual task recognition often focus on scene-specific tasks, like copying tasks for office environments, which lack applicability to new scenarios, e.g., museums. In this paper, we propose four scene-agnostic task types for facilitating task type recognition across a broader range of scenarios. We present a new dataset that includes eye and head movement data recorded from 20 participants while they engaged in four task types across 15 360-degree VR videos. Using this dataset, we propose an egocentric gaze-aware task type recognition method, TRCLP, which achieves promising results. Additionally, we illustrate the practical applications of task type recognition with three examples. Our work offers valuable insights for content developers in designing task-aware intelligent applications. Our dataset and source code are available at zhimin-wang.github.io/TaskTypeRecognition.html.

Efficient and Accurate Semi-Automatic Neuron Tracing with Extended Reality.

Neuron tracing, alternately referred to as neuron reconstruction, is the procedure for extracting the digital representation of the three-dimensional neuronal morphology from stacks of microscopic images. Achieving accurate neuron tracing is critical for profiling the neuroanatomical structure at single-cell level and analyzing the neuronal circuits and projections at whole-brain scale. However, the process often demands substantial human involvement and represents a nontrivial task. Conventional solutions towards neuron tracing often contend with challenges such as non-intuitive user interactions, suboptimal data generation throughput, and ambiguous visualization. In this paper, we introduce a novel method that leverages the power of extended reality (XR) for intuitive and progressive semi-automatic neuron tracing in real time. In our method, we have defined a set of interactors for controllable and efficient interactions for neuron tracing in an immersive environment. We have also developed a GPU-accelerated automatic tracing algorithm that can generate updated neuron reconstruction in real time. In addition, we have built a visualizer for fast and improved visual experience, particularly when working with both volumetric images and 3D objects. Our method has been successfully implemented with one virtual reality (VR) headset and one augmented reality (AR) headset with satisfying results achieved. We also conducted two user studies and proved the effectiveness of the interactors and the efficiency of our method in comparison with other approaches for neuron tracing.

Is Video Gaming a Cure for Cybersickness? Gamers Experience Less Cybersickness Than Non-Gamers in a VR Self-Motion Task.

Cybersickness remains a major drawback of Virtual Reality (VR) headsets, as a breadth of stationary experiences with visual self-motion can result in visually-induced motion sickness. However, not everybody experiences the same intensity or type of adverse symptoms. Here we propose that prior experience with virtual environments can predict ones degree of cybersickness. Video gaming can enhance visuospatial abilities, which in-turn relate negatively to cybersickness - meaning that consistently engaging in virtual environments can result in protective habituation effects. In a controlled stationary VR experiment, we found that 'VR-naive' video gamers experienced significantly less cybersickness in a virtual tunnel-travel task and outperformed 'VR-naive' non-video gamers on a visual attention task. These findings strongly motivate the use of non-VR games for training VR cybersickness resilience, with future research needed to further understand the mechanism(s) by which gamers become cybersickness resilient - potentially expanding access to VR for even the most susceptible participants.

Reduction of Preoperative Anxiety Using Virtual Reality vs Midazolam: A Randomized Controlled Trial

More than 50% of pediatric patients experience significant stress and anxiety prior to surgery.1 High anxiety can result in increased postoperative pain, analgesic consumption, and delayed recovery.2 To reduce this preoperative anxiety, multiple therapeutic modalities have been developed, including the use of distraction, such as playing video games, watching movies, and listening to music. In severe cases of anxiety, anxiolytic and sedative medications like midazolam are used. However, given the acknowledged drawbacks of medications, including the risk of paradoxical reactions to the drug, alternatives to medication for reducing preoperative anxiety in patients may be useful. We aim to compare the use of virtual reality (VR) to midazolam in reducing preoperative anxiety in surgical patients and assess differences in induction compliance, emergence delirium, pain scores, and opioid use in VR vs. midazolam-treated patients. Methods This study was approved by the Phoenix Children’s Hospital Institutional Review Board. First-time surgical patients (N = 36) between the ages of 5 and 11 years undergoing tonsillectomy or tonsillectomy/adenoidectomy procedures were randomly assigned to either receive midazolam (0.5 mg/kg up to 25 mg) or play an interactive underwater-themed game using VR. The Modified Yale Preoperative Anxiety Scale (mYPAS) was administered by a single child life specialist preoperatively, and only patients who reached a threshold of >40 on mYPAS scoring were enrolled (scale range: 23 - 100). Additional anxiety measurement was tested using the adult and child State-Trait Anxiety Inventory (STAI). Midazolam or VR was administered prior to transport to the OR, and mYPAS was scored again at the time of separation from the family. The Induction Compliance Checklist (ICC) was utilized for assessment at the time of anesthesia induction. The VR-treated patients continued use of the VR headset through mask induction. A standardized anesthesia induction protocol was used for all patients. The Pediatric Anesthesia Emergence Delirium (PAED) scale was administered at emergence, postoperatively. Postoperative nurses scored pain and administered IV pain medication as needed. Group means and standard deviations were reported and compared with two-sided t tests. Results Interim results show the mYPAS anxiety scores dropped 20.1 ± 11.7 points following midazolam treatment (p<0.001) and dropped 28.3 ± 7.3 points following VR treatment (p < 0.001). There was a significant difference in mYPAS scores between groups following treatment (midazolam = 32.0 ± 4.9; VR = 25.4 ± 4.7; p = 0.04). There were no significant differences between midazolam- and VR-treated groups in the Induction Compliance Checklist, PAED scale, peak postoperative pain scores, and medication use for pain control postoperatively. This study is currently ongoing. Conclusion VR appears to reduce preoperative anxiety similarly to midazolam in anxious first-time surgical pediatric patients. Limitations include patient population. Further studies should be conducted for greater generalizability.

Real and Virtual Lecture Rooms: Validation of a Virtual Reality System for the Perceptual Assessment of Room Acoustical Quality

Enhancing the acoustical quality in learning environments is necessary, especially for hearing aid (HA) users. When in-field evaluations cannot be performed, virtual reality (VR) can be adopted for acoustical quality assessments of existing and new buildings, contributing to the acquisition of subjective impressions in lab settings. To ensure an accurate spatial reproduction of the sound field in VR for HA users, multi-speaker-based systems can be employed to auralize a given environment. However, most systems require a lot of effort due to cost, size, and construction. This work deals with the validation of a VR-system based on a 16-speaker-array synced with a VR headset, arranged to be easily replicated in small non-anechoic spaces and suitable for HA users. Both objective and subjective validations are performed against a real university lecture room of 800 m3 and with 2.3 s of reverberation time at mid-frequencies. Comparisons of binaural and monoaural room acoustic parameters are performed between measurements in the real lecture room and its lab reproduction. To validate the audiovisual experience, 32 normal-hearing subjects were administered the Igroup Presence Questionnaire (IPQ) on the overall sense of perceived presence. The outcomes confirm that the system is a promising and feasible tool to predict the perceived acoustical quality of a room.

Automation and innovation in home hemodialysis machines.

In this review, we discuss the timeline of innovation and technologic development in home hemodialysis (HHD) in the United States and the legislative approvals that accompanied them. The most recently FDA-approved home hemodialysis devices provide features that include on-demand and batch dialysate generation, access disconnect for venous needle dislodgement, touchscreen interface with visual and auditory prompts and animations, drop-in sterilized cartridges with prestrung tubing, hot water disinfection of tubing allowing extended-use, dialysate flow rates as high as 500 ml/min, as well as remote treatment monitoring capabilities. Furthermore, wearable/portable dialysis devices are currently under development to simplify dialysis delivery to patients with end-stage kidney disease. Home hemodialysis devices providing longitudinal hemodialysis across different clinical settings, virtual reality headsets for more personalized training, automated patient support, as well as wearable device development and innovations give hope for a future where home hemodialysis is more accessible and seamless.

The Rehabilitation of Texter’s Thumb with Virtual Reality Headsets - A Systematic Review

Rationale– In this day and age, it has become a troublesome task for one to resist video games or avoid texting on computers, tablets and cell phones. The continuous use of cell phones for texting and gaming leads to various injuries and one such injury is the Texter’s thumb. Aim- The aim of this systematic literature review was to determine the effectiveness of using virtual reality headsets for Texter’s thumb rehabilitation. Objective- To discuss the causes, symptoms, conventional treatment options and the latest alternatives provided by Artificial Intelligence (AI), i.e., virtual reality headsets, for the rehabilitation of Texter’s thumb. Methods- The present systematic literature review was conducted according to the PRISMA 2020 statement in Web of Science, Scopus, PubMed, ResearchGate and Google Scholar databases and was limited to the title and keywords. The initial electronic search yielded 105 articles and 41 articles were eventually included in the final review. Results- The analysis of the reviewed articles revealed that patients used virtual reality headsets for the rehabilitation of Texter’s thumb. Many subjects found these headsets easy to understand, easy to use, interesting, motivating, engaging, along with an improvement in hand and thumb function, a reduction in pain and an increase in the pinch and grip strength. A few of the users experienced other problems such as headache and visual disturbances. Discussion- Evaluation of the articles included in the review showed that virtual reality headsets ultimately help to make thumb rehabilitation less painful. They follow the attention-distraction method as the patient gets distracted by the vastness of the virtual world and his attention is shifted from the discomfort caused by the injury to his surroundings in the virtual world. This makes VR, one of the simplest psychological therapies for the treatment of pain. Conclusion- To conclude this systematic review, it can be stated that virtual reality headsets have indeed proved to be a boon for all the youngsters out there as the injury caused by strenuous texting can be rehabilitated through the use of AI. Nevertheless, it is still necessary to further enhance our knowledge and study in this field. Keywords: artificial intelligence; virtual reality; texting injuries; Texter’s thumb; hand rehabilitation

Meta-Heart Team: enhancing multidisciplinary heart teams through virtual reality in the metaverse

Abstract Introduction Cardiovascular Multidisciplinary Heart Teams (MDHTs) are integral for patient management, but persistent challenges, including limited subspecialty expertise and time constraints, necessitate innovative approaches. This study explores the viability of conducting international Meta-Heart Team sessions utilizing virtual reality (VR) within the metaverse, aiming to address these challenges. Methods The Meta-Heart Team, comprising participants from diverse medical specialties and countries, engaged in VR sessions facilitated by VR headsets and web browsers. The immersive Aimedis metaverse platform recreated a three-dimensional hospital setting, complete with a dedicated Meta-Heart Team room featuring large screens displaying patient data such as coronary angiograms and echocardiograms. A 0-10 scale questionnaire evaluated participant experiences, covering technical quality, immersion, willingness to participate again, and overall satisfaction. Results The virtual environment effectively facilitated discussions on valvular heart disease cases among 10 participants, dedicating 15 minutes to each case. Technical stability was robust (90%), with only one participant experiencing internet disconnection. Positive participant feedback highlighted high ratings for technical quality (8.0±1.8) and engagement, a good immersive experience (8.0±1.3), willingness to participate again (9.2±0.8), and confidence in treatment decisions (80%). Despite a sense of digital fatigue reported by a few participants, the majority expressed that the VR session saved time compared to traditional meetings. Privacy concerns were acknowledged by 80% of participants. Discussion The virtual environment demonstrated potential in augmenting MDHT collaboration, providing advantages in global accessibility, multidimensional analysis, and adaptability. Participants recognized limitations in non-verbal communication and interpersonal connections but underscored the adaptability and effectiveness of the virtual setting. Technical challenges, including a single internet disconnection, emphasized the importance of a robust technical infrastructure. Privacy issues, digital fatigue, and potential exclusions were highlighted, prompting consideration of ethical guidelines and ongoing technological advancements. Conclusion Leveraging VR in the metaverse for MDHT sessions is feasible and offers substantial benefits. Despite challenges such as technical issues and privacy concerns, the Meta-Heart Team complements traditional interactions, ushering in a new era in collaborative decision-making while demanding ongoing attention to technological and ethical considerations.Two presenters explaining the processThe Metaverse-based Heart Team room

EOG Region Detection using Fuzzy k-NN for Virtual Reality Applications

Virtual Reality (VR) systems have become widespread for a decade with the mass production of VR headsets. Advancement in the VR industry benefits both biomedical and computer gaming fields to create better Human-Computer Interface (HCI) applications. In this study, Electrooculogram (EOG) signals are studied on a calibrated A4 paper to simulate reading and tracking eye movement in different regions for VR user interface applications. For that reason, eye activity features from EOG are used to identify relative 2D spatial coordinates and classified with the fuzzy k-Nearest Neighbor (fuzzy k-NN) method. Within the experimental setup, different behaviors such as blinking and depth focus change signals are recorded with constant depth regional borders are analyzed on an A4 paper with reading eye movement recordings. In experimental results, fuzzy k-NN classification results are obtained from observed regional eye movement. The study shows that the fuzzy k-NN method to detect regions at a reading distance is feasible for user interface applications in VR. So, by setting rendering focus at the detected regional area, eye strain can be reduced during prolonged VR sessions especially when reading and/or on user interfaces.

Developing a Workflow for Transforming BIM Models into Immersive Virtual Reality Experiences

Abstract. The integration of Extended Reality (XR) and Building Information Modelling (BIM) has emerged as a promising approach for enhancing interaction with spatial data in the built environment. While the potential of BIM for advanced visualization has been recognized, there remains a need for standardized workflows that facilitate the transformation of BIM models into immersive virtual reality (VR) experiences. This research contributes to the ongoing development of BIM-VR integration by presenting a workflow that leverages Revit, Twinmotion, and Datasmith to create visually rich and interactive VR environments. The established process focuses on enhancing textures, incorporating dynamic lighting and weather simulations, and populating the virtual space with realistic elements. The workflow also addresses the integration of interactable objects to elevate user engagement and the use of cutting-edge VR headsets for an immersive experience. By providing a structured approach to bridging complex BIM data with VR, this research aims to support architects, engineers, construction professionals, and clients in design collaboration, project review, and decision-making across the building lifecycle. The workflow's potential for facilities management and training applications is also explored. Through a case study, the research demonstrates the workflow's effectiveness in facilitating a deeper understanding of architectural spaces before construction, highlighting its potential for improving efficiency and reducing rework. The paper also discusses the challenges and opportunities associated with integrating BIM with GIS and sensor data to create comprehensive digital twins. This research contributes to the growing body of knowledge on BIM-VR integration and underscores the importance of continued development in this field to enhance the design, communication, and experience of the built environment.

Changes in Auditory Performance Following a Virtual Reality Music Concert.

The purpose of this study was to evaluate threshold and suprathreshold auditory risk from a newly popular platform of music concert entertainment; virtual reality (VR) headsets. Recreational noise exposure to music is the primary source of hearing hazard in young-adults, with noise doses of in-person concert venues and music festivals well in excess of the recommended daily exposure recommendation from the National Institute for Occupational Safety and Health. While research on the relationship between personal music players and noise-induced hearing loss risk is abundant, no study has yet evaluated noise-induced hearing loss risk from VR headsets, which are newest to the commercial market at this time. Thirty-one young-adult participants (18 to 25 years) with normal-hearing sensitivity (0 to 16 dB HL) experienced a VR music concert and participated in three data collection timepoints: Session A preexposure, Session A post-exposure, and Session B post-exposure. Participants underwent baseline testing for audiometry (0.25 to 20 kHz), distortion product otoacoustic emission testing (1 to 10 kHz), and Words-in-Noise testing. Participants then wore a commercially available VR headset (Meta Quest 2) and experienced a freely available online VR music concert (via the video-sharing website "YouTube"). The VR music concert duration was 90 min set to maximum volume, which yielded an average sound level equivalent of 78.7 dBA, max sound level of 88.2 dBA, and LC peak sound level of 98.6 dBA. Post-exposure testing was conducted immediately at the conclusion of the VR concert, and again within 24 hr to 1 week after the exposure. Participants also answered a questionnaire that estimated noise exposure history (National Acoustics Laboratory "Noise Calculator"). Post-exposure deficit was not observed in DPOAEs or Words-in-Noise score (p's > 0.05). However, statistically significant temporary post-exposure deficit was observed in audiometry at 4, 8, and 12.5 kHz (p's < 0.05) (mean differences: 2 to 3 dB HL). Twenty-four hours and 1-week post-exposure measurements revealed no permanent changes from baseline measurements (p's > 0.05) aside from one spurious difference at 12.5 kHz. Males tended to exhibit a significantly higher noise history score on average than females. The primary, secondary, and tertiary sources of noise hazard history in this young-adult cohort included amplified music. These preliminary data suggest that VR music concerts-which are likely to produce a substantially lower noise dose than in-person music concerts-may still be capable of producing at least slight, temporary threshold shifts on the order of 2 to 3 dB HL. Future research should include VR headsets in personal music player risk assessment, as the VR music concert platform is increasing rapidly in popularity among young-adults.

AffectiVR: A Database for Periocular Identification and Valence and Arousal Evaluation in Virtual Reality

This study introduces AffectiVR, a dataset designed for periocular biometric authentication and emotion evaluation in virtual reality (VR) environments. To maximize immersion in VR environments, interactions must be seamless and natural, with unobtrusive authentication and emotion recognition technologies playing a crucial role. This study proposes a method for user authentication by utilizing periocular images captured by a camera attached to a VR headset. Existing datasets have lacked periocular images acquired in VR environments, limiting their practical application. To address this, periocular images were collected from 100 participants using the HTC Vive Pro and Pupil Labs infrared cameras in a VR environment. Participants also watched seven emotion-inducing videos, and emotional evaluations for each video were conducted. The final dataset comprises 1988 monocular videos and corresponding self-assessment manikin (SAM) evaluations for each experimental video. This study also presents a baseline study to evaluate the performance of biometric authentication using the collected dataset. A deep learning model was used to analyze the performance of biometric authentication based on periocular data collected in a VR environment, confirming the potential for implicit and continuous authentication. The high-resolution periocular images collected in this study provide valuable data not only for user authentication but also for emotion evaluation research. The dataset developed in this study can be used to enhance user immersion in VR environments and as a foundational resource for advancing emotion recognition and authentication technologies in fields such as education, therapy, and entertainment. This dataset offers new research opportunities for non-invasive continuous authentication and emotion recognition in VR environments, and it is expected to significantly contribute to the future development of related technologies.

Understanding Expressions of Self-Determination Theory in the Evaluation of IDEA-Themed VR Storytelling

This study investigates how prior experiences (personal or a close other’s) influence individuals’ engagement with virtual reality (VR) stories designed to promote understanding and foster prosocial behavior. Integrating self-determination theory and self–other overlap, we conducted an experimental mixed-method study with 35 participants who experienced three VR stories focused on inclusion, diversity, equity, and accessibility (IDEA): living with Alzheimer’s, blindness, and in a refugee camp. Findings indicate that while participants felt some autonomy with the VR headset, they experienced a lack of autonomy, competence, and relatedness in the storytelling. Participants engaged in perspective-taking but often thought about those close to them who had similar experiences rather than themselves. Thus, a close other’s experience affected whether people engaged in perspective-taking. However, prior experience with IDEA topics did not predict cognitive effort, indicating that individuals with such experience do not exert more cognitive effort than those without it. Additionally, cognitive effort did not predict prosocial attitudes or behaviors. This study highlights the complexities of how previous experiences affect engagement with IDEA-centered VR, perspective-taking, and cognitive effort and suggests directions for future research.

Audio’s Impact on Immersive Experience in Extended Reality and Digital Games: A Systematic Review

Extended reality and digital games strive to deliver a high level of “immersion,” a complex phenomenon influenced by both perceptual and psychological factors. Audio plays a crucial role in shaping immersive experiences, yet there is no clear consensus on its impact or on the best methods to evaluate it. This paper presents a systematic literature review spanning two decades, outlining the methods and findings related to how audio influences immersion in extended reality and digital games. It reveals a strong preference for experiments using virtual reality headsets and headphones and notes a gap in research on augmented and mixed reality environments. Moreover, it underscores the need for audio-specific metrics to better assess the ways that audio variables impact immersion. The findings demonstrate that audio elements like spatial fidelity, music, and the integration of sound in multimodal environments generally contribute to the immersive experience but also highlight a threshold beyond which further enhancements may not perceptibly improve the experience. It emphasizes the need for realtime, objective measures of immersion as well as the consideration of diverse methodological approaches to deepen the understanding of audio’s role in immersive technologies.

Surgeon perspectives on a virtual reality platform for preoperative planning in complex bone sarcomas

Background and objectivesTreatment of primary bone and soft tissue sarcomas typically includes complete surgical resection with or without adjunctive modalities. Despite best efforts, for the most challenging clinical scenarios such as axial or pelvic sarcoma, five-year survival rates are reported to be between 27 and 40 %. Since quality of resection is a key determinant of oncologic outcomes, it is critical to preoperatively plan the surgical approach to improve resection accuracy, ensure sufficient surgical margins, and reduce the risk of local or metastatic recurrence. The computer conversion of 2-dimensional (2D) computerized tomography (CT) and magnetic resonance imaging (MRI) to a three-dimensional (3D) virtual reality (VR) avatar image may allow improved preoperative estimation of tumor size, location, adjacent anatomy, and spatial understanding of the tumor without relying on surgeon experience, memory, and imagination. The purpose of this study is to investigate the utility of a virtual reality platform in preoperative planning and surgical approach in a retrospective cohort of pelvic bone sarcoma cases. MethodsThe histopathology database at our institution was queried for all historical cases of bone and soft tissue sarcoma with surgical resection failure, defined as positive gross or microscopic margins. Four cases of pelvic bone sarcoma were chosen for retrospective review by fellowship-trained orthopedic tumor specialists. For each case, participants first studied conventional 2D preoperative CT images and answered a questionnaire pertaining to objective case parameters. Participants then interacted with case-specific 3D models while wearing a VR headset and answered the same questionnaire. The VR ‘avatar’ was created with custom-developed software. After using both modalities, participants completed a Likert-scale survey aiming to evaluate the VR technology's subjective impact on understanding tumor environment, surgical plan confidence, and its ability to improve communication with colleagues and patients. Four attending orthopedic oncologists, one orthopedic oncology fellow, and one senior orthopedic oncology resident participated in the study. ResultsFour cases of failed resection were evaluated by a group of both attending surgeons and a group of trainees composed of both residents and fellows. Tumor borders were clearly delineated in 0 % and 66.6 % cases when evaluating with conventional 2D imaging and VR, respectively. Participants changed adjacent structure involvement grade 22.2 % of the time after assessing involvement grade on the VR technology, with adjacent ligamentous structure grading changed most frequently in 55.5 % of cases. Users reported they would change the surgical approach or margins 44.4 % of the time after reviewing with VR technology. Initial 6 plane resection plans were changed in every user case. Subjective responses indicated that surgeons expressed more confidence in their approach, confidence with obtaining negative margins, and provided more detail regarding structures to be resected in specific planes. ConclusionPelvic tumors present unique surgical challenges due to complex 3D anatomy, the proximity of vital structures, consistency of the tumor, and the need to alter patient position during resection procedures. Using examples of failed pelvic bone sarcoma resections, our study found that VR imaging increased understanding of the tumor environment, characteristics, and ability to communicate with patients and colleagues.

Exploring neural efficiency in spatial cognition: A comparative study of 3D visual stimuli in virtual reality across STEM and non-STEM fields

Spatial cognition plays a crucial role in our daily lives. The relationship between spatial abilities and mathematical performance is well-established, with visuospatial training offering significant benefits in academic STEM (Science, Technology, Engineering, and Mathematics) disciplines. Developing visuospatial training requires an objective evaluation of spatial cognition and consideration of various 3D displays. This study aims to compare the neural efficiency of STEM and non-STEM individuals during mental rotation tasks (MRT) in 3D and 2.5D conditions (pseudo 3D) using virtual reality (VR). For that, we propose a novel integrative assessment of spatial cognition by combining a cost-effective VR headset and functional near-infrared spectroscopy (fNIRS). Overall, the findings reveal that STEM individuals exhibit greater neural efficiency in the dorsolateral prefrontal cortex (PFC) while solving MRT in a VR environment compared to their non-STEM counterparts. Additionally, the study shows that there is no significant difference in performance between 3D and 2.5D stimuli, suggesting that both conditions are equally suitable for MRT in VR. One possible explanation is that immersive VR reduces the distinctions between 3D models and 2.5D images, considering MRT scores and PFC activity. This research underscores the practicality and relevance of using VR and fNIRS to evaluate visuospatial tasks and the potential to identify distinct student learning profiles and enhance spatial skills. Furthermore, it highlights the potential of 2.5D stimuli as a cost-effective alternative for learning applications in VR. Here, we demonstrated that modeling the same task in 3D and 2.5D conditions can compare how humans interact with visuospatial tests, providing insights into applying VR devices to develop spatial skills.

Impact of virtual reality hypnosedation on perioperative pain and anxiety in port implantation under local anesthesia: a randomized controlled pilot trial (VIP Trial)

BackgroundThis monocentric randomized controlled pilot trial investigates the impact of virtual reality (VR) hypnosedation on perioperative anxiety, pain, patient satisfaction, and medication usage during port implantation under local anesthesia.MethodsA total of 120 patients undergoing elective port implantation between January 2022 and August 2023 were enrolled and randomized in a 1:1 ratio to either a VR hypnosedation group or a control group. The VR group used a commercially available VR headset with the HypnoVR application, providing various environments, musical backgrounds, and a guiding voice, while the control group underwent the procedure without VR. Patients with ASA > 3, chronic pain, cognitive issues, and contraindications against VR use were excluded. The main outcomes measured were perioperative pain and anxiety scores, with secondary outcomes including perioperative medication usage. Due to the nature of the interventions, blinding of patients and physicians was not feasible. Statistical analysis was primarily descriptive and exploratory, focusing on estimating effect sizes for future trials.ResultsThe study found no significant differences in immediate postoperative pain with 1.43 ± 1.63 vs. 1.6 ± 2.05 (p = 0.62) or anxiety scores 30.65 ± 9.13 vs. 31.78 ± 13.34 (p = 0.60) between the no VR and VR group, respectively. Additionally, there was a trend to less usage of certain medications, particularly remifentanil (mean dose of 200 mg vs. 100 mg (p = 0.12)) and novaminsulfon (mean dose of 1250 mg vs. 900 mg (p = 0.26)) in the VR group vs. no VR group, respectively. However, these differences were not statistically significant and therefore no definitive conclusions can be drawn regarding medication usage based on this data.ConclusionWhile VR hypnosedation did not significantly reduce perioperative pain or anxiety in this pilot trial, the observed trends in reduced medication usage suggest potential benefits. These findings warrant further investigation in larger, confirmatory trials to better understand the role of VR in enhancing patient comfort and potentially reducing reliance on pharmacological interventions during surgical procedures.Trial registrationGerman Clinical Trials Register: DRKS00028508; registration date 15 March 2022; Universal Trial Number: U1111-1275–4995.

Designing a virtual reality system for clinical education and examination

The COVID-19 pandemic clearly showed how much medical and clinical students’ education relied on physical instruction and examination. The work presented here was born by the fact that medical and clinical education had to be suspended during the social distancing phase of the pandemic. This work presents the lessons learned from creating a virtual reality system (VTRACS) for educating and assessing clinical students on a limited budget. Our work showed that clinical education could be done in a virtual space with a minimal virtual reality setup and a low-cost virtual reality headset.