Standard Virtual Reality Research Articles

Exploring the Feasibility of Head-Tracking Data for Cybersickness Prediction in Virtual Reality

Cybersickness remains a significant barrier to the widespread adoption of virtual reality (VR) technology. Traditional methods for predicting cybersickness rely on self-reported questionnaires or physiological signals from specialized sensors, which have their limitations. This study explores the potential of using real-time, easily acquired head-tracking data (HTD) from standard VR headsets as a scalable alternative for estimating cybersickness. Twelve participants engaged in a VR session using an Oculus Quest 2 headset while their HTD were recorded. Kinematic metrics such as linear and angular velocity, acceleration, and jerk were computed from the HTD, including positional and angular parameters. Participants’ cybersickness levels were assessed using the Virtual Reality Sickness Questionnaire. While exploratory data analysis revealed no significant direct correlation between individual kinematic variables and cybersickness scores, machine learning models were employed to identify predictive patterns. Subsequently, four regression models, including Random Forest, Gradient Boosting, K-Nearest Neighbors, and Support Vector Machines, were trained and evaluated using the computed kinematic features to predict the cybersickness score. Among these, the Gradient Boosting model demonstrated superior performance, accurately predicting cybersickness scores with normalized differences less than 3.08% on unseen data. This approach offers a scalable and practical solution for real-time cybersickness prediction in VR applications and compliments other techniques that rely on physiological sensors, hardware, or user profiles.

Fuzzy-Based Virtual Reality System for Cultural Heritage: Enhancing User Interaction and Experience Through Contextual Assistive Messaging

The article highlights the need for enhanced user interaction and personalization in virtual reality (VR) systems for cultural heritage. As cultural sites become accessible through VR, delivering meaningful and tailored user experiences is crucial for effective learning and engagement. Traditional VR systems often fail to address varying levels of user expertise, limiting the accessibility of cultural content. To solve this, the study introduces SculptMate, a fuzzy logic-based VR system that estimates user proficiency in computers and VR, delivering context-sensitive assistive messages. In a study with 64 participants, SculptMate was compared to a standard VR system. Results demonstrated significantly higher engagement and comprehension of cultural artifacts with SculptMate, offering a personalized, immersive experience. The study emphasizes the potential of integrating fuzzy logic into VR to improve educational outcomes and user satisfaction. Future enhancements include dynamic machine learning, multisensory components, and platform optimization for broader accessibility and better user experiences.

Virtual reality for the management of pain and anxiety during outpatient manual vacuum aspiration for miscarriage or incomplete abortion: a mixed methods trial.

To evaluate the efficacy and acceptability of virtual reality (VR) as a distraction technique in the management of acute pain and anxiety during outpatient uterine aspiration using a manual vacuum aspirator (MVA). This mixed methods study included a prospective multi-centre randomised controlled trial and structured individual interviews. Of the 72 patients approached, 50 consenting, eligible participants were randomised to VR intervention (immersive video content 'The Forest of Serenity') or standard care during MVA for the management of miscarriage or incomplete abortion from July 2021-July 2022 across two university hospitals in London, UK. Expected and actual pain scores, and anxiety before and after the procedure were measured as numeric rating scores (0-10). Structured interviews were undertaken after the procedure in women randomised to VR. Statistical analysis of pain and anxiety scores were by intention-to-treat including all randomised participants, using Stata-12 software. Qualitative analysis was achieved by thematic analysis of transcribed interviews. There was no significant difference in pain or anxiety scores reported by participants randomised to VR compared with standard care. Mean worst pain scores were 5.98 and 6.88 in the standard care and VR groups respectively (p-value 0.13), with corresponding anxiety scores at the end of the procedure 3.94 and 3.3 (p-value 0.57). Qualitative analysis from interviews was highly favourable from women randomised to VR with all participants reporting a positive experience. 90% (18/20) of participants reported that VR reduced their anxiety and 71% (15/21) stated that it helped to reduce or distract from their pain. While virtual reality did not decrease pain or anxiety scores during MVA, it is a feasible and acceptable option that may improve patient experience.

An Empirical Study on Social Anxiety in a Virtual Environment through Mediating Variables and Multiple Sensor Data

Social anxiety disorder is a psychological condition characterized by excessive nervousness in social situations, such as interpersonal interactions. Exposure therapy has shown benefits in its treatment, and virtual reality (VR) technology has gained much attention for reducing physical and psychological distance and providing additional quantitative evidence from the data generated by standard VR devices (e.g., head-mounted display). Clinical psychology studies have highlighted the importance of mediating variables of social anxiety; however, existing VR-based social anxiety studies have neglected such variables with respect to user experience and data analysis in the context of VR, although these variables could provide insights into the design and use of VR for the treatment of social anxiety. In this study, we focused on two representative mediating variables of social anxiety: (1) the gap between self-presentation motivation and expectancy , and (2) self-focused attention . We used sensor data (e.g., head movement, eye movement, eye gaze, and psychological signals) to investigate the impact of these variables on users' anxiety responses in VR. We developed <u>VR</u>-based <u>S</u>ocial Anxiety Support <u>T</u>ool (VRST) that reflects the theoretical design elements of effective anxiety provocation. Based on the results of a user study with 30 participants, we confirmed that the mediating variables were associated with social anxiety in the VR environment. We also found that the mediating variables were associated with eye gaze, eye pupil, head movement, and body temperature. Our study results provide researchers, designers, and practitioners with empirical evidence and implications for the use of VR technology and sensor data in the mental health context.

The role of virtual reality on physical and psychological health among older adults: A systematic review

To synthesis and appraise the existing research about the effect and outcomes of virtual reality (VR) interventions among older adults. A systematic review. This systematic review was conducted following the PRISMA guidelines and including multiple databases: Scopus, CINHAL, PubMed, Medline, and Web of Science, from 30 March 2014 to 30 March 2024. A total of 13 studies from 424 articles were included in the review. Seven studies were randomized control trial (RCT) and five studies were quasi-experimental study for feasibility trial with one for longitudinal study. The intervention group showed positive outcomes on physical activity and cognitive function (p<0.001) among older adults. This review concluded that the use of virtual reality intervention can promote cognitive function, physical health, mental health, well-being, and reduce the risk of falls among older people. VR technology plays the role to improved physical and psychological health among older adults. Future research can study the standardized VR intervention on health promotion for the effect and sustainability among older people.

My virtual escape from patient life: a feasibility study on the experiences and benefits of individualized virtual reality for inpatients in palliative cancer care

BackgroundCancer patients benefit from Virtual Reality (VR) in burdensome situations, but evidence is scarce for palliative situations. Based on earlier work in palliative care, individualized VR interventions like seeing the patient’s home may address a patient’s wish to be at home and thus have a greater effect compared to standard VR content. Yet, some patients and relatives may be concerned about their privacy. Also, patient stakeholders raised concerns about triggering depressed mood or homesickness.AimTo test the feasibility and safety of individualized vs. standard 360°video VR interventions in palliative cancer inpatients.MethodsProspective observational study with patient-reported outcome measurement using validated instruments of well-being (MDBF), symptoms and psychosocial burden (IPOS), cybersickness (SSQ), presence experience (SPES), subjective benefit (2 items), content analysis of interviews, and field notes. Individualized VR content was recorded with action camcorder-technology to protect the patients’ privacy.ResultsSeventeen patients participated, median age 65 years (range 20–82), 9 women (53%), 8 single or widowed (47%), 4 childless (23.5%), 4 academics (23.5%), with a median length of stay of 9 days (1–75) in the hematology (10), palliative care (3), or radiotherapy (2) unit of a German university hospital. Eight patients (53.3%) chose their own home environments or family for individualized VR-content. All participants enjoyed the intervention. Compared to standard VR content the individualized VR tended to have a stronger effect on well-being and emotional touch. It was not inferior in terms of psychosocial burden and cybersickness. No subjective and relevant side effects occurred. The patients well tolerated the assessments. However, most patients demanded a lighter headset and a desire for more interactivity.ConclusionsIndividualization of VR content shows potential for enhancement of immersion, which improves the VR experience and does not harm in terms of depressed mood or worsening of symptoms. The patients’ and family desire for privacy is feasible with the support of family members who recorded the individualized videos, which is easily manageable today. We suggest a pragmatic randomized clinical trial to compare the effects of individualized vs. standard VR-content.Trial registrationRegistered at German Clinical Trials Register (Deutsches Register Klinischer Studien; DRKS); registration number: DRKS00032172; registration date: 11/07/2023.

Infectious Diseases-Approved Virtual Reality Goggles for Common Procedures in Pediatric Surgical Patients.

Background/Objective: Virtual reality (VR) technology has been reported as effective in mitigating fear, anxiety, and pain in children undergoing various medical procedures. Our aim was to test the effectiveness of non-sponge-coated mobile phone-operated VR goggles approved by infectious diseases (ID) control in pediatric surgical patients. Methods: A prospective randomized trial in which pre-procedural and post-procedural heart rate, fear, and anxiety, and post-procedural pain were measured in pediatric surgical patients assigned to receive standard care versus standard care and VR goggles. The patients underwent line insertions, peripheral venipunctures for blood draws, drain removals, and wound care. Results: The control group and the intention-to-treat group were each randomly assigned twenty-four patients. Since eight patients who received VR goggles removed them prior to completion of the procedure, the study group included sixteen patients. In the study group, heart rate, fear, and anxiety scores were significantly lower after the procedure as compared to prior to the procedure. In the control group, these parameters were similar before and after the procedure. Post-procedural decrease in fear and anxiety was significant when comparing VR to control. However, despite better post-procedural physiological and emotional scores in the VR group as compared to control, the differences were not statistically significant. Pre-procedural anxiety was significantly higher in the study group. Conclusions: ID-approved VR goggles can reduce fear and anxiety associated with procedures commonly performed in pedicatric surgical patients. However, since increased baseline anxiety might be associated with VR, a higher benefit might be achieved if goggles were worn only by children who express a clear desire to use them.

Virtual Reality Simulation of Airway Management Post-Cleft Palate Surgery: A Model for Sustainable and Equitable Education.

The effectiveness of virtual-reality (VR) simulation-based training in cleft surgery has not been tested. The purpose of this study was to evaluate learners' acceptance of VR simulation in airway management of a pediatric patient post-cleft palate repair. This VR simulation was developed through collaboration between BioDigital and Smile Train. 26 medical students from a single institution completed 10 min of standardized VR training and 5 min of standardized discussion about airway management post-cleft palate repair. They spent 4-8 min in the VR simulation with guidance from a cleft surgery expert. Participants completed pre- and post-surveys evaluating confidence in using VR as an educational tool, understanding of airway management, and opinions on VR in surgical education. Satisfaction was evaluated using a modified Student Evaluation of Educational Quality questionnaire and scored on a 5-point Likert scale. Wilcoxon signed-rank tests were performed to evaluate responses. There was a significant increase in respondents' confidence using VR as an educational tool and understanding of airway management post-cleft palate repair after the simulation (P < .001). Respondents' opinions on incorporating VR in surgical education started high and did not change significantly post-simulation. Participants were satisfied with VR-based simulation and reported it was stimulating (4.31 ± 0.88), increased interest (3.77 ± 1.21), enhanced learning (4.12 ± 1.05), was clear (4.15 ± 0.97), was effective in teaching (4.08 ± 0.81), and would recommend the simulation (4.2 ± 1.04). VR-based simulation can significantly increase learners' confidence and skills in airway management post-cleft palate repair. Learners find VR to be effective and recommend its incorporation in surgical education.

Virtual Reality and Transcranial Direct Current Stimulation for Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is a common psychiatric disorder that is particularly difficult to treat in military veterans. Noninvasive brain stimulation has significant potential as a novel treatment to reduce PTSD symptoms. To test whether active transcranial direct current stimulation (tDCS) plus virtual reality (VR) is superior to sham tDCS plus VR for warzone-related PTSD. This double-blind randomized clinical trial was conducted among US military veterans enrolled from April 2018 to May 2023 at a secondary care Department of Veterans Affairs hospital and included 1- and 3-month follow-up visits. Participants included US military veterans with chronic PTSD and warzone-related exposure, recruited via referral and advertisement. Patients in psychiatric treatment had to be on a stable regimen for at least 6 weeks to be eligible for enrollment. Data were analyzed from May to September 2023. Participants were randomly assigned to receive 2-mA anodal tDCS or sham tDCS targeted to the ventromedial prefrontal cortex, during six 25-minute sessions of standardized warzone VR exposure, delivered over 2 to 3 weeks. The co-primary outcomes were self-reported PTSD symptoms, measured via the PTSD checklist for DSM-5 (PCL-5), alongside quality of life. Other outcomes included psychophysiological arousal, clinician-assessed PTSD, depression, and social/occupational function. A total of 54 participants (mean [SD] age, 45.7 [10.5] years; 51 [94%] males) were assessed, including 26 in the active tDCS group and 28 in the sham tDCS group. Participants in the active tDCS group reported a superior reduction in self-reported PTSD symptom severity at 1 month (t = -2.27, P = .02; Cohen d = -0.82). There were no significant differences in quality of life between active and sham tDCS groups. Active tDCS significantly accelerated psychophysiological habituation to VR events between sessions compared with sham tDCS (F5,7689.8 = 4.65; P < .001). Adverse effects were consistent with the known safety profile of the corresponding interventions. These findings suggest that combined tDCS plus VR may be a promising strategy for PTSD reduction and underscore the innovative potential of these combined technologies. ClinicalTrials.gov Identifier: NCT03372460.

Stylus and Gesture Asymmetric Interaction for Fast and Precise Sketching in Virtual Reality

This research investigates fast and precise Virtual Reality (VR) sketching methods with different tool-based asymmetric interfaces. In traditional real-world drawing, artists commonly employ an asymmetric interaction system where each hand holds different tools, facilitating diverse and nuanced artistic expressions. However, in virtual reality (VR), users are typically limited to using identical tools in both hands for drawing. To bridge this gap, we aim to introduce specifically designed tools in VR that replicate the varied tool configurations found in the real world. Hence, we developed a VR sketching system supporting three hybrid input techniques using a standard VR controller, a VR stylus, or a data glove. We conducted a formal user study consisting of an internal comparative experiment with four conditions and three tasks to compare three asymmetric input methods with each other and with a traditional symmetric controller-based solution based on questionnaires and performance evaluations. The results showed that in contrast to symmetric dual VR controller interfaces, the asymmetric input with gestures significantly reduced task completion times while maintaining good usability and input accuracy with a low task workload. This shows the value of asymmetric input methods for VR sketching. We also found that the overall user experience could be further improved by optimizing the tracking stability of the data glove and the VR stylus.

Sex-related differences in young binge drinkers on the neurophysiological response to stress in virtual reality.

Stress is one of the main environmental factors involved in the onset of different psychopathologies. In youth, stressful life events can trigger inappropriate and health-damaging behaviors, such as binge drinking. This behavior, in turn, can lead to long-lasting changes in the neurophysiological response to stress and the development of psychological disorders late in life, e.g., alcohol use disorder. Our aim was to analyze the pattern of neurophysiological responses triggered with the exposition to a stressful virtual environment in young binge drinkers. AUDIT-3 (third question from the full AUDIT) was used to detect binge drinking (BD) in our young sample (age 18-25 years). According to the score, participants were divided into control (CO) and BD group. Next, a standardized virtual reality (VR) scenario (Richie's Plank) was used for triggering the stress response while measuring the following neurophysiological variables: brain electrical activity by electroencephalogram (EEG) and cortisol levels through saliva samples both measurements registered before and after the stressful situation. Besides, heart rate (HR) with a pulsometer and electrodermal response (EDA) through electrodes placed on fingers were analyzed before, during and after the VR task. Regarding the behavior assessed during the VR task, BD group spent significantly less amount of time walking forward the table and a tendency toward more time walking backwards. There was no statistically significant difference between the BD and the CO group regarding time looking down, but when we controlled the variable sex, the BD women group displayed higher amount of time looking down than the rest of the groups. Neurophysiological measurements revealed that there was not any statistically significant difference between groups in any of the EEG registered measures, EDA response and cortisol levels. Sex-related differences were found in HR response to VR scenario, in which BD women displayed the highest peak of response to the stressor. Also, the change in heartbeat was higher in BD women than men. Unveiling the neurophysiological alterations associated with BD can help us to prevent and detect early onset of alcohol use disorder. Also, from our data we conclude that participants' sex can modulate some stress responses, especially when unhealthy behaviors such as BD are present. Nevertheless, the moment of registration of the neurophysiological variables respect to the stressor seems to be a crucial variable.

Development of a second‐screen system for sharing virtual reality information

AbstractSince virtual reality technology can easily realize a particular environment, it has been applied to various training. This technology is also expected in education such as those dealing with three‐dimensional figures because they can represent phenomena in three dimensions. One of the standard virtual reality technologies is wearing a head‐mounted display to experience a virtual reality project. However, the virtual reality experience is limited to the person wearing the head‐mounted display (in most cases) when considering the use of head‐mounted display‐based virtual reality in education, making its usage unsuitable for mass education. Therefore, in this study, we develop a second‐screen system that can share virtual reality information using an Android device. Healthy first‐ and second‐year high school students between the ages of 15 and 17 were asked to use the virtual reality educational materials that implemented the developed system, and a questionnaire survey was conducted. There were no negative comments in the survey on whether proposing second‐screen system was necessary, demonstrating the usefulness of the proposed system. Therefore, the second‐screen system may adapt VR technology to mass education. In addition, we developed a package to integrate our second‐screen system into the pre‐existing virtual reality projects. This package simplifies the procedure for implementing a second‐screen system, thus helping to reuse the virtual reality projects that have been developed so far.

Implementing Affordable Virtual Reality Interventions for Older Adults in Latin America: A Feasibility Study

Introduction:Virtual Reality (VR)-based meditation has shown to help reduce, stress, anxiety, sadness, and anger in younger adults. However, this has not been extensively studied in older adults. Furthermore, there are no standard guidelines on how VR mindfulness interventions should be implemented to ensure successful outcomes in different cultures and languages. The availability of affordable hardware raises the possibility of VR being used in low-income countries. The goal of this study is to describe and highlight some key considerations and challenges when implementing low-cost VR mindfulness interventions with older adults in Quito, Ecuador.Methods:We created a guided mindfulness intervention using low-cost VR (smartphones and Destek V5 headsets) for older adults with anxiety in Quito, Ecuador. This project is a collaboration between the Technology and Aging Lab at McLean Hospital and the Universidad San Francisco de Quito in Ecuador. Our goal was to recruit 20 older adults with anxiety from various outpatient settings in Quito. We used the free “Sites in VR” app and selected different nature scenes for each intervention. The intervention consists of a total of 10 sessions each lasting 30 minutes. We assessed depression using the Geriatric Depression Scale (GDS), and anxiety with the Generalized Anxiety Disorder 7-item scale (GAD-7). In addition, we also administered the Mindfulness Attention Awareness Scale (MAAS) and the Behavior Activation for Depression scale (BADS).Results:At the time of writing, we have reached 100% of our recruitment goal and anticipate completing data analysis by January 2023. Qualitatively, our intervention revealed barriers to designing scalable VR Spanish language interventions in Latin America. Some of the main difficulties we encountered are described below: (i) There are very few virtual reality videos (360° videos) that are available for use with the DesTeK VS VR Headset in Spanish. We therefore, used a standardized Spanish narration to guide the mindfulness practice based on a script used in the United States. (ii) We found that majority of the available content is not suitable for mindfulness. Using the application Sites in VR remedied this concern, as it provides static 360° images, suitable for mindfulness. (iii) Not all technology necessary for VR interventions is readily available in Latin America: smartphones sold in Latin America do not always have a gyroscope sensor.Conclusion:Mindfulness interventions using virtual reality may be an effective way to address stress and mood symptoms in older adults across cultures. However, there are many culture-specific aspects that must be addressed before applying these interventions in different cultures. This study, conducted in Latin America, is an initial step toward the establishment of best practices and standardized low-cost VR mindfulness intervention in older adults, and many aspects addressed here may be generalizable to other cultures, settings, and countries.

Predicting Post-Traumatic Stress Disorder Treatment Response Using Heart Rate Variability to Virtual Reality Environment and Modified Stroop Task: An Exploratory Study.

Predicting treatment response can inform treatment decisions, expectations, and optimize use of mental health treatment resources. This study examined heart rate (HR), heart rate variability (HRV), and a modified Stroop task (mStroop) to predict post-traumatic stress disorder (PTSD) treatment response. We report on an observational, longitudinal study with 45 U.S. veterans in outpatient PTSD care, who had deployed to Iraq or Afghanistan. HR and HRV were collected before, during, and after virtual reality (VR) combat and civilian scenes. HRV recovery was defined as HRV after a 3-minute VR simulation minus HRV during a VR scene. mStroop threat variables included index scores for combat and general threat. Self-report data were collected at baseline and 6 months later. The outcome variable was the 17-item Clinician Administered PTSD Scale (CAPS). Controlling for baseline CAPS and number of combat experiences, the following baseline HRV recovery variables were significant predictors of 6-month CAPS: standard deviation of normal beat to beat interval (SDNN) after combat scene minus SDNN during combat scene and low-frequency (LF HRV) after civilian scene minus LF during civilian scene. HRV at rest, HR reactivity, HR recovery, and mStroop scores did not predict treatment response. In conclusion, HRV recovery variables in the context of a standardized VR stressor were significant predictors of PTSD treatment response after controlling for baseline CAPS and number of combat experiences. The direction of this relationship indicates that greater baseline HRV recovery predicts lower 6-month PTSD symptom severity. This was an exploratory study in need of replication.

Optimizing Immersion: Analyzing Graphics and Performance Considerations in Unity3D VR Development

Aims: Virtual reality (VR) is a new approach that gives users an immersive experience. VR applications frequently experience performance bottlenecks due to the high processing cost of displaying real-time animations multiple times (for both eyes) and the limited resources of wearable devices, performance optimization serves a significant part in VR application development. The goal of this paper is to investigate approaches and techniques available in Unity3D to improve the immersion of VR in virtual reality. This entails studying visuals and performance elements to design more fluid and engaging VR apps.&#x0D; Study Design: Quantitative analysis.&#x0D; Methodology: Systematic literature reviews, Consensus on the design space for VR-based education would greatly benefit future advances. To do this, we use a systematic mapping technique to the literature, extracting essential data from papers indexed in four academic online databases.&#x0D; Results: VR applications include extra aspects like graphics rendering and actual time animation, performance improvements for VR apps might differ significantly from those for standard software. Fully immersive virtual environments vary from standard virtual reality environments in that they can record entire body movements. This skill enables users to engage with other avatars, computer-controlled entities, and artifacts in the virtual world using their complete range of physical activities. VR performance optimization, in essence, relates to the methods, tactics, and procedures used to ensure that VR experiences function as smoothly as feasible.&#x0D; Conclusion: This optimization might be performed on different kinds of technology, particularly low-end devices, without sacrificing visual fidelity or immersive experience. VR is well-known for. It is critical to optimize visuals as well as performance in Unity3D VR apps to produce immersive and engaging experiences. Balancing great aesthetics with seamless performance necessitates a thorough grasp of Unity's features as well as a dedication to constant optimization.

Validation of a multidisciplinary virtual reality (VR) robotic surgical curriculum.

The objective is to identify whether trainees demonstrate improvement in a standardized knot-tying task as assessed by Global Evaluative Assessment of Robotic Skills (GEARS) score after completion of a virtual reality (VR) robotic curriculum. An IRB-exempt prospective study was conducted with surgical trainees from August 2021 to February 2023. Participants initially performed a baseline robotic suturing task in which they were instructed to tie interrupted square knots in 10min. Participants then completed a virtual reality simulation curriculum involving 23 exercises until they achieved 90% proficiency on all tasks. Participants then repeated the suturing task. Pre- and post-curriculum suturing tasks were recorded, de-identified, and scored by expert graders using a GEARS score. Trainees from three academic centers were invited to participate. Medical students (MS1-MS3) and surgical residents from gynecology, urology, and general surgery were invited to participate. Twenty-five trainees completed the pre-curriculum suturing task, the VR curriculum, and the post-curriculum suturing task. Trainees demonstrated significant improvement in their post-test GEARS score by 2.43 points (p < 0.05) and were able to tie three additional knots within 10min after completion of the curriculum (p < 0.05). Trainees also demonstrated a faster time to complete first knot (114s improvement, p < 0.05) after completion of the curriculum. All participants agreed or strongly agreed that completion of the robotic curriculum helped them feel more comfortable using the robotic console, and improved their robotic surgical skills. Surgical trainees and medical students with limited prior robotic surgical experience demonstrated objective improvement after completion of a standardized VR curriculum.

Brass Haptics: Comparing Virtual and Physical Trumpets in Extended Realities

Despite the benefits of learning an instrument, many students drop out early because it can be frustrating for the student, expensive for the caregiver, and loud for the household. Virtual Reality (VR) and Extended Reality (XR) offer the potential to address these challenges by simulating multiple instruments in an engaging and motivating environment through headphones. To assess the potential for commercial VR to augment musical experiences, we used standard VR implementation processes to design four virtual trumpet interfaces: camera-tracking with tracked register selection (two ways), camera-tracking with voice activation, and a controller plus a force-feedback haptic glove. To evaluate these implementations, we created a virtual music classroom that produces audio, notes, and finger pattern guides loaded from a selected Musical Instrument Digital Interface (MIDI) file. We analytically compared these implementations against physical trumpets (both acoustic and MIDI), considering features of ease of use, familiarity, playability, noise, and versatility. The physical trumpets produced the most reliable and familiar experience, and some XR benefits were considered. The camera-based methods were easy to use but lacked tactile feedback. The haptic glove provided improved tracking accuracy and haptic feedback over camera-based methods. Each method was also considered as a proof-of-concept for other instruments, real or imaginary.

A Note on Macroscopic Optical Coherence Tomography Imaging Enabled 3D Scanning for Museum and Cultural Heritage Applications

ABSTRACT Optical coherence tomography (OCT) is a non-invasive imaging method that can be used to study the surface features and subsurface structures of delicate cultural heritage objects. However, the field of view of OCT severely limits the system’s scanning area. Previously, we have presented a hybrid scanning platform combined with an imaging stitching algorithm to achieve macroscopic OCT (macro-OCT) imaging. This paper further demonstrates the potential applications of the OCT data by rendering 3D volumetric data into standard virtual reality (VR), augmented reality (AR), and 3D printing formats. The 3D model can be 3D printed or interactively displayed through various platforms such as VR and AR headsets, smartphones, and web pages. The high-resolution 3D models obtained from the macro-OCT system can potentially improve the experience of accessing artworks online and assist individuals with visual impairments to study art through tactile feedback.

Designing complex manufacturing systems by virtual reality: A novel approach and its application to the virtual commissioning of a production line

The design of complex manufacturing systems (CMSs) is challenging, because of the requirements of efficiency, safety, and ergonomics, and the need of optimizing resources, i.e., space, machines, operators, and data. Virtual reality (VR) – one of the promising technologies at the base of Industry 4.0 – is able to address the design issues of CMSs, and even decrease costs and time when employed from the initial conception to the final validation of production lines, since it facilitates their virtual commissioning, i.e., it enables the full verification of systems and related components by virtual inspection and tests. Despite the above advantages, VR is still rarely used in the design of CMSs, and there is no standard VR approach in industry yet. In addition, the related scientific literature is scarce and often limited to small or simplified cases. To fill this gap, this work presents a novel VR-based approach for designing CMSs, composed of four phases: Three-dimensional CAD Export, Model Import, Scene Creation, and VR Review. The proposed approach is applied to a real industrial use case related to the virtual commissioning of an electric axles production line and it is evaluated through a questionnaire from industry professionals. The case study shows that using the VR technology enhanced the technical communication between experts in the teamwork, and it was particularly effective in finding ergonomics flaws like issues in visibility, reach, and posture using a virtual golden zone. In addition, all users found the VR interaction enjoyable and easy to learn, and beginner users perceived a comparable workload as advanced users. • We propose a new approach for manufacturing systems design by virtual reality. • The approach effectiveness is demonstrated through a real industrial case study. • The main strengths are in the ability to detect and prevent ergonomic design issues. • The approach effectiveness is evaluated through a questionnaire to professionals.

ObReco-2: Two-step validation of a tool to assess memory deficits using 360° videos.

Traditional neuropsychological evaluations are usually carried out using psychometric paper and pencil tests. Nevertheless, there is a continuous discussion concerning their efficacy to capture life-like abilities. The introduction of new technologies, such as Virtual Reality (VR) and 360° spherical photos and videos, has improved the ecological validity of the neuropsychological assessment. The possibility of simulating realistic environments and situations allows clinicians to evaluate patients in realistic activities. Moreover, 360° photos and videos seem to provide higher levels of graphical realism and technical user-friendliness compared to standard VR, regardless of their limitations in terms of interactivity. We developed a novel 360° tool, ObReco-2 (Object Recognition version 2), for the assessment of visual memory which simulates a daily situation in a virtual house. More precisely, patients are asked to memorize some objects that need to be moved for a relocation. After this phase, they are asked to recall them after 15 min and later to recognize them in the same environment. Here we present a first study about the usability of ObReco-2, and a second one exploring its clinical efficacy and updated usability data. We focused on Free Recall and Recognition scores, comparing the performances obtained by the participants in the standard and the 360° test. The preliminary results support the use of 360° technology for enhancing the ecological value of standard memory assessment tests.