Virtual Reality Prototype Research Articles

On the Efficiency of a VR Hand Gesture-Based Interface for 3D Object Manipulations in Conceptual Design

ABSTRACTIn the early stages of 3D design, sketches are used to quickly conceptualize ideas and gain insight into problems and possible solutions. Computer-aided design tools are widely used for 3D modeling and design, but their required precision and 2D mouse and screen-based interface inhibit the flow of ideas. A study was conducted to explore the efficiency of hand tracking and virtual reality (VR) for 3D object manipulations in conceptual design. Based on existing research on conceptual design and hand gestures, an intuitive hand-based interaction model is proposed. An experiment on basic 3D manipulation shows that participants using a simple VR and hand-tracking interface prototype have similar performance to those using a traditional mouse and screen interface. For the improvement of gestural conceptual design interfaces, the relevant issues are identified.

Applying virtual reality model to green ironmaking industry and education: ‘a case study of charcoal mini-blast furnace plant’

ABSTRACTA virtual reality (VR) model has been developed in the case of a generic green ironmaking industrial unit, namely a typical charcoal mini-blast furnace (CMBF) plant in Brazil. The VR prototype construction of the CMBF plant has been implemented through integration of data in different softwares and hardwares, including detailed engineering design of various auxiliary units and major equipments with realistic project parameters. Through the VR technology, one can actually have the unique experience visiting all parts of the CMBF plant, promote technical discussions on engineering and process control with users and improve information handling, communication, safety, maintenance procedures and development of advanced engineering projects in the field. VR industry-professional education platform can be used in universities, museums and industries with great benefits to students, workers and users.

Benefits of virtual reality based cognitive rehabilitation through simulated activities of daily living: a randomized controlled trial with stroke patients.

BackgroundStroke is one of the most common causes of acquired disability, leaving numerous adults with cognitive and motor impairments, and affecting patients’ capability to live independently. There is substancial evidence on post-stroke cognitive rehabilitation benefits, but its implementation is generally limited by the use of paper-and-pencil methods, insufficient personalization, and suboptimal intensity. Virtual reality tools have shown potential for improving cognitive rehabilitation by supporting carefully personalized, ecologically valid tasks through accessible technologies. Notwithstanding important progress in VR-based cognitive rehabilitation systems, specially with Activities of Daily Living (ADL’s) simulations, there is still a need of more clinical trials for its validation. In this work we present a one-month randomized controlled trial with 18 stroke in and outpatients from two rehabilitation units: 9 performing a VR-based intervention and 9 performing conventional rehabilitation.MethodsThe VR-based intervention involved a virtual simulation of a city – Reh@City - where memory, attention, visuo-spatial abilities and executive functions tasks are integrated in the performance of several daily routines. The intervention had levels of difficulty progression through a method of fading cues. There was a pre and post-intervention assessment in both groups with the Addenbrooke Cognitive Examination (primary outcome) and the Trail Making Test A and B, Picture Arrangement from WAIS III and Stroke Impact Scale 3.0 (secondary outcomes).ResultsA within groups analysis revealed significant improvements in global cognitive functioning, attention, memory, visuo-spatial abilities, executive functions, emotion and overall recovery in the VR group. The control group only improved in self-reported memory and social participation. A between groups analysis, showed significantly greater improvements in global cognitive functioning, attention and executive functions when comparing VR to conventional therapy.ConclusionsOur results suggest that cognitive rehabilitation through the Reh@City, an ecologically valid VR system for the training of ADL’s, has more impact than conventional methods.Trial registrationThis trial was not registered because it is a small sample study that evaluates the clinical validity of a prototype virtual reality system.

Home Sweet Mind-Controlled Home

Students at Colorado State University built a virtual reality prototype for experimenting with cognitive control of connected household devices.

Interactive Simulation and Visualization of In-Reactor and Under-Sodium Viewing Operations

A prototype virtual reality simulator for mechanical operations in a sodium-cooled fast reactor is described. Developing simulation capabilities for fuel-handling operations and component inspection are of particular emphasis. Building on the first prototype, the objective is to provide multimodal (visual and haptic) sensing functionality, improve component models, and implement select scenarios for demonstration. RoboticsLab, a robotics software development framework, enables the necessary integration and development for mechanical operations simulation, supporting the capabilities for the construction of the virtual reality environment, fast robot prototyping, dynamics simulation, and customized sensing. Special emphasis was given to the simulation of the fuel-handling system and under-sodium viewing operation, which is one of the bottlenecks in the sodium-cooled fast reactor technology roadmap. By providing computer-based visualization, the virtual reality simulator can facilitate better reactor operation training and more comprehensive understanding and development of new concepts in integral mechanical operations.

Folk Dance Evaluation Using Laban Movement Analysis

Motion capture (mocap) technology is an efficient method for digitizing art performances, and is becoming increasingly popular in the preservation and dissemination of dance performances. Although technically the captured data can be of very high quality, dancing allows stylistic variations and improvisations that cannot be easily identified. The majority of motion analysis algorithms are based on ad-hoc quantitative metrics, thus do not usually provide insights on style qualities of a performance. In this work, we present a framework based on the principles of Laban Movement Analysis (LMA) that aims to identify style qualities in dance motions. The proposed algorithm uses a feature space that aims to capture the four LMA components (B ody , E ffort , S hape , S pace ), and can be subsequently used for motion comparison and evaluation. We have designed and implemented a prototype virtual reality simulator for teaching folk dances in which users can preview dance segments performed by a 3D avatar and repeat them. The user’s movements are captured and compared to the folk dance template motions; then, intuitive feedback is provided to the user based on the LMA components. The results demonstrate the effectiveness of our system, opening new horizons for automatic motion and dance evaluation processes.

A prototype virtual reality system for preoperative planning of neuro-endovascular interventions.

This paper describes our efforts at creating a system with real time acquisition and geometric processing of the patients vascular anatomy, supplemented by a framework to simulate catheter vasculature interaction. Our system uses biplane angiograms coupled with an algorithm for generation of 3D vascular trees for patient data acquisition. Surface reconstruction and processing of this data is performed to provide novel decision aids to the interventionalist. The processed data can be loaded in a virtual environment to simulate guidance of the catheter through the patient's vasculature. With our combination of techniques, a patient specific visualization and simulation environment can be prepared within the narrow time window available for this procedure.

Abstract W P135: Usability of a Virtual Reality Tool for In-Home Stroke Rehabilitation: A Case Series

Stroke is the leading cause of serious, long-term disability in the United States. Exercise and activity in the chronic phase of stroke have shown to be beneficial in achieving and maintaining improvements in motor and ADL function. Interactive video games and virtual reality (VR) have also shown to be effective in improving motor function following stroke. We developed a prototype VR rehabilitation tool called Mystic Isle that uses the Microsoft Kinect sensor and a standard PC. The purpose of this case series was to explore the usability of Mystic Isle as a 5-week intervention to improve performance of client identified activities for adults (>21 years) with chronic stroke (>6 months post) in the home setting. Three participants with chronic stroke completed the five week intervention. Outcomes were measured at baseline, immediately pre-intervention (after a 2 week delay from baseline), and immediately post-intervention. The intervention was conducted in each participant’s home. The results of the Canadian Occupational Performance Measure at baseline guided the choice of the virtual tasks for the intervention. The participants were instructed to complete 4 hours each week. The primary outcome was usability and feasibility of the intervention measured with the Game Experience Questionnaire, the System Usability Questionnaire, and a semi-structured interview. Primary outcome data were analyzed using a mixed methods grounded theory approach. Secondary outcomes included motor impairment, quality of life and occupational performance measured using standard clinical measures. Two of the three participants had very positive responses to the intervention and use of the VR tool in the home setting. All three participants demonstrated improvements in quality of life from pre- to post-intervention and improvements in motor function were scattered across participants. All participants expressed the desire to use the system in the future if improvements were made to increase the usability of the system for the home setting. They also spoke about how they attempted to integrate the game into their daily routine or schedule. A major barrier to use for all participants was a busy day that left them too fatigued to interact with the system and complete the intervention.

Real-Time Semi-Physical Simulation of Industry Design System Based on Virtual Reality Technology

Research how to realize real-time hardware in the loop (HIL) of industry design system by utilizing a variety of virtual reality (VR) hardware and software. In this paper, it introduces VR and virtual prototyping technology, and then proposes joint control and simulation based on ADAMS / Aircraft, Simulink, Flightgear three software. Moreover, the virtual scene, data gloves and real-time semi-physical simulation are analyzed and researched; finally as an example, build a real-time semi-physical simulation platform of the landing gear system for multi-wheel and multi-strut aircraft. The system can do kinematic and dynamic analysis, real-time control by visual prototyping and digital models through real-time data acquisition and co-simulation.

Avatar Implementation in Virtual Reality Environment using Situated Learning for “Tawaf”

The growing need on learner-centered education in recent years has motivated this study by applying virtual reality learning environment as an approach via engaging problem-solving activities. This study is emphasizing on 3D virtual reality environment using avatar human based immersive and simulation. The avatar will guide learners through virtual reality environment as they participate in a role based problem solving, hold highly potential for situated learning. Simulation allows learners to immerse themselves in a problematic situation by providing a dynamic navigation. Situated learning enables learner to takes on active role in the learning context in system being studied which is learning the Moslem's tawaf practice as one of the hajj pillars. Later, it will provide learners with preliminary understanding by engaging into practice the tawaf virtually before they undergo for actual training by using avatar. Thus, learners will be able to immerse themselves with tawaf process virtually. Finally a virtual reality prototype that focuses on tawaf practice will be developed which can be used by a diversify learners from school students to adult learners.

Simulating the Control of a Scara Robot by Means of a 3D Hand Position Sensing System

In this paper is presented a possible method for controlling a robot, in this particular case a SCARA robot by using a capacitive 3D hand positioning system. This system makes possible the control of and for virtual reality prototype with application in augmented reality systems.

Virtual reality prototype for measurement of expression characteristics in emotional situations

Expressions are a basic necessity for daily living, as they are required for managing relationships with other people. Conventional expression training has difficulty achieving an objective measurement, because their assessment depends on the therapist's ability to assess a patient's state or training effectiveness. In addition, it is difficult to provide emotional and social situations in the same manner for each training or assessment session. Virtual reality techniques can overcome shortcomings occurring in conventional studies by providing exact and objective measurements and emotional and social situations. In this study, we developed a virtual reality prototype that could present emotional situation and measure expression characteristics. Although this is a preliminary study, it could be considered that this study shows the potential of virtual reality as an assessment tool.

Design Evaluation System with Visualization and Interaction of Mobile Devices Based on Virtual Reality Prototypes

In this paper, we present a design evaluation system with visualization and interaction of mobile devices using virtual-reality-based prototypes which can be used to easily change design parameters and simulate embedded software. To evaluate and predict affective-engineering-based design preferences for mobile devices under a virtual environment, we have developed a high quality visualization platform which creates images that look similar to real mobile devices in addition to real-time simulation of realistic motions and functions of mobile devices. To support a quantitative usability test scenario for external design shape, we also have built a system which consists of a mixed-reality-based testing platform for measuring hand load.

Scientific Sketching for Collaborative VR Visualization Design

We present four studies investigating tools and methodologies for artist-scientist-technologist collaboration in designing multivariate, virtual reality (VR) visualizations. Design study 1 identifies the promise of 3D drawing-style interfaces for VR design and also establishes limitations of these tools with respect to precision and support for animation. Design study 2 explores animating artist-created visualization designs with scientific 3D fluid flow data. While results captured an accurate sense of flow that was advantageous as compared to the results of study 1, the potential for visual exploration using the design tools tested was limited. Design study 3 reveals the importance of a new 3D interface that overcomes the precision limitation found in study 1 while remaining accessible to artist collaborators. Drawing upon previous results, design study 4 engages collaborative teams in a design process that begins with traditional paper sketching and moves to animated, interactive, VR prototypes "sketched" by designers in VR using interactive 3D tools. Conclusions from these four studies identify important characteristics of effective artist-accessible VR visualization design tools and lead to a proposed formalized methodology for successful collaborative design that we expect to be useful in guiding future collaborations. We call this proposed methodology Scientific Sketching.

Virtual reality prototype in healthcare simulation training

Virtual reality prototype in healthcare simulation training

Pilot Evaluation Study of a Virtual Paracentesis Simulator for Skill Training and Assessment: The Beneficial Effect of Haptic Display

Effective, real-time training of health care professionals in invasive procedures is a challenging task. Furthermore, assessing in practice the acquisition of the dexterity and skills required to safely perform such operations is particularly difficult to perform objectively and reliably. The development of virtual reality (VR) simulators offers great potential toward these objectives, and can help bypass some of the difficulties associated with classical surgical training and assessment procedures. In this context, we have developed a prototype VR simulator platform for training in a class of invasive procedures, such as accessing central vessels. This paper focuses more particularly on a pilot study treating the specific application case of subclavian vein paracentesis. The simulation incorporates 3D models of all the human anatomy structures involved in this procedure, where collision detection and response algorithms are implemented to simulate most of the potential complications in accordance with the situations encountered in real clinical practice. Furthermore, haptic display is integrated using a typical force feedback device providing the user with a sense of touch during the simulated operations. Our main objective in this study was to obtain quantitative evaluation results regarding the effect of haptic display on performance. Two user groups participated in the study: (I) novice users and (II) experienced surgeons. The system automatically provides quantitative assessment scores of users' performance, applying a set of objective measures that also involve the optimality of the needle insertion path and indicators of maneuvering errors. Training and skill assessment performance of the system is evaluated in a twofold manner, regarding respectively: (a) the learning curve of novice users, and (b) the correlation of the system-generated scores with the actual surgical experience of the user. These performance indicators are assessed with respect to the activation of the haptic display and to whether this has any beneficial effect (or not). The experimental findings of this first pilot study provide quantitative evidence about the significance of haptic display, not only as a means to enhance the realism of the surgical simulation, but especially as an irreplaceable component for achieving objective and reliable skill assessment. Further larger-scale and long-term clinical studies are needed to validate the effectiveness of such platforms for actual training and dexterity enhancement, particularly when more complex sensorimotor skills are involved.

Application of a virtual reality prototype for pain relief of pediatric burn in Taiwan

This study examines the usability and effectiveness of virtual reality in reducing pain in wound-care procedures for pediatric burn patients in Taiwan. Virtual reality has continuously gained prominence in the medical arena, for instance, the telepresence for surgery, the management of mental health disorders and pain control of the paediatric burn. Notwithstanding an increased application of virtual reality in the medical arena in North America, there have been no studies investigating its use for paediatric burn patients in Asia. This descriptive study has two phases: Phase I: the development of a virtual reality prototype. Phase II: the implementation of the prototype to discern its usability and efficacy with paediatric burn patients at a local hospital. The findings suggest that a significant difference is found in the children's reported pain, with or without the virtual reality intervention, over the three phases: before, during and after the dressing change. However, less pain was noted in the intervention group during and after the dressing change. Adding to the existing clinical value of virtual reality identifies the nature of and different children's responses to pain with the use of virtual reality. This study is significant since it demonstrates a difference in the child's response to pain based on the nature of presence and distraction. Moreover, given the evidence that a decrease in anxiety was experienced after the dressing change with virtual reality intervention, timing of using the virtual reality intervention before the child develops conditioning anxiety and anticipated pain for the procedure would be of importance.

Neural underpinning of postural responses to visual field motion

Numerous results emerging from current research strongly implicate the effect of Visual Field Motion on the organization of postural responses. However, this is the first empirical study exploring the neural substrates underlying the subjects’ response to Visual Field Motion. Two separate experiments were conducted to investigate the subject responses to Visual Field Motion. In the first experiment, the standing subjects were exposed to Visual Field Motion in the VR environment. In the second experiment, the recumbent subjects viewed the same Visual Field Motion while in a MRI scanner. A virtual reality (VR) prototype of the moving room paradigm [Lee, D.N., Aronson, E., 1974. Visual proprioceptive control of standing in human infants. Perception & Psychophysics 15, 529–532] was developed to simulate various optic flow patterns in a controlled VR environment. Postural responses (center of pressure, body kinematics, vection, egomotion) and brain activation patterns (fMRI signals) were examined. The subjects experienced egomotion and have reported vection in both experiments only when certain attributes of Visual Field Motion were introduced. This was accompanied by significant activation of specific brain structures, including prefrontal, parietal cortices and bilateral cerebellum. We propose the existence of functional interactions between modality specific areas of the brain involved in postural responses to Visual Field Motion (VFM).

Virtual reality in product evaluations with potential customers: An exploratory study comparing virtual reality with conventional product representations

This paper reports on a study in which virtual reality representations of a car were compared with concept sketches and a real car as a means for customer evaluations. Early communication with customers is important in order to identify customer needs and to achieve response on design solutions. Physical prototypes are often used for these purposes, but they are costly to produce, inflexible in modifications, and expensive and fragile to carry, which has lead to an increased interest for the use of virtual reality prototypes. However, knowledge is scarce of how different types of product representations may influence customers' understanding of a product concept. The study indicated that the different product representations resulted in small differences in the participants' understanding of the car, despite the greater degree of realism in the virtual reality representations and, of course in the real car, compared with the sketches. The study indicates that there are other factors to consider than the degree of realism in the product representations for efficient product evaluations with customers; for example, that the participants are well familiar with the type of product, but also with the type of representation technology.

A desktop VR prototype for industrial training applications

The recent advances in computer graphics has spurred interest from both academics and industries in virtual reality (VR) enabled training applications. This paper presents a desktop VR prototype for industrial training applications. It is designed and implemented as a general shell by providing the data interface to import both the virtual environment models and specific domain knowledge. The geometric models of the virtual environment are constructed using feature-based modelling and assembly function by external CAD tools, and then transferred into the prototype through a conversion module. A hierarchical structure is proposed to partition and organise these imported virtual environment models. Based on this structure, a visibility culling approach is developed for fast rendering and user interaction. The case study has demonstrated the functionality of the proposed prototype system by applying it to a maintenance training application for a refinery bump system, which, in general, has a large number of polygons and a certain depth complexity. Significant speedup in both context rendering and response to user manipulations has been achieved to provide the user with a fast system response within the desktop virtual environment. Compared with the immersive VR system, the proposed system has offered an affordable and portable training media for industrial applications.