Application Of Mixed Reality Technology Research Articles

Application of mixed reality technology in free fibular flap transplantation for repairing mandibular defects

To explore the feasibility and effectiveness of mixed reality technology for localizing perforator vessels in the repair of mandibular defects using free fibular flap. Between June 2020 and June 2023, 12 patients with mandibular defects were repaired with free fibular flap. There were 8 males and 4 females, with an average age of 61 years (range, 35-78 years). There were 9 cases of ameloblastomas and 3 cases of squamous cell carcinomas involving the mandible. The disease duration ranged from 15 days to 2 years (median, 14.2 months). The length of mandibular defects ranged from 5 to 14 cm (mean, 8.5 cm). The area of soft tissue defects ranged from 5 cm×4 cm to 8 cm×6 cm. Preoperative enhanced CT scans of the maxillofacial region and CT angiography of the lower limbs were performed, and the data was used to create three-dimensional models of the mandible and lower limb perforator vessels. During operation, the mixed reality technology was used to overlay the three-dimensional model of perforator vessels onto the body surface for harvesting the free fibular flap. The length of the fibula harvested ranged from 6 to 15 cm, with a mean of 9.5 cm; the size of the flap ranged from 6 cm×5 cm to 10 cm×8 cm. The donor sites were sutured directly in 7 cases and repaired with free skin grafting in 5 cases. Thirty perforator vessels were located by mixed reality technology before operation, with an average of 2.5 vessels per case; the distance between the exit point of the perforator vessels located before operation and the actual exit point ranged from 1 to 4 mm, with a mean of 2.8 mm. All fibular flaps survived; 1 case had necrosis at the distal end of flap, which healed after dressing changes. One donor site had infection, which healed after anti-inflammatory dressing changes; the remaining incisions healed by first intention, and the grafts survived smoothly. All patients were followed up 8-36 months (median, 21 months). The repaired facial appearance was satisfactory, with no flap swelling. Among the patients underwent postoperative radiotherapy, 2 patients had normal bone healing and 1 had delayed healing at 6 months. In free fibular flap reconstruction of mandibular defects, the use of mixed reality technology for perforator vessel localization can achieve three-dimensional visualization, simplify surgical procedures, and reduce errors.

A study on the application of mixed reality technology in experimental teaching in economic colleges and universities

Abstract With the continuous development of the computer field, mixed reality technology is increasingly used in various fields of life. This paper aims to create a mixed reality interactive experimental teaching system for economic colleges and develop the overall framework of the system using the target detection algorithm. It first designs the interaction system module based on monocular visual spatial localization. Then it builds a teaching evaluation system based on face detection, recognition, and gesture estimation for the experimental teaching of economic colleges and universities for the mixed reality interaction system. This paper empirically analyzes the proposed mixed reality interaction system for experimental teaching in economic colleges. It can achieve a processing speed of 19 frames per second and a high recognition accuracy of 88.23% in the teaching test. The average scores of each index after the testers’ use are above 4, and the average value of the system’s overall score is 4.66. This study has excellent performance and provides a practical roadmap and reference value for developing mixed reality technology in the direction of experimental teaching.

The Application of Mixed Reality Technology as Innovative Approach in Museums

The Application of Mixed Reality Technology as Innovative Approach in Museums

Mixed reality technology enhances teaching of spinal blockade procedures.

To investigate the efficacy of utilizing mixed reality technology-assisted teaching of a spinal medial branch nerve block. Twenty undergraduate students from a 5-year clinical medicine program in Fujian Medical University were selected. They were divided into group A and group B using a random number generator, with 10 students in each group. Group A used the traditional teaching method and Group B used the mixed reality technology-assisted teaching method. At the end of the teaching period, both groups were assessed on the blocking operation, number of punctures required, puncture time, and final error value (distance between the final position and the reference position). A questionnaire was administered to both groups to assess teaching satisfaction. The number of punctures required was 7.40 ± 1.26 and 2.10 ± 0.74 for groups A and B, respectively. The puncture time in group A was 297.80 ± 50.95 s and 65.60 ± 22.02 s in group B. All differences were significant p < 0.01. The final error of the puncture in group A was 2.24 ± 0.35 mm and 1.96 ± 0.26 mm in group B-not significant. Group B had (p < 0.01) higher evaluation scores than group A for teaching effectiveness, learning interest, initiative, and teaching satisfaction. The application of mixed reality technology in the teaching of posterior medial branch blocks of the spinal nerve is superior to previous methods. This method should be adopted wherever possible to enhance learning of this difficult technique.

Application of mixed reality technology in talocalcaneal coalition resection.

With positive outcomes recorded, the mixed reality (MR) technology has lately become popular in orthopedic surgery. However, there are few studies that specifically address the utility of MR in talocalcaneal coalitions (TCC) resection. Our goal in this retrospective study is to assess certain data while examining the viability of using MR to treat TCC resection. Six consecutive patients with TCC diagnosed by computed tomography (CT) for which nonoperative therapy had failed and MR system assisted TCC resection were included in this study from March 2021 to December 2021. The feasibility and accuracy of TCC resection were assessed by post-operation radiography. The American Orthopaedic Foot & Ankle Society (AOFAS) hindfoot score and visual analog scale (VAS) score were used to assess the recovery condition and pain level pre- and post-operation. The surgeon can accurately resect the TCC according to the preoperatively determined range by superimposing the holographic model with the actual anatomy of the TCC using an MR system. Additionally, no additional x-ray was necessary while operating. Mean follow-up was 10.3 months, with a minimum of 6 months. There is a significant difference between the preoperative AOFAS score of 53.4 ± 3.8 and the 6-month follow-up AOFAS score of 97.3 ± 2.2 (p < 0.05). There is also a significant difference between the preoperative VAS score of 8.1 ± 0.7 and the 6-month follow-up VAS score of 1.7 ± 0.4 (p < 0.05). All individuals had clinical subtalar mobility without stiffness following surgery. While the TCC resection operation is being performed, the application of MR technology is practicable, effective, and radiation-free, giving surgeons satisfactory support.

Exploration and application of mixed reality technology in modern home design

Exploration and application of mixed reality technology in modern home design

Users’ Perceptions of Technological Features in Augmented Reality (AR) and Virtual Reality (VR) in Fashion Retailing: A Qualitative Content Analysis

This study explores users’ perceptions of technological features in augmented reality (AR) and virtual reality (VR) and analyzes the advantages and disadvantages of technologies (e.g., AR vs. VR) in fashion retailing. The findings are presented from a qualitative approach and content analysis of focus group interviews. Users’ perception of AR technological features consisted of 5 dimensions: augmentation, user control, vividness, responsiveness, and simplicity. Users’ perception of VR technological features consisted of 4 dimensions: telepresence, simulator sickness, visual discomfort, and user control. Practical implications for the application of mixed reality technology in fashion venues are discussed: for AR technology as a part of shopping tools, the advantages of control and simplicity should be taken seriously; for VR, an immersive experience as the main pros facilitated by telepresence, while sickness, followed by visual discomfort as the main simulator cons. This research offers valuable and useful insights into AR and VR as antecedents from the technological aspect and helps marketers develop and formulate new solutions for the application of AR and VR in fashion retailing.

Review and Future/Potential Application of Mixed Reality Technology in Orthopaedic Oncology.

In orthopaedic oncology, surgical planning and intraoperative execution errors may result in positive tumor resection margins that increase the risk of local recurrence and adversely affect patients’ survival. Computer navigation and 3D-printed resection guides have been reported to address surgical inaccuracy by replicating the surgical plans in complex cases. However, limitations include surgeons’ attention shift from the operative field to view the navigation monitor and expensive navigation facilities in computer navigation surgery. Practical concerns are lacking real-time visual feedback of preoperative images and the lead-time in manufacturing 3D-printed objects. Mixed Reality (MR) is a technology of merging real and virtual worlds to produce new environments with enhanced visualizations, where physical and digital objects coexist and allow users to interact with both in real-time. The unique MR features of enhanced medical images visualization and interaction with holograms allow surgeons real-time and on-demand medical information and remote assistance in their immediate working environment. Early application of MR technology has been reported in surgical procedures. Its role is unclear in orthopaedic oncology. This review aims to provide orthopaedic tumor surgeons with up-to-date knowledge of the emerging MR technology. The paper presents its essential features and clinical workflow, reviews the current literature and potential clinical applications, and discusses the limitations and future development in orthopaedic oncology. The emerging MR technology adds a new dimension to digital assistive tools with a more accessible and less costly alternative in orthopaedic oncology. The MR head-mounted display and hand-free control may achieve clinical point-of-care inside or outside the operating room and improve service efficiency and patient safety. However, lacking an accurate hologram-to-patient matching, an MR platform dedicated to orthopaedic oncology, and clinical results may hinder its wide adoption. Industry-academic partnerships are essential to advance the technology with its clinical role determined through future clinical studies.

Mixed Reality Technology in Total Knee Arthroplasty: An Updated Review With a Preliminary Case Report

BackgroundAugmented reality and mixed reality have been used to help surgeons perform complex surgeries. With the development of technology, mixed reality (MR) technology has been used to improve the success rate of complex hip arthroplasty due to its unique advantages. At present, there are few reports on the application of MR technology in total knee arthroplasty. We presented a case of total knee arthroplasty with the help of mixed reality technology.Case PresentationWe presented a case of a 71-year-old woman who was diagnosed with bilateral knee osteoarthritis with varus deformity, especially on the right side. After admission, the right total knee arthroplasty was performed with the assistance of MR technology. Before the operation, the three-dimensional virtual model of the knee joint of the patient was reconstructed for condition analysis, operation plan formulation, and operation simulation. During the operation, the three-dimensional virtual images of the femur and tibia coincided with the real body of the patient, showing the osteotomy plane designed before the operation, which can accurately guide the completion of osteotomy and prosthesis implantation.ConclusionsAs far as we know, this is the first report on total knee arthroplasty under the guidance of mixed reality technology.

Application of mixed reality technology in the field of hepatobiliary surgery

Mixed reality is a new three-dimensional presentation technology that combines the virtual digital world with the real world, which has been initially applied in the field of hepatobiliary surgery. Compared with virtual reality, augmented reality and three-dimensional visualization technology, mixed reality technology has unique advantages in preoperative evaluation and formulation of surgical plan, real-time accurate navigation during operation and three-dimensional virtual teaching. And it is a new generation of auxiliary tool for precision hepatobiliary surgery. This paper describes the application and research progress of mixed reality technology in the field of hepatobiliary surgery, and discusses its application potential and current limitations.

Research on the application of mixed reality technology in the field of art design

Aim: summarize the application of mixed reality technology in the field of art design and analyse its shortcomings and trends. Method: by searching the Web of science as the main source of information to explain the basic concept and development of MR and state of art in product design, display design and interactive design. Discuss the pros and cons of mixed reality technology in human-computer interaction, hardware, and user experience. Result: Mixed reality technology is widely used in art, design, especially in product design, display design, and interactive design. The future trend of mixed reality technology is summarized the combining status of market and industry. Conclusion: The application of mixed reality technology in the field of art design is already drawing more and more attention from industry, but it still lacks enough attention from academia community. This paper systematically introduces the state-of-the-art applications and trends of MR in the field of art design which helps readers to get an insight on this fascinating research area.

Application of Mixed Reality Technology in Surgical Resection of Vestibular Schwannoma and Doctor-patient Communication

Application of Mixed Reality Technology in Surgical Resection of Vestibular Schwannoma and Doctor-patient Communication

Comparative study on the clinical application of mixed reality technology leading micro-invasive intervertebral foramen puncture location and blind puncture location.

Objective:To discuss the function of mixed reality (MR) technology in guiding location of intervertebral foramen microscopic puncture and analyze its feasibility and clinical application value.Methods:Sixty patients with lumbar intervertebral disc who were treated between January 2017 to October 2017 were chosen, and classified into navigation group (30 cases) and traditional control (30 cases) according to random number table. Intervertebral foramen microscopic operation was conducted for both groups. MR technology was applied for the navigation group to guide puncture and establish intervertebral foramen microscopic cannula. Traditional C-arm X-ray apparatus was used for traditional group to establish intervertebral foramen microscopic cannula. Intra-operative puncture times, fluoroscopy times, puncture time and VAS score 1d, 3m and 6m after the operation were recorded and compared.Results:Postoperative waist and leg pain symptoms of both groups were relieved obviously, and straight leg raising test for the diseased limb turned to be negative. Intra-operative puncture times, fluoroscopy times, puncture time and operation time had statistical significance decrease.Conclusion:Mixed reality (MR) can accurately guide the establishment of intervertebral foramen microscopic cannula, solve the bottleneck problem of intervertebral foramen microscopic technology, promote puncture success rate, reduce repeated puncture times, avoid by-injury, shorten puncture time and reduce X-ray radiation quantity of operators and patients, so it deserves to be promoted and applied.

Application of mixed reality technology in hammering inspection work

Application of mixed reality technology in hammering inspection work

Modelling and Visualizing Holographic 3D Geographical Scenes with Timely Data Based on the HoloLens

Commonly, a three-dimensional (3D) geographic information system (GIS) is based on a two-dimensional (2D) visualization platform, hindering the understanding and expression of the real world in 3D space that further limits user cognition and understanding of 3D geographic information. Mixed reality (MR) adopts 3D display technology, which enables users to recognize and understand a computer-generated world from the perspective of 3D glasses and solves the problem that users are restricted to the perspective of a 2D screen, with a broad application foreground. However, there is a gap, especially dynamically, in modelling and visualizing a holographic 3D geographical Scene with GIS data/information under the development mechanism of a mixed reality system (e.g., the Microsoft HoloLens). This paper attempts to propose a design architecture (HoloDym3DGeoSce) to model and visualize holographic 3D geographical scenes with timely data based on mixed reality technology and the Microsoft HoloLens. The HoloDym3DGeoSce includes two modules, 3D geographic scene modelling with timely data and HoloDym3DGeoSce interactive design. 3D geographic scene modelling with timely data dynamically creates 3D geographic scenes based on Web services, providing materials and content for the HoloDym3DGeoSce system. The HoloDym3DGeoSce interaction module includes two methods: Human–computer physical interaction and human–computer virtual–real interaction. The human–computer physical interaction method provides an interface for users to interact with virtual geographic scenes. The human–computer virtual–real interaction method maps virtual geographic scenes to physical space to achieve virtual and real fusion. According to the proposed architecture design scheme, OpenStreetMap data and the BingMap Server are used as experimental data to realize the application of mixed reality technology to the modelling, rendering, and interacting of 3D geographic scenes, providing users with a stronger and more realistic 3D geographic information experience, and more natural human–computer GIS interactions. The experimental results show that the feasibility and practicability of the scheme have good prospects for further development.

Mixed reality breathes fresh energy into the development of modern surgery

Abstract With the rapid development of holographic imaging technology, virtual reality and augmented reality technology have been used in medicine for decades. However, due to the lack of compatibility between the virtual world and the real world and the lack of human-computer interaction, their widespread use is limited. As a research hotspot in recent years, the mixed reality technology has a huge prospect in the medical field by virtue of its unique advantages combined with the virtual world and the real world, as well as better human-machine real-time interaction and precise matching. This article will focus on the development of this technology in recent years, and introduce the application of mixed reality technology in medical education and clinical application. Download : Download full-size image

Application of mixed reality technology in medical field

With the rapid development of holographic image technology, virtual reality technology and augmented reality technology have applied to medical education and medical activities. But due to the exclusion of virtual and real world and lack of interaction, their wide application is greatly limited. With the combination of reality and virtual world, real-time interaction and accurate matching, mixed reality technology has become a hot research topic in recent years, its applications in various fields of medicine have been emerging. This paper will focus on the development of the technology in recent years at home and abroad, from the medical research, medical education, clinical application, to make a review about the application of mixed reality technology in medical field. Key words: Mixed reality; Medical research; Medical education; Clinical application

Application of Mixed Reality Technology in Visualization of Medical Operations.

With the continuous progress of virtual simulation technology, medical surgery visualization system has been developed from two-dimensional to three-dimensional, from digital to network and intelligentization. The visualization system with mixed reality technology will also be used in all stage of medical surgery, such as case discussion, surgical planning, intraoperative guidance, post-operative evaluation, rehabilitation, so as to further promote high intelligence, high precision of medical surgery, and consequently improve effectiveness of treatment and quality of medical service. This paper discusses the composition and technical characteristics of medical operation visualization system based on mixed reality technology, and introduces some typical applications of mixed reality technology in medical operation visualization, which provides a new perspective for the application of mixed technology in medical surgery.