The Medical Metaverse, Part 1: Introduction, Definitions, and New Horizons for Neuropsychiatry.

Abstract

Back to table of contents Next article Windows to the BrainFull AccessThe Medical Metaverse, Part 1: Introduction, Definitions, and New Horizons for NeuropsychiatryWilfredo López-Ojeda, M.S., Ph.D., and Robin A. Hurley, M.D.Wilfredo López-OjedaSearch for more papers by this author, M.S., Ph.D., and Robin A. HurleySearch for more papers by this author, M.D.Published Online:12 Jan 2023https://doi.org/10.1176/appi.neuropsych.20220187AboutSectionsPDF/EPUB ToolsAdd to favoritesDownload CitationsTrack Citations ShareShare onFacebookTwitterLinked InEmail Editor’s note: This report is the first of a two-part series introducing the concepts of the medical metaverse. Part 1 covers the basic definitions and its current utility in mental health care. Part 2 will address the metaverse as it relates to clinical neurosciences and will appear in a subsequent issue of The Journal of Neuropsychiatry and Clinical Neurosciences.The “metaverse” was initially used in literature by the science fiction writer Neal Stephenson in his 1992 dystopian novel Snow Crash (8, 9). The metaverse denotes a digital platform as a new and alternative environment manifested through digital content delivered via advanced technological devices employing artificial intelligence (AI) (2). This platform encompasses highly immersive and collaborative environments based on three-dimensional and real-time digital worlds in which multiple users can engage in activities (e.g., social, economic, and cultural). The users interact via avatars in versatile settings without physical limitations (10, 11). A metaverse research organization, the Acceleration Studies Foundation (ASF), proposed thinking about the metaverse as a link or connection point between the real and virtual worlds (2, 12). In the metaverse, however, users are not limited by the typical rules of nature (e.g., age, gender, appearance, and species). Freedom from other restrictions, such as time and space, is also enabled by virtual reality (VR) technologies (both hardware and software). Thus, individuals can engage in a wide array of activities that are impossible in real life (2).Metaverse TechnologiesThe cybernetic progression continues to advance with support from major technology companies. According to the literature, within the next 5 years tens of billions of dollars will be invested to expand currently available platforms (13). This rapid progression of core technologies, including AI, “big data,” the Internet of things (IoT), edge computing, blockchain, digital twins (DT), extended reality (XR), and high-speed 5G Internet networks, underpins the metaverse’s existence, advancement, and sustainability (14–18). The coronavirus disease 2019 (COVID-19) pandemic stimulated additional advances (2). Therefore, it is necessary to understand the concept of the metaverse, its nuances, and its applications for medical education and health care delivery (19).According to the ASF, the metaverse roadmap distinguishes technologies along two separate dimensions, augmentation versus simulation and intimate versus external, to characterize four general types of metaverse technologies: augmented reality (AR), lifelogging, mirror worlds, and virtual worlds (1). In the metaverse, augmentation and simulation are defined by whether the information is presented in physical reality (via AR) or in VR (via simulation) (Figures 1 and 2) (1, 2). Conversely, intimate (identity-focused) technologies are centered on the actions of the individual or object; for example, the user or object (i.e., semi-intelligent object) engages by using an avatar or digital profile. In contrast, the external (world-focused) technologies are centered on the outside world, and they typically focus on the control of aspects of the surrounding world, such as the ability to provide information about the conditions of the external environment and how the user can control these conditions (Figures 1 and 2) (1, 2).FIGURE 1. Quadrant-based metaverse diagram.The horizontal axis includes metaverse technologies that facilitate the empirical relationship between technology and user. The left side reflects the external environment, and the personalized experience of the user is intensified toward the right, intimate side (1, 2). In the external milieu, the surrounding world is emphasized, and this outward perspective is user centered and provides guidance to the user on how to engage with these environmental features. The intimate element of the metaverse provides an inward perspective and focuses on individualized behaviors guided by customized data. The vertical axis includes technologies that exemplify the relationship between reality and innovation. Augmentation increases the human sensory experience by incorporating new functions into the real-world environment via visual, auditory, and other sensory stimuli. Conversely, simulation duplicates the real world by modeling reality in a virtual world (1, 2).FIGURE 2. Four categories of metaverse technology.A. Augmented reality (AR). AR uses virtual imaging and fetching technologies to integrate digital information into the real-world environment (3). B. Lifelogging. This technology obtains digital records of the user’s personal data (e.g., heart rate, breathing, and sleep patterns) by capturing, storing, and sharing information by using multimodal digital sensors integrated in high-tech devices, such as smart watches, smart phones, and wearables (2, 4). C. Mirror worlds. In this type of technology, the real world is depicted (i.e., simulated) with digital innovations (e.g., satellites and interactive software) to reflect the characteristics of the external world in the cybernetic world. These simulations replicate an accurate version of the real-world structures and human environments (i.e., mirror duplicates). Google Earth, Foldit, and Microsoft Teams are examples of digital applications simulating mirror worlds (2, 5, 6). D. Virtual worlds. The virtual world incorporates virtual reality (VR) technology. In VR, the user is fully immersed and is completely blinded to the real environment; this immersion is facilitated by a head-mounted display (digital lenses) in which the user receives visual, auditory, and other sensory inputs (1, 2, 7).COVER. Artistic depiction of the medical metaverse. On the right, various technologies of the digital biomedical world. On the left, the head-mounted display lenses and the brain symbolize the immersive experience of extended reality and its role in the metaverse.All images created under the terms of the Creative Commons Attribution License. Created with VH Dissector, Canva, and BioRender.com.Medical MetaverseMetaverse technologies have opened new horizons for innovations in medicine. Medical education and health care practices are embracing technological advancements to improve patient care (2, 20–22). A wide range of subspecialties, such as cardiology, emergency medicine, gastroenterology, gynecology, oncology, ophthalmology, and radiology, are employing metaverse technologies (4, 22–26). Mental health disciplines are also benefiting from metaverse innovations, specifically XR technologies (VR, AR, and mixed reality) (27). VR technologies are among the most widely used advances in mental health interventions. VR exposure therapy (VRET) and AR exposure therapy have proven effective in treating specific phobias, posttraumatic stress disorder (PTSD), anxiety, attention-deficit hyperactivity disorder, substance-related disorders, depression, and eating disorders (20, 28–31).VRET employs psychotherapeutic immersive paradigms that provide multisensory VR experiences to amplify the patient’s experiential engagement during treatment sessions (27). VRET interventions are effective in reducing PTSD symptoms of active-duty and combat soldiers after military trauma (32, 33). XR therapeutic benefits are based partly on its immersive capabilities that allow experiences at a digital multisensorial level and integrate a seamless human-computer interface (27). Deepak Chopra indicated that “the metaverse guides us past the notion that mind, body, and spirit are separate” because the metaverse incorporates technologies (e.g., AR and VR) to rectify one’s dysfunctional reality by using virtual (functional) reality (34). VR innovations allow for the reproduction of transcendental experiences (e.g., delivering joy, distraction, and positive affect in a soothing environment) (34–36). Higher-level cognitive functions (e.g., decision making and problem solving) may vary based on the body’s characteristics that the individual perceives as self-owned. A study performed by Banakou et al. used superintelligent (“Albert Einstein”) and average-intelligence virtual body avatars to illustrate this concept (37). Participants who embodied the Einstein avatar performed cognitively better than those who embodied an average-intelligence avatar of an age similar to their own (37). A similar influence of the owned body has been shown in social behavior studies. These experiments investigated whether acting through certain types of avatars (i.e., as players in video games) and the avatars’ actions could influence pro- or antisocial behaviors (194 subjects). Players choosing more heroic avatars were encouraged to behave in a more prosocial manner. The authors reported that after acting as a villain or superhero within the virtual world, participants modeled the behaviors of their chosen avatars when interacting with their fellow players in the real world. In addition, the investigators highlighted that role-taking activities supported behaviors consistent with the priming actions (i.e., activities of the heroic or villainous avatar) (38). The introduction of avatars may support treatment engagement during psychotherapy (39). Thus, the virtual world can serve as a vehicle for observation, simulation, and modeling, and avatars power these processes (38). Additional benefits of avatar-integrated therapies include increases in treatment seeking via anonymity, reductions in communication barriers, facilitation of expression and exploration of client identity, and improvements in interventional settings by allowing therapists to control and manipulate the treatment conditions within the virtual environment (39).Metaverse technologies may establish an ideal scenario for mental health research (e.g., sense of body ownership) and the development of new therapies. The fact that real-life situations are difficult to replicate in the real world (i.e., during psychotherapy sessions) but can be safely recreated in cyberspace opens many possibilities for new therapeutic interventions (28). For example, VRET has proven effective in replicating human reactions (e.g., fear-inducing situations generating social anxiety) in real social environments (40, 41). Furthermore, VRET has been successfully used to reduce social anxiety associated with stuttering when speaking to those with authority or during public speaking (42).The COVID-19 pandemic has resulted in significant lifestyle changes worldwide. By extension, health care systems have transformed traditional health education and clinical care settings in an effort to decrease face-to-face interactions. Metaverse technologies are an effective alternative for remote care of certain chronic conditions and biometrically enhance care models involving mental health treatment. These treatments include mindfulness and cognitive-behavioral therapy, either guided by a therapist or as a self-help program (43, 44). In addition, medical metaverse XR innovations may supplement current therapeutic approaches and expand mental health care access (31).ConclusionsIn conclusion, the world is experiencing a digital health care transformation with the development of core technologies (e.g., AI, IoT, DT, and XR). The metaverse is driving these innovations synergistically to increase access to health care services among multiple disciplines, supplement medical education and training, and optimize the experience of delivering and receiving medical care to meet the clinical needs of patients. Part 2 of this series will further explore the rapidly changing influence that the metaverse has on clinical neurosciences.Veterans Affairs Mid-Atlantic Mental Illness Research, Education and Clinical Center (MIRECC) and the Research and Academic Affairs Service Line, W. G. Hefner Veterans Affairs Medical Center, Salisbury, N.C. (López-Ojeda, Hurley); Departments of Psychiatry and Behavioral Medicine (López-Ojeda, Hurley) and Department of Radiology (Hurley), Wake Forest School of Medicine, Winston-Salem, N.C.; Menninger Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston (Hurley).Send correspondence to Dr. Hurley ([email protected]).Supported by Veterans Integrated Services Network 6 MIRECC.The authors report no financial relationships with commercial interests.