User Experience and Engagement in the Reality–Virtuality Continuum: A Special Issue Guest Editorial

Abstract

Virtual, augmented and mixed reality technologies are escaping the “trough of disillusionment”—the lowest point of the Gartner Hype Curve that follows the “inflated peak of early expectations” (Muñoz-Saavedra, Miró-Amarante, & Domínguez-Morales, 2020). Now, at this exciting juncture, as we see stronger alignments among technology expectations, performance, penetration, and application, we are delighted to continue the Presence series of special issues—following on from issues on “Arts, Aesthetics, and Performance in Telepresence” (Jeon & Fishwick, 2017), “VR for Culture and Heritage: The Experience of Cultural Heritage with Virtual Reality” (Ch'ng, Cai, & Thwaites, 2017; Ch'ng, Cai, & Thwaites, 2018), and “Virtual and Augmented Reality for Autonomous Driving and Intelligent Vehicles” (Riener, Gabbard, & Trivedi, 2019)—with this new special issue on “User Experience and Engagement in the Reality–Virtuality Continuum.”There has, of course, been an international step change in telepresence, virtualization, and user experience interest following the Covid-19 pandemic restrictions on travel and in-person leisure, cultural, educational, and work-related events and experiences (Amankwah-Amoah, Khan, Wood, & Knight, 2021). Now, we are also seeing virtual technologies and experiences evolve and diversify, for example, ABBA's planned 2022 virtual performances at live venues (BBC, 2021), the creation of dedicated online virtual concert places such as Oberhasli (2021), Apple's anticipated AR/XR technology unveiling (Perry, 2020), and Facebook's “Meta” rebranding with the launch of its Metaverse as an embodied evolution in social technology (Meta, 2021). Perhaps, though, we should be mindful that prior to the pandemic, virtual concerts hosted on popular gaming platforms, such as Fortnite and Minecraft, had already attracted millions of attendees (BBC, 2019). All of these exciting developments, together with ongoing user experience challenges (Ashtari, Bunt, McGrenere, Nebeling, & Chilana, 2020), inspired this MIT Press Presence journal special issue, “User Experience and Engagement in the Reality–Virtuality Continuum.”Our Guest Editor academic interests relating to this special issue theme span two decades of research invested in digitizing and virtualizing cultural artifacts (Ch'ng et al., 2014; Collins, Woolley, Gehlken, & Ch'ng, 2019) and automating the reconstruction of artifacts from virtual 3D fragments (Woolley et al., 2017). Prior to the outbreak of Covid-19, we were evolving research prototypes of an in-museum QR-code triggered augmented reality “AR Museum” app for the purpose of supporting and inspiring stakeholder requirement elicitations (Woolley et al., 2020). Like so many research efforts during the pandemic, our project was substantially affected by lockdowns (for us, this was the cancellation of events and the closure of UK museums), which meant we needed to redirect our efforts. For example, it was necessary for us to redesign our iOS and Android apps to remove the need for physical triggers and the need for app users to visit specific locations. Perhaps, overall, and in the longer term, the necessitated efforts of all researchers over these difficult times, will have benefited the evolution of virtualization technologies and applications. Perhaps, also, researchers will have been further inspired by recent challenges to create more connected and more accessible experiences (Woolley, Collins, Andras, et al., 2021) that could, for example, provide engaging opportunities for “forgotten” heritage sites (Hain & Ganobjak, 2018) and for the smaller and less colorful artifacts that are so often overlooked in traditional museum display contexts, where larger and more dramatically visual and colorful objects take center stage (Woolley, Collins, Rhodes, & Polack, 2021).In this issue, we are delighted to bring seven works on user experience and engagement in the reality—virtuality continuum to Presence journal readers. These works represent novel and timely contributions from 27 authors at 15 institutions in 8 countries. We thank all authors for their valuable contributions to this special issue and we also thank all reviewers who volunteered their time to contribute opinions during what was a very difficult and demanding period.Launching a journal special issue call for papers during a global pandemic and a series of national lockdowns was not ideal timing, especially given the unprecedented demands on academic time when, for example, there were urgent demands for course virtualization, delivery, and assessment, and rather less time for research, paper production, and review. Despite these difficulties, papers submitted to this special issue underwent a rigorous review process. Each submitted manuscript was reviewed by two to four reviewers in each of two review rounds. In total, eleven papers were received and seven were accepted. Guest editors performed meta-reviews on the papers in each round of review and the manuscripts selected for publication were those receiving the highest ratings from reviewers.The seven papers in this special issue, “User Experience and Engagement in the Reality–Virtuality Continuum,” encompass design, analysis and implementation studies addressing virtual reality, augmented reality, and hybrid environments.Two papers relate to interface design relevant to user experience in augmented and virtual realities. For augmented reality interface design, the paper by Joe Cowlyn and Nick Dalton, “A Spatial Informance Design Method to Elicit Early Interface Prototypes for Augmented Reality,” proposes a novel participatory design method for augmented reality interfaces and provides testing evidence demonstrating effectiveness of the method for spatial interface ideation. For virtual environments, the paper by Lisa Rebenitsch and Delaina Engle, “The Effects of Steering Locomotion on User Preference and Accuracy in Virtual Environments,” compares virtual environment self-steering methods in terms of accuracy and minimization of cybersickness, evidencing a “pointing” method using a handheld controller to be preferred in both respects.The issue includes two analysis works. The paper, “Lessons Learned from a Study on Distractions in Virtual Learning Environments: Reliability, Ecological Validity, and an Elusive Social Component,” by Betty Tärning, Eva-Maria Ternblad, Magnus Haake, Agneta Gulz, and Jens Nirme, explores the potential for virtual reality to simulate real-life learning situations in educational research and contributes lessons learned from their study simulating social relationships between the participants and virtual agents and highlighting challenges that need to be addressed to evoke naturalistic behaviors.Limited expectations and parental resistance toward immersive virtual reality adoption are highlighted and questioned in the empirical work reported in the paper, “When Will Immersive Virtual Reality Have Its Day? Challenges to IVR Adoption in the Home as Exposed in Studies with Teenagers, Parents, and Experts,” by Lynne Hall, Samiullah Paracha, Nicole Mitsche, Tom Flint, Fiona Stewart, Kate MacFarlane, Gill Hagan-Green, and Yvonne Dixon-Todd. The authors report parental and expert agreement that mainstream immersive virtual reality adoption is unlikely in the near future but, in contrast, expect children to be using headsets in the near future. Teenagers were reported as interested in the technology but did not envisage many applications of interest beyond gaming and entertainment.In terms of implementation, practice, and application, the issue includes three papers. “Presence and Communication in Hybrid Virtual and Augmented Reality Environments” by Yue Li, Eugene Ch'ng, Sue Cobb, and Simon See, explores hybrid environment communication between paired users in virtual and augmented reality environments. Although shared virtual reality experiences were evidenced to afford higher levels of perceived spatial presence, augmented reality users experienced higher levels of perceived social presence with virtual reality partners.Following on from the 2019 Presence journal special issue on “Virtual and Augmented Reality for Autonomous Driving and Intelligent Vehicles” (Riener et al., 2019), this special issue further contributes to the domain with “A Systematic Review of Augmented Reality Applications for Automated Driving: 2009–2020” from Andreas Riegler, Andreas Riener, and Clemens Holzmann. In this review, 156 papers are surveyed and categorized, and trends identified, for example, the trend toward simulating augmented reality content in virtual driving simulators.Remote learning became a necessity during the Covid lockdowns; Cecilia Hammar Wijkmark, Ilona Heldal, and Maria Metallinou provide a technology assessment in “What Makes Remote Virtual Simulations for Practice-Based Training Work? Presence and Performance in Incident Commander Education.” The authors provide detailed experimental observations, including some positive experiences and outcomes, in the transition from live on-site simulation to remote virtual simulation training for Swedish Fire Service Incident Commanders.We greatly appreciate the contributions of all 27 special issue authors and of all reviewers. We cordially invite Presence readers to a fascinating journey through a collection of high-quality research articles assembled in this special issue, “User Experience and Engagement in the Reality–Virtuality Continuum.”Guest Editors: Sandra I. Woolley, School of Computing and Mathematics, Keele University, UK; and Tim Collins, Department of Engineering, Manchester Metropolitan University, UK.