Interaction Paradigm Research Articles

A Review on Mixed Reality Operating Systems : Current Trends, Challenges and Prospects

This comprehensive article explores the rapidly evolving landscape of Mixed Reality (MR) operating systems, examining their core functionalities, architectural components, and the cutting-edge trends shaping their development. The article provides an in-depth analysis of the challenges facing MR OS developers, including interoperability, scalability, and user experience optimization, while offering insights into potential solutions. A comparative article of leading MR platforms highlights the diverse approaches and capabilities within the current ecosystem. The article delves into future prospects, discussing the integration of artificial intelligence, advanced user interaction paradigms, and their potential impact across various industries. Additionally, it addresses strategies for overcoming current limitations and explores the broader implications of MR technology on society, including ethical considerations and privacy concerns. By synthesizing current research and industry developments, this paper offers a comprehensive overview of the state of MR operating systems, their potential applications, and the transformative role they are poised to play in shaping human-computer interaction and digital experiences. The article concludes by emphasizing the critical importance of continued innovation in MR operating systems for advancing the field and realizing the full potential of mixed reality technology in both personal and professional domains.

Investigating the role of PmrB mutation on Colistin antibiotics drug resistance in Klebsiella Pneumoniae

Klebsiella pneumoniae, a member of the Enterobacteriaceae family, naturally resides in the digestive tracts of both healthy animals and humans. Carbapenem-resistant Klebsiella pneumoniae (CRKP) poses a significant health risk for hospitalized patients worldwide, greatly reducing the effectiveness of commonly used antibiotics. This leaves healthcare providers with limited treatment options, often relying on colistin. PmrB is important for the survival of Klebsiella pneumonia and, a mutation in the PmrB protein is accountable for the development of colistin antibiotic resistance in Klebsiella pneumonia. This is especially important because colistin is a fundamental component in the treatment of pneumonia. Three mutated residues—T157P, G207D, and T246A—are responsible for colistin resistance. The structural alterations and underlying mechanisms in the PmrB protein that cause resistance owing to mutation remain unclear. As a result, this study is focused to the exploration of the putative mechanism of resistance resulting from these mutations, as well as the structure modification of normal and mutant PmrB proteins, using molecular docking and molecular dynamics simulations analysis. Our results demonstrated that the interaction paradigm for the mutants has been altered and thus showing a significant effect upon the hydrogen bonding network. Interestingly, the binding of Colistin with the three mutant demonstrate unstable behavior as compared with WT+Colistin. The proposed drug-resistance mechanism will help to guide the development of PmrB drugs. These finding may give a new framework for developing novel drugs against the mutant version of PmrB.

Investigating Creation Perspectives and Icon Placement Preferences for On-Body Menus in Virtual Reality

On-body menus present a novel interaction paradigm within Virtual Reality (VR) environments by embedding virtual interfaces directly onto the user’s body. Unlike traditional screen-based interfaces, on-body menus enable users to interact with virtual options or icons visually attached to their physical form. In this paper, We investigated the impact of the creation process on the effectiveness of on-body menus, comparing first-person, third-person, and mirror perspectives. Our first study ( N = 12) revealed that the mirror perspective led to faster creation times and more accurate recall compared to the other two perspectives. To further explore user preferences, we conducted a second study ( N = 18) utilizing a VR system with integrated body tracking. By combining distributions of icons from both studies ( N = 30), we confirmed significant preferences in on-body menu placement based on icon category ( e.g. , Social Media icons were consistently placed on forearms). We also discovered associations between categories, such as Leisure and Social Media icons frequently co-occurring. Our findings highlight the importance of the creation process, uncover user preferences for on-body menu organization, and provide insights to guide the development of intuitive and effective on-body interactions within virtual environments.

On your terms or mine: pigs’ response to imposed gentle tactile contact vs. free form interaction with a familiar human

AbstractPositive human–animal interactions (HAIs) can be intrinsically rewarding and facilitate positive human–animal relationships. However, HAI paradigms vary across studies, and the influence of different interaction paradigms on the animal’s response has been overlooked. We compared the behavioural responses of pigs (n = 28) individually tested with two types of gentle tactile interactions with a familiar human: ‘free form (FF)’ where the pig could voluntarily approach and interact as they normally would, and ‘imposed contact (IC)’ where the human imposed tactile contact on the pig according to a standardised protocol. Pigs did not differ in their level of engagement with the human between the two types of interactions. However, they differed in their behaviour as they explored the pen more during the FF test, while they emitted more low-pitched vocalisations (grunts) during the IC test. These differences can likely be imputed to the IC test differing to the pigs’ habituation to human contact, which could have evoked greater attention to the human or triggered frustration due to violation of expectation. These findings highlight the influence of the predictability of the interaction or level of agency provided to the animal in HAI tests and relation to their previous experience of interacting.

A One-Dimensional Model for Investigating Scale-separated Approaches to the Interaction of Oceanic Internal Waves

Abstract High-frequency wave propagation in near-inertial wave shear has, for four decades, been considered fundamental in setting the spectral character of the oceanic internal wave continuum and for transporting energy to wave-breaking. We compare idealized ray tracing numerical results with metrics derived using a wave turbulence derivation for the kinetic equation and a path integral to study this specific process. Statistical metrics include the changing ensemble mean vertical wavenumber, referred to as a mean drift, dispersion about the mean drift, time lagged correlation estimates of wavenumber and phase locking of the wave packets with the background. The path integral permits us to identify the mean drift as a resonant process and dispersion about that mean drift as non-resonant. At small inertial wave amplitudes; ray tracing, wave turbulence and the path integral provide consistent descriptions for the mean drift of wavepackets in the spectral domain and dispersion about the mean drift. Extrapolating these results to the background internal wavefield over-predicts downscale energy transports by an order of magnitude. At oceanic amplitudes, however, the numerics support diminished transport and dispersion that coincide with the mean drift time scale becoming similar to the lagged correlation time scale. We parse this as the transition to a non-Markovian process. Despite this decrease, numerical estimates of downscale energy transfer are still too large. We argue that residual differences result from an unwarranted discard of Bragg scattering resonances. Our results support replacing the long standing interpretive paradigm of extreme scale-separated interactions with a more nuanced slate of ‘local’ interactions in the kinetic equation.

Conceptualizing Global Trends

Numerous publications contain high-quality descriptions of causes, processes, and effects of global trends. However, very few of these publications are theoretically guided or aim at theory building. This is a handicap preventing most publications on global trends from developing high-quality explanations and prognostications. This article contains an attempt at developing a conceptual framework for resolving the issue. The attempt is based on the paradigm of social interaction and includes arguments in favor of four global trends: upgrading the rationality of organizations, individualization, spread of instrumental activism, and homogenization of culture. The decomposition of the trends makes it possible to identify their structures and dynamics. The analyzed examples usually refer to constructive processes and effects. In reality, the global trends are internally controversial and bring about both constructive and destructive processes and effects. The most challenging task for future studies concerns the interplay of the internal dynamics of each global trend with the dynamics of the configuration of global trends. The conceptualization of the dynamic configuration of interacting global trends is the core of the diagnosis of the global situation.

Exploring the Human-Centric Interaction Paradigm: Augmented Reality-Assisted Head-Up Display Design for Collaborative Human-Machine Interface in Cockpit

Human-cybernetic interfaces (HCI) focuses on the integration and synergy of human-centric design, human factors (HFs) and economics, and human–machine interaction (HMI). The scrutiny of single pilot operations (SPO) approval from civil aviation authorities (CAAs) is subject to the aviation safety and pilot capability during exceptional handling and flight emergency. Airliners advocate the possibility from dual pilot operations (DPO) to SPO because of the financial considerations and captain shortage in the post-pandemic era. One could expect that SPO can only realise when reduced crew operations initiative is proven to be safe and airworthy. Public concerns pilot mental workload and potentially low situational awareness (SA) when handling overwhelmed multi-source information from the HMI in a cockpit, leading to degraded skills and flying performance. Advanced head up display (HUD) design, an integrated transparent display, can assist pilots in maintaining their optimal performance when SPO exercised. In this study, we are interested to design a SPO-favoured cockpit design with HUD and investigate the potential of integrating augmented reality (AR) and HUD in SPO in flight operations. An experiment involving 21 pilots was conducted to assess the effectiveness of AR-HUD on SA and workload in DPO, SPO, and SPO with AR-HUD scenarios. The Situation Awareness Present Assessment Method (SPAM) and a self-rated workload scale were used to evaluate SA and workload levels. Eye-tracking data was also collected to analyse behavioural performance. Results indicated that the AR-HUD scenario achieved optimal workload and SA levels and demonstrated superior performance in handling emergencies. Eye-tracking data revealed that AR-HUD facilitated a more equitable distribution of gaze between instruments and external view. In conclusion, the integration of AR in cockpit design introduces a human-centric interaction paradigm, contributing to aviation safety, SPO implementation and adaptive HMI design.

Development of an Interactive Multimedia-Based IIMSE Learning Model: Accounting Learning

The purpose of this study is to ascertain whether the interactive multimedia-based IIMSE learning paradigm is feasible and beneficial for teaching accounting to students in class XI at Budisatrya Private Vocational School in Medan. This kind of research uses the ASSURE model in conjunction with R&D product creation. Based on the validation of learning material experts (86.4%), learning design experts (88.1%), and media experts (90.6%), who all fall into the very feasible category, the research's findings indicate that the interactive multimedia-based IIMSE learning model is appropriate for use. Field trials came in at 85.6%, small group trials came in at 81.7%, and individual trials came in at 77.1%, all falling into the extremely feasible category. The hypothesis submission results demonstrate that the interactive multimedia-based IIMSE learning model is appropriate for use in accounting courses and that the learning outcomes of students treated with the interactive multimedia-based IIMSE learning model differ significantly from those of students treated with the conventional learning model. This is demonstrated by the data processing findings, which show that tcount > ttable (5.63>1.63) at the significance level α = 0.05 with df obtained t table = 50. We can conclude that there are disparities in the learning results before and after therapy, with Ho being rejected and Ha being accepted. As a result, student learning outcomes are improved by the IIMSE learning paradigm, which is based on interactive multimedia in accounting education.

NGO ‘Screen-Being’ and Stakeholder Engagement: A ‘Wicked Problem’?

AbstractAmple survey research and content analysis has established that NGO internet presence is qualitatively weak and characterized by the dominance of asymmetrical communication. We argue that the emergent communicative and social paradigm of on-line interaction forms what could be defined as a wicked problem. NGOs, seen as a ‘sender’ of information, may well face a crisis of accountability determined by the very nature of the media; whereas the NGOs’ ‘information receivers’ often are deprived of the very possibility of stakeholder relatedness. In the internet-based/on-screen ‘universe’, information and electronic flow are assumed to be continual, which supersedes the entity logic crucial to NGO accountability and legitimacy. In designing their social media presence, NGOs may, therefore, face an impossible challenge.Informed by Stéphane Vial’s analysis of the nature of on-line interactive media, we evaluate these conundrums. Then, inspired by Lucas Introna and Fernando Ilharco, we question the dialogic potential to ‘screen-being’. While the shift from an ‘actor-centric’ to ‘flow-oriented’ paradigm of ‘screen-being’ is inherent to digital communication, it destabilizes the entity-grounded accountability of NGO legitimacy. Hence, we end with explicating the risks to dialogic relatedness of ‘sceen being’ for NGOs. By so doing, we challenge the oft vocalized perspective that NGOs ‘just’ have to increase their digital communications in order to improve their relations with various stakeholders.

Timbral brightness perception investigated through multimodal interference

Brightness is among the most studied aspects of timbre perception. Psychoacoustically, sounds described as “bright” versus “dark” typically exhibit a high versus low frequency emphasis in the spectrum. However, relatively little is known about the neurocognitive mechanisms that facilitate these metaphors we listen with. Do they originate in universal magnitude representations common to more than one sensory modality? Triangulating three different interaction paradigms, we investigated using speeded classification whether intramodal, crossmodal, and amodal interference occurs when timbral brightness, as modeled by the centroid of the spectral envelope, and pitch height/visual brightness/numerical value processing are semantically congruent and incongruent. In four online experiments varying in priming strategy, onset timing, and response deadline, 189 total participants were presented with a baseline stimulus (a pitch, gray square, or numeral) then asked to quickly identify a target stimulus that is higher/lower, brighter/darker, or greater/less than the baseline after being primed with a bright or dark synthetic harmonic tone. Results suggest that timbral brightness modulates the perception of pitch and possibly visual brightness, but not numerical value. Semantically incongruent pitch height-timbral brightness shifts produced significantly slower reaction time (RT) and higher error compared to congruent pairs. In the visual task, incongruent pairings of gray squares and tones elicited slower RTs than congruent pairings (in two experiments). No interference was observed in the number comparison task. These findings shed light on the embodied and multimodal nature of experiencing timbre.

Stimulating social interest: The translational value of basic investigations into frontal cortex function

Fan etal. use electrical stimulation during a novel social interaction paradigm to demonstrate a role for the orbitofrontal cortex in directing social attention. Their results shed new light on the basic functions of the orbitofrontal cortex and have translational value in understanding circuit modulation for psychiatric disorders.

Explainable AI decision support improves accuracy during telehealth strep throat screening

BackgroundArtificial intelligence-based (AI) clinical decision support systems (CDSS) using unconventional data, like smartphone-acquired images, promise transformational opportunities for telehealth; including remote diagnosis. Although such solutions’ potential remains largely untapped, providers’ trust and understanding are vital for effective adoption. This study examines how different human–AI interaction paradigms affect clinicians’ responses to an emerging AI CDSS for streptococcal pharyngitis (strep throat) detection from smartphone throat images.MethodsIn a randomized experiment, we tested explainable AI strategies using three AI-based CDSS prototypes for strep throat prediction. Participants received clinical vignettes via an online survey to predict the disease state and offer clinical recommendations. The first set included a validated CDSS prediction (Modified Centor Score) and the second introduced an explainable AI prototype randomly. We used linear models to assess explainable AI’s effect on clinicians’ accuracy, confirmatory testing rates, and perceived trust and understanding of the CDSS.ResultsThe study, involving 121 telehealth providers, shows that compared to using the Centor Score, AI-based CDSS can improve clinicians’ predictions. Despite higher agreement with AI, participants report lower trust in its advice than in the Centor Score, leading to more requests for in-person confirmatory testing.ConclusionsEffectively integrating AI is crucial in the telehealth-based diagnosis of infectious diseases, given the implications of antibiotic over-prescriptions. We demonstrate that AI-based CDSS can improve the accuracy of remote strep throat screening yet underscores the necessity to enhance human–machine collaboration, particularly in trust and intelligibility. This ensures providers and patients can capitalize on AI interventions and smartphones for virtual healthcare.

A Human–AI interaction paradigm and its application to rhinocytology

This article explores Human-Centered Artificial Intelligence (HCAI) in medical cytology, with a focus on enhancing the interaction with AI. It presents a Human–AI interaction paradigm that emphasizes explainability and user control of AI systems. It is an iterative negotiation process based on three interaction strategies aimed to (i) elaborate the system outcomes through iterative steps (Iterative Exploration), (ii) explain the AI system’s behavior or decisions (Clarification), and (iii) allow non-expert users to trigger simple retraining of the AI model (Reconfiguration). This interaction paradigm is exploited in the redesign of an existing AI-based tool for microscopic analysis of the nasal mucosa. The resulting tool is tested with rhinocytologists. The article discusses the analysis of the results of the conducted evaluation and outlines lessons learned that are relevant for AI in medicine.

Effects of human-robot interaction type on customer tolerance of humanoid robot service failure

ABSTRACT The impact of robot service failure on customer retention is well-recognized, with a growing focus on effective robot recovery strategies. Despite this, the formation of human-robot relationships during interactions is not well understood. This research explores the impact of human-robot interaction types on customer tolerance toward humanoid robot service failures. Employing three scenario-based experimental studies, we demonstrate that customers generate the highest tolerance for robot service failures within companionate relationships, followed by assistive relationships, and instrumental relationships. In addition, this research confirms the mediating role of psychological distance and identifies the moderating role of service context in the relationship between the human-robot interaction relationships and customer tolerance through psychological distance. The findings offer insights for enhancing marketing strategies and the development of human-robot interaction paradigms.

Estimation of human body 3D pose for parent-infant interaction settings using azure Kinect and OpenPose

Automatic pose estimation has become a valuable tool for the study of human behavior, including dyadic interactions. It allows researchers to analyze the nuanced dynamics of interactions more effectively, and facilitates the integration of behavioral data with other modalities (EEG, etc.). However, many technical difficulties remain. Particularly, for parent-infant interactions, automatic pose estimation for infants is unpredictable; the immature proportions and smaller bodies of children may cause misdetections. OpenPose is one tool that has shown high performance in pose tracking from video, even in infants. However, OpenPose is limited to 2D (i.e., coordinates relative to the image space). This may be undesirable in a multitude of paradigms (e.g., naturalistic settings). We developed a method for expanding the functionality of OpenPose to 3D, tailored to parent-infant interaction paradigms. This method merges the estimations from OpenPose with the depth information from a depth camera to obtain a 3D pose that works even for young infants.•Video recordings of interactions of parents and infants are taken using a dual color-depth camera.•2D-positions of parents and their infants are estimated from the color video.•Using the depth camera, we transform the 2D estimations into real-world 3D positions, allowing movement analysis in full-3D space.

Nucleosomes play a dual role in regulating transcription dynamics

Transcription has a mechanical component, as the translocation of the transcription machinery or RNA polymerase (RNAP) on DNA or chromatin is dynamically coupled to the chromatin torsion. This posits chromatin mechanics as a possible regulator of eukaryotic transcription, however, the modes and mechanisms of this regulation are elusive. Here, we first take a statistical mechanics approach to model the torsional response of topology-constrained chromatin. Our model recapitulates the experimentally observed weaker torsional stiffness of chromatin compared to bare DNA and proposes structural transitions of nucleosomes into chirally distinct states as the driver of the contrasting torsional mechanics. Coupling chromatin mechanics with RNAP translocation in stochastic simulations, we reveal a complex interplay of DNA supercoiling and nucleosome dynamics in governing RNAP velocity. Nucleosomes play a dual role in controlling the transcription dynamics. The steric barrier aspect of nucleosomes in the gene body counteracts transcription via hindering RNAP motion, whereas the chiral transitions facilitate RNAP motion via driving a low restoring torque upon twisting the DNA. While nucleosomes with low dissociation rates are typically transcriptionally repressive, highly dynamic nucleosomes offer less of a steric barrier and enhance the transcription elongation dynamics of weakly transcribed genes via buffering DNA twist. We use the model to predict transcription-dependent levels of DNA supercoiling in segments of the budding yeast genome that are in accord with available experimental data. The model unveils a paradigm of DNA supercoiling-mediated interaction between genes and makes testable predictions that will guide experimental design.

Pelatihan Pemanfaatan Media Kartu Huruf Berbasis Audio Visual untuk Meningkatkan Kemampuan Daya Ingat

Technological advancements directly influence the field of education, particularly shifting the paradigm of interaction between teachers and students. This influence demands teachers to innovate and create using available technology. Teacher creativity significantly impacts the quality of the learning process. Learning media supports the learning process and holds a crucial position within the educational system. Without media, communication during learning processes becomes less engaging, potentially making learning less appealing and boring. Utilizing audio-visual-based letter card media to enhance student memory skills at the PAUD Al-Ikhtiar, teachers and students can easily utilize these cards during their learning process. This enhances teachers' understanding and ability to use audio-visual letter-based media effectively, creating a more enjoyable learning environment and improving students' memory, thereby enhancing children's interest in reading. The method employed in this community service program includes participatory training in utilizing learning media. The program's execution involves a team approach with university faculty members assigned to assist teachers, ensuring the training's optimal implementation. Implementation methods encompass activity coordination, resource preparation, execution, and evaluation. The results of the community service initiative were met with enthusiasm and motivation among participants. Practically, it can be concluded that 88% of training participants have effectively developed the Linktree learning media.

From explanations to human-AI co-evolution: charting trajectories towards future user-centric AI

Abstract This paper explores the evolving landscape of User-Centric Artificial Intelligence, particularly in light of the challenges posed by systems that are powerful but not fully transparent or comprehensible to their users. Despite advances in AI, significant gaps remain in aligning system actions with user understanding, prompting a reevaluation of what “user-centric” really means. We argue that current XAI efforts are often too much focused on system developers rather than end users, and fail to address the comprehensibility of the explanations provided. Instead, we propose a broader, more dynamic conceptualization of human-AI interaction that emphasizes the need for AI not only to explain, but also to co-create and cognitively resonate with users. We examine the evolution of a communication-centric paradigm of human-AI interaction, underscoring the need for AI systems to enhance rather than mimic human interactions. We argue for a shift toward more meaningful and adaptive exchanges in which AI’s role is understood as facilitative rather than autonomous. Finally, we outline how future UCAI may leverage AI’s growing capabilities to foster a genuine co-evolution of human and machine intelligence, while ensuring that such interactions remain grounded in ethical and user-centered principles.

Harmonizing Rights and Rewards: Music NFTs as a Paradigm for Equitable Compensation in the Digital Era

This paper provides a critical examination of Music Non-Fungible Tokens (NFTs) within the context of the digital transformation of the music industry, focusing on the implications for equitable artist compensation. As digitalization reshapes consumption and revenue models, the advent of Music NFTs, predicated on blockchain technology, presents a nuanced paradigm for artist-fan interactions and compensation structures. Through an interdisciplinary methodology that integrates literature review and expert interviews, this study scrutinizes the operational mechanisms of Music NFTs, their potential to reconfigure the economics of music production, and the attendant legal and technical challenges. While Music NFTs proffer an innovative approach to direct artist revenue and engagement, this inquiry reveals a complex landscape fraught with legal ambiguities, technological hurdles, and market volatility. The findings underscore the dialectical relationship between the potential benefits of Music NFTs for artists and the prevailing challenges that circumscribe their efficacy.

Interactive learning of natural sign language with radar

AbstractOver the past decade, there have been great advancements in radio frequency sensor technology for human–computer interaction applications, such as gesture recognition, and human activity recognition more broadly. While there is a significant amount of study on these topics, in most cases, experimental data are acquired in controlled settings by directing participants what motion to articulate. However, especially for communicative motions, such as sign language, such directed data sets do not accurately capture natural, in situ articulations. This results in a difference in the distribution of directed American Sign Language (ASL) versus natural ASL, which severely degrades natural sign language recognition in real‐world scenarios. To overcome these challenges and acquire more representative data for training deep models, the authors develop an interactive gaming environment, ChessSIGN, which records video and radar data of participants as they play the game without any external direction. The authors investigate various ways of generating synthetic samples from directed ASL data, but show that ultimately such data does not offer much improvement over just initialising using imagery from ImageNet. In contrast, an interactive learning paradigm is proposed by the authors in which model training is shown to improve as more and more natural ASL samples are acquired and augmented via synthetic samples generated from a physics‐aware generative adversarial network. The authors show that the proposed approach enables the recognition of natural ASL in a real‐world setting, achieving an accuracy of 69% for 29 ASL signs—a 60% improvement over conventional training with directed ASL data.