User Performance Research Articles

On-body sensing technologies and signal processing techniques in addressing safety of human machine collaboration

AbstractSafety is a challenge in human machine collaboration despite of the advantages in achieving efficiency, cost reduction and productivity in a collaborative scenario between human and machine/robot. During collaboration with machines, the user might not be able to follow the collaborative tasks as expected due to the cognitive burden causing potential safety concerns such as collision. Addressing this challenge, the aim of this paper is to explore the potential of on-body sensing systems in study of user experience and the psychological condition during the collaboration between machines and human. As the psychological condition is reflected in physiological signals, sensing technologies and signal processing techniques to extract features from physiological signals are explored with applicability in human machine collaboration scenarios. An experiment is designed utilising an industrial collaborative robot arm while quantitative and qualitative data is gathered for this purpose exploring the problem to study user experience and impact of mental strain and cognitive workload on user performance and experience during human machine collaboration. Results show that an adaptive machine to user experience measured by on-body sensing systems during the collaboration has the potential to address safety in human machine collaboration while improving performance and user experience.

Enhancing Human-Computer Interaction in Augmented Reality (AR) and Virtual Reality (VR) Environments: The Role of Adaptive Interfaces and Haptic Feedback Systems

Human-Computer Interaction (HCI) in Augmented Reality (AR) and Virtual Reality (VR) environments has emerged as a critical area of research, shaping how users interact with immersive technologies. This study explores the design and development of advanced HCI frameworks in AR/VR environments, with a particular focus on adaptive interfaces and haptic feedback systems. Adaptive interfaces employ real-time data to personalize user experiences, while haptic feedback systems provide tactile sensations to bridge the gap between digital and physical interactions. The integration of these technologies enhances user engagement, immersion, and efficiency across applications such as gaming, training simulations, healthcare, and remote collaboration. This research investigates the challenges in creating intuitive, responsive systems and examines cutting-edge solutions in multimodal interactions, gesture recognition, and real-time feedback processing. By analyzing user performance and satisfaction, this study contributes to the refinement of AR/VR systems, paving the way for next-generation immersive environments.

SoftBoMI: a non-invasive wearable body-machine interface for mapping movement of shoulder to commands

Objective.Customized human-machine interfaces for controlling assistive devices are vital in improving the self-help ability of upper limb amputees and tetraplegic patients. Given that most of them possess residual shoulder mobility, using it to generate commands to operate assistive devices can serve as a complementary approach to brain-computer interfaces.Approach.We propose a hybrid body-machine interface prototype that integrates soft sensors and an inertial measurement unit. This study introduces both a rule-based data decoding method and a user intent inference-based decoding method to map human shoulder movements into continuous commands. Additionally, by incorporating prior knowledge of the user's operational performance into a shared autonomy framework, we implement an adaptive switching command mapping approach. This approach enables seamless transitions between the two decoding methods, enhancing their adaptability across different tasks.Main results.The proposed method has been validated on individuals with cervical spinal cord injury, bilateral arm amputation, and healthy subjects through a series of center-out target reaching tasks and a virtual powered wheelchair driving task. The experimental results show that using both the soft sensors and the gyroscope exhibits the most well-rounded performance in intent inference. Additionally, the rule-based method demonstrates better dynamic performance for wheelchair operation, while the intent inference method is more accurate but has higher latency. Adaptive switching decoding methods offer the best adaptability by seamlessly transitioning between decoding methods for different tasks. Furthermore, we discussed the differences and characteristics among the various types of participants in the experiment.Significance.The proposed method has the potential to be integrated into clothing, enabling non-invasive interaction with assistive devices in daily life, and could serve as a tool for rehabilitation assessment in the future.

Evaluating the User Experience and Usability of the MINI Robot for Elderly Adults with Mild Dementia and Mild Cognitive Impairment: Insights and Recommendations

Introduction: In recent years, the integration of robotic systems into various aspects of daily life has become increasingly common. As these technologies continue to advance, ensuring user-friendly interfaces and seamless interactions becomes more essential. For social robots to genuinely provide lasting value to humans, a favourable user experience (UX) emerges as an essential prerequisite. This article aimed to evaluate the usability of the MINI robot, highlighting its strengths and areas for improvement based on user feedback and performance. Materials and Methods: In a controlled lab setting, a mixed-method qualitative study was conducted with ten individuals aged 65 and above diagnosed with mild dementia (MD) and mild cognitive impairment (MCI). Participants engaged in individual MINI robot interaction sessions, completing cognitive tasks as per written instructions. Video and audio recordings documented interactions, while post-session System Usability Scale (SUS) questionnaires quantified usability perception. Ethical guidelines were followed, ensuring informed consent, and the data underwent qualitative and quantitative analyses, contributing insights into the MINI robot’s usability for this demographic. Results: The study addresses the ongoing challenges that tasks present, especially for MD individuals, emphasizing the importance of user support. Most tasks require both verbal and physical interactions, indicating that MD individuals face challenges when switching response methods within subtasks. These complexities originate from the selection and use of response methods, including difficulties with voice recognition, tablet touch, and tactile sensors. These challenges persist across tasks, with individuals with MD struggling to comprehend task instructions and provide correct answers and individuals with MCI struggling to use response devices, often due to the limitations of the robot’s speech recognition. Technical shortcomings have been identified. The results of the SUS indicate positive perceptions, although there are lower ratings for instructor assistance and pre-use learning. The average SUS score of 68.3 places device usability in the “good” category. Conclusions: Our study examines the usability of the MINI robot, revealing strengths in quick learning, simple system and operation, and integration of features, while also highlighting areas for improvement. Careful design and modifications are essential for meaningful engagement with people with dementia. The robot could better benefit people with MD and MCI if clear, detailed instructions and instructor assistance were available.

A new era for stress research: supporting user performance and experience in the digital age

Stress is both a driver of objective performance impairments and a source of negative user experience of technology. This review addresses future directions for research on stress and ergonomics in the digital age. The review is structured around three levels of analysis. At the individual user level, stress is elicited by novel technologies and tasks including interaction with AI and robots, working in Virtual Reality, and operating autonomous vehicles. At the organisational level, novel, potentially stressful challenges include maintaining cybersecurity, surveillance and monitoring of employees supported by technology, and addressing bias and discrimination in the workplace. At the sociocultural level, technology, values and norms are evolving symbiotically, raising novel demands illustrated with respect to interactions with social media and new ethical challenges. We also briefly review the promise of neuroergonomics and emotional design to support stress mitigation. We conclude with seven high-level principles that may guide future work.

Searching Across Realities: Investigating ERPs and Eye-Tracking Correlates of Visual Search in Mixed Reality.

Mixed Reality allows us to integrate virtual and physical content into users' environments seamlessly. Yet, how this fusion affects perceptual and cognitive resources and our ability to find virtual or physical objects remains uncertain. Displaying virtual and physical information simultaneously might lead to divided attention and increased visual complexity, impacting users' visual processing, performance, and workload. In a visual search task, we asked participants to locate virtual and physical objects in Augmented Reality and Augmented Virtuality to understand the effects on performance. We evaluated search efficiency and attention allocation for virtual and physical objects using event-related potentials, fixation and saccade metrics, and behavioral measures. We found that users were more efficient in identifying objects in Augmented Virtuality, while virtual objects gained saliency in Augmented Virtuality. This suggests that visual fidelity might increase the perceptual load of the scene. Reduced amplitude in distractor positivity ERP, and fixation patterns supported improved distractor suppression and search efficiency in Augmented Virtuality. We discuss design implications for mixed reality adaptive systems based on physiological inputs for interaction.

Too much of a good thing: How varying levels of automation impact user performance in a simulated intrusion detection task

Cyber analysts face a demanding task when prioritizing alerts from intrusion detection systems, balancing the challenge of numerous false positives from rule-based methods with the critical need to detect genuine cyber threats, necessitating unwavering vigilance and imposing a significant cognitive burden. In this field, there exists pressure to incorporate artificial intelligence techniques to enhance the automation of analyst workflows, yet without a clear grasp of how elevating the Level of Automation impacts the allocation of attentional and cognitive resources among analysts. This paper describes a simulated AI-assisted intrusion detection task which varies five degrees of automation as well as the sensitivity of the assistant, evaluating performance-based (e.g., accuracy, response time, sensitivity, response bias) and subjective (e.g., surveys on workload and trust) measures. Participants white-listed a series of time-sensitive alerts in a simulated Snort® environment. Our findings indicate that elevating the level of automation altered participants’ behavior, evident in their tendency to display a response bias towards rejecting hits (reduced hit rate and false alarm rate) when overriding an AI’s decision. Additionally, participants subjectively reported experiencing a decreased cognitive workload with a more precise algorithm, irrespective of any variance in their actual performance. Our findings suggest the necessity for additional research before implementing further automation into analyst workflows, as the demands of tasks evolve with escalating levels of automation.

Laboratory Management; Challenges and Opportunities in FkipUhamka

This study aims to analyze the management of basic physics laboratories at UniversitasMuhammadiyah Prof DR HAMKA and its impact on user performance and satisfaction. Optimal management of basic physics laboratories is very important to support the learning process and student practicums. This study uses a descriptive method with a quantitative approach, where data is collected through questionnaires distributed to lecturers and students who use the laboratory. The results of the study indicate that the management of basic physics laboratories at UniversitasMuhammadiyah Prof DR HAMKA has been running well, but there are still several aspects that need to be improved, such as equipment maintenance, additional facilities, and improving work safety. Data analysis shows that there is a significant relationship between laboratory management and user performance and satisfaction. Good management will improve the efficiency of laboratory use, which in turn will improve academic performance and user satisfaction. Based on the findings, several suggestions are given for further improvement, including planning for periodic maintenance, adding facilities, improving laboratory technician skills, and regular monitoring and evaluation. The implementation of these suggestions is expected to improve the quality of basic physics laboratory management at UniversitasMuhammadiyah Prof. DR HAMKA.

PERFECT: Personalized Exercise Recommendation Framework and architECTure

Background : The health benefits of regular physical activity (PA) are well-established and widely acknowledged. Through the integration of wearable trackers, the Internet of Things (IoT)—a network of interconnected devices capable of collecting and exchanging data—coupled with mobile health (mHealth), which refers to the use of mobile devices to support medical and public health practices, it is now feasible to systematically gather and present individual exercise behaviors. This advanced approach enables the precise correlation of users’ physiological data and daily activities with their specific fitness needs, offering a personalized pathway to improving health outcomes. Objective : This study aims to enhance PA levels among individuals by developing a personalized exercise recommendation system. Utilizing reinforcement learning, the system proposes tailored exercise plans based on biomarkers and the user’s specific context. Methods : In this study, we developed applications for smartphones and smartwatches designed to gather, monitor, and recommend exercise routines through the application of a contextual multi-arm bandit algorithm. To evaluate the efficacy of this mHealth exercise regimen, we enlisted the participation of twenty female college students. Results : The outcomes of our investigation revealed a significant enhancement in the average daily duration of exercise (P \({\lt}\) . 001). Participants expressed high levels of satisfaction with both the walking program and the recommendation system, achieving average ratings of 4.31 (SD \(=\) 0.60) and 3.69 (SD \(=\) 0.95), respectively, on a 5-point scale. Furthermore, the average scores for participants’ confidence in safely performing the recommended walking exercises, as well as their perception of the study’s effectiveness in meeting their PA needs, were both above 4, indicating a positive reception and confidence in the program’s design and implementation. Conclusions : The evolution of the IoT and wearable technology has marked the beginning of a new era for mHealth systems, particularly in the personalization of health interventions. Such advancements enable the precise personalization of PA recommendations, potentially enhancing user engagement and performance outcomes. This paper introduces a novel exercise recommendation system that utilizes reinforcement learning to personalize walking exercises based on the user’s biomarkers and context, aiming to improve the user’s aerobic capacity significantly.

IBCFaiCDR: Auxiliary data-driven item-based collaborative filtering in cross-domain RSs to address user cold start problem

The adoption of Recommender Systems (RSs) in various services is imperative in the present era. One of the inherent challenge faced by RSs is the user cold start problem (UCS) and it occurs when there is a lack of enough data available for a new user, which restricts the capacity to provide accurate recommendations. Researchers have conducted investigations into the utilization of auxiliary data like social network data, review text, demographic information etc., to augment the RSs ability to learn and understand the user's preferences, with the aim of solving this issue. The provided information is inadequate due to the restricted level of user engagement within the specified domain. The researchers utilize a Cross-Domain RS (CDR) that incorporates information from multiple domains to provide personalized suggestions to users. Item Based Collaborative Filtering (IBCF), which utilizes item-item similarity, is commonly used when dealing with sparse data. The suggested collaborative filtering technique employs IBCF which uses the item similarity obtained with item features. These features are generated by the proposed approach IBCFaiCDR's model, trained on source domain data such as product images and reviews. The efficacy of the proposed approach is assessed using a large dataset from Amazon, consisting of user interactions across many categories. The results on target domain, evaluated using MAE and RMSE, indicate that the inclusion of auxiliary information (image + text) enhances the RS performance for new users.

Artificial intelligence and machine learning for additive manufacturing composites toward enriching Metaverse technology

<p class="Abstract">As a result of the growing significance and application of technology across a wide range of fields, digital environments such as Metaverse started to take shape over the span of the previous decade. This study aims to discover an area of engineering that could benefit from this new technology by developing an artificial intelligence (AI)—based approach to analyzing and predicting the mechanical properties of carbon fiber reinforced syntactic thermoset composites that are made through additive manufacturing (AM). These composites are intended to be utilized as a tool for metaverse technology in a variety of domains—as the presence of the limitations in the currently experimental methods. The metaverse allows for the generation of simulations through the application of artificial intelligence (AI) and machine learning (ML). Consequently, this paves the way for individuals to investigate various design possibilities and view the virtual manifestation of those possibilities. This is made possible by the use of machine learning algorithms, which allow for the monitoring and evaluation of user performance, as well as the provision of individualized feedback and suggestions for improvement. As a consequence of this, it is feasible that professionals will be able to get education and training that are both more efficient and effective. Consequently, this work aims to introduce an Adaptive Neuro-Fuzzy Inference System (ANFIS)—based model, which is able to effectively anticipate the behavior of mechanical systems in a variety of settings without the need for significant measurements. The validity of the ANFIS model was determined through the utilization of flexure and compression testing. The approach that was used to improve the technical assessment of the manufactured composites—is verified by the model’s near-realistic predictions. Moreover, this method is superb for lowering weight, enhancing mechanical qualities, and minimizing product complexity.</p>

Improving cell edge user performance using cooperative cyclic interleaved non-orthogonal multiple access under rayleigh fading channel

Improving cell edge user performance using cooperative cyclic interleaved non-orthogonal multiple access under rayleigh fading channel

ASSESSMENT AND TECHNICAL CONSTRAINT IDENTIFICATION OF SMALLHOLDER IRRIGATION PUMP IN ARSI AND EAST SHEWA ZONE, OROMIA

Efficient irrigation begins with properly installed and maintained pumps, motors, and engines. For this, the study was conducted on potential irrigation pump users of the Arsi and East Shewa zones with the objective of identifying the technical constraints of smallholder irrigation pump users. Doddota from Arsi and Dugda and Bora woreda from the East Shewa zone were selected. 211 samples size from 2321 pump users were used for data collection. The constraints listed by respondents, like pump damage, pump cost, long priming, and fuel, were the most common bottlenecks in pump irrigation schemes. Pump damage was positively correlation with use of un-recommended suction and delivery head, age of pump, long priming time and continues operation time but negatively correlation with pump maintenance, experience in irrigation farming and educational level of the household. Long priming and fuel consumption was positively (+Ve) correlation with use of un-recommended suction and delivery head, age of pump, operation time and pump size. From the existing pump type respondent responses, KAMA pumps were highly available on the market, vulnerable to damage, and had sufficient spare parts with values of 60.66, 64.45 and 44.08%, respectively. The lowest were Cushion their values were 1.42%, 3.32% and 3.78%, respectively. The respondents also reply, due to absence of governmental pump maintaining organization, cost of maintenance at local and private garage were very expensive (68.25%) and expensive (26.07%). This makes another problem on small holder irrigation pump. Therefore, it is recommended to government to add pump maintaining structure at engineering center which serves' closely to scheme users and providing regular training on maintenance checklist. It is also recommended for engineering and socio-economic researchers to conduct research collaboratively to assess the gap frequently for other kebele pump user and technical performance evaluation for pump that have problems.

Does Prosocial Automation Increase Driver’s Well-being?

As societies transition to hybrid mobility systems, interactions between automated vehicles (AVs) and human users in public spaces become more complex, highlighting the critical role of prosocial behaviors. These behaviors are essential for the seamless operation of interdependent transportation networks, helping to address integration challenges of AVs with human-operated vehicles and enhancing well-being by creating more efficient, less stressful, and inclusive environments. This study explores the impact of receiving prosocial behaviors on the cognition, riding performance, and well-being of micromobility users in simulated urban traffic scenarios. Using a mixed-method design, the research contrasts two types of social interactions—prosocial and asocial—across three temporal conditions: relaxed, neutral, and urgent. The Structural Equation Modeling underscored the intricate relationships between prosocial behaviors, satisfaction, cognition, riding performance, and well-being. Incorporating social factors into driving systems could enhance safety and improve urban mobility solutions.

Individual Differences in Stride Length During Powered Exoskeleton Walking Due to Changes in Quasi-Stiffness Control Parameter

Active exoskeletons are driven by controllers that execute commands that respond to a user’s intent. It is unclear how precise these systems need to be to assist humans efficiently and reduce the risk of injury. This study evaluated participants’ stride length during powered ankle exoskeleton walking while controlling the quasi-stiffness coefficient, the relationship between exoskeleton ankle torque and ankle angle. Compared with the reference quasi-stiffness value, 31% of participants showed a statistically significant increase in normalized stride length (NSL) at high and low quasi-stiffness coefficients. In comparison, 50% showed a statistically significant decrease in NSL. Only 19% showed a statistically significant increase at either low or high quasi-stiffness coefficients. The results suggest that it is essential to consider individual responses, as different stride lengths emerged from changes in quasi-stiffness across participants. This knowledge is important for improving user experience and performance and ensuring the system is used efficiently.

Design and Mechanical Validation of Commercially Viable, Personalized Passive Prosthetic Feet

Abstract Current high-performance prosthetic feet work well for many users, but the low resolution of size and stiffness categories may limit walking performance for certain users. A line of prosthetic feet with a high resolution of sizes and stiffnesses, designed through amputee-specific personalization, could provide clinical and economic value. The lower leg trajectory error (LLTE) design framework facilitates the design of high-performance, amputee-specific prosthetic feet; however, previous foot prototypes were not designed to satisfy the economic, mechanical, and aesthetic requirements for commercial adoption. The aims of this work were to understand how a personalized, affordable prosthetic foot can align with the clinical-commercial ecosystem, innovate a viable future product, and inform other prosthesis designers of considerations required to connect innovation to real-world implementation. We evaluated needs by identifying how products, capital, and services flow between stakeholders, and we elucidated design requirements for a personalized prosthetic foot that can be manufactured, distributed, and clinically provided. Based on material properties and manufacturing process capabilities, computer numerically controlled (CNC) machining of Nylon 6/6 satisfies these requirements. We present a novel parametric foot architecture that can be CNC machined, fits within a commercial foot shell, and can be designed for individual users’ body characteristics and activity levels. Prototypes made using the new foot design behaved as anticipated (1–12% error in modeled displacement), satisfied industry-standard strength (ISO 10328) and mechanical performance (AOPA dynamic heel/keel) requirements, and elicited positive feedback from both amputees and prosthetists.

Auditory, Visual, or Both? Comparing Visual and Auditory Representations of Game Elements in a Gamified Image-Tagging Task

In gamification users show increased motivation and engagement towards tasks. So far, this effect has mostly been empirically tested based on the visual depiction of game elements, while research on the use and addition of auditory aspects is sparse. In this work we investigate the effect of different modalities of game elements (auditory, visual, audiovisual) on user experience, perception and performance in a gamified image-tagging task. We approached this via an online validation survey to find suitable sound effects (N=50), a main quantitative study (N=109) and a qualitative semi-structured interview (N=9). Our results show that while visual gamification increases performance, auditory and audiovisual gamification had no effect. However, they were shown to have an influence on the user's flow state. Our qualitative follow-up study shed light on underlying reasons and revealed each modality has its own drawbacks and advantages and that combining both visual and auditory aspects was preferred by participants.

Predictive Gaze Analytics: A Comparative Case Study of the Foretelling Signs of User Performance during Interaction with Visualizations of Ontology Class Hierarchies

The current research landscape in ontology visualization has largely focused on tool development, yielding an extensive array of visualization tools. Although many existing solutions provide multiple ontology visualization layouts, there is limited research in adapting to an individual user’s performance, despite successful applications of adaptive technologies in related fields, including information visualization. In an effort to innovate beyond traditional one-size-fits-all visualizations, this paper contributes one step towards realizing user adaptive visualization by recognizing timely moments when users may potentially need intervention, as real-time adaptation can only occur if it is possible to correctly predict user success and failure during an interaction in the first place. In addition, an open-source, reusable, and extensible software: Beach Environment for the Analytics of Human Gaze (BEACH-Gaze) is made available to the broader scientific community interested in descriptive and predictive gaze analytics. Building on a wealth of research in eye tracking, this paper compares four approaches to predictive gaze analytics through a series of experiments that utilize scheduled gaze digests, irregular gaze events, the last known gaze status, as well as all gaze captured for a user at a given moment in time. The results from a set of experimental trials suggest that irregular gaze events are most informative of early predictions of user performance, whereas cognitive workload appears to be most indicative of overall user performance in the task scenario presented in this paper. These empirical findings highlight the importance of an analytical approach to gaze on user predictions and indicate careful consideration when applying.

Visual augmentation of live-streaming images in virtual reality to enhance teleoperation of unmanned ground vehicles

First-person view (FPV) technology in virtual reality (VR) can offer in-situ environments in which teleoperators can manipulate unmanned ground vehicles (UGVs). However, non-experts and expert robot teleoperators still have trouble controlling robots remotely in various situations. For example, obstacles are not easy to avoid when teleoperating UGVs in dim, dangerous, and difficult-to-access areas with environmental obstacles, while unstable lighting can cause teleoperators to feel stressed. To support teleoperators’ ability to operate UGVs efficiently, we adopted construction yellow and black lines from our everyday life as a standard design space and customised the Sobel algorithm to develop VR-mediated teleoperations to enhance teleoperators’ performance. Our results show that our approach can improve user performance on avoidance tasks involving static and dynamic obstacles and reduce workload demands and simulator sickness. Our results also demonstrate that with other adjustment combinations (e.g., removing the original image from edge-enhanced images with a blue filter and yellow edges), we can reduce the effect of high-exposure performance in a dark environment on operation accuracy. Our present work can serve as a solid case for using VR to mediate and enhance teleoperation operations with a wider range of applications.

Sensorimotor brain–computer interface performance depends on signal-to-noise ratio but not connectivity of the mu rhythm in a multiverse analysis of longitudinal data

Objective.Serving as a channel for communication with locked-in patients or control of prostheses, sensorimotor brain-computer interfaces (BCIs) decode imaginary movements from the recorded activity of the user's brain. However, many individuals remain unable to control the BCI, and the underlying mechanisms are unclear. The user's BCI performance was previously shown to correlate with the resting-state signal-to-noise ratio (SNR) of the mu rhythm and the phase synchronization (PS) of the mu rhythm between sensorimotor areas. Yet, these predictors of performance were primarily evaluated in a single BCI session, while the longitudinal aspect remains rather uninvestigated. In addition, different analysis pipelines were used to estimate PS in source space, potentially hindering the reproducibility of the results.Approach.To systematically address these issues, we performed an extensive validation of the relationship between pre-stimulus SNR, PS, and session-wise BCI performance using a publicly available dataset of 62 human participants performing up to 11 sessions of BCI training. We performed the analysis in sensor space using the surface Laplacian and in source space by combining 24 processing pipelines in a multiverse analysis. This way, we could investigate how robust the observed effects were to the selection of the pipeline.Main results.Our results show that SNR had both between- and within-subject effects on BCI performance for the majority of the pipelines. In contrast, the effect of PS on BCI performance was less robust to the selection of the pipeline and became non-significant after controlling for SNR.Significance.Taken together, our results demonstrate that changes in neuronal connectivity within the sensorimotor system are not critical for learning to control a BCI, and interventions that increase the SNR of the mu rhythm might lead to improvements in the user's BCI performance.