User Experience Assessment Research Articles

Unsupervised robot-assisted rehabilitation after stroke: feasibility, effect on therapy dose, and user experience

BackgroundUnsupervised robot-assisted rehabilitation is a promising approach to increase the dose of therapy after stroke, which may help promote sensorimotor recovery without requiring significant additional resources and manpower. However, the unsupervised use of robotic technologies is not yet a standard, as rehabilitation robots often show low usability or are considered unsafe to be used by patients independently. In this paper we explore the feasibility of unsupervised therapy with an upper limb rehabilitation robot in a clinical setting, evaluate the effect on the overall therapy dose, and assess user experience during unsupervised use of the robot and its usability.MethodsSubacute stroke patients underwent a four-week protocol composed of daily 45 min-sessions of robot-assisted therapy. The first week consisted of supervised therapy, where a therapist explained how to interact with the device. The second week was minimally supervised, i.e., the therapist was present but intervened only if needed. After this phase, if participants learnt how to use the device, they proceeded to two weeks of fully unsupervised training. Feasibility, dose of robot-assisted therapy achieved during unsupervised use, user experience, and usability of the device were evaluated. Questionnaires to evaluate usability and user experience were performed after the minimally supervised week and at the end of the study, to evaluate the impact of therapists’ absence.ResultsUnsupervised robot-assisted therapy was found to be feasible, as 12 out of the 13 recruited participants could progress to unsupervised training. During the two weeks of unsupervised therapy participants on average performed an additional 360 min of robot-assisted rehabilitation. Participants were satisfied with the device usability (mean System Usability Scale scores > 79), and no adverse events or device deficiencies occurred.ConclusionsWe demonstrated that unsupervised robot-assisted therapy in a clinical setting with an actuated device for the upper limb was feasible and can lead to a meaningful increase in therapy dose. These results support the application of unsupervised robot-assisted therapy as a complement to usual care in clinical settings and pave the way to its application in home settings.Trial registrationRegistered on 13.05.2020 on clinicaltrials.gov (NCT04388891).

Usability Testing of Waters Brand Promotion Website on University Students

<em>Usability testing plays a pivotal role in assessing user experience on websites, providing businesses with invaluable insights into customer perspectives. Eye-tracking, a widely accepted methodology, zeroes in on visual engagement by analyzing specific Areas of Interest (AOI). This study embarked on an exploration of the impact of AOI on dwell time for the latest iteration of the Waters website and further delineated the sections that captivated the most and least user attention. Adopting a quantitative stance, a two-way ANOVA was deployed on a sample comprising 15 master’s students from two distinct academic institutions. Preliminary findings underscore significant disparities in dwell times across different AOIs, implying that specific AOIs retain user attention more robustly. Notably, the research has its constraints, encompassing potential deviations in webcam-based eye-tracking accuracy, the modest sample size, and post-hoc AOI categorization. As an extension, subsequent studies could probe the nuanced factors swaying dwell time within Waters' website AOIs, integrating methodologies such as the WSD technique and proactive AOI classification.</em>

Improving Usability in Mobile Apps for Residential Energy Management: A Hybrid Approach Using Fuzzy Logic

This paper presents a study that evaluates the usability and user experience of a mobile application interface for residential energy management, adopting a hybrid approach that integrates quantitative and qualitative methods within a user-centered design framework. For the evaluation, metrics and tools such as the User Experience Questionnaire Short (UEQ-S) and the System Usability Scale (SUS) were used, in addition to the implementation of a fuzzy logic model to interpret and contrast the data obtained through these metrics, allowing a more accurate assessment of usability and user experience, reflecting the variability and trends in the responses. Three aspects evaluated stand out: satisfaction with the interface, ease of use, and efficiency. These are fundamental to understanding how users perceive the system. The results indicate a high likelihood of user recommendation of the system and a high overall quality of user experience. This study significantly contributes to mobile application usability, especially in residential energy management, offering valuable insights for designing more intuitive and effective user interfaces on mobile devices.

Assessing User Experiences in Virtual Reality Learning Environments

Assessing User Experiences in Virtual Reality Learning Environments

The Application of User Experience Questionnaire to Evaluate Customer Experience When Using Digital Platform to Purchase Flight Ticket in Two Travel and Ticketing Digital Companies

This research aims to find out the results of the assessment and comparison of user experience in online airline ticket booking applications using the user experience questionnaire (UEQ). Data collection methods include using literature studies and distributing questionnaires. The sampling technique used in this research was a simple random sampling method with a total of 100 respondents. Validity tests and reliability tests are also carried out using statistical calculations and tools. Based on the average score assessment on each travel A and travel B application scale using the UEQ questionnaire, both applications have a good overall user experience (UX) level. In travel application A, the average score for each scale, such as attractiveness, is 2.6, clarity is 2.4, efficiency is 2.5, accuracy is 2.4, stimulation is 2.5, and novelty is 2.5, all of which indicate that this application scored above or at least equal to the established "excellent" threshold. Meanwhile, for travel application B, the average score on each scale also shows that this application reaches a good UX level. The average scores for the attractiveness scale were 2.4, clarity was 2.5, efficiency was 2.5, accuracy was 2.3, stimulation was 2.4, and novelty was 2.2, all meeting or exceeding the threshold value of "excellent." From these results, it can be concluded that travel has a good performance in providing a satisfactory user experience on the online airline ticket booking application. Although there are slight variations in the average scores on several scales between the two applications, both overall provide an excellent user experience based on evaluation using the UEQ questionnaire.

Audience participation fighting game: Exploring social facilitation for an enhanced APG experience

This paper discusses the popularity of live streaming video games and its potential to address psychological challenges, especially during the COVID-19 pandemic. An audience participation game (APG) that involve massive audiences in gameplay, blurring the lines between viewers and players, is introduced. The game highlights the dynamic adjustment of AI character strengths based on audience inputs, specifically cheering and jeering. The study examines factors that influence user experience (UX) and activeness in APG. System evaluation includes comprehensive AI testing, consisting of 500,000 one-minute game rounds, and a user experiment involving 82 participants. UX assessment is conducted using a pairwise preference, four-alternative forced choice (4-AFC), version of the Game User Experience Satisfaction Scale (GUESS). Finally, the paper concludes by offering guidelines and hypotheses for future research in the field of APGs.

User Experience Assessment on Virtual-Reality Robot-Assisted Smart Hybrid Prototype of a Vehicle Trunk Lid

Engineering tasks in product development are becoming increasingly complex and must consider the individualization of products, the adaptability to customer requirements, shortened development times and high product quality standards. CAD and CAE models enable computer-based modeling and testing of virtual prototypes, replacing physical prototypes, leading to reduced manufacturing cost and development times. However, possibilities to perform user studies for quality testing with solely virtual prototypes are limited. Smart Hybrid Prototyping (SHP) combines functional virtual prototyping with extended reality technologies and haptic interaction features, enabling early multimodal design testing. The aim is to design future products faster and more cost-effectively by integrating user tests on SHP prototypes at an early stage, reducing the number of development steps and avoiding changes at later phases in product development. To achieve this goal a hybrid prototype was developed by the authors as part of the public research project “RobVRAR”. The hybrid prototype simulates the opening and closing behavior of an automotive trunk lid, offers haptic interaction features through a robot arm and displays 3D-models of the vehicle in real-time in virtual reality (VR). Subsequently a user study comparing a real trunk lid with our prototype was conducted to investigate the quality of user experience.

A multimodal group-based immersive virtual reality intervention for improving cognition and mental health in patients with post-covid-19 condition. A quasi-experimental design study.

Adults with Post-COVID-19 Condition (PCC) may show cognitive impairments in attention, processing speed, memory, and executive function. Multimodal programs that combine cognitive training, physical activity and emotional tasks, such as mindfulness-based interventions (MBIs), may offer a suitable alternative for improving PCC treatments. Immersive Virtual Reality (IVR) is a promising technology that can enhance traditional cognitive training, physical activity, and MBIs. The use of IVR technology may increase engagement with these interventions and potentially enhance the individual benefits of cognitive training, exercise and MBIs. The current study evaluated the impact of a multimodal IVR intervention, comparing this with a usual care intervention (control group), in order to assess changes in cognition and mental health in adults with PCC. We also aimed to assess user experience factors such as enjoyment, perceived improvement, and fatigue following each multimodal IVR session within the experimental group. Thirty-one participants with PCC symptoms were assigned to either the experimental group (IVR, n = 15) or the control group (usual care intervention, n = 16) in a quasi-experimental design study. The multimodal IVR intervention consisted of MBI, cognitive training and physical exercise and was delivered in a 60-min group session with 5 participants, twice a week, for 8 weeks (16 sessions in total). Measures of global cognition, attention, processing speed, verbal episodic memory and subjective memory complaints (primary measures), and depressive and anxiety symptoms and fatigue (secondary measures) were assessed at baseline and also after 8 weeks (post-intervention). Mixed between-group (group) and within-group (pre-post assessments) ANOVAs revealed significant group*time interactions in global cognition, simple attention, processing speed, memory and depressive symptoms, with large effect sizes (p < 0.05; partial η2 > 0.14). There was also a marginally significant group*time interaction for executive function (p = 0.05). Follow-up analyses comparing pre-and post-intervention outcomes for each group separately showed that the experimental group significantly improved in global cognition, processing speed, memory and depressive symptoms, while the control group showed no significant pre-post changes. Friedman tests showed a significant main effect of time (χ2(2) = 6.609, p = 0.04), with a gradual increase in enjoyment from the first, to the mid, and then to the final session. In addition, perceived improvement scores remained high throughout the intervention, and patient-reported fatigue levels did not fluctuate significantly throughout the intervention. To our knowledge, no previous research has combined cognitive training, physical exercise and MBI using an IVR paradigm in adults with PCC. Despite their inherent limitations, our findings mark a pioneering step toward improving cognition and mental health outcomes in PCC through the innovative use of new technology and multimodal approaches. This first study should be accompanied by more extensive, randomized clinical trials aimed at further exploring and refining these interventions.

Research on the Innovative Development of Digital Media Enabled by Computer Visual Arts

Abstract This paper explores the integration of computer visual art with digital media, highlighting the innovative potential of computer technology in creating dynamic digital media art. Initially, we review relevant theories of computer-based visual art and examine their applications in digital media art. We then detail an immersive scene design using Web3D technology, where images are processed via a computer vision camera imaging model, transformed, and analyzed with the SIFT algorithm to extract feature points. These are integrated with the incremental SFM algorithm for three-dimensional image reconstruction in immersive environments. We validate these methods with real datasets and controlled experiments to assess user experience improvements in digital media applications. Results indicate that the SIFT algorithm’s image-matching accuracy ranges from 50% to 78%, and the incremental SFM algorithm shows an average rotation error of only 0.183°. User sentiment scores improved significantly, from 11.583 to 23.452, post-experience, demonstrating enhanced realism and a new direction for digital media art.

Discussion on Efficacy Evaluation Methods of Nourishing Skin Care Products

Nourishing skin care products play a significant role in the beauty industry as they moisturize, repair, and protect the skin. This article explores various methods for evaluating the efficacy of nourishing skin care products, including clinical trials, chemical analysis, user experience, and professional assessment. By employing a combination of these evaluation methods, consumers and professionals can make informed decisions when selecting the most suitable skin care products. It is important to consider these evaluation methods to ensure the selection of the most appropriate products.

Exploring the context of use for voice user interfaces: Toward context‐dependent user experience quality testing

AbstractVoice user interface (VUI) systems, such as Alexa, Siri, and Google Assistant, are popular and widely available. Still, challenges such as privacy and the ability to have a dialog remain. In the latter example, the user expects a human‐like conversation, that is, that the VUI understands the dialog and its context. However, this VUI feature of context‐aware interaction is rather error prone. For this reason, we intend to explore the VUI context of use and its impact on interaction, that is, relevant user experience (UX). We see a demand for context‐dependent UX measurement because analyzing the context of use and UX assessment are both critical human‐centered design (HCD) methods. Therefore, we examine the VUI context of use by asking users about how, where, and for what they use VUIs, as well as their UX and improvement proposals. We interviewed people with disabilities who rely on VUIs and people without disabilities who use VUIs for convenience or fun. We identified VUI context‐of‐use categories and factors and explored their impacts on relevant UX qualities. Our result is a matrix containing these elements; thus, it provides an overview of the contextual UX of our target group's VUI interaction. We intend to develop a VUI context‐of‐use conceptual structure in the future based on this matrix, which is needed to create an automated context‐dependent UX measurement recommendation tool for VUIs. This conceptual structure could also be useful for automated UX testing in the context of VUI.

A pilot study comparing immersive virtual reality simulation and computerized virtual patient simulation in undergraduate medical education

Simulation-based teaching is an integral feature within medical education and following the emergence of virtual simulation, an array of possibilities exists for educators to choose between. However, evidence informing their use is scarce, particularly regarding outcomes assessing user experience and knowledge acquisition, and experimental studies comparing different approaches to virtual simulation. Therefore, this study compared immersive virtual reality (VR) simulation to computerized virtual patient (VP) simulation measuring their effect on knowledge acquisition and retention, as well as user experience, in fifth-year medical students. This pilot study, of a randomized crossover design, comprised 18 participants independently completing an immersive VR simulation and a computerized VP simulation. All participants completed the same two scenarios and received an induction to both modalities. Multiple-choice questions were employed to assess knowledge acquisition and retention, with participants completing the questions immediately before and after the simulation and following a 12-week interval. User experience questionnaires were completed after the simulation, utilizing both Likert scale and open-ended questions. Statistical analysis comprised a Student’s Both interventions achieved statistically significant levels of knowledge acquisition and retention. However, VR simulation achieved higher levels of acquisition (2.11; 95% CI = 0.89, 3.32, The findings indicated that both interventions are effective and acceptable educational tools. However, learning does not appear to be uniform across different virtual simulators, with participants achieving higher levels of learning following immersive VR simulation. Moreover, participants reacted significantly more positively to VR simulation, though potential applications were identified for both interventions. This study highlights the importance of an evidence-based approach to the implementation of novel simulation technologies. The findings contribute to an underexplored area of the literature and offer a step towards enabling medical educators to make an informed decision regarding the application of virtual simulation in their context.

Abstract 12421: Guided Advanced Cardiovascular Life Support Mobile App Improves Trainee Experience and Performance During Simulated Cardiac Arrest: A Randomized Controlled Trial

Introduction: Leading hospital code teams is stressful for resident physicians, and variability in training and experience may result in inconsistent care and outcomes. Nearly all bedside aids like AHA advanced cardiovascular life support (ACLS) pocket cards and third-party ACLS mobile apps lack step-by-step guidance or reminders. Our team designed a guided ACLS mobile app to help trainees lead more effective hospital resuscitations and conducted a randomized controlled trial to assess user experience and performance according to 2020 AHA ACLS guidelines. Hypothesis: A guided ACLS app will improve subjective user experience and adherence to AHA ACLS guidelines. Methods: The ACLS mobile app was developed using Swift UIKit. Internal Medicine, Emergency Medicine, Surgery, and Anesthesia residents (N = 46) were randomized to lead a simulated code for cardiac arrest due to massive pulmonary embolism using either AHA pockets cards (N = 22) or the ACLS app (N = 24). User experience was assessed via surveys. Code outcomes, guideline adherence, and errors were analyzed from video recordings. A focus group of 22 residents provided feedback. Statistical analysis was conducted using R software and included two-sided t-tests and Fisher exact tests. Results: App users showed significantly increased confidence (1.0 vs 0.3; p = 0.005), backboard use (96% vs 27%; p &lt;0.001), end-tidal CO2 monitoring (58% vs 27%; p = 0.042), correct thrombolytic administration (54% vs 23%; p = 0.035), and achieving return of spontaneous circulation (50% vs 18%; p = 0.032) compared to controls. Focus group results showed that 100% of the participants would use the app and that 82% preferred the guided app to AHA pocket cards. Conclusions: The guided app improves user confidence and adherence to AHA ACLS guidelines and addresses the need for greater standardization in hospital code management. Validation studies are necessary to confirm its effectiveness in clinical practice.

A Digital Mental Health Support Program for Depression and Anxiety in Populations With Attention-Deficit/Hyperactivity Disorder: Feasibility and Usability Study.

A total of 1 in 2 adults with attention-deficit/hyperactivity disorder (ADHD) struggles with major depressive or anxiety disorders. The co-occurrence of these disorders adds to the complexity of finding utility in as well as adherence to a treatment option. Digital therapeutic solutions may present a promising alternative treatment option that could mitigate these challenges and alleviate symptoms. This study aims to investigate (1) the feasibility and acceptance of a digital mental health intervention, (2) participants' engagement and retention levels, and (3) the potential efficacy with respect to anxiety and depression symptoms in a population with ADHD. Our main hypothesis was that a digital, data-driven, and personalized intervention for adults with coexisting ADHD and depressive or anxiety symptoms would show high engagement and adherence, which would be accompanied by a decrease in depressive and anxiety symptoms along with an increase in quality of life and life satisfaction levels. This real-world data, single-arm study included 30 adult participants with ADHD symptomatology and coexisting depressive or anxiety symptoms who joined a 16-week digital, data-driven mental health support program. This intervention is based on a combination of evidence-based approaches such as cognitive behavioral therapy, mindfulness, and positive psychology techniques. The targeted symptomatology was evaluated using the Patient Health Questionnaire-9, Generalized Anxiety Disorder-7, and Barkley Adult ADHD Rating Scale-IV. Quality of life aspects were evaluated using the Satisfaction With Life Scale and the Life Satisfaction Questionnaire, and user feedback surveys were used to assess user experience and acceptability. The study retention rate was 97% (29/30), and high engagement levels were observed, as depicted by the 69 minutes spent on the app per week, 5 emotion logs per week, and 11.5 mental health actions per week. An average decrease of 46.2% (P<.001; r=0.89) in depressive symptoms and 46.4% (P<.001; r=0.86) in anxiety symptoms was observed, with clinically significant improvement for more than half (17/30, 57% and 18/30, 60%, respectively) of the participants. This was followed by an average increase of 23% (P<.001; r=0.78) and 20% (P=.003; r=0.8) in Satisfaction With Life Scale and Life Satisfaction Questionnaire scores, respectively. The overall participant satisfaction level was 4.3 out of 5. The findings support the feasibility, acceptability, and value of the examined digital program for adults with ADHD symptomatology to address the coexisting depressive or anxiety symptoms. However, controlled trials with larger sample sizes and more diverse participant profiles are required to provide further evidence of clinical efficacy.

Evaluating and eliciting design requirements for an improved user experience in live-streaming commerce interfaces

Live-streaming commerce is emerging as a novel and interactive form of media commerce, allowing consumers to partake in live shows, purchase products, and engage with hosts in real time. Despite its substantial growth potential, there is a dearth of research on user interaction with live-streaming commerce in the context of user experience (UX). To comprehend user engagement with this technology and explore avenues for UX enhancement, we devised a three-stage user study. First, we conducted a UX assessment of leading live commerce platforms, employing both a self-report questionnaire and eye tracking. This enabled us to ascertain users' perceptions of user interface (UI) and live-streaming commerce components as well as identify the most user-friendly UI design. Second, we examined frequent users' experiences via online focus group interviews (FGIs). Through these, we observed that users employ chat and reaction features to convey empathy, enjoy themselves, or obtain rewards, ultimately driving sustained engagement and interaction with live-streaming commerce. Finally, we evaluated the visual effects designed to boost interactivity and pleasurable experiences through the development of a live-streaming commerce prototype. We determined that visual effects encompassing serendipitous elements augment users’ enjoyable experiences considerably during live-streaming commerce. Our findings provide valuable insights for practitioners aiming to refine live-streaming commerce interfaces and components to enhance UX.

The Factors Affecting User Experience Maturity in Free and Open Source Software Community: An Empirical Study

Assessing User eXperience (UX) maturity is mandatory in the free and open-source software (FOSS) community to avoid wasting resources on projects that may fall short of expectations. Best practices suggest employing UX Capability Maturity Models (UXCMMs), which often specify an evolutionary plateau toward developing a UX-matured system and quantify organizational UX maturity into maturity levels ranging from no or ad hoc improvement to integrated continuous improvement. Numerous generically developed UXCMMs exist. However, none is created for the FOSS community, and less information is available to support their perfect match. Thus, raise suspicions if they have proper UX maturity influencing factors (UXMIFs) for the FOSS community or measure the right thing. The FOSS community differs from traditional software-developing communities and may have different dynamics and UXMIFs, necessitating unique and new methodologies for their discovery. This study, therefore, aims to identify the FOSS community’s UXMIFs and evaluate the community’s knowledge of UX maturity-related concepts. Its findings may help future researchers, practitioners, and other FOSS developers to develop UXCMMs exclusive to the FOSS community. The study’s design is both qualitative and quantitative. It adopted a systematic literature review, interviews, fuzzy Delphi Method, and thematic analysis to collect and analyze data and present the findings. The study’s sample included sixty-two active FOSS projects, fifteen FOSS stakeholders, and twelve UX experts. The outcome shows that 84% of UX experts agreed on the thirty-six FOSS’s UXMIFs with threshold d = 0.143 and crisp values greater than α-cut = 0.5. User feedback and adopted technologies were ranked first, while learnability and use speed were ranked last. Similarly, FOSS stakeholders have shown a shared understanding of UX maturity, connected concepts, and impacting factors.

Satisfaction, Perceived Usefulness, and Therapeutic Alliance as Correlates of Participant Engagement in a Pediatric Digital Mental Health Intervention: Cross-Sectional Questionnaire Study.

Although evidence suggests that digital mental health interventions (DMHIs) are effective alternatives to traditional mental health care, participant engagement continues to be an issue, especially for pediatric DMHIs. Extant studies of DMHIs among adults suggest that participants' satisfaction, perceived usefulness, and therapeutic alliance are closely tied to engagement. However, these associations have not been investigated among children and adolescents involved in DMHIs. To address these gaps in extant DMHI research, the purpose of this study was to (1) develop and implement a measure to assess satisfaction, perceived usefulness, and therapeutic alliance among children and adolescents participating in a DMHI and (2) investigate satisfaction, perceived usefulness, and therapeutic alliance as correlates of children's and adolescents' engagement in the DMHI. Members (children and adolescents) of a pediatric DMHI who had completed at least one session with a care provider (eg, coach or therapist) were eligible for inclusion in the study. Adolescent members and caregivers of children completed a survey assessing satisfaction with service, perceived usefulness of care, and therapeutic alliance with care team members. This study provides evidence for the reliability and validity of an adolescent- and caregiver-reported user experience assessment in a pediatric DMHI. Moreover, our findings suggest that adolescents' and caregivers' satisfaction and perceived usefulness are salient correlates of youths' engagement with a DMHI. This study provides valuable preliminary evidence that caregivers' satisfaction and perceived usefulness are salient correlates of youths' engagement with a DMHI. Although further research is required, these findings offer preliminary evidence that caregivers play a critical role in effectively increasing engagement among children and adolescents involved in DMHIs.

Human-computer Interaction Based Music Emotion Visualization System and User Experience Assessment

Human-computer Interaction Based Music Emotion Visualization System and User Experience Assessment

Assessing User Experience and Usability in the OVO Application: Utilizing the User Experience Questionnaire and System Usability Scale for Evaluation

The OVO application, despite having a large user base in Indonesia, has received low ratings compared to other digital wallet apps on the Google Play Store and App Store. Users frequently complain about the user experience, which greatly affects their overall satisfaction. This study evaluates the user experience and usability of the OVO application using the User Experience Questionnaire (UEQ) and System Usability Scale (SUS). The UEQ results show that efficiency is excellent (1.55), while attractiveness, perspicuity, dependability, and stimulation are above average (1.56, 1.67, 1.33, and 1.16, respectively). However, the novelty aspect falls below average (0.64), indicating a need for improvement. The SUS score is 77.53, classifying the application as "Acceptable" with a "C" grade and an overall "Good" rating. Addressing identified shortcomings can enhance user experience and usability, ultimately improving user satisfaction. This study contributes valuable empirical data to the field, offering insights for researchers and practitioners in assessing the user experience and usability of mobile applications.

Assessment of User Experience, Satisfaction, and Quality of Life among Bone - Anchored Hearing Aid Users in Karnataka

Assessment of User Experience, Satisfaction, and Quality of Life among Bone - Anchored Hearing Aid Users in Karnataka