Conduct Usability Testing Research Articles

Internet-delivered emotional self-management program for the general population during the COVID-19 pandemic: Usability testing.

Internet-based self-help interventions have the potential to help people address their emotional needs at relatively low costs. However, if the system does not offer optimal functions, it could reduce end-user adherence and satisfaction with treatment and compromise the effectiveness of the program. This study evaluated the usability of an Internet-based self-help intervention for emotional self-management among the general population of Italy during the COVID-19 pandemic. A balanced sex-age sample of 10 individuals who met the inclusion criteria were consecutively recruited online. The think-aloud testing method, the system usability scale and an ad hoc semi-structured interview were used to determine the overall system usability.Quantitative data were analyzed using descriptive statistics and qualitative data were analyzed using thematic analysis. The participants were mostly satisfied with the usability of the program. However, older users (<45 years) encountered some problems, which took longer, made more mistakes, and needed more help in performing the tasks than their younger counterparts. The analysis of the interviews revealed three central themes: general thoughts about the platform, weaknesses of the platform and difficulties encountered while navigating and completing tasks, and strengths of the platform. Based on the results of this study, important improvements will be made before the RinasciMENTE program is tested under real-world conditions. Conducting usability testing is a crucial step at an early stage of the development process of an Internet-based self-help intervention to identify potential usability problems with the system.

ATM 사용자 리서치를 통한 사용성 개선을 위한 연구

With the development of information and communication technology, the use of smart banking, a non-face-to-face financial business processing system, is expanding. However, the elderly who have difficulty using smart devices or users who have anxiety about using online banking visit the bank in person, make deposits and withdrawals through employees, or solve banking business by using ATMs. In this way, it aims to present interface guidelines for useful ATMs that can appropriately use cash and electronic payment methods according to the situation. This study conducted usability tests, SUS evaluations, and interviews to analyze the usability of existing ATMs, and produced a prototype by improving the interface through the usability analysis results of existing ATMs and expert advice. Significance tests were conducted through a prototype with an improved interface, and final guidelines were presented through this. The ATM interface guidelines derived through this study are expected to help minimize confusion experienced by various users when using ATMs.

Improvement of marketing tools for ensuring the development of the innovative potential of aviation enterprises

The aim of the article. The purpose of the study is to improve the marketing toolkit for ensuring the development of the innovative potential of aviation enterprises. The results of the analyses. It has been established that traditional marketing is no longer sufficient to target the modern consumer, as his needs and requests are changeable, flexible, shaped by the influence of the global competitive environment in the air transportation market. Analysis of consumer behavior and permanent communication between airlines and customers is an indispensable attribute of marketing activities. The improvement of marketing tools for ensuring the development of the innovative potential of airlines emphasizes the need to increase the volume of initial marketing data for the formation of innovative policies, the collection, processing and interpretation of which is impossible without digital marketing tools based on artificial intelligence and machine learning in real time. Adaptation of products and services of air carriers to new market demands in conditions of quite strong competition requires the introduction of progressive marketing tools and technologies, which includes Growth-Hacking. At the stages of development of an innovative offer, Growth-Hacking is aimed at conducting experiments to find the correspondence between new market value and consumer needs. At this transition of a product innovation from concept to marketing and sales, Growth-Hacking tools intersect with adaptive marketing tools in targeting the airline's efforts to attract customers by meeting their needs. If adaptive marketing at this stage operates with general tools for assessing the target audience, strengthening customer relationships, developing a competitive advantage strategy, then Growth-Hacking is aimed at experimental conversion testing through chatbot tools, gamification, conducting usability tests with customers, customer surveys, analysis of customer reviews, use of heat maps. Collecting data and feedback from real customers at this stage helps inform experimentation to find an innovative solution. The creation of a comprehensive system of marketing tools to ensure the development of innovative potential is of crucial importance for the airline's competitiveness, allowing to offer customers more innovative and improved products and services relevant to their needs. Conclusions and direction for further research. The marketing toolkit for ensuring the development of the innovative potential of airlines has been improved, which is proposed to be formed on the basis of the synthesis of digital marketing, adaptive marketing and Growth-Hacking-marketing. The proposed approach covers all stages of the innovation process with marketing tools, starting from the generation of an innovative idea to the implementation of innovative products and services of airlines, therefore its implementation into a functional model of the development of innovative potential is rational. The advantage of the author's vision is the scientifically based marketing tools proposal of the relevance of the innovative idea to the needs and requests of consumers (adaptive marketing based on big data), its quick and cost-effective implementation (Growth-Hacking approach). With the perspective of further research, it is expedient to determine the justification of approaches to the strategic focus of the marketing concept on the development of the innovative potential of aviation enterprises.

Engaging patient-family dyads to inform the development of a digital health intervention to support cancer caregivers.

221 Background: Shifts in cancer care from hospital to home have increased the burden on family caregivers of individuals with cancer. Cancer caregiving is demanding and associated with declines in caregivers’ physical and psychological well-being. Digital health interventions may improve caregiver well-being by supporting them to monitor patient symptoms, access social support, and communicate with patients’ care team members. Despite benefits to quality care, few digital health interventions have been developed or implemented to support cancer caregivers. The purpose of this study was to develop a web-based intervention (myCare2) focused on supporting caregivers and caregiver well-being. Methods: This multi-method study followed a user-centered design. Participants were recruited from two clinics within one NCI-designated cancer center. We conducted three focus groups with patients with hematologic or gastrointestinal cancers and their caregivers to identify needs and preferences and guide intervention development. Next, we developed a wireframe prototype of myCare2. We iteratively refined the prototype in response to feedback obtained in cognitive interviews with patient-caregiver dyads. Lastly, we built a functioning web-based prototype and conducted user tests with dyads. Focus groups, cognitive interviews, and user tests were audio recorded, transcribed, and analyzed using conventional content analysis. Results: Eight dyads participated in three focus groups. Caregivers reported feeling unprepared and viewed themselves as “head of logistics” for the patient. Caregivers expressed the desire for a tool to help them organize caregiver responsibilities, including medication management, daily schedules and appointments, symptom monitoring, nursing and medical tasks, self-care, and communication with clinicians and support networks. In cognitive interviews, four dyads reviewed and provided positive feedback on the wireframe prototype features that allow the caregiver to schedule tasks; report patient and caregiver concerns; track patient symptoms and medications; ask family and friends for support; share updates with support networks; and find local resources, classes, and events. Five dyads tested myCare2, providing positive and constructive feedback about the intervention layout and functionality. Conclusions: Growing evidence suggests digital health interventions can benefit caregivers managing cancer care at home. The myCare2 intervention is a web-based tool based on caregiver and patient feedback that was found helpful and acceptable. Future research should evaluate the feasibility of myCare2, measure its effects on caregiver and patient outcomes, and identify optimal implementation strategies for use in practice.

Redesigning Research Guides

At the University of Memphis, a team of librarians and library staff formed the Research Guides Redesign Team (RGRT) to redesign, organize, and evaluate the University Libraries’ (UL) research guides. The purpose of the project was to ensure that the new design of the research guides homepage was intuitive to use. While it is impossible to ensure absolute usability for every user, this usability study attempts to eradicate the most common interface issues in community experiences at the University of Memphis. The RGRT conducted usability testing to evaluate the effectiveness of the new standardized format, grouped headings, and the appearance of the interface. The RGRT worked within the limitations of Springshare’s software to create the design and then chose five users to complete various task scenarios. Upon analysis of the users’ ability to complete the tasks, the RGRT discovered that overall, the design was effective, but they did make a few minor changes. This study describes the process and includes the original design, the new design, edits made after usability testing was conducted, and plans for future testing.

The dementia-inclusive choices in exercise project: Using participatory action research to improve physical activity supports for persons with dementia.

Persons with dementia have the right to equal inclusion in rehabilitation, including physical activity. However, the perspectives of persons with dementia are rarely integrated into decision-making related to physical activity programming, services, and supports. Here, we describe the participatory action research (PAR) approach used to develop the Dementia-Inclusive Choices for Exercise (DICE) toolkit, which aims to increase the quality and number of physical activity opportunities available to persons with dementia. The DICE Research Team included persons with dementia, a family care partner, exercise professionals, community and dementia service providers, health care professionals, and researchers who worked to: 1) Engage/maintain the Research Team; 2) Set/navigate ways of engagement; 3) Understand barriers to physical activity; 4) Prioritize the audience and actions; 5) Develop the toolkit; 6) Conduct usability testing; and 7) Implement and evaluate. Guided by the Behaviour Change Wheel, and informed by interviews, focus groups, and existing research, our PAR Team chose to prioritize training exercise providers; exercise providers can enable exercise for persons with dementia if they understand common changes with dementia and how to support persons with dementia in exercise. The content and format of the toolkit was co-developed: drafted by our Research Team, adapted through a stakeholder workshop, and refined through iterative development and usability testing. The product of our PAR process, the DICE toolkit, includes videos meant to destigmatize dementia, training modules and a training manual for exercise providers, a physical activity handout for persons with dementia, and wallet cards to help persons with dementia communicate their abilities, needs, and preferences. Our usability study indicated that the toolkit could be used by exercise providers and may improve attitudes about dementia. Our vision is that our co-developed DICE toolkit will empower exercise providers to improve physical activity opportunities and support for persons with dementia.

User and Usability Testing of a Web-Based Genetics Education Tool for Parkinson Disease: Mixed Methods Study.

Genetic testing is essential to identify research participants for clinical trials enrolling people with Parkinson disease (PD) carrying a variant in the glucocerebrosidase (GBA) or leucine-rich repeat kinase 2 (LRRK2) genes. The limited availability of professionals trained in neurogenetics or genetic counseling is a major barrier to increased testing. Telehealth solutions to increase access to genetics education can help address issues around counselor availability and offer options to patients and family members. As an alternative to pretest genetic counseling, we developed a web-based genetics education tool focused on GBA and LRRK2 testing for PD called the Interactive Multimedia Approach to Genetic Counseling to Inform and Educate in Parkinson's Disease (IMAGINE-PD) and conducted user testing and usability testing. The objective was to conduct user and usability testing to obtain stakeholder feedback to improve IMAGINE-PD. Genetic counselors and PD and neurogenetics subject matter experts developed content for IMAGINE-PD specifically focused on GBA and LRRK2 genetic testing. Structured interviews were conducted with 11 movement disorder specialists and 13 patients with PD to evaluate the content of IMAGINE-PD in user testing and with 12 patients with PD to evaluate the usability of a high-fidelity prototype according to the US Department of Health and Human Services Research-Based Web Design & Usability Guidelines. Qualitative data analysis informed changes to create a final version of IMAGINE-PD. Qualitative data were reviewed by 3 evaluators. Themes were identified from feedback data of movement disorder specialists and patients with PD in user testing in 3 areas: content such as the topics covered, function such as website navigation, and appearance such as pictures and colors. Similarly, qualitative analysis of usability testing feedback identified additional themes in these 3 areas. Key points of feedback were determined by consensus among reviewers considering the importance of the comment and the frequency of similar comments. Refinements were made to IMAGINE-PD based on consensus recommendations by evaluators within each theme at both user testing and usability testing phases to create a final version of IMAGINE-PD. User testing for content review and usability testing have informed refinements to IMAGINE-PD to develop this focused, genetics education tool for GBA and LRRK2 testing. Comparison of this stakeholder-informed intervention to standard telegenetic counseling approaches is ongoing.

Development and Initial Evaluation of Web-Based Cognitive Behavioral Therapy for Insomnia in Rural Family Caregivers of People With Dementia (NiteCAPP): Mixed Methods Study.

Informal caregivers of people with dementia frequently experience chronic insomnia, contributing to stress and poor health outcomes. Rural caregivers are particularly vulnerable but have limited access to cognitive behavioral therapy for insomnia (CBT-I), a recommended frontline treatment for chronic insomnia. Web-based delivery promises to improve insomnia, particularly for rural caregivers who have limited access to traditional in-person treatments. Our team translated an efficacious 4-session standard CBT-I content protocol into digital format to create NiteCAPP. This study aimed to (1) adapt NiteCAPP for dementia caregivers to create NiteCAPP CARES, a tailored digital format with standard CBT-I content plus caregiver-focused modifications; (2) conduct usability testing and evaluate acceptability of NiteCAPP CARES' content and features; and (3) pilot-test the adapted intervention to evaluate feasibility and preliminary effects on sleep and related health outcomes. We followed Medical Research Council recommendations for evaluating complex medical interventions to explore user needs and adapt and validate content using a stepwise approach: (1) a rural dementia caregiver (n=5) and primary care provider (n=5) advisory panel gave feedback that was used to adapt NiteCAPP; (2) caregiver (n=5) and primary care provider (n=7) focus groups reviewed the newly adapted NiteCAPP CARES and provided feedback that guided further adaptations; and (3) NiteCAPP CARES was pilot-tested in caregivers (n=5) for feasibility and to establish preliminary effects. Self-report usability measures were collected following intervention. Before and after treatment, 14 daily electronic sleep diaries and questionnaires were collected to evaluate arousal, health, mood, burden, subjective cognition, and interpersonal processes. The stepped approach provided user and expert feedback on satisfaction, usefulness, and content, resulting in a new digital CBT-I tailored for rural dementia caregivers: NiteCAPP CARES. The advisory panel recommended streamlining content, eliminating jargon, and including caregiver-focused content. Focus groups gave NiteCAPP CARES high usefulness ratings (mean score 4.4, SD 0.79, scored from 1=least to 5=most favorable; score range 4.2-4.8). Multiple features were evaluated positively, including the intervention's comprehensive and engaging information, caregiver focus, good layout, easy-to-access intervention material, and easy-to-understand sleep graphs. Suggestions for improvement included the provision of day and night viewing options, collapsible text, font size options, tabbed access to videos, and a glossary of terms. Pilot-test users rated usefulness (mean score 4.3, SD 0.83; range 4.1-4.5) and satisfaction (mean score 8.4, SD 1.41, scored from 1=least to 10=most satisfied; range 7.4-9.0) highly. Preliminary effects on caregiver sleep, arousal, health, mood, burden, cognition, and interpersonal processes (all P<.05) were promising. Adaptations made to standard digital CBT-I created a feasible, tailored digital intervention for rural dementia caregivers. Important next steps include further examination of feasibility and efficacy in a randomized controlled trial with an active control condition, a multisite effectiveness trial, and eventual broad dissemination. ClinicalTrials.gov NCT04632628; https://clinicaltrials.gov/ct2/show/NCT04632628.

Usability Analysis of Digital-Based Agricultural Product Marketing Platform at Farmers Level in Region V, Bogor Regency

Purpose: This study examines the usability of a digital platform called Kiosagri.com. This study needs to carry out as one of the solutions to overcome the limited accessibility of agricultural product promotion through the use of a digital platform that is expected to have usability. Therefore, this study aims to analyze the usability of digital-based agricultural product marketing platforms at the farmer level in Region V of Bogor Regency.Methods: This research employed a mixed method with an explanatory sequential design. The intended audience for the census of respondents was farmers who had utilized the Kiosagri.com platform. Data analysis was done on 32 respondents during the quantitative phase using descriptive statistics. Ten respondents were chosen purposefully for descriptive qualitative analysis during the qualitative phase.Results: According to the results, the Kiosagri platform is very user-friendly. It is achieved as a result of several beneficial aspects connected to the benefits perceived by users, such as ease of use, suitability of design, and features offered by Kiosagri.Novelty: In this study, a different way to measure the usability of digital platforms for agricultural products marketing is applied, namely by using the explanatory sequential design by conducting usability testing using descriptive statistics through the use of questionnaires and explaining the results further using descriptive qualitative through in-depth interviews which both methods are suitable for testing user experience and usability in the agricultural sector. The results of this study will be useful for the government in implementing digital marketing of agricultural products.

Applying User-Centered Design and Implementation Science to the Early-Stage Development of a Telehealth-Enhanced Hybrid Cardiac Rehabilitation Program: Quality Improvement Study.

Cardiac rehabilitation (CR) is an evidence-based intervention that improves event-free survival in patients with cardiac conditions, yet <27% of all eligible patients use CR in the United States. CR is traditionally delivered in clinic-based settings where implementation barriers abound. Innovative nontraditional program designs and strategies are needed to support widespread CR uptake. This study aimed to demonstrate how user-centered design (UCD) and implementation science (IS) principles and methods can be integrated into the early-stage development of nontraditional CR interventions. As part of a NewYork-Presbyterian Hospital (NYPH) quality improvement initiative (March 2020-February 2022), we combined UCD and IS principles and methods to design a novel home- and clinic-based telehealth-enhanced hybrid CR (THCR) program. We co-designed this program with multilevel stakeholders using an iterative 3-step UCD process to identify user and contextual barriers and facilitators to CR uptake (using semistructured interviews and contextual inquiry [step 1]), design an intervention prototype that targets contextual and user factors and emulates the evidence-based practice (through design workshops and journey mapping [step 2]), and review and refine the prototype (according to real-world usability testing and feedback [step 3]). The UCD process was informed by the Theoretical Domains Framework and Consolidated Framework for Implementation Research. At step 1, we conducted semistructured interviews with 9 provider- and system-level stakeholders (female: n=6, 67%) at 3 geographically diverse academic medical centers, which revealed behavioral (eg, self-efficacy and knowledge) and contextual (eg, social distancing guidelines, physical space, staffing, and reimbursement) barriers to uptake; hybrid delivery was a key facilitator. Step 2 involved conducting 20 design workshops and 3 journey-mapping sessions with multidisciplinary NYPH stakeholders (eg, digital health team, CR clinicians, and creative director) where we identified key design elements (eg, mix of clinic- and home-based CR and synchronous remote patient monitoring), yielding an initial THCR prototype that leveraged NYPH's telehealth infrastructure. At step 3, we conducted usability testing with 2 CR clinicians (both female) administering home-based sessions to 3 CR patients (female: n=1, 33%), which revealed usability themes (eg, ease of using remote patient monitoring devices or a telehealth platform, technology disruptions, and confidence in using the telehealth platform to safely monitor patients) and design solutions (eg, onboarding sessions, safety surveys, and fully supervised remote sessions) to be included in the final THCR prototype. Combining UCD and IS methods while engaging multidisciplinary stakeholders in an iterative process yielded a theory-informed THCR program targeting user and contextual barriers to real-world CR implementation. We provide a detailed summary of the process and guidance for incorporating UCD and IS principles and methods into the early-stage development of a nontraditional CR intervention. The feasibility, acceptability, appropriateness, and usability of the final THCR prototype is being evaluated in an ongoing study.

SISTEM INFORMASI PENGUKURAN MATRIKS ISO USABILITY TESTING BERBASIS WEB: STUDI KASUS SHOPEE

The manual metric measurement is time-consuming due to the large number of users and test criteria. Additionally, not all tester is able to complete all metrics measurement correctly in time. Software testers can process and analyze test data much more easily when using information systems in conducting usability testing. The purposes of this study is to develop a web-based information system of ISO metrics measurement and conducting usability tests on the Shopee application with 10 users. The level of usability of the Shopee application is highly dependent on measuring user happiness with the application. Usability testing matrics measurements are based on ISO measures that include effectiveness, efficiency, and satisfaction. The system is feasible to use and runs normally, according to the calculation results interpreted based on the Likert Scale, which came to 66.924%. However, there are still many users who do not understand how to use the features. It’s expected that this research will help sotware tester to improve the quality in conducting usability testing as well as provide feedbacks from the user in order to elevate the ease of use of the application.&#x0D; &#x0D;

System Development and Evaluation of Human–Computer Interaction Approach for Assessing Functional Impairment for People with Mild Cognitive Impairment: A Pilot Study

Non-pharmacological treatments have gained significant attention in the field of cognitive impairment. Among them, human–computer interaction-based (HCI) methods have emerged as a promising approach due to their broad applicability and convenience in assessing symptoms associated with this progressively debilitating condition. However, existing rehabilitation training systems for cognitive impairment lack effective assessment methods to meet the diverse rehabilitation needs of users. In this article, we surveyed existing HCI-based cognitive rehabilitation training systems and analyzed their advantages and shortcomings. Drawing from the insights gained from these systems, we propose a novel Leap Motion-based building block training system that incorporates system software capable of generating highly realistic virtual scenes, with the added capability of user behavior detection using Kinect. We conducted user testing of this new system, comparing the performance of a representative cohort with mild cognitive impairment (MCI) (n = 9) to that of disease-free participants (n = 10). Additionally, we conducted ergonomic experiments to assess the system’s performance in elderly people. The experimental results revealed significant differences between the MCI cohort and the control cohort. Specifically, the MCI cohort exhibited a reduced range of motion and longer task completion times compared to the control cohort. These findings have the potential to contribute to the differentiation of cognitive levels. In conclusion, our analysis of existing cognitive rehabilitation training systems provides valuable insights for researchers working on the development of future innovative cognitive rehabilitation training systems and enriches the non-pharmacological treatment models for cognitive impairment. Furthermore, the observed relationship between behavioral data, task completion times, and cognitive levels in older adults offers useful insights for the design of HCI-based approaches for diagnosing and assessing the treatment of MCI.

Development of Web-Based Education Modules to Improve Carer Engagement in Cancer Care: Design and User Experience Evaluation of the e-Triadic Oncology (eTRIO) Modules for Clinicians, Patients, and Carers.

Carers often assume key roles in cancer care. However, many carers report feeling disempowered and ill-equipped to support patients. Our group published evidence-based guidelines (the Triadic Oncology [TRIO] Guidelines) to improve oncology clinician engagement with carers and the management of challenging situations involving carers. To facilitate implementation of the TRIO Guidelines in clinical practice, we aimed to develop, iteratively refine, and conduct user testing of a suite of evidence-based and interactive web-based education modules for oncology clinicians (e-Triadic Oncology [eTRIO]), patients with cancer, and carers (eTRIO for Patients and Carers [eTRIO-pc]). These were designed to improve carer involvement, communication, and shared decision-making in the cancer management setting. The eTRIO education modules were based on extensive research, including systematic reviews, qualitative interviews, and consultation analyses. Guided by the person-based approach, module content and design were reviewed by an expert advisory group comprising academic and clinical experts (n=13) and consumers (n=5); content and design were continuously and iteratively refined. User experience testing (including "think-aloud" interviews and administration of the System Usability Scale [SUS]) of the modules was completed by additional clinicians (n=5), patients (n=3), and carers (n=3). The final clinician module comprises 14 sections, requires approximately 1.5 to 2 hours to complete, and covers topics such as carer-inclusive communication and practices; supporting carer needs; and managing carer dominance, anger, and conflicting patient-carer wishes. The usability of the module was rated by 5 clinicians, with a mean SUS score of 75 (SD 5.3), which is interpreted as good. Clinicians often desired information in a concise format, divided into small "snackable" sections that could be easily recommenced if they were interrupted. The carer module features 11 sections; requires approximately 1.5 hours to complete; and includes topics such as the importance of carers, carer roles during consultations, and advocating for the patient. The patient module is an adaptation of the relevant carer module sections, comprising 7 sections and requiring 1 hour to complete. The average SUS score as rated by 6 patients and carers was 78 (SD 16.2), which is interpreted as good. Interactive activities, clinical vignette videos, and reflective learning exercises are incorporated into all modules. Patient and carer consumer advisers advocated for empathetic content and tone throughout their modules, with an easy-to-read and navigable module interface. The eTRIO suite of modules were rigorously developed using a person-based design methodology to meet the unique information needs and learning requirements of clinicians, patients, and carers, with the goal of improving effective and supportive carer involvement in cancer consultations and cancer care.

Adapting a Telephone-Based, Dyadic Self-management Program to Be Delivered Over the Web: Methodology and Usability Testing.

The COVID-19 pandemic has amplified the need for web-based behavioral interventions to support individuals who are diagnosed with chronic conditions and their informal caregivers. However, most interventions focus on patient outcomes. Dyadic technology-enabled interventions that simultaneously improve outcomes for patients and caregivers are needed. This study aimed to describe the methodology used to adapt a telephone-based, facilitated, and dyadic self-management program called Self-care Using Collaborative Coping Enhancement in Diseases (SUCCEED) into a self-guided, web-based version (web-SUCCEED) and to conduct usability testing for web-SUCCEED. We developed web-SUCCEED in 6 steps: ideation-determine the intervention content areas; prototyping-develop the wireframes, illustrating the look and feel of the website; prototype refinement via feedback from focus groups; finalizing the module content; programming web-SUCCEED; and usability testing. A diverse team of stakeholders including content experts, web designers, patients, and caregivers provided input at various stages of development. Costs, including full-time equivalent employee, were summarized. At the ideation stage, we determined the content of web-SUCCEED based on feedback from the program's original pilot study. At the prototyping stage, the principal investigator and web designers iteratively developed prototypes that included inclusive design elements (eg, large font size). Feedback about these prototypes was elicited through 2 focus groups of veterans with chronic conditions (n=13). Rapid thematic analysis identified two themes: (1) web-based interventions can be useful for many but should include ways to connect with other users and (2) prototypes were sufficient to elicit feedback about the esthetics, but a live website allowing for continual feedback and updating would be better. Focus group feedback was incorporated into building a functional website. In parallel, the content experts worked in small groups to adapt SUCCEED's content, so that it could be delivered in a didactic, self-guided format. Usability testing was completed by veterans (8/16, 50%) and caregivers (8/16, 50%). Veterans and caregivers gave web-SUCCEED high usability scores, noting that it was easy to understand, easy to use, and not overly burdensome. Notable negative feedback included "slightly agreeing" that the site was confusing and awkward. All veterans (8/8, 100%) agreed that they would choose this type of program in the future to access an intervention that aims to improve their health. Developing and maintaining the software and hosting together cost approximately US $100,000, excluding salary and fringe benefits for project personnel (steps 1-3: US $25,000; steps 4-6: US $75,000). Adapting an existing, facilitated self-management support program for delivery via the web is feasible, and such programs can remotely deliver content. Input from a multidisciplinary team of experts and stakeholders can ensure the program's success. Those interested in adapting programs should have a realistic estimate of the budget and staffing requirements.

“Micro World – Exploring the Microbial Kingdom”: design and testing of a microbial VR science product

ABSTRACT We designed a microbial science popularization product based on virtual reality technology, “Micro World – Exploring the Microbial Kingdom,” and conducted usability tests. Participants used head-mounted VR glasses to experience virtual scenarios teaching microbiological knowledge. The product’s user experience was evaluated through a User Experience Questionnaire (UEQ), and the results showed that our product provided both usefulness and enjoyment. In addition, the quality of participants’ relevant knowledge acquisition was measured using the Student Education of Educational Quality (SEEQ). The SEEQ results show that “Micro World” is an effective tool for popularizing microbiology science and can actively promote students’ independent learning and improve learning quality.

Electroencephalogram as a Validation Method in Usability Testing

Usability testing is a recommended main testing method to evaluate the usability or ease of use of a software. However, this approach can induce bias. Usability testing with survey method using questionnaire instruments and interview has a risk of generating lack of objectivity from the participants because the facilitator can influence the evaluation results. The evaluation process is not optimal and the biases that arise from usability testing can affect the success or failure of a software in the market. A method for validating usability testing results needs to be studied to ensure whether the test results obtained are valid and unbiased. Electroencephalogram (EEG) is one of the tool that can be used to validate usability testing. This study aims to conduct usability testing of the three most popular e-marketplace applications in Indonesia. From the results it can be seen that usability testing using user-based testing gives a fairly good result in term of accuracy. Usability testing using EEG gives lower results than user-based testing. Nevertheless, we cannot rule out EEG as a usability testing method in the future.

The Development of a Hypertension Prevention and Financial-Incentive mHealth Program Using a "No-Code" Mobile App Builder: Development and Usability Study.

Regular physical activity (PA) is a key lifestyle component for hypertension prevention. Previous studies have shown that mobile health (mHealth) apps can be an effective tool for improving PA behaviors. However, adherence to and poor engagement with these apps is a challenge. A potential solution to overcome this challenge may be to combine financial incentives with innovative behavior theory, such as the Multiprocess Action Control (M-PAC) framework. Currently, there is a lack of PA financial incentive-driven M-PAC mHealth programs aimed at hypertension prevention. We aimed to describe the process of developing an 8-week mHealth PA and financial-incentive hypertension education program (Healthy Hearts) and to evaluate usability of the Healthy Hearts program. The first 2 stages of the Integrate, Design, Assess, and Share framework were used to guide the development of the Healthy Hearts program. The development process consisted of 2 phases. In phase 1, the research team met to discuss implementing the M-PAC framework to adopt an existing web-based hypertension prevention program to a mobile app. The app was developed using a no-code app development platform, Pathverse (Pathverse Inc), to help decrease overall development time. In phase 2, we created a prototype and conducted usability testing to evaluate lesson 1 of the Healthy Hearts program to further enhance the user experience. We used semistructured interviews and the mHealth App Usability Questionnaire to evaluate program acceptability and usability. Intervention development among the research team successfully created an 8-week financial-incentive hypertension education program for adults aged 40-65 years who did not currently meet the Canadian Physical Activity Guidelines (<150 minutes of moderate to vigorous PA per week). This program lasted 8 weeks and comprised 25 lessons guided by the M-PAC framework. The program used various behavior change techniques to further support PA adherence. Usability testing of the first lesson was successful, with 6 participants recruited for 2 rounds of testing. Feedback was gathered to enhance the content, layout, and design of the Healthy Hearts program to prepare the mHealth program for feasibility testing. Results of round 1 of usability testing suggested that the content delivered in the lessons was long. Therefore, the content was divided into multiple lessons before round 2 of usability testing, where feedback was only on design preferences. A minimum viable product was created with these results. The iterative development process and the usability assessments suggested by the Integrate, Design, Assess, and Share framework enabled participants to provide valuable feedback on the content, design, and layout of the program before advancing to feasibility testing. Furthermore, the use of the "no-code" app development tool enabled our team to rapidly make changes to the app based on user feedback during the iterative design process.

The Best RX is Better UX: Redesigning, Migrating, and Usability Testing a Hospital Library Website

ABSTRACT The John S. Marietta Library team provides onsite services as part of a collaborative agreement between the UNT Health Science Center and JPS Health Network. The team was tasked with migrating the hospital library website to a new content management system (CMS) in Summer 2021. The migration project provided an opportunity to reimagine the look and feel of the website and conduct usability testing to improve user experience (UX). Conducting thorough usability testing with a diverse group of clinicians and staff provided valuable insights regarding the search behavior and needs of this unique patron population.

Proxy Users for Usability Testing of Medical Devices for Use in Sub-Saharan Africa

Medical device implementation in global health requires careful considerations around usability and the use of proxy user groups. Working with appropriate proxy users can address the cost burden of conducting international studies with target users. This study evaluated whether proxy users are a practical substitution for conducting usability testing on devices for implementation in low-resource international settings. Identical usability studies were conducted with 18 clinicians from Blantyre, Malawi, and a carefully selected proxy group of 13 clinicians from Houston, Texas, U.S.A., across seven newborn-focused medical devices. Task success rate, System Usability Scale (SUS) scores, and NASA-Task Load (NASA TLX) scores from the two groups were compared. No significant differences were found between groups other than NASA-TLX temporal demand sub-scale, showing it is possible to use a carefully selected proxy group for usability evaluation in international settings. However, there was no consistent agreement between the groups on a task level, indicating that proxy groups should be used with an abundance of caution. Studies with target users must be additionally conducted to confirm results. Further work needs to be done with a larger sample size to test the viability of a proxy group for international studies on medical devices.

Usability Analysis of MSME Business Accounting Applications Based on User Retention Using ISO 9241-11

BukuWarung has been known as a MSME’s bookkeeping application in Indonesia. As the features developed, there were disappointed responses from Playstore reviews, social media, and research interviews who complained about the usability aspect of this application, thus triggering the desire for users to stop using the application. This condition motivates the author to assess the impact level of usability in aspects of Effectiveness, Efficiency, and Satisfaction on user retention. This study used a partial least square–structural equation model method. The total of 248 user samples was obtained using simple random sampling and voluntary response techniques. The research uses CSUQ, as well as questions for user retention. For data testing used Ms. Excel and SmartPLS version 3.3.3. According to the measurement model, 7 of 22 all variables were deleted. This study proves that Effectiveness, Efficiency, and Satisfaction have a positive and significant effect of up to 74.8% on user retention. However, the size of influence and relative influence is weak on user retention. User retention indicators affected by usability are increasing purchases as tenure grows, customer referrals, and premium prices. The implication for BukuWarung is to conduct usability testing on each feature.