Mean System Usability Scale Score Research Articles

Design and usability evaluation of a mobile app for elementary school inquiry‐based science learning

AbstractTeachers often struggle to implement inquiry‐based science teaching. To support them, IndagApp—a 3D educational app that offers curriculum‐aligned, inquiry‐based lesson plans—was designed. The app is rooted in the inquiry phases recommended in best‐practices literature, which arguably align with most international standards. This study describes IndagApp and evaluates its usability with fifth‐graders from two elementary schools in Spain (N = 43). The system usability scale (SUS) and the Pictorial‐SUS were used to collect students' feedback on usability. Both frequentist and Bayesian analyses were conducted to compare the mean SUS score with established benchmarks for usability. The results showed that IndagApp had high usability ratings, with most students rating it as the “Best imaginable” or “Good.” The mean SUS score was 84.816, which was significantly higher than the benchmark score of 68. There were no differences in usability between girls and boys, and students in private and public schools. These findings suggest that IndagApp is a valuable resource for inquiry learning in elementary grades and has significant implications for science education and science teacher professional development, as it helps teachers adopt reform‐oriented teaching practices that align with the curricular standards and goals.

Design and rationale of an interactive serious game to teach Basic Life Support among schoolchildren in Brazil.

Cardiovascular diseases are leading causes of death and morbidity worldwide. CPR and early defibrillation significantly enhance survival rates. Serious Games (SG) improve learning through entertainment. Current strategies target Cardiopulmonary resuscitation for communities and schoolchildren, but none have been validated for children in low-to-middle-income settings. The SG Children Save Hearts, developed in Brazil, teaches the five resuscitation steps according to International Liaison Committee on Resuscitation 2020 guidelines and requires formal usability assessment. The study aimed to evaluate the usability of SG Children Save Hearts among IT and healthcare professionals using the System Usability Scale (SUS). The usability test was conducted in August 2022 in the university's IT department. The game was developed targeting schoolchildren aged 7 to 17. Categorical variables as absolute and relative frequencies, while continuous variables were presented as median with interquartile range (IQR). Normality was assessed using the Shapiro-Wilk test. Comparisons between IT and healthcare professionals were made using the independent t-test for normal distributions or the Mann-Whitney U test for non-normal distributions. We included 17 volunteers with a mean age of 22 years (IQR 20-26). All participants played the game and completed a 10-question survey on its usability using a Likert-type scale. The final grade was converted to a 0 to 100 scale, with a grade above 70 considered acceptable for a minimum viable product. The mean SUS score was 75 (IQR 72.5-87.5). Healthcare professionals gave higher grades to all five domains compared to IT professionals. The average time spent playing the game was 3.2 minutes. Novel technologies have shown promising results for CPR teaching using active teaching methods, but face challenges in developing countries, such as language barriers, device acquisition, cultural differences, and technical support. To our knowledge, this is the first SG developed in portuguese for brazilian schoolchidren. Despite some usability issues, the SG Children Save Hearts is considered adequate for teaching CPR to schoolchildren in Brazil.

Usability and Preliminary Efficacy of an Adaptive Supportive Care System for Patients With Cancer: Pilot Randomized Controlled Trial.

Using an iterative user-centered design process, our team developed a patient-centered adaptive supportive care system, PatientCareAnywhere, that provides comprehensive biopsychosocial screening and supportive cancer care to patients across the continuum of care adaptively. The overarching goal of PatientCareAnywhere is to improve health-related quality of life (HRQOL) and self-efficacy of patients with cancer by empowering them with self-management skills and bringing cancer care support directly to them at home. Such support is adaptive to the patient's needs and health status and coordinated across multiple sources in the forms of referrals, education, engagement of community resources, and secure social communication. This study aims to assess the usability of the new web-based PatientCareAnywhere system and examine the preliminary efficacy of PatientCareAnywhere to improve patient-reported outcomes compared with usual care. For phase 1, usability testing participants included patients with cancer (n=4) and caregivers (n=7) who evaluated the software prototype and provided qualitative (eg, interviews) and quantitative (eg, System Usability Scale) feedback. For phase 2, participants in the 3-month pilot randomized controlled trial were randomized to receive the PatientCareAnywhere intervention (n=36) or usual care control condition (n=36). HRQOL and cancer-relevant self-efficacy were assessed at baseline (preintervention assessment) and 12 weeks from baseline (postintervention assessment); mean differences between pre- and postintervention scores were compared between the 2 groups. Participants were highly satisfied with the prototype and reported above-average acceptable usability, with a mean System Usability Scale score of 84.09 (SD 10.02). Qualitative data supported the overall usability and perceived usefulness of the intervention, with a few design features (eg, "help request" function) added based on participant feedback. With regard to the randomized controlled trial, patients in the intervention group reported significant improvements in HRQOL from pre- to postintervention scores (mean difference 6.08, SD 15.26) compared with the control group (mean difference -2.95, SD 10.63; P=.01). In contrast, there was no significant between-group difference in self-efficacy (P=.09). Overall, PatientCareAnywhere represents a user-friendly, functional, and acceptable supportive care intervention with preliminary efficacy to improve HRQOL among patients diagnosed with cancer. Future studies are needed to further establish the efficacy of PatientCareAnywhere as well as explore strategies to enhance user engagement and investigate the optimal intensity, frequency, and use of the intervention to improve patient outcomes. ClinicalTrials.gov NCT02408406; https://clinicaltrials.gov/study/NCT02408406.

Interactive Health Technology Tool for Kidney Living Donor Assessment to Standardize the Informed Consent Process: Usability and Qualitative Content Analysis.

Kidney living donation carries risks, yet standardized information provision regarding nephrectomy risks and psychological impacts for candidates remains lacking. This study assesses the benefit of interactive health technology in improving the informed consent process for kidney living donation. The Kidney Hub institutional open portal offers comprehensive information on kidney disease and donation. Individuals willing to start the kidney living donation process at Helsinki University Hospital (January 2019-January 2022) were invited to use the patient-tailored digital care path (Living Donor Digital Care Path) included in the Kidney Hub. This platform provides detailed donation process information and facilitates communication between health care professionals and patients. eHealth literacy was evaluated via the eHealth Literacy Scale (eHEALS), usability with the System Usability Scale (SUS), and system utility through Likert-scale surveys with scores of 1-5. Qualitative content analysis addressed an open-ended question. The Kidney Hub portal received over 8000 monthly visits, including to its sections on donation benefits (n=1629 views) and impact on donors' lives (n=4850 views). Of 127 living kidney donation candidates, 7 did not use Living Donor Digital Care Path. Users' ages ranged from 20 to 79 years, and they exchanged over 3500 messages. A total of 74 living donor candidates participated in the survey. Female candidates more commonly searched the internet about kidney donation (n=79 female candidates vs n=48 male candidates; P=.04). The mean eHEALS score correlated with internet use for health decisions (r=0.45; P<.001) and its importance (r=0.40; P=.01). Participants found that the Living Donor Digital Care Path was technically satisfactory (mean SUS score 4.4, SD 0.54) and useful but not pivotal in donation decision-making. Concerns focused on postsurgery coping for donors and recipients. Telemedicine effectively educates living kidney donor candidates on the donation process. The Living Donor Digital Care Path serves as a valuable eHealth tool, aiding clinicians in standardizing steps toward informed consent. ClinicalTrials.gov NCT04791670; https://clinicaltrials.gov/study/NCT04791670. RR2-10.1136/bmjopen-2021-051166.

P-601 Monitoring reproductive hormones during ovarian stimulation: performance and usability of a self-operated at-home urine test

Abstract Study question How effective and user-friendly is a non-invasive, patient-operated urine test (Kinder) in tracking reproductive hormone levels during ovarian stimulation (OS) treatment in an IVF cycle? Summary answer Urinary E1-3G correlates well with blood E2 levels and ovarian follicle development. Patients found it easy and stress-free to perform the urine test at home. What is known already Monitoring blood reproductive hormone levels during OS is a widely accepted practice to ensure the optimal ovarian response to gonadotropin treatment, timing of oocyte maturation triggering and mitigating hyperstimulation risk. However, conventional blood testing is invasive, necessitating patients to travel to clinics for blood sampling, adding to their overall burden. Previous studies have revealed a robust correlation between blood E2 levels, and its corresponding urinary metabolites E1-3G. Kinder is a portable device designed for quantifying urinary E1-3G, allowing patients to conduct tests in the privacy of their homes, and for many obviating the need to travel substantial distances for monitoring. Study design, size, duration This is a prospective, single-cohort, study of Caucasian patients (28-34 years), conducted at Fertility Specialists of Western Australia in Perth, Australia, where patients may travel vast distances for treatment. Twenty-five patients were enrolled from Aug 2022-Aug 2023, and performed home urine tests utilizing the Kinder device in parallel with clinic scheduled blood (ELISA) and ultrasound tests. The primary end point of the study was the correlation between urinary and blood reproductive hormone concentrations (E1-3G). Participants/materials, setting, methods Spearman and Pearson correlation coefficients (CC) and 95% confidence intervals were calculated for E1-3G and E2, and E1-3G/E2 and follicle development (total volume of ovarian follicles by ultrasound). To assess patient acceptability patient-reported outcomes (PRO) were assessed using the State Trait Anxiety Inventory (STAI) questionnaire. Further, patient-reported experiences (PRE) were evaluated through the System Usability Scale (SUS) questionnaire, along with assessing their likelihood to recommend Kinder to their friends or family undergoing IVF treatment. Main results and the role of chance Upon analysing 100 concurrent urine and blood samples from 25 patients, a robust correlation was found between E1-3G and E2 levels (Spearman CC: 0.818, 95% CI: 0.680-0.904; Pearson CC: 0.847, 95% CI: 0.712-0.939). Additionally, we observed a moderate correlation between E1-3G levels and ovarian volume (Spearman CC: 0.701, 95% CI: 0.556-0.805; Pearson CC: 0.670, 95% CI: 0.519-0.781, n = 72), resembled the correlation between E2 levels and ovarian volume (Spearman CC: 0.874, 95% CI: 0.804-0.920; Pearson CC: 0.849, 95% CI: 0.770-0.902, n = 75). PRE: 22 out of 23 patients who completed the survey confirmed that they would definitely, or probably, recommend Kinder. The mean SUS score (91.4) signified an excellent user experience. PRO: Anxiety levels were not affected by use of Kinder (STAI score below threshold of 42.38) in 18/20 patients who completed three STAI surveys (first one before and second one after the initial Kinder test; third one after the third/fourth Kinder test). Although 2/20 patients reported a STAI score of 49 in the final survey, suggesting increased anxiety, both affirmed in the PRE survey that they “will definitely recommend Kinder”, suggesting that the elevated STAI score can be attributed to the overall IVF treatment rather than the use of Kinder itself. Limitations, reasons for caution The sample size is relatively small, necessitating further multi-centre studies with a larger sample size to validate the findings. Wider implications of the findings The results suggest an acceptable interchangeability between at-home urine E1-3G and at-clinic blood E2 monitoring hormone levels during OS treatment. A digital health approach, combining tele-counselling, remote at-home hormone monitoring, and follicle tracking, could reduce patient burden and save many patients the inconvenience of travelling large distances for cycle monitoring. Trial registration number ACTRN12622000488707

Data-Driven Web-Based Service Travel Resume Information System

The Energy and Mineral Resources Department (ESDM) of South Sumatra Province has significantly enhanced its operational efficiency by implementinga Web-Based Official Travel Resume Information System. This system was developed to address the inefficiencies and risks associated with the previous manual method of managing official travel data. The new system leverages PHP, MySQL, Javascript, JQuery, and Bootstrap to provide a robust, secure, and user-friendly platform for handling travel reports, assignment orders, and official travel documentation. The digital transformation has streamlined data entry, improved data integrity, and facilitated real-time information access,enabling better decision-making and strategic planning. A System Usability Scale (SUS) test was conducted with 120 participants to evaluate the system's usability. The results showed a mean SUS score of 78.5, indicating good usability, with a standard deviation of 8.3. High scores were recorded for the system's ease of use, integration of functions, and user confidence, while lower scores highlighted initial complexity and a need for additional user training. The successful implementation and positive usability results underscore the system's effectiveness in enhancing the ESDM Department's operational capabilities. Recommendations for further improvements include enhancing mobile accessibility, providing ongoing user training, integrating advanced reporting features, and refining the user interface to ensure continued user satisfaction and system efficiency.

Development and usability testing of an online support tool to identify models and frameworks to inform implementation

BackgroundTheories, models and frameworks (TMFs) are useful when implementing, evaluating and sustaining healthcare evidence-based interventions. Yet it can be challenging to identify an appropriate TMF for an implementation project. We developed and tested the usability of an online tool to help individuals who are doing or supporting implementation practice activities to identify appropriate models and/or frameworks to inform their work.MethodsWe used methods guided by models and evidence on implementation science and user-centered design. Phases of tool development included applying findings from a scoping review of TMFs and interviews with 24 researchers/implementers on barriers and facilitators to identifying and selecting TMFs. Based on interview findings, we categorized the TMFs by aim, stage of implementation, and target level of change to inform the tool’s algorithm. We then conducted interviews with 10 end-users to test the usability of the prototype tool and administered the System Usability Scale (SUS). Usability issues were addressed and incorporated into the tool.ResultsWe developed Find TMF, an online tool consisting of 3–4 questions about the user’s implementation project. The tool’s algorithm matches key characteristics of the user’s project (aim, stage, target change level) with characteristics of different TMFs and presents a list of candidate models/frameworks. Ten individuals from Canada or Australia participated in usability testing (mean SUS score 84.5, standard deviation 11.4). Overall, participants found the tool to be simple, easy to use and visually appealing with a useful output of candidate models/frameworks to consider for an implementation project. Users wanted additional instruction and guidance on what to expect from the tool and how to use the information in the output table. Tool improvements included incorporating an overview figure outlining the tool steps and output, displaying the tool questions on a single page, and clarifying the available functions of the results page, including adding direct links to the glossary and to complementary tools.ConclusionsFind TMF is an easy-to-use online tool that may benefit individuals who support implementation practice activities by making the vast number of models and frameworks more accessible, while also supporting a consistent approach to identifying and selecting relevant TMFs.

The feasibility and usability of mixed reality teaching in a hospital setting based on self-reported perceptions of medical students

BackgroundClinical teaching during encounters with real patients lies at the heart of medical education. Mixed reality (MR) using a Microsoft HoloLens 2 (HL2) offers the potential to address several challenges: including enabling remote learning; decreasing infection control risks; facilitating greater access to medical specialties; and enhancing learning by vertical integration of basic principles to clinical application. We aimed to assess the feasibility and usability of MR using the HL2 for teaching in a busy, tertiary referral university hospital.MethodsThis prospective observational study examined the use of the HL2 to facilitate a live two-way broadcast of a clinician-patient encounter, to remotely situated third and fourth year medical students. System Usability Scale (SUS) Scores were elicited from participating medical students, clinician, and technician. Feedback was also elicited from participating patients. A modified Evaluation of Technology-Enhanced Learning Materials: Learner Perceptions Questionnaire (mETELM) was completed by medical students and patients.ResultsThis was a mixed methods prospective, observational study, undertaken in the Day of Surgery Assessment Unit. Forty-seven medical students participated. The mean SUS score for medical students was 71.4 (SD 15.4), clinician (SUS = 75) and technician (SUS = 70) indicating good usability. The mETELM Questionnaire using a 7-point Likert Scale demonstrated MR was perceived to be more beneficial than a PowerPoint presentation (Median = 7, Range 6–7). Opinion amongst the student cohort was divided as to whether the MR tutorial was as beneficial for learning as a live patient encounter would have been (Median = 5, Range 3–6). Students were positive about the prospect of incorporating of MR in future tutorials (Median = 7, Range 5–7). The patients’ mETELM results indicate the HL2 did not affect communication with the clinician (Median = 7, Range 7–7). The MR tutorial was preferred to a format based on small group teaching at the bedside (Median = 6, Range 4–7).ConclusionsOur study findings indicate that MR teaching using the HL2 demonstrates good usability characteristics for providing education to medical students at least in a clinical setting and under conditions similar to those of our study. Also, it is feasible to deliver to remotely located students, although certain practical constraints apply including Wi-Fi and audio quality.

Augmented Reality-Guided Extraction of Fully Impacted Lower Third Molars Based on Maxillofacial CBCT Scans

(1) Background: This study aimed to integrate an augmented reality (AR) image-guided surgery (IGS) system, based on preoperative cone beam computed tomography (CBCT) scans, into clinical practice. (2) Methods: In preclinical and clinical surgical setups, an AR-guided visualization system based on Microsoft’s HoloLens 2 was assessed for complex lower third molar (LTM) extractions. In this study, the system’s potential intraoperative feasibility and usability is described first. Preparation and operating times for each procedure were measured, as well as the system’s usability, using the System Usability Scale (SUS). (3) Results: A total of six LTMs (n = 6) were analyzed, two extracted from human cadaver head specimens (n = 2) and four from clinical patients (n = 4). The average preparation time was 166 ± 44 s, while the operation time averaged 21 ± 5.9 min. The overall mean SUS score was 79.1 ± 9.3. When analyzed separately, the usability score categorized the AR-guidance system as “good” in clinical patients and “best imaginable” in human cadaver head procedures. (4) Conclusions: This translational study analyzed the first successful and functionally stable application of the HoloLens technology for complex LTM extraction in clinical patients. Further research is needed to refine the technology’s integration into clinical practice to improve patient outcomes.

Effectiveness of the HEAR-Aware App for Adults Not Ready for Hearing Aids, but Open to Self-Management Support: Results of a Randomized Controlled Trial.

Recently, the HEAR-aware app was developed to support adults who are eligible for hearing aids (HAs) but not yet ready to use them. The app serves as a self-management tool, offering assistance for a range of target behaviors (TBs), such as communication strategies and emotional coping. Using ecological momentary assessment and intervention, the app prompts users to complete brief surveys regarding challenging listening situations they encounter in their daily lives (ecological momentary assessment). In response, users receive educational content in the form of "snippets" (videos, texts, web links) on the TBs, some of which are customized based on the reported acoustic environmental characteristics (ecological momentary intervention). The primary objective of this study was to assess the effectiveness of the HEAR-aware app in enhancing readiness to take action on various TBs and evaluate its impact on secondary outcomes. The secondary objective was to examine the app's usability, usefulness, and user satisfaction. A randomized controlled trial design with two arms was used. Participants with hearing loss aged 50 years and over were recruited via an HA retailer and randomly assigned to the intervention group (n = 42, mean age = 65 years [SD = 9.1]) or the control group (n = 45, mean age = 68 years [SD 8.7]). The intervention group used the app during 4 weeks. The control group received no intervention. All participants completed online questionnaires at baseline (T0), after 4 weeks (T1), and again 4 weeks later (T2). Participants' readiness to take action on five TBs was measured with The Line Composite. A list of secondary outcomes was used. Intention-to-treat analyses were performed using Linear Mixed effect Models including group (intervention/control), time (T0/T1/T2), and Group × Time Interactions. In addition, a per protocol analysis was carried out to explore whether effects depended on app usage. For the secondary aim the System Usability Scale (SUS), the Intrinsic Motivation Inventory, item 4 of the International Outcome Inventory-Alternative Intervention (IOI-AI), and a recommendation item were used (intervention group only at T1). For objective 1, there was no significant group difference for The Line Composite over the course of T0, T1, and T2. However, a significant (p = 0.033) Group × Time Interaction was found for The Line Emotional coping, with higher increase in readiness to take action on emotional coping in the intervention group than in the control group. The intention-to-treat analyses revealed no other significant group differences, but the per protocol analyses showed that participants in the intervention group were significantly more ready to take up Assistive Listening Devices (The Line Assistive Listening Devices) and less ready to take up HAs (Staging Algorithm HAs) than the control group (p = 0.049). Results for objective 2 showed that on average, participants rated the app as moderately useful (mean Intrinsic Motivation Inventory score 5 out of 7) and its usability as "marginal" (mean SUS score 68 out of 100) with about half of the participants rating the app as "good" (SUS score >70) and a minority rating is as "unacceptable" (SUS score ≤50). This study underscores the potential of self-management support tools like the HEAR-aware app in the rehabilitation of adults with hearing loss who are not yet ready for HAs. The range in usability scores suggest that it may not be a suitable intervention for everyone.

#2978 Formative usability test of a novel device for peritoneal dialysis (WEAKID)

Abstract Background and Aims Chronic kidney disease is a growing problem worldwide with a growing number of patients requiring kidney replacement therapy. In recent years we have developed a novel device for peritoneal dialysis (PD), the WEarable Artificial KIDney (WEAKID); composed of a wearable device connected to a dialysate reservoir. WEAKID uses both sorbent technology and continuous flow PD to improve dialysis efficacy. Formative usability testing aids to the identification of design issues that may interfere with a device's safe and effective use and thus may influence decisions made in the design process. Here, we present the results of an international, multicentre, formative usability study of WEAKID among nurses and patients. Method This study used a mixed-methods design and was conducted in hospitals in Italy (Modena University Hospital), Spain (La Paz University Hospital, Madrid), and the Netherlands (University Medical Center Utrecht) between November 2021 and December 2022. An individual, formative usability testing session was conducted with each participant (nurse or patient) under the conditions of simulated use. Participants were asked to perform basic operational procedures (i.e. turning the device on/off, input of dialysis settings, handling an alarm) with the device according to a usability task list. Their performance was observed and use errors (i.e., something that a participant does or fails to do that results in an unexpected or unintended outcome) were noted. Furthermore, participants were asked for feedback, both verbally and by means of completing the system usability scale (SUS), reflecting perceived usability on a scale from 0 (worst) to 100 (best). Results We included 14 participants (n = 6 nurses, n = 8 patients) in three participating centres. All nurses were female and had a median experience with PD of 20.5 years (range 0.5-32). Patients were generally highly educated (n = 5, 63%). In total, 22 use errors occurred, 10 in nurses and 12 in patients. These use errors included factors not related to the device, e.g. not taking appropriate hygiene measures. In particular, use errors occurred during the priming/connection of catheter and handling the alarm. Participants’ feedback mainly concerned the small screen (and thus font) size, user interface (e.g. lack of colour-coded soft buttons), and (short) length of the patient line. The mean SUS score was 70 (range 57.5–85) for nurses, and 71.9 (range 55–87.5) for patients. Conclusion Despite the slightly above-average perceived usability of the device's current design stage, participants made a lot of suggestions for improvements, and usability must be improved to make the device ready for market introduction.

Clinical Utility and Usability of the Digital Box and Block Test: Mixed Methods Study.

The Box and Block Test (BBT) is a clinical tool used to measure hand dexterity, which is often used for tracking disease progression or the effectiveness of therapy, particularly benefiting older adults and those with neurological conditions. Digitizing the measurement of hand function may enhance the quality of data collection. We have developed and validated a prototype that digitizes this test, known as the digital BBT (dBBT), which automatically measures time and determines and displays the test result. This study aimed to investigate the clinical utility and usability of the newly developed dBBT and to collect suggestions for future improvements. A total of 4 occupational therapists participated in our study. To evaluate the clinical utility, we compared the dBBT to the BBT across dimensions such as acceptance, portability, energy and effort, time, and costs. We observed therapists using the dBBT as a dexterity measurement tool and conducted a quantitative usability questionnaire using the System Usability Scale (SUS), along with a focus group. Evaluative, structured, and qualitative content analysis was used for the qualitative data, whereas quantitative analysis was applied to questionnaire data. The qualitative and quantitative data were merged and analyzed using a convergent mixed methods approach. Overall, the results of the evaluative content analysis suggested that the dBBT had a better clinical utility than the original BBT, with ratings of all collected participant statements for the dBBT being 45% (45/99) equal to, 48% (48/99) better than, and 6% (6/99) lesser than the BBT. Particularly in the subcategories "acceptance," "time required for evaluation," and "purchase costs," the dBBT was rated as being better than the original BBT. The dBBT achieved a mean SUS score of 83 (95% CI 76-96). Additionally, several suggested changes to the system were identified. The study demonstrated an overall positive evaluation of the clinical utility and usability of the dBBT. Valuable insights were gathered for future system iterations. These pioneering results highlight the potential of digitizing hand dexterity assessments.

Pilot study evaluating the usability of MonŒil, a ChatGPT-based education tool in ophthalmology

ImportanceThere is an increasing use of artificial intelligence (AI) in ophthalmology to respond to the needs of patients to access reliable, easy-to-understand medical information. ObjectiveTo assess patient satisfaction with the usability of MonŒil, an AI-based platform designed for patient education in ophthalmology. DesignThis was a pilot cross-sectional study of the usability of MonŒil by patients followed for advanced age-related macular degeneration (AMD). MonŒil is based on ChatGPT-4 technology with specific ophthalmology-focused customizations and accessibility enhancements, and is freely available at monoeil.help. Patients were given 20 min of unsupervised interaction with no prior training or guidance, after which their feedback was collected. SettingThe study was performed in the ophthalmology department at the Creteil University Hospital. ParticipantsParticipants included 54 patients diagnosed with advanced AMD defined presenting for follow-up. Patients had to be older than 50 years of age, capable of giving informed consent, and able to understand and interact with MonŒil. Exclusion criteria were severe visual and cognitive impairment that prevented interaction with MonŒil. Main Outcome(s) and Measure(s)The primary outcome was the usability of MonŒil as measured by the System Usability Scale (SUS) questionnaire. ResultsOf the 54 participants, 34 were female (62.96 %). The mean age of the cohort was 77.76±8.14 years (range 58 to 97 years). The mean SUS score was 90.23±12.04 with a median of 92.50 (range 42.50 to 100.00), indicating excellent usability. There was a positive relationship between visual acuity and SUS score (regression coefficient 0.30 (95 % CI 0.08 to 0.51), r2=0.19, p = 0.0077). Conclusions and RelevanceMonŒil demonstrated excellent usability and satisfaction in a sample population of elderly patients with advanced AMD. These results suggest that AI-based tools like MonŒil can enhance patient education with minimal oversight in a complex field like ophthalmology, supporting its use as an adjunct to the physician-patient discussion. Further studies may be necessary to establish the applicability of MonŒil to a broader user base, and to assess its usefulness and clinical impact on patient outcomes such as patient knowledge and vision-related quality of life.

Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme: a single-arm pilot study

BackgroundThe growing obesity epidemic in Malaysia presents a public health challenge that requires innovative intervention strategies. In an effort to address this problem, an Interactive Malaysian Childhood Healthy Lifestyle (i-MaCHeL) programme, which is a web-based initiative designed for preschool child–parent dyads offers a novel approach. Nevertheless, the success of such a web-based intervention depends on several interrelated factors. This research aims to examine the feasibility of i-MaCHeL in the Malaysian context, its usability for preschool child–parent dyads, and the acceptability of the programme among these user groups.MethodsThis was a single-arm pilot study involving 46 child–parent dyads recruited from six government preschools in Terengganu, Malaysia. The preschools were selected using a cluster random sampling technique at the preschool level. The intervention feasibility was determined based on the retention rate of participants in the pilot study. The System Usability Scale (SUS) and intervention process evaluation were used to assess the usability and acceptability of the web-based i-MaCHeL programme.ResultsThe retention data demonstrated that 42 out of 46 participants completed the 13-week intervention programme, which showed that the overall retention rate was 91.3%. A mean (SD) SUS score of 84.70 (13.82) was obtained from parents, indicating that the web-based i-MaCHeL had an acceptable usability level. The mean scores of the process evaluation items ranged from 4.52 (0.63) to 4.83 (0.38), demonstrating that the web-based i-MaCHeL was highly accepted by the parents. The acceptability data also indicated that at least 92.9% (39/42) of the parents agreed/strongly agreed that the web content, programme duration, intervention dose, WhatsApp group, and delivery mode were appropriate.ConclusionsAccording to these findings, the i-MaCHeL intervention using a web-based approach was feasible, usable, and acceptable as part of a weight-related behaviour change intervention for preschool child–parent dyads. This pilot study demonstrated that the web-based i-MaCHeL was feasible and promising for delivering weight-related behavioural intervention to child–parent dyads.Trial registrationClinicalTrials.gov, NCT04711525. Registered on January 15, 2021.

A Digital Health Intervention Platform (Active and Independent Management System) to Enhance the Rehabilitation Experience for Orthopedic Joint Replacement Patients: Usability Evaluation Study.

Optimal rehabilitation programs for orthopedic joint replacement patients ensure faster return to function, earlier discharge from hospital, and improved patient satisfaction. Digital health interventions show promise as a supporting tool for re-enablement. The main goal of this mixed methods study was to examine the usability of the AIMS platform from the perspectives of both patients and clinicians. The aim of this study was to evaluate a re-enablement platform that we have developed that uses a holistic systems approach to address the de-enablement that occurs in hospitalized inpatients, with the older adult population most at risk. The Active and Independent Management System (AIMS) platform is anticipated to deliver improved patient participation in recovery and self-management through education and the ability to track rehabilitation progression in hospital and after patient discharge. Two well-known instruments were used to measure usability: the System Usability Scale (SUS) with 10 items and, for finer granularity, the User Experience Questionnaire (UEQ) with 26 items. In all, 26 physiotherapists and health care professionals evaluated the AIMS clinical portal; and 44 patients in hospital for total knee replacement, total hip replacement, or dynamic hip screw implant evaluated the AIMS app. For the AIMS clinical portal, the mean SUS score obtained was 82.88 (SD 13.07, median 86.25), which would be considered good/excellent according to a validated adjective rating scale. For the UEQ, the means of the normalized scores (range -3 to +3) were as follows: attractiveness=2.683 (SD 0.100), perspicuity=2.775 (SD 0.150), efficiency=2.775 (SD 0.130), dependability=2.300 (SD 0.080), stimulation=1.950 (SD 0.120), and novelty=1.625 (SD 0.090). All dimensions were thus classed as excellent against the benchmarks, confirming the results from the SUS questionnaire. For the AIMS app, the mean SUS score obtained was 74.41 (SD 10.26), with a median of 77.50, which would be considered good according to the aforementioned adjective rating scale. For the UEQ, the means of the normalized scores were as follows: attractiveness=2.733 (SD 0.070), perspicuity=2.900 (SD 0.060), efficiency=2.800 (SD 0.090), dependability=2.425 (SD 0.060), stimulation=2.200 (SD 0.010), and novelty=1.450 (0.260). All dimensions were thus classed as excellent against the benchmarks (with the exception of novelty, which was classed as good), providing slightly better results than the SUS questionnaire. The study has shown that both the AIMS clinical portal and the AIMS app have good to excellent usability scores, and the platform provides a solid foundation for the next phase of research, which will involve evaluating the effectiveness of the platform in improving patient outcomes after total knee replacement, total hip replacement, or dynamic hip screw.

User-Centered Development of a Patient Decision Aid for Choice of Early Abortion Method: Multi-Cycle Mixed Methods Study.

People seeking abortion in early pregnancy have the choice between medication and procedural options for care. The choice is preference-sensitive-there is no clinically superior option and the choice depends on what matters most to the individual patient. Patient decision aids (PtDAs) are shared decision-making tools that support people in making informed, values-aligned health care choices. We aimed to develop and evaluate the usability of a web-based PtDA for the Canadian context, where abortion care is publicly funded and available without legal restriction. We used a systematic, user-centered design approach guided by principles of integrated knowledge translation. We first developed a prototype using available evidence for abortion seekers' decisional needs and the risks, benefits, and consequences of each option. We then refined the prototype through think-aloud interviews with participants at risk of unintended pregnancy ("patient" participants). Interviews were audio-recorded and documented through field notes. Finally, we conducted a web-based survey of patients and health care professionals involved with abortion care, which included the System Usability Scale. We used content analysis to identify usability issues described in the field notes and open-ended survey questions, and descriptive statistics to summarize participant characteristics and close-ended survey responses. A total of 61 individuals participated in this study. Further, 11 patients participated in think-aloud interviews. Overall, the response to the PtDA was positive; however, the content analysis identified issues related to the design, language, and information about the process and experience of obtaining abortion care. In response, we adapted the PtDA into an interactive website and revised it to include consistent and plain language, additional information (eg, pain experience narratives), and links to additional resources on how to find an abortion health care professional. In total, 25 patients and 25 health care professionals completed the survey. The mean System Usability Scale score met the threshold for good usability among both patient and health care professional participants. Most participants felt that the PtDA was user-friendly (patients: n=25, 100%; health care professionals: n=22, 88%), was not missing information (patients: n=21, 84%; health care professionals: n=18, 72%), and that it was appropriate for patients to complete the PtDA before a consultation (patients: n=23, 92%; health care professionals: n=23, 92%). Open-ended responses focused on improving usability by reducing the length of the PtDA and making the website more mobile-friendly. We systematically designed the PtDA to address an unmet need to support informed, values-aligned decision-making about the method of abortion. The design process responded to a need identified by potential users and addressed unique sensitivities related to reproductive health decision-making.

A Randomized Evaluation of MoodFX, a Patient-Centred e-Health Tool to Support Outcome Measurement for Depression: Une évaluation randomisée de MoodFX, un outil de santé en ligne centré sur le patient pour soutenir la mesure du résultat dans la dépression.

e-Health tools using validated questionnaires to assess outcomes may facilitate measurement-based care for psychiatric disorders. MoodFX was created as a free online symptom tracker to support patients for outcome measurement in their depression treatment. We conducted a pilot randomized evaluation to examine its usability, and clinical utility. Patients presenting with a major depressive episode (within a major depressive or bipolar disorder) were randomly assigned to receive either MoodFX or a health information website as the intervention and control condition, respectively, with follow-up assessment surveys conducted online at baseline, 8 weeks and 6 months. The primary usability outcomes included the percentage of patients with self-reported use of MoodFX 3 or more times during follow up (indicating minimally adequate usage) and usability measures based on the System Usability Scale (SUS). Secondary clinical outcomes included the Quick Inventory of Depressive Symptomatology, Self-Rated (QIDS-SR) and Patient Health Questionnaire (PHQ-9). Forty-nine participants were randomized (24 to MoodFX and 25 to the control condition). Of the 23 participants randomized to MoodFX who completed the user survey, 18 (78%) used MoodFX 3 or more times over the 6 months of the study. The mean SUS score of 72.7 (65th-69th percentile) represents good usability. Compared to the control group, the MoodFX group had significantly better improvement on QIDS-SR and PHQ-9 scores, with large effect sizes and higher response rates at 6 months. There were no differences between conditions on other secondary outcomes such as functioning and quality of life. MoodFX demonstrated good usability and was associated with reduction in depressive symptoms. This pilot study supports the use of digital tools in depression treatment.

Unsupervised robot-assisted rehabilitation after stroke: feasibility, effect on therapy dose, and user experience

BackgroundUnsupervised robot-assisted rehabilitation is a promising approach to increase the dose of therapy after stroke, which may help promote sensorimotor recovery without requiring significant additional resources and manpower. However, the unsupervised use of robotic technologies is not yet a standard, as rehabilitation robots often show low usability or are considered unsafe to be used by patients independently. In this paper we explore the feasibility of unsupervised therapy with an upper limb rehabilitation robot in a clinical setting, evaluate the effect on the overall therapy dose, and assess user experience during unsupervised use of the robot and its usability.MethodsSubacute stroke patients underwent a four-week protocol composed of daily 45 min-sessions of robot-assisted therapy. The first week consisted of supervised therapy, where a therapist explained how to interact with the device. The second week was minimally supervised, i.e., the therapist was present but intervened only if needed. After this phase, if participants learnt how to use the device, they proceeded to two weeks of fully unsupervised training. Feasibility, dose of robot-assisted therapy achieved during unsupervised use, user experience, and usability of the device were evaluated. Questionnaires to evaluate usability and user experience were performed after the minimally supervised week and at the end of the study, to evaluate the impact of therapists’ absence.ResultsUnsupervised robot-assisted therapy was found to be feasible, as 12 out of the 13 recruited participants could progress to unsupervised training. During the two weeks of unsupervised therapy participants on average performed an additional 360 min of robot-assisted rehabilitation. Participants were satisfied with the device usability (mean System Usability Scale scores > 79), and no adverse events or device deficiencies occurred.ConclusionsWe demonstrated that unsupervised robot-assisted therapy in a clinical setting with an actuated device for the upper limb was feasible and can lead to a meaningful increase in therapy dose. These results support the application of unsupervised robot-assisted therapy as a complement to usual care in clinical settings and pave the way to its application in home settings.Trial registrationRegistered on 13.05.2020 on clinicaltrials.gov (NCT04388891).

Evaluation of an mHealth App on Self-Management of Osteoporosis: Prospective Survey Study.

Mobile health (mHealth) technologies can be used for disease-specific self-management, and these technologies are experiencing rapid growth in the health care industry. They use mobile devices, specifically smartphone apps, to enhance and support medical and public health practices. In chronic disease management, the use of apps in the realm of mHealth holds the potential to improve health outcomes. This is also true for mHealth apps on osteoporosis, but the usage and patients' experiences with these apps are underexplored. This prospective survey study aimed to investigate the eHealth literacy of Danish patients with osteoporosis, as well as the usability and acceptability of the app "My Bones." Data on patient characteristics, disease knowledge, eHealth literacy, usability, and acceptability were collected using self-administered questionnaires at baseline, 2 months, and 6 months. The following validated questionnaires were used: eHealth Literacy Questionnaire, System Usability Scale, and Service User Technology Acceptability Questionnaire. Mean scores for eHealth literacy ranged from 2.6 to 3.1, with SD ranging from 0.5 to 0.6 across the 7 domains. The mean (SD) System Usability Scale score was 74.7 (14.4), and the mean (SD) scores for domains 1, 2, and 6 of the Service User Technology Acceptability Questionnaire were 3.4 (1.2), 4.5 (1.1), 4.1 (1.2), respectively. Danish patients with osteoporosis are both motivated and capable of using digital health services. The app's usability was acceptable, and it has the potential to reduce visits to general practitioner clinics, enhance health outcomes, and serve as a valuable addition to regular health or social care services.

Adapting mHealth Interventions (PrEPmate and DOT Diary) to Support PrEP Retention in Care and Adherence Among English and Spanish-Speaking Men Who Have Sex With Men and Transgender Women in the United States: Formative Work and Pilot Randomized Trial.

A growing number of mobile health (mHealth) technologies are being developed to support HIV preexposure prophylaxis (PrEP) adherence and persistence; however, most tools have focused on men who have sex with men (MSM), and few are available in Spanish. To maximize the potential impact of these tools in reducing gender and racial/ethnic disparities and promoting health equity, mHealth tools tailored to Spanish-speaking people and transgender women are critically needed. The aim of this study is to adapt and tailor 2 mHealth technologies, PrEPmate and DOT Diary, to support daily PrEP adherence and persistence among Spanish-speaking MSM and English- and Spanish-speaking transgender women and to evaluate the feasibility and acceptability of these tools. PrEPmate, an interactive, bidirectional, text messaging intervention that promotes personalized communication between PrEP users and providers, and DOT Diary, a mobile app that promotes self-management of PrEP use and sexual health through an integrated electronic pill-taking and sexual activity diary, were previously developed for English-speaking MSM. We conducted 3 focus groups with 15 English- and Spanish-speaking transgender women and MSM in San Francisco and Miami to culturally tailor these tools for these priority populations. We then conducted a 1-month technical pilot among 21 participants to assess the usability and acceptability of the adapted interventions and optimize the functionality of these tools. Participants in focus groups liked the "human touch" of text messages in PrEPmate and thought it would be helpful for scheduling appointments and asking questions. They liked the daily reminder messages, especially the fun facts, gender affirmations, and transgender history topics. Participants recommended changes to tailor the language and messages for Spanish-speaking and transgender populations. For DOT Diary, participants liked the adherence tracking and protection level feedback and thought the calendar functions were easy to use. Based on participant recommendations, we tailored language within the app for Spanish-speaking MSM and transgender women, simplified the sexual diary, and added motivational badges. In the technical pilot of the refined tools, mean System Usability Scale scores were 81.2/100 for PrEPmate and 76.4/100 for DOT Diary (P=.48), falling in the "good" to "excellent" range, and mean Client Satisfaction Questionnaire scores were 28.6 and 28.3 for PrEPmate and DOT Diary, respectively (maximum possible score=32). Use of both tools was high over the 1-month pilot (average of 10.5 messages received from each participant for PrEPmate; average of 17.6 times accessing the DOT Diary app), indicating good feasibility for both tools. Using a user-centered design approach, we culturally tailored PrEPmate and DOT Diary to support daily PrEP use among Spanish-speaking MSM and English- and Spanish-speaking transgender women. Our positive findings in a technical pilot support further testing of these mHealth interventions in an upcoming comparative effectiveness trial.