System Usability Scale Score Research Articles

Analisis Kepuasan Pengguna Website Repository Universitas Amikom Purwokerto menggunakan Metode System Usability Scale (SUS)

This study aims to analyze user satisfaction with the Universitas Amikom Purwokerto repository website using the System Usability Scale (SUS) method. In the digital era, online repositories play a crucial role as a platform for storing, managing, and distributing academic work, supporting academic activities and knowledge exchange. However, observations indicate that the repository website faces challenges in accessibility, including unintuitive navigation, difficult-to-understand menus, and limited language options, as it is only available in English. Through a SUS survey involving 100 respondents, an average SUS score of 46 was obtained, falling into the "Not Acceptable" category with a grade of "F" and an adjective rating of "Poor." This result indicates that the website’s usability is insufficient and requires improvement. Recommendations include enhancing navigation, ensuring interface consistency, providing a dual-language option (Indonesian and English), improving website speed, and conducting regular user satisfaction evaluations. These improvements aim to optimize the Universitas Amikom Purwokerto repository website, thereby providing a better user experience and effectively supporting academic activities and the dissemination of academic work.

Reliability, validity and usability of the K-force® grip dynamometer to evaluate handgrip-strength in patients with intensive care unit-acquired weakness.

Handgrip dynamometry is recognised as a method for evaluating volitional muscle strength in the intensive care, but conventional handgrip dynamometers cannot accurately measure grip strength in very weak patients. The aim of this study was to determine the reliability, validity and usability of the K-force® grip in patients with intensive care unit-acquired weakness. Evaluation of measurement properties of the K-force® grip. Two Intensive Care Units in The Netherlands. Patients diagnosed with intensive care unit-acquired weakness according to a Medical Research Council sum score <48. Intra- and inter-rater reliability of the K-force® grip were assessed using the intraclass correlation coefficient. Concurrent validity was examined using calibration weights. The usability was evaluated with the System Usability Scale. Intra-rater reliability showed an intraclass correlation coefficient of 0.987 for the dominant hand and 0.972 for the non-dominant hand. Inter-rater reliability showed coefficients of 0.944 for the dominant hand and 0.942 for the non-dominant hand. There was a perfect correlation (r = 1) between the K-force® grip and the calibration weights. The usability of the K-force® grip was rated excellent by 11 healthcare professionals with a System Usability Scale score of 86. The K-force® grip is a promising new tool for the evaluation of muscle strength in intensive care unit-acquired weakness patients who are too weak to use conventional hand dynamometers.

Evaluating the Usability of a Remote Ischemic Conditioning Device for Pre-Hospital Stroke Management: Insights from Paramedic Simulations

Background/Objectives: In acute stroke, often-prolonged hospital transport times present an opportunity for early interventions to salvage brain tissue. Remote ischemic conditioning (RIC), where brief cycles of ischemia–reperfusion in a limb are induced to protect the brain, is a promising treatment for this setting. We assessed the usability of a novel RIC system in a simulated emergency response scenario. Methods: Paramedics were asked to use the RIC device in an emergency stroke care and ambulance transport simulation, overseen by a confederate. Feedback on device use was collected through questionnaires, including the System Usability Scale (SUS) and the NASA Task Load Index (NASA-TLX), and a semi-structured interview. Questionnaire responses were summarized using descriptive statistics; interview transcripts were analyzed thematically. Results: Nine paramedics (including the confederate) participated, with a mean of 10.0 ± 10.3 years of professional experience. Questionnaire responses indicated high device usability (mean SUS score: 85.3 ± 12.9 out of 100) and low task-related demands, effort, and frustration (mean NASA-TLX domain scores: ≤3.9 out of 20). Seven paramedics stated they would use the device in daily practice. They expressed concerns related to display screen clarity, interference with standard procedures, cable management, device fragility, and patient discomfort. Suggested improvements included adding indicators of device performance and refining the cuff design. Conclusions: While the device was considered easy to use, paramedics also identified important areas of improvement. With a small, localized study sample, our findings are primarily applicable to the refinement of the RICovery system for use in future clinical trials in the same healthcare setting. However, feedback on the importance of mitigating potential interference of newly introduced procedures with those already established, robustness of equipment, and effective paramedic–patient communication may also help inform the design of other pre-hospital interventions.

The usability analysis of software loading tools in a commercial airline.

Aircraft software loading tools evolved as enhanced floppy disks and different types of portable data loaders emerged into the modern world. However, there was a lack of academic research centered on the usability of those tools. This study analyzed the usability of three aircraft software loading tools: floppy disks, Teledyne PMAT, and MBS mini PDL. A total of 20 avionics technicians answered 10 System Usability Scale (SUS) indicators and performed the software loading task. These professionals completed three sets of SUS questionnaires, one set for each software tool. Analysis of Variance (ANOVA) indicated that there were statistical differences in SUS score and completion time. The comparable SUS score and completion time pertained to the following tools: floppy disks & MBS mini PDL and Teledyne PMAT & MBS mini PDL. Pearson correlation analysis noted a significant positive relationship between SUS score & software tool. Moreover, there was a significant negative relationship between SUS score & completion time and software tool & completion time. However, avionics technicians' years of experience lacked a significant impact on SUS score and completion time. Ultimately, it was recommended to utilize MBS mini PDL. This aircraft loading tool had the most significant impact, highest SUS score, and fastest completion time. The researchers presented managerial implications if MBS mini PDL was utilized, including sales increase and overhead cost savings. Finally, this research was the first study that analyzed the usability of the commonly used aircraft software loading tools.

Evaluating the User Experience and Usability of the MINI Robot for Elderly Adults with Mild Dementia and Mild Cognitive Impairment: Insights and Recommendations

Introduction: In recent years, the integration of robotic systems into various aspects of daily life has become increasingly common. As these technologies continue to advance, ensuring user-friendly interfaces and seamless interactions becomes more essential. For social robots to genuinely provide lasting value to humans, a favourable user experience (UX) emerges as an essential prerequisite. This article aimed to evaluate the usability of the MINI robot, highlighting its strengths and areas for improvement based on user feedback and performance. Materials and Methods: In a controlled lab setting, a mixed-method qualitative study was conducted with ten individuals aged 65 and above diagnosed with mild dementia (MD) and mild cognitive impairment (MCI). Participants engaged in individual MINI robot interaction sessions, completing cognitive tasks as per written instructions. Video and audio recordings documented interactions, while post-session System Usability Scale (SUS) questionnaires quantified usability perception. Ethical guidelines were followed, ensuring informed consent, and the data underwent qualitative and quantitative analyses, contributing insights into the MINI robot’s usability for this demographic. Results: The study addresses the ongoing challenges that tasks present, especially for MD individuals, emphasizing the importance of user support. Most tasks require both verbal and physical interactions, indicating that MD individuals face challenges when switching response methods within subtasks. These complexities originate from the selection and use of response methods, including difficulties with voice recognition, tablet touch, and tactile sensors. These challenges persist across tasks, with individuals with MD struggling to comprehend task instructions and provide correct answers and individuals with MCI struggling to use response devices, often due to the limitations of the robot’s speech recognition. Technical shortcomings have been identified. The results of the SUS indicate positive perceptions, although there are lower ratings for instructor assistance and pre-use learning. The average SUS score of 68.3 places device usability in the “good” category. Conclusions: Our study examines the usability of the MINI robot, revealing strengths in quick learning, simple system and operation, and integration of features, while also highlighting areas for improvement. Careful design and modifications are essential for meaningful engagement with people with dementia. The robot could better benefit people with MD and MCI if clear, detailed instructions and instructor assistance were available.

Beyond videoconferencing: enhancing remote home assessments with 3D modeling technology

Purpose: Occupational therapists in the Veterans Health Administration have transitioned from in-person to videoconferencing for home assessments, benefiting Veterans living in remote and rural areas. However, videoconferencing has limitations, including restricted field of view and poor video quality, affecting hazard identification accuracy. This study aims to introduce and evaluate a three-dimensional (3D) model as an alternative technology for remote home assessments. Materials and methods: We created 3D models using a 360-degree camera and mobile app. Five occupational therapists individually completed virtual training and practice sessions to familiarize themselves with using the 3D model. Each participant then conducted a remote home assessment using the 3D model and completed questionnaires, System Usability Scale (SUS), and semi-structured interviews. Results: Participants spent an average of 10 min training and practicing with the 3D model, and most reported either maintaining or gaining confidence in using it compared to before. All participants successfully completed the assessments, which took an average of 17 min. They rated the 3D model as easy to use, with an average SUS score of 78.5. Participants preferred the 3D model over videoconferencing, noting that it effectively addressed current challenges, and expressed their willingness to integrate it into clinical practice. Conclusion: This study demonstrates that 3D models offer a promising option for remote home assessments. With minimal training, occupational therapists could conduct more effective assessments. It is recommended to use 3D models for an initial understanding of the home environment before videoconferencing-based assessments to enhance the remote assessment experience for occupational therapists and clients.

Development, Content Validity and Usability of a Self-Assessment Instrument for the Lifestyle of Breast Cancer Survivors in Brazil.

Breast cancer is the most common cancer among women globally, and it negatively impacts diet and quality of life, increasing the risk of recurrence. Adhering to World Cancer Research Fund (WCRF) and American Institute for Cancer Research (AICR) lifestyle guidelines, such as healthy eating habits and nutritional status, can help in primary and secondary cancer prevention. However, no questionnaire was found for self-assessment of these guidelines for the Brazilian population. The aim of this study is to carry out content validity, pilot, and usability testing of the self-administered digital instrument "PrevCancer" assessing adherence to the WCRF/AICR recommendations in Brazilian female breast cancer survivors. We conducted a psychometric study that involved the development of an instrument based on WCRF/AICR recommendations. Assessment of content validity involved the Content Validity Index (CVI) based on expert assessments (n = 7). The pilot study involved the System Usability Scale (SUS) after applying the developed instrument (n = 65) and anthropometric assessment for convergent validity by female participants (n = 55). The final usability test consisted of evaluating the satisfaction with the instrument of women with breast cancer (n = 14). The "PrevCancer" instrument demonstrated good content (CVI = 1.0) as well as good usability and acceptability in the pilot study (mean SUS score = 88.1). The convergent validity stage demonstrated positive associations between the PrevCancer parameters and anthropometric parameters (p < 0.001). In the final usability study (mean SUS score = 90.3), participants' receptivity to the instrument was excellent. The PrevCancer instrument had valid content and great usability by the target population, proving to be a useful tool for future cancer research.

Home-Based, Low-Intensity, Gamification-Based, Interactive Physical-Cognitive Training for Older Adults Using the ADDIE Model: Design, Development, and Evaluation of User Experience.

Declines in physical and cognitive function are natural biological processes, leading to an increased risk of falls. Promising evidence suggests that combined physical-cognitive exercise has beneficial effects in improving both physical and cognitive health. Although moderate-to-high exercise intensity is commonly recommended, it might be impractical for older adults facing physical limitations or contraindications. Thus, low-intensity exercise is a viable option. The main barriers to engaging in exercise in older adults include transportation, time, motivation, and enjoyment. To overcome these challenges, a home-based, gamification-based training system may provide an effective approach to enhance exercise adherence. This study aimed to develop and evaluate the usability of a low-intensity, gamification-based, interactive physical-cognitive exercise for older adults in a home-based setting. The prototype of a game-based physical-cognitive exercise was created following the ADDIE model (analysis, design, development, implementation, and evaluation) and assessed for user experience in older adults. A total of 15 older adults engaged in the game-based physical-cognitive exercise at home for 60 minutes per day, 3 days per week, for 4 weeks. The usability of the game-based training system was evaluated using the system usability scale (SUS) after completion of a 4-week training program. As for satisfaction, the 8-item Physical Activity Enjoyment Scale (PACES) questionnaire was used to assess participants' enjoyment level after 1 week and 4 weeks of training. Descriptive statistics were used to illustrate the SUS score. A Wilcoxon signed-rank test was used to compare the PACES scores between the first week and the end of the 4-week period, with significance set at P<.05. As for experts' consensus, the game-based training consisted of 3 games: Ocean Diver, Road Runner, and Moving and Memorizing. The games had 3 levels of difficulty: beginner, intermediate, and advanced. A computer vision-based system was selected as the delivery platform for a home setting. The total SUS score for all participants was mean 87.22 (SD 5.76), indicating the user's perception of the usability of a system ranging from good to excellent. At the end of the 4-week training, the total PACES score was significantly greater than the first week, suggesting an improvement in enjoyment (first week: mean 44.93, SD 3.99 vs fourth week: mean 50.53, SD 4.70; P=.001). The prototype of low-intensity, gamification-based, interactive physical-cognitive training was designed and developed using the ADDIE model, which included both experts and end users in the process. The findings showed that the exergame prototype was a usable and practical approach for a home-based setting, enhancing older adults' enjoyment and motivation. Further research is warranted to determine the effectiveness of such gamification-based training in promoting physical and cognitive functions.

Usability of an AI-based independent pedestrian navigation device designed for blind people

Abstract Background 2.2 billion people live with visual impairment (VI) worldwide and face orientation and mobility challenges in various aspects of their lives. Despite technological advancements, the most used mobility solutions for VI are still the walking cane and the guide dog. The objective of this research is to assess the system usability of an AI-based independent pedestrian navigation device (.lumen glasses), designed for blind people. Methods During 31st of October and 2nd of November 2023, 27 visually impaired people living in Bucharest, Romania, tested the .lumen glasses for 1-3 hours during an outdoor navigation task. The glasses use AI to recognize the user’s environment and haptic and audio feedback to guide them. The System Usability Scale (SUS), a 10-item instrument, was used to evaluate the level of usability the participants ascribe to the .lumen glasses. Qualitative feedback was collected as part of the post-test survey and analyzed using thematic analysis. Data were triangulated to identify usability issues. Results The mean age of the participants was 30.3 years old (SD = 12.07, min=21 max =56, range: 48), 55.6% (N = 15) of the participants were male, 96,3% (N = 26) were completely blind, and 81.5% were using a white cane for orientation and mobility. Our findings reveal a mean SUS score of 83.65 (SD = 15.23, range 47.5, min=52.5, max=100) indicating high usability. The thematic analysis revealed 5 themes: (1) auditive and (2) haptic feedback in navigation, (3) hardware (adjustment system &amp; buttons), (4) tutorial &amp; presentation of how the device works and (5) other aspects (usage in combination with other assistive technologies etc.). The participants declared that the glasses are intuitive to use and promote the feeling of safety and independence. Conclusions Data suggest that the .lumen glasses area promising assistive technology for the mobility of VI. Findings are currently used to steer the development and implementation of the AI-based system. Key messages • According to participants’ feedback, .lumen glasses are a scalable AI-based mobility solution that can make navigation and orientation easier for visually impaired individuals. • .lumen glasses designed for the visually impaired individuals are one of the current and limited assistive technology improving the mobility and orientation.

USABILITY TESTING ANALYSIS ON PROFESSIONAL SOCIAL MEDIA USING THE SYSTEM USABILITY SCALE (SUS) METHOD

Usability is a critical aspect of digital product design, which determines how effective, efficient, and satisfying a product is for its users. This research aims to evaluate the level of usability of digital applications in a professional context using the System Usability Scale (SUS) method. The SUS method was chosen for its ability to provide a quick and accurate assessment of the usability of a product or service. The test results show that the average SUS score of the respondents is 63, which is below the general average of 68. This score indicates that the tested digital product has a poor level of usability and requires improvement to increase user satisfaction.

Redesain UI UX Website Lemonder Indonesia Menggunakan Metode Design Thinking Untuk Meningkatkan Media Promosi

Lemonder Indonesia's website is designed to compete in the market for lemons, vegetables, and other high-quality fresh products. This website provides easy access to information about the company and its products for all users. The purpose of this research is to increase customer trust and improve the design of the Lemonder Indonesia website. The Design Thinking approach is used as a method for redesigning the website. This method includes five stages: Empathy, Define, Ideate, Prototype, and Testing. It focuses on consumer-centered innovation, emphasizing product and service designs that attract attention in the business world. During the testing phase, this research uses usability testing to evaluate the effectiveness of the website redesign. The System Usability Scale (SUS) involves using a questionnaire distributed via Google Forms. Before the redesign, the SUS score was 51.75%, which is a grade D with a "poor" indicator. However, after the redesign, the SUS score significantly increased to 85.08%, which is a grade A with an "excellent" indicator. This result demonstrates that the SUS testing in this research was successful and that the new design is well-received by users.

Development and Pilot Study of myfood24 West Africa—An Online Tool for Dietary Assessment in Nigeria

Background and objective: Tools to accurately and efficiently measure dietary intake in Nigeria are lacking. We aimed to develop and assess the usability of a new online dietary assessment tool for Nigeria—myfood24 West Africa. Methods: We developed the myfood24 West Africa database using data from existing food composition tables, packaged foods labels and research articles. The development followed seven steps: identified data sources, selected foods, processed/cleaned the data, calculated the nutrient content of recipes, created and allocated portion sizes, quality-checked the database and developed food accompaniments. To pilot the tool, we recruited 179 university staff in Nigeria using a cross-sectional design. Usability was assessed using a questionnaire that included the System Usability Scale (SUS) and a feedback session. Results: The database included 924 foods, with up to 54 nutrients and 35 portion-size images allocated to foods. Sixty percent of the data were sourced from the 2019 West Africa Food Composition Table, 17% from back-of-pack labels of packaged foods, 14% from the 2017 Nigerian Food Composition Table, 5% from generated recipes and 4% from the published literature. Of the participants, 30% (n = 53) self-recorded their food intake, with a total of 1345 food and drink entries from both self- and interviewer-collected data. The mean SUS score of 74 (95% CI: 68,79) indicated good usability. The feedback showed that the tool was user-friendly, educational and included a variety of local foods. Conclusions: This new tool will enhance the dietary assessment of the Nigerian population. More work will expand coverage to include more foods from the region.

Feasibility, acceptability, and fidelity of remote-delivered abbreviated mindfulness-based cognitive therapy interventions for patients with migraine and depressive symptoms.

This study was an open-label single-arm clinical trial evaluating the fidelity, feasibility, acceptability, and clinical signal of abbreviated mindfulness-based cognitive therapy (MBCT-brief) delivered either via telephone (MBCT-T) or by video conferencing (MBCT-V) for people with migraine and comorbid depressive symptoms. Migraine is commonly comorbid with elevated depressive symptoms. MBCT reduces depressive symptoms and shows promise to reduce migraine-related disability. An abbreviated and remotely delivered version of MBCT could increase access to care. People with migraine and elevated depressive symptoms were recruited from a large urban health system. Participants were assigned in blocks of eight to receive an evidence-based MBCT-brief treatment, including eight weekly group classes and home practice delivered via telephone (MBCT-T) or video (MBCT-V); MBCT-T was randomly selected for the first block. Sessions were recorded and coded for treatment fidelity. Feasibility was assessed via session attendance (primary), homework completion, recruitment rate, and survey completion rate. Acceptability was assessed via the eight-item Client Satisfaction Questionnaire (CSQ-8; primary), the Credibility/Expectancy Questionnaire (CEQ), the System Usability Scale (SUS), and items assessing survey acceptability. Participants completed the Headache Disability Inventory (HDI) and Quick Inventory of Depressive Symptomatology-Self Report 16-item (QIDS-SR16) at baseline, mid-treatment, and post-treatment. Feasibility and acceptability rates were compared to a priori benchmarks. Participants (n = 16) were all female with a mean (standard deviation [SD]) age of 45 (13) years, the majority of whom identified as White (13/16, 81%) and non-Hispanic (14/16, 88%). The intervention met the a priori criteria set for therapist fidelity to treatment protocol (mean [SD] MBCT-Treatment Acceptability and Competence Scale Adherence score 2.9 [0.2]), feasibility (mean [SD] session attendance was 7.9/8 [0.3]), and acceptability (mean [SD] CSQ-8 score 28.8 [3.3]) for the entire sample and for each treatment arm. The usability of the remote-delivery system was high across study participants (mean [SD] SUS score 84.8 [11.0]). Survey procedures were broadly deemed acceptable, with at least 80% participants either endorsing "Agree" or "Strongly Agree" across all items. Using Wilcoxon tests, we observed significant reductions in both the HDI (pre-treatment median [interquartile range] score 63 [40, 70] vs. post-treatment 36 [26, 54], p = 0.004) and the QIDS-SR16 (pre-treatment median [interquartile range] score 8 [5, 13] vs. post-treatment 4 [3, 6], p = 0.003). We found that remotely delivered MBCT-brief for migraine and depressive symptoms was feasible and acceptable to patients in both the telephone and video modalities. Intervention was associated with significant post-treatment reductions in headache-related disability and depressive symptomatology, findings that must be interpreted cautiously in the absence of a control group.

Integrating Real-Time Air Quality Monitoring, Ecological Momentary Assessment, and Spirometry to Evaluate Asthma Symptoms: Usability Study.

Individuals are exposed to a variety of indoor residential toxins including volatile organic compounds and particulates. In adults with asthma, such exposures are associated with asthma symptoms, asthma exacerbations, and decreased lung function. However, data on these exposures and asthma-related outcomes are generally collected at different times and not in real time. The integration of multiple platforms to collect real-time data on environmental exposure, asthma symptoms, and lung function has rarely been explored. This paper describes how adults with asthma perceive the acceptability and usability of three integrated devices: (1) residential indoor air quality monitor, (2) ecological momentary assessment (EMA) surveys delivered via a smartphone app, and (3) home spirometry, over 14 days. Participants (N=40) with uncontrolled asthma were mailed the Awair Omni indoor air quality monitor, ZEPHYRx home spirometer, and detailed instructions required for the in-home monitoring. The air quality monitor, spirometer, and EMA app were set up and tested during a videoconference or phone orientation with a research team member. Midway through the 14-day data collection period, participants completed an interview about the acceptability of the study devices or apps, instructional materials provided, and the setup process. At the end of the 14-day data collection period, participants completed a modified System Usability Scale. A random sample of 20 participants also completed a phone interview regarding the acceptability of the study and the impact of the study on their asthma. Participants ranged in age from 26 to 77 (mean 45, SD 13.5) years and were primarily female (n=36, 90%), White (n=26, 67%), college graduates (n=25, 66%), and residing in a single-family home (n=30, 75%). Most indicated that the air quality monitor (n=23, 58%), the EMA (n=20, 50%), and the spirometer (n=17, 43%) were easy to set up and use. Challenges with the EMA included repetitive surveys, surveys arriving during the night, and technical issues. While the home spirometer was identified as a plausible means to evaluate lung function in real time, the interpretation of the readings was unclear, and several participants reported side effects from home spirometer use. Overall, the acceptability of the study and the System Usability Scale scores were high. The study devices were highly acceptable and usable. Participant feedback was instrumental in identifying technical challenges that should be addressed in future studies.

A Study of Exergame System Using Hand Gestures for Wrist Flexibility Improvement for Tenosynovitis Prevention

Currently, as an increasing number of people have been addicted to using cellular phones, smartphone tenosynovitis has become common from long-term use of fingers for their operations. Hand exercise while playing video games, which is called exergame, can be a good solution to provide enjoyable daily exercise opportunities for its prevention, particularly, for young people. In this paper, we implemented a simple exergame system with a hand gesture recognition program made in Python using the Mediapipe library. We designed three sets of hand gestures to control the key operations to play the games as different exercises useful for tenosynovitis prevention. For evaluations, we prepared five video games running on a web browser and asked 10 students from Okayama and Hiroshima Universities, Japan, to play them and answer 10 questions in the questionnaire. Their playing results and System Usability Scale (SUS) scores confirmed the usability of the proposal, although we improved one gesture set to reduce its complexity. Moreover, by measuring the angles for maximum wrist movements, we found that the wrist flexibility was improved by playing the games, which verifies the effectiveness of the proposal.

Interactive Serious Game to Teach Basic Life Support Among Schoolchildren in Brazil: Design and Rationale.

Cardiovascular diseases are leading causes of death and morbidity worldwide. CPR and early defibrillation significantly enhance survival rates. Serious Games (SG) improve learning through entertainment. Current strategies target Cardiopulmonary resuscitation for communities and schoolchildren, but none have been validated for children in low-to-middle-income settings. The SG Children Save Hearts, developed in Brazil, teaches the five resuscitation steps according to International Liaison Committee on Resuscitation 2020 guidelines and requires formal usability assessment. The study aimed to evaluate the usability of SG Children Save Hearts among IT and healthcare professionals using the System Usability Scale (SUS). The usability test was conducted in August 2022 in the university's IT department. The game was developed targeting schoolchildren aged 7 to 17. Categorical variables as absolute and relative frequencies, while continuous variables were presented as median with interquartile range (IQR). Normality was assessed using the Shapiro-Wilk test. Comparisons between IT and healthcare professionals were made using the independent t-test for normal distributions or the Mann-Whitney U test for non-normal distributions. We included 17 volunteers with a mean age of 22 years (IQR 20-26). All participants played the game and completed a 10-question survey on its usability using a Likert-type scale. The final grade was converted to a 0 to 100 scale, with a grade above 70 considered acceptable for a minimum viable product. The mean SUS score was 75 (IQR 72.5-87.5). Healthcare professionals gave higher grades to all five domains compared to IT professionals. The average time spent playing the game was 3.2 minutes. Novel technologies have shown promising results for CPR teaching using active teaching methods, but face challenges in developing countries, such as language barriers, device acquisition, cultural differences, and technical support. To our knowledge, this is the first SG developed in portuguese for brazilian schoolchidren. Despite some usability issues, the SG Children Save Hearts is considered adequate for teaching CPR to schoolchildren in Brazil.

OWASP A03 Injection Vulnerability in Web Application Development

Web applications are crucial for businesses and individuals by providing efficient communication, collaboration, and access to services and information via browsers, boosting connectedness, productivity, and creativity in the digital era. Insecure web applications pose risks of data breaches, malware, and unauthorized access which jeopardize user privacy, trust, and organizational security. Web developers must be knowledgeable and prepared to deal with common vulnerabilities in web applications. A prototype web application (https://webriska3.tech) with lesson and editor module is developed to train web developers on the Open Web Application Security Project (OWASP) Top Ten security risks, focusing on A03 - Injection vulnerability. OWASP A03 Injection vulnerability is one of the most common vulnerabilities that is at the heart of any database-driven web applications. Evaluation on the prototype in improvement knowledge on A03 – Injection vulnerability, testers are recruited to complete two coding tasks in laboratory environment. 80% of testers mastered Output escaping/encoding defensive technique while Prepared statement/Parameterized Query defensive technique is the hardest to master. The prototype obtained average System Usability Scale (SUS) score of 57 that is below average, indicating issues with the prototype interface. This work showed promising results of increase understanding on A03 Injection vulnerability and implementation skills to protect web application against attack and exploitations.

B-192 Covid on the PCR Pro: a consumer-friendly PCR test

Abstract Background The emergence of COVID-19 highlighted the need for rapid and accurate diagnostic solutions that can be deployed on a broad scale. The complexity and long turn-around-time of PCR testing typically performed in molecular laboratories is not compatible with community-wide screening. To overcome these challenges, we present the Co-Dx PCR Pro™, a rapid and simple test platform developed for self-collection and at-home use. The instrument is controlled from the user’s smartphone or tablet and performs sample treatment, RT-PCR, and DNA melting analysis. An automatic calling algorithm provides a simple, “Detected,” or, “Not detected,” result. We demonstrate the utility of this platform using a test for the detection of SARS-COV-2. Methods A self-collected anterior nasal swab sample and 2 mLs of water are added to the collection cup. Closing the lid of the cup initiates rehydrating a dried Proteinase K mixture to digest proteins in the sample. After a brief Proteinase K heat-kill step, the instrument mixes the sample with a dried PCR master mix. Primers target two SARS-COV-2 specific genes (RdRp and E gene) and the human RNase P gene as a control. The sample undergoes an RT step followed by 45 cycles of PCR and DNA melting analysis. Detection is by an automatic calling algorithm that identifies a SARS-COV-2 amplicon melting peak at 82°C and RNase P peak at 87°C. The total runtime is less than 30 minutes. The limit of detection for the assay was assessed by contriving intact virus in negative sample matrix, which was then applied to dry swabs. In addition, frozen and banked clinical samples were tested using the Logix Smart®™ Covid-19 test as a comparator assay. A third party performed a usability assessment by having (1) naïve users follow the instructions and self-administer the test (2) expert trained users perform an independent assessment of the assay. Participants were then asked to complete a usability assessment. Results The 95% limit of detection was 2,100 copies/swab using contrived nasal swabs. Clinical samples were blinded to the operator and run on the platform. All samples resulted in a diagnosis concordant with the comparator assay. The usability assessment was performed by six naïve users and resulted in a systems usability scale score of “Best” (84.2 ± 14.3, out of 100). The two expert users determined an 80% limit of detection of 700 genome equivalents and “ease of use,” and “satisfaction,” scores of 4.5/5.0 and 5.0/5.0, respectively. Conclusions Performance of the PCR Pro platform is on par with laboratory-based PCR testing. The benefits of our assay are its speed and the low complexity platform accessible to the lay. This platform could improve access to molecular diagnostic testing, including use at home. Future expansion to include common respiratory pathogens (Flu, RSV, Strep) will increase utility. Additionally, anonymized results can be aggregated and provide a wealth of epidemiological information at the community level to better inform public health initiatives and health outcomes.

Pharmacogenomic augmented machine learning in electronic health record alerts: A health system-wide usability survey of clinicians.

Pharmacogenomic (PGx) biomarkers integrated using machine learning can be embedded within the electronic health record (EHR) to provide clinicians with individualized predictions of drug treatment outcomes. Currently, however, drug alerts in the EHR are largely generic (not patient-specific) and contribute to increased clinician stress and burnout. Improving the usability of PGx alerts is an urgent need. Therefore, this work aimed to identify principles for optimal PGx alert design through a health-system-wide, mixed-methods study. Clinicians representing multiple practices and care settings (N = 1062) in urban, rural, and underserved regions were invited to complete an electronic survey comparing the usability of three drug alerts for citalopram, as a case study. Alert 1 contained a generic warning of pharmacogenomic effects on citalopram metabolism. Alerts 2 and 3 provided patient-specific predictions of citalopram efficacy with varying depth of information. Primary outcomes included the System's Usability Scale score (0-100 points) of each alert, the perceived impact of each alert on stress and decision-making, and clinicians' suggestions for alert improvement. Secondary outcomes included the assessment of alert preference by clinician age, practice type, and geographic setting. Qualitative information was captured to provide context to quantitative information. The final cohort comprised 305 geographically and clinically diverse clinicians. A simplified, individualized alert (Alert 2) was perceived as beneficial for decision-making and stress compared with a more detailed version (Alert 3) and the generic alert (Alert 1) regardless of age, practice type, or geographic setting. Findings emphasize the need for clinician-guided design of PGx alerts in the era of digital medicine.

An effective farmer-centred mobile intelligence solution using lightweight deep learning for integrated wheat pest management

Integrated Pest Management (IPM) techniques have been widely used in agriculture to manage pest damage in the most economical way and to minimise harm to people, property and the environment. However, current research and products on the market cannot consolidate this process. Most existing solutions either require experts to visually identify pests or cannot automatically assess pest levels and make decisions based on detection results. To make the process from pest identification to pest management decision making more automated and intelligent, we propose an end-to-end integrated pest management solution that uses deep learning for semi-automated pest detection and an expert system for pest management decision making. Specifically, a low computational cost sampling point generation algorithm is proposed to enable mobile devices to generate uniformly distributed sampling points in irregularly shaped fields. We build a pest detection model based on YoloX and use Pytorch Mobile to deploy it on mobile phones, allowing users to detect pests offline. We develop a standardised sampling specification and a mobile application to guide users to take photos that allow pest population density to be calculated. A rule-based expert system is established to derive pest management thresholds from prior agricultural knowledge and make decisions based on pest detection results. We also propose a human-in-the-loop algorithm to continuously track and update the validity of the thresholds in the expert system. The mean average precision of the pest detection model is 58.17% for 97 classes, 75.29% for 2 classes, and 57.33% for 11 classes on three pest datasets, respectively. The usability of the pest management system is assessed by the User Experience Surveys and achieves a System Usability Scale (SUS) score of 76. The usability of the proposed solution is validated by qualitative field experiments.