Post-Study System Usability Questionnaire Research Articles

A Geospatial Drug Abuse Risk Assessment and Monitoring Dashboard Tailored for School Students: Development Study With Requirement Analysis and Acceptance Evaluation.

The enormous consequences of drugs include suicides, traffic accidents, and violence, affecting the individual, family, society, and country. Therefore, it is necessary to constantly identify and monitor the drug abuse rate among school-going youth. A geospatial dashboard is vital for the monitoring of drug abuse and related crime incidence in a decision support system. This paper mainly focuses on developing MyAsriGeo, a geospatial drug abuse risk assessment and monitoring dashboard tailored for school students. It introduces innovative functionality, seamlessly orchestrating the assessment of drug abuse usage patterns and risks using multivariate student data. A geospatial drug abuse dashboard for monitoring and analysis was designed and developed in this study based on agile methodology and prototyping. Using focus group and interviews, we first examined and gathered the requirements, feedback, and user approval of the MyAsriGeo dashboard. Experts and stakeholders such as the National Anti-Drugs Agency, police, the Federal Department of Town and Country Planning, school instructors, students, and researchers were among those who responded. A total of 20 specialists were involved in the requirement analysis and acceptance evaluation of the pilot and final version of the dashboard. The evaluation sought to identify various user acceptance aspects, such as ease of use and usefulness, for both the pilot and final versions, and 2 additional factors based on the Post-Study System Usability Questionnaire and Task-Technology Fit models were enlisted to assess the interface quality and dashboard sufficiency for the final version. The MyAsriGeo geospatial dashboard was designed to meet the needs of all user types, as identified through a requirement gathering process. It includes several key functions, such as a geospatial map that shows the locations of high-risk areas for drug abuse, data on drug abuse among students, tools for assessing the risk of drug abuse in different areas, demographic information, and a self-problem test. It also includes the Alcohol, Smoking, and Substance Involvement Screening Test and its risk assessment to help users understand and interpret the results of student risk. The initial prototype and final version of the dashboard were evaluated by 20 experts, which revealed a significant improvement in the ease of use (P=.047) and usefulness (P=.02) factors and showed a high acceptance mean scores for ease of use (4.2), usefulness (4.46), interface quality (4.29), and sufficiency (4.13). The MyAsriGeo geospatial dashboard is useful for monitoring and analyzing drug abuse among school-going youth in Malaysia. It was developed based on the needs of various stakeholders and includes a range of functions. The dashboard was evaluated by a group of experts. Overall, the MyAsriGeo geospatial dashboard is a valuable resource for helping stakeholders understand and respond to the issue of drug abuse among youth.

Design and evaluation of a serious video game to treat preschool children with speech sound disorders

Speech sound disorder (SSD) is one of the most common communication disorders in children, which must be diagnosed and treated in childhood to prevent its negative psychological, occupational, and social consequences in adulthood. The use of serious games is one technology that could help treat SSD. This study aims to design and evaluate the usability of a digital game for 3–6-year-old children. This developmental study was carried out in three main stages: determining information requirements, designing and developing a digital game, and evaluating the usability of the designed game. In the first stage, the consonants, syllables, words, and sentences that should be used in the game were determined through focus group sessions and a questionnaire completed by 30 speech-language pathologists (SLPs) in two Delphi rounds. In the designing and developing stage, the game design document was first written, and then sketches and wireframes were drawn based on this document. Then, the game was developed in the second phase using Java programming language. In the third stage, the usability of the designed game was evaluated by six experts and 22 SLPs using Nielsen's usability heuristics and the Post-Study System Usability Questionnaire (PSSUQ), respectively. Also, the usability of the game was evaluated by ten children. To determine the information requirements, SLPs confirmed 23 consonants, 138 syllables, 564 words, and 69 sentences to teach children the game. According to Nielsen's usability heuristics, the designed game had 23 unique usability problems with a mean severity of 2.29. "User control and freedom," with five usability problems, was the most frequently identified problem, and "error prevention," with a mean severity of 3.83, was the most severe problem. The results of the SLPs’ evaluation also showed that the "interface quality" of the designed game obtained the highest score, with a mean score of 6.25 out of 7. Also, 100% of children stated that the game was designed beautifully, and 90% of children also liked the game. A serious game designed for children with SSDs achieved satisfactory results in usability evaluation. Therefore, this smartphone-based game can be easily used among these children to provide fun therapy sessions under the supervision of parents.

Usability of novel beat-by-beat ECG annotation software portal for generating large-scale machine learning training datasets

Abstract Introduction Despite the availability of numerous large publicly available ECG datasets, there is a distinct absence of specialized software to enable the beat-by-beat annotation and labeling, limiting the ability to generate high-quality machine learning training datasets. This study analyzed the usability of such a novel software interface. Through a survey of several cardiologists and clinic staff, several metrics were gauged, including user satisfaction, system and app simplicity, user interface, and effectiveness. The survey results gleaned insight into the users’ experiences, providing an understanding of the software’s user-friendliness and potential in developing a large-scale machine learning annotated ECG training dataset to advance cardiac health research. Methods 3 cardiology physicians, and 9 cardiac telemetry unit staff were surveyed following use of the SafeBeat Annotation Software Platform to annotate a large publicly available dataset ECGs (n=10,646) beat-by-beat. The validated Post-Study System Usability Questionnaire (PSSUQ) and mobile Health App Usability Questionnaire (MAUQ) were used to assess the overall usability of the software interface. Results are reported as mean ± standard deviation. Results Users completed 10,646 ECG beat-by-beat annotations in 62 days, and averaged 164.0 ECGs per day. Physicians rated the software interface highly, with an overall mean PSSUQ of 6.4 ± 0.8 and MAUQ of 6.4 ± 0.7. Staff also rated the software interface highly, with an overall mean PSSUQ of 6.7 ± 0.6 and MAUQ of 6.8 ± 0.5. Overall 92% of the users reported that they strongly agreed they would use the application again and 83% strongly agreed that it was easy to learn how to use the system. Conclusion The usability analysis of this novel beat-by-beat ECG annotation software revealed that it was a highly effective tool for both cardiologists and clinic staff. Both the system and app were reported to be simple to learn, comfortable to use, and easily navigable. With most users responding that they could become productive quickly using this system, there is clear potential for it to be used to develop a large-scale machine learning dataset.Figure 1

Evaluating the Usability and Safety of Virtual Reality Application Combined with the SWalker for Functional Gait Rehabilitation.

Objective: This research evaluates from a usability point of view the combination of a developed fully immersive virtual reality (VR) solution with the SWalker robotic device. It aims to contribute to research in the exploration of immersive experiences overground with a functional gait recovery device. Materials and Methods: We evaluated the system in a pilot study with 20 healthy participants aged 85.1 (SD: 6.29). Participants used the SWalker-VR platform while testing one VR application focused on walking and the other on balance practice. Afterward, the participants answered three usability questionnaires. Results: The platform was validated in terms of safety using the Simulator Sickness Questionnaire, obtaining less than 20 points for all subscales: nausea (4.29 ± 14.47), oculomotor (0.38 ± 14.18), and disorientation (1.39 ± 14.52). For usability evaluation, the System Usability Scale provided an overall score of 70.63 ± 11.64, and the Post-Study System Usability Questionnaire (PSSUQ) rated 1.61 ± 0.54. The usability scores reported by both questionnaires were moderate and good, respectively. These results were similar in overall scores for both groups: participants with low cognitive level and participants with high cognitive level. Finally, the possible causes for the "no answered" responses on the PSSUQ were discussed. Conclusion: It is concluded that the SWalker-VR platform is reported to have adequate usability and high security by older adults. The potential interest of studying the effects of the long-term use of this platform by older adults with gait impairment is expressed. Clinical Trials reference: NCT06025981.

Intellischool: A Student Information System for Senior High School

An IntelliSchool: A Student Information System (SIS) for Senior High School (SHS) is a software application intended to oversee and simplify different aspects of student-related academic information efficiently. This study aimed to ensure data accuracy and consistency, develop a paperless and web-based class record, ensure fairness and transparency in generating forms, and enhance parent-school communication and involvement by incorporating a messaging system. Descriptive-developmental approach was employed in this study. Interviews and direct observation of transaction processes were used as data collection methods in developmental approach. The software development life cycle (SDLC) adopted was Rapid Application Development (RAD), encompassing stages from requirements planning, user design, development, and system launch. The system was developed using Code Igniter PHP Framework, MySql, JQuery, and Code Espresso SMS Gateway technologies. In descriptive approach, test case to check systems functionality and Post Study System Usability Questionnaire (PSSUQ) were administered sequentially to 5 IT experts and 35 end-users. In data analysis, standard mean was employed. The test case obtained "passed" rating. In PSSUQ, overall mean is 1.21 across system usefulness, interface quality, and information quality. The system has undergone pilot implementation through locally hosted network infrastructure, fulfilling its intended nature and purpose. The recommendation was to use a server that accommodates users without sacrificing the system’s performance.

A Combination of Three Scales for Measuring User-Perceived Usability of a Clinical Information System: Which Approach Produces the Most Informative Results?

Introduction: For the first time in Iran, a kidney stone clinical information system (CIS) has been designed to manage and calculate and visualize patients’ kidney stone risk profiles. Nevertheless, the usability of this system has not been evaluated yet. Medically, this study aims to evaluate the user-perceived usability of the kidney stone CIS. Technically, the current study aims to determine which user-perceived usability testing approach produces the most informative results about the usability of this system.Material and Methods: Three questionnaires, including system usability scale (SUS), software usability measurement inventory (SUMI), and post-study system usability questionnaire, were applied to carry out the study. A total of 15 users of the kidney stone CIS participated.Results: The findings revealed that the system is of medium usability. Moreover, of the three methods used, the SUMI echoes the comments of the end-users. Despite the medium usability of the system, it was comprehensive in terms of proper data collection and storage, as well as reporting. The interface design, the lack of appropriate guidance, the time-consuming data entry, and the slow reporting system were aspects needed improvement.Conclusion: Using a combination of tools is recommended for usability evaluation. Since there is much space in the Global and each sub-scale, whereby measures may improve with SUMI, this research recommends its use for future evaluation of the kidney stone CIS.

Factors Influencing Integration and Usability of Model-Informed Precision Dosing Software in the Intensive Care Unit.

Antimicrobial dosing in critically ill patients is challenging and model-informed precision dosing (MIPD) software may be used to optimize dosing in these patients. However, few intensive care units (ICU) currently adopt MIPD software use. To determine the usability of MIPD software perceived by ICU clinicians and identify implementation barriers and enablers of software in the ICU. Clinicians (pharmacists and medical staff) who participated in a wider multicenter study using MIPD software were invited to participate in this mixed-method study. Participants scored the industry validated Post-study System Usability Questionnaire (PSSUQ, assessing software usability) and Technology Acceptance Model 2 (TAM2, assessing factors impacting software acceptance) survey. Semistructured interviews were used to explore survey responses. The framework approach was used to identify factors influencing software usability and integration into the ICU from the survey and interview data. Seven of the eight eligible clinicians agreed to participate in the study. The PSSUQ usability scores ranked poorer than the reference norms (2.95 vs. 2.62). The TAM2 survey favorably ranked acceptance in all domains, except image. Qualitatively, key enablers to workflow integration included clear and accessible data entry, visual representation of recommendations, involvement of specialist clinicians, and local governance of software use. Barriers included rigid data entry systems and nonconformity of recommendations to local practices. Participants scored the MIPD software below the threshold that implies good usability. Factors such as availability of software support by specialist clinicians was important to participants while rigid data entry was found to be a deterrent.

Evaluation of The Usability of Virtual Reality as An Educational Tool for Nursing Student Simulators

Technology-based simulation learning methods have great potential to support education for students in the health sector. One of the innovations that can be done is virtual reality. In using virtual reality, paying attention to the quality of virtual reality services to provide learning satisfaction and motivate students to be active in the learning process is essential. VNursLab designed VR as an additional learning media for Padjadjaran University nursing students. Therefore, this study aims to identify nursing students' satisfaction with using VR as a learning media simulator.The method used is pre-experimental quantitative research and a one-shot case study approach. The sampling used in the study was purposive. Eighty-six respondents completed the research by following the VR simulation for 20 minutes and continued filling out the PSSUQ (Post-Study System Usability Questionnaire) questionnaire. The data were analyzed using descriptive analytics by finding the mean value of each aspect of the assessment obtained from the mean of each element of the respondent. The results show that the overall quality of VR VNursLab is good (2.2), with a mean value of system quality (2.3), mean InfoQual (2.21), and IntQual (2.28). Based on these results, VR VNursLab as a learning media with virtual simulation methods has a good quality of use assessment and provides satisfaction with nursing students' use.

Validation of a Thai artificial chatmate designed for cheering up the elderly during the COVID-19 pandemic.

The COVID-19 pandemic severely affected populations of all age groups. The elderly are a high-risk group and are highly vulnerable to COVID-19. Assistive software chatbots can enhance the mental health status of the elderly by providing support and companionship. The objective of this study was to validate a Thai artificial chatmate for the elderly during the COVID-19 pandemic and floods. Chatbot design includes the establishment of a dataset and emotional word vectors in which data consisting of emotional sentences were converted into the word vector form using a pre-trained word2vec model. A word vector was then input into a convolutional neural network (CNN) and trained until the model converges using sentence embedding and similarity word segmentation. Sentence vectors were generated by averaging each word vector using an averaged vector method. For approximate similarity matching, the Annoy library was used to create the indices in tree sorting. Data were collected from 22 elderly and assessed by the Post-Study System Usability Questionnaire (PSSUQ). The study revealed that 72.73% of the respondents found the chatbot easy to learn and use, 63.64% of the respondents found the chatbot can autonomously determine the next course of action, and 59.09% of the respondents believed that troubleshooting guidelines were provided for overcoming errors. The accuracy of the chatbot providing a reasonable response is 56.20±13.99%. Most users were satisfied with the chatbot system. The proposed chatbot provided considerable essential insights into the development of assistance systems for the elderly during the coronavirus pandemic (COVID-19) and during the period of national disasters. The model can be expanded to other applications in the future.

Pre-Implementation Analysis of the Usability and Acceptability of a Poststroke Complex Telehealth Biofeedback Intervention.

Complex telehealth interventions can facilitate remote occupational therapy services and improve access for people living with chronic neurological conditions. Understanding the factors that influence the uptake of these technologies is important. To explore the fit between electromyography (EMG) biofeedback and telerehabilitation for stroke survivors, optimize EMG biofeedback interventions, and, more broadly, support other efforts to develop complex telerehabilitation interventions. Pre-implementation mixed-methods analysis of usability and acceptability data collected during a pilot and feasibility study. Community. Adult stroke survivors with hemiparesis (N = 11; M age = 54 yr). Game-based EMG biofeedback system for arm sensorimotor rehabilitation, delivered via telehealth. Post-Study System Usability Questionnaire, an extended Unified Theory of Acceptance and Use of Technology model questionnaire, and semistructured interview. We coded the interview data using questionnaire constructs. Participants used an EMG biofeedback intervention at home. Quantitative measures show high levels of perceived usability and acceptability, supported by qualitative findings describing specific facilitators and barriers. Pre-implementation studies can improve the design and relevance of complex telehealth interventions. One major conclusion from this study is the influence of therapy providers on acceptability and usability of complex telehealth interventions. Plain-Language Summary: This study contributes to an emerging body of literature that examines the use of complex telehealth interventions with survivors of neurological injury. The findings highlight the value and support the development and use of complex telehealth interventions, which have the potential to improve remote access to occupational therapy for clients living with chronic neurological conditions. Complex telehealth interventions can open doors for survivors of neurological injury who face barriers to accessing occupational therapy and would benefit from technology-enabled therapy at home.

Design and Development of e-MARZ: A Practical Guide to Implementing Cost-effective VR Experiences for Music Education

The study introduces e-MARZ, a Virtual Reality (VR) software designed to tackle challenges faced by music educators in enhancing music appreciation lessons within the Malaysian lower secondary school music curriculum. The research aims to improve student engagement, provide immersive and interactive learning experiences, and develop a user-friendly VR application. A video production process was employed to create 360-degree music performance videos, which were integrated into the e-MARZ software via interactive modules. This article mainly discusses the development and evaluation aspects, utilising the modified ADDIE Instructional model, m-ADDIE, during the development phase. The e-MARZ prototype underwent evaluation using the System Usability Scale (SUS) and the Post-Study System Usability Questionnaire (PSSUQ) for quantitative data collection and analysis to assess usability, with a sample of five music education experts and 82 secondary school music students. Limitations of the study include the use of 360 media of live performances tailored for secondary school students' music appreciation and employing 3DOF (degrees of freedom) instead of the more advanced 6DOF, potentially impacting the generalisability of findings and the scope of achievable VR experiences. Despite these limitations, the high usability scores obtained during the evaluation, as measured by SUS and PSSUQ, indicate the software's effectiveness in addressing its intended challenges. The e-MARZ software offers an immersive, user-friendly VR experience that is cost-effective and compatible with various devices. This research provides insights into producing cost-effective, user-friendly VR applications using 360 media, promoting accessible VR application development in education. As a result, the study transforms students' engagement with music appreciation, fostering a more immersive, interactive, and enjoyable learning experience.

Validation of a Thai artificial chatmate designed for cheering up the elderly during the COVID-19 pandemic

Background The COVID-19 pandemic severely affected populations of all age groups. The elderly are a high-risk group and are highly vulnerable to COVID-19. Assistive software chatbots can enhance the mental health status of the elderly by providing support and companionship. The objective of this study was to validate a Thai artificial chatmate for the elderly during the COVID-19 pandemic and floods. Methods Chatbot design includes the establishment of a dataset and emotional word vectors in which data consisting of emotional sentences were converted into the word vector form using a pre-trained word2vec model. A word vector was then input into a convolutional neural network (CNN) and trained until the model converges using sentence embedding and similarity word segmentation. Sentence vectors were generated by averaging each word vector using an averaged vector method. For approximate similarity matching, the Annoy library was used to create the indices in tree sorting. Data were collected from 22 elderly and assessed by the Post-Study System Usability Questionnaire (PSSUQ). Results The study revealed that 72.73% of the respondents found the chatbot easy to learn and use, 63.64% of the respondents found the chatbot can autonomously determine the next course of action, and 59.09% of the respondents believed that troubleshooting guidelines were provided for overcoming errors. The accuracy of the chatbot providing a reasonable response is 56.20±13.99%. Conclusions Most users were satisfied with the chatbot system. The proposed chatbot provided considerable essential insights into the development of assistance systems for the elderly during the coronavirus pandemic (COVID-19) and during the period of national disasters. The model can be expanded to other applications in the future.

Redesigning UI/UX Of Itenas Online Graduation Registration Website Using Lean UX And Post-Study System Usability Questionnaire

Rapid advancement of Information Technology has accelerated the flow of information and data. The National Institute of Technology (Itenas) has improved its services with an online graduation registration system (Pendaftaran Wisuda Online). However, based on observations and the result of Post-Study System Usability Questionnaire (PSSUQ) revealed negative experiences on the website. Based on PSSUQ scores, where lower values indicate better performance, it averaged 3.31 for SYSUSE, 3.41 for INFOQUAL, and 3.71 for INTERQUAL, all of which exceeded the Upper Limit of PSSUQ. This suggests room for enhancing usability and user experience. Addressing this, a study focused on redesigning Itenas’ Graduation Registration website using the Lean UX approach and evaluating it through Usability Testing and PSSUQ. The results of usability testing included effectiveness, efficiency, and satisfaction aspects. Effectiveness scored 90.5%, surpassing the 78% average. Efficiency achieved a time of 0.0658 goal/seconds. For the satisfaction aspect, assessed by PSSUQ, achieved significant results, where all sub-scales received scores below the Lower Limit, indicating excellent performance, showed excellent performance with scores below the Lower Limit. SYSUSE scored 1.55, INFOQUAL 1.92, INTERQUAL 1.38, and OVERALL, 1.65. These results indicate that UI/UX improvements fulfilled user needs, marking a successful overhaul of the Itenas Graduation Registration website.

Multiplatform web app (My Way Up) plus motivational interviewing for improving treatment retention in patients with onset of alcohol-related liver disease and alcohol use disorder - an example of participatory research.

With the aim of improving treatment retention in patients with the onset of alcohol-related liver disease (ArLD), we designed a blended intervention (brief motivational intervention + 'serious game' (SG)). We present the participatory design methodology and outcomes and the usability assessment of the intervention. (1) The design of the SG was based on the outcomes of two 3-h co-creation sessions with 37 participants (healthcare and technology professionals, patients, and patients' relatives). The brief face-to-face motivational intervention was based on the 5 As Model and adapted to the ArLD population. (2) Usability pilot study: 20 participants (10 ArLD patients + 10 healthcare professionals) received the intervention. System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ) were applied to assess the SG usability and patients' satisfaction with it. Weekly semi-structured interviews on the phone were conducted to identify the preferred elements in the SG and those aspects that should be improved. (1) Design: an SG in the form of a gamified web app, consisting of a daily activity for six weeks and adapted brief motivational interviewing. (2) Usability pilot study: usability results were excellent for both patients and healthcare professionals (SUS median score = 85). The general usability, the quality of the information provided by the SG and the quality of the interface were very positively rated in the PSSUQ (overall median score = 2, IQR = 1-2). The best-rated aspects were the provision of feedback, the use of metaphors and the application of audiovisual material. Changes in the design, response mechanics and content were applied after the study. The usability and acceptability of an intervention for increasing retention to treatment in patients with recent onset of ArLD and AUD were excellent for patients and healthcare professionals. A randomized-controlled trial is required to test the efficacy of this approach.

The most used questionnaires for evaluating the usability of robots and smart wearables: A scoping review.

As the field of robotics and smart wearables continues to advance rapidly, the evaluation of their usability becomes paramount. Researchers may encounter difficulty in finding a suitable questionnaire for evaluating the usability of robotics and smart wearables. Therefore, the aim of this study is to identify the most commonly utilized questionnaires for assessing the usability of robots and smart wearables. A comprehensive search of databases, including PubMed, Web of Science, and Scopus, was conducted for this scoping review. Two authors performed the selection of articles and data extraction using a 10-field data extraction form. In cases of disagreements, a third author was consulted to reach a consensus. The inclusions were English-language original research articles that utilized validated questionnaires to assess the usability of healthcare robots and smart wearables. The exclusions comprised review articles, non-English publications, studies not focused on usability, those assessing clinical outcomes, articles lacking questionnaire details, and those using non-validated or researcher-made questionnaires. Descriptive statistics methods (frequency and percentage), were employed to analyze the data. A total of 314 articles were obtained, and after eliminating irrelevant and duplicate articles, a final selection of 50 articles was included in this review. A total of 17 questionnaires were identified to evaluate the usability of robots and smart wearables, with 10 questionnaires specifically for wearables and 7 questionnaires for robots. The System Usability Scale (50%) and Post-Study System Usability Questionnaire (19.44%) were the predominant questionnaires utilized to assess the usability of smart wearables. Moreover, the most commonly used questionnaires for evaluating the usability of robots were the System Usability Scale (56.66%), User Experience Questionnaire (16.66%), and Quebec User Evaluation of Satisfaction with Assistive Technology (10%). Commonly employed questionnaires serve as valuable tools in assessing the usability of robots and smart wearables, aiding in the refinement and optimization of these technologies for enhanced user experiences. By incorporating user feedback and insights, designers can strive towards creating more intuitive and effective robotic and wearable solutions.

A MOBILE LEARNING APPLICATION TO FOSTER SUSTAINABLE AGRICULTURE THROUGH HYDROPONICS: DEVELOPMENT AND USABILITY TESTING

This study explores the development and usability testing of a mobile learning application tailored to provide an engaging educational experience in hydroponics for school children aged 12 years and below. The challenges faced by the agricultural education sector in capturing the interest and participation of the younger generation, where conventional methods have often struggled to engage and inspire. Embracing the principles of design thinking, this research seeks to bridge the gap in agriculture education, addressing the unique needs and preferences of younger learners in the digital age. A mobile learning application was developed, designed to combine the principles of hydroponics with interactive digital learning experiences. The design thinking methodology guided the iterative development process, placing a strong emphasis on user-centred design. The usability of the mobile learning application was assessed using the Post-Study System Usability Questionnaire (PSSUQ). Results of the usability testing revealed high levels of usability and user satisfaction among participants. The application's usefulness, user-friendly interface, engaging content, that aligned with educational objectives were among the factors contributing to its positive reception. The mobile learning application serves as a promising solution to enhance agriculture education, making hydroponics an accessible and engaging subject for school children. As a result, this research contributes to the broader goal of fostering sustainable agriculture and environmental consciousness among future generations.

USABILITY TESTING OF THE PACE APP TO SUPPORT FAMILY CAREGIVERS IN MANAGING PAIN FOR PEOPLE WITH DEMENTIA

Abstract Pain is a common symptom in older adults with Alzheimer’s Disease and Related Dementias (ADRD). It is difficult to assess and is often undertreated in people with ADRD. The PACE-app (Pain Control Enhancement application, was developed to enhance self-efficacy of family caregivers when controlling the pain of their care partner. The objective of this study was to test the usability of the PACE-app with family caregivers and clinicians. We evaluated the usability of the PACE-app. Participants (17 family caregivers, 6 clinicians) took part in a mixed-methods study that included a one-time recorded zoom meeting with standardized semi-structured guided review, interview, and a survey specific to their role. The Post-Study System Usability Questionnaire (PSSUQ) was used to measure usability. The overall PSSUQ score we found was 1.9. The range of scores can be between 1 and 7 with the lower numbers meaning favorable usability. The qualitative interviews showed a favorable user experience with 75% of all participants feeling the overall design was effective; 48% felt the tailored pain management strategies were useful; 24% suggested improving the app by having direct coaching information for the family caregiver. This study demonstrated favorable usability with those who tested the PACE-app. Suggestions for improvement were given and using the interview results in conjunction with the PSSUQ scores, we are able to make changes to the app interface to impact the overall design to enhance user experience.

IMPLEMENTATION OF BRAINCHECK FOR COGNITIVE ASSESSMENT AND CARE PLANNING IN THE CLINICAL SETTING

Abstract With the growth of the older adult population (age ≥ 65 years), age-associated neurocognitive disorders, such as Alzheimer’s disease and related dementias (ADRD), are becoming more common in America and worldwide. The increasing number of patients has surpassed the capacity of healthcare systems. Thus, there is a need for time-efficient, cost-effective solutions for better allocation of limited clinical resources that can benefit clinicians and patients. Here, we conducted a quality improvement study in collaboration with Savannah Neurology Specialists and Dent Neurologic Institute. We evaluated users’ perspectives on the usability and feasibility of implementing BrainCheck, a computerized tool for cognitive assessment and care planning. One neurologist and their team from each institute received 45 minutes of training on BrainCheck and used it on an iPad from mid-November to the end of December 2022. In total, 49 patients have completed BrainCheck Cognitive Assessment, and 7 of them also completed BrainCheck Cognitive Care Planning during the study period. On average, it took 13-18 minutes to administer BrainCheck Cognitive Assessment, interpret the result, and document it in EHR. The majority of patients (96%) reported satisfaction with the testing experience and found the instructions easy to understand. Both providers reported high usability of BrainCheck (6.2/7.0) as measured by the Post-Study System Usability Questionnaire. These results demonstrate the great potential of BrainCheck for clinical use, as it can support providers in assessing the cognitive function of their patients in a timely and efficient manner.

Integrated Immunization Information System in Indonesia: Prototype Design Using Quantitative and Qualitative Data.

As the volume of immunization records increases, problems with fragmented records arise, especially since the majority of records in developing countries, including Indonesia, remain paper based. Implementing an immunization information system (IIS) offers a solution to this problem. In this study, we designed an integrated IIS prototype in Indonesia using the design science research (DSR) methodology. The stages of the DSR methodology followed in this study included identifying problems and motivating and defining objectives for a solution, design and development, demonstration, evaluation, communication, and drawing conclusions and suggestions. Specifically, this study began with problem formulation and a literature review. We then applied quantitative (questionnaire with 305 members of the public) and qualitative (interviews with 15 health workers including nurses, midwives, and doctors) data collection approaches. The resulting high-fidelity prototype follows the 8 golden rules. There are 2 IIS designs, one for the public as immunization recipients and another for health workers. The functionalities include immunization history, schedule, recommendations, verification, certificates, reminders and recalls, coverage, monitoring, news, and reports of adverse events. Evaluation of the prototype was carried out through interviews and a questionnaire designed according to the System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ). The SUS value was 72.5 or "Good (Acceptable)," while the system usefulness, information quality, interface quality, and overall value on the PSSUQ were 2.65, 2.94, 2.48, and 2.71, respectively, which indicate it has an effective design. This provides a guide for health facilities, health regulators, and health application developers on how to implement an integrated IIS in Indonesia.

Design and Development of a Reading Assessment Manager


 
 
 
 An alarming result from the 2018 Programme for International Pupil Assessment (PISA) revealed that the Philippines ranked lowest among the other 79 countries that participated in the assessment. This pushed the Department of Education to create reinforcement programs for reading, which were unfortunately shelved when face-to-face classes were canceled. Hence, the researchers created the Reading Assessment Manager (RAM) for the continuity of reading programs such as the assessment of pupils’ reading grade levels. RAM virtually stores a reading inventory of learners’ reading grade levels and suggests level-matching reading materials. Based on the administered evaluation utilizing the System Usability Scale (SUS), RAM outperformed 90-95% of industry software systems. Furthermore, the given Post Study System Usability Questionnaire (PSSUQ) reported Above Average user satisfaction.