Computer System Usability Questionnaire Research Articles

Usability evaluation of the educational website “understanding my diabetes” for Mexican patients with type 2 diabetes

BackgroundDiabetes education is an integral part of the treatment for the metabolic control of patients with diabetes. The use of the Internet as a tool for diabetes education, as well as its acceptance, is still under study.AimTo assess the usability of the educational website “I understand my diabetes” designed for patients with type 2 diabetes attending primary care clinics.Material and methodA cross-sectional study was done in 110 patients with type 2 diabetes from two family medicine clinics, each of whom was assigned a user account on the educational website “Entiendo mi diabetes.” The web site assigned a user name and password to each patient. They were able to access the educational website at home. After a 15-day review period, participants were asked to evaluate usability using the Computer System Usability Questionnaire. Additionally, we developed an eight-item questionnaire usability focusing on diabetes care. Sociodemographic data, blood pressure, and anthropometric measurements were recorded. Glucose levels and lipid profiles were also measured.ResultsThe patients with diabetes had a mean age of 52.7 years and a median of 5 years since they were diagnosed with diabetes. The website received a good usability rating from 89.1% of participants, with favorable assessments in all three dimensions: 87.3% for information, 85.5% for quality, and 88.2% for interface. Regarding usability specifically for diabetes care, 98.2% rated it as having good usability.ConclusionThe website for education about the disease in patients “I understand my diabetes” had an adequate usability evaluation by patients, so they also considered it very useful for diabetes care. The diabetes care instrument had adequate usability and reliability.

Don Mariano Marcos Memorial State University Medical OutPatient Records Management System: A Prototype

Exploring a transformative solution is driven by the inefficiencies inherent in the traditional manual, paper-based outpatient record management system at Don Mariano Marcos Memorial State University (DMMMSU). This research introduces the Medical Out-Patient Records Management System (MORMS) to fill this gap. Developed through the software development lifecycle, this OMRMS optimally maintains outpatient records; therefore, it assists medical professionals in recording, organizing, and retrieving patient data effortlessly. Notably, statistical reports represent data trends that are an invaluable product. The overall approval of MORMS was unanimous during User Acceptance Testing (UAT), with each tested component receiving a 100 percent acceptability index. Based on this assessment, it can be concluded that there is a high likelihood of integrating the system into the daily processes of DMMMSU’s medical officers across all its three campuses because its usefulness is valued by them. Moreover, usability testing validates the functional practicality of MORMS with respect to the Computer System Usability Questionnaire subscales -system usefulness, information quality, and interface quality. Consistent median ratings of 1 for these scales indicate pragmaticity or practicability; dependability; precision and ease of use, which are some merits of this methodical tool. Consequently, not only gaining acceptance from users but also being highly usable makes MORMS effective in complying with various requirements set by different groups within DMMMSU’s medical staff.

Exploring the Learner Information System (LIS): A Usability Assessment on Enhanced Facility for Educators

A Learner Information System (LIS) is a web- based tool that serves as a database for all students enrolled in basic education. The department implemented several facility enhancements to address identified problems with enrolling students, updating their profiles and statuses, and generating reports. However, to determine whether the system's facility augmentation is effective, it is crucial to look at the system's usability from the viewpoint of the end- user. This study aims to evaluate users’ usability assessment of system quality, information quality, and interface quality of the system. A survey-type study that utilized a mixed method and adopted the Lewis Computer System Usability Questionnaire (CSUQ) with 19 questions and used a 7-point Likert scale. The study used convenience sampling of 30 out of 54 junior and senior high school teacher-advisers. The result of the study indicates that the responses have a positive perception of the three main factors of system usability assessment. The result also shows that only the information quality indicator significantly affects the length of service. Overall, the respondents were satisfied with their user’s experience on the LIS.

Do Cone Beam CT Picture Archiving and Communication Systems Viewer Interfaces Meet the Expectations of Dental Professionals From a Usability Perspective?

Background Cone beam computed tomography (CBCT) has revolutionized dental and maxillofacial imaging by providing high-resolution 3D visualizations, essential for accurate diagnosis and treatment planning. Despite its clinical advancements, the usability of CBCT viewer interfaces, which play a crucial role in the effective interpretation of imaging data, remains a critical concern. Objective This study aims to evaluate the usability of a CBCT viewer interfaceinclinical settings, focusing on theeffectiveness, efficiency, and satisfaction perspectives, to identify potential areas for improvement. Methods Twenty-two participants (N=22) were assigned the task of locating the mental foramen in a mandible dataset, selected randomly, using the multiplanar reconstruction (MPR) mode of a CBCT viewer interface on a local network. The task's effectiveness was gauged by the completion rate, while efficiency was measured through the duration of the task, the number of mouse clicks, and the cursor's path in both pixels and meters. Satisfaction or perceived usability was evaluated using the system usability scale (SUS-TR), and computer system usability questionnaire (T-CSUQ), among other scales, with participants also providing open-ended feedback. Demographic characteristics served as classification variables. Results All participants completed the given task. No demography-related differences in efficiency were observed. Perceived usability (SUS-TR: 60.68±19.58, T-CSUQ: 43.63±16.34) was below the industry standards, categorizing the system as a detractor. Commonly reported issues included accessing the MPR window, cursor behavior, and unclear error messages. The mean SUS-TR score negatively correlated with efficiency-related variables (p<0.05 for each). Conclusions The study's findings indicate that the CBCT viewer interface does not fully meet dental professionals' usability expectations, as evidenced by the task's completion rate, efficiency metrics, and below-average usability scores. Despite the successful task completion by all participants, the identified issues in interface design, such as difficulties in accessing the MPR window and unclear error messages, highlight significant areas for improvement. To enhance user satisfaction and efficiency, future developments of CBCT viewer interfaces should incorporate feedback from end-users and prioritize user-friendly design principles.

Feasibility and Usability of EnergyPoints: A Mobile Health App to Guide Acupressure Use for Cancer Symptom Management.

To examine the feasibility and usability of EnergyPoints™, an innovative mobile health app that teaches and guides people with cancer to implement daily acupressure to self-manage their fatigue and sleep disturbances. The study used an integrated agile, human-centered approach. Adults (age 18 years and over) with cancer experiencing at least moderate fatigue, and living in the Greater New York City community, were recruited from social media, patient advocacy groups, and referrals. Twenty participants (in 3 sprints of 3, 5, and 12) were video-recorded thinking aloud while using the app for the first time. They then used the app at home to self-administer acupressure (twice daily for 1 week) while continuously wearing a fitness tracker. Each participant completed an exit interview and modified Computer System Usability Questionnaire post-participation. Participants were ages 40 to 76 years and 65% female; 65% were non-Hispanic white. Mean pass rates per ritual exceeded 80%. Users completed (totally or partially) greater than 90% of stimulating acupressure and 70% of relaxing acupressure rituals. Sprint 3 SPs totally completed at least 1 ritual 87% of the time. The majority agreed or strongly agreed the app was easy to use (90%), easy to learn (85%), easy to understand (75%), and effective in helping perform self-acupressure (85%). In an analysis of ease of completing 5 key tasks, all successfully completed the tasks; 3 users required some assistance. Of 654 usability statements, those coded as personal experience/context (197), content related to acupressure learning (105), and content related to the onboarding/profile (71) were most frequent. The design team integrated recommendations into the app before the next sprint. Findings supported feasibility and usability, as well as acceptability, and led to significant alterations and improvements. EnergyPoints™ offers an opportunity to mainstream acupressure and help cancer survivors self-manage their symptoms.

Differences in Software Usability Level Based on User Background

The development of software must consider usability as one of its key success indicators. Relatively few studies discuss the factors influencing usability, including users’ backgrounds. The purpose of this research was to investigate the impact of user background, specifically gender, class (year of college admission), and frequency of use on the rating of usability. This research utilized a descriptive quantitative method with instruments: the usability matrix of the Computer System Usability Questionnaire (CSUQ), the System Usability Scale (SUS), the Usability Metric for User Experience (UMUX), and the Net Promoter Score (NPS). The research object was the Learning Management System (LMS) of two state universities in Yogyakarta. Two sets of questionnaire responses were obtained: 305 men and 442 women answered the first time, and 280 men and 584 women answered the second time. Our result shows that the mean value of usability level from CSUQ, SUS, UMUX, and NPS is mostly higher in female than male respondents, in junior to more senior students, and in respondents who use the system more frequently than those who use it less. This trend was consistent, even though the sequence of questionnaire choice order was reversed between the first and second data collection at the two universities. This research hence concluded that, based on gender, women tend to offer a higher rating of usability than men; based on class, the younger generation tends to provide higher ratings of usability than the older generation, and users who use the system more frequently tend to give higher usability rating than those who less use it.

Usability and acceptability of ‘iSupport for dementia’: insights from multiple culturally adapted versions

AbstractBackgrounde‐Health interventions have shown to be effective in supporting informal caregivers of people living with dementia (PLwD) and have been explored as a solution to overcome the accessibility issues of conventional face‐to‐face interventions. However, uptake and retention in such interventions might be hindered by a lack of user‐centred design and poor usability. Understanding the usability and acceptability of e‐health interventions may help save costs and improve user experience and engagement. The methods and results from three usability and acceptability studies of three culturally adapted versions of WHO’s iSupport for dementia (Brazil, Portugal and Spain) are presentedMethodThree mixed‐methods studies have been conducted in Brazil, Portugal, and Spain. Participants were caregivers of PLwD (combined n = 79) and health/social support professionals (n = 12). The usability and acceptability assessment protocols included pre and post‐usability testing surveys, task performance on iSupport’s interface, validated scales (System Usability Scale and Computer System Usability Questionnaire), structured and semi‐structured interviews, and focus groups. Thematic analysis was used to analyze text data.ResultParticipants’ perceptions of iSupport’s usability were excellent for both the Brazilian and the European‐Portuguese versions (86.5 and 89.5 points in the SUS, respectively). When measured, success rates were high for tasks performed in the interface, suggesting easiness of use. In its different country‐specific versions, iSupport’s interfaces were described as user‐friendly, and its contents as useful and responsive to caregivers’ needs. Several suggestions associated with the program’s layout, functional requirements, and content were identified as necessary to improve the usability and acceptability of iSupport.ConclusionThe Brazilian and European‐Portuguese versions of iSupport were considered acceptable and usable by family caregivers of PLwD. Lessons learned, challenges identified, and methods used to assess the usability and acceptability of iSupport may be replicated and/or used to inform the development of other country‐specific versions within iSupport’s network, potentially lowering the development costs and improving the appropriateness of those versions. Usability and acceptability studies of iSupport are key to discovering design problems and usage patterns of the program, and are therefore valuable for planning feasibility studies and effectiveness trials.

Usability evaluation of a knowledge graph‐based dementia care intelligent recommender system: A mixed‐methods study

AbstractBackgroundKnowledge graph‐based recommender systems offer the possibility of meeting the personalized needs of people with dementia and their caregivers. However, the usability of such a recommender system remains unknown.ObjectiveThis study aimed to evaluate the usability of a knowledge graph‐based dementia care intelligent recommender system (DCIRS).MethodsA convergent mixed‐methods design was employed to conduct the usability evaluation, including the collection of quantitative and qualitative data. Participants were recruited via social media advertisements. After two weeks of DCIRS use, feedback was collected with the Computer System Usability Questionnaire and semi‐structured interviews. Descriptive statistics were used to describe sociodemographic characteristics and questionnaire scores. Qualitative data were analyzed systematically using inductive thematic analysis.ResultsA total of 56 caregivers were recruited. Quantitative data suggested that the DCIRS was easy for caregivers to use, and the mean questionnaire score was 2.14. Qualitative data showed that caregivers generally believed that the content of the DCIRS was professional, easy to understand, instructive and could meet users’ personalized needs; they were willing to continue to use it. However, the DCIRS also had some shortcomings. Functions that enable interactions between professionals and caregivers and that provide caregiver support and resource recommendations might be added to improve the system’s usability.ConclusionsThe recommender system provides a solution to meet the personalized needs of people with dementia and their caregivers and has the potential to substantially improve health outcomes. The next step will be to optimize and update the recommender system based on caregivers' suggestions and evaluate the effect of the application.

Chinese CSUQ: Cross-Cultural Adaptation and Evaluation of Measurement Properties

The Computer System Usability Questionnaire is one of the most popular standardized usability questionnaires used to assess the perceived usability of computer software, and it has been rigorously translated into multiple languages. This article aims to complete the cross-cultural adaptation of CSUQ in a Chinese environment and examine the psychometric characteristics. We used the forward–backward translation method to complete the initial translation, and designed the psychometric experiment according to the measurement properties required by the consensus-based standards for the selection of health measurement instruments (COSMIN). The COSMIN risk of bias checklist and updated criteria for good measurement properties were used to examine the Chinese CSUQ. The results demonstrated good performance of the Chinese CSUQ in content validity, internal structure and the remaining measurement properties. The results of the factor analysis revealed a three-factor structure, as well as any discrepancy between the Chinese CSUQ and its original version. Therefore, the Chinese CSUQ can be used confidently by Chinese usability practitioners and also serve as an effective alternative to other standardized usability scales.

Usability Evaluation of a Knowledge Graph-Based Dementia Care Intelligent Recommender System: Mixed Methods Study.

Knowledge graph-based recommender systems offer the possibility of meeting the personalized needs of people with dementia and their caregivers. However, the usability of such a recommender system remains unknown. This study aimed to evaluate the usability of a knowledge graph-based dementia care intelligent recommender system (DCIRS). We used a convergent mixed methods design to conduct the usability evaluation, including the collection of quantitative and qualitative data. Participants were recruited through social media advertisements. After 2 weeks of DCIRS use, feedback was collected with the Computer System Usability Questionnaire and semistructured interviews. Descriptive statistics were used to describe sociodemographic characteristics and questionnaire scores. Qualitative data were analyzed systematically using inductive thematic analysis. A total of 56 caregivers were recruited. Quantitative data suggested that the DCIRS was easy for caregivers to use, and the mean questionnaire score was 2.14. Qualitative data showed that caregivers generally believed that the content of the DCIRS was professional, easy to understand, and instructive, and could meet users' personalized needs; they were willing to continue to use it. However, the DCIRS also had some shortcomings. Functions that enable interactions between professionals and caregivers and that provide caregiver support and resource recommendations might be added to improve the system's usability. The recommender system provides a solution to meet the personalized needs of people with dementia and their caregivers and has the potential to substantially improve health outcomes. The next step will be to optimize and update the recommender system based on caregivers' suggestions and evaluate the effect of the application.

Evaluating REDCap as the Central Data Collection Tool for the Hamburg City Health Study.

The collection of examination data for large clinical studies is often done with proprietary systems, which are accompanied by several disadvantages such as high cost and low flexibility. With the use of open-source tools, these disadvantages can be overcome and thereby improve data collection as well as data quality. Here we exemplary use the data collection process of the Hamburg City Health Study (HCHS), carried out at the University Medical Center Hamburg-Eppendorf (UKE). We evaluated how the recording of the examination data can be converted from an established, proprietary electronic healthcare record (EHR) system to the free-to-use Research Electronic Data Capture (REDCap) software. For this purpose, a technical conversion of the EHR system is described first. Metafiles derived from the EHR system were used for REDCap electronic case report form (eCRF) building. The REDCap system was tested by HCHS study assistants via completion of self-developed tasks mimicking their everyday study life. Usability was quantitatively evaluated via the IBM Computer System Usability Questionnaire (CSUQ) and qualitatively assessed with a semi-structured interview. With the IBM CSUQ, the study assistants rated the usage of the basic REDCap system for HCHS examination data collection with an overall score of 4.39, which represents a medium acceptance. The interview feedback was used to formulate user stories to subsequently increase the administrative sovereignty and to conceptualize a REDCap HCHS information technology (IT) infrastructure. Our work aims to serve as a template for evaluating the feasibility of a conversion from a proprietary to a free-to-use data collection tool for large clinical studies such as the HCHS. REDCap has great potential, but extensions and an integration to the current IT infrastructure are required.

Educational Media Development using Guided Discovery Learning Approach in Chemical Element Subject

A chemical element is one of the materials in high school for chemistry subject. Students have difficulties in studying chemical elements due to ample theories that must be memorized. In addition, conventional learning models that tend to be one-way create boredom feeling towards students. The use of interactive educational media can be a solution to the learning process. This study tries to provide a solution by developing mobile-based educational media combined with guided discovery learning models to help the learning process of chemical elements in high school. The use of appropriate educational media can be used as an independent learning tool. This study uses Research &amp; Development (R&amp;D) combined with SAM Model to develop this educational media. Testing is using an expert validation approach for the prototype of educational media. This study adapted the Computer System Usability Questionnaire (CSUQ) to assess an aspect of the usability of educational media. To assess the content of the material in this educational media, this study uses an evaluation questionnaire from the subject matter and media experts. The development process is carried out in three iterations, namely the preparation stage, iterative stage, and iterative development stage. The results of this study show that the assessment of chemical elements in educational media has a score of 86.8% on its system usability according to media experts and a score of 90.5% on educational media content according to material experts. So, this educational media is feasible to be applied to high school students. Overall, this educational media got a good score on the pretest-posttest, where the effectiveness of using this educational media increased student learning outcomes with an N-Gain value of 80.62%.

Perceived Usability Evaluation of Educational Technology Using the Post-Study System Usability Questionnaire (PSSUQ): A Systematic Review

Given that educational technology has increased tremendously, usability testing is a necessity to maximize the efficiency of technological tools in education. The findings of a systematic review including 42 research papers that evaluated the educational technologies’ perceived usability with the Post-Study System Usability Questionnaire (PSSUQ) and the Computer System Usability Questionnaire (CSUQ) are presented in this article. The results were categorized according to the following factors: (a) score derived from evaluating usability with PSSUQ/CSUQ, (b) type of educational technology employed, (c) subject studied, (d) educational stage, (e) participant type, (f) age, and (g) participant count in each survey. The usability levels were found to be satisfactory (M = 72.75, SD = 15.12) from the statistical analysis of all surveys (N = 58). The mobile applications category showed a very good mean PSSUQ/CSUQ score (M = 81.53, SD = 12.61) followed by the multimedia category with 73.89 (SD = 19.69) and internet platforms (M = 73.23, SD = 7.74). The educational stage (p = 0.01) and the participant type (p = 0.005) seem to relate to the obtained PSSUQ/CSUQ scores. However, the participants’ age, the subject being studied, or the participant count in each study did not exhibit any significant correlation with the PSSUQ/CSUQ scores. Over the course of time, a marginal non-statistically significant improvement was noted in terms of perceived usability (p = 0.136).

Usability and Satisfaction Testing of Game-Based Learning Avatar-Navigated Mobile (GLAm), an App for Cervical Cancer Screening: Mixed Methods Study.

Barriers to cervical cancer screening in young adults include a lack of knowledge and negative perceptions of testing. Evidence shows that mobile technology reduces these barriers; thus, we developed a web app, Game-based Learning Avatar-navigated mobile (GLAm), to educate and motivate cervical cancer screening using the Fogg Behavioral Model as a theoretic guide. Users create avatars to navigate the app, answer short quizzes with education about cervical cancer and screening, watch videos of the screening process, and earn digital trophies. We tested ease of use, usefulness, and satisfaction with the GLAm app among young adults. This mixed methods study comprised a qualitative think-aloud play interview session and a quantitative survey study. Participants were cervical cancer screening-eligible US residents aged 21 to 29 years recruited through social media. Qualitative study participants explored the app in a think-aloud play session conducted through videoconference. Data were analyzed using directed content analysis to identify themes of ease of use, usefulness, and content satisfaction. Qualitative study participants and additional participants then used the app independently for 1 week and completed a web-based survey (the quantitative study). Ease of use, usefulness, and satisfaction were assessed using the validated Technology Acceptance Model and Computer System Usability Questionnaire adapted to use of an app. Mean (SD) scores (range 1-7) are presented. A total of 23 individuals participated in one or both study components. The mean age was 25.6 years. A majority were cisgender women (21/23, 91%) and White (18/23, 78%), and 83% (19/23) had at least some secondary education. Nine participants completed the think-aloud play session. Direct content analysis showed desire for content that is concise, eases anxiety around screenings, and uses game features (avatars and rewards). Twenty-three individuals completed the quantitative survey study. Mean scores showed the app was perceived to be easy to use (mean score 6.17, SD 0.27) and moderately useful to increase cervical cancer screening knowledge and uptake (mean score 4.94, SD 0.27). Participants were highly satisfied with the app (mean score 6.21, SD 1.20). Survey results showed participants were satisfied with the app format and found it easy to use. The app was perceived to be moderately useful to inform and motivate cervical cancer screening; notably, the screening reminder function was not tested in this study. Qualitative study results demonstrated the app's ability to ease anxiety about screening through demonstration of the screening process, and brevity of app components was favored. Interpretation of results is limited by the predominantly cisgender, White, and educated study population; additional testing in populations which historically have lower cervical cancer screening uptake is needed. A modified version of the app is undergoing efficacy testing in a randomized clinical trial.

Evaluation Of The Level Of Usefulness Of The "Jeknyong"�Application Using The Computer System Usability Questionnare (CSUQ) Method

The Jeknyong application (Ojeke Inyong) is a household garbage collection service application with a transaction value. However, the use of the Jeknyong application has not been maximized because there are obstacles, such as several features still in development. This study discusses the Evaluation of the Level of Usability of the "Jeknyong" Application using the Computer System Usability Questionnaire (CSUQ) method, where Usability is a technique to find out how easily users can use the system, how efficiently and effectively the system can help users achieve goals. Data collection used a questionnaire with Banyumas community subjects who knew the Jeknyong application. The results are in the form of an indexed percentage of 85% in the Agree Interval category. The first variable System Usability (SYSUSE) evaluation results were 5135 or in the agreed interval. The second variable Information Quality (INFOQUAL) was 4588 or in the Fairly Disagree category. The third variable, Interface Quality (INTERQUAL), was 2039 or in the Agree category; the third variable, Overall Usability (OVERALL), gets a result of 709 or is in the Strongly Agree interval.

Examining a Resilience Mental Health App in Adolescents: Acceptability and Feasibility Study.

Resilience is defined as the ability to rely on internal characteristics and external strengths to adapt to adverse events. Although universal resilience-enhancing programs are effective for adolescents, there is a need for interventions that are more easily accessible and can be customized for individual teens. Phone apps are easy to use, can be tailored to individuals, and have demonstrated positive effects for mental health outcomes. This study aimed to examine the feasibility and acceptability of a resilience app for adolescents. This app aimed to enhance resilience through modules focused on depression prevention, stress management, and healthy lifestyle approaches containing videos, measures, and practice suggestions. Furthermore, the study aimed to evaluate the effect of short-term app use on changes in resilience. In study 1, individual interviews and focus groups were conducted with adolescents, parents, teachers, and clinicians to discuss possible incentives for using a mental health app, the benefits of app use, and concerns associated with app use. Feedback from study 1 led to ideas for the prototype. In study 2, individual interviews and focus groups were conducted with adolescents, parents, teachers, and clinicians to gather feedback about the resilience app prototype. Feedback from study 2 led to changes in the prototype, although not all suggestions could be implemented. In study 3, 40 adolescents used the app for 30 days to determine feasibility and acceptability. Additionally, resilience and secondary mental health outcomes were measured before and after app use. Dependent samples 2-tailed t tests were conducted to determine whether there were changes in resilience and secondary mental health outcomes among the adolescents before and after app use. Multiple themes were identified through study 1 individual interviews and focus groups, including app content, features, engagement, benefits, concerns, and improvement. Specifically, the adolescents provided helpful suggestions for making the prototype more appealing and functional for teen users. Study 2 adolescents and adults reported that the prototype was feasible and acceptable through the Computer System Usability Questionnaire (mean 6.30, SD 1.03) and Mobile App Rating Scale (mean 4.08, SD 0.61). In study 2, there were no significant differences in resilience and mental health outcomes after using the app for 30 days. There was variation between the participants in the extent to which they used the app, which may have led to variation in the results. The users appeared to prefer the depression module and survey sections, which provided mental health feedback. Qualitative and quantitative data provide evidence that youth are interested in a resilience mental health app and that the current prototype is feasible. Although there were no significant mental health changes in study 3 users, practical implications and future directions are discussed for mental health app research.

Usability of a mobile application for health professionals in home care services: a user-centered approach

The use of mobile devices by healthcare professionals has led to rapid growth in the development of mobile healthcare applications designed to improve healthcare services. This study was conducted to assess the acceptability and usability of a mobile application for health professionals in relation to their work in hospitalization at home. A mixed methods approach was used. Acceptance, included the satisfaction of the professionals, attitudes toward using the application, and intention or willingness to continue using the application. Usability tests were performed in laboratory analyzing five controlled clinical tasks, and the interaction of the participants with the mobile application was based on the six basic facial expressions published by the American Psychological Association. Perceived satisfaction was assessed using the computer system usability questionnaire. Thirty-two participants completed the task scenarios and questionnaire. More than 90 per cent of participants were able to complete the tasks with only some difficult with vital signs. Satisfaction had a score of 6.18/7 (SD: 0.76), and recommendation of the mobile application had a score of 6.21/7 (SD: 0.81). This study showed a significant usability and acceptability of this mobile application, in terms of effectiveness, efficiency, and satisfaction.

Development of application for sustainable tourism index calculation

The lack of a reliable application to automate the assessment process has led to surveyors performing manual calculations, which increases the risk of human errors during data processing. Therefore, this research aims to develop a composite index calculation application designed using Macro VBA in Excel, focusing on user-friendliness and customized functionalities based on user needs. The proposed application assesses sustainable cultural tourism across four dimensions: environmental, economic, government, and socio-cultural. The development process follows the Rapid Application Development (RAD) method, consisting of three stages: requirements planning, workshop design, and implementation. The application's validity is assessed by comparing its output with manual calculations. The application was tested through functionality, maintainability, and usability testing. Application usability was evaluated using the Computer System Usability Questionnaire (CSUQ) method. The research outcome is a reliable composite index calculation application, enhancing the efficiency and accuracy of sustainable tourism assessments.

Versão para Web do protocolo de avaliação miofuncional com escores: usabilidade e aprendizado

The Orofacial Myofunctional Evaluation with Scores (OMES) protocol has been validated and used in clinical practice and research. The goals of this study were to develop, analyze and improve a version of OMES for the Web and to investigate the relationship between the usability judgments and the prior experience of the evaluators and whether using the interface promotes learning, as shown by the task completion time (TCT). Study steps: 1) inspection of the prototype by the team; 2) evaluation of usability by three experienced speech-language pathologists (SLPs); and 3) evaluation of its usability by 12 SLPs with varying levels of experience in the use of OMES. Participants answered the Heuristic evaluation (HE), the Computer System Usability Questionnaire (CSUQ), and expressed free comments. The TCT was recorded. The OMES-Web reached excellent usability levels, and the participants were highly satisfied. The correlations between the participants' experience and the HE and CSUQ scores were not significant. The TCT decreased significantly throughout the tasks. OMES-Web meets the usability criteria, and participants feel satisfied with the system regardless of their level of experience. The fact that it is easy to learn favors its adoption by professionals.

EVALUATING A COMPUTER APPLICATION THAT AIDS MULTI-CRITERIA DECISION MAKING

In this article, we describe and assess the implementation of several methods of multi-criteria decision-making using a web-based computer application. Such an application makes it easier to determine the effective- ness of decisions. The methods adopted in this application are SMART (Simple Multi-Attribute Rating Technique), AHP (Analytic Hierarchy Pro- cess), and ANP (Analytic Network Process). Each of these methods has distinctive characteristics in determining the best alternative for the user. This study assesses the feasibility of each method in the application. The application is assessed based on functionality, reliability, efficiency, and usability. (1) Functionality is tested according to the appropriateness of the decisions made, (2) Reliability is assessed using stress testing, (3) Effi- ciency is assessed according to the computational effort, and (4) System usability is tested according to the user’s answers to the Computer System Usability Questionnaire authored by J.R. Lewis. This research results in a decision support system based on SMART that has been appropriately tested and is ready for use. Keywords: multi-criteria analysis, SMART, AHP, ANP, system usability.