System Usability Testing Research Articles

Development and usability testing of diabetes risk calculator (diacal): a health education application

Despite the growing popularity of the mobile health application, the application that addressed to calculated diabetes risk is still limited. DiaCal was developed to prevent type 2 diabetes mellitus by screening and early detection approach. This study aimed to develop and examine the usability of DiaCal smartphone application-based education. This study was conducted with a cross-sectional approach. The framework of this application is based on the American Diabetes Association diabetes risk screening instrument. The development of the DiaCal was divided into three phases: preparation, design, and piloting. System Usability Testing (SUS) instruments used to examine the user-level acceptance of this application. DiaCal app developed in android platform core modules: a) data entry, b) conversion and calculation, c) output of the risk assessment, d) education. Twenty respondents were recruited in this study to evaluate DiaCal through SUS instrument. The average adjective range score is 85.25 which indicates that the DiaCal application is in the “excellent” category and the grade level scale is in “A+”. This study showed a significant usability and acceptability of DiaCal in terms of effectiveness, efficiency, and satisfaction.

Designing Academic Data Visualization Dashboard Using Google Data Studio at SMPN 8 Pariaman

This study aims to use Google Data Studio to produce an academic data visualization dashboard system to display information, which can manage academic data, namely teacher attendance data and student grades, to provide decision-making support for decision makers in the monitoring process and evaluate school internal processes and monitor student grades at SMPN 8 Pariaman School. The type of research used is the R&D (Research and Development) approach SDLC (Systems Development Life Cycle) method with a prototype model. The stages carried out are communication, planning, modeling, construction and handover (handover). The system testing method studied uses questionnaire guidelines for functional testing to test system functionality to verifiers and usability testing to test system usability and suitability of functions and services to users. Based on the results of the validator functional test study, the results of meeting the functional requirements with both a value of 1 and 89% of the feasibility value of the system usability test are classified as very feasible. Therefore, it can be concluded that the academic data visualization dashboard system using Google Data Studio meets the requirements and is very suitable as a support for SMPN 8 Pariaman School in processing academic data on teacher attendance and student grades.

Design and Evaluation of Maliki V-Lab: A Metaverse-Based Virtual Laboratory for Computer Assembly Learning in Higher Education

Some schools keep using online learning media even after the new normal of COVID-19 to provide broader reach for students and teachers. Online learning in practicum class requiring physical practice equipment remains a challenge. This research proposes Maliki V-Lab, a metaverse-based VR laboratory that provides practicum class for computer assembly as an online learning media platform. The developed system then evaluated for the usefulnes and sense of virtual presence. System usability was measured using the System Usability Scale (SUS) questionnaire, and virtual presence was measured using the Igroup Presence Questionnaire (IPQ) that consist four categories. The system usability test result is marginally acceptable, while virtual presence test result is acceptable for general presence, spatial presence, and expected realism category, and marginally acceptable for involvement category. Based on these results, this system can used for practical learning specifically according to the criteria that have been tested. Maliki V-Labs needs to improve the level of usability and virtual presence before it can be expanded with another practicum class and another type of respondent.

Go Across Immersive Technology: A Preliminary Study of the Design and Development of a System for Gait Training Using Virtual Reality.

Virtual reality (VR) allows visuotactile interaction in a virtual environment. VR has several potential applications such as surgical training, phobia treatments, and gait rehabilitation. However, further interface development is required. Therefore, the objective of this study was to develop a noninvasive wearable device control to a VR gait training program. It consists of custom-made insoles with vibratory actuators, and plantar pressure sensor-based wireless interface with a VR game. System usability testing involved a habituation period and three gaming sessions. Significant gait improvement was associated with game scores (P < 0.05). This VR gait training system allowed real-time virtual immersive interaction with anticipatory stimulus and feedback during gait.

Development and evaluation of a clinical decision support system for early diagnosis of acute appendicitis

The most frequent reason for individuals experiencing abdominal discomfort to be referred to emergency departments of hospitals is acute appendicitis, and the most frequent emergency surgery performed is an appendectomy. The purpose of this study was to design and develop an intelligent clinical decision support system for the timely and accurate diagnosis of acute appendicitis. The number of participants which is equal to 181 was chosen as the sample size for developing and evaluating neural networks. The information was gathered from the medical files of patients who underwent appendicectomies at Shahid Modarres Hospital as well as from the findings of their appendix samples' pathological tests. The diagnostic outcomes were then ascertained by the development and comparison of a Multilayer Perceptron network (MLP) and a Support Vector Machine (SVM) system in the MATLAB environment. The SVM algorithm functioned as the central processing unit in the Clinical Decision Support System (CDSS) that was built. The intelligent appendicitis diagnostic system was subsequently developed utilizing the Java programming language. Technical evaluation and system usability testing were both done as part of the software evaluation process. Comparing the output of the optimized artificial neural network of the SVM with the pathology result showed that the network's sensitivity, specificity, and accuracy were 91.7%, 96.2%, and 95%, respectively, in diagnosing acute appendicitis. Based on the existing standards and the opinions of general surgeons, and also comparing the results with the diagnostic accuracy of general surgeons, findings indicated the proper functioning of the network for the diagnosis of acute appendicitis. The use of this system in medical centers is useful for purposes such as timely diagnosis and prevention of negative appendectomy, reducing patient hospital stays and treatment costs, and improving the patient referral system.

Multi-criteria Decision Support System for Prioritizing Challenges of Internet of Things (IoT)

Abstract: The adoption and utilization of Internet of Things (IoT) technologies such as IoT Platforms, 5G, connected sensors, WAN, etc mostly come with numerous, seemingly complex and expensive challenges for institutions and organisations, particularly in developing countries as they work to fill their fair share of the global IoT market. Multi-criteria decision support systems (MCDSS) can be indispensable tools for evaluating and prioritizing these complex competing difficulties by multistakeholder decision makers. While eliminating conventional decision problems such as, human biases, time consumption, cost of decision, etc, MCDSS make it possible for companies to concentrate on solving challenges which their limited resources can cater for. This study presents an approach for design and implementation of a prototype MCDSS for prioritizing challenges that institutions and organizations face while adopting and utilizing IoT technologies using Fuzzy Analytic Hierarchy Process (FAHP) methodology. ASP.Net model View controller (MVC) framework and C Sharp programming Language was used for the GUI and the Logic development. The system's default IoT challenges and dataset were adapted from the works of A.K. Mohammadzadeh (Baseline dataset). The system usability test result obtained shows that the system is friendly and usable. The output weights and rating of the IoT technology adoption challenges/sub-challenges exhibit over 80% similarity when compared to the Baseline dataset. Further studies are recommended to make the system a

Implementasi Teorema Bayes Pada Sistem Informasi Posyandu Dalam Mendeteksi Stunting Pada Balita

Abstract–The management of posyandu data in Majegan Village is still carried out manually. This causes health monitoring to be not optimal, especially in detecting stunting in toddlers. One of the efforts to overcome this problem is to provide a posyandu information system that can make it easier for posyandu officers to record and analyze fetal growth until toddlerhood and can detect symptoms of stunting. Through the implementation of Bayes' theorem in a web-based application, stunting symptoms can be observed earlier. Bayes' theorem calculates the values of the symptoms experienced by toddlers so as to obtain the results of probability numbers that can be used to predict stunting in toddlers. System design uses the waterfall method which goes through the stages of SDLC (System Development Life Cycle). After the system was developed, to test the quality of the application and the accuracy of naïve bayes in predicting stunting, two types of testing were carried out, namely black box testing and system usability testing (SUS). The black box test results show that the application functionality runs well with an error percentage of 0%, while the SUS test results show that the application has a usability level at Level B which means the application can be used and help users. Meanwhile, the results of the prediction of naïve bayes produced the model with the highest prediction of 60%.

Development of Cloud-Based Data Integration for Non-Profit Organization System

Palang Merah Indonesia (PMI) noted that the stock of blood in Indonesia reached 87,238 bags as of June 14, 2022, where it should be estimated that Indonesia needs 5.1 million bags of blood every year. The conventional blood donor process procedure is one of the main reasons the younger generation does not intend to donate blood. A new system is needed to regulate the flow of the blood donation process so that it is faster and attracts the interest of young people to donate blood. This research resulted in a blood donation system in the form of a website application for each blood donor unit and a mobile application for users who are blood donors. The system was developed with the Agile method which makes it easy for researchers to adapt to the evolving needs of users. The system usability test is based on Nielsen's Criteria which includes 5 main aspects, including learnability, efficiency, memorability, errors and satisfaction. The results of the trial on the targeted respondents showed that almost all of them were interested in using and would routinely donate blood with the new system that had been built, because it was considered to simplify the blood donation procedure which was previously considered complicated. In addition, data between blood donor units can be well integrated with the system that has been built. In the end, this research has the main goal of changing people's habits, especially young people to continue to regularly donate blood, not only is it good for health, but also can help others in need.

Mobile-Based Course Learning Modules in a University in Eastern Samar, Philippines

The Covid-19 pandemic turned educational institutions from face-to-face to modular learning modality. Through the implementation of distance learning scheme in the Philippines, Eastern Samar State University (ESSU) also adapted this new normal learning strategy through development of mobile-based course modules for distance learning as an alternative to its present modular distance learning approach. Paper-based modules seemed to be expensive and sometimes texts are not clear and readable. Thus, students get bored and perform low at school. As a response, a mobile-based course learning module is developed for offline learners. This study employs Waterfall model in the development of the application. This model follows several phases from designing, developing and testing the application to ensure its quality. The findings of the study show that the application is highly usable and functional after series of tests conducted. Moreover, it gained 88.75 overall score in the System Usability test conducted. This implies that the application is usable, user-friendly, functional, and portable. A further study may be conducted on the effectiveness of the mobile application in the instruction.

E-Library Interaktif dengan SLiMS Bulian Menggunakan Metode RAD

The use of technology in various fields has developed very quickly and has become a necessity in supporting the services of an organization or company. Educational institutions are one of the sectors that are guided in the learning process using Information and Communication Technology (ICT). Education, especially libraries, is one of the fields that uses high ICT, namely the digitalization of libraries or often e-libraries in order to realize quality education and ICT competitiveness in the world of education. As for the e-library in educational institutions, one of the schools is a source of information or reference for students, to increase students' reading interest, as well as to increase students' knowledge and competence. This makes the e-library has a very important role and must be developed to meet these needs such as developing an interactive and interesting e-library. The methods used for data collection are observations to the school library, interviews with library managers, and literature studies to deepen problem understanding. The software development method used is Rapid Application Development (RAD) by utilizing the Unified Modeling Language (UML) to design the system design developed. The results of this study are the existence of a complete e-library and an attractive application design and forum feature that makes the e-library interactive so that it can encourage the level of visits and literacy culture for students. The e-library has been carried out through black box testing and System Usability Test (SUS) with acceptable results.

Dhwani Fire: Aerial System for Extinguishing Fire

Fire is among the most feared dangers. Therefore, a fire extinguisher is necessary equipment. Unfortunately, conventional fire extinguishers have certain disadvantages, such as the use of hazardous chemical ingredients that leave a residue. The current extinguishers use a variety of chemicals depending on the types of fires to be extinguished. They are usually pressurized with nitrogen or carbon dioxide and when this pressure is released on fire, they extinguish it. Water, potassium bicarbonate, foam, and other asphyxiating and extinguishing agents are commonly used materials in the current fire extinguishers. All of these agents leave behind some byproducts that are toxic and pollute the environment. The proposed firefighting system consists of an Unmanned Aerial Vehicle (UAV), a drone that has two sets of sensors, an image capturing unit, a sound wave generator, a cooling assembly, and a processing unit onboard. The first set of sensors is configured to detect heat parameters of the fire, while the second set of sensors detects one or more airborne particulates in the fire area. The image capturing unit navigates and captures images of the fire area. The sound wave generator and the cooling assembly are controlled by the processing unit configured to actuate them and enable the system to extinguish fire. The system usability test exhibits that this sound wave-based firefighting extinguisher is a novel, cleaner, safer, and user-friendly firefighting solution.

Design of an Arduino-Based Water Quality Monitoring System

In agricultural cultivation, water is a critical climatic element. It has an impact on the growth and development of plants. Their abundance or shortage can lead to a good harvest, a lower yield, or even failure. Water quality testing is an essential part of environmental monitoring. When water quality is inadequate, it has an impact on agricultural life as well as the biological system as a whole. The researcher decided to design, build, and test a device that would enable real-time water monitoring based on this concept. After five months of research and development at Eastern Samar State University Salcedo Campus, the device was finished. The Arduino-based Water Monitoring System is entirely functional and can detect sensor readings from four parameters, including temperature, pH, turbidity, and electrical conductivity. According to the experiment results and the system usability test, it can now be deployed. The gadget also has an ESP32 included in it, which can transfer data through WIFI and Bluetooth. The device was practical and usable because it complied with the specifications. When paired with the Water Quality Mobile Application, the device is compatible with a 5-volt power bank and works well. The researcher suggests that digital sensors be considered because the gadget employs analog sensors, and reading is completely dependent on the type of sensor used. Additional testing, such as monitoring the ammonia level and dissolved oxygen, can be done while considering the device power requirements and overall design.

Investigation of COVID-19 Vaccine Information Websites across Europe and Asia Using Automated Accessibility Protocols.

Websites content accessibility guidelines (WCAG) ensure that websites should be perceivable, understandable, navigable, and interactive. During the SARS-CoV-2 pandemic, the importance of accessible websites and online content grew throughout the world. Therefore, in this study, we examined COVID-19-related official government websites. This research covered 21 government websites, with 13 websites from European countries and 8 websites from Asian countries, to evaluate their accessibility following WCAG 2.0 and WCAG 2.1 guidelines. The overall goal of this study was to identify the frequent accessibility problems that might help the website owners to identify the shortcomings of their websites. The target websites were evaluated in two steps: in step-1, evaluation was performed through four automatic web accessibility testing tools such as Mauve++, Nibbler, WAVE, and WEB accessibility tools; in step-2, evaluation went through human observation, such as system usability testing and expert testing. The automatic evaluation results showed that few of the websites were accessible; a significant number of websites were not accessible for people with disabilities. In addition, system usability testing found some complexity in website organization, short explanations, and outdated information. The expert testing suggested improving the color of the websites, organization of links, buttons, and font size. This study might be helpful for associated authorities to improve the quality of the websites in the future.

Sistem Pakar Deteksi Dini Penyakit Preeklamsia pada Ibu Hamil Menggunakan Metode Certainty Factor

Preeclampsia is a disease in pregnant women characterized by high blood pressure and positive urine protein. The disease has a high risk of maternal and fetal death, so there is a need for early detection of mothers at risk of preeclampsia. Early online detection of preeclampsia is the best solution during the Covid-19 pandemic by analyzing the influencing factors. The purpose of this study is to build an expert system for early detection of preeclampsia in pregnant women using the Certainty Factor method and the waterfall system development model in order to provide the possibility of pregnant women suffering from preeclampsia. Testing the accuracy of 30 medical record data for pregnant women resulted in a system accuracy level of 90%, while usability testing resulted in a user satisfaction level of 55 with the System Usability Testing (SUS) score criteria being "Poor", therefore improvements are needed on expert system in the future.

Application of Augmented Reality Technology as an Alternative Media for Campus IT Telkom Purwokerto

Augmented Reality is a technology that involves graphics on a computer in the real world, which in the virtual world of three dimensions is brought to the real-world environment in real-time. The application of Augmented Reality technology is currently growing rapidly, including in the field of promotional media. IT Telkom Purwokerto is a private university in Central Java engaged in Information and Communication Technology (ICT). In introducing the campus environment, IT Telkom Purwokerto still uses the manual given to students when PKKMB is also rarely read, and the introduction of buildings uses 3D miniatures by utilising styrofoam where these miniatures are displayed. Based on a survey conducted by researchers to find out the level of difficulty in finding a room at IT Telkom Purwokerto, 70% of respondents obtained that IT Telkom Purwokerto students agreed that they had trouble finding a room for the first time at IT Telkom Purwokerto. This recognition media is made using Augmented Reality with marker-based tracking technology; in the manufacturing process uses Unity and Vuforia a container for storing markers or markers. Development for this software uses the Agile model. Testing is the final stage before the application is presented to the user, using black-box and system usability testing. The test results on this application obtained results for black-box testing of 97.7% and System Usability Scale of 83.6, which can be concluded that users can use the application easily. Based on these results, it can be supposed that it is also included in the Excellent category with a B rating

ColorPoetry: Multi-Sensory Experience of Color with Poetry in Visual Arts Appreciation of Persons with Visual Impairment

Visually impaired visitors experience many limitations when visiting museum exhibits, such as a lack of cognitive and sensory access to exhibits or replicas. Contemporary art is evolving in the direction of appreciation beyond simply looking at works, and the development of various sensory technologies has had a great influence on culture and art. Thus, opportunities for people with visual impairments to appreciate visual artworks through various senses such as hearing, touch, and smell are expanding. However, it is uncommon to provide a multi-sensory interactive interface for color recognition, such as integrating patterns, sounds, temperature, and scents. This paper attempts to convey a color cognition to the visually impaired, taking advantage of multisensory coding color. In our previous works, musical melodies with different combinations of pitch, timbre, velocity, and tempo were used to distinguish vivid (i.e., saturated), light, and dark colors. However, it was rather difficult to distinguish among warm/cool/light/dark colors with using sound cues only. Therefore, in this paper, we aim to build a multisensory color-coding system with combining sound and poem such that poem leads to represent more color dimensions, such as including warm and cool colors for red, orange, yellow, green, blue, and purple. To do this, we first performed an implicit association test to identify the most suitable poem among the candidate poems to represent colors in artwork by finding the common semantic directivity between the given candidate poem with voice modulation and the artwork in terms of light/dark/warm/color dimensions. Finally, we conducted a system usability test on the proposed color-coding system, confirming that poem will be an effective supplement for distinguishing between vivid, light, and dark colors with different color appearance dimensions, such as warm and cold colors. The user experience score of 15 college students was 75.1%, that was comparable with the color-music coding system that received a user experience rating of 74.1%. with proven usability.

RANCANG BANGUN APLIKASI SI-WAJA BERBASIS ANDROID UNTUK MENCEGAH KECELAKAAN LALU LINTAS DI KOTA SURAKARTA

The needs of land transportation grows rapidly each year, along with the increasing population and mobility. It threatens the safety of road users if not handled appropriately. From 2015 to 2018 accidents in the city of Surakarta were relatively increased by the number of accidents in 2018 was 834 events. 55% of accident events caused by road users are not orderly. There is already handling done, but not effective. No one has overcome the blackspot with technology. Si Waja application is designed to reduce traffic accidents. Si Waja application serves to improve the driver's attention. The process of designing this application using methods of research and development. Application design Si Waja uses Android Studio integrated with Firebase. There are two tests conducted to test the Si Waja application Black Box Testing and Usability Testing. All elements in the application go well, evidenced by the Black Box Testing. This usability test uses the System Usability Testing (SUS) method which provides adequate results based on the consideration of small sample quantities, time, and cost. The SUS calculation result will be converted to certain values. This conversion result will give the app information that is made worthy or unfeasible to implement. From the 100 total value, Si Waja obtained 71,833, with index B. It means that this application is eligible to be applied in Surakarta.

Prototipe Aplikasi Mobile Pendukung Keputusan Pemilihan Destinasi Wisata di Yogyakarta

Yogyakarta is one of the most visited regions in Indonesia that is most visited by tourists. Almost every year there are always new tourist objects that have sprung up in Yogyakarta. The problem is the limited time that tourists have to visit Yogyakarta. Therefore, with limited time for tourists, it is difficult to determine which attractions they will visit. This study aims to create a decision support system for tourism object selection in the Special Region of Yogyakarta using the TOPSIS method. In its calculations, the criteria considered are distance, tourist ticket prices, facilities, ease of transportation, the beauty of tourist attractions, cleanliness, and security of tourist attractions. Based on system usability testing, the results show that 37.2% of respondents strongly agree, 58.8% of respondents agree, 3.3% of respondents are neutral, 0.5% of respondents disagree, and 0.0% of respondents strongly disagree with the results of the recommendations.

Usability inquiry of a gamified behavior change app for increasing physical activity and reducing sedentary behavior in adults with and without autism spectrum disorder.

The purpose of this study was to conduct the first usability inquiry of a gamified, behavior change theory-guided mobile app PuzzleWalk for increasing physical activity and reducing sedentary behavior in adults with and without autism spectrum disorder (ASD). Eighteen adults with and without ASD participated in a mixed-methods study that consisted of cognitive walkthrough, system usability assessment, and qualitative interviews. The results of the system usability testing indicated satisfactory quality of the PuzzleWalk system that can be readily applicable to both adults with and without ASD. Several notable issues were identified from the qualitative interviews that address critical insights into unique health and social needs in adults with ASD. Future work is warranted to examine the long-term effects of the PuzzleWalk system on increasing physical activity and reducing sedentary behavior in adults with and without ASD in real-world settings.

Application of Food Marketing Optimization using Analytical Hierarchy Process (AHP)

At present, the agricultural commodity marketing system in Indonesia is detrimental to farmers. Due to the low selling price due to its dependence on intermediaries. That dependency indicates the difficulty of farmers to obtain data or information related to the market. But now, the government has provided data on the commodity market for the public interest. This research seeks to provide alternative solutions by providing web-based decision support applications that can help farmers get optimum marketing in selling their commodities. The price and market location dataset and market conditions obtain by synchronizing data services for the Food Security & Counseling Agency (BKKP) in Yogyakarta. Application of decision models using AHP produces the best marketing decision recommendations in the form of market location and price, based on the location of the farmer’s house and the condition of the commodity. System usability test results with 30 farmer respondents resulted in an average value of SUS 70.0, and SUPER-Q scored 79%. The application can be accepted by farmers to use.