Heuristic Evaluation Method Research Articles

Hired by Artificial Intelligence: Digital Inclusion Practices for People With Disabilities

Artificial intelligence (AI) rapidly advances across various industries, including healthcare, finance, education, robotics, entertainment, and commerce. Human resource (HR) management plays a crucial role in AI, helping employees feel valued and creative. However, AI-powered systems often neglect the needs of people with disabilities, who often face barriers in digital environments. This paper aims to investigate digital inclusion practices for people with disabilities in AI-driven human resource management systems. It proposes a heuristic evaluation method for software accessibility assessment based on international standards. The objectives include researching best practices for digital workplace inclusion, studying international standards for software accessibility, and researching AI-powered recruitment systems. An experiment assessed the accessibility of color schemes for people with color blindness.

Analisis Usability Website PT. Perkebunan Nusantara (PTPN IX) Untuk Menunjang Industri Kreatif di Era Global

Technology is rapidly advancing in society and the workplace. PT Perkebunan NusantaraIX (PTPN IX), which operates in the management and marketing of plantationcommodities, has utilized technology to facilitate the presentation of downstream productinformation through a dynamic website. The PTPN IX website plays a crucial role inpresenting the company's latest information. However, the PTPN IX website has neverundergone a usability testing process. Therefore, this study aims to analyze the quality ofthe website in supporting its role and functions. The results of the observations indicate thatseveral users experience problems when accessing the website. To analyze these issues,heuristic evaluation methods were used to identify usability problems on the website, andthe System Usability Scale (SUS) to assess the system's feasibility. This method involved3 evaluators and 100 users to evaluate the website based on 10 heuristic aspects, whichwere mapped into sub-aspects according to their severity levels. The overall evaluationresults indicated categories of cosmetic issues and minor usability problems. This studyidentified 10 problems and provided recommendations for improving the PTPN IXwebsite. The improvement recommendations aim to optimize the website system to betterfulfill its role and function as an information provider platform related to local commodityproducts for all elements of society.

EVALUASI USABILITY WEBSITE DISDUKCAPIL KABUPATEN MAJALENGKA MENGGUNAKAN METODE HEURISTIC EVALUATION

This study evaluates the usability of the DISDUKCAPIL website of Majalengka Regency using the heuristic evaluation method. By collecting questionnaire data referring to ten heuristic principles, this study identified key issues such as aesthetics, flexibility, and system feedback. The results indicate that a more minimalist and consistent design is needed to improve user experience. Recommendations for improvement are focused on increasing visibility, user control, and help features. Implementation of recommendations is expected to improve the effectiveness and efficiency of services provided through this website, so that it better meets the needs of the Majalengka community.

Evaluasi Heuristik E-Learning Institut Agama Hindu Negeri Tampung Penyang Palangka Raya

Institute of Hindu Religion (IAHN) Tampung Penyang Palangka Raya has e-learning in an e-campus with complex features. Many e-learning features become ineffective, and make users unable to maximize their use. Therefore, a heuristic evaluation approach from Nielsen's is needed to find out the extent of usability in the e-learning. The heuristic evaluation method is a method used to find usability problems of a product using 10 heuristic evaluation principles. In this research, the assessment was carried out by 4 expert usability evaluators. The calculation of usability heuristic evaluation using severity ratings scale has been done. The results of the assessment based on heuristic evaluation on the IAHN-TP Palangka Raya e-campus application resulted in 24 problem findings. The highest value of the average severity rating (SR) is on the principle of error prevention and as much as 92% of the largest percentage is on the principle of visibility of system status. This research also provides recommendations for design improvements ranging from adding functions, changing appearance, and layout according to the results of the heuristic evaluation. These recommendations can be used as a consideration for the IAHN-TP campus management in improving the application.

The Analysis and Improvement of User Interface Design on Climate Information Service Mobile Application Using the Lean UX Method

Info BMKG is an iOS and Android app providing weather, temperature, air quality, and earthquake data across Indonesia. Issues related to the usability of the BMKG Info application were identified through observations and feedback found on the Google Play Store, which has a rating of 4.4. The responses identified included an unattractive appearance, limited features, increasing complexity, and a need for more innovation, necessitating usability evaluation and UI design improvements to enhance user experience. The analysis and redesign follow the Lean UX approach and Heuristic Evaluation method. Usability testing, specifically the Post-Study System Usability Questionnaire, is used to assess user satisfaction. The study finds that implementing Lean UX significantly improves the system's quality and user experience. UI design enhancements, based on usability testing, improve navigation, information clarity, and ease of use. Recommendations result in better outcomes, with Heuristic Evaluation yielding scores of H1 = 1 (System status visibility), H2 = 1 (Match between the system and the real world), H4 = 1 (Consistency and standards), H5 = 1 (Error prevention), H7 = 1 (Flexibility and efficiency of use), H8 = 1 (Aesthetic and minimalist design), and H9 = 1 (Help users recognize, diagnose, and recover from errors). The Post-Study System Usability Questionnaire method shows an improvement from high to a better category.

Integration of Equity, Diversity, Inclusivity, and Indigeneity Principles into Usability Heuristic Evaluations.

Cognitive walkthrough is a form of usability testing that considers the perspective of the end users to identify issues related to user experience and web design. This project aims to enhance traditional heuristic evaluation methods with consideration of equity, diversity, inclusivity, and indigeneity (EDI-I) principles. The authors provide suggestions that align with modern informatics advancements, aiming for inclusive design systems and the elimination of systemic barriers.

Usability Evaluation of Medical Tourism Websites in Iran

Introduction: Medical tourism is a recent form of travel that involves rapidly increasing overseas trips to address a variety of health issues. Medical tourism websites play a vital role in offering information and resources for people looking for medical treatment overseas. A well-designed and easy-to-use website can help build trust and credibility with potential patients. The aim of this study is to assess the usability of the leading medical tourism websites in Iran.Material and Methods: The present study was a descriptive and cross-sectional study. In this study, the usability of five top medical tourism website in Iran were evaluated using heuristic evaluation method. The checklist was based on Nielsen’s heuristics. The criteria for selecting the top websites were Alexa Rank Checker.Results: The median of usability problems rates in website1, website2, website3, website4, and website5 were 11.1%, 7.7%, 9.9%, 10% and 9.1%, respectively. The median severity of identified problems for website1, website2, website3, website4, and website5 were 2.6%, 2.9%, 2.9%, 2.9% and 2.8%, respectively. The principles of “help and documentation”, “visibility of site status”, and “Security and privacy” in the five websites were categorized into the “highest rate of problems”, “lowest rate of problems”, and “highest severity of problems” groups, respectively.Conclusion: By addressing usability issues of medical tourism websites, organizations can better serve their users and ultimately contribute to the growth of the medical tourism industry.

BRIDGING THEORY AND PRACTICE: COMPARATIVE INSIGHTS INTO EVALUATING USER INTERFACES

Abstract Keywords Cite This Article as User interface (UI) evaluation is an important aspect of software development, ensuring that software or systems are efficient and user satisfactory. Among the various usability testing methods available, Cognitive Walkthrough Method, Heuristic Evaluation Method and Concurrent Usability Testing Method stand out as most popular approaches. This research paper presents a comparative analysis of these testing methods, emphasizing their strengths, flaws, and applicability in different situations. Through a detailed analysis of each testing method's procedural steps, and practical concerns, we aim to provide insights into their effectiveness and suitability for evaluating User Interface (UI) designs. Additionally, we discuss potential synergies and inadequacies when combining these testing methods in practice. Our results and findings contribute to a deeper understanding of UI evaluation techniques and provide guidance for selecting the most appropriate approach for testing team’s specific needs.

Grado de usabilidad de plataformas e-learning a través delmétodo de evaluación heurística en estudiantes de universidad pública de Trujillo 2021-2022

The National University of Trujillo offers high quality educational services in its various programmes; due to the health crisis, the institution underwent a major change in the mode of delivery of classes, which became from face-to-face to virtual. This change forced the university population to make use of technological tools such as virtual platforms, but the process of adaptation was very difficult for everyone. Barriers such as the lack of previous culture and the complex manipulation of these systems prevented many students from continuing their studies. In order to address this problem, a study was carried out to determine the degrees of usability of virtual platforms through a heuristic evaluation method with the aim of identifying attributes that could be improved with the support of experts. In order to achieve this, the components that make the correct and simple use of these platforms possible were determined, where the student has the possibility of developing their subjects and being able to understand the use of the platform, which has intuitive characteristics. This research concluded with the evaluation of the grades for each component giving as a result a very significant level in the use of the virtual classroom E-learning.

User Interface Analysis of PeduliLindungi Application to Improve User Experience with The Heuristic Evaluation Method

The Covid-19 pandemic limits human activities every day. The spread of the virus is uncontrollable, it can attack anyone, anytime, and anywhere. As a solution, the use of the PeduliLindungi application technology developed by the Ministry of Communication and Information in collaboration with other relevant Ministries and Institutions is used to help track the spread of viruses and understand preventive measures to stop their spread. Research was conducted on the appearance of the application's User Interface using the Heuristic Evaluation method to measure its usefulness. However, there are several problems experienced by users, namely the information is not updated (vaccines and Covid-19 tests), the language used is inconsistent, and others. Questionnaire testing with 10 questions based on 10 Heuristic Evaluation criteria was distributed via Google Form to 33 respondents. Then, carry out validity and reliability tests with the research results obtained Valid and Reliable. as well as testing the hypothesis of all Learnability, Efficiency, Memorability, and Error Prevention factors, based on usability and user satisfaction aspects, questionnaire items all test results are accepted and there are no serious problems. However, there are a number of things that need to be improved so that the application can run more optimally.

Application of Heuristic Evaluation Method to Evaluate User Experience and User Interface of Personnel Management Information Systems to Improve Employee Performance

This research aims to determine the level of user satisfaction with using SIMPEG application and evaluate the user interface design to improve the user experience. The research was conducted using qualitative methods. Researchers decided to involve as many as 100 participants in this research. To collect data and information based on system requirements, researchers collect data using observation, interviews, questionnaires, and literature studies. In designing the evaluation at application, researchers used a user-centered design approach and the heuristic evaluation method. Based on the research results, it was found that in the UCD approach, it often experiences bugs and errors, whereas in application there is no mobile application available, which aims to make it easier for employees to access the application anywhere and anytime. It is currently only available on a web basis. The UCD approach shows that the application has uses and functions that meet employee expectations with an average percentage of 70%, falling into the attractive category. The end result of the UCD approach emphasizes the importance of clearly understanding users and providing better user experiences. Meanwhile, the HE approaches helps identify problems with the application and focuses attention on usability issues in the HE aspects. In an effort to improve the quality of the user interface (UI) and user experience (UX) in application, the evaluation that has been carried out shows that improvements need to be focused on the appearance and use of the application.

Heuristic Evaluation of a Web-Based Application to Deliver a Home-Based Personalized Physical Exercise Program for Older Adults

It is crucial to assess the usability of digital health applications to promote physical exercise since problems with usability could lead to errors in utilization, which may result in accidents such as falls. Heuristic evaluation has been applied in different areas, including applications to promote healthy and active aging. The objective of this study was to evaluate the usability of the two user interfaces (i.e., the practitioner interface and the participant interface) of a web-based application to deliver a home-based personalized physical exercise program for older adults using the heuristic evaluation method. The Heuristic Evaluation System Checklist (HESC) was used, and three evaluators analysed both user interfaces. The results indicate that there were minor usability issues in both interfaces, and that the web-based application presents good usability. Out of the 292 checklist sub-heuristics of the HESC Checklist, 183 in the practitioner interface were compliant, ten were not compliant, and 99 were not applicable. Similarly, 172 sub-heuristics in the participant interface were compliant, eight were not compliant, and 112 were not applicable. The study highlighted that heuristic evaluation generates a considerable amount of objective information, providing an exhaustive identification of aspects that require improvement.

Evaluation and Improvement of User Interface Design in Mobile Delivery Services With User Centered Design Approach and Heuristic Evaluation (Case Study: Kirimaja Application)

KirimAja is a mobile-based goods delivery service application that is useful for helping people to send goods easily. This application has several features for sending goods, such as the Sameday Service, Nextday Service, Regular Service, Check Rates, and Check Receipts features. Usability problems in the KirimAja application were found based on observations and responses found in the "Google Play Store" and "App Store", namely in an unattractive appearance and display of error messages that were not well understood, therefore a usability evaluation and improvement of the user interface design are needed help the user when using the application. Evaluation and improvement of the user interface design in the KirimAja application uses the User Centered Design approach and the Heuristic Evaluation method, while testing user satisfaction with the KirimAja application uses the System Usability Scale method. The design improvements made resulted in increased results, namely by using the Heuristic Evaluation method to get scores on the H5 Error Prevention and H9 Help Users Recognize, Diagnoze, and Recover from Errors aspects from 2 to 0, while using the System Usability Scale method experienced an increase in the grade scale from D to A.

Evaluasi Sistem ATR/BPN Berbasis Webuse dan Heuristic Evaluation

The Ministry of Agrarian Spatial Planning/National Land Agency (ATR/BPN) provides services that aim to facilitate the public in managing the legality of land services online, which can be accessed anywhere with the aim of providing convenience and security to the public in conducting service transactions as an effort to increase the ease of doing business, but the benefits of this website have not been measured for the usability of the website effectively and efficiently. Therefore, this research was conducted with the aim of evaluating and assessing the appearance of the interface with the Heuristic Evaluation method and the Web Usability Evaluation Tool (WEBUSE) and measuring display development. ATR/BPN website to help the community. The research method uses the Web Usability Evaluation Tool (WEBUSE) in the form of a questionnaire and then evaluates it using Heuristic Evaluation. The research that has been carried out has produced findings that show the ATR/BPN Website has a level that is good enough to be used by Notary/PPAT employees and the community. From the usability test, it shows that the quality attribute can be said to be of high value. The conclusion of the study shows that each category of WEBUSE Evaluation has a usability value of 0.69 points, which indicates the usability level is at a good level while the lowest value is in the visibility of system status (feedback) variable (H1 of 61.02%) according to the usability level at the Moderate. This means it's not working properly. And the Savery Rating is 1.3119 when rounded up to 1 category of cosmetic problem that takes time to fix.

ANALISIS USER INTERFACE (UI) DAN USER EXPERIENCE (UX) PADA WEBSITE COFFEE SUFI MENGGUNAKAN METODE HEURISTIC EVALUATION

Coffee Sufi is a business that focuses on selling coffee, which already has a website as a medium for transactions and promotions, therefore a website must be able to attract the attention of potential customers. To support website design, it is necessary to have periodic developments. Based on research by distributing questionnaires answered by 60 respondents who were taken randomly, namely: the need for improvements to the ordering page through the website by adding several functions such as choosing payment methods, adding order cancellations, ordering history, besides that some argue that in terms of website appearance it requires updating the user interface both in terms of page content composition, icons on the website, in order to produce a good user experience. There are many ways or methods that can be used to evaluate the usability of the user interface and user experience of the website. One of them is the Heuristic Evaluation method. Heuristic Evaluation method is a method that examines the ease of use (usability) and helps find or identify problems that exist in the interface or user interface of a software (Nielsen, 1994).

ANALYSIS OF FKIP UNSIKA WEBSITE BASED ON HUMAN AND COMPUTER INTERACTION PRINCIPLES

The website of the Fakultas Keguruan dan Ilmu Pendidikan Unsika functions as a platform for FKIP Unsika students to access information related to lectures. The purpose of analyzing the FKIP Unsika Website is to understand the relationship between system functions based on the principles and paradigms of Human and Computer Interaction (HCI). In analyzing the Website interface design, the author uses a heuristic evaluation method that evaluates human, technological, usability, and ergonomic aspects. The data used in this research was obtained through distributing questionnaires to respondents who have experience in designing and creating websites, and have a background in informatics. The results show that the rules in the heuristic evaluation method used, such as Visibility of system status, Match between the system and the real world, User control and freedom, Consistency and standards, Recognition rather than recall, and Flexibility and efficiency of use, have not been fully met because there are still problems that need to be fixed.

Development of a serious game-based cognitive rehabilitation system for patients with brain injury

BackgroundTraumatic brain injury (TBI) resulting from a forceful impact to the head can cause severe functional disabilities, with cognitive impairment being a major hindrance to patients' return to daily life. Encouraging patients to engage in rehabilitation programs consistently poses a significant challenge for therapists. To address this issue, gamification has gained momentum as an effective approach. This study aims to develop a serious game-based cognitive rehabilitation system tailored for patients with brain injury.MethodsThe study included four stages. Initially, the requirements were analyzed through focus groups. Then the system structure and game content were discussed and was agreed as a conceptual model. In second stage, the system design was drawn using various modeling diagrams. In third stage, a system prototype was developed using the Unity game engine and C# programming. Finally, a heuristic evaluation method was employed to assess usability.ResultsBased on the focus group meetings with seven participants, a conceptual model of the system structure and game content was designed. Game's interface was developed for both the therapist and patient versions. The focus groups determined a 2D casual gaming genre with a postman character and 10 missions on the smartphone platform. For example, in the first mission, the postman must move from mailboxes 1 to 10 and pick up the letters. This is according to Trail Making Test task. The 16 tasks in different subcategories of attention were selected to make these missions. The usability evaluation highlighted privacy, help and documentation, and aesthetic and minimalist design as the areas with the highest percentage of problems.ConclusionsCognitive rehabilitation is vital in facilitating patients' faster return to daily routines and enhancing their quality-of-life following brain injury. Incorporating a game-based system provides patients with increased motivation to engage in various cognitive exercises. Additionally, continuous monitoring by specialists ensures effective patient management. The game-based system offers different game stages to strengthen and rehabilitate attention in patients with brain injury. In the next step, the clinical effects of this system will be evaluated.

Mock Up Website “Conato Bakery” Dengan Menerapkan Prinsip Usability

In the increasingly developing digital era, website design has become one of the key elements for online business success and provides a satisfying experience for users. The usability principle is a concept related to the extent to which a website can be easily used by its users.Usability principles include Effective, Efficient, Interesting, Easy to learn and easy to remember. By applying the usability principle, a website can be effective in achieving its goals. Then there is the method used, namely the User Experience Lifecycle, which is a framework that can be applied when you want to develop a product (Prototype, Hardware and Software). There are four stages in this method, namely Analysis, Design, Implementation and Evaluation. The heuristic evaluation method is a process in which experts use rules of thumb to measure the usability of a user interface in independent search and problem reporting. The results are discussed using UX analysis methods.In designing the design has been created in a site map and innovations are adapted to solving problems. In implementation, namely implementing the design results into a web design which has its own function and evaluation applies existing usability principles.

Evaluation of User Interface in the Just Meme Application Using the Heuristic Evaluation Method

Just Meme is a mobile application used for expressing people's feelings by creating stickers, GIFs, and funny videos. The aim of this research is to evaluate the user interface of the Just Meme application using the Heuristic Evaluation Method. Prior to this study, the researcher conducted an evaluation with 20 users of the Just Meme application, resulting in a plethora of user comments. Consequently, the researcher decided to assess the quality of the user interface in the Just Meme application with the goal of ensuring user satisfaction with the new feature displays and attracting more users to use this application. This was accomplished by distributing questionnaires to individuals considered experts in the field. The research findings, based on the ten principles of Heuristic Evaluation, revealed two principles with significantly higher scores than the others. Firstly, "recognition rather than recall" received a total score of 1.444 (cosmetic problem), indicating no need for improvement as it does not affect the user. Secondly, "Help and Documentation" scored similarly, with a total of 1.333 (cosmetic problem), suggesting that no significant improvements are required, and it does not impact the user

Reflections on Surrogate-Assisted Search-Based Testing: A Taxonomy and Two Replication Studies based on Industrial ADAS and Simulink Models

Surrogate-assisted search-based testing (SA-SBT) aims to reduce the computational time for testing compute-intensive systems. Surrogates enhance testing techniques by improving test case generation focusing the testing budget on the most critical portions of the input domain. In addition, they can serve as approximations of the system under test (SUT) to predict test results instead of executing the tests on compute-intensive SUTs. This article reflects on the existing SA-SBT techniques, particularly those applied to system-level testing and often facilitated using simulators or complex test beds. Recognizing the diversity of heuristic algorithms and evaluation methods employed in existing SA-SBT techniques, our objective is to synthesize these differences and present a comprehensive view of SA-SBT solutions. In addition, by critically reviewing our previous work on SA-SBT, we aim to identify the limitations in our proposed algorithms and evaluation methods and to propose potential improvements. We present a taxonomy that categorizes and contrasts existing SA-SBT solutions and highlights key research gaps. To identify the evaluation challenges, we conduct two replication studies of our past SA-SBT solutions: One study uses industrial advanced driver assistance system (ADAS) and the other relies on a Simulink model benchmark. We compare our results with those of the original studies and identify the difficulties in evaluating SA-SBT techniques, including the impact of different contextual factors on results generalization and the validity of our evaluation metrics. Based on our taxonomy and replication studies, we propose future research directions, including re-considerations in the current evaluation metrics used for SA-SBT solutions, utilizing surrogates for fault localization and repair in addition to testing, and creating frameworks for large-scale experiments by applying SA-SBT to multiple SUTs and simulators.