Barrier Walkthrough Research Articles

M2M: Universally Designed Multimedia Training and Learning Application for Maternal Health

The figure of Maternal Mortality Ratio in the global south is worrying and requires a serious attention from all stakeholders. Despite the progress made on maternity healthcare in the last two decades, a huge effort is still required to achieve the SDG3 target. The effort includes capacitating the health professionals and local doulas through training and learning application platforms. Universally designed multimedia training and learning applications plays such a significant role in facilitating this effort. To design an accessible maternity training and learning application, the accessibility barriers of the target diverse user groups must be identified, and the impact of the barriers need to be quantified. In this research work, we have developed a prototype called M2M that comprises VR-based animation to identify the possible accessibility barriers of multimedia-based maternity training and learning application experienced by people with low vision through the combination of heuristic and barrier walkthrough methods. We studied the severity of the identified accessibility barriers and their impact which will serve as a benchmark to develop a fully-fledged maternity health training and learning application for the global south. We have shown the strong correlation between the number of UI elements and the prevalence of accessibility barriers that must be considered in designing the UI/UX of the fully-fledged maternity training and learning application. We have also observed that multimedia contents must be evaluated independently for any accessibility issues before integrating the contents to training applications.

A Heuristic Method for Evaluating Accessibility in Web-Based Serious Games for Users with Low Vision

Nowadays, serious games have become a beneficial resource in the learning process; they are part of our culture and promote social inclusion. Designing accessible serious games is a complete challenge, even more for non-experts. Most existing serious games do not meet accessibility standards because of a lack of methods that include standards and help create more accessible serious games. For this reason, our research presents a heuristic method with three modifications to Giorgio Brajnik’s barrier walkthrough method and based on the Web Content Accessibility Guidelines 2.1 (WCAG 2.1). We defined 28 barriers for the users with low vision and the related impact and persistence variables by defining severity ranges to evaluate accessibility. This method allows measuring the accessibility of web-based serious games; the method proposed in this article can be a good help for non-experts. As a case study, this heuristic method was applied to 40 web-based serious games. The evaluators concluded that serious games should apply WCAG 2.1 to achieve an adequate and inclusive accessibility level. However, this study has limitations; the heuristic method depends on the evaluators’ experience. This work can contribute to studies related to accessibility heuristics in serious games; it can also help construct a software tool that applies WCAG 2.1 and helps experts and non-experts evaluate accessibility in serious games.

A Heuristic Method to Evaluate Web Accessibility for Users With Low Vision

Checking the accessibility of a website is a significant challenge for accessibility experts. Users who suffer from age-related changes, such as low vision, poor hearing, and diminishing motor skills, among others, have problems accessing the services offered by the web. Currently, there are qualitative and quantitative methods to check if a website is accessible. Most methods apply automatic tools because they are low cost, but they do not present an ideal solution. Instead, heuristic methods require manual support that will help the expert to assess accessibility by establishing severity ranges. This research used a modification of the Barrier Walkthrough method proposed by Giorgio Brajnik considering the Web Content Accessibility Guidelines 2.1. The modification consisted of including persistence to determine the severity of an accessibility barrier. This method enabled the measurement of the accessibility of websites to test a new heuristic process and to obtain sample data for analysis. The method was applied to 40 websites, including those of 30 universities in Latin America, according to the Webometrics ranking, and 10 websites among the most visited, according to Alexa ranking. With this heuristic method, the evaluators concluded that although a website is in a high-ranking position, this does not imply that it is accessible and inclusive. However, the manual method takes too long, and it is therefore too costly to solve accessibility problems. This research can serve as a starting point for future studies related to web accessibility heuristics.

Automatic Generation of Tailored Accessible User Interfaces for Ubiquitous Services

Egoki is an automatic generator of accessible user interfaces designed to allow people with disabilities to access supportive ubiquitous services. Egoki follows a model-based approach and selects suitable interaction resources and modalities depending on users’ capabilities. A proof-of-concept prototype evaluation was conducted with accessibility experts and participants in two different scenarios: one devoted to blind people and the other to people with cognitive impairments. Two services were developed for each scenario: a service for selecting the menu for lunch and a bus schedule service. The tailored user interfaces automatically generated for both scenarios were evaluated by accessibility experts following a barrier walkthrough method. In addition, a user evaluation was performed with eleven participants (two blind participants and nine participants with cognitive impairments). Observational methods were employed during the evaluation sessions where participants were asked to perform several tasks. The results revealed that the tailored user interfaces automatically generated by Egoki were operable and accessible and that all of the participants were able to complete the proposed tasks.

Applying the Barrier Walkthrough Method: Going Beyond the Automatic Evaluation of Accessibility

Over the years, people suffer changes caused by the aging of the body and might develop some kind of visual, hearing, motor, among others dysfunctions. These limitations may represent difficulties to access services provided by the Internet, which are growing increasingly. This work is an assessment of accessibility of Internet banking service of the Banco do Brasil using the Method Barrier Walkthrough. The application of this technique made it possible to identify, evaluate and suggest improvements to diminish the obstacles that hinder and/or make it impossible for the elderly users to perform tasks on this website.

The Expertise Effect on Web Accessibility Evaluation Methods

Web accessibility means that disabled people can effectively perceive, understand, navigate, and interact with the web. Web accessibility evaluation methods are needed to validate the accessibility of web pages. However, the role of subjectivity and of expertise in such methods is unknown and has not previously been studied. This article investigates the effect of expertise in web accessibility evaluation methods by conducting a Barrier Walkthrough (BW) study with 19 expert and 57 nonexpert judges. The BW method is an evaluation method that can be used to manually assess the accessibility of web pages for different user groups such as motor impaired, low vision, blind, and mobile users. Our results show that expertise matters, and even though the effect of expertise varies depending on the metric used to measure quality, the level of expertise is an important factor in the quality of accessibility evaluation of web pages. In brief, when pages are evaluated with nonexperts, we observe a drop in validity and reliability. We also observe a negative monotonic relationship between number of judges and reproducibility: more evaluators mean more diverse outputs. After five experts, reproducibility stabilizes, but this is not the case with nonexperts. The ability to detect all the problems increases with the number of judges: With 3 experts all problems can be found, but for such a level 14 nonexperts are needed. Even though our data show that experts rated pages differently, the difference is quite small. Finally, compared to nonexperts, experts spent much less time and the variability among them is smaller, they were significantly more confident, and they rated themselves as being more productive. The article discusses practical implications regarding how BW results should be interpreted, how to recruit evaluators, and what happens when more than one evaluator is hired. Supplemental materials are available for this article. Go to the publisher's online edition of Human–Computer Interaction for statistical details and additional measures for this article.

Barriers common to mobile and disabled web users

World Wide Web accessibility and best practice audits and evaluations are becoming increasingly complicated, time consuming, and costly because of the increasing number of conformance criteria which need to be tested. In the case of web access by disabled users and mobile users, a number of commonalities have been identified in usage, which have been termed situationally-induced impairments; in effect the barriers experienced by mobile web users have been likened to those of visually disabled and motor impaired users. In this case, we became interested in understanding if it was possible to evaluate the problems of mobile web users in terms of the aggregation of barriers-to-access experienced by disabled users; and in this way attempt to reduce the need for the evaluation of the additional conformance criteria associated with mobile web best practice guidelines. We used the Barrier Walkthrough (BW) method as our analytical framework. Capable of being used to evaluate accessibility in both the disabled and mobile contexts, the BW method would also enable testing and aggregation of barriers across our target user groups. We tested 61 barriers across four user groups each over four pages with 19 experts and 57 non-experts focusing on the validity and reliability of our results. We found that 58% of the barrier types that were correctly found were identified as common between mobile and disabled users. Further, if our aggregated barriers alone were used to test for mobile conformance only four barrier types would be missed. Our results also showed that mobile users and low vision users have the most common barrier types, while low vision and motor impaired users experiencing similar rates of severity in the barriers they experienced. We conclude that the aggregated evaluation results for blind, low vision and motor impaired users can be used to approximate the evaluation results for mobile web users.

Web accessibility guideline aggregation for older users and its validation

Web site-evaluation methodologies and validation engines take the view that all accessibility guidelines must be met to gain compliance. Problems exist in this regard, as contradictions within the rule set may arise, and the type of impairment or its severity is not isolated. The Barrier Walkthrough (BW) method goes someway to addressing these issues, by enabling barrier types derived from guidelines to be applied to different user categories such as motor or visual impairment, etc. However, the problem remains of combinatorial explosion of possibilities when one has to consider users with multiple disabilities. In this paper, a simple set theory operation is used to create a validation scheme for older users by aggregating barrier types specific to motor impaired and low-vision users, thereby creating a new “older users” category from the results of this set union. To evaluate the feasibility and validity of this aggregation approach, two BW experiments were conducted. The first experiment evaluated the aggregated results by focusing on quality attributes and showed that aggregation generates data whose quality is comparable to the original one. However, this first experiment could not test for validity, as the older users category was not included. To remedy this deficiency, another BW experiment was conducted with expert judges who evaluated a web page in the context of older users. In this second experiment, it was found that there is no significant difference between the aggregated and the manually evaluated (by experts) barrier scores, and that the same barriers are identified using experts and aggregation, even though there are differences in how severity scores are distributed. From these results, it is concluded that the aggregation of barriers is a viable alternative to expert evaluation, when the target of that aggregation could not be evaluated manually or it would not be feasible to do so. It is also argued that aggregation is a technique that can be used in combination with other evaluation methods, like user testing or subjective assessments.