Generalization of Tooltips: An Assistive Technology Extension

Abstract

Software applications use tooltips to assist users to improve their understanding of icons. When hovering over an icon with the cursor, a short text description of the icon appears. Text-based tooltips are helpful for users without any literacy limitations. An extension was created to generalize tooltips for users with low text literacy. In this case study and to explore such generalization, video based tooltips show short South African Sign Language clips to assist those who use South African Sign Language as a first language. When the user hovers over an icon, a video appears with a short description of the icon in South African Sign Language. As a way to abstract tooltips, audio-based tooltips have also been developed, for users with language barriers, reading disabilities and those who are visually impaired. When hovering over an icon, a short audio description of the icon plays. Both audio and South African Sign Language video based tooltips have been pre-recorded. Through a web extension, users are able to select a tooltip preference for their Mozilla Firefox Browser for audio-based or video-based tooltips.