Sign Language Users Research Articles

User Interface Evaluation of Design Alternatives of the Emotion-Libras—An Emotional Self-Report Instrument for Sign Language Users

Abstract For researchers interested in analyzing participants’ self-reflection about their emotional experience during user studies, having an instrument designed for a specific target user can be seen to show empathy for providing socio-cultural elements that involved parties feel a connection with. In user studies, communication mediation between sign language users and non-signers may include a bias; therefore, direct communication between the involved parties is welcome to reduce this risk and expand sign language users’ autonomy. This paper presents the Emotion-Libras, a self-report instrument to collect emotional responses of sign language users after interacting with technology and report findings from a user study. We conducted a focus group with five sign language users to collect their perceptions regarding the three design alternatives of the instrument. As a result, participants selected the best-fitted design interface of the instrument and also found room for improvement in video quality, language choice, written labels and user control.

How sign language expertise can influence the effects of face masks on non-linguistic characteristics

Face masks occlude parts of the face which hinders social communication and emotion recognition. Since sign language users are known to process facial information not only perceptually but also linguistically, examining face processing in deaf signers may reveal how linguistic aspects add to perceptual information. In general, signers could be born deaf or acquire hearing loss later in life. For this study, we focused on signers who were born deaf. Specifically, we analyzed data from a sample of 59 signers who were born deaf and investigated the impacts of face masks on non-linguistic characteristics of the face. Signers rated still-image faces with and without face masks for the following characteristics: arousal and valence of three facial expressions (happy, neutral, sad), invariant characteristics (DV:sex, age), and trait-like characteristics (attractiveness, trustworthiness, approachability). Results indicated that, when compared to masked faces, signers rated no-masked faces with stronger valence intensity across all expressions. Masked faces also appeared older, albeit a tendency to look more approachable. This experiment was a repeat of a previous study conducted on hearing participants, and a post hoc comparison was performed to assess rating differences between signers and hearing people. From this comparison, signers exhibited a larger tendency to rate facial expressions more intensely than hearing people. This suggests that deaf people perceive more intense information from facial expressions and face masks are more inhibiting for deaf people than hearing people. We speculate that deaf people found face masks more approachable due to societal norms when interacting with people wearing masks. Other factors like age and face database’s legitimacy are discussed.

Video Relay Interpretation and Overcoming Barriers in Health Care for Deaf Users: Scoping Review.

BackgroundPersons who are deaf are more likely to avoid health care providers than those who can hear, partially because of the lack of means of communication with these providers and the dearth of available interpreters. The use of video remote interpretation, namely the video camera on an electronic device, to connect deaf patients and health providers has rapidly expanded owing to its flexibility and advantageous cost compared with in-person sign language interpretation. Thus, we need to learn more about how this technology could effectively engage with and respond to the priorities of its users.ObjectiveWe aimed to identify existing evidence regarding the use of video remote interpretation (VRI) in health care settings and to assess whether VRI technology can enable deaf users to overcome barriers to interpretation and improve communication outcomes between them and health care personnel.MethodsWe conducted a search in 7 medical research databases (including MEDLINE, Web of Science, Embase, and Google Scholar) from 2006 including bibliographies and citations of relevant papers. The searches included articles in English, Spanish, and French. The eligibility criteria for study selection included original articles on the use of VRI for deaf or hard of hearing (DHH) sign language users for, or within, health care.ResultsFrom the original 176 articles identified, 120 were eliminated after reading the article title and abstract, and 41 articles were excluded after they were fully read. In total, 15 articles were included in this study: 4 studies were literature reviews, 4 were surveys, 3 were qualitative studies, and 1 was a mixed methods study that combined qualitative and quantitative data, 1 brief communication, 1 quality improvement report, and 1 secondary analysis. In this scoping review, we identified a knowledge gap regarding the quality of interpretation and training in sign language interpretation for health care. It also shows that this area is underresearched, and evidence is scant. All evidence came from high-income countries, which is particularly problematic given that most DHH persons live in low- and middle-income countries.ConclusionsFurthering our understanding of the use of VRI technology is pertinent and relevant. The available literature shows that VRI may enable deaf users to overcome interpretation barriers and can potentially improve communication outcomes between them and health personnel within health care services. For VRI to be acceptable, sign language users require a VRI system supported by devices with large screens and a reliable internet connection, as well as qualified interpreters trained on medical interpretation.

E-learning is a burden for the deaf and hard of hearing

When considering deaf and hard of hearing (DHH) population, research recognizes that fatigue due to communication challenges and multi-focal attention allocation is a significant concern. Given the putative heightened demands of distance learning on deaf and hard of hearing students, we investigate how an online environment might differently affect deaf and hard of hearing participants, compared to hearing participants, Portuguese Sign Language (PSL) users and non-users. Our findings show that the deaf and hard of hearing group present higher values in the post-task fatigue rates with significant differences from the hearing group (non-PSL users). Furthermore, our results revealed an association between post-task fatigue rates and lower performance scores for the deaf and hard of hearing group, and the gap is significantly bigger when compared with the hearing group (non-PSL users). We also found evidence for high levels of post-task fatigue and lower performance scores in the hearing group PSL users. These novel data contribute to the discussion concerning of the pros and cons of digital migration and help redesign more accessible and equitable methodologies and approaches, especially in the DHH educational field, ultimately supporting policymakers in redefining optimal learning strategies.

Accessibility of national cultural heritage to deaf tourists

Individuals with hearing impairments face numerous obstacles when engaged in touristic activities or using infrastructure and services in touristic spots. When tourism is considered a social good of first necessity, new concerns arise and pressure for inclusion in the sector stimulates the advance of innovative solutions for inclusive tourism. There are also economic interests in inclusive tourism, an unexplored market niche that might compensate the expected drop on the tourism growth rate in comparison to recent years in Portugal. The ICHT project – Inclusive Cultural Heritage Tourism – aims to promote the accessibility of deaf tourists to cultural heritage by embedding new technology-aids, online and on-site, to raise awareness, to attract deaf tourists, to assist them while visiting us, and to exploit their experience as a new dissemination channel. ICHT is focused on creating digital tools and digital content in sign language to be available online, on mobile devices and on-site at cultural touristic attractions in the North of Portugal through innovative channels like games, holography, and collaborative platforms. ICHT advocates the integration of novel high-tech sign language user interfaces in tourism destinations and stimulates local operators to learn the basics of sign language communication to welcome deaf tourists in Portugal. ICHT brings in R&D world-class results in the field of automatic sign language translation qualifying Portugal to guide Inclusive Tourism worldwide and become a pioneer leading the Tourism of the Future. The full system includes an on-site application using holography, a game to play on a mobile device (before, during, and after visiting the attraction), an online collaborative platform to assist deaf and non-deaf tourists, and a set of International Sign training courses. The ICHT system will be available in five pilot installations at Torre dos Clérigos, Lello bookshop, Maia Zoo, Port wine cellars, and Viseu thermae. ICHT brings a new approach to teach sign language to the professionals in the touristic sector opening new opportunities for a more inclusive society. The sign language training together with the assistive technology tools developed by ICHT generate inclusive environments for the deaf. ICHT has the potential to become a PIN project in the Tourism sector.

The eye and the other: Language and ethics in deaf Nepal

AbstractThis article examines interactions between deaf and hearing people in Nepal that are conducted in natural sign, a mode of signed communication involving relatively small repertoires of conventional signs complemented by iconic and indexical strategies. Natural sign is an exemplary case for unpacking the claim that ethics is not only intrinsic to linguistic interaction but also grounds its very possibility. While this is ultimately true for all language use, natural sign heightens this quality and its consequences, in terms of both interaction (whether people understand) and analysis (how scholars understand whether people understand). Bringing together Nepali Sign Language users’ insights with academic theories of interaction, pragmatics, and semiotics, this article demonstrates the high stakes for deaf natural signers of being rendered intelligible or unintelligible by the “ordinary” ethical actions of their interlocutors.

A Portable Sign Language Collection and Translation Platform with Smart Watches Using a BLSTM-Based Multi-Feature Framework.

Continuous sign language recognition (CSLR) using different types of sensors to precisely recognize sign language in real time is a very challenging but important research direction in sensor technology. Many previous methods are vision-based, with computationally intensive algorithms to process a large number of image/video frames possibly contaminated with noises, which can result in a large translation delay. On the other hand, gesture-based CSLR relying on hand movement data captured on wearable devices may require less computation resources and translation time. Thus, it is more efficient to provide instant translation during real-world communication. However, the insufficient amount of information provided by the wearable sensors often affect the overall performance of this system. To tackle this issue, we propose a bidirectional long short-term memory (BLSTM)-based multi-feature framework for conducting gesture-based CSLR precisely with two smart watches. In this framework, multiple sets of input features are extracted from the collected gesture data to provide a diverse spectrum of valuable information to the underlying BLSTM model for CSLR. To demonstrate the effectiveness of the proposed framework, we test it on an extremely challenging and radically new dataset of Hong Kong sign language (HKSL), in which hand movement data are collected from 6 individual signers for 50 different sentences. The experimental results reveal that the proposed framework attains a much lower word error rate compared with other existing machine learning or deep learning approaches for gesture-based CSLR. Based on this framework, we further propose a portable sign language collection and translation platform, which can simplify the procedure of collecting gesture-based sign language dataset and recognize sign language through smart watch data in real time, in order to break the communication barrier for the sign language users.

Attitudes Toward Signing Avatars Vary Depending on Hearing Status, Age of Signed Language Acquisition, and Avatar Type.

The use of virtual humans (i.e., avatars) holds the potential for interactive, automated interaction in domains such as remote communication, customer service, or public announcements. For signed language users, signing avatars could potentially provide accessible content by sharing information in the signer's preferred or native language. As the development of signing avatars has gained traction in recent years, researchers have come up with many different methods of creating signing avatars. The resulting avatars vary widely in their appearance, the naturalness of their movements, and facial expressions—all of which may potentially impact users' acceptance of the avatars. We designed a study to test the effects of these intrinsic properties of different signing avatars while also examining the extent to which people's own language experiences change their responses to signing avatars. We created video stimuli showing individual signs produced by (1) a live human signer (Human), (2) an avatar made using computer-synthesized animation (CS Avatar), and (3) an avatar made using high-fidelity motion capture (Mocap avatar). We surveyed 191 American Sign Language users, including Deaf (N = 83), Hard-of-Hearing (N = 34), and Hearing (N = 67) groups. Participants rated the three signers on multiple dimensions, which were then combined to form ratings of Attitudes, Impressions, Comprehension, and Naturalness. Analyses demonstrated that the Mocap avatar was rated significantly more positively than the CS avatar on all primary variables. Correlations revealed that signers who acquire sign language later in life are more accepting of and likely to have positive impressions of signing avatars. Finally, those who learned ASL earlier were more likely to give lower, more negative ratings to the CS avatar, but we did not see this association for the Mocap avatar or the Human signer. Together, these findings suggest that movement quality and appearance significantly impact users' ratings of signing avatars and show that signed language users with earlier age of ASL acquisition are the most sensitive to movement quality issues seen in computer-generated avatars. We suggest that future efforts to develop signing avatars consider retaining the fluid movement qualities integral to signed languages.

Cross-language activation in bimodal bilinguals: Do mouthings affect the co-activation of speech during sign recognition?

AbstractThe present study provides insight into cross-language activation in hearing bimodal bilinguals by (1) examining co-activation of spoken words during processing of signs by hearing bimodal bilingual users of Dutch (their L1) and Sign Language of the Netherlands (NGT; late learners) and (2) investigating the contribution of mouthings to bimodal cross-language activation. NGT signs were presented with or without mouthings in two sign-picture verification experiments. In both experiments the phonological relation (unrelated, cohort overlap or final rhyme overlap) between the Dutch translation equivalents of the NGT signs and pictures was manipulated. Across both experiments, the results showed slower responses for sign-picture pairs with final rhyme overlap relative to phonologically unrelated sign-picture pairs, indicating co-activation of the spoken language during sign processing, but no significant effect for sign-picture pairs with cohort overlap in Dutch. In addition, co-activation was not affected by the presence or absence of mouthings.

Understanding cultural aspects of deaf communities in México towards the codesign of automatic sign language processing systems

This paper reports findings from a study through which we seek to understand the socio-economic and cultural context of deaf communities in a city in México in order to inform the codesign of automatic sign language processing systems. We conducted eleven interviews in two school settings with three deaf persons who are sign language users and eight hearing persons who have close relationships with deaf persons. We designed interview scripts to collect data from deaf persons, parents, and sign language teachers and interpreters. In addition to demographic data, we collected data on experience with technology for communication use as well as salient cultural aspects. Key findings from our research relate to perceptions of study participants about themselves and their context: Socio-economic aspects are consistent with previous studies; cultural traits are central for communication, denote a strong sense of identity, and highlight the role of sight and perception. We also report on reflections that were facilitated by the application of existing schemes and frameworks, which allowed us to learn about communication hardships and workarounds, as well as the most important values for the community. These findings shed light on a path we want to further investigate, which aims to understand whether variations exist in the basic needs of deaf signers with respect to the codesign of ASLP systems, independently of the countries where they live.

Testing the body specificity hypothesis: A comparative study of the Persian language and the Persian Sign language

The present study explores the role of language in establishing the lateral space-valence mappings in mind. According to the body specificity hypothesis, regardless of linguistic and cultural conventions, “goodness” in people's minds is associated with the body's dominant side. The current study explores the language's influence on conceptualizing spatial metaphors by comparing two right-handed groups with similar cultural experiences but different language patterns. We used a computer-based task to compare the conceptual mappings between the right/left sides of space and emotional valence in Persian speakers and Persian Sign language users. Our result showed that right-handed Persian speakers strongly relate positive emotions to the right side and negative emotions to the left. This result is predictable by the effects of both linguistic and bodily experiences that are consistent in this case. However, in the case of Persian Sign language users, the bodily and linguistic experiences disagreed. Our finding showed that Sign language participants disregarding their bodily experiences, followed their linguistic patterns.

Bilingual digital educational resources design: a model for assessment and supporting checklist

Bilingual Digital Educational Resources (DERs) are digital media (videos, animations, multimedia, etc.) designed for the teaching-learning process of deaf students, users of Brazilian Sign Language and Portuguese in its written form. The conception of these resources consists of a specific design demand, both as a project, as well as in the formal aesthetic aspects and in the organization of information. In this context, the design challenge of bilingual DERs is to contemplate two languages, articulating visual resources that support text and signaling, without overloading the user. Currently, many DERs are produced for the deaf, but research is scarce on how to assess the quality and select these materials. In this sense, the aim of this article is to present a model for evaluating the design of bilingual digital educational resources (Libras/Portuguese), as well as a support checklist for the evaluation of these resources, which can be carried out by researchers, teachers and project teams.

Zwiększenie czytelności wypowiedzi w polskim języku migowym przez animowaną wirtualną postać. Badania użytkowników z wykorzystaniem nowych technologii

Research in construction of sign language avatars, which are computer-generated representations of linguistic phenomena, can be used to arrive at solutions facilitating communication with hearing-impaired persons. The clarity of content of the sign communication is particularly important for its recipient. As part of its project “How to Increase the Comprehensibility of Utterances in the Polish Sign Language through Animated Virtual Assistant”, the research network Łukasiewicz- Instytut Technik Innowacyjnych EMAG from Katowice (Ł-EMAG)23 has undertaken research with a view to evaluating the efficacy of the Polish Sign Language (PJM) through a virtual assistant; the other objective is to single out those traits which most contribute to satisfactory reception and comprehension of communication. The present article reports on the comparative studies conducted so far, which include surveys and in-depth interviews with hearing-impaired users of sign language by means of dedicated research tools. The first (introductory) stage consisted in gathering users’ opinions on the comprehensibility of the sign language of the first created avatar, including features which either facilitate of hinder communication as well as the level of experience of hearing-impaired persons in the use of on-line translators. In the second stage, a model of a 3D virtual assistant was developed, which took into consideration all the above-mentioned features facilitating or hindering communication. This part of the research yielded data concerning the comprehensibility of the virtual avatar as well as users’ comparison of the two avatars.

Sense of Community: The Irish Deaf Community

There is a strong perception among members of the Irish deaf community that the community is in gradual decline, with dwindling traditional bases for producing Irish Sign Language (ISL) users. For instance, enrolments in residential schools for the deaf have been declining steadily, and the numbers involved in social, sports and cultural activities in the community have been falling. Technological advances, consolidation of educational policies for deaf children in mainstream education, and individualisation and increased social mobility have also had an impact on how this community operates. However, there is paltry research on how such changes have affected deaf community cohesion, especially in the Irish context. Therefore, this ongoing research entitled Sense of Community – the Irish Deaf Community, seeks to explore the notion and strength of community belonging amongst the deaf community in Ireland. This project report presents the results of one element of this research, i.e. an online survey study conducted in June 2020. Initial analysis of the results of this survey indicate that ISL is one of the primary bonds holding the Irish deaf community together and that issues that divide the community include trustworthiness, feelings of exclusion, and the notion of leadership.

The mental wellbeing of Deaf sign language users

The mental wellbeing of Deaf sign language users

"They're Not Willing To Accommodate Deaf patients": Communication Experiences of Deaf American Sign Language Users in the Emergency Department.

Deaf people who use American Sign Language (ASL) are more likely to use the emergency department (ED) than their hearing English-speaking counterparts and are also at higher risk of receiving inaccessible communication. The purpose of this study is to explore the ED communication experience of Deaf patients. A descriptive qualitative study was performed by interviewing 11 Deaf people who had used the ED in the past 2years. Applying a descriptive thematic analysis, we developed five themes: (1) requesting communication access can be stressful, frustrating, and time-consuming; (2) perspectives and experiences with Video Remote Interpreting (VRI); (3) expectations, benefits, and drawbacks of using on-site ASL interpreters; (4) written and oral communication provides insufficient information to Deaf patients; and (5) ED staff and providers lack cultural sensitivity and awareness towards Deaf patients. Findings are discussed with respect to medical and interpreting ethics to improve ED communication for Deaf patients.

Exploring the lived experiences of British Sign Language (BSL) users who access NHS adult hearing aid clinics: an interpretative phenomenological analysis

Objective To explore the lived experiences of culturally Deaf British Sign Language (BSL) users who access adult hearing aid services. Design Semi-structured qualitative interviews were conducted in BSL by the Deaf researcher and analysed using an Interpretative Phenomenological Analysis (IPA) approach. Study sample Eight Deaf BSL expert informants who were experienced users of NHS adult hearing aid clinics. Results Participants expressed dissatisfaction about audiology staff's lack of Deaf awareness and did not feel valued as Deaf signers. Participants' motivations for hearing aid use primarily concerned audibility rather than speech. Mismatch of perspectives on ‘hearing’ between audiologists and Deaf patients are discussed in the context of culturally sensitive services. Inadequate or uncertain linguistic access during appointments is considered in light of patient agency. Conclusion This is the first study to explore culturally Deaf signers' specific experiences of adult hearing aid services in the UK and their experiences of hearing aids. There are numerous reasons why Deaf signers wear hearing aids, but access to spoken language is not a priority. Limited Deaf awareness and cultural competence in adult hearing aid services can result in patient frustration and disempowerment. Suggestions for improvement in the Deaf signing patient experience are offered.

The accessibility of BBC television to users with disabilities: from the law to user satisfaction

Universal accessibility to public television guarantees the fundamental right to receive media information and promotes social inclusion. British audiovisual regulations impose minimum quotas for subtitling, audio description, and sign language to make content more accessible to people with visual or hearing impairment. However, these minimum requirements do not ensure full user satisfaction. The aim of this study is to present a descriptive analysis of user satisfaction with the accessibility of BBC public television services, both linear and on demand, and collect the improvements demanded by users. The survey method was applied, interviewing 442 UK residents who were users of subtitles, audio description, and sign language, mostly people with disabilities or members of their families. The questionnaire also included qualitative questions to capture basic demands identified by the users. One of the main results is the need to improve the quality and synchrony of live subtitling, and to increase the fractions of programming with audio description and sign language. Moreover, beyond compliance with the law, it is essential to listen to the opinions of users with visual or hearing impairment to ensure that services fulfill their mission of guaranteeing audiovisual accessibility and promoting social inclusion.

On cognitive tensionsm.

Aim. The foundation of symbolization is a substitution: a mediation between a Representamen and Object. The paper leverages this core mechanic to examine the substitutions within the conscious and unconscious parts of the mind, which compose every act of thinking. Recognizing it is a single instance: the Ego, which regulates this parallel mediation, the paper focuses on the exploration of dichotomies that result from the necessity to perform two symbolizations simultaneously. Concepts. The study’s theoretical framework is determined by Charles S. Peirce’s (1998) concept of sign and Melanie Klein’s (1948) psychoanalytic theory. From semiotic and psychoanalytic angles, this paper explores possible comprehensions of the object in the quasi-mind (Interpretant in infinite semiosis) and actual realization of code in the act of individual thinking (Ego mediating between conscious and unconscious symbolization). Results and conclusion. The main result of the study is the exposure of dichotomies that structure the shared ground for the conscious and the unconscious symbolization. This, in turn, highlights tangible constraints that the mind is subjected to in the act of thinking. Cognitive value. The study’s main contribution is the high-level scheme of dynamics that hold the Ego in reality through the means of unconscious and conscious symbolization. The study also incorporates into coherent model unexamined aspects of individual sign usage: it deploys psychic continuity into the conscious symbolization process (by basing the model on the instance of Ego), which allows addressing the issues arising at the border of conscious and unconscious symbolization.

L. S. Vygotsky’s cultural-historical theory: globalisation, post-non-classical paradigm and digitalisation

L. S. Vygotsky’s cultural-historical theory postulates the underlying unity of psychological and social factors contributing to the formation of man. It explains both internal factors determining the evolution of consciousness and social trends in social development. The paper highlights the role of L. S. Vygotsky’s theory in the interpretation of the changes in the modern human consciousness. These changes are caused by new culture tools of knowledge building currently created in the information space. The author emphasises the following ideas proposed by L. S. Vygotsky: 1) signs are functionally analogous to tools; 2) culture intentionally creates objects to realise its communicative-significative function; 3) sign utilization leads to the formation of fundamentally new associative bonds in the brain. Such bonds create a novel regulatory mechanism of human behaviour; 4) social determination of man is achieved with the help of signs; 5) the formation and functioning of mind depend on the means of thought and individual sociocultural experience; 6) ‘socialised speech’ influences the evolution of inner speech as a specific type of thinking-in-words and the logic of thinking; 7) the historical evolution of human culture plays the key role in the formation and functioning of individual psyches; 8) due to sign usage the nature of human evolution changed from biological to sociohistorical; consequently, mankind’s evolution significantly depends on the signs used by individuals. Modern digital technologies actively generate signs whose nature is contrary to verbal ones. The process of globalisation and the values of the post-non-classical mindset sustain generation of such signs. Globalisation creates a standardised and maximally regimented reality, which contributes to the reinforcement of reduplication as the socially approved way of knowledge use. What is more, globalisation requires revision of the traditional humanistic values and customs. Post-non-classical thinking enhances individuals’ feelings of insecurity and uncertainty, thus nearly making them act within the framework of conventional behavioural and mental models.