American Sign Language Interpreter Research Articles

Language Complexities for Deaf and Hard of Hearing Individuals in Their Pursuit of a Career in Science, Technology, Engineering, Mathematics, and Medicine: Perspectives From an LSL/ASL User.

A research scientist with 35 years of experience in the field of hearing research, the author writes that his own experiences have provided a perspective that may be valuable for both future d/Deaf and Hard of Hearing (D/HH) individuals and their peers with typical hearing in their pursuit of a career in Science, Technology, Engineering, Mathematics, and Medicine (STEMM). The author first describes the role of Hearing Inclusive-Association for Research in Otolaryngology in enhancing inclusivity and accessibility for D/HH scientists in the field of Hearing Research. Second, the challenges faced by D/HH scientists arise from the difficulties of working with peers with typical hearing, resulting in less inclusivity and accessibility for the D/HH scientists. The next section deals with solutions to these challenges, including American Sign Language interpreters, websites that give advice on inclusivity and accessibility, and technological advances such as assistive listening devices and smartphones with a capacity for auto captioning. The solutions, however, are fraught with issues such as limited budgets and misperception. Fourth, the author argues that the experiences necessary for a career in STEMM may require a higher-than-expected degree of collaboration with peers with typical hearing outside the laboratory. Finally, studies on successful D/HH scientists in STEMM fields should include experiences of obtaining successful research funding.

A sign language journey to the land of smiles: Thailand study abroad.

This qualitative study focused on the synergistic experience of a group of Deaf1 and hearing participants during a 2-week international study-abroad program to investigate the impact of immersing hearing American Sign Language (ASL) undergraduate majors with culturally Deaf faculty and doctoral students. 20 participants included undergraduate students who were ASL majors, Deaf doctoral students, faculty members, and an interpreter. Data included narratives with the Deaf faculty leader and the hearing ASL interpreter, a content analysis with the hearing undergraduates, and a section focused on the Deaf perspective with a thematic analysis with the Deaf faculty, students, and alumni. 6 themes emerged in the discussion of students' experiences during the tour in Thailand, including being immersed into the Deaf world, the challenge of not comprehending what was happening, the patience of the Thai people, experiencing cultural differences, receptive skills improving, comprehension increasing, and issues related to scheduling of events. The impact of both international and multicultural influences are discussed. Additionally, recommendations for travel agencies that work with Deaf study-abroad leaders are included.

The ASL Dataset for Real-Time Recognition and Integration with LLM Services

This study aims to investigate the impact of hand gesture recognition techniques on the efficiency of American Sign Language (ASL) interpretation, addressing a critical gap in the existing literature. The research seeks new insights into the challenges of automated sign language recognition, contributing to a deeper understanding of accessibility in communication for the deaf and hard-of-hearing community. The study employs a quantitative approach, using a dataset comprising hand gesture images representing the static letters of the ASL alphabet collected from multiple users. Data were collected from various individuals to ensure diversity and analyzed using machine learning models to evaluate their effectiveness in recognizing ASL signs. The results reveal that the machine learning models implemented achieved a high accuracy rate in recognizing hand gestures, indicating that person-specific variations do not significantly hinder performance. These findings provide evidence that the proposed dataset and methodologies can improve the reliability of sign language recognition systems, offering significant implications for the development of more inclusive communication technologies. This research offers a novel perspective on sign language recognition, providing valuable insight that extends the current understanding of gesture-based communication systems. The study’s findings contribute to advancements in accessibility technologies, highlighting areas for future research and practical applications in improving communication for the Deaf and hard of hearing community.

Cognitive resource allocation in deaf individuals: Any implications for injurious falls?

Abstract Background: This mixed-methods pilot study was designed to investigate the possible risk of injurious falls in American Sign Language (ASL) users. Sign language is highly cognitive, yet the impacts of concurrent cognitive load among ASL users are unclear. Research on dual task of walking and signing may provide functional and critical information to prevent injurious falls in the Deaf community where ASL is a primary language. The current study was designed to investigate the potential fall risks due to the simultaneous activity of walking and signing among ASL users. Methods: Five ASL users (4 native ASL users and 1 ASL interpreter) participated in the study. Participants completed three walking tasks under a different cognitive load: Walking without signing, walking while retelling the Cinderella story using ASL, and walking while having a conversation in ASL. Four gait parameters (i.e., functional ambulation profile (FAP), velocity, stride length (SL), and double support time [DST]) were measured using the GAITRite© Portable Walkway System from CIR Systems, Inc. Following the walking tasks, a semi-structured interview was conducted to understand participants’ subjective perception of potential fall risks associated with the dual task. Results: The one-way analysis of variance with the within-subject factor of cognitive load and the Tukey post hoc test revealed participants’ gait stability decreased as the cognitive load increased, evidenced by the significant decrease in FAP scores, SL, and velocity, and increase in DST. Through the qualitatively thematic analysis of the interview, three themes were identified: Walking and signing is a common experience in the Deaf community; signers maintain compensatory strategies; and cultural rules to minimize fall risks while walking and signing exist. Discussion: While the sample size was limited, objective gait deterioration was found in all participants which implies increased fall risks. In addition, participants stated cultural rules and strategies that evidence the presence of such gait changes. The results from this pilot study suggest that while the risk of falls is underperceived, the impact of such an occurrence is felt throughout this sample of Deaf community members. Further investigations in this area are warranted. Conclusion: This pilot study reveals that walking and signing concurrently may increase fall risk among ASL users, as evidenced by objective gait deterioration and participants’ noted compensatory strategies. These findings emphasize the need for greater awareness and further research on fall prevention approaches within the Deaf community.

American Sign Language Translation from Deaf-Mute People Based on Novel System

This paper presents a system to translate gestures from the American Sign Language alphabet using an instrumented wearable glove. This system represents an attempt to utilize a slide potentiometer in sign language translating. The hardware part of the system consists of five slide potentiometers and two force-sensitive resistors, which are best positioned on a glove, based on the analysis of American Sign Language (ASL) letters. In the software part a neural network is used, which was built and trained using Google Colab and Python as the programming language. The performance of the system was tested on three data sets with different numbers of samples. After that, the letters corresponding to the gestures performed are displayed on a computer screen in real time.

UNDERSTANDING CHALLENGES AND SOLUTIONS FOR DEAF OLDER ADULTS

Abstract The Aging Concerns, Challenges, and Everyday Solution Strategies (ACCESS) project explores everyday activity challenges and solutions experienced by U.S. older adults as they age with a lifelong disability involving vision, motor, or hearing. Here, we report our findings from our community-engaged research with older adults who self-identify as members of the U.S. Deaf Community and who use American Sign Language (ASL) as their primary language. Using trained Deaf interviewers, we conducted semi-structured interviews in ASL with 60 Deaf participants (age 60-79 years) to understand their challenges performing various everyday activities (e.g., doing things around the home, activities outside the home, transportation, and managing health). Overall, our thematic analyses revealed that Deaf older adults navigate everyday tasks quite well. However, they experience particular challenges with technology, communication, and accessibility; specifically, fragile or inaccessible technology systems. For instance, technology alerting systems at home (e.g., smoke alarms) or airports (e.g., gate change announcements) are typically auditory. Accessibility is also poor when healthcare or wellness providers fail to provide an ASL interpreter. When probed about their responses to these challenges, Deaf older adults often reported frustration or resignation when experiencing barriers; the need for constant vigilance and self-advocacy; or reliance on hearing family members when systems fail them. Improving communication access and technologies that Deaf older adults rely on is critical and requires the inclusion of individuals from the Deaf community to identify the challenges and potential avenues for solutions.

Flipping the Interpreter Script: Perspectives on Accessibility

In this positional essay, Jessica A. Scott, G. Sue Kasun, and Stephanie J. Gardiner-Walsh discuss their experiences and frustrations around American Sign Language interpreters in higher education settings. They draw from their intersecting experiences as researchers of language and/or deaf education to call for a “flipping of scripts” around how we frame who is being interpreted for in signed language contexts. They argue that the majoritarian, ableist mindset in higher education needs to shift to remember that hearing/abled individuals also need to learn from disabled individuals and that the field of multilingual education needs to better engage signed language in the broader field.

Self-Reported Accommodation Needs for Patients with Disabilities in Primary Care

People with disabilities experience barriers to engaging with health care due to inaccessible social and physical environments at primary care clinics. Despite legal mandates, identification and provision of necessary accommodations for this population at primary care clinics are poor. The objective of this cross-sectional study was to assess patient-reported disability status and accommodation needs among patients at a primary care clinic. An electronic health record-based Disability and Accommodations Questionnaire assessing disability status, types, and accommodation needs was developed by subject matter experts at Michigan Medicine and the University of Michigan Council for Disability Concerns. The questionnaire underwent multiple rounds of reviews and revisions before its use in clinical settings. A paper-based questionnaire was administered to all patients presenting for a wellness-based visit at an academic health system primary care clinic in southeast Michigan. Data were collected between March 2022 and August 2022. Approximately 13% of the 541 patients self-reported a disability, with 54.2% indicating at least one needed accommodation. The most commonly reported disabilities were mental health and hearing-related disabilities, by 4.8% and 4.6% of patients, respectively. The most frequently requested accommodations were communication- or language-based (for example, presence of an American Sign Language interpreter, assistive listening devices), cognitive-based (for example, inclusion of a support person with care decisions), and mobility-based (for example, assistance with transfers). The Disability and Accommodations Questionnaire helped identify the presence of a disability, its types, and any requested accommodations requested at a primary care health center.

American Sign Language Recognition and its Conversion from Text to Speech

Abstract: Speech impairment is a complicated condition that impairs a person's capacity for verbal and audible communication. Those who are impacted frequently use sign language and other alternate forms of communication. While sign language has gained popularity, bridging the communication gap between those who sign and those who don't remains a challenge. Our project endeavors to address this issue by developing an innovative application that offers real-time sign language-to-text translation. This technology aims to facilitate seamless communication between those who use sign language and those who do not. To achieve this, we have constructed a cutting-edge sign language recognition system as part of our project. Our system primarily utilizes American Sign Language (ASL) as its foundation. To accurately detect gestures, we employ a Convolutional Neural Network (CNN) with Inception V3 as the underlying model. This project's core objective is to harness Machine Learning Techniques for converting ASL hand gestures into text and vice versa. We go beyond mere translation by enabling real-time American Sign Language interpretation through single-hand gestures. Furthermore, our system can recognize ASL words, converting them into text before rendering them into audible speech.

Mixed Abilities and Varied Experiences: A Group Autoethnography of a Virtual Summer Internship

The COVID-19 pandemic forced many people to convert their daily work lives to a "virtual" format, in which they connected remotely from home. In this new, virtual environment, accessibility barriers changed, in some respects for the better (e.g., more flexibility) and in other aspects, for the worse (e.g., problems including American Sign Language interpreters over video calls). Microsoft Research held its first cohort of all virtual interns in 2020. We, the interns, full-time members, and affiliates of the Ability Team, a Microsoft research team focused on accessibility, report on our experiences navigating the challenges of working remotely. We constituted a variety of abilities, positions, and levels of seniority. Using an autoethnographic method, we provide a nuanced view of how the virtual setting affected the experiences of our mixed-ability team, the strategies we used to improve access, and areas for further improvement. We close by presenting guidelines for future virtual mixed-ability teams to improve workplace accessibility.

570-P: Designing the Deaf Diabetes Can Together Intervention

Deaf individuals who communicate using American Sign Language (ASL) are 3 times more likely to have diabetes than hearing people, yet experience challenges obtaining diabetes education due to a multitude of systematic barriers. One barrier is communication breakdown between the Deaf patient, an ASL interpreter, and clinician. Due to a lack of unified diabetes medical terms in ASL, confusion can occur when different ASL interpreters are used at diabetes appointments. In collaboration with an all-Deaf Community Advisory Board, a Certified Deaf Interpreter, Deaf health professionals, a universal access designer, and experts in Diabetes care, we co-designed an ASL Glossary of diabetes terms. The ASL Glossary confirmed, clarified, updated, and/or developed new signs and explanatory expansions during a 5-phase process. The ASL Glossary include 42 videos of diabetes terms and 28 explanatory expansions. New signs were developed for the term, ‘insulin’ to help distinguish insulin made within the body and exogenous insulin. A sign clarification was needed to establish the seriousness of prediabetes. The terms ‘diet’ and ‘fat’ were modified to be more politically correct. Technology, such as continuous glucose monitoring, insulin pumps, and smart pens required new signs and/or expansions. The ASL Glossary of diabetes terms addresses systemic barriers that exist in working with Deaf patients and research participants. The ASL Glossary of diabetes terms will support diabetes self-management education and support videos that are being created for the next phase of the Deaf Diabetes Can Together single-arm pilot study. Additionally, the ASL Glossary of diabetes terms will be used to support a future ASL interpreter training. Disclosure M.L.Litchman: None. N.A.Allen: Consultant; Diathrive Health, Dexcom, Inc. E.Iacob: None. N.A.Miller: None. M.Henderson: None. S.M.Canela: None. S.Lee: None. Funding Gordon and Betty Moore Foundation (GBMF9048); Margolis Foundation

Considerations for practitioners using applied behavior analysis therapy with autistic deaf/hard of hearing clients

AbstractThere is scarce research on adapting evidence‐based practices, such as Applied Behavior Analysis (ABA)‐based therapy, for Deaf/Hard of Hearing (DHH) children diagnosed with autism spectrum disorder (ASD). The current case involved delivering intensive ABA‐based intervention for improving communication skills to a 5‐year‐old child, Lilly, with dual diagnoses of DHH and ASD. Teaching procedures were modified to include consideration of deaf cultural norms, incorporation of American Sign Language (ASL)‐specific instructional procedures, and consultation with an ASL interpreter within all intervention sessions. Outcome data measured by the Verbal Behavior Milestones Assessment and Placement Program (VB‐MAPP) reflected rapid skill acquisition across multiple verbal operants within a 7‐month admission. Recommendations on how to deliver intensive ABA‐based intervention services to children with dual diagnoses of DHH and ASD are provided for further research and discussion. Utilizing modified behavior analytic procedures can provide increased access to needed services for this population.

In Situ Co‐transformation of Reduced Graphene Oxide Embedded in Laser‐Induced Graphene and Full‐Range On‐Body Strain Sensor

AbstractOn‐body strain information provides various indicators such as heart rate, physiological pulse, voice waveform, respiratory rate, and body motion status. Recent advances in wearable strain sensors using nanomaterials have significantly enhanced sensor performance with regard to sensitivity, detectable range, and response time. However, it is still challenging to obtain all types of body strain information, from small vibrations to joint movements, using one type of sensor. Herein, a full‐range on‐body strain (FROS) sensor covering ultrasmall‐to‐large strains such as vocal vibration and joint movement is reported. To achieve an ultrawide detectable range, reduced graphene oxide (rGO)‐embedded laser‐induced graphene (LIG) is synthesized by laser engraving on a graphene oxide (GO)‐embedded polyimide (PI) complex film. An rGO‐LIG homostructure based on sp2‐carbons is photothermally reconstructed from the GO‐PI heterostructure in a complex film by in situ co‐transformation and then transferred to an elastomer substrate. The fabricated FROS sensor successfully performs on‐body strain monitoring of various indicators, such as physiological pulse, vocal sound waveform, and body movement, as well as American sign language translation. Furthermore, it is believed that this rGO‐LIG homostructure‐based material synthesized by in situ co‐transformation can potentially provide novel functionalities in fields such as wearable electronics, humanoid, soft robotics, and intelligent prosthetics.

Considerations in the Management of Functional Neurological Disorders in Patients with Hearing Loss.

Adam is a 14-year-old adolescent boy with hearing loss who presented to the pediatric neurology clinic accompanied by his father for evaluation of new-onset left hand tremor for a duration of 1 month. An American Sign Language interpreter was present and used throughout the visit.Adam has bilateral sensorineural hearing loss related to premature birth at 28 weeks' gestation. He uses sign language and attends a school for the hearing impaired. He has been diagnosed with attention-deficit/hyperactivity disorder (ADHD) and a nonspecific learning disorder. His ADHD symptoms are well controlled with a stimulant medication. He is independent in activities of daily living, and there is no concern for intellectual disability. His father is concerned that Adam may have anxiety, but this has not been evaluated.After careful history, it is found that the tremor was first noted the day after burglars broke into his home and stole precious belongings. Current stressors include difficulties with schoolwork and a strained relationship with an extended family member. There is no family history of tremor.The tremor was intermittent initially, with episodes lasting around 30 minutes. Over time, the tremor became more persistent. Adam is left-handed, and the tremor is now interfering with handwriting, eating, and other fine motor skills. The tremor worsens when Adam is tired or stressed and improves with relaxation. No tremor has been noted in other body parts. Adam denies any other neurological symptoms, including headache, vision changes, or gait abnormalities.On examination, Adam seemed anxious but showed no significant distress and had normal vital signs. His general examination was unremarkable. His neurological examination showed intact cranial nerves, apart from the hearing impairment. He had normal muscle tone, intact strength and coordination, and a normal casual gait. Rhythmic shaking of the left upper extremity was present with action, while maintaining posture. Using specific examination techniques, the examiner was able to alter the rhythm of the tremor, and the tremor was noted to subside when the patient was engaged with the examiner. These findings in addition to signs of suggestibility and variable frequency/direction were consistent with a functional etiology.The diagnosis of a functional neurological disorder manifesting in the form of functional tremor was discussed with the patient and his father with assistance from the sign language interpreter. Counseling regarding management consisting mainly of cognitive behavioral therapy and evaluation of possible coexisting conditions, such as anxiety, was discussed.What factors would you consider in diagnosis and management of functional neurological disorder in a hearing-impaired child/adolescent?

Whole-food plant-based Jumpstart for a Deaf and Hard of Hearing cohort.

Deaf and Hard of Hearing (DHH) patients are at high risk of developing chronic illness, and when they do, are at higher risk of poor outcomes than in a hearing community. Rochester Lifestyle Medicine Institute adapted its online, Zoom-based, medically-facilitated 15 Day Whole-Food Plant-Based (WFPB) Jumpstart program, to give DHH participants knowledge, skills, and support to make dietary changes to improve their health. Adaptations included having a medical provider present who is fluent in American Sign Language (ASL), is board-certified in Lifestyle Medicine, and has a Master of Science in Deaf Education; spotlighting participants when asking a question during the Q&A session; using ASL interpreters; utilizing closed captioning/automatic transcription during all Zoom meetings; and employing a Success Specialist to provide outreach via text and email throughout the program. Participants had significant positive changes in their eating pattern. They reported improvements in biometric measures as well as in how they were feeling. They all reported that they planned to continue to eat a more WFPB diet than they did prior to Jumpstart. All either agreed or strongly agreed that they learned important information, were confident that they knew the best eating pattern for health, and gained the skills they needed to make changes. Although this was a small pilot program, it suggests that this model can be used to provide education and support for behavior change that will lead to improved health in a DHH community.

Experiences of pregnancy and perinatal healthcare access of women who are deaf: a qualitative study.

Women who are deaf experience higher rates of reproductive healthcare barriers and adverse birth outcomes compared with their peers who can hear. This study explores the pregnancy experiences of women who are deaf to better understand their barriers to and facilitators of optimal pregnancy-related health care. Qualitative study using thematic analysis. Semi-structured, individual, remote or in-person interviews conducted in the USA. Forty-five women who are deaf and communicate using American Sign Language (ASL) and gave birth in the USA within the past 5 years participated in the interviews. Semi-structured interviews explored how mothers who are deaf experienced pregnancy and birth, including access to perinatal information and resources, relationships with healthcare providers, communication access and their involvement with the healthcare system throughout pregnancy. A thematic analysis was conducted. Barriers and facilitators related to a positive experience of perinatal care access among women who are deaf. Three major themes emerged: (1) communication accessibility; (2) communication satisfaction; and (3) healthcare provider and team support. Common barriers included choosing healthcare providers, inconsistent communication access and difficulty accessing health information. However, when women who are deaf were able to use ASL interpreters, they had more positive pregnancy and birth experiences. Self-advocacy served as a common facilitator for more positive pregnancy and healthcare experiences. Healthcare providers need to be more aware of the communication and support needs of their patients who are deaf, especially how to communicate effectively. Increased cultural awareness and consistent provision of on-site interpreters can improve pregnancy and birth experiences for women who are deaf.

Collaging as Embodied Method: The Use of Collage in a Study of American Sign Language (ASL) Interpreters' Experiences

This methodological essay describes the generativity of collaborative collaging in a qualitative inquiry project with American Sign Language (ASL) interpreters who serve D/deaf students within a public university. Sign language interpreting is a demanding profession requiring physical endurance, creativity, and quick mental processing to switch between spoken and sign language. Interpreters’ visual communicative culture aligns conceptually with the embodied arts-based, visual, and tactile research technique of collaging. We first introduce collaging scholarship to ground our discussion of using collaging as a method within this case study of ASL interpreters. We then provide an overview of ASL interpreter research and our case study to situate the collaging method used alongside other approaches, asking, “How was collaging a productive method for exploring interpreters’ understanding of their work experiences?” We describe the use of the method and the productivity of interpreters’ collaging for surfacing embodied experiences, fueling collaborative meaning-making, and showing rather than telling aspects of interpreters’ labor in another expressive language. We conclude by identifying the value of collaborative collaging in this case study and for other researchers, issues, and contexts.

American Sign Language Translation Using Wearable Inertial and Electromyography Sensors for Tracking Hand Movements and Facial Expressions.

A sign language translation system can break the communication barrier between hearing-impaired people and others. In this paper, a novel American sign language (ASL) translation method based on wearable sensors was proposed. We leveraged inertial sensors to capture signs and surface electromyography (EMG) sensors to detect facial expressions. We applied a convolutional neural network (CNN) to extract features from input signals. Then, long short-term memory (LSTM) and transformer models were exploited to achieve end-to-end translation from input signals to text sentences. We evaluated two models on 40 ASL sentences strictly following the rules of grammar. Word error rate (WER) and sentence error rate (SER) are utilized as the evaluation standard. The LSTM model can translate sentences in the testing dataset with a 7.74% WER and 9.17% SER. The transformer model performs much better by achieving a 4.22% WER and 4.72% SER. The encouraging results indicate that both models are suitable for sign language translation with high accuracy. With complete motion capture sensors and facial expression recognition methods, the sign language translation system has the potential to recognize more sentences.

The Self-Determination Inventory: Student Report American Sign Language Translation.

Research literature and community narratives both emphasize the importance of self-determination in the lives of deaf youth. This paper describes the development, initial validation, and potential applications of a translated measure of self-determination for deaf youth, the SDI:SR ASL Translation (SDI:SR ASL). A sample of 3,309 young people who completed the SDI:SR, of whom 392 were deaf, was used in this validation study. Results provide preliminary support for the use of SDI:SR ASL with deaf youth. Findings also indicate that deaf youth who take the SDI:SR ASL score more similarly to youth without disabilities taking the SDI:SR than youth with disabilities. The SDI:SR ASL can be an important tool for researchers and practitioners to better understand self-determination among deaf youth and facilitate continued development of self-determination skills.

Opening the Pathway: An Example of Universal Design for Learning as a Guide to Inclusive Teaching Practices.

Universal Design for Learning (UDL) provides a flexible framework for supporting a wide variety of learners. We report here on a conference that presented the UDL framework as a way to increase success of deaf and hard-of-hearing (deaf/hh) students in introductory biology courses. The Opening the Pathway conference was an NSF Advanced Technological Education project focusing on raising awareness about careers in biotechnology and student success in introductory biology, a key gateway course for careers in biotechnology. The participants were professionals who work with deaf/hh students at pivotal points in students’ educational pathways for raising awareness of biotechnology career options, including community college faculty, high school faculty at schools for the deaf, and American Sign Language (ASL) interpreters. The conference goal was to provide an effective, meaningful professional development experience in biology instruction. The conference explicitly addressed the role of a UDL approach in building accessible, inclusive, productive learning environments, particularly for deaf/hh students, and demonstrated how to make effective pedagogical practices, specifically case-based learning, inclusive and UDL-aligned in an introductory biology context. We describe the conference, conference outcomes for participants, and in particular the application of the UDL framework to create an inclusive experience.