Learning American Sign Language Research Articles

Exploring the Benefits and Applications of Video-Span Selection and Search for Real-Time Support in Sign Language Video Comprehension among ASL Learners

People learning American Sign Language (ASL) and practicing their comprehension skills will often encounter complex ASL videos that may contain unfamiliar signs. Existing dictionary tools require users to isolate a single unknown sign before initiating a search by selecting linguistic properties or performing the sign in front of a webcam. This process presents challenges in extracting and reproducing unfamiliar signs, disrupting the video-watching experience, and requiring learners to rely on external dictionaries. We explore a technology that allows users to select and view dictionary results for one or more unfamiliar signs while watching a video. We interviewed 14 ASL learners to understand their challenges in understanding ASL videos, strategies for dealing with unfamiliar vocabulary, and expectations for an in-situ dictionary system. We then conducted an in-depth analysis with 8 learners to examine their interactions with a Wizard-of-Oz prototype during a video comprehension task. Finally, we conducted a comparative study with 6 additional ASL learners to evaluate the speed, accuracy, and workload benefits of an embedded dictionary search feature within a video player. Our tool outperformed a baseline in the form of an existing online dictionary across all three metrics. The integration of a search tool and span selection offered advantages for video comprehension. Our findings have implications for designers, computer vision researchers, and sign language educators.

Getting Inspired: A Qualitative Study on the Use of the Inspirisles Role-Playing Game to Teach Middle Schoolers American Sign Language

Background The purpose of this study was to determine the effectiveness of a role-playing game (RPG) as a pedagogical tool for teaching beginning American Sign Language (ASL) to middle school students in a classroom setting. Methods In this qualitative study, n = 40 students participated in a 50-minute class centered on the ASL role-playing game, Inspirisles, for 45 days. To collect data on the student experience of the Inspirisles class, a post-process focus group was conducted with an external moderator and students (n =18) who chose to participate. Student responses were coded using applied thematic analysis. Results Students reported learning 50 to 100 words in American Sign Language, including numbers and the fingerspelling alphabet. Beyond language acquisition, they reported three main themes: a change in learning dispositions, positive social-emotional growth, and identification of important factors for success in continuing classes. Conclusion Students in the Inspirisles -based ASL class showed progress in learning ASL, with additional considerations for prosocial group learning in the classroom setting. However, further research is needed to see if this pedagogy is a viable option for long-term learning of ASL in the classroom setting.

ASL champ!: a virtual reality game with deep-learning driven sign recognition

We developed an American Sign Language (ASL) learning platform in a Virtual Reality (VR) environment to facilitate immersive interaction and real-time feedback for ASL learners. We describe the first game to use an interactive teaching style in which users learn from a fluent signing avatar and the first implementation of ASL sign recognition using deep learning within the VR environment. Advanced motion-capture technology powers an expressive ASL teaching avatar within an immersive three-dimensional environment. The teacher demonstrates an ASL sign for an object, prompting the user to copy the sign. Upon the user’s signing, a third-party plugin executes the sign recognition process alongside a deep learning model. Depending on the accuracy of a user’s sign production, the avatar repeats the sign or introduces a new one. We gathered a 3D VR ASL dataset from fifteen diverse participants to power the sign recognition model. The proposed deep learning model’s training, validation, and test accuracy are 90.12%, 89.37%, and 86.66%, respectively. The functional prototype can teach sign language vocabulary and be successfully adapted as an interactive ASL learning platform in VR.

Development of the American Sign Language Fingerspelling and Numbers Comprehension Test (ASL FaN-CT)

We describe the development and initial validation of the “ASL Fingerspelling and Number Comprehension Test” (ASL FaN-CT), a test of recognition proficiency for fingerspelled words in American Sign Language (ASL). Despite the relative frequency of fingerspelling in ASL discourse, learners commonly struggle to produce and perceive fingerspelling more than they do other facets of ASL. However, assessments of fingerspelling knowledge are highly underrepresented in the testing literature for signed languages. After first describing the construct, we describe test development, piloting, revisions, and evaluate the strength of the test’s validity argument vis-à-vis its intended interpretation and use as a screening instrument for current and future employees. The results of a pilot on 79 ASL learners provide strong evidence that the revised test is performing as intended and can be used to make accurate decisions about ASL learners’ proficiency in fingerspelling recognition. We conclude by describing the item properties observed in our current test, and our plans for continued validation and analysis with respect to a battery of tests of ASL proficiency currently in development.

Learning a Sign Language Does Not Hinder Acquisition of a Spoken Language.

The purpose of this study is to determine whether and how learning American Sign Language (ASL) is associated with spoken English skills in a sample of ASL-English bilingual deaf and hard of hearing (DHH) children. This cross-sectional study of vocabulary size included 56 DHH children between 8 and 60 months of age who were learning both ASL and spoken English and had hearing parents. English and ASL vocabulary were independently assessed via parent report checklists. ASL vocabulary size positively correlated with spoken English vocabulary size. Spoken English vocabulary sizes in the ASL-English bilingual DHH children in the present sample were comparable to those in previous reports of monolingual DHH children who were learning only English. ASL-English bilingual DHH children had total vocabularies (combining ASL and English) that were equivalent to same-age hearing monolingual children. Children with large ASL vocabularies were more likely to have spoken English vocabularies in the average range based on norms for hearing monolingual children. Contrary to predictions often cited in the literature, acquisition of sign language does not harm spoken vocabulary acquisition. This retrospective, correlational study cannot determine whether there is a causal relationship between sign language and spoken language vocabulary acquisition, but if a causal relationship exists, the evidence here suggests that the effect would be positive. Bilingual DHH children have age-expected vocabularies when considering the entirety of their language skills. We found no evidence to support recommendations that families with DHH children avoid learning sign language. Rather, our findings show that children with early ASL exposure can develop age-appropriate vocabulary skills in both ASL and spoken English.

Four American Sign Language Learner Groups: Are They Really Different?

We investigated the receptive American Sign Language (ASL) skills of four separate groups using the 42-item ASL-Receptive Skills Test: Deaf high school-aged students who attended a residential school; deaf incoming college students who preferred signed language; deaf incoming college students who preferred spoken language; and typically hearing college-aged second language-second modality learners (M2L2) of ASL. Many deaf students learn ASL as a delayed first language due to a lack of sign language models within their home environments. In contrast, M2L2 students likely engage in some transfer between their first (spoken) and second (signed) language when learning ASL. All four groups scored similarly overall on the ASL-RST (~77% correct), and all four groups scored the lowest for number-distribution, spatial verbs location, size-and-shape-specifiers, and role shift. We present instructional implications that include incorporation of ASL standards and evidence-based instructional strategies for all four groups.

Corrective Feedback to Second Language Learners of American Sign Language

This study examined the corrective feedback Deaf teachers used to target handshape, movement, and place-of-articulation errors in introductory American Sign Language (ASL) classes for hearing students. Although feedback is underresearched in bimodal second language (M2-L2) pedagogy, there is some evidence that teacher practices may differ from those observed in spoken L2 classes, notably in the more frequent use of direct corrections. Willoughby et al.'s (2015) study of Auslan (Australian Sign Language) reports that the teachers' preference for this type of correction stemmed from beliefs about the challenges of learning signed language phonology. Spoken L2 research suggests that a reliance on this type of feedback may limit students' opportunities to learn from their errors, as the nontarget form is corrected for the student and is not often followed by student "repair" of the original error (Panova and Lyster 2002). As student response to teacher feedback was not examined in Willoughby et al.'s (2015) study, we do not know if M2-L2 students show similar behavior. The current study was designed to address this issue, examining both teacher feedback practices and student responses to feedback.

Hearing parents learning American Sign Language with their deaf children: a mixed-methods survey.

Hearing parents with deaf children face difficult decisions about what language(s) to use with their child. Sign languages such as American Sign Language (ASL) are fully accessible to deaf children, yet most hearing parents are not proficient in ASL prior to having a deaf child. Parents are often discouraged from learning ASL based in part on an assumption that it will be too difficult, yet there is little evidence supporting this claim. In this mixed-methods study, we surveyed hearing parents of deaf children (n=100) who had learned ASL to learn more about their experiences. In their survey responses, parents identified a range of resources that supported their ASL learning as well as frequent barriers. Parents identified strongly with belief statements indicating the importance of ASL and affirmed that learning ASL is attainable for hearing parents. We discuss the implications of this study for parents who are considering ASL as a language choice and for the professionals who guide them.

Adjusting to Change: Learning American Sign Language Online During A Global Pandemic

Second language acquisition of American Sign Language (ASL) requires opportunities for engagement with native language models (Krashen, 1988). The shift to online instruction due to the impact of COVID-19 presented unique challenges for ASL programs across the United States. With little time to redesign courses, instructors and students had to navigate the experience of online learning together. The students who participated in this 2020 study at Western Oregon University (WOU) shared their raw experiences related to this transition, and unfortunately, one year later, many of the same barriers reported by students persist. The purpose of this article is to share their stories, and present evidence that face-to-face instruction of ASL is essential and cannot simply be replaced with online learning without negative consequences. Access to immersion opportunities and consistent engagement with native language models are not easy to replicate in online environments, pointing to the fact that there is a need for face-to-face opportunities to acquire ASL when it is safe to do so.

Effects of inverted L2/Ln language pedagogy on student experiences and outcomes: The case of American Sign Language

Second language (L2) learning has largely occurred in the traditional lecture-based classroom setting. Studies show that the lecture format has an impact on student outcomes and perceptions of classroom learning. Negative impacts include insufficient time for reinforcement activities, reviewing lecture materials, and engaging in conversation between instructors and students. An innovative way to enhance L2 students’ classroom outcomes and perceptions is the inverted classroom pedagogy. This study assesses whether the inverted pedagogy leads to more positive student perspectives and higher student outcomes compared to traditional pedagogy in L2 classrooms in American Sign Language (ASL). In this study, student outcomes and instructor and student perceptions of inverted pedagogy for ASL are assessed using a mixed method design with one controlled (traditional) and one experimental (inverted) advanced ASL class in a post-secondary setting. Results suggest that the inverted pedagogy is an approach that is as viable as the traditional approach for teaching and learning ASL as an L2 that enables students to engage in meaningful activities and conversations.

Emerging ASL Distinctions in Sign-Speech Bilinguals' Signs and Co-speech Gestures in Placement Descriptions.

Previous work on placement expressions (e.g., “she put the cup on the table”) has demonstrated cross-linguistic differences in the specificity of placement expressions in the native language (L1), with some languages preferring more general, widely applicable expressions and others preferring more specific expressions based on more fine-grained distinctions. Research on second language (L2) acquisition of an additional spoken language has shown that learning the appropriate L2 placement distinctions poses a challenge for adult learners whose L2 semantic representations can be non-target like and have fuzzy boundaries. Unknown is whether similar effects apply to learners acquiring a L2 in a different sensory-motor modality, e.g., hearing learners of a sign language. Placement verbs in signed languages tend to be highly iconic and to exhibit transparent semantic boundaries. This may facilitate acquisition of signed placement verbs. In addition, little is known about how exposure to different semantic boundaries in placement events in a typologically different language affects lexical semantic meaning in the L1. In this study, we examined placement event descriptions (in American Sign Language (ASL) and English) in hearing L2 learners of ASL who were native speakers of English. L2 signers' ASL placement descriptions looked similar to those of two Deaf, native ASL signer controls, suggesting that the iconicity and transparency of placement distinctions in the visual modality may facilitate L2 acquisition. Nevertheless, L2 signers used a wider range of handshapes in ASL and used them less appropriately, indicating that fuzzy semantic boundaries occur in cross-modal L2 acquisition as well. In addition, while the L2 signers' English verbal expressions were not different from those of a non-signing control group, placement distinctions expressed in co-speech gesture were marginally more ASL-like for L2 signers, suggesting that exposure to different semantic boundaries can cause changes to how placement is conceptualized in the L1 as well.

When event knowledge overrides word order in sentence comprehension: Learning a first language after childhood.

Limited language experience in childhood is common among deaf individuals, which prior research has shown to lead to low levels of language processing. Although basic structures such as word order have been found to be resilient to conditions of sparse language input in early life, whether they are robust to conditions of extreme language delay is unknown. The sentence comprehension strategies of post-childhood, first-language (L1) learners of American Sign Language (ASL) with at least 9years of language experience were investigated, in comparison to two control groups of learners with full access to language from birth (deaf native signers and hearing L2 learners who were native English speakers). The results of a sentence-to-picture matching experiment show that event knowledge overrides word order for post-childhood L1 learners, regardless of the animacy of the subject, while both deaf native signers and hearing L2 signers consistently rely on word order to comprehend sentences. Language inaccessibility throughout early childhood impedes the acquisition of even basic word order. Similar to the strategies used by very young children prior to the development of basic sentence structure, post-childhood L1 learners rely more on context and event knowledge to comprehend sentences. Language experience during childhood is critical to the development of basic sentence structure.

University American Sign Language Learners: Self-Awareness and Error Analysis within a Narrative Context

Second-language learners of American Sign Language (ASL) often struggle in the acquisition of more complex ASL aspects, such as role shift, constructed action, and eye gaze to represent characters and their actions with narratives. These learners also often overestimate their ASL skill level. This study investigated errors in second modality, second language (M2L2) university learners' ASL narrative retellings through rating comparisons (i.e., agreements and disagreements) between learners themselves and their instructor. Learners engaged in repeated viewings of ASL models of two Signing Naturally stories, Timber and Gum, paired with instructor analysis, modeling, and feedback on learners' productions within a sociocultural framework. Learners' self-evaluations were compared to instructor evaluations using an itemized list of narrative episode details and options for how they were produced to identify where these evaluations were in agreement or not. Overall agreement was high (i.e., M = 92%), however, agreement across specific ASL aspects, including role shift, constructed action, and accurate sign production, varied to a greater extent (i.e., 89–94%). Two types of disagreements occurred: those in which learners rated a detail as absent while the instructor rated it as present, and those in which learners rated a detail as present while the instructor rated it as absent. Omissions occurred infrequently, in which both the learner and instructor agreed that a detail was absent. The specific instructional framework used in this study and implications for university-level ASL instruction are discussed in this article.

Teaching American Sign Language in Mixed Reality

This paper presents a holistic system to scale up the teaching and learning of vocabulary words of American Sign Language (ASL). The system leverages the most recent mixed-reality technology to allow the user to perceive her own hands in an immersive learning environment with first- and third-person views for motion demonstration and practice. Precise motion sensing is used to record and evaluate motion, providing real-time feedback tailored to the specific learner. As part of this evaluation, learner motions are matched to features derived from the Hamburg Notation System (HNS) developed by sign-language linguists. We develop a prototype to evaluate the efficacy of mixed-reality-based interactive motion teaching. Results with 60 participants show a statistically significant improvement in learning ASL signs when using our system, in comparison to traditional desktop-based, non-interactive learning. We expect this approach to ultimately allow teaching and guided practice of thousands of signs.

Person vs. locative agreement: Evidence from late learners and language emergence.

Sign languages are frequently described as having three verb classes. One, 'agreeing' verbs, indicates the person/number of its subject and object by modification of the beginning and ending locations of the verb. The second, 'spatial' verbs, makes a similar appearing modification of verb movement to represent the source and goal locations of the theme of a verb of motion. The third class, 'plain' verbs, is characterized as having neither of these types of modulations. A number of researchers have proposed accounts that collapse all of these types, or the person-agreeing and spatial verbs. Here we present evidence from late learners of American Sign Language and from the emergence of new sign languages that person agreement and locative agreement have a different status in these conditions, and we claim their analysis should be kept distinct, at least in certain ways.

Forced Transitions: Learning ASL In A Virtual Environment

Engagement with native language models is essential for second language acquisition. Social distancing mandates made this interaction nearly impossible for students learning American Sign Language (ASL), at a small rural university in western Oregon. COVID-19 brought with it many challenges, not the least of which was a hurried transition from face-to-face to online learning. The author found that some courses degraded in content and instruction when shifting to an online platform. Without access to community events where native language models were present, ASL students had less opportunities for incidental learning, legitimate peripheral participation, and connection within Deaf communities of practice.

Lexical Recognition in Deaf Children Learning American Sign Language: Activation of Semantic and Phonological Features of Signs.

Children learning language efficiently process single words, and activate semantic, phonological, and other features of words during recognition. We investigated lexical recognition in deaf children acquiring American Sign Language (ASL) to determine how perceiving language in the visual-spatial modality affects lexical recognition. Twenty native- or early-exposed signing deaf children (ages 4 to 8 years) participated in a visual world eye-tracking study. Children were presented with a single ASL sign, target picture, and three competitor pictures that varied in their phonological and semantic relationship to the target. Children shifted gaze to the target picture shortly after sign offset. Children showed robust evidence for activation of semantic but not phonological features of signs, however in their behavioral responses children were most susceptible to phonological competitors. Results demonstrate that single word recognition in ASL is largely parallel to spoken language recognition among children who are developing a mature lexicon.

Children flexibly seek visual information to support signed and spoken language comprehension.

During grounded language comprehension, listeners must link the incoming linguistic signal to the visual world despite uncertainty in the input. Information gathered through visual fixations can facilitate understanding. But do listeners flexibly seek supportive visual information? Here, we propose that even young children can adapt their gaze and actively gather information for the goal of language comprehension. We present 2 studies of eye movements during real-time language processing, where the value of fixating on a social partner varies across different contexts. First, compared with children learning spoken English (n = 80), young American Sign Language (ASL) learners (n = 30) delayed gaze shifts away from a language source and produced a higher proportion of language-consistent eye movements. This result provides evidence that ASL learners adapt their gaze to effectively divide attention between language and referents, which both compete for processing via the visual channel. Second, English-speaking preschoolers (n = 39) and adults (n = 31) fixated longer on a speaker's face while processing language in a noisy auditory environment. Critically, like the ASL learners in Experiment 1, this delay resulted in gathering more visual information and a higher proportion of language-consistent gaze shifts. Taken together, these studies suggest that young listeners can adapt their gaze to seek visual information from social partners to support real-time language comprehension. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The Hearing Loss Talk

The Hearing Loss Talk

Cross-modal translation priming and iconicity effects in deaf signers and hearing learners of American Sign Language.

This study used ERPs to a) assess the neural correlates of cross-linguistic, cross-modal translation priming in hearing beginning learners of American Sign Language (ASL) and deaf highly proficient signers and b) examine whether sign iconicity modulates these priming effects. Hearing learners exhibited translation priming for ASL signs preceded by English words (greater negativity for unrelated than translation primes) later in the ERP waveform than deaf signers and exhibited earlier and greater priming for iconic than non-iconic signs. Iconicity did not modulate translation priming effects either behaviorally or in the ERPs for deaf signers (except in a 800-1000 ms time window). Because deaf signers showed early translation priming effects (beginning at 400ms-600ms), we suggest that iconicity did not facilitate lexical access, but deaf signers may have recognized sign iconicity later in processing. Overall, the results indicate that iconicity speeds lexical access for L2 sign language learners, but not for proficient signers.