Word-object Pairings Research Articles

The effect of masks on infants' ability to fast-map and generalize new words.

Young children today are exposed to masks on a regular basis. However, there is limited empirical evidence on how masks may affect word learning. The study explored the effect of masks on infants' abilities to fast-map and generalize new words. Seventy-two Chinese infants (43 males, Mage = 18.26 months) were taught two novel word-object pairs by a speaker with or without a mask. They then heard the words and had to visually identify the correct objects and also generalize words to a different speaker and objects from the same category. Eye-tracking results indicate that infants looked longer at the target regardless of whether a speaker wore a mask. They also looked longer at the speaker's eyes than at the mouth only when words were taught through a mask. Thus, fast-mapping and generalization occur in both masked and not masked conditions as infants can flexibly access different visual cues during word-learning.

Age differences in priming as a function of processing at encoding

It is unclear whether implicit memory (priming) is affected by aging. Some studies have reported no difference between young and older adults, while others have uncovered reliable reductions. An important factor that may explain these discrepancies is the manner of encoding. Processing requirements (perceptual/conceptual) have varied considerably between studies, yet processing abilities are not equally affected by aging. This study examined whether processing during encoding moderates age effects on priming. Young and older participants studied object-word pairs and made natural/manufactured (conceptual) and left/right rotation (perceptual) judgements in relation to the word or object. Objects served as targets on a subsequent continuous identification with recognition task to assess priming and recognition. Priming and recognition were greater in young than older adults for attended items, with a larger effect size in the conceptual than the perceptual condition. Findings suggest that age differences in priming may be a function of processing at encoding.

A lack of retrieval practice effects in children's recognition and recall memory of novel words during storybook reading

IntroductionRetrieval practice enhances adults' long-term memory over restudying. However, it is less clear whether young children also benefit from retrieval practice. This study assessed whether retrieval practice could support children's novel word learning in the context of storybook reading.MethodIn Experiments 1–3, preschoolers (N = 167, RangeAge = 26–68 months) were presented with 10 novel word-object pairs across four consecutive storybook readings. Half of the children were read the storybook four times (i.e., SSSS), whereas the other half of the children were read the storybook once and were then asked to retrieve the novel words during the subsequent three readings (i.e., STTT). Children's recall and recognition memory for the novel words was tested after a 5-min delay.Results and discussionResults revealed that although children had high retrieval success during learning, retrieval practice did not provide an advantage over re-reading for children's recall (Experiment 1), even when additional mapping and retrieval opportunities were provided (Experiment 2); that is, children who engaged in retrieval practice did not outperform children who re-read the storybooks. A retrieval practice effect also did not emerge in children's recognition memory of novel words (Experiment 3). Taken together, this study suggests that retrieval practice may only benefit young children under specific learning conditions. Future research should therefore consider characteristics of the learner and broader learning context to explain developmental differences in retrieval practice effects.

Word Learning in Deaf Adults Who Use Cochlear Implants: The Role of Talker Variability and Attention to the Mouth.

Although cochlear implants (CIs) facilitate spoken language acquisition, many CI listeners experience difficulty learning new words. Studies have shown that highly variable stimulus input and audiovisual cues improve speech perception in CI listeners. However, less is known whether these two factors improve perception in a word learning context. Furthermore, few studies have examined how CI listeners direct their gaze to efficiently capture visual information available on a talker's face. The purpose of this study was two-fold: (1) to examine whether talker variability could improve word learning in CI listeners and (2) to examine how CI listeners direct their gaze while viewing a talker speak. Eighteen adults with CIs and 10 adults with normal hearing (NH) learned eight novel word-object pairs spoken by a single talker or six different talkers (multiple talkers). The word learning task comprised of nonsense words following the phonotactic rules of English. Learning was probed using a novel talker in a two-alternative forced-choice eye gaze task. Learners' eye movements to the mouth and the target object (accuracy) were tracked over time. Both groups performed near ceiling during the test phase, regardless of whether they learned from the same talker or different talkers. However, compared to listeners with NH, CI listeners directed their gaze significantly more to the talker's mouth while learning the words. Unlike NH listeners who can successfully learn words without focusing on the talker's mouth, CI listeners tended to direct their gaze to the talker's mouth, which may facilitate learning. This finding is consistent with the hypothesis that CI listeners use a visual processing strategy that efficiently captures redundant audiovisual speech cues available at the mouth. Due to ceiling effects, however, it is unclear whether talker variability facilitated word learning for adult CI listeners, an issue that should be addressed in future work using more difficult listening conditions.

English-Learning 12-Month-Olds Do Not Map Function-Like Words to Objects

ABSTRACT By 12 months, English-learning infants have an awareness of the sound patterns of word forms that constitute acceptable labels for objects in their native language. In the following experiments, we replicated and extended previous findings that Canadian English-learning infants will not link function-like words with novel objects. Across three experiments using the Switch task, 101 infants living in Calgary, Canada, were habituated to two CV and VC word-object pairings. At test, infants did not look longer on the Switch trial and the Same trial, suggesting they did not form word-object associations between prototypical function words and a novel object in any of the experiments (ps>0.5). This set of null results extends prior research showing that Canadian English-learning infants will not link function-like words with novel objects and suggests that infants’ prior experience with their native language may constrain their learning of novel labels.

Talker variability is not always the right noise: 14 month olds struggle to learn dissimilar word-object pairs under talker variability conditions

Seminal work by Stager & Werker (1997) finds that 14-month-olds can rapidly learn two word-object pairings if the words are distinct (e.g. “neem” and “lif”) but not similar (e.g. the minimal pair “bih” and “dih”). More recently, studies have found that adding talker variability during exposure to new word-object pairs lets 14-month-olds succeed on the more challenging minimal pair task, presumably due to talker variability highlighting the “relevant” consistencies between the similar words (Rost & McMurray, 2009; Galle et al., 2015; Hohle et al., 2020). It remains an open question, however, whether talker variability would be similarly useful for learning new word-object pairings when the words themselves are already distinct, or whether instead this extra variability may extinguish learning due to increased task demands. We find evidence for the latter. Namely, in our sample of 54 English-learning 14-month-olds, training infants on two word-object pairings (e.g. “neem” with a dog toy and “lof” with a kitchen tool) only led them to notice when the words and objects were switched if they were trained with single-speaker identical word tokens. When the training featured talker variability (from one or multiple talkers) infants failed to learn the pairings. We suggest that when talker variability is not necessary to highlight the invariant differences between similar words, it may actually increase task difficulty, making it harder for infants to determine what to attend to in the earliest phases of word learning.

Combining statistics: the role of phonotactics on cross-situational word learning

Language learners can rely on phonological and semantic information to learn novel words. Using a cross-situational word learning paradigm, we explored the role of phonotactic probabilities on word learning in ambiguous contexts. Brazilian-Portuguese speaking adults (N = 30) were exposed to two sets of word-object pairs. Words from one set of labels had slightly higher phonotactic probabilities than words from the other set. By tracking co-occurrences of words and objects, participants were able to learn word-object mappings similarly across both sets. Our findings contrast with studies showing a facilitative effect of phonotactic probability on word learning in non-ambiguous contexts.

Background context affects word-object mapping.

Children encounter new words across variable and noisy contexts. This variability may affect word learning, but the literature includes discrepant findings. The current experiment investigated one source of these discrepant findings: whether contexts with familiar, nameable objects are associated with less robust label learning. Two year olds were exposed to word-object pairings on variable contexts that either included nameable objects or did not. Target selection was more robust when exposure occurred without other nameable objects. The difference was present immediately, but not after a delay. This study provides the evidence that context effects are context-bound.

Event-related potential studies of cross-situational word learning in four-year-old children

Young children learn word-referent links in cross-situational learning paradigms despite uncertainty as to a given word’s correct referent on individual exposures. However, the semantic status of these word-referent links is unknown. Here, we used a novel event-related potential (ERP) testing approach to investigate whether children showed electrophysiological signatures of semantic representations following a typical cross-situational learning paradigm. In Study 1, 20 4-year-old children (mean age: 51.35 months) learned eight new word-object pairs in a cross-situational learning task which included familiar object labeling before training. Then, they completed an ERP task which involved seeing pictures of the novel objects and then hearing words that were either congruent or incongruent with the word-referent association that was trained. Results showed a robust N400 ERP effect, thereby providing evidence for having acquired a semantic representation during the cross-situational learning paradigm. Children also showed good performance on a comprehension test approximately 20 min after training. In a second study, a different sample of 20 4-year-old children (mean age: 52 months) completed the same cross-situational task but without the initial familiar word pretraining. Here, we did not see the N400 effect we saw in Study 1, but children still showed good performance on the delayed comprehension test. We conclude that rapid semantic encoding can occur during cross-situational learning, but that pretraining on the structure of the paradigm may be critical for facilitating that encoding. We speculate on the mechanisms by which pretraining might have effects and discuss the implications of these findings for early word learning.

Preference at First Sight: Effects of Shape and Font Qualities on Evaluation of Object-Word Pairs.

Subjective preferences for visual qualities of shapes and fonts have been separately reported. Such preferences are often similarly attributed to factors such as aesthetic impressions, attributed meaning from the visual properties, or processing fluency. Because shapes and fonts were rarely studied together, we investigated whether these qualities had a similar impact on preference judgment of object-word pairs. Each pair consisted of an abstract object with either preferred or disliked shape qualities and a pseudoword with either preferred or disliked font qualities. We found that only shape qualities, but not font qualities, influenced preference ratings of the object-word pairs, with higher preferences for pairs with preferred than disliked shapes. Moreover, eye movement results indicated that while participants fixated the word before the object, their prolonged fixation on the object when first attending to it might have contributed to the preference ratings. Nonetheless, other measures, including response times, total fixation numbers, and total dwell time, showed different patterns for shape and font qualities, revealing that participants attended more to objects with preferred than disliked shapes, and to words with disliked than preferred fonts. Taken together, these results suggest that shape and font qualities have differential influences on preferences and processing of objects and words.

Can gesture input support toddlers' fast mapping?

Forty-eight toddlers participated in a word-learning task to assess gesture input on mapping nonce words to unfamiliar objects. Receptive fast mapping and expressive naming for target object-word pairs were tested in three conditions - with a point, with a shape gesture, and in a no-gesture, word-only condition. No statistically significant effect of gesture for receptive fast-mapping was found but age was a factor. Two year olds outperformed one year olds for both measures. Only one girl in the one-year-old group correctly named any items. There was a significant interaction between gesture and gender for expressive naming. Two-year-old girls were six times more likely than two-year-old boys to correctly name items given point and shape gestures; whereas, boys named more items taught with the word only than with a point or shape gesture. The role of gesture input remains unclear, particularly for children under two years and for toddler boys.

Music Perception Abilities and Ambiguous Word Learning: Is There Cross-Domain Transfer in Nonmusicians?

Perception of music and speech is based on similar auditory skills, and it is often suggested that those with enhanced music perception skills may perceive and learn novel words more easily. The current study tested whether music perception abilities are associated with novel word learning in an ambiguous learning scenario. Using a cross-situational word learning (CSWL) task, nonmusician adults were exposed to word-object pairings between eight novel words and visual referents. Novel words were either non-minimal pairs differing in all sounds or minimal pairs differing in their initial consonant or vowel. In order to be successful in this task, learners need to be able to correctly encode the phonological details of the novel words and have sufficient auditory working memory to remember the correct word-object pairings. Using the Mistuning Perception Test (MPT) and the Melodic Discrimination Test (MDT), we measured learners’ pitch perception and auditory working memory. We predicted that those with higher MPT and MDT values would perform better in the CSWL task and in particular for novel words with high phonological overlap (i.e., minimal pairs). We found that higher musical perception skills led to higher accuracy for non-minimal pairs and minimal pairs differing in their initial consonant. Interestingly, this was not the case for vowel minimal pairs. We discuss the results in relation to theories of second language word learning such as the Second Language Perception model (L2LP).

20-month-olds selectively generalize newly learned word meanings based on cues to linguistic community membership.

A growing body of work suggests that speaker-race influences how infants and toddlers interpret the meanings of words. In two experiments, we explored the role of speaker-race on whether newly learned word-object pairs are generalized to new speakers. Seventy-two 20-month-olds were taught two word-object pairs from a familiar race speaker, and two different word-object pairs from an unfamiliar race speaker (four new pairs total). Using an intermodal preferential looking procedure, their interpretation of these new word-object pairs was tested using an unpictured novel speaker. We found that toddlers did not generalize word meanings taught by an unfamiliar race speaker to a new speaker (Experiment 1), unless given evidence that the unfamiliar race speaker was a member of the child's linguistic community through affiliative behaviour and linguistic competence (Experiment 2). In both experiments, generalization was observed for the word-object pairs taught by the familiar race speaker. These experiments indicate that children attend to speakers' non-linguistic properties, and this, in turn, can influence the perceived relevance of speakers' labels.

Word learning in the field: Adapting a laboratory-based task for testing in remote Papua New Guinea.

Adapting laboratory psycholinguistic methods to fieldwork contexts can be fraught with difficulties. However, successful implementation of such methods in the field enhances our ability to learn the true extent and limitations of human behavior. This paper reports two attempts to run word learning experiments with the small community of Nungon speakers in Towet village in the Saruwaged Mountains, Papua New Guinea. A first attempt involved running a cross-situational task in which word-object pairings were presented ambiguously in each trial, and an explicit word learning task in which pairings were presented explicitly, or unambiguously, in each trial. While this quickly garnered a respectable 34 participants over the course of a week, it yielded null results, with many participants appearing to show simple patterned responses at test. We interpreted the null result as possibly reflecting the unfamiliarity of both the task and the laptop-based presentation mode. In Experiment 2, we made several adjustments to the explicit word learning task in an attempt to provide clearer instructions, reduce cognitive load, and frame the study within a real-world context. During a second 11-day stay in the village, 34 participants completed this modified task and demonstrated clear evidence of word learning. With this success serving as a future guide for researchers, our experiences show that it may require multiple attempts, even by experienced fieldworkers familiar with the target community, to successfully adapt experiments to a field setting.

Semantic congruency effects of prime words on tool visual exploration

Most recent research on human tool use highlighted how people might integrate multiple sources of information through different neurocognitive systems to exploit the environment for action. This mechanism of integration is known as “action reappraisal”. In the present eye-tracking study, we further tested the action reappraisal idea by devising a word-priming paradigm to investigate how semantically congruent (e.g., “nail”) vs. semantically incongruent words (e.g., “jacket”) that preceded the vision of tools (e.g., a hammer) may affect participants' visual exploration of them. We found an implicit modulation of participants' temporal allocation of visuospatial attention as a function of the object-word consistency. Indeed, participants tended to increase over time their fixations on tools' manipulation areas under semantically congruent conditions. Conversely, participants tended to concentrate their visual-spatial attention on tools’ functional areas when inconsistent object-word pairs were presented. These results support and extend the information-integrated perspective of the action reappraisal approach. Also, these findings provide further evidence about how higher-level semantic information may influence tools' visual exploration.

The Cologne Picture Naming Test for Language Mapping and Monitoring (CoNaT): An Open Set of 100 Black and White Object Drawings.

Language assessment using a picture naming task crucially relies on the interpretation of the given verbal response by the rater. To avoid misinterpretations, a language-specific and linguistically controlled set of unambiguous, clearly identifiable and common object–word pairs is mandatory. We, here, set out to provide an open-source set of black and white object drawings, particularly suited for language mapping and monitoring, e.g., during awake brain tumour surgery or transcranial magnetic stimulation, in German language. A refined set of 100 black and white drawings was tested in two consecutive runs of randomised picture order and was analysed in respect of correct, prompt, and reliable object recognition and naming in a series of 132 healthy subjects between 18 and 84 years (median 25 years, 64% females) and a clinical pilot cohort of 10 brain tumour patients (median age 47 years, 80% males). The influence of important word- and subject-related factors on task performance and reliability was investigated. Overall, across both healthy subjects and patients, excellent correct object naming rates (97 vs. 96%) as well as high reliability coefficients (Goodman–Kruskal's gamma = 0.95 vs. 0.86) were found. However, the analysis of variance revealed a significant, overall negative effect of low word frequency (p < 0.05) and high age (p < 0.0001) on task performance whereas the effect of a low educational level was only evident for the subgroup of 72 or more years of age (p < 0.05). Moreover, a small learning effect was observed across the two runs of the test (p < 0.001). In summary, this study provides an overall robust and reliable picture naming tool, optimised for the clinical use to map and monitor language functions in patients. However, individual familiarisation before the clinical use remains advisable, especially for subjects that are comparatively prone to spontaneous picture naming errors such as older subjects of low educational level and patients with clinically apparent word finding difficulties.

Re-Attention for Visual Question Answering.

A simultaneous understanding of questions and images is crucial in Visual Question Answering (VQA). While the existing models have achieved satisfactory performance by associating questions with key objects in images, the answers also contain rich information that can be used to describe the visual contents in images. In this paper, we propose a re-attention framework to utilize the information in answers for the VQA task. The framework first learns the initial attention weights for the objects by calculating the similarity of each word-object pair in the feature space. Then, the visual attention map is reconstructed by re-attending the objects in images based on the answer. Through keeping the initial visual attention map and the reconstructed one to be consistent, the learned visual attention map can be corrected by the answer information. Besides, we introduce a gate mechanism to automatically control the contribution of re-attention to model training based on the entropy of the learned initial visual attention maps. We conduct experiments on three benchmark datasets, and the results demonstrate the proposed model performs favorably against state-of-the-art methods.

Cross-Situational Word Learning in Two Foreign Languages: Effects of Native Language and Perceptual Difficulty

Cross-situational word learning (CSWL) paradigms have gained traction in recent years as a way to examine word learning in ambiguous scenarios in infancy, childhood, and adulthood. However, no study thus far has examined how CSWL paradigms may provide viable learning pathways for second language (L2) word learning. Here, we used a CSWL paradigm to examine how native Australian English (AusE) speakers learned novel Dutch (Experiment 1) and Brazilian Portuguese (Experiment 2) word-object pairings. During each learning phase trial, two words and objects were presented without indication as to which auditory word belonged to which visual referent. The two auditory words formed a non-minimal or vowel minimal pair. Minimal pairs were classified as “perceptually easy” or “perceptually difficult” based on the acoustic-phonetic relationship between AusE and each L2. At test, participants again saw two visual referents but heard one auditory label and were asked to select the corresponding referent. We predicted that accuracy would be highest for non-minimal pair trials (in which the auditory words associated with the target and distractor object formed a non-minimal pair), followed by perceptually easy minimal pairs, with lowest accuracy for perceptually difficult minimal pair trials. Our results support these hypotheses: While accuracy was above chance for all pair types, in both experiments accuracy was highest for non-minimal pair trials, followed by perceptually easy and then perceptually difficult minimal pair trials. These results are the first to demonstrate the effectiveness of CSWL in adult L2 word learning. Furthermore, the difference between perceptually easy and perceptually difficult minimal pairs in both language groups suggests that the acoustic-phonetic relationship between the L1-L2 is an important factor in novel L2 word learning in ambiguous learning scenarios. We discuss the implications of our findings for L2 acquisition, cross-situational learning and encoding of phonetic detail in a foreign language.

24-Month-olds and over remember novel object names after a single learning event

In the context of word learning, it is commonly assumed that repetition is required for young children to form and maintain in memory an association between a novel word and its corresponding object. For instance, at 2 years of age, children are able to disambiguate word-related situations in one shot but are not able to further retain this newly acquired knowledge. It has been proposed that multiple fast-mapping experiences would be required to promote word retention or that the inferential reasoning needs to be accompanied by explicit labeling of the target. We hypothesized that when 2-year-olds simply encounter an unambiguous learning context, word learning may be fast and maintained in time. We also assumed that, under this condition, even a single exposure to an object would be sufficient to form a memory trace of its name that would survive a delay. To test these hypotheses, 2- and 4-year-olds were ostensively taught three arbitrary word–object pairs using a 15-s video sequence during which each object was manually displayed and labeled three times in a row. Retention was measured after a 30-min distractive period using a forced-choice procedure. Our results provide evidence that declarative memory does not need repetition to be formed and maintained, for at least a 30-min period, by children as young as 2 years. This finding suggests that the mechanisms required for extremely rapid and robust word acquisition not only are present in preschoolers with developed language and cognitive skills but also are already operative at a younger age.

Re-Attention for Visual Question Answering

Visual Question Answering~(VQA) requires a simultaneous understanding of images and questions. Existing methods achieve well performance by focusing on both key objects in images and key words in questions. However, the answer also contains rich information which can help to better describe the image and generate more accurate attention maps. In this paper, to utilize the information in answer, we propose a re-attention framework for the VQA task. We first associate image and question by calculating the similarity of each object-word pairs in the feature space. Then, based on the answer, the learned model re-attends the corresponding visual objects in images and reconstructs the initial attention map to produce consistent results. Benefiting from the re-attention procedure, the question can be better understood, and the satisfactory answer is generated. Extensive experiments on the benchmark dataset demonstrate the proposed method performs favorably against the state-of-the-art approaches.