Referential Communication Task Research Articles

Remembering visual and linguistic common ground in shared history.

Successful communication requires speakers and listeners to refer to information in their common ground. Shared history is one of the bases for common ground, as information from a communicative episode in the past can be referred to in future communication. However, to draw upon shared history, communicative partners need to have an accurate memory record that they can refer to. The memory mechanism for shared history is poorly understood. The current study investigated the ways in which memory for shared history is prioritised. Two experiments presented a referential communication task followed by a surprise recognition memory task, with the former task serving as an episode of shared history. Experiment 1 revealed superior memory for information that was both seen in the communicators' common ground and referred to, followed by information that was seen but not referred to, and finally by information privileged to the participants. Experiment 2 provided a replication of Experiment 1 and further demonstrated that these co-presence effects are not dependent on the presence of a speaker with a different perspective to the participant.

Influence of autistic traits and communication role on eye contact behavior during face-to-face interaction

Eye contact is a central component in face-to-face interactions. It is important in structuring communicative exchanges and offers critical insights into others' interests and intentions. To better understand eye contact in face-to-face interactions, we applied a novel, non-intrusive deep-learning-based dual-camera system and investigated associations between eye contact and autistic traits as well as self-reported eye contact discomfort during a referential communication task, where participants and the experimenter had to guess, in turn, a word known by the other individual. Corroborating previous research, we found that participants’ eye gaze and mutual eye contact were inversely related to autistic traits. In addition, our findings revealed different behaviors depending on the role in the dyad: listening and guessing were associated with increased eye contact compared with describing words. In the listening and guessing condition, only a subgroup who reported eye contact discomfort had a lower amount of eye gaze and eye contact. When describing words, higher autistic traits were associated with reduced eye gaze and eye contact. Our data indicate that eye contact is inversely associated with autistic traits when describing words, and that eye gaze is modulated by the communicative role in a conversation.

Spontaneous perspective-taking in real-time language comprehension: evidence from eye-movements and grain of coordination

Linguistic communication requires interlocutors to consider differences in each other’s knowledge (perspective-taking). However, perspective-taking might either be spontaneous or strategic. We monitored listeners’ eye movements in a referential communication task. A virtual speaker gave temporally ambiguous instructions with scalar adjectives (“big” in “big cubic block”). Scalar adjectives assume a contrasting object (a small cubic block). We manipulated whether the contrasting object (a small triangle) for a competitor object (a big triangle) was in common ground (visible to both speaker and listener) or was occluded so it was in the listener’s privileged ground, in which case perspective-taking would allow earlier reference-resolution. We used a complex visual context with multiple objects, making strategic perspective-taking unlikely when all objects are in the listener’s referential domain. A turn-taking, puzzle-solving task manipulated whether participants could anticipate a more restricted referential domain. Pieces were either confined to a small area (requiring fine-grained coordination) or distributed across spatially distinct regions (requiring only coarse-grained coordination). Results strongly supported spontaneous perspective-taking: Although comprehension was less time-locked in the coarse-grained condition, participants in both conditions used perspective information to identify the target referent earlier when the competitor contrast was in privileged ground, even when participants believed instructions were computer-generated.

The Division of Labor in Conversational Repair in a Family Sign Language from Guatemala: Who Makes It Work?

Abstract: The term repair refers to strategies deployed by language users to resolve breakdowns in communication. In this study, I ask what strategies for conversational repair are deployed, and who takes responsibility for their execution, when a language is used in a small local signing ecology. I focus on signers from a single family within a larger speech community that does not use a national signed language and analyze conversations from four dyads of signers who engaged in a director-matcher referential communication task. I find that for three of the four dyads, there is a preference for restricted repairs that closely matches studies of repair in other signed and spoken languages. I also find a strong connection between participant role and repair type—with matchers more likely to use other-initiated repairs while directors produced self-repairs. The findings from this study highlight the complex relationship between participant identities and pragmatic strategies and the complicated social function of different types of repair in interaction.

Combined effects of age and hearing impairment on utterances and requests for clarification in spontaneous conversation and a referential communication task.

The impact of hearing impairment is typically studied in terms of its effects on speech perception, yet this fails to account for the interactive nature of communication. Recently, there has been a move towards studying the effects of age-related hearing impairment on interaction, often using referential communication tasks; however, little is known about how interaction in these tasks compares toeveryday communication. To investigate utterances and requests for clarification used in one-to-one conversations between older adults with hearing impairment and younger adults without hearing impairment, and between two younger adults without hearing impairment. A total of 42 participants were recruited to the study and split into 21 pairs, 10 with two younger adults without hearing impairment and 11 with one younger adult without hearing impairment and one older participant with age-related hearing impairment (hard of hearing). Results from three tasks-spontaneous conversation and two trials of a referential communication task-were compared. A total of 5 min of interaction in each of the three tasks was transcribed, and the frequency of requests for clarification, mean length of utterance and total utterances were calculated for individual participants and pairs. When engaging in spontaneous conversation, participants made fewer requests for clarification than in the referential communication, regardless of hearing status/age (p ≤ 0.012). Participants who were hard of hearing made significantly more requests for clarification than their partners without hearing impairment in only the second trial of the referential communication task (U = 25, p = 0.019). Mean length of utterance was longer in spontaneous conversation than in the referential communication task in the pairs without hearing impairment (p ≤ 0.021), but not in the pairs including a person who was hard of hearing. However, participants who were hard of hearing used significantly longer utterances than their partners without hearing impairment in the spontaneous conversation (U = 8, p < 0.001) but not in the referential communication tasks. The findings suggest that patterns of interaction observed in referential communication tasks differ to those observed in spontaneous conversation. The results also suggest that fatigue may be an important consideration when planning studies of interaction that use multiple conditions of a communication task, particularly when participants are older or hard of hearing. What is already known on this subject Age-related hearing impairment is known to affect communication; however, the majority of studies have focused on its impact on speech perception in controlled conditions. This indicates little about the impact on everyday, interactive, communication. What this study adds to the existing knowledge We investigated utterance length and requests for clarification in one-to-one conversations between pairs consisting of one older adult who is hard of hearing and one younger adult without hearing impairment, or two younger adults without hearing impairment. Results from three tasks (two trials of a referential communication task and spontaneous conversation) were compared. The findings demonstrated a significant effect of task type on requests for clarification in both groups. Furthermore, in spontaneous conversation, older adults who were hard of hearing used significantly longer utterances than their partners without hearing impairment. This pattern was not observed in the referential communication task. What are the potential or actual clinical implications of this work? These findings have important implications for generalizing results from controlled communication tasks to more everyday conversation. Specifically, they suggest that the previously observed strategy of monopolizing conversation, possibly as an attempt to control it, may be more frequently used by older adults who are hard of hearing in natural conversation than in a more contrived communication task.

Five-year-olds’ sensitivity to knowledge discrepancies about object identity during online language comprehension

In everyday communication, children experience situations where their knowledge or perspectives differ from those of their communicative partner. The current study examined this issue in the context of real-time language comprehension, focusing on 5-year-old children’s ability to manage knowledge discrepancies about the identity of mutually visible objects. In Experiment 1, we examined 5-year-olds’ ability to manage privileged knowledge about an object’s identity. Using a referential communication task, we tested children (N = 60) in either a shared knowledge condition, where both the child and the speaker knew the identity of a visually misleading object (e.g., a candle that looks like an apple), or a privileged knowledge condition, where only the child knew the identity of the visually misleading object. Of interest was whether children could suppress private knowledge while processing a phonologically related word (e.g., “Look at the candy”). Results showed that children did not inhibit this knowledge during the early moments of referential interpretation. In Experiment 2 (N = 30), we contrasted the privileged knowledge condition in Experiment 1 with the more traditional scenario used to test common ground use, where the child knows the speaker cannot see certain display objects. Results confirmed a stronger ability to manage discrepancies in the latter case. Together, the findings demonstrate differences in children’s ability to manage distinct types of knowledge discrepancies during real-time language comprehension.

Investigating the influence of local and personal common ground on memory for conversation using an online referential communication task.

To maintain efficiency during conversation, interlocutors form and retrieve memory representations for the shared understanding or common ground that they have with their partner. Here, an online referential communication task (RCT) was used in two experiments to examine whether the strength and type of common ground between dyads influence their ability to form and recall referential labels for images. Results from both experiments show a significant association between the strength of common ground formed between dyads for images during the RCT and their verbatim-but not semantic-recall memory for image descriptions about a week later. Participants who generated the image descriptions during the RCT also showed superior verbatim and semantic recall memory performance. In Experiment 2, a group of friends with pre-existing personal common ground were significantly more efficient in their use of words to describe images during the RCT than a group of strangers without personal common ground. However, personal common ground did not lead to enhanced recall memory performance. Together, these findings provide evidence that individuals can remember some verbatim words and phrases from conversations, and partially support the theoretical notion that common ground and memory are intricately linked conversational processes. The null findings with regard to semantic recall memory suggest that the structured nature of the RCT may have constrained the types of memory representations that individuals formed during the interaction. Findings are discussed in relation to the multidimensional nature of common ground and the importance of developing more natural conversational tasks for future work. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Real-time inference in communication across cultures: Evidence from a nonindustrialized society.

In everyday communication, speakers and listeners make sophisticated inferences about their conversation partner's intended meaning. They combine their knowledge of the visuospatial context with reasoning about the other person's knowledge state and rely on shared assumptions about how language is used to express communicative intentions. However, these assumptions may differ between languages of nonindustrialized-where conversations often primarily take place within a, so-called, society of intimates-and industrialized cultures-societies of strangers. Here, we study inference in communication in the Tsimane', an indigenous people of the Bolivian Amazon, who have little contact with industrialization or formal education. Using a referential communication task, we probe how Tsimane' speakers refer to objects in the world around them when there are potential ambiguities (e.g., referring to a cup when there are multiple cups in view) across different visual contexts. Using an eye-tracking task, we probe the real-time inferences that Tsimane' listeners make about the speaker's intentions. We find that Tsimane' speakers use visual (color, size) contrasts to disambiguate referents (e.g., "Hand me the small cup"), much like English speakers, and they predictively direct their gaze to objects in a contrast set when they hear a modifier (e.g., "small"). Despite myriad cultural and linguistic dissimilarities between the two populations, the qualitative patterns of behavior and eye-gaze of Tsimane' and English speakers were strikingly similar, suggesting that the communicative expectations underlying many everyday inferences may be shared across cultures. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Collaboration under uncertainty in unscripted conversations: The role of hedges.

The present study examined the role of hedges in a referential communication task. Pairs of participants received an identical set of cards, each card displaying a geometric configuration (a "tangram"). One participant, the director, instructed their partner, the matcher, to reproduce a series of predetermined tangram sequences using their own cards. Directors sometimes included a hedge in their description of a tangram (e.g., "looks kinda like an eagle"), and more so the first time than on subsequent mentions. The present study tested the hypothesis that, by revealing their uncertainty regarding the adequacy of their description in conveying the intended meaning, directors signal a possible difficulty in establishing reference. This in turn prompts their addressee to display, rather than merely assert, their understanding (by presenting a description for the tangram the matcher believes the director is referring to, for the director to evaluate). Analyses of matchers' responses to descriptions that directors had hedged or not confirmed the hypothesis. This finding supports the view that conversational partners work together to reach the mutual belief that they have coordinated what the speaker means and what their addressee takes them to mean. Conversational partners expend more joint effort when they deem the risk of misunderstanding to be high than when it is perceived to be low. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A mind-reading puzzle: Autistic people are more efficient at a theory-of-mind task

Theory of Mind (ToM) is essential to adapt in social situations; however, a ToM deficit might be involved in autism. To better understand how ToM reasoning affects problem solving in autistic and non-autistic individuals, we compared autistic and non-autistic children and adults in a series of problems presented in social and non-social framings, using an adapted version of a classical referential communication task. In the social framing, participants were asked to anticipate the behavior of an agent who might ignore some components of the scene. In the non-social framing, the task required participants to consider and ignore similar features of the scene, but an agent was not involved. Simply framing the task as a social one increased the difficulty, particularly for non-autistic participants. Interestingly, the framing had less of an impact on autistic participants, who showed better performance in the social task relative to non-autistics and maintained similar performance across framings. We propose that autistic participants might have translated the social instructions into a general rule that proved more efficient in this situation. Our findings suggest a critical distinction between ToM understanding and the continuous use of a ToM strategy in repeated situations.

Musical coordination affects children's perspective-taking, but musical synchrony does not.

Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self-other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that would otherwise have occurred. We found no evidence for online perspective-taking in 4- to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. A video abstract of this article can be viewed at https://youtu.be/TM9h_GpFlsA. RESEARCH HIGHLIGHTS: This study is the first to show that rhythmic coordination, a form of non-linguistic interaction, can affect children's performance in a subsequent linguistic task. Eye-movement data revealed that children's perspective-taking in language processing was facilitated by prior asynchronous and antiphase synchronous musical interactions, but not by synchronous coordination. The results challenge the common "similar is better" view, suggesting that maintaining self-other distinction may benefit social interactions that involve representing individual differences.

Is speech intelligibility what speech intelligibility tests test?

Natural, conversational speech signals contain sources of symbolic and iconic information, both of which are necessary for the full understanding of speech. But speech intelligibility tests, which are generally derived from written language, present only symbolic information sources, including lexical semantics and syntactic structures. Speech intelligibility tests exclude almost all sources of information about talkers, including their communicative intentions and their cognitive states and processes. There is no reason to suspect that either hearing impairment or noise selectively affect perception of only symbolic information. We must therefore conclude that diagnosis of good or poor speech intelligibility on the basis of standard speech tests is based on measurement of only a fraction of the task of speech perception. This paper presents a descriptive comparison of information sources present in three widely used speech intelligibility tests and spontaneous, conversational speech elicited using a referential communication task. The aim of this comparison is to draw attention to the differences in not just the signals, but the tasks of listeners perceiving these different speech signals and to highlight the implications of these differences for the interpretation and generalizability of speech intelligibility test results.

Adjective position and referential efficiency in American Sign Language: Effects of adjective semantics, sign type and age of sign exposure

Previous research has pointed at communicative efficiency as a possible constraint on language structure. Here we investigated adjective position in American Sign Language (ASL), a language with relatively flexible word order, to test the incremental efficiency hypothesis, according to which both speakers and signers try to produce efficient referential expressions that are sensitive to the word order of their languages. The results of three experiments using a standard referential communication task confirmed that deaf ASL signers tend to produce absolute adjectives, such as color or material, in prenominal position, while scalar adjectives tend to be produced in prenominal position when expressed as lexical signs, but in postnominal position when expressed as classifiers. Age of ASL exposure also had an effect on referential choice, with early-exposed signers producing more classifiers than late-exposed signers, in some cases. Overall, our results suggest that linguistic, pragmatic and developmental factors affect referential choice in ASL, supporting the hypothesis that communicative efficiency is an important factor in shaping language structure and use.

The Development of Pointing Gestures in Children

Pointing is seen as the cornerstone of human communication, and many researches have provided evidences for the fact &#x0D; that human infant start to point before they can speak. However, these studies have often focused on the motivation and function &#x0D; behind their pointing behaviors. This study investigated children pointing gesture development by administering a referential communication task. Our findings showed that children from five to six do much better than other children as they can successfully use &#x0D; manual pointing to complete the task on the basis of understanding the task requirements.

Detecting Alzheimer's Disease Using Natural Language Processing of Referential Communication Task Transcripts.

People with Alzheimer's disease (AD) often demonstrate difficulties in discourse production. Referential communication tasks (RCTs) are used to examine a speaker's capability to select and verbally code the characteristics of an object in interactive conversation. In this study, we used contextualized word representations from Natural language processing (NLP) to evaluate how well RCTs are able to distinguish between people with AD and cognitively healthy older adults. We adapted machine learning techniques to analyze manually transcribed speech transcripts in an RCT from 28 older adults, including 12 with AD and 16 cognitively healthy older adults. Two approaches were applied to classify these speech transcript samples: 1) using clinically relevant linguistic features, 2) using machine learned representations derived by a state-of-art pretrained NLP transfer learning model, Bidirectional Encoder Representation from Transformer (BERT) based classification model. The results demonstrated the superior performance of AD detection using a designed transfer learning NLP algorithm. Moreover, the analysis showed that transcripts of a single image yielded high accuracies in AD detection. The results indicated that RCT may be useful as a diagnostic tool for AD, and that the task can be simplified to a subset of images without significant sacrifice to diagnostic accuracy, which can make RCT an easier and more practical tool for AD diagnosis. The results also demonstrate the potential of RCT as a tool to better understand cognitive deficits from the perspective of discourse production in people with AD.

The Primacy of Multimodal Alignment in Converging on Shared Symbols for Novel Referents

ABSTRACT When people interact to establish shared symbols for novel objects or concepts, they often rely on multiple communicative modalities as well as on alignment (i.e., cross-participant repetition of communicative behavior). Yet these interactional resources have rarely been studied together, so little is known about if and how people combine multiple modalities in alignment to achieve joint reference. To investigate this, we systematically track the emergence of lexical and gestural alignment in a referential communication task with novel objects. Quantitative analyses reveal that people frequently use a combination of lexical and gestural alignment, and that such multimodal alignment tends to emerge earlier compared to unimodal alignment. Qualitative analyses of the interactional contexts in which alignment emerges reveal how people flexibly deploy lexical and gestural alignment in line with modality affordances and communicative needs.

Gaining access to the unknown: Preschoolers privilege unknown information as the target of their questions about verbs

Children are opportunistic word learners, making passive use of nearly any available cue to link labels and referents. However, children may also actively drive their word learning by inquiring about unknown labels. Until recently, research has largely overlooked active word learning mechanisms. In the current study, two experiments investigated the emergence of preschoolers’ ability to tailor their questions about words and definitions to maximize information gains. Experiment 1 tested whether 3- and 5-year-olds’ frequency of questionasking differed for known and unknown verbs in a referential communication task. Results revealed that 3- and 5-year-olds (N = 36) asked more questions about unknown verbs (M = 3.86) than about known verbs (M = 0.22, p < .001), but this tendency was greater for 5-year-olds (M = 6.11) than for 3-year-olds (M = 1.35, p < .001), suggesting a developmental difference in information-seeking proficiency. Experiment 2 tested whether 3- and 5-year-olds’ frequency of question asking about unknown verbs differed when words were embedded in definitions of high- and low-informative quality. Results demonstrated that 3- and 5-year-olds (N = 42) asked questions about unknown verbs more when provided with uninformative definitions (M = 0.86) compared with informative definitions (M = 0.05, p = .028), suggesting a sensitivity to definition quality that drives preschoolers’ information search for word meanings. These findings offer insight into children’s information seeking during exposure to new words. Results advance the characterization of children’s active verbal information seeking in shaping their word learning.

The neural correlates of referential communication: Taking advantage of sparse-sampling fMRI to study verbal communication with a real interaction partner

This paper introduces an innovative functional magnetic resonance imaging (fMRI) protocol to study real verbal interactions while limiting the impact of speech-related movement artefacts. This protocol is based on a sparse sampling acquisition technique and allowed participants to complete a referential communication task with a real interaction partner. During verbal interactions, speakers adjust their verbal productions depending on their interlocutors’ knowledge of the referents being mentioned. These adjustments have been linked to theory of mind (ToM), the ability to infer other’s mental states. We thus sought to determine if the brain regions supporting ToM would also be activated during a referential communication task in which participants have to present movie characters that vary in their likelihood of being known by their interlocutor. This pilot study establishes that the sparse sampling strategy is a viable option to study the neural correlates of referential communication while minimizing movement artefacts. In addition, the brain regions supporting ToM were recruited during the task, though specifically for the conditions where participants could adjust their verbal productions to the interlocutor’s likely knowledge of the referent. This study therefore demonstrates the feasibility and relevance of a sparse-sampling approach to study verbal interactions with fMRI, including referential communication.

Reciprocity in Instant Messaging Conversations.

We tested how the introduction and removal of well-defined roles influenced contribution behaviors in instant messaging conversations. Pairs of participants worked on a referential communication task where one participant (the director) had more information than the other (the matcher). Next, these roles were removed and the participants were allowed to communicate freely. Participants then switched director/matcher roles and the procedure was repeated. On average participants in the director role wrote more than participants in the matcher role during the task. But instead of a balanced conversation during unstructured chat, which might have happened without a task preceding it, during off-task conversation former-matchers, on average, contributed more than former-directors. Results support the hypothesis that speech complementarity leads to efforts to redress imbalance, a process we call reciprocity.

Referential Communication Between Friends and Strangers in the Wild

The Map Task (Anderson et al., 1991) and Tangram Task (Clark &amp; Wilkes-Gibbs, 1986) are traditional referential communication tasks that are used in psycholinguistics research to demonstrate how conversational partners mutually agree on descriptions (or referring expressions) for landmarks or unusual target objects. These highly-controlled, laboratory-based tasks take place under conditions that are relatively unusual for naturally-occurring conversations (Speed, Wnuk, &amp; Majid, 2016). In this study, we used the Artwalk Task (Liu, Fox Tree, &amp; Walker, 2016) – a real world-situated blend of the Map Task and Tangram Task – to demonstrate that the process of negotiating referring expressions ‘in the wild’ is similar to the process that takes place in a laboratory. In Artwalk, participant pairs communicated via a Skype-to-mobile phone connection. One participant guided the other through a small downtown area with the goal of identifying public art objects, finding objects twice during two rounds. In addition to replicating laboratory results, we also found that acquaintanceship and extraversion influenced the number of unique descriptors used by dyads in this task. In Round 1, introverts in stranger dyads used fewer descriptors but introverts in friend dyads were indistinguishable from extraverts. The influence of extraversion declined by Round 2. This study suggests that referent negotiation observed in labs is generalizable but that naturalistic communication is subject to social and personality factors that may not be as influential in laboratory conditions.