Cue-based Retrieval Research Articles

Semantic accessibility and interference in pronoun resolution

The general view in syntactic literature is that binding constraints can make antecedents syntactically inaccessible. However, several studies showed that antecedents which are ruled out by syntactic binding constraints still influence online processing of anaphora in some stages, suggesting that a cue-based retrieval mechanism plays a role during anaphora resolution. As in the syntactic literature, in semantic accounts like Discourse Representation Theory (DRT), formal constraints are formulated in terms of accessibility of the antecedent. We explore the discourse inaccessibility postulated in DRT by looking at its role in pronoun resolution of inter-sentential anaphoric relations in four off-line and two eye-tracking experiments. The results of the eye-tracking experiments suggest that accessibility has an effect on pronoun resolution from early on. The study quantifies evidence of inaccessible antecedents affecting pronoun resolution and shows that almost all evidence points to the conclusion that discourse-inaccessible antecedents are ruled out for pronoun resolution in processing. The only potential counter-example to this claim is also detected, but remains only as anecdotal evidence even after combining data from both eye-tracking studies. The findings in the study show that accessibility plays a significant role in the processing of pronoun resolution in a way which is potentially challenging for the cue-based retrieval mechanism. The paper argues that discourse accessibility can help expand the theories of retrieval beyond the syntactic and sentence-level domain and provides a window into the study of interference in discourse.

Novel evidence for cue-based retrieval of top-down sets in spatial cueing

Task cues that correctly (vs.incorrectly) inform humans about their upcoming tasks, benefit (vs. interfere with) performance because participants can use task cues to retrieve the corresponding task set, so that targets can (vs. cannot) be processed according to the currently applying task set from target onset onwards. Here, we tested if task-associated features of peripheral cues have a similar effect. Typically, peripheral cues with a task-associated, searched-for color (i.e., top-down matching cues) capture attention: Search for targets presented at the cued position (valid condition) is faster than for targets presented away from the cue (invalid condition), even if cues do not predict the likely target location. For example, when searching for red and green targets, a red cue captures attention even if presented prior to a green target, but a blue cue does not. We know that cue-target color congruence—whether the cue has a target-similar color (congruent case) vs. a target-dissimilar color (incongruent case)—additionally expedites vs. delays search times. However, it is unclear if this congruence effect reflects feed-forward color priming of the target only; or if cue-elicited retrieval of color-specific task sets is involved. Crucially, we hypothesized that cue-based task-set retrieval should incur additional costs if the task sets for the two target colors differ more. In contrast, mere feed-forward priming should not be affected by task-set similarity between color-associated task sets. Congruence effects were indeed larger when color-associated task sets were more different. This finding indicates cue-elicited retrieval of color-associated task sets can contribute to effects of cue-target color congruence. Results are discussed in light of recent theories.

The representation of agreement features in memory is updated during sentence processing: Evidence from verb-reflexive interactions

The formation of linguistic dependencies is subject to memory interference. In this study, we ask whether memory representations are fixed, or whether they can be distorted and updated after their initial encoding. Models of Cue-Based Retrieval assume that memory representations are fixed. However, representational interference and rational inference models assume that memory contents can be edited. To examine this, we test how reflexive attraction is affected by preceding verbal agreement in Hebrew. Cue-Based Retrieval suggests that agreement on the verb can exaggerate the reflexive’s sensitivity to the distractor. In contrast, we propose that if memory representations can be edited, verbal agreement can alter the representation of the subject. This process would reduce vulnerability to distortions originating from the distractor. In two self-paced reading experiments and one forced-choice completion we find (i) decreased reflexive attraction when (grammatical or ungrammatical) agreement cues were available on the preceding verb; and (ii) a preference for reflexive forms matching the verb over forms matching the subject when the sentence included ungrammatical verbal agreement. These results suggest that comprehenders use featural information from the verb to recover properties of the subject. The findings are therefore consistent with a memory model where representations can be distorted and updated, as well as with rational inference about memory disruption.

Romanian (subject-like) DPs attract more than bare nouns: Evidence from speeded continuations

This paper investigates whether agreement attraction is modulated by distributional properties determining subject-likelihood by examining the degree to which bare nouns and full determiner phrases (DPs) cause agreement attraction effects in Romanian. Romanian represents an ideal testing ground for this, given two distributional constraints making bare nouns less subject-like: Locative Determiner Omission, preventing locative prepositions from taking nouns with definite articles (unless modified by adjectives), and the Naked Noun Constraint, disallowing bare nouns as preverbal subjects. We predicted that bare nouns should be less likely to trigger agreement attraction than overt DPs. We conducted four speeded forced-choice sentence continuation tasks on Romanian native speakers to test this prediction. We observe that overt DPs cause significantly more attraction than bare nouns. We suggest that the results are consistent with a cue-based retrieval mechanism for forming agreement dependencies, where cues that determine subjecthood are used to reactivate elements in working memory upon processing a verb. These cues can be language specific, and in Romanian, this means that agreement attraction is sensitive to the morphophonological overtness of the determiner.

Syntactic and semantic interference in sentence comprehension: Support from English and German eye-tracking data

A long-standing debate in the sentence processing literature concerns the time course of syntactic and semantic information processing in online sentence comprehension. The default assumption in cue-based models of parsing is that syntactic and semantic retrieval cues simultaneously guide dependency resolution. When retrieval cues match multiple items in memory, this leads to similarity-based interference. Both semantic and syntactic interference have been shown to occur in English. However, the relative timing of syntactic vs. semantic interference remains unclear. In this cross-linguistic investigation of the time course of syntactic vs. semantic interference, the data from two eye-tracking during reading experiments (English and German) suggest that the two types of interference can in principle arise simultaneously during retrieval. However, the data also indicate that semantic cues are evaluated with a small timing lag in German compared to English. This cross-linguistic difference between English and German may be due to German having richer morphosyntactic marking than English, resulting in syntactic cues dominating over semantic cues during dependency resolution. More broadly, our cross-linguistic results pose a challenge for the cue-based retrieval model’s default assumption that syntactic and semantic cues are used simultaneously during long-distance dependency formation. Our work also highlights the importance of collecting cross-linguistic data on psycholinguistic phenomena which can potentially advance theory development.

Similarity-Based Interference in Sentence Comprehension in Aphasia: a Computational Evaluation of Two Models of Cue-Based Retrieval

Sentence comprehension requires the listener to link incoming words with short-term memory representations in order to build linguistic dependencies. The cue-based retrieval theory of sentence processing predicts that the retrieval of these memory representations is affected by similarity-based interference. We present the first large-scale computational evaluation of interference effects in two models of sentence processing — the activation-based model and a modification of the direct-access model — in individuals with aphasia (IWA) and control participants in German. The parameters of the models are linked to prominent theories of processing deficits in aphasia, and the models are tested against two linguistic constructions in German: pronoun resolution and relative clauses. The data come from a visual-world eye-tracking experiment combined with a sentence-picture matching task. The results show that both control participants and IWA are susceptible to retrieval interference, and that a combination of theoretical explanations (intermittent deficiencies, slow syntax, and resource reduction) can explain IWA’s deficits in sentence processing. Model comparisons reveal that both models have a similar predictive performance in pronoun resolution, but the activation-based model outperforms the direct-access model in relative clauses.

An Experimental Investigation of Multiple Sluicing in Mandarin Chinese

This paper examines multiple sluicing constructions in Mandarin Chinese (henceforth, MC) experimentally. The acceptability status of such constructions in MC is controversial, and the judgments reported in the previous literature vary. Obtaining experimental evidence on the acceptability status is, therefore, important to advance the research on multiple sluicing in MC. Consequently, the present study conducts two sets of experiments to investigate factors affecting the acceptability of multiple sluicing sentences and the influence of the distribution of shi preceding wh-remnants on acceptability ratings. The results show that multiple sluicing in MC is generally a marked construction. Nevertheless, factors including prepositionhood and specificity have ameliorating effects on the acceptability of such constructions. Moreover, the influence of the distribution of shi on the acceptability ratings is related to the nature of wh-remnants; that is, its presence significantly improves the acceptability of cases of multiple sluicing when it precedes bare wh-arguments. We argue that the observed ameliorating effects on multiple sluicing can be explained by a cue-based retrieval approach to cross-linguistic elliptical constructions. Compared to bare wh-arguments, prepositional and discourse-linked wh-phrases provide cues to facilitate the retrieval of information from antecedent clauses.

Number feature distortion modulates cue-based retrieval in reading

In sentence comprehension, what are the cognitive constraints that determine number agreement computation? Two broad classes of theoretical proposals are: (i) Representation distortion accounts, which assume that the number feature on the subject noun gets overwritten probabilistically by the number feature on a non-subject noun, leading to a non-veridical memory trace of the subject noun; and (ii) The cue-based retrieval account, a general account of dependency completion processes which assumes that the features on the subject noun remain intact, and that processing difficulty is only a function of the memory constraints on dependency completion. However, both these classes of model fail to account for the full spectrum of number agreement patterns observed in published studies. Using 17 benchmark datasets on number agreement from four languages, we implement seven computational models: three variants of representation distortion, two cue-based retrieval models, and two hybrid models that assume both representation-distortion and retrieval. Quantitative model comparison shows that the best fit is achieved by a hybrid model that assumes both feature distortion (specifically, feature percolation) and cue-based retrieval; numerically, the second-best quantitative fit was achieved by a distortion-based model of number attraction that assumes grammaticality bias during reading. More broadly, the work furnishes comprehensive evidence to support the idea that cue-based retrieval theory, which aims to be a general account of dependency completion, needs to incorporate a feature distortion process.

Individual Differences in Cue Weighting in Sentence Comprehension: An Evaluation Using Approximate Bayesian Computation.

Cue-based retrieval theories of sentence processing assume that syntactic dependencies are resolved through a content-addressable search process. An important recent claim is that in certain dependency types, the retrieval cues are weighted such that one cue dominates. This cue-weighting proposal aims to explain the observed average behavior, but here we show that there is systematic individual-level variation in cue weighting. Using the Lewis and Vasishth cue-based retrieval model, we estimated individual-level parameters for reading speed and cue weighting using 13 published datasets; hierarchical approximate Bayesian computation (ABC) was used to estimate the parameters. The modeling reveals a nuanced picture of cue weighting: we find support for the idea that some participants weight cues differentially, but not all participants do. Only fast readers tend to have the predicted higher weighting for structural cues, suggesting that reading proficiency (approximated here by reading speed) might be associated with cue weighting. A broader achievement of the work is to demonstrate how individual differences can be investigated in computational models of sentence processing without compromising the complexity of the model.

Case-matching effects under clausal ellipsis and the cue-based theory of sentence processing

This paper is concerned with case-matching effects under clausal ellipsis. We begin by considering available crosslinguistic data that indicate that variation in case marking on a fragment is delimited by the argument structure of the lexical head that assigns case to the fragment’s correlate in the antecedent clause. We then offer experimental evidence for a case-matching preference in Korean when a fragment and its correlate may differ in case marking. This case-matching preference corresponds to a known case of mandatory case-matching in Hungarian, but their relationship is not predicted by any of the existing syntactic accounts of case-matching effects under clausal ellipsis. We propose a novel perspective on fragments that derives case-matching effects, including optional and mandatory case matching, from the predictions of cue-based retrieval. Two further acceptability judgment studies are offered in support of our proposal.

Ellipsis interference revisited: New evidence for feature markedness effects in retrieval

An active question in psycholinguistics concerns how we mentally encode and retrieve linguistic information in memory. In particular, it remains unclear what information (“cues”) guide retrieval. Previous work has extensively tested retrieval of noun phrases, but less is known about retrieval of other constituents, including verb phrases (VPs). This study examines retrieval for VP ellipsis to allow for a more comprehensive theory of cues. Four experiments (acceptability, self-paced reading) used an interference paradigm to examine voice information (active, passive) in retrieval. Results revealed a selective profile: passive ellipsis shows interference, but active ellipsis does not. These results are aligned with the markedness asymmetry observed for agreement attraction, where marked features (plural, passive) trigger interference, but unmarked features (singular, active) do not. This analysis motivates a unified account of verbal dependencies where markedness plays a more fundamental role than previously assumed. Lastly, I use ACT-R to demonstrate how markedness effects might arise in a cue-based retrieval architecture and discuss the current findings with respect to the leading theories of interference effects.

Misretrieval but not misrepresentation: A feature misbinding account of post-interpretive effects in number attraction.

Attraction effects in comprehension have reliably shown a grammaticality asymmetry in which mismatching plural attractors confer facilitatory interference for ungrammatical verbs, but no processing cost for grammatical verbs. While this has favoured cue-based retrieval accounts of attraction phenomena in comprehension, Patson and Husband offered offline evidence suggesting that comprehenders systematically misrepresent number information in attraction phrases, leaving open the possibility for faulty noun phrase (NP) representations later in processing. The current study employs two self-paced reading discourse experiments to test for number attraction misrepresentations in real time. Specifically, the attraction phrases occurred as embedded direct object phrases, allowing for a direct test of the role of attractor noun number in head noun number misrepresentation (i.e., no number cue from verb). Although no online evidence for misrepresentation was found, a third single-sentence rapid serial visual presentation experiment showed error rates to offline probes corroborating the post-interpretive findings from Patson and Husband, suggesting that a search in memory for associative features may not employ the same processes as the formation of dependencies in discourse comprehension. The findings are discussed in the framework of feature misbinding in memory in line with recent post-interpretive accounts of offline comprehension errors.

Parsing as a Cue-Based Retrieval Model.

This paper develops a novel psycholinguistic parser and tests it against experimental and corpus reading data. The parser builds on the recent research into memory structures, which argues that memory retrieval is content‐addressable and cue‐based. It is shown that the theory of cue‐based memory systems can be combined with transition‐based parsing to produce a parser that, when combined with the cognitive architecture ACT‐R, can model reading and predict online behavioral measures (reading times and regressions). The parser's modeling capacities are tested against self‐paced reading experimental data (Grodner & Gibson, 2005), eye‐tracking experimental data (Staub, 2011), and a self‐paced reading corpus (Futrell et al., 2018).

Negative polarity item (NPI) illusion is a quantification phenomenon.

Illusions of grammaticality have often been used to probe the properties of the human sentence processor in syntactic activities like subject-verb agreement, reflexive binding, and negative polarity item (NPI) licensing. Originally, NPI licensing in processing was thought to be a product of cue-based retrieval. Mounting evidence that the NPI illusion is far from universal suggests that a revised account is necessary. We examine the distribution of the NPI illusion using a single methodology and evaluate its compatibility with existing theories. We find that most licensors fail to show illusion behavior but the negative quantifier no and the quantificational phrase not a single trigger illusion in high and low relative clause positions. This evidence indicates that distribution of NPI illusion is not predicted by existing processing accounts. Future explanations must engage the unique properties of negative quantifiers to account for the distribution of the NPI illusion phenomenon. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

On the grammaticality of morphosyntactically reduced remnants in Polish sluicing

Abstract This paper explores the grammaticality status of reduced sluicing remnants (i.e., remnants realized as NPs due to preposition drop) in Polish. We provide experimental evidence that reduced remnants are variously acceptable in a specific environment (where there is a prior explicit correspondent in the antecedent clause) and are as unacceptable as ungrammatical structures elsewhere. We interpret this pattern as reflecting elaboration effects (i.e., effects that the degree of elaboration of explicit correspondents has on the acceptability of reduced remnants) that follow from the cue-based retrieval theory of sentence processing. Our data support the option of treating reduced remnants as ungrammatical but sometimes acceptable and the option of treating them as grammatical but sometimes degraded, and we discuss how they fit into the current theories of clausal ellipsis.

Encoding interference effects support self-organized sentence processing

According to cue-based retrieval theories of sentence comprehension, establishing the syntactic dependency between a verb and the grammatical subject is susceptible to interference from other noun phrases in the sentence. At the verb, the subject must be retrieved from memory, but non-subject nouns that are similar on dimensions that are relevant to subject-verb agreement, like number marking, can make the retrieval more difficult. However, cue-based retrieval models fail to account for a class of interference effects, conventionally called “encoding interference,” that cannot be due to retrieval interference. In this paper, we implement a self-organized sentence processing model that provides a more parsimonious explanation of encoding interference effects than otherwise reasonable extensions that could be made to the cue-based retrieval approach. We first also present new behavioral evidence for encoding interference using a semantic similarity manipulation in two self-paced reading studies of subject-verb number agreement. The results of these experiments are more compatible with the self-organizing account. We argue that self-organization, which reduces all parsing to fallible feature match optimization and makes no a priori distinction between encoding and retrieval, can provide a unifying approach to similarity-based interference in sentence comprehension.

A Principled Approach to Feature Selection in Models of Sentence Processing.

Among theories of human language comprehension, cue-based memory retrieval has proven to be a useful framework for understanding when and how processing difficulty arises in the resolution of long-distance dependencies. Most previous work in this area has assumed that very general retrieval cues like [+subject] or [+singular] do the work of identifying (and sometimes misidentifying) a retrieval target in order to establish a dependency between words. However, recent work suggests that general, handpicked retrieval cues like these may not be enough to explain illusions of plausibility (Cunnings & Sturt, 2018), which can arise in sentences like The letter next to the porcelain plate shattered. Capturing such retrieval interference effects requires lexically specific features and retrieval cues, but handpicking the features is hard to do in a principled way and greatly increases modeler degrees of freedom. To remedy this, we use well-established word embedding methods for creating distributed lexical feature representations that encode information relevant for retrieval using distributed retrieval cue vectors. We show that the similarity between the feature and cue vectors (a measure of plausibility) predicts total reading times in Cunnings and Sturt's eye-tracking data. The features can easily be plugged into existing parsing models (including cue-based retrieval and self-organized parsing), putting very different models on more equal footing and facilitating future quantitative comparisons.

Gender interference in processing Chinese compound reflexive: evidence from reading eye-tracking

ABSTRACT In Chinese, the compound reflexive ta-ziji (“him/her-self”) has the gender marking pronoun ta, hence presenting a good test case for interference effects from structurally illicit antecedents predicted by cue-based retrieval models. Using reading eye-tracking, we manipulated the gender of ta-ziji that (mis)matches that of matrix- and local-subject. Results showed no interference whatsoever when ta-ziji matched local subjects. Only when ta-ziji mismatched local subjects did we find an inhibitory interference on first fixation duration and gaze duration at the verb immediately preceding ta-ziji, but a facilitatory interference on gaze duration at ta-ziji. Furthermore, at ta-ziji, total reading times were longer for gender-mismatching local subjects than for gender-matching ones. These findings are partially predicted by the standard cue-based retrieval model, but are mostly consistent with the structure-favoring cue-based retrieval model, suggesting that the structural cue plays a dominant role in the antecedent retrieval process, with interference occurring only in highly constrained situations.

Using approximate Bayesian computation for estimating parameters in the cue-based retrieval model of sentence processing

A commonly used approach to parameter estimation in computational models is the so-called grid search procedure: the entire parameter space is searched in small steps to determine the parameter value that provides the best fit to the observed data. This approach has several disadvantages: first, it can be computationally very expensive; second, one optimal point value of the parameter is reported as the best fit value; we cannot quantify our uncertainty about the parameter estimate. In the main journal article that this methods article accompanies (Jäger et al., 2020, Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study, Journal of Memory and Language), we carried out parameter estimation using Approximate Bayesian Computation (ABC), which is a Bayesian approach that allows us to quantify our uncertainty about the parameter's values given data. This customization has the further advantage that it allows us to generate both prior and posterior predictive distributions of reading times from the cue-based retrieval model of Lewis and Vasishth, 2005.•Instead of the conventional method of using grid search, we use Approximate Bayesian Computation (ABC) for parameter estimation in the [4] model.•The ABC method of parameter estimation has the advantage that the uncertainty of the parameter can be quantified.

Interference patterns in subject-verb agreement and reflexives revisited: A large-sample study.

Cue-based retrieval theories in sentence processing predict two classes of interference effect: (i) Inhibitory interference is predicted when multiple items match a retrieval cue: cue-overloading leads to an overall slowdown in reading time; and (ii) Facilitatory interference arises when a retrieval target as well as a distractor only partially match the retrieval cues; this partial matching leads to an overall speedup in retrieval time. Inhibitory interference effects are widely observed, but facilitatory interference apparently has an exception: reflexives have been claimed to show no facilitatory interference effects. Because the claim is based on underpowered studies, we conducted a large-sample experiment that investigated both facilitatory and inhibitory interference. In contrast to previous studies, we find facilitatory interference effects in reflexives. We also present a quantitative evaluation of the cue-based retrieval model of Engelmann et al. (2019), with respect to the reflexives data. Data and code are available from: https://osf.io/reavs/.