Response Caution Research Articles

The Quality of Response Time Data Inference: A Blinded, Collaborative Assessment of the Validity of Cognitive Models

Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression of latent variables including 1) ease of processing, 2) response caution, 3) response bias, and 4) non-decision time. Inferences about these psychological factors, hinge upon the validity of the models’ parameters. Here, we use a blinded, collaborative approach to assess the validity of such model-based inferences. Seventeen teams of researchers analyzed the same 14 data sets. In each of these two-condition data sets, we manipulated properties of participants’ behavior in a two-alternative forced choice task. The contributing teams were blind to the manipulations, and had to infer what aspect of behavior was changed using their method of choice. The contributors chose to employ a variety of models, estimation methods, and inference procedures. Our results show that, although conclusions were similar across different methods, these "modeler’s degrees of freedom" did affect their inferences. Interestingly, many of the simpler approaches yielded as robust and accurate inferences as the more complex methods. We recommend that, in general, cognitive models become a typical analysis tool for response time data. In particular, we argue that the simpler models and procedures are sufficient for standard experimental designs. We finish by outlining situations in which more complicated models and methods may be necessary, and discuss potential pitfalls when interpreting the output from response time models.

A Diffusion Model Analysis of Magnitude Comparison in Children with and without Dyscalculia: Care of Response and Ability Are Related to Both Mathematical Achievement and Stimuli.

The respective roles of the approximate number system (ANS) and an access deficit (AD) in developmental dyscalculia (DD) are not well-known. Most studies rely on response times (RTs) or accuracy (error rates) separately. We analyzed the results of two samples of elementary school children in symbolic magnitude comparison (MC) and non-symbolic MC using a diffusion model. This approach uses the joint distribution of both RTs and accuracy in order to synthesize measures closer to ability and response caution or response conservatism. The latter can be understood in the context of the speed-accuracy tradeoff: It expresses how much a subject trades in speed for improved accuracy. We found significant effects of DD on both ability (negative) and response caution (positive) in MC tasks and a negative interaction of DD with symbolic task material on ability. These results support that DD subjects suffer from both an impaired ANS and an AD and in particular support that slower RTs of children with DD are indeed related to impaired processing of numerical information. An interaction effect of symbolic task material and DD (low mathematical ability) on response caution could not be refuted. However, in a sample more representative of the general population we found a negative association of mathematical ability and response caution in symbolic but not in non-symbolic task material. The observed differences in response behavior highlight the importance of accounting for response caution in the analysis of MC tasks. The results as a whole present a good example of the benefits of a diffusion model analysis.

The elimination of positive priming with increasing prime duration reflects a transition from perceptual fluency to disfluency rather than bias against primed words

With immediate repetition priming of forced choice perceptual identification, short prime durations produce positive priming (i.e., priming the target leads to higher accuracy, while priming the foil leads to lower accuracy). Many theories explain positive priming following short duration primes as reflecting increased perceptual fluency for the primed target (i.e., decreased identification latency). However, most studies only examine either accuracy or response times, rather than considering the joint constraints of response times and accuracy to properly address the role of decision biases and response caution. This is a critical oversight because several theories propose that the transition to negative priming following a long duration prime reflects a decision strategy to compensate for the effect of increased perceptual fluency. In contrast, the nROUSE model of Huber and O’Reilly (2003) explains this transition as reflecting perceptual habituation, and thus a change to perceptual disfluency. We confirmed this prediction by applying a sequential sampling model (the diffusion race model) to accuracy and response time distributions from a new single item same-different version of the priming task. In this way, we measured strategic biases and perceptual fluency in each condition for each subject. The nROUSE model was only applied to accuracy from the original forced-choice version of the priming task. This application of nROUSE produced separate predictions for each subject regarding the degree of fluency and disfluency in each condition, and these predictions were confirmed by the drift rate parameters (i.e., fluency) from the response time model in contrast to the threshold parameters (i.e., bias).

Bayesian statistical approaches to evaluating cognitive models.

Cognitive models aim to explain complex human behavior in terms of hypothesized mechanisms of the mind. These mechanisms can be formalized in terms of mathematical structures containing parameters that are theoretically meaningful. For example, in the case of perceptual decision making, model parameters might correspond to theoretical constructs like response bias, evidence quality, response caution, and the like. Formal cognitive models go beyond verbal models in that cognitive mechanisms are instantiated in terms of mathematics and they go beyond statistical models in that cognitive model parameters are psychologically interpretable. We explore three key elements used to formally evaluate cognitive models: parameter estimation, model prediction, and model selection. We compare and contrast traditional approaches with Bayesian statistical approaches to performing each of these three elements. Traditional approaches rely on an array of seemingly ad hoc techniques, whereas Bayesian statistical approaches rely on a single, principled, internally consistent system. We illustrate the Bayesian statistical approach to evaluating cognitive models using a running example of the Linear Ballistic Accumulator model of decision making (Brown SD, Heathcote A. The simplest complete model of choice response time: linear ballistic accumulation. Cogn Psychol 2008, 57:153-178). WIREs Cogn Sci 2018, 9:e1458. doi: 10.1002/wcs.1458 This article is categorized under: Neuroscience > Computation Psychology > Reasoning and Decision Making Psychology > Theory and Methods.

Impairment of manual but not saccadic response inhibition following acute alcohol intoxication

BackgroundAlcohol impairs response inhibition; however, it remains contested whether such impairments affect a general inhibition system, or whether affected inhibition systems are embedded in, and specific to, each response modality. Further, alcohol-induced impairments have not been disambiguated between proactive and reactive inhibition mechanisms, and nor have the contributions of action-updating impairments to behavioural ‘inhibition’ deficits been investigated. MethodsForty Participants (25 female) completed both a manual and a saccadic stop-signal reaction time (SSRT) task before and after a 0.8g/kg dose of alcohol and, on a separate day, before and after a placebo. Blocks in which participants were required to ignore the signal to stop or make an additional ‘dual' response were included to obtain measures of proactive inhibition as well as updating of attention and action. ResultsAlcohol increased manual but not saccadic SSRT. Proactive inhibition was weakly reduced by alcohol, but increases in the reaction times used to baseline this contrast prevent clear conclusions regarding response caution. Finally, alcohol also increased secondary dual response times of the dual task uniformly as a function of the delay between tasks, indicating an effect of alcohol on action-updating or execution. ConclusionsThe modality-specific effects of alcohol favour the theory that response inhibition systems are embedded within response modalities, rather than there existing a general inhibition system. Concerning alcohol, saccadic control appears relatively more immune to disruption than manual control, even though alcohol affects saccadic latency and velocity. Within the manual domain, alcohol affects multiple types of action updating, not just inhibition.

The importance of age-related differences in prospective memory: Evidence from diffusion model analyses.

Event-based prospective memory (PM) refers to relying on environmental cues to trigger retrieval of a deferred action plan from long-term memory. Considerable research has demonstrated PM declines with increased age. Despite efforts to better characterize the attentional processes that underlie these decrements, the majority of research has relied on measures of central tendency to inform theoretical accounts of PM that may not entirely capture the underlying dynamics involved in allocating attention to intention-relevant information. The purpose of the current study was to examine the utility of the diffusion model to better understand the cognitive processes underlying age-related differences in PM. Results showed that emphasizing the importance of the PM intention increased cue detection selectively for older adults. Standard cost analyses revealed that PM importance increased mean response times and accuracy, but not differentially for young and older adults. Consistent with this finding, diffusion model analyses demonstrated that PM importance increased response caution as evidenced by increased boundary separation. However, the selective benefit in cue detection for older adults may reflect peripheral target-checking processes as indicated by changes in nondecision time. These findings highlight the use of modeling techniques to better characterize the processes underlying the relations among aging, attention, and PM.

Modeling cognitive load effects of conversation between a passenger and driver.

Cognitive load from secondary tasks is a source of distraction causing injuries and fatalities on the roadway. The Detection Response Task (DRT) is an international standard for assessing cognitive load on drivers' attention that can be performed as a secondary task with little to no measurable effect on the primary driving task. We investigated whether decrements in DRT performance were related to the rate of information processing, levels of response caution, or the non-decision processing of drivers. We had pairs of participants take part in the DRT while performing a simulated driving task, manipulated cognitive load via the conversation between driver and passenger, and observed associated slowing in DRT response time. Fits of the single-bound diffusion model indicated that slowing was mediated by an increase in response caution. We propose the novel hypothesis that, rather than the DRT's sensitivity to cognitive load being a direct result of a loss of information processing capacity to other tasks, it is an indirect result of a general tendency to be more cautious when making responses in more demanding situations.

Adoption of Task-Specific Sets of Visual Attention.

Evidence from behavioral and physiological studies suggests attentional weighting of stimulus information from different sources, according to task demands. We investigated the adoption of task-specific attentional sets by administering a flanker task, which required responding to a centrally presented letter while ignoring two adjacent letters, and a same-different judgment task, which required a homogenous/heterogeneous classification concerning the complete three-letter string. To assess the distribution of attentional weights across the letter locations we intermixed trials of a visual search task, in which a target stimulus occurred randomly in any of these locations. Search task reaction times displayed a stronger center-to periphery gradient, indicating focusing of visual attention on the central location, when the search task was intermixed into blocks of trials of the flanker task than into blocks of trials of the same-different task (Experiment 1) and when a cue indicated the likely occurrence of the flanker task as compared to the likely occurrence the same-different task (Experiment 2). These findings demonstrate flexible adoption of task-specific sets of visual attention that can be implemented during preparation. In addition, responses in the intermixed search task trials were faster and (marginally significantly) more error-prone after preparation for a (letter) task repetition than for a task switch, suggesting that response caution is reduced during preparation for a task repetition.

Testing the validity of conflict drift-diffusion models for use in estimating cognitive processes: A parameter-recovery study.

Researchers and clinicians are interested in estimating individual differences in the ability to process conflicting information. Conflict processing is typically assessed by comparing behavioral measures like RTs or error rates from conflict tasks. However, these measures are hard to interpret because they can be influenced by additional processes like response caution or bias. This limitation can be circumvented by employing cognitive models to decompose behavioral data into components of underlying decision processes, providing better specificity for investigating individual differences. A new class of drift-diffusion models has been developed for conflict tasks, presenting a potential tool to improve analysis of individual differences in conflict processing. However, measures from these models have not been validated for use in experiments with limited data collection. The present study assessed the validity of these models with a parameter-recovery study to determine whether and under what circumstances the models provide valid measures of cognitive processing. Three models were tested: the dual-stage two-phase model (Hübner, Steinhauser, & Lehle, Psychological Review, 117(3), 759-784, 2010), the shrinking spotlight model (White, Ratcliff, & Starns, Cognitive Psychology, 63(4), 210-238, 2011), and the diffusion model for conflict tasks (Ulrich, Schröter, Leuthold, & Birngruber, Cogntive Psychology, 78, 148-174, 2015). The validity of the model parameters was assessed using different methods of fitting the data and different numbers of trials. The results show that each model has limitations in recovering valid parameters, but they can be mitigated by adding constraints to the model. Practical recommendations are provided for when and how each model can be used to analyze data and provide measures of processing in conflict tasks.

Drift diffusion model of reward and punishment learning in rare alpha-synuclein gene carriers

To understand the cognitive effects of alpha-synuclein polymorphism, we employed a drift diffusion model (DDM) to analyze reward- and punishment-guided probabilistic learning task data of participants with the rare alpha-synuclein gene duplication and age- and education-matched controls. Overall, the DDM analysis showed that, relative to controls, asymptomatic alpha-synuclein gene duplication carriers had significantly increased learning from negative feedback, while they tended to show impaired learning from positive feedback. No significant differences were found in response caution, response bias, or motor/encoding time. We here discuss the implications of these computational findings to the understanding of the neural mechanism of alpha-synuclein gene duplication.

The Processing-Speed Impairment in Psychosis Is More Than Just Accelerated Aging.

Processing speed is impaired in patients with psychosis, and deteriorates as a function of normal aging. These observations, in combination with other lines of research, suggest that psychosis may be a syndrome of accelerated aging. But do patients with psychosis perform poorly on tasks of processing speed for the same reasons as older adults? Fifty-one patients with psychotic illnesses and 90 controls with similar mean IQ (aged 19-69 years, all African American) completed a computerized processing-speed task, reminiscent of the classic digit-symbol coding task. The data were analyzed using the drift-diffusion model (DDM), and Bayesian inference was used to determine whether psychosis and aging had similar or divergent effects on the DDM parameters. Psychosis and aging were both associated with poor performance, but had divergent effects on the DDM parameters. Patients had lower information-processing efficiency ("drift rate") and longer nondecision time than controls, and psychosis per se did not influence response caution. By contrast, the primary effect of aging was to increase response caution, and had inconsistent effects on drift rate and nondecision time across patients and controls. The results reveal that psychosis and aging influenced performance in different ways, suggesting that the processing-speed impairment in psychosis is more than just accelerated aging. This study also demonstrates the potential utility of computational models and Bayesian inference for finely mapping the contributions of cognitive functions on simple neurocognitive tests.

Focal striatum lesions impair cautiousness in humans

Functional neuroimaging data indicate the dorsal striatum is engaged when people are required to vary the cautiousness of their decisions, by emphasizing the speed or accuracy of responding in laboratory-based decision tasks. However, the functional contribution of the striatum to decision making is unknown. In the current study we tested patients with focal ischemic lesions of the dorsal striatum and matched non-lesion control participants on a speed-accuracy tradeoff (SAT) task. Analysis using a computational model of response selection in a competitive and time-pressured context indicated that the decisions of patients with striatal lesions were less cautious than those of matched controls. This deficit was most prominent when the accuracy of decisions was emphasized. The results are consistent with the hypothesis that the striatum plays an important role in strategically setting response caution, an essential function for flexible behavior.

Semantic incongruity influences response caution in audio-visual integration.

Multisensory stimulus combinations trigger shorter reaction times (RTs) than individual single-modality stimuli. It has been suggested that this inter-sensory facilitation effect is found exclusively for semantically congruent stimuli, because incongruity would prevent multisensory integration. Here we provide evidence that the effect of incongruity is due to a change in response caution rather than prevention of stimulus integration. In two experiments, participants performed two-alternative forced-choice decision tasks in which they categorized auditory stimuli, visual stimuli or audio-visual stimulus pairs. The pairs were either semantically congruent (e.g. ambulance image and horn sound) or incongruent (e.g. ambulance image and bell sound). Shorter RTs and violations of the race model inequality on congruent trials are in accordance with previous studies. However, Bayesian hierarchical drift diffusion analyses contradict former co-activation-based explanations of the effects of congruency. Instead, they show that longer RTs on incongruent compared to congruent trials are most likely the result of an incongruity caution effect-more cautious response behaviour in face of semantically incongruent sensory input. Further, they show that response caution can be adjusted on a trial-by-trial basis depending on incoming information. Finally, stimulus modality influenced non-cognitive components of the response. We suggest that the combined stimulus energy from simultaneously presented stimuli reduces encoding time.

Transcranial Direct Current Stimulation Does Not Influence the Speed-Accuracy Tradeoff in Perceptual Decision-making: Evidence from Three Independent Studies.

In perceptual decision-making tasks, people balance the speed and accuracy with which they make their decisions by modulating a response threshold. Neuroimaging studies suggest that this speed-accuracy tradeoff is implemented in a corticobasal ganglia network that includes an important contribution from the pre-SMA. To test this hypothesis, we used anodal transcranial direct current stimulation (tDCS) to modulate neural activity in pre-SMA while participants performed a simple perceptual decision-making task. Participants viewed a pattern of moving dots and judged the direction of the global motion. In separate trials, they were cued to either respond quickly or accurately. We used the diffusion decision model to estimate the response threshold parameter, comparing conditions in which participants received sham or anodal tDCS. In three independent experiments, we failed to observe an influence of tDCS on the response threshold. Additional, exploratory analyses showed no influence of tDCS on the duration of nondecision processes or on the efficiency of information processing. Taken together, these findings provide a cautionary note, either concerning the causal role of pre-SMA in decision-making or on the utility of tDCS for modifying response caution in decision-making tasks.

An Opportunity for Charity? A Catholic Tradition in Understanding Disability and Its Impact on Ministry

ABSTRACTDavid Perry, the father of a boy with Down Syndrome, wrote an angry reaction to Pope Francis' references to individuals and families living with disabilities in Amoris Laetitia. Perry is con-cerned about the limited perspective of persons with disabilities that is portrayed in the texts, which show families commended for their love and tolerance, with a lack of appreciation for the person with a disability as a person of interest, rather than an object of pity. He offers further reflections of caution and hope in response to words and actions of Pope Francis during a Mass celebrating disability awareness. Perry's comments provide the starting point for reflecting on the image of persons with disabilities presented in Amoris Laetitia and a discussion of possibilities for charity to serve as a corrective for this and pastoral practice.

The effect of alcohol hangover on choice response time.

The effect of alcohol hangover on cognitive processing has received little attention. We explored the effect of alcohol hangover on choice response time (RT), a dominant dependent variable (DV) in cognitive research. Prior research of the effect of hangover on RT has produced mixed findings; all studies reviewed relied exclusively on estimates of central tendency (e.g. mean RT), which has limited information value. Here we present novel analytical methods by going beyond mean RT analysis. Specifically, we examined performance in hangover conditions (n=31) across the whole RT distribution by fitting ex-Gaussian models to participant data, providing a formal description of the RT distribution. This analysis showed detriments to performance under hangover conditions at the slower end of the RT distribution and increased RT variance under hangover conditions. We also fitted an explicit mathematical process model of choice RT - the diffusion model - which estimates parameters reflecting psychologically-meaningful processes underlying choice RT. This analysis showed that hangover reduced information processing efficiency during response selection, and increased response caution; changes in these parameters reflect hangover affecting core decisional-components of RT performance. The implications of the data as well as the methods used for hangover research are discussed.

A diffusion model analysis of episodic recognition in preclinical individuals with a family history for Alzheimer's disease: The adult children study.

A family history of Alzheimer's disease (AD) increases the risk of developing AD and can influence the accumulation of well-established AD biomarkers. There is some evidence that family history can influence episodic memory performance even in cognitively normal individuals. We attempted to replicate the effect of family history on episodic memory and used a specific computational model of binary decision making (the diffusion model) to understand precisely how family history influences cognition. Finally, we assessed the sensitivity of model parameters to family history controlling for standard neuropsychological test performance. Across 2 experiments, cognitively healthy participants from the Adult Children Study completed an episodic recognition test consisting of high- and low-frequency words. The diffusion model was applied to decompose accuracy and reaction time (RT) into latent parameters which were analyzed as a function of family history. In both experiments, individuals with a family history of AD exhibited lower recognition accuracy and this occurred in the absence of an apolipoprotein E (APOE) ε4 allele. The diffusion model revealed this difference was due to changes in the quality of information accumulation (the drift rate) and not differences in response caution or other model parameters. This difference remained after controlling for several standard neuropsychological tests. These results confirm that the presence of a family history of AD confers a subtle cognitive deficit in episodic memory as reflected by decreased drift rate that cannot be attributed to APOE. This measure may serve as a novel cognitive marker of preclinical AD.

A new framework for modeling decisions about changing information: The Piecewise Linear Ballistic Accumulator model

In the real world, decision making processes must be able to integrate non-stationary information that changes systematically while the decision is in progress. Although theories of decision making have traditionally been applied to paradigms with stationary information, non-stationary stimuli are now of increasing theoretical interest. We use a random-dot motion paradigm along with cognitive modeling to investigate how the decision process is updated when a stimulus changes. Participants viewed a cloud of moving dots, where the motion switched directions midway through some trials, and were asked to determine the direction of motion. Behavioral results revealed a strong delay effect: after presentation of the initial motion direction there is a substantial time delay before the changed motion information is integrated into the decision process. To further investigate the underlying changes in the decision process, we developed a Piecewise Linear Ballistic Accumulator model (PLBA). The PLBA is efficient to simulate, enabling it to be fit to participant choice and response-time distribution data in a hierarchal modeling framework using a non-parametric approximate Bayesian algorithm. Consistent with behavioral results, PLBA fits confirmed the presence of a long delay between presentation and integration of new stimulus information, but did not support increased response caution in reaction to the change. We also found the decision process was not veridical, as symmetric stimulus change had an asymmetric effect on the rate of evidence accumulation. Thus, the perceptual decision process was slow to react to, and underestimated, new contrary motion information.

Sequential Sampling Models in Cognitive Neuroscience: Advantages, Applications, and Extensions

Sequential sampling models assume that people make speeded decisions by gradually accumulating noisy information until a threshold of evidence is reached. In cognitive science, one such model--the diffusion decision model--is now regularly used to decompose task performance into underlying processes such as the quality of information processing, response caution, and a priori bias. In the cognitive neurosciences, the diffusion decision model has recently been adopted as a quantitative tool to study the neural basis of decision making under time pressure. We present a selective overview of several recent applications and extensions of the diffusion decision model in the cognitive neurosciences.

Commentary: When the brain takes a break: a model-based analysis of mind wandering.

Commentary: When the brain takes a break: a model-based analysis of mind wandering.