Intertrial Effects Research Articles

Distracted by Previous Experience: Integrating Selection History, Current Task Demands and Saliency in an Algorithmic Model

AbstractAttention can be biased by previous learning and experience. We present an algorithmic-level model of this selection history bias in visual attention that predicts quantitatively how stimulus-driven processes, goal-driven control and selection history compete to control attention. In the model, the output of saliency maps as stimulus-driven guidance interacts with a history map that encodes learning effects and a goal-driven task control to prioritize visual features. The model works on coded features rather than image pixels which is common in many traditional saliency models. We test the model on a reaction time (RT) data from a psychophysical experiment. The model accurately predicts parameters of reaction time distributions from an integrated priority map that is comprised of an optimal, weighted combination of separate maps. Analysis of the weights confirms selection history effects on attention guidance. The model is able to capture individual differences between participants’ RTs and response probabilities per group. Moreover, we demonstrate that a model with a reduced set of maps performs worse, indicating that integrating history, saliency and task information are required for a quantitative description of human attention. Besides, we show that adding intertrial effect to the model (as another lingering bias) improves the model’s predictive performance.

Long-term (statistically learnt) and short-term (inter-trial) distractor-location effects arise at different pre- and post-selective processing stages.

A salient distractor interferes less with visual search if it appears at a location where it is likely to occur, referred to as distractor-location probability cueing. Conversely, if the current target appears at the same location as a distractor on the preceding trial, search is impeded. While these two location-specific "suppression" effects reflect long-term, statistically learnt and short-term, inter-trial adaptations of the system to distractors, it is unclear at what stage(s) of processing they arise. Here, we adopted the additional-singleton paradigm and examined lateralized event-related potentials (L-ERPs) and lateralized alpha (8-12 Hz) power to track the temporal dynamics of these effects. Behaviorally, we confirmed both effects: reaction times (RTs) interference was reduced for distractors at frequent versus rare (distractor) locations, and RTs were delayed for targets that appeared at previous distractor versus non-distractor locations. Electrophysiologically, the statistical-learning effect was not associated with lateralized alpha power during the pre-stimulus period. Rather, it was seen in an early N1pc referenced to the frequent distractor location (whether or not a distractor or a target occurred there), indicative of a learnt top-down prioritization of this location. This early top-down influence was systematically modulated by (competing) target- and distractor-generated bottom-up saliency signals in the display. In contrast, the inter-trial effect was reflected in an enhanced SPCN when the target was preceded by a distractor at its location. This suggests that establishing that an attentionally selected item is a task-relevant target, rather than an irrelevant distractor, is more demanding at a previously "rejected" distractor location.

Sequential dependency for affective appraisal of food images

How we perceive the world is not solely determined by our experiences at a given moment in time, but also by what we have experienced in our immediate past. Here, we investigated whether such sequential effects influence the affective appraisal of food images. Participants from 16 different countries (N = 1278) watched a randomly presented sequence of 60 different food images and reported their affective appraisal of each image in terms of valence and arousal. For both measures, we conducted an inter-trial analysis, based on whether the rating on the preceding trial(s) was low or high. The analyses showed that valence and arousal ratings for a given food image are both assimilated towards the ratings on the previous trial (i.e., a positive serial dependence). For a given trial, the arousal rating depends on the arousal ratings up to three trials back. For valence, we observed a positive dependence for the immediately preceding trial only, while a negative (repulsive) dependence was present up to four trials back. These inter-trial effects were larger for males than for females, but independent of the participants’ BMI, age, and cultural background. The results of this exploratory study may be relevant for the design of websites of food delivery services and restaurant menus.

Dual target search: Attention tuned to relative features, both within and across feature dimensions.

Current models of attention propose that we can tune attention in a top-down controlled manner to a specific feature value (e.g., shape, color) to find specific items (e.g., a red car; feature-specific search). However, subsequent research has shown that attention is often tuned in a context-dependent manner to the relative features that distinguish a sought-after target from other surrounding nontarget items (e.g., larger, bluer, and faster; relational search). Currently, it is unknown whether search will be feature-specific or relational in search for multiple targets with different attributes. In the present study, observers had to search for 2 targets that differed either across 2 stimulus dimensions (color, motion; Experiment 1) or within the same stimulus dimension (color; Experiment 2: orange/redder or aqua/bluer). We distinguished between feature-specific and relational search by measuring eye movements to different types of irrelevant distractors (e.g., relatively matching vs. feature-matching). The results showed that attention was biased to the 2 relative features of the targets, both across different feature dimensions (i.e., motion and color) and within a single dimension (i.e., 2 colors; bluer and redder). The results were not due to automatic intertrial effects (dimension weighting or feature priming), and we found only small effects for valid precueing of the target feature, indicating that relational search for two targets was conducted with relative ease. This is the first demonstration that attention is top-down biased to the relative target features in dual target search, which shows that the relational account generalizes to multiple target search. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Choice-induced inter-trial inhibition is modulated by idiosyncratic choice-consistency.

Humans constantly decide among multiple action plans. Carrying out one action usually implies that other plans are suppressed. Here we make use of inter-trial effects to determine whether suppression of non-chosen action plans is due to proactively preparing for upcoming decisions or due to retroactive influences from previous decisions. Participants received rewards for timely and accurate saccades to targets appearing left or right from fixation. Each block interleaved trials with one (single-trial) or two targets (choice-trial). Whereas single-trial rewards were always identical, rewards for the two targets in choice-trials could either be identical (unbiased) or differ (biased) within one block. We analyzed single-trial latencies as a function of idiosyncratic choice-consistency or reward-bias, the previous trial type and whether the same or the other target was selected in the preceding trial. After choice-trials, single-trial responses to the previously non-chosen target were delayed. For biased choices, inter-trial effects were strongest when choices were followed by a single-trial to the non-chosen target. In the unbiased condition, inter-trial effects increased with increasing individual consistency of choice behavior. These findings suggest that the suppression of alternative action plans is not coupled to target selection and motor execution but instead depends on top-down signals like the overall preference of one target over another.

Positive sequential dependency for face attractiveness perception.

Recent findings from several groups have demonstrated that visual perception at a given moment can be biased toward what was recently seen. This is true both for basic visual attributes and for more complex representations, such as face identity, gender, or expression. This assimilation to the recent past is a positive serial dependency, similar to a temporal averaging process that capitalizes on short-term correlations in visual input to reduce noise and boost perceptual continuity. Here we examine serial dependencies in face perception using a simple attractiveness rating task and a rapid series of briefly presented face stimuli. In a series of three experiments, our results confirm a previous report that face attractiveness exhibits a positive serial dependency. This intertrial effect is not only determined by face attractiveness on the previous trial, but also depends on the faces shown up to five trials back. We examine the effect of stimulus presentation duration and find that stimuli as brief as 56 ms produce a significant positive dependency similar in magnitude to that produced by stimuli presented for 1,000 ms. We observed stronger positive dependencies between same-gender faces, and found a task dependency: Alternating gender discrimination trials with attractiveness rating trials produced no serial dependency. In sum, these findings show that a perception-stabilizing assimilation effect operates in face attractiveness perception that is task dependent and is acquired surprisingly quickly.

Differential inter-trial effects in the visual search of children, adolescents, and young adults

We examined the age-related variation in one type of inter-trial effect of visual search, the distractor previewing effect (DPE), in affectively neutral and affectively charged contexts. In Experiment 1, children, adolescents, and young adults were faster to identify the shape of a color target when the color of the current distractors had already been previewed than when the target had been previewed in the preceding target-absent trial, indicative of a color-based DPE. The results revealed a greater DPE in children than in adolescents and young adults, but it can be attributed to children's slower RTs than the other two groups. In Experiment 2, children, adolescents, and young adults were instructed to respond to a schematic face that was different from the other two faces. Young adults were faster in searching for a threatening face among friendly ones when they had previewed a target-absent display consisting of friendly faces than that of threatening faces, indicating an emotional DPE. By contrast, children showed a reversed DPE under the same condition, whereas adolescents showed no DPE. Taken together, these results suggested that the three age groups were all able to create an inhibitory attentional bias on the basis of trial history in affectively neutral context, whereas children and adolescents were not able to create such an inhibitory attentional bias in affectively charged contexts in the same way as adults did. These findings implied that the development of attentional inhibition abilities in affectively charged contexts might be delayed compared to those in affectively neutral contexts.

Repeatability and Safety of the Functional Capacity Evaluation-One-Handed for Individuals with Upper Limb Reduction Deficiency and Amputation

Purpose To assess repeatability and safety of the functional capacity evaluation-one-handed (FCE-OH), a FCE-OH individuals, consisting of eight items. Method The FCE-OH protocol was administered twice to 23 individuals with upper limb absence (87% male; median age 46 years; median 2 days between sessions). To examine repeatability, test–retest reliability and agreement were assessed with the intraclass correlations coefficient (ICC) and limits of agreement (LoA), respectively. Reliability was considered acceptable when ICC-values were ≥0.75. Widths of LoA of four tests were compared with those of healthy adults. Safety and pain response were assessed with a questionnaire. Results After controlling for stability of construct, ICC-values ranged between 0.23 and 0.96, and widths of LoA ranged between 16 and 79%. Intertrial (learning) effects were present in three test items. No serious adverse reactions were reported. A pain response was reported by 30% of the participants. Conclusion Good or excellent reliability was observed in five tests, while three items showed poor or moderate test–retest reliability. Interpretation of agreement was possible for four tests, of which three showed widths of LoA similar to those reported in healthy adults. Learning effects were present; therefore, interpretation at the individual level should be performed with care. As the CI of several items were wide, confirmation of results in a larger sample is warranted. Safety was confirmed.

Face familiarity promotes stable identity recognition: exploring face perception using serial dependence.

Studies suggest that familiar faces are processed in a manner distinct from unfamiliar faces and that familiarity with a face confers an advantage in identity recognition. Our visual system seems to capitalize on experience to build stable face representations that are impervious to variation in retinal input that may occur due to changes in lighting, viewpoint, viewing distance, eye movements, etc. Emerging evidence also suggests that our visual system maintains a continuous perception of a face's identity from one moment to the next despite the retinal input variations through serial dependence. This study investigates whether interactions occur between face familiarity and serial dependence. In two experiments, participants used a continuous scale to rate attractiveness of unfamiliar and familiar faces (either experimentally learned or famous) presented in rapid sequences. Both experiments revealed robust inter-trial effects in which attractiveness ratings for a given face depended on the preceding face's attractiveness. This inter-trial attractiveness effect was most pronounced for unfamiliar faces. Indeed, when participants were familiar with a given face, attractiveness ratings showed significantly less serial dependence. These results represent the first evidence that familiar faces can resist the temporal integration seen in sequential dependencies and highlight the importance of familiarity to visual cognition.

Feature-based attention across saccades and immediate postsaccadic selection.

Before each eye movement, attentional resources are drawn to the saccade goal. This saccade-related attention is known to be spatial in nature, and in this study we asked whether it also evokes any feature selectivity that is maintained across the saccade. After a saccade toward a colored target, participants performed a postsaccadic feature search on an array displayed at landing. The saccade target either had the same color as the search target in the postsaccadic array (congruent trials) or a different color (incongruent or neutral trials). Our results show that the color of the saccade target did not prime the subsequent feature search. This suggests that "landmark search", the process of searching for the saccade target once the eye lands (Deubel in Visual Cognition, 11, 173-202, 2004), may not involve the attentional mechanisms that underlie feature search. We also analyzed intertrial effects and observed priming of pop-out (Maljkovic & Nakayama in Memory & Cognition, 22, 657-672, 1994) for the postsaccadic feature search: the detection of the color singleton became faster when its color was repeated on successive trials. However, search performance revealed no effect of congruency between the saccade and search targets, either within or across trials, suggesting that the priming of pop-out is specific to target repetitions within the same task and is not seen for repetitions across tasks. Our results support a dissociation between feature-based attention and the attentional mechanisms associated with eye movement programming.

Transformation priming helps to disambiguate sudden changes of sensory inputs

Retinal input is riddled with abrupt transients due to self-motion, changes in illumination, object-motion, etc. Our visual system must correctly interpret each of these changes to keep visual perception consistent and sensitive. This poses an enormous challenge, as many transients are highly ambiguous in that they are consistent with many alternative physical transformations. Here we investigated inter-trial effects in three situations with sudden and ambiguous transients, each presenting two alternative appearances (rotation-reversing structure-from-motion, polarity-reversing shape-from-shading, and streaming-bouncing object collisions). In every situation, we observed priming of transformations as the outcome perceived in earlier trials tended to repeat in subsequent trials and this repetition was contingent on perceptual experience. The observed priming was specific to transformations and did not originate in priming of perceptual states preceding a transient. Moreover, transformation priming was independent of attention and specific to low level stimulus attributes. In summary, we show how “transformation priors” and experience-driven updating of such priors helps to disambiguate sudden changes of sensory inputs. We discuss how dynamic transformation priors can be instantiated as “transition energies” in an “energy landscape” model of the visual perception.

Evidence for distinct mechanisms underlying attentional priming and sensory memory for bistable perception.

Attentional selection in visual search paradigms and perceptual selection in bistable perception paradigms show functional similarities. For example, both are sensitive to trial history: They are biased toward previously selected targets or interpretations. We investigated whether priming by target selection in visual search and sensory memory for bistable perception are related. We did this by presenting two trial types to observers. We presented either ambiguous spheres that rotated over a central axis and could be perceived as rotating in one of two directions, or search displays in which the unambiguously rotating target and distractor spheres closely resembled the two possible interpretations of the ambiguous stimulus. We interleaved both trial types within experiments, to see whether priming by target selection during search trials would affect the perceptual outcome of bistable perception and, conversely, whether sensory memory during bistable perception would affect target selection times during search. Whereas we found intertrial repetition effects among consecutive search trials and among consecutive bistable trials, we did not find cross-paradigm effects. Thus, even though we could ascertain that our experiments robustly elicited processes of both search priming and sensory memory for bistable perception, these same experiments revealed no interaction between the two.

The Right Angular Gyrus Combines Perceptual and Response-related Expectancies in Visual Search: TMS-EEG Evidence.

Visual search performance is sensitive to changes in the environment. Attention is sensitive to trial history, in terms of both perception and response. Although the bases of these sensorimotor interactions remain unclear, both behaviorally and neurally, converging evidence from a variety of methods indicates that the right angular gyrus (rANG) may be important. The present study tests whether the rANG plays a causal role in generating these inter-trial effects. Participants performed a compound task for feature singleton targets. We applied rTMS over the rANG (or a control site, or no TMS) during the inter-trial interval and measured effects both on behavior and on neural activity using psychophysics and event-related potential (ERP) recording. rANG TMS during the inter-trial interval improved performance to the upcoming stimuli only when the target-defining dimension and the response-defining feature both repeated across successive trials. rANG TMS also increased the amplitude of the visual N1 component evoked by the upcoming stimuli. These effects did not occur after control TMS. rANG plays a causal role in the formation of combined expectancies binding together stimulus- and response-characteristics of the previous trial to optimize visual search performance. This supports a visuomotor theory of parietal cortex and the dimension weighting account of attention. We suggest current models of inter-trial effects in visual search need to be expanded to include an interactive component representing both perceptual and motoric inter-trial expectancies, affecting the early analysis of stimulus features in the upcoming trial.

No attentional capture for simple visual search: evidence for a dual-route account.

An enduring question in visual attention research is whether unattended objects are subject to perceptual processing. The traditional view suggests that, whereas focal attention is required for the processing of complex features or for individuating objects, it is not required for detecting basic features. However, other models suggest that detecting basic features may be no different from object identification and also require focal attention. In the present study, we approach this problem by measuring the effect of attentional capture in simple and compound visual search tasks. To make sure measurements did not reflect strategic components of the tasks, we measured accuracy with brief displays. Results show that attentional capture influenced only compound but not basic feature searches, suggestive of a distinction between attentional requirements of the 2 tasks. We discuss our findings, together with recent results of top-down word cue effects and dimension-specific intertrial effects, in terms of the dual-route account for visual search, which suggests that the task that is being completed determines whether search is based on attentive or preattentive mechanisms.

Relative contributions of task-relevant and task-irrelevant dimensions in priming of pop-out

Intertrial effects such as priming of pop-out (PoP) often occur for task-irrelevant dimensions as well as task-relevant dimensions, though to a weaker extent. Here we test the hypothesis that increased priming for task-relevant dimensions is due to greater passive build-up of priming for the task-relevant dimension rather than to an active filtering of task-irrelevant dimensions; if this is the case, then we should observe a positive correlation between the magnitude of task-relevant and task-irrelevant priming. We tested this hypothesis using a pop-out search task in which the task-relevant dimension was orientation and the task-irrelevant dimension was color. We found a strong, positive association between task-relevant and task-irrelevant priming across a large group of participants (N = 100); additionally, we observed increased priming over consecutive repetitions for the task-relevant dimension, whereas task-irrelevant priming was constant across multiple repetitions. As further evidence against an active filtering account, task-irrelevant priming showed no systematic relationship with visual short-term memory capacity, which has been shown to correlate with filtering ability. Together, our results suggest that task-irrelevant dimensions are co-selected rather than filtered out during target search. Further, increased task-relevant priming may reflect an enhanced representation of the task-relevant dimension that is reinforced over consecutive repetitions.

The inter-trial effect of prepared but not executed antisaccades.

A preceding antisaccade increases the latency of the saccade in the next trial. Whether this inter-trial effect is generated by the preparation or the execution of the antisaccade is not certain. Our goal was to examine the inter-trial effects from trials on which subjects prepared an antisaccade but did not make one. We tested 15 subjects on blocks of randomly ordered prosaccades and antisaccades. An instructional cue at fixation indicated whether a prosaccade or antisaccade was required, with the target appearing 2 s later. On 20 % of antisaccade trials, the target did not appear (prepared-only antisaccade trials). We analyzed the latencies of all correct prosaccades or antisaccades preceded by correctly executed trials. The latencies of prosaccade trials were 15 ms shorter if they were preceded by prosaccades than if the prior trial was an antisaccade. Prosaccades preceded by trials on which antisaccades were cued but not executed also showed prolonged latencies that were equivalent to those preceded by executed antisaccades. We conclude that the inter-trial effects from a prior antisaccade are generated by its preparation rather than its execution. This may reflect persistence of pre-target preparatory activity from the prior trial to affect that of the next trial in structures like the superior colliculus and frontal eye field.

Not all "distractor" tags are created equal: using a search asymmetry to dissociate the inter-trial effects caused by different forms of distractors.

In a typical pop-out task, there is one target and a varying number of distractor stimuli. Now imagine a target-absent display in the context of a pop-out task: all items are identical, and it is decidedly easy to conclude that all items in the display are distractors, precisely because there is no target to select on that display. One may be tempted to say that, as far as the attention system is concerned, these two types of distractors are the same: target-present distractors and target-absent distractors. The present study proposes that this is actually not the case. Target-absent distractors can sometimes produce inter-trial effects that their close-cousins, the target-present distractors, cannot. We used a letters/numbers categorical oddball task to demonstrate this difference. The results are interpreted in the context of recent findings in cognitive neuroscience as well as cognitive modeling.

From features to dimensions: cognitive and motor development in pop-out search in children and young adults.

In an experiment involving a total of 124 participants, divided into eight age groups (6-, 8-, 10-, 12-, 14-, 16-, 18-, and 20-year-olds) the development of the processing components underlying visual search for pop-out targets was tracked. Participants indicated the presence or absence of color or orientation feature singleton targets. Observers also solved a detection task, in which they responded to the onset of search arrays. There were two main results. First, analyses of inter-trial effects revealed differences in the search strategies of the 6-year-old participants compared to older age groups. Participants older than 8 years based target detection on feature-less dimensional salience signals (indicated by cross-trial RT costs in target dimension change relative to repetition trials), the 6-year-olds accessed the target feature to make a target present or absent decision (cross-trial RT costs in target feature change relative to feature repetition trials). The result agrees with predictions derived from the Dimension Weighting account and previous investigations of inter-trial effects in adult observers (Müller et al., 1995; Found and Müller, 1996). The results are also in line with theories of cognitive development suggesting that the ability to abstract specific visual features into feature categories is developed after the age of 7 years. Second, overall search RTs decreased with increasing age in a decelerated fashion. RT differences between consecutive age groups can be explained by sensory-motor maturation up to the age of 10 years (as indicated by RTs in the onset detection task). Expedited RTs in older age groups (10-, vs. 12-year-olds; 14- vs. 16-year-olds), but also in the 6- vs. 8-year-olds, are due to the development of search-related (cognitive) processes. Overall, the results suggest that the level of adult performance in visual search for pop-out targets is achieved by the age of 16.

Modeling the Effect of Selection History on Pop-Out Visual Search

While attentional effects in visual selection tasks have traditionally been assigned “top-down” or “bottom-up” origins, more recently it has been proposed that there are three major factors affecting visual selection: (1) physical salience, (2) current goals and (3) selection history. Here, we look further into selection history by investigating Priming of Pop-out (POP) and the Distractor Preview Effect (DPE), two inter-trial effects that demonstrate the influence of recent history on visual search performance. Using the Ratcliff diffusion model, we model observed saccadic selections from an oddball search experiment that included a mix of both POP and DPE conditions. We find that the Ratcliff diffusion model can effectively model the manner in which selection history affects current attentional control in visual inter-trial effects. The model evidence shows that bias regarding the current trial's most likely target color is the most critical parameter underlying the effect of selection history. Our results are consistent with the view that the 3-item color-oddball task used for POP and DPE experiments is best understood as an attentional decision making task.

The Emotional Distractor Previewing Effect in Visual Search

The Distractor Previewing Effect(DPE) is one of the inter-trial effects in visual search based on features or categories. In the DPE tasks, oddball-present and oddball-absent trials are intermixed to present. The target is defined by one feature(e.g., a green diamond among red ones) or category(e.g., a face picture among house pictures), and the response is defined by another feature, such as the shape of the color oddball or which side of the face pictures has a red dot next to it. The DPE is indicated by faster responses on the current oddball-present trial when the distractors are congruent with the stimuli on the preceding oddball-absent trial than when the target does so. Both behavioral and neuroscience studies have revealed that the DPE reflects an attentional bias caused by past unsuccessful experience. In this study, participants were shown three emotional stimuli on each display, with or without one picture having a different valence from the other two. They searched for this emotional oddball and identified its non-affective feature if an oddball was present. If the RTs on the current oddball-present trial are faster when the valence of the target is congruent with that of the stimuli on the preceding oddball-absent trial than when the target does so, this inter-trial effect is the emotional DPE. Pictures of veridical faces of emotional expressions were shown in Experiment 1, whereas pictures of threat-relevant and threat-irrelevant animals were shown in Experiment 2. The emotional DPE was elicited in both experiments. In Experiment 1, the emotional DPE was significant in visual search for an angry face among neutral faces, but this effect was eliminated when these faces were inverted, suggesting that the DPE was due to the emotional category of the faces. In addition, the DPE was not significant in visual search for a neutral face(among angry or happy ones) or for a happy face among neutral distractors, suggesting the asymmetry of the emotional DPE. By contrast, the results of Experiment 2 revealed reliable DPEs in visual search for a fearful animal among peaceful animals. Taken together, the results of this study suggest that the valence of emotional stimuli can be remembered by the attention system to guide attention. Specifically, experience with negative stimuli can be remembered to guide attention to elicit a reliable DPE. Future research is called to test the influence of the observer's emotional state on the DPE.