Classic Visual Search Research Articles

Research on re-searching: interrupted foraging is not disrupted foraging

In classic visual search, observers typically search for the presence of a target in a scene or display. In foraging tasks, there may be multiple targets in the same display (or “patch”). Observers typically search for and collect these target items in one patch until they decide to leave that patch and move to the next one. This is a highly rule-governed behavior. The current study investigated whether these rules are disrupted when the foraging is interrupted in various manners. In Experiment 1, the foraging was briefly interrupted and then resumed in the same patch. In Experiments 2 and 3, the foraging in each patch either ended voluntarily or compulsorily after a fixed amount of time. In these cases, foraging resumed in a patch only after all patches were visited. Overall, the rules of foraging remained largely intact, though Experiment 2 shows that foraging rules can be overridden by the demand characteristics of the task. The results show that participants tended to perform approximately consistently despite interruptions. The results suggest that foraging behavior in a relatively simple foraging environment is resilient and not easily disrupted by interruption.

The effects of visual and auditory synchrony on human foraging.

Can synchrony in stimulation guide attention and aid perceptual performance? Here, in a series of three experiments, we tested the influence of visual and auditory synchrony on attentional selection during a novel human foraging task. Human foraging tasks are a recent extension of the classic visual search paradigm in which multiple targets must be located on a given trial, making it possible to capture a wide range of performance metrics. Experiment 1 was performed online, where the task was to forage for 10 (out of 20) vertical lines among 60 randomly oriented distractor lines that changed color between yellow and blue at random intervals. The targets either changed colors in visual synchrony or not. In another condition, a non-spatial sound additionally occurred synchronously with the color change of the targets. Experiment 2 was run in the laboratory (within-subjects) with the same design. When the targets changed color in visual synchrony, foraging times were significantly shorter than when they randomly changed colors, but there was no additional benefit for the sound synchrony, in contrast to predictions from the so-called "pip-and-pop" effect (Van der Burg et al., Journal of Experimental Psychology, 1053-1065, 2008). In Experiment 3, task difficulty was increased as participants foraged for as many 45° rotated lines as possible among lines of different orientations within 10 s, with the same synchrony conditions as in Experiments 1 and 2. Again, there was a large benefit of visual synchrony but no additional benefit for sound synchronization. Our results provide strong evidence that visual synchronization can guide attention during multiple target foraging. This likely reflects the local grouping of the synchronized targets. Importantly, there was no additional benefit for sound synchrony, even when the foraging task was quite difficult (Experiment 3).

The Attentional Capture Debate: When Can We Avoid Salient Distractors and When Not?

There has been a long-standing debate concerning whether we are able to resist attention capture by salient distractors. The so-called "signal suppression hypothesis" of Gaspelin and Luck (2018) claimed to have resolved this debate. According to this view, salient stimuli "naturally attempt to capture attention", yet attention capture may be prevented by a top-down inhibitory mechanism. The current paper describes the conditions in which attention capture by salient distractors can be avoided. Capture by salient items can be avoided when the target is non-salient and therefore difficult to find. Because fine discrimination is needed, a small attentional window is adapted resulting in serial (or partly serial) search. Salient signals outside the focused attentional window do not capture attention anymore not because they are suppressed but because they are ignored. We argue that in studies that have provided evidence for signal suppression, search was likely serial or at least partly serial. When the target is salient, search will be conducted in parallel, and in those cases the salient singleton cannot be ignored nor suppressed but instead will capture attention. We argue that the "signal suppression" account (Gaspelin & Luck, 2018) that seeks to explain resistance to attentional capture has many parallels to classic visual search models such as the "feature integration theory" (Treisman & Gelade, 1980), "feature inhibition" account (Treisman & Sato, 1990), and "guided search" (Wolfe et al, 1989); all models that explain how the serial deployment of attention is guided by the output of earlier parallel processes.

Active visual search in naturalistic environments reflects individual differences in classic visual search performance

Visual search is a ubiquitous activity in real-world environments. Yet, traditionally, visual search is investigated in tightly controlled paradigms, where head-restricted participants locate a minimalistic target in a cluttered array that is presented on a computer screen. Do traditional visual search tasks predict performance in naturalistic settings, where participants actively explore complex, real-world scenes? Here, we leverage advances in virtual reality technology to test the degree to which classic and naturalistic search are limited by a common factor, set size, and the degree to which individual differences in classic search behavior predict naturalistic search behavior in a large sample of individuals (N = 75). In a naturalistic search task, participants looked for an object within their environment via a combination of head-turns and eye-movements using a head-mounted display. Then, in a classic search task, participants searched for a target within a simple array of colored letters using only eye-movements. In each task, we found that participants’ search performance was impacted by increases in set size—the number of items in the visual display. Critically, we observed that participants’ efficiency in classic search tasks—the degree to which set size slowed performance—indeed predicted efficiency in real-world scenes. These results demonstrate that classic, computer-based visual search tasks are excellent models of active, real-world search behavior.

Aesthetic appeal influences visual search performance

Aesthetic appeal of a visual image can influence performance in time-critical tasks, even if it is irrelevant to the task. This series of experiments examined whether aesthetic appeal can act as an object attribute that guides visual search. If appeal enhances the salience of the targets pre-attentively, then appealing icons would lead to more efficient searches than unappealing targets and, conversely, appeal of distractors would reduce search efficiency. Three experiments (N = 112) examined how aesthetic appeal influences performance in a classic visual search task. In each experiment, participants completed 320 visual search trials, with icons varying in rated aesthetic appeal and either visual complexity (Experiments 1 and 2) of concreteness (Experiment 3) among two, four, eight, or 11 distractor icons. While target appeal did not influence search efficiency it sped up search times in all three experiments: appealing targets led to faster response time (RT) than unappealing targets across all experiments, and compared to neutral distractors, appealing distractors slowed search RT down. These findings are the first to show that an object’s aesthetic appeal influences visual search performance.

Classic Visual Search Effects in an Additional Singleton Task: An Open Dataset.

Visual search refers to our ability to find what we are looking for among many competing visual inputs. Here, we report the availability of a rich dataset that replicates key visual search effects and shows that these effects are robust to several changes to the experimental design. Experiment 1 replicates classic findings from an additional singleton visual search task. First, participants are captured by a salient but irrelevant color singleton, as indexed by slower response times when a color singleton distractor is present versus absent. Second, attentional capture by a color singleton is reduced when the visual search array contains heterogeneous shapes rather than homogenous shapes. Finally, attentional capture by a color singleton is reduced when the display colors are repeated rather than switched unpredictably from trial to trial. Experiment 2 demonstrates that these classic visual search effects are robust to small procedural changes such as task timing (i.e., a 2–8 second rather than ~1 second inter-trial interval). Experiment 3 demonstrates that these classic effects are likewise robust to changes to the distractor frequency (75% rather than 50%) and to fully blocking versus interleaving blocks of two task conditions. All told, this dataset includes 8 sub-experiments, 190 participants and >210,000 trials, and it will serve as a useful resource for power analyses and exploratory analyses of visual search behaviors.

Fear of Missing Out Predicts Distraction by Social Reward Signals Displayed on a Smartphone in Difficult Driving Situations.

Smartphones are particularly likely to elicit driver distraction with obvious negative repercussions on road safety. Recent selective attention models lead to expect that smartphones might be very effective in capturing attention due to their social reward history. Hence, individual differences in terms of Fear of Missing Out (FoMO) – i.e., of the apprehension of missing out on socially rewarding experiences – should play an important role in driver distraction. This factor has already been associated with self-reported estimations of greater attention paid to smartphones while driving, but the potential link between FoMO and smartphone-induced distraction has never been tested empirically. Therefore, we conducted a preliminary study to investigate whether FoMO would modulate attentional capture by reward distractors displayed on a smartphone. First, participants performed a classical visual search task in which neutral stimuli (colored circles) were associated with high or low social reward outcomes. Then, they had to detect a pedestrian or a roe deer in driving scenes with various levels of fog density. The social reward stimuli were displayed as distractors on the screen of a smartphone embedded in the pictures. The results showed a significant three-way interaction between FoMO, social reward distraction, and task difficulty. More precisely, under attention-demanding conditions (i.e., high-fog density), individual FoMO scores predicted attentional capture by social reward distractors, with longer reaction times (RTs) for high rather than low social reward distractors. These results highlight the importance to consider reward history and FoMO when investigating smartphone-based distraction. Limitations are discussed, notably regarding our sample characteristics (i.e., mainly young females) that might hamper the generalization of our findings to the overall population. Future research directions are provided.

Towards Interactive Search: Investigating Visual Search in a Novel Real-World Paradigm.

An overwhelming majority of studies on visual search and selective attention were conducted using computer screens. There are arguably shortcomings in transferring knowledge from computer-based studies to real-world search behavior as findings are based on viewing static pictures on computer screens. This does not go well with the dynamic and interactive nature of vision in the real world. It is crucial to take visual search research to the real world in order to study everyday visual search processes. The aim of the present study was to develop an interactive search paradigm that can serve as a “bridge” between classical computerized search and everyday interactive search. We based our search paradigm on simple LEGO® bricks arranged on tabletop trays to ensure comparability with classical computerized visual search studies while providing room for easily increasing the complexity of the search environment. We found that targets were grasped slower when there were more distractors (Experiment 1) and there were sizable differences between various search conditions (Experiment 2), largely in line with classical visual search research and revealing similarities to research in natural scenes. Therefore, our paradigm can be seen as a valuable asset complementing visual search research in an environment between computerized search and everyday search.

Principles of tactile search over the body.

Although we routinely experience complex tactile patterns over our entire body, how we selectively experience multisite touch over our bodies remains poorly understood. Here, we characterized tactile search behavior over the full body using a tactile analog of the classic visual search task. On each trial, participants judged whether a target stimulus (e.g., 10-Hz vibration) was present or absent anywhere on the body. When present, the target stimulus could occur alone or simultaneously with distractor stimuli (e.g., 30-Hz vibrations) on other body locations. We systematically varied the number and spatial configurations of the distractors as well as the target and distractor frequencies and measured the impact of these factors on tactile search response times. First, we found that response times were faster on target-present trials compared with target-absent trials. Second, response times increased with the number of stimulated sites, suggesting a serial search process. Third, search performance differed depending on stimulus frequencies. This frequency-dependent behavior may be related to perceptual grouping effects based on timing cues. We constructed linear models to explore how the locations of the target and distractor cues influenced tactile search behavior. Our modeling results reveal that, in isolation, cues on the index fingers make relatively greater contributions to search performance compared with stimulation experienced on other body sites. Additionally, costimulation of sites within the same limb or simply on the same body side preferentially influence search behavior. Our collective findings identify some principles of attentional search that are common to vision and touch, but others that highlight key differences that may be unique to body-based spatial perception.NEW & NOTEWORTHY Little is known about how we selectively experience multisite touch patterns over the body. Using a tactile analog of the classic visual target search paradigm, we show that tactile search behavior for flutter cues is generally consistent with a serial search process. Modeling results reveal the preferential contributions of index finger stimulation and two-site stimulus interactions involving ipsilateral patterns and within-limb patterns. Our results offer initial evidence for spatial and temporal principles underlying tactile search behavior over the body.

Перспективы использования задач зрительного поиска в современной когнитивной психологии

The article describes the main results of modern foreign studies with modifications of classical visual search tasks, as well as proposed classification of such modifications. The essence of visual search is to find target stimuli among the distracters, and the standard task involves finding one target stimulus, which is usually a simple object. Modifications to the standard task may include the presence of more than one target on the screen, the search for more than one type of target, and options that combine both of these modifications. Proposed modifications of the standard task allow not only to study new aspects of visual attention, but also to approach real-life tasks within laboratory studies.

Does Threat Have an Advantage After All? - Proposing a Novel Experimental Design to Investigate the Advantages of Threat-Relevant Cues in Visual Processing.

The automatic visual attentional procession of threatening stimuli over non-threatening cues has long been a question. The so-called classical visual search task (VST) has quickly become the go-to paradigm to investigate this. However, the latest results showed that the confounding results could originate from the shortcomings of the VST. Thus, here we propose a novel approach to the behavioral testing of the threat superiority effect. We conducted two experiments using evolutionary relevant and modern real-life scenes (e.g., forest or street, respectively) as a background to improve ecological validity. Participants had to find different targets in different spatial positions (close to fovea or periphery) using a touch-screen monitor. In Experiment 1 participants had to find the two most often used exemplar of the evolutionary and modern threatening categories (snake and gun, respectively), or neutral objects of the same category. In Experiment 2 we used more exemplars of each category. All images used were controlled for possible confounding low-level visual features such as contrast, frequency, brightness, and image complexity. In Experiment 1, threatening targets were found faster compared to neutral cues irrespective of the evolutionary relevance. However, in Experiment 2, we did not find an advantage for threatening targets over neutral ones. In contrast, the type of background, and spatial position of the target only affected the detection of neutral targets. Our results might indicate that some stimuli indeed have an advantage in visual processing, however, they are not highlighted based on evolutionary relevance of negative valence alone, but rather through different associational mechanisms.

Tablet computer games to measure dorsal stream performance in good and poor readers

Evidence suggests a link between deficits in visuo-spatial attention, and subsequent reading ability. However, all the research in the area thus far has been conducted using traditional, lab-based psychophysics, with very tightly controlled visual parameters. In order to take this research further, such as using visuo-spatial tasks for remediation purposes, it must be established that such tasks can be taken out of the laboratory, ‘gamified’, and still predict reading ability. This study aimed to determine if subtle visual deficits in poor readers could be detected outside a traditional laboratory, in relatively uncontrolled settings using portable game-like technology. Classic visual search and change detection programs, thought to rely on the visual dorsal stream, were modified to a game-like format. They were administered on a portable computer tablet within the participants’ school setting. Whilst IQ predicted reading rate, visuo-spatial tasks such as visual search speed, and change detection, each accounted for unique variance in reading rate over and above IQ, age and phonological ability. These results are consistent with the visuo–spatial attention deficit hypothesis, and provide support for the development of portable computerised games that may assess and potentially target this deficit in poor readers.

The effect of mood state on visual search times for detecting a target in noise: An application of smartphone technology.

The study of visual perception has largely been completed without regard to the influence that an individual’s emotional status may have on their performance in visual tasks. However, there is a growing body of evidence to suggest that mood may affect not only creative abilities and interpersonal skills but also the capacity to perform low-level cognitive tasks. Here, we sought to determine whether rudimentary visual search processes are similarly affected by emotion. Specifically, we examined whether an individual’s perceived happiness level affects their ability to detect a target in noise. To do so, we employed pop-out and serial visual search paradigms, implemented using a novel smartphone application that allowed search times and self-rated levels of happiness to be recorded throughout each twenty-four-hour period for two weeks. This experience sampling protocol circumvented the need to alter mood artificially with laboratory-based induction methods. Using our smartphone application, we were able to replicate the classic visual search findings, whereby pop-out search times remained largely unaffected by the number of distractors whereas serial search times increased with increasing number of distractors. While pop-out search times were unaffected by happiness level, serial search times with the maximum numbers of distractors (n = 30) were significantly faster for high happiness levels than low happiness levels (p = 0.02). Our results demonstrate the utility of smartphone applications in assessing ecologically valid measures of human visual performance. We discuss the significance of our findings for the assessment of basic visual functions using search time measures, and for our ability to search effectively for targets in real world settings.

Attentional selection predicts rapid automatized naming ability in Chinese-speaking children with ADHD

Children with attention-deficit/hyperactivity disorder (ADHD) are reported to have a significantly higher risk of showing reading difficulties or disorders. Here, we aimed to identify the relationship between electroencephalographic (EEG) marker of spatial attention and reading ability in Chinese children with ADHD. First, we demonstrated that rapid automatized naming (RAN) is a strong predictor of reading ability in Chinese-speaking children. Then, EEG data of 9-to 15-year-old children with ADHD (n = 38) and typically developing (TD) controls (n = 36) were collected while the children performed a classical visual search task. Children with ADHD showed slower RAN speed than TD children. For event-related potentials (ERPs), children with ADHD showed a reduced target-evoked N2pc component, which predicted their poorer RAN performance. However, in TD children the early occipital P1 amplitude was negatively correlated with their RAN performance. The correlation between decreased N2pc and poor RAN performance in children with ADHD suggests that their reading problems may in part be due to impaired attentional selection. In contrast, in TD children, development in early visual processing co-occurs with improvements in reading ability.

Right away: A late, right-lateralized category effect complements an early, left-lateralized category effect in visual search.

According to the Sapir-Whorf hypothesis, learned semantic categories can influence early perceptual processes. A central finding in support of this view is the lateralized category effect-namely, the finding that categorically different colors (e.g., blue and green hues) can be discriminated faster than colors within the same color category (e.g., different hues of green), especially when they are presented in the right visual field. Because the right visual field projects to the left hemisphere, this finding has been popularly couched in terms of the left-lateralization of language. However, other studies have reported bilateral category effects, which has led some researchers to question the linguistic origins of the effect. Here we examined the time course of lateralized and bilateral category effects in the classical visual search paradigm by means of eyetracking and RT distribution analyses. Our results show a bilateral category effect in the manual responses, which is combined of an early, left-lateralized category effect and a later, right-lateralized category effect. The newly discovered late, right-lateralized category effect occurred only when observers had difficulty locating the target, indicating a specialization of the right hemisphere to find categorically different targets after an initial error. The finding that early and late stages of visual search show different lateralized category effects can explain a wide range of previously discrepant findings.

Evolving the stimulus to fit the brain: a genetic algorithm reveals the brain's feature priorities in visual search.

How does the brain find objects in cluttered visual environments? For decades researchers have employed the classic visual search paradigm to answer this question using factorial designs. Although such approaches have yielded important information, they represent only a tiny fraction of the possible parametric space. Here we use a novel approach, by using a genetic algorithm (GA) to discover the way the brain solves visual search in complex environments, free from experimenter bias. Participants searched a series of complex displays, and those supporting fastest search were selected to reproduce (survival of the fittest). Their display properties (genes) were crossed and combined to create a new generation of "evolved" displays. Displays evolved quickly over generations towards a stable, efficiently searched array. Color properties evolved first, followed by orientation. The evolved displays also contained spatial patterns suggesting a coarse-to-fine search strategy. We argue that this behavioral performance-driven GA reveals the way the brain selects information during visual search in complex environments. We anticipate that our approach can be adapted to a variety of sensory and cognitive questions that have proven too intractable for factorial designs.

Selective manipulation of target identification demands in visual search: The role of stimulus contrast in CDA activations

In classic visual pop-out search, response times are slowed remarkably when participants are required to precisely identify (e.g., vertical vs. horizontal orientation) as compared to simply localize (e.g., left vs. right position) a feature singleton target. This cost associated with stimulus identification has been recently proposed (Töllner, Rangelov, & Müller, 2012) to derive from the engagement of postselective recurrent processes that via feedback connections extract the information required for motor-response selection. Here, we examined whether the contralateral delay activity (CDA), an asymmetric neural marker generally assumed to reflect active maintenance of stimulus information in visual short-term memory (vSTM), may further index the degree of postselective processing requirements in visual search. Employing a compound-search task, we selectively manipulated the ease/difficulty of identifying the response-critical target orientation attribute (horizontal vs. vertical)--irrespective of the target-defining color feature (red vs. green)--by introducing different levels of stimulus-background contrast. As expected, we found a monotonic reaction time increase to be associated with gradually increasing CDA magnitudes as the stimulus contrast decreased. Thus, our findings provide direct evidence that CDA activations provide a useful tool to estimate the amount of postselective recurrent processing recruited to extract detailed object information from vSTM.

Playing shooter and driving videogames improves top-down guidance in visual search

Playing action videogames is known to improve visual spatial attention and related skills. Here, we showed that playing action videogames also improves classic visual search, as well as the ability to locate targets in a dual search that mimics certain aspects of an action videogame. In Experiment 1A, first-person shooter (FPS) videogame players were faster than nonplayers in both feature search and conjunction search, and in Experiment 1B, they were faster and more accurate in a peripheral search and identification task while simultaneously performing a central search. In Experiment 2, we showed that 10 h of play could improve the performance of nonplayers on each of these tasks. Three different genres of videogames were used for training: two action games and a 3-D puzzle game. Participants who played an action game (either an FPS or a driving game) achieved greater gains on all search tasks than did those who trained using the puzzle game. Feature searches were faster after playing an action videogame, suggesting that players developed a better target template to guide search in a top-down manner. The results of the dual search suggest that, in addition to enhancing the ability to divide attention, playing an action game improves the top-down guidance of attention to possible target locations. The results have practical implications for the development of training tools to improve perceptual and cognitive skills.

Is Sternberg’s Memory Scanning Task Really a Short-Term Memory Task?

Sternberg’s paradigm is currently viewed as a typical short-term memory task and is widely used to tap mnemonic capacities in neuroscience studies. However, Sternberg’s original procedure includes an experimental constraint – recalling the sequence of digits in order – which was not reused in the following studies. In previous research ( Corbin & Marquer, 2008 , 2009 ), we showed that the recall constraint has an impact on the quantitative results as well as on the strategies implemented. These findings led us to wonder whether the presence or absence of this simple experimental constraint could also affect the processes implemented in Sternberg’s task. In order to answer this question, we analyzed the relationships between the performance levels of 50 participants on Sternberg’s task on various well-known span tasks and on a classical visual search task. The results showed that, in the recall condition, Sternberg’s paradigm appears to be a verbal working memory task, whereas in the no-recall condition, the task appears to be a recognition task that involves visuospatial memory capacities. In this latter condition, the processes implemented may be more similar to those implemented in visual search tasks.

VISUAL SEARCH AND ATTENTION IN BUMBLEBEES

VISUAL SEARCH AND ATTENTION IN BUMBLEBEES