Search Array Research Articles

Learning to suppress a location is configuration-dependent.

Where and what we attend is very much determined by what we have encountered in the past. Recent studies have shown that people learn to extract statistical regularities in the environment resulting in attentional suppression of locations that were likely to contain a distractor, effectively reducing the amount of attentional capture. Here, we asked whether this suppression effect due to statistical learning is dependent on the specific configuration within which it was learned.The current study employed the additional singleton paradigm using search arrays that had a configuration consisting of set sizes of either four or 10 items. Each configuration contained its own high probability distractor location. If learning would generalize across set size configurations, both high probability locations would be suppressed equally, regardless of set size. However, if learning to suppress is dependent on the configuration within which it was learned, one would expect only suppression of the high probability location that matched the configuration within which it was learned. The results show the latter, suggesting that implicitly learned suppression is configuration-dependent. Thus, we conclude that the high probability location is learned within the configuration context within which it is presented.

Deep Learning Optimisation of Static Malware Detection with Grid Search and Covering Arrays

This paper investigates the impact of several hyperparameters on static malware detection using deep learning, including the number of epochs, batch size, number of layers and neurons, optimisation method, dropout rate, type of activation function, and learning rate. We employed the cAgen tool and grid search optimisation from the scikit-learn Python library to identify the best hyperparameters for our Keras deep learning model. Our experiments reveal that cAgen is more efficient than grid search in finding the optimal parameters, and we find that the selection of hyperparameter values has a significant impact on the model’s accuracy. Specifically, our approach leads to significant improvements in the neural network model’s accuracy for static malware detection on the Ember dataset (from 81.2% to 95.7%) and the Kaggle dataset (from 94% to 98.6%). These results demonstrate the effectiveness of our proposed approach, and have important implications for the field of static malware detection.

Statistical Learning of Distractor Suppression Downregulates Prestimulus Neural Excitability in Early Visual Cortex.

Visual attention is highly influenced by past experiences. Recent behavioral research has shown that expectations about the spatial location of distractors within a search array are implicitly learned, with expected distractors becoming less interfering. Little is known about the neural mechanism supporting this form of statistical learning. Here, we used magnetoencephalography (MEG) to measure human brain activity to test whether proactive mechanisms are involved in the statistical learning of distractor locations. Specifically, we used a new technique called rapid invisible frequency tagging (RIFT) to assess neural excitability in early visual cortex during statistical learning of distractor suppression while concurrently investigating the modulation of posterior alpha band activity (8-12 Hz). Male and female human participants performed a visual search task in which a target was occasionally presented alongside a color-singleton distractor. Unbeknown to the participants, the distracting stimuli were presented with different probabilities across the two hemifields. RIFT analysis showed that early visual cortex exhibited reduced neural excitability in the prestimulus interval at retinotopic locations associated with higher distractor probabilities. In contrast, we did not find any evidence of expectation-driven distractor suppression in alpha band activity. These findings indicate that proactive mechanisms of attention are involved in predictive distractor suppression and that these mechanisms are associated with altered neural excitability in early visual cortex. Moreover, our findings indicate that RIFT and alpha band activity might subtend different and possibly independent attentional mechanisms.SIGNIFICANCE STATEMENT What we experienced in the past affects how we perceive the external world in the future. For example, an annoying flashing light might be better ignored if we know in advance where it usually appears. This ability of extracting regularities from the environment is called statistical learning. In this study, we explore the neuronal mechanisms allowing the attentional system to overlook items that are unequivocally distracting based on their spatial distribution. By recording brain activity using MEG while probing neural excitability with a novel technique called RIFT, we show that the neuronal excitability in early visual cortex is reduced in advance of stimulus presentation for locations where distracting items are more likely to occur.

Assessing the allocation of attention during visual search using digit-tracking, a calibration-free alternative to eye tracking

Digit-tracking, a simple, calibration-free technique, has proven to be a good alternative to eye tracking in vision science. Participants view stimuli superimposed by Gaussian blur on a touchscreen interface and slide a finger across the display to locally sharpen an area the size of the foveal region just at the finger's position. Finger movements are recorded as an indicator of eye movements and attentional focus. Because of its simplicity and portability, this system has many potential applications in basic and applied research. Here we used digit-tracking to investigate visual search and replicated several known effects observed using different types of search arrays. Exploration patterns measured with digit-tracking during visual search of natural scenes were comparable to those previously reported for eye-tracking and constrained by similar saliency. Therefore, our results provide further evidence for the validity and relevance of digit-tracking for basic and applied research on vision and attention.

Caregiver faces capture 6- to 10-year-old children's attention during an online visual search task.

Developing attention skills allow children to parse their complex world by orienting to a subset of especially salient or meaningful inputs. Infants and children are biased to orient to faces and have difficulty ignoring faces when they appear as distractors. Although these past findings suggest that faces are more salient than nonsocial stimuli, it is unclear whether specific types of faces capture attention to a greater extent than others. Caregiver faces are one of the most prevalent and socially motivating stimuli in infants' and children's environments, suggesting that they may be biased to orient to caregiver faces to a greater extent than faces in general. Forty-six 6- to 10-year-old children across the United States and Canada completed an online attention capture task in which participants searched for a target within arrays containing multiple distractors. During some trials, either a stranger or the child's caregiver's face appeared as one of the distractors. Children showed consistently poorer performance (i.e., increased omission errors, poorer accuracy, and slower response times) when the caregiver face appeared as a distractor, especially during trials in which the target was present and within larger search arrays. These increased performance costs indicate an enhanced orienting bias to caregiver faces, which may reflect increased motivational salience of these faces. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

The effects of search-irrelevant working memory content on visual search.

Previous experiments investigating visual search have shown that distractors that are semantically related to a search target can capture attention and slow the search process. In two experiments, we examine if distractors exactly matching, or semantically related to, search-irrelevant information held in working memory (WM) can also influence visual search while ruling out potential effects of color similarity. Participants first viewed and memorized an image of an everyday object, then they determined if a target item was present or absent in a two-object search array. On exact-match trials, the memorized object appeared as a distractor; on semantic-match trials, an object semantically related to the memorized object appeared as a distractor. Both exact-match and semantic-match distractors slowed search when the target was present in the search array. Our findings extend previous findings by demonstrating WM-driven attentional guidance by complex objects rather than simple features. The results also suggest that visual search can be influenced by distractors sharing only semantic features with a search-irrelevant, but active, WM representation.

Role of Social Gaze on Visual Search in an Eye-Tracking Paradigm

Gaze cueing refers to the natural inclination to direct one’s gaze in the direction of another’s gaze. This can be used in visual search tasks to facilitate or interfere with the search. Here, we examined the interaction between 3 gaze cue conditions (congruent, incongruent, and neutral) and a search task using letter arrays. Congruent cues had a gaze cue looking at the target, incongruent cues had a gaze cue looking away from the target, and neutral cues had a gaze cue looking straight ahead. An eye tracker was used to measure search task completion times (CTs). For all conditions, participants fixated on a target stimulus in the middle of the screen to begin the trial. The target disappeared. Then the gaze cue appeared, followed by the search array. Participants then had to locate the target. We expected CTs to be shortest for congruent cues and longest for incongruent cues, with neutral cues somewhere in the middle. Trials were randomized between our 3 conditions. A 1-way ANOVA found a significant impact of gaze cueing on this search task, F(2) = 10.15, p < .001, ηp2 = .28. Pairwise comparisons found significant differences between congruent and incongruent conditions, p < .001, and between neutral and congruent conditions, p = .006. Together, these results supported our hypothesis; congruent gaze cueing facilitated visual search whereas incongruent gaze and neutral gaze failed to assist visual search. These findings provide a firmer understanding of the interactions between gaze cueing and visual search paradigms.

Efficiency of a Visual Search Explained by the Small-World Features of a Gaze Position Network

A visual search is implemented when the eye moves to find a target symbol amongst many other symbols (distractors). The efficiency of a visual search is described by Hick's law, which shows that the search time increases logarithmically as the number of symbols increases. In this paper, the efficiency of visual search was analyzed from the perspective of the network features of a conceptual ‘unobservable’ gaze position network superimposed on a monitor screen filled with many symbols (search array board). We assume that the gaze position does not move freely around the search array board, but rather moves in a way restricted to the unobservable gaze position network. First, we statistically verified that the artificial gaze position network designed from the data of visual search experiments have small-world features, and depends on the ratio of the saccades. Second, by implementing gaze step simulations on such small-world networks, we statistically verified that the simulation search times were close to those obtained from the experiments and also to the minimum search times. Thus, this study suggests that an efficient visual search can be explained by a small-world architecture hidden in the unobservable gaze position network and thus has to be artificially designed.

The Rejection Template of Working Memory Operates after Attention Capture.

Although scientists know that information stored in working memory guides visual attention, how this is accomplished is still under debate. Specifically, there is a dispute between the Biased Competition Model and Visual Attention Theory. The current study used two experiments to resolve this controversy based on previous research. Experiment 1 found that although inverse efficiency scores for High and Low numbers of memory distractors were both longer than the Baseline (no memory distractors), they did not significantly differ from each other. This indicated that memory might guide attention via a capture-then-global-inhibition process. Experiment 2 addressed the possibility that the findings resulted from the time needed to reject the interfering objects by requiring both memory-matching and memory-mismatching conditions to be rejected under a highlighted target. This result showed that the memory-matching condition resulted in longer search times than the memory-mismatching condition, indicating an attention-capture effect based on working memory. Together, the two experiments support the idea that when multiple memory-matching distractors in a search array first capture an individual's attention, it then acts as a template that allows the individual to suppress all interfering items that containing memory information holds. This study supports the Biased Competition Model early on in visual search. However, the late stage of visual search supports the Visual Attention Theory. These advance our knowledge regarding the relationship between working memory content and attention.

Salience by competitive and recurrent interactions: Bridging neural spiking and computation in visual attention.

Decisions about where to move the eyes depend on neurons in frontal eye field (FEF). Movement neurons in FEF accumulate salience evidence derived from FEF visual neurons to select the location of a saccade target among distractors. How visual neurons achieve this salience representation is unknown. We present a neuro-computational model of target selection called salience by competitive and recurrent interactions (SCRI), based on the competitive interaction model of attentional selection and decision-making (Smith & Sewell, 2013). SCRI selects targets by synthesizing localization and identification information to yield a dynamically evolving representation of salience across the visual field. SCRI accounts for neural spiking of individual FEF visual neurons, explaining idiosyncratic differences in neural dynamics with specific parameters. Many visual neurons resolve the competition between search items through feedforward inhibition between signals representing different search items, some also require lateral inhibition, and many act as recurrent gates to modulate the incoming flow of information about stimulus identity. SCRI was tested further by using simulated spiking representations of visual salience as input to the gated accumulator model of FEF movement neurons (Purcell et al., 2010, 2012). Predicted saccade response times fit those observed for search arrays of different set sizes and different target-distractor similarities, and accumulator trajectories replicated movement neuron discharge rates. These findings offer new insights into visual decision-making through converging neuro-computational constraints and provide a novel computational account of the diversity of FEF visual neurons. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Visual search as an embodied process: The effects of perspective change and external reference on search performance.

Traditional visual search tasks in the laboratories typically involve looking for targets in 2D displays with exemplar views of objects. In real life, visual search commonly entails 3D objects in 3D spaces with nonperpendicular viewing and relative motions between observers and search array items, both of which lead to transformations of objects’ projected images in lawful but unpredicted ways. Furthermore, observers often do not have to memorize a target before searching, but may refer to it while searching, for example, holding a picture of someone while looking for them from a crowd. Extending the traditional visual search task, in this study, we investigated the effects of image transformation as a result of perspective change yielded by discrete viewing angle change (Experiment 1) or continuous rotation of the search array (Experiment 2) and of having external references on visual search performance. Results showed that when searching from 3D objects with a non-zero viewing angle, performance was similar to searching from 2D exemplar views of objects; when searching for 3D targets from rotating arrays in virtual reality, performance was similar to searching from stationary arrays. In general, discrete or continuous perspective change did not affect the search outcomes in terms of accuracy, response time, and self-rated confidence, or the search process in terms of eye movement patterns. Therefore, visual search does not require the exact match of retinal images. Additionally, being able to see the target during the search improved search accuracy and observers’ confidence. It increased search time because, as revealed by the eye movements, observers actively checked back on the reference target. Thus, visual search is an embodied process that involves real-time information exchange between the observers and the environment.

Searching on the Back: Attentional Selectivity in the Periphery of the Tactile Field

Recent evidence has identified the N140cc lateralized component of event-related potentials as a reliable index of the deployment of attention to task-relevant items in touch. However, existing ERP studies have presented the tactile search array to participants' limbs, most often to the hands. Here, we investigated distractor interference effects when the tactile search array was presented to a portion of the body that is less lateralized and peripheral compared to the hands. Participants were asked to localize a tactile target presented among distractors in a circular arrangement to their back. The N140cc was elicited contralateral to the target when the singleton distractor was absent. Its amplitude was reduced when the singleton distractor was present and contralateral to the target, suggesting that attention was directed at least in part to the distractor when the singletons are on opposite sides. However, similar N140cc were observed when the singleton distractor was ipsilateral to the target compared to distractor absent trials. We suggest that when target and singleton distractor are ipsilateral, the exact localization of the target requires the attentional processing of all items on the same side of the array, similar to distractor absent trials. Together, these observations replicate the distractor interference effects previously observed for the hands, suggesting that analogous mechanisms guide attentional selectivity across different body parts.

Visual search habits and the spatial structure of scenes

Some spatial layouts may suit our visual search habits better than others. We compared eye movements during search across three spatial configurations. Participants searched for a line segment oriented 45∘ to the right. Variation in the orientation of distractor line segments determines the extent to which this target would be visible in peripheral vision: a target among homogeneous distractors is highly visible, while a target among heterogeneous distractors requires central vision. When the search array is split into homogeneous and heterogeneous left and right halves, a large proportion of fixations are “wasted” on the homogeneous half, leading to slower search times. We compared this pattern to two new configurations. In the first, the array was split into upper and lower halves. During a passive viewing baseline condition, we observed biases to look both at the top half and also at the hetergeneous region first. Both of these biases were weaker during active search, despite the fact that the heterogeneous bias would have led to improvements in efficiency if it had been retained. In the second experiment, patches of more or less heterogeneous line segments were scattered across the search space. This configuration allows for more natural, spatially distributed scanpaths. Participants were more efficient and less variable relative to the left/right configuration. The results are consistent with the idea that visual search is associated with a distributed sequence of fixations, guided only loosely by the potential visibility of the target in different regions of the scene.

Between the Scenes.

We constantly move our eyes to new information while inspecting a scene, but these patterns of eye movements change based on the task and goals of the observer. Inhibition of return (IOR) may facilitate visual search by reducing the likelihood of revisiting previously attended locations. However, IOR may present in any visual task, or it may be search-specific. We investigated the presence of IOR in foraging, memorization, change detection, and two versions of visual search. One version of search used a static search array that remained stable throughout the trial, but the second used a scene flickering paradigm similar to the change detection task. IOR was observed in both versions of visual search, memorization, and foraging, but not in change detection. Visual search and change detection both had temporal nonscene components, and we observed that IOR could be maintained despite the scene removal but only for search. Although IOR is maintained in scene coordinates, short disruptions to this scene are insufficient to completely remove the inhibitory tags. Finally, we compare return saccades in trials without a probe and observe fewer return saccades in tasks for which IOR was observed, providing further evidence that IOR might serve as a novelty drive.

Top-down control of attention by stereoscopic depth

Stereoscopic depth has a mixed record as a guiding attribute in visual attention. Visual search can be efficient if the target lies at a unique depth; whereas automatic segmentation of search arrays into different depth planes does not appear to be pre-attentive. These prior findings describe bottom-up, stimulus-driven depth guidance. Here, we ask about the top-down selection of depth information. To assess the ability to direct attention to specific depth planes, Experiment 1 used the centroid judgment paradigm which permits quantitative measures of selective processing of items of different depths or colors. Experiment 1 showed that a subset of observers could deploy specific attention filters for each of eight depth planes, suggesting that at least some observers can direct attention to a specific depth plane quite precisely. Experiment 2 used eight depth planes in a visual search experiment. Observers were encouraged to guide their attention to far or near depth planes with an informative but imperfect cue. The benefits of this probabilistic cue were small. However, this may not be a specific problem with guidance by stereoscopic depth. Equivalently poor results were obtained with color. To check and prove that depth guidance in search is possible, Experiment 3 presented items in only two depth planes. In this case, information about the target depth plane allows observers to search more efficiently, replicating earlier work. We conclude that top-down guidance by stereoscopic depth is possible but that it is hard to apply the full range of our stereoscopic ability in search.

Contextual cueing in co-active visual search: Joint action allows acquisition of task-irrelevant context.

Repeatedly presenting a target within a stable search array facilitates visual search, an effect termed contextual cueing. Previous solo-performance studies have shown that successful acquisition of contextual memories requires explicit allocation of attentional resources to the task-relevant repeated contexts. By contrast, repeated but task-irrelevant contexts could not be learned when presented together with repeated task-relevant contexts due to a blocking effect. Here we investigated if such blocking of context learning could be diminished in a social context, when the task-irrelevant context is task-relevant for a co-actor in a joint action search mode. We adopted the contextual cueing paradigm and extended this to the co-active search mode. Participants learned a context-cued subset of the search displays (color-defined) in the training phase, and their search performance was tested in the transfer phase, where previously irrelevant and relevant subsets were swapped. The experiments were conducted either in a solo search mode (Experiments 1 and 3) or in a co-active search mode (Experiment 2). Consistent with the classical contextual cueing studies, contextual cueing was observed in the training phase of all three experiments. Importantly, however, in the "swapped" test session, a significant contextual cueing effect was manifested only in the co-active search mode, not in the solo search mode. Our findings suggest that social context may widen the scope of attention, thus facilitating the acquisition of task-irrelevant contexts.

A bilateral SPCN is elicited by to-be-memorized visual stimuli displayed along the vertical midline.

We recently showed that deploying attention to target stimuli displayed along the vertical meridian elicits a bilateral N2pc, that we labeled N2pcb (Psychophysiology). Here we investigated whether a different component, the sustained posterior contralateral negativity (SPCN), shows the same property when a varying number of visual stimuli are displayed either laterally or on the vertical meridian. We displayed one or two cues that designated candidate targets to be detected in a search array that was displayed after a retention interval. The cues were either on the horizontal meridian or on the vertical meridian. When the cues were on the horizontal meridian, we observed an N2pc followed by an SPCN in their classic form, as negativity increments contralateral to the cues. As expected, SPCN amplitude was greater when two cues had to be memorized than when only one cue had to be memorized. When the cues were on the vertical meridian, we observed an N2pcb followed by a bilateral SPCN (or SPCNb). Critically, like SPCN, SPCNb amplitude was greater when two cues had to be memorized than when only one cue had to be memorized. A series of additional parametrical and topographical comparisons between N2pcb and SPCNb revealed similarities but also some important differences between these two components that we interpreted as evidence for their distinct neural sources.

Auditory enhancement of visual searches for event scenes.

Increasing research has revealed that uninformative spatial sounds facilitate the early processing of visual stimuli. This study examined the crossmodal interactions of semantically congruent stimuli by assessing whether the presentation of event-related characteristic sounds facilitated or interfered with the visual search for corresponding event scenes in pictures. The search array consisted of four images: one target and three non-target pictures. Auditory stimuli were presented to participants in synchronization with picture onset using three types of sounds: a sound congruent with a target, a sound congruent with a distractor, or a control sound. The control sound varied across six experiments, alternating between a sound unrelated to the search stimuli, white noise, and no sound. Participants were required to swiftly localize a target position while ignoring the sound presentation. Visual localization resulted in rapid responses when a sound that was semantically related to the target was played. Furthermore, when a sound was semantically related to a distractor picture, the response times were longer. When the distractor-congruent sound was used, participants incorrectly localized the distractor position more often than at the chance level. These findings were replicated when the experiments ruled out the possibility that participants would learn picture-sound pairs during the visual tasks (i.e., the possibility of brief training during the experiments). Overall, event-related crossmodal interactions occur based on semantic representations, and audiovisual associations may develop as a result of long-term experiences rather than brief training in a laboratory.

Are all real-world objects created equal? Estimating the "set-size" of the search target in visual working memory.

Are all real-world objects created equal? Visual search difficulty increases with the number of targets and as target-related visual working memory (VWM) load increases. Our goal was to investigate the load imposed by individual real-world objects held in VWM in the context of search. Measures of visual clutter attempt to quantify real-world set-size in the context of scenes. We applied one of these measures, the number of proto-objects, to individual real-world objects and used contralateral delay activity (CDA) to measure the resulting VWM load. The current study presented a real-world object as a target cue, followed by a delay where CDA was measured. This was followed by a four-object search array. We compared CDA and later search performance from target cues containing a high or low number of proto-objects. High proto-object target cues resulted in greater CDA, longer search RTs, target dwell times, and reduced search guidance, relative to low proto-object targets. These findings demonstrate that targets with more proto-objects result in a higher VWM load and reduced search performance. This shows that the number of proto-objects contained within individual objects produce set-size like effects in VWM and suggests proto-objects may be a viable unit of measure of real-world VWM load. Importantly, this demonstrates that not all real-world objects are created equal.

The Functional Visual Field(s) in simple visual search

During a visual search for a target among distractors, observers do not fixate every location in the search array. Rather processing is thought to occur within a Functional Visual Field (FVF) surrounding each fixation. We argue that there are three questions that can be asked at each fixation and that these imply three different senses of the FVF. 1) Can I identify what is at location XY? This defines a resolution FVF. 2) To what shall I attend during this fixation? This defines an Attentional FVF. 3) Where should I fixate next? This defines an Exploratory FVF. We examine FVFs 2&3 using eye movements in visual search. In three Experiments, we collected eye movements during visual search for the target letter T among distractor letter Ls (Exps 1 and 3) or for a color X orientation conjunction (Exp 2). Saccades that do not go to the target can be used to define the Exploratory FVF. The saccade that goes to the target can be used to define the Attentional FVF since the target was probably covertly detected during the prior fixation. The Exploratory FVF is larger than the Attentional FVF for all three experiments. Interestingly, the probability that the next saccade would go to the target was always well below 1.0, even when the current fixation was close to the target and well within any reasonable estimate of the FVF. Measuring search-based Exploratory and Attentional FVFs sheds light on how we can miss clearly visible targets.