Mechanisms Of Selective Attention Research Articles

Fault diagnosis of driving gear in battery swapping system based on auditory bionics

Rack and pinion drives (RPD) are widely used in battery swapping system (BSS) for electric heavy trucks (EHT), and due to the continuous heavy-load and high-intensity operation, along with the electric erosion, the gears in the RPD are always damaged, which causes unexpected consequences such as downtime or safety incidents. The working conditions of the RPD in BSS include uncertain noises, fluctuant and low speed, which pose steep challenges to accurate fault diagnosis. Considering the auditory resistance of interference, the low-frequency sensitivity of auditory perception, and the auditory saliency mechanism, to leverage the advantages of auditory perceptual mechanism in addressing the above challenges, as the contribution in artificial intelligence, we propose an entire vibration signal processing scheme based on auditory bionics, including some mathematical models for auditory mechanisms. For the application in engineering, the proposed scheme is employed for fault diagnosis of RPD in BSS in unique working conditions. First, adaptive resampling is used to smooth the speed fluctuation, then, Gammatone filters are employed to transform vibration signals to cochleograms, after that, based on auditory stream segregation and selective attention mechanisms, effective frequency channels and salient features are extracted from the cochleograms, besides, to improve the diagnosis accuracy, binaural features are also extracted, finally, based on (sectional) sparse representation and fusion, fault diagnosis is achieved. The effectiveness of the fault diagnosis scheme is demonstrated using a BSS prototype system.

Complex trade-offs in a dual-target visual search task are indexed by lateralised ERP components

In everyday tasks, the choices we make incorporate complex trade-offs between conflicting factors that affect how we will achieve our goals. Previous experimental research has used dual-target visual search to determine how people flexibly adjust their behaviour and make choices that optimise their decisions. In this experiment, we leveraged a visual search task that incorporates complex trade-offs, and electroencephalography (EEG), to understand how neural mechanisms of selective attention contribute to choice behaviour in these tasks. On each trial, participants could choose to respond to the gap location on either of two possible targets. Each target was colour coded such that colour indicated which of the two had the easier gap discrimination. Orthogonally, we manipulated the set size of coloured distractors to modulate how efficiently each target could be found. As a result, optimised task performance required participants to trade-off conflicts between the ease of finding a target given the current set size, and the ease of making its associated gap discrimination. Our results confirm that participants are able to flexibly adjust their behaviour, and trade-off these two factors to maintain their response speed and accuracy. Additionally, the N2pc and SPCN components elicited by search displays could reliably predict the choice that participants would ultimately make on a given trial. These results suggest that initial attentional processes may help to determine the choice participants make, highlighting the central role that attention may play in optimising performance on complex tasks.

Spatial attention for human-centric visual understanding: An Information Bottleneck method

The selective visual attention mechanism in the Human Visual System (HVS) restricts the amount of information that reaches human visual awareness, allowing the brain to perceive high-fidelity natural scenes in real-time with limited computational cost. This selectivity acts as an “Information Bottleneck (IB)” that balances information compression and predictive accuracy. However, such information constraints are rarely explored in the attention mechanism for deep neural networks (DNNs). This paper introduces an IB-inspired spatial attention module for DNNs, which generates an attention map by minimizing the mutual information (MI) between the attentive content and the input while maximizing that between the attentive content and the output. We develop this IB-inspired attention mechanism based on a novel graphical model and explore various implementations of the framework. We show that our approach can yield attention maps that neatly highlight the regions of interest while suppressing the backgrounds, and are interpretable for the decision-making of the DNNs. To validate the effectiveness of the proposed IB-inspired attention mechanism, we apply it to various computer vision tasks including image classification, fine-grained recognition, cross-domain classification, semantic segmentation, and object detection. Extensive experiments demonstrate that it bootstraps standard DNN structures quantitatively and qualitatively for these tasks.

A comprehensive guide to content-based image retrieval algorithms with visualsift ensembling.

Content-based image retrieval (CBIR) systems are vital for managing the large volumes of data produced by medical imaging technologies. They enable efficient retrieval of relevant medical images from extensive databases, supporting clinical diagnosis, treatment planning, and medical research. This study aims to enhance CBIR systems' effectiveness in medical image analysis by introducing the VisualSift Ensembling Integration with Attention Mechanisms (VEIAM). VEIAM seeks to improve diagnostic accuracy and retrieval efficiency by integrating robust feature extraction with dynamic attention mechanisms. VEIAM combines Scale-Invariant Feature Transform (SIFT) with selective attention mechanisms to emphasize crucial regions within medical images dynamically. Implemented in Python, the model integrates seamlessly into existing medical image analysis workflows, providing a robust and accessible tool for clinicians and researchers. The proposed VEIAM model demonstrated an impressive accuracy of 97.34% in classifying and retrieving medical images. This performance indicates VEIAM's capability to discern subtle patterns and textures critical for accurate diagnostics. By merging SIFT-based feature extraction with attention processes, VEIAM offers a discriminatively powerful approach to medical image analysis. Its high accuracy and efficiency in retrieving relevant medical images make it a promising tool for enhancing diagnostic processes and supporting medical research in CBIR systems.

Attentional selection and communication through coherence: Scope and limitations.

Synchronous neural oscillations are strongly associated with a variety of perceptual, cognitive, and behavioural processes. It has been proposed that the role of the synchronous oscillations in these processes is to facilitate information transmission between brain areas, the 'communication through coherence,' or CTC hypothesis. The details of how this mechanism would work, however, and its causal status, are still unclear. Here we investigate computationally a proposed mechanism for selective attention that directly implicates the CTC as causal. The mechanism involves alpha band (about 10 Hz) oscillations, originating in the pulvinar nucleus of the thalamus, being sent to communicating cortical areas, organizing gamma (about 40 Hz) oscillations there, and thus facilitating phase coherence and communication between them. This is proposed to happen contingent on control signals sent from higher-level cortical areas to the thalamic reticular nucleus, which controls the alpha oscillations sent to cortex by the pulvinar. We studied the scope of this mechanism in parameter space, and limitations implied by this scope, using a computational implementation of our conceptual model. Our results indicate that, although the CTC-based mechanism can account for some effects of top-down and bottom-up attentional selection, its limitations indicate that an alternative mechanism, in which oscillatory coherence is caused by communication between brain areas rather than being a causal factor for it, might operate in addition to, or even instead of, the CTC mechanism.

Design of Adaptive Target Tracking Algorithm for Robots Based on Visual Attention Mechanism

Adaptive target tracking with visual attention represents a sophisticated approach to object detection and localization in dynamic environments. With principles inspired by human visual perception, this methodology employs mechanisms of selective attention to prioritize relevant visual information for tracking moving targets. By dynamically adjusting attentional focus based on salient visual cues and target motion characteristics, adaptive target tracking enhances the efficiency and accuracy of object localization in cluttered scenes. This research presents a novel adaptive target tracking algorithm designed for robotic systems, integrating a visual attention mechanism with the Fuzzy Clustering Multi-Point Tracking utilizing the Green Channel (FC-MPT-GC) approach. The proposed FC-MPT-GC model comprises of Fuzzy Clustering for the extraction of features in the robots-based environment. The FC-MPT-GC model uses the estimation of green channels in the classification environment. With the estimation of features in the environment with Fuzzy C-means clustering green channels are deployed in the deep learning, The proposed algorithm aims to enhance the adaptability and precision of target tracking in dynamic environments. By incorporating a visual attention mechanism, the algorithm dynamically allocates attentional focus to salient regions of the visual input, optimizing the tracking process for moving targets. The FC-MPT-GC methodology further refines target localization by utilizing fuzzy clustering and multi-point tracking strategies, particularly leveraging information from the Green Channel to improve robustness in various lighting conditions. Simulation analysis demonstrated that the proposed FC-MPT-GC model tracking accuracy is achieved at 95.1% with the minimal computation time of 15.2 ms.

SA-ConvNeXt: A Hybrid Approach for Flower Image Classification Using Selective Attention Mechanism

In response to the current lack of annotations for flower images and insufficient focus on key image features in traditional fine-grained flower image classification based on deep learning, this study proposes the SA-ConvNeXt flower image classification model. Initially, in the image preprocessing stage, a padding algorithm was used to prevent image deformation and loss of detail caused by scaling. Subsequently, the model was integrated using multi-level feature extraction within the Efficient Channel Attention (ECA) mechanism, forming an M-ECA structure to capture channel features at different levels; a pixel attention mechanism was also introduced to filter out irrelevant or noisy information in the images. Following this, a parameter-free attention module (SimAM) was introduced after deep convolution in the ConvNeXt Block to reweight the input features. SANet, which combines M-ECA and pixel attention mechanisms, was employed at the end of the module to further enhance the model’s dynamic extraction capability of channel and pixel features. Considering the model’s generalization capability, transfer learning was utilized to migrate the pretrained weights of ConvNeXt on the ImageNet dataset to the SA-ConvNeXt model. During training, the Focal Loss function and the Adam optimizer were used to address sample imbalance and reduce gradient fluctuations, thereby enhancing training stability. Finally, the Grad-CAM++ technique was used to generate heatmaps of classification predictions, facilitating the visualization of effective features and deepening the understanding of the model’s focus areas. Comparative experiments were conducted on the Oxford Flowers102 flower image dataset. Compared to existing flower image classification technologies, SA-ConvNeXt performed excellently, achieving a high accuracy of 96.7% and a recall rate of 98.2%, with improvements of 4.0% and 3.7%, respectively, compared to the original ConvNeXt. The results demonstrate that SA-ConvNeXt can effectively capture more accurate key features of flower images, providing an effective technical means for flower recognition and classification.

Interaction-and-Response Network for Distantly Supervised Relation Extraction.

Distantly supervised relation extraction (DSRE) aims to identify semantic relations from massive plain texts. A broad range of the prior research has leveraged a series of selective attention mechanisms over sentences in a bag to extract relation features without considering dependencies among the relation features. As a result, potential discriminative information existed in the dependencies is ignored, causing a decline in the performance of extracting entity relations. In this article, we focus on going beyond the selective attention mechanisms and propose a new framework termed interaction-and-response network (IR-Net) that adaptively recalibrates the features of sentence, bag, and group levels by explicitly modeling interdependencies among the features on each level. The IR-Net consists of a series of interactive and responsive modules throughout feature hierarchy, seeking to strengthen its power of learning salient discriminative features for distinguishing entity relations. We conduct extensive experiments on three benchmark DSRE datasets, including NYT-10, NYT-16, and Wiki-20m. The experimental results demonstrate that the IR-Net brings obvious improvements in performance when comparing ten state-of-the-art DSRE methods for entity relation extraction.

Implicit Selective Attention: The Role of the Mesencephalic-basal Ganglia System.

The ability of the brain to recognize and orient attention to relevant stimuli appearing in the visual field is highlighted by a tuning process, which involves modulating the early visual system by both cortical and subcortical brain areas. Selective attention is coordinated not only by the output of stimulus-based saliency maps but is also influenced by top-down cognitive factors, such as internal states, goals, or previous experiences. The basal ganglia system plays a key role in implicitly modulating the underlying mechanisms of selective attention, favouring the formation and maintenance of implicit sensory-motor memories that are capable of automatically modifying the output of priority maps in sensory-motor structures of the midbrain, such as the superior colliculus. The article presents an overview of the recent literature outlining the crucial contribution of several subcortical structures to the processing of different sources of salient stimuli. In detail, we will focus on how the mesencephalic- basal ganglia closed loops contribute to implicitly addressing and modulating selective attention to prioritized stimuli. We conclude by discussing implicit behavioural responses observed in clinical populations in which awareness is compromised at some level. Implicit (emergent) awareness in clinical conditions that can be accompanied by manifest anosognosic symptomatology (i.e., hemiplegia) or involving abnormal conscious processing of visual information (i.e., unilateral spatial neglect and blindsight) represents interesting neurocognitive "test cases" for inferences about mesencephalicbasal ganglia closed-loops involvement in the formation of implicit sensory-motor memories.

Prediction of drug–target binding affinity based on multi-scale feature fusion

Accurate prediction of drug–target binding affinity (DTA) plays a pivotal role in drug discovery and repositioning. Although deep learning methods are widely used in DTA prediction, two significant challenges persist: (i) how to effectively represent the complex structural information of proteins and drugs; (ii) how to precisely model the mutual interactions between protein binding sites and key drug substructures. To address these challenges, we propose a MSFFDTA (Multi-scale feature fusion for predicting drug target affinity) model, in which multi-scale encoders effectively capture multi-level structural information of drugs and proteins are designed. And then a Selective Cross Attention (SCA) mechanism is developed to filter out the trivial interactions between drug–protein substructure pairs and retain the important ones, which will make the proposed model better focusing on these key interactions and offering insights into their underlying mechanism. Experimental results on two benchmark datasets demonstrate that MSFFDTA is superior to several state-of-the-art methods across almost all comparison metrics. Finally, we provide the ablation and case studies with visualizations to verify the effectiveness and the interpretability of MSFFDTA. The source code is freely available at https://github.com/whitehat32/MSFF-DTA/.

Empowering Semantic Segmentation With Selective Frequency Enhancement and Attention Mechanism for Tampering Detection

Empowering Semantic Segmentation With Selective Frequency Enhancement and Attention Mechanism for Tampering Detection

An automated approach for predicting HAMD-17 scores via divergent selective focused multi-heads self-attention network

This study introduces the Divergent Selective Focused Multi-heads Self-Attention Network (DSFMANet), an innovative deep learning model devised to automatically predict Hamilton Depression Rating Scale-17 (HAMD-17) scores in patients with depression. This model introduces a multi-branch structure for sub-bands and artificially configures attention focus factors on various branches, resulting in distinct attention distributions for different sub-bands. Experimental results demonstrate that when DSFMANet processes sub-band data, its performance surpasses current benchmarks in key metrics such as mean square error (MSE), mean absolute error (MAE), root mean square error (RMSE), and coefficient of determination (R2). This success is particularly evident in terms of MSE and MAE, where the performance of sub-band data is significantly superior, highlighting the model's potential in accurately predicting HAMD-17 scores. Concurrently, the experiment also compared the model's performance with sub-band and full-band data, affirming the superiority of the selective focus attention mechanism in electroencephalography (EEG) signal processing. DSFMANet, when utilizing sub-band data, exhibits higher data processing efficiency and reduced model complexity. The findings of this study underscore the significance of employing deep learning models based on sub-band analysis in depression diagnosis. The DSFMANet model not only effectively enhances the accuracy of depression diagnosis but also offers valuable research directions for similar applications in the future. This deep learning-based automated approach can effectively ascertain the HAMD-17 scores of patients with depression, thus offering more accurate and reliable support for clinical decision-making.

Selective social interactions and speed-induced leadership in schooling fish

Animals moving together in groups are believed to interact among each other with effective social forces, such as attraction, repulsion, and alignment. Such forces can be inferred using "force maps," i.e., by analyzing the dependency of the acceleration of a focal individual on relevant variables. Here, we introduce a force map technique suitable for the analysis of the alignment forces experienced by individuals. After validating it using an agent-based model, we apply the force map to experimental data of schooling fish. We observe signatures of an effective alignment force with faster neighbors and an unexpected antialignment with slower neighbors. Instead of an explicit antialignment behavior, we suggest that the observed pattern is the result of a selective attention mechanism, where fish pay less attention to slower neighbors. This mechanism implies the existence of temporal leadership interactions based on relative speeds between neighbors. We present support for this hypothesis both from agent-based modeling as well as from exploring leader-follower relationships in the experimental data.

Generalized anxiety disorder and selective attention: An unsuccessful replication of Yiend et al., (2015) in a student population

ABSTRACT Generalized Anxiety Disorder (GAD) is an anxiety disorder that is believed to affect attention (Stein, M. B., & Sareen, J. (2015). Generalized anxiety disorder. New England Journal of Medicine, 373(21), 2059–2068. https://doi.org/10.1056/NEJMcp1502514; Yiend, J., Mathews, A., Burns, T., Dutton, K., Fernández-Martín, A., Georgiou, G. A., Luckie, M., Rose, A., Russo, R., & Fox, E. (2015). Mechanisms of selective attention in generalized anxiety disorder. Clinical Psychological Science, 3(5), 758–771. https://doi.org/10.1177/2167702614545216). Previous literature has found that selective attention is changed when someone perceives threatening stimuli, such as an angry face, and that those with anxiety disorders, may have a heightened or delayed response to threatening stimuli (Richards, H. J., Benson, V., Donnelly, N., & Hadwin, J. A. (2014). Exploring the function of selective attention and hypervigilance for threat in anxiety. Clinical Psychology Review, 34(1), 1–13. https://doi.org/10.1016/j.cpr.2013.10.006; Stevens, C., & Bavelier, D. (2012). The role of selective attention on academic foundations: A cognitive neuroscience perspective. Developmental Cognitive Neuroscience, 2, S30–S48. https://doi.org/10.1016/j.dcn.2011.11.001), which may alter how fast a presented task is completed (Yiend et al., 2015). The present study aimed to reproduce findings by Yiend et al. (2015), which identified an unexpected pattern in those with GAD: faster disengagement from angry faces compared to positive (happy, neutral) faces. The present study recruited a larger (nonclinical) sample from a student population to achieve greater statistical power. None of the findings reported by Yiend and colleagues (Experiment 1; 2015) were replicated in a student sample. The implications are discussed.

Gradual Residuals Alignment: A Dual-Stream Framework for GAN Inversion and Image Attribute Editing

GAN-based image attribute editing firstly leverages GAN Inversion to project real images into the latent space of GAN and then manipulates corresponding latent codes. Recent inversion methods mainly utilize additional high-bit features to improve image details preservation, as low-bit codes cannot faithfully reconstruct source images, leading to the loss of details. However, during editing, existing works fail to accurately complement the lost details and suffer from poor editability. The main reason is they inject all the lost details indiscriminately at one time, which inherently induces the position and quantity of details to overfit source images, resulting in inconsistent content and artifacts in edited images. This work argues that details should be gradually injected into both the reconstruction and editing process in a multi-stage coarse-to-fine manner for better detail preservation and high editability. Therefore, a novel dual-stream framework is proposed to accurately complement details at each stage. The Reconstruction Stream is employed to embed coarse-to-fine lost details into residual features and then adaptively add them to the GAN generator. In the Editing Stream, residual features are accurately aligned by our Selective Attention mechanism and then injected into the editing process in a multi-stage manner. Extensive experiments have shown the superiority of our framework in both reconstruction accuracy and editing quality compared with existing methods.

A novel feature-level fusion scheme with multimodal attention CNN for heart sound classification

Background and objectiveMost of the existing machine learning-based heart sound classification methods achieve limited accuracy. Since they primarily depend on single domain feature information and tend to focus equally on each part of the signal rather than employing a selective attention mechanism. In addition, they fail to exploit convolutional neural network (CNN) - based features with an effective fusion strategy. MethodsIn order to overcome these limitations, a novel multimodal attention convolutional neural network (MACNN) with a feature-level fusion strategy, in which Mel-cepstral domain as well as general frequency domain features are incorporated to increase the diversity of the features, is proposed in this paper. In the proposed method, DilationAttenNet is first utilized to construct attention-based CNN feature extractors and then these feature extractors are jointly optimized in MACNN at the feature-level. The attention mechanism aims to suppress irrelevant information and focus on crucial diverse features extracted from the CNN. ResultsExtensive experiments are carried out to study the efficacy of the feature level fusion in comparison to that with early fusion. The results show that the proposed MACNN method significantly outperforms the state-of-the-art approaches in terms of accuracy and score for the two publicly available Github and Physionet datasets. ConclusionThe findings of our experiments demonstrated the high performance for heart sound classification based on the proposed MACNN, and hence have potential clinical usefulness in the identification of heart diseases. This technique can assist cardiologists and researchers in the design and development of heart sound classification methods.

A mechanism for deviance detection and contextual routing in the thalamus: a review and theoretical proposal.

Predictive processing theories conceptualize neocortical feedback as conveying expectations and contextual attention signals derived from internal cortical models, playing an essential role in the perception and interpretation of sensory information. However, few predictive processing frameworks outline concrete mechanistic roles for the corticothalamic (CT) feedback from layer 6 (L6), despite the fact that the number of CT axons is an order of magnitude greater than that of feedforward thalamocortical (TC) axons. Here we review the functional architecture of CT circuits and propose a mechanism through which L6 could regulate thalamic firing modes (burst, tonic) to detect unexpected inputs. Using simulations in a model of a TC cell, we show how the CT feedback could support prediction-based input discrimination in TC cells by promoting burst firing. This type of CT control can enable the thalamic circuit to implement spatial and context selective attention mechanisms. The proposed mechanism generates specific experimentally testable hypotheses. We suggest that the L6 CT feedback allows the thalamus to detect deviance from predictions of internal cortical models, thereby supporting contextual attention and routing operations, a far more powerful role than traditionally assumed.

Phasic alerting in visual search tasks.

Many tasks require one to search for and find important objects in the visual environment. Visual search is strongly supported by cues indicating target objects to mechanisms of selective attention, which enable one to prioritise targets and ignore distractor objects. Besides selective attention, a major influence on performance across cognitive tasks is phasic alertness, a temporary increase of arousal induced by warning stimuli (alerting cues). Alerting cues provide no specific information on whose basis selective attention could be deployed, but have nevertheless been found to speed up perception and simple actions. It is still unclear, however, how alerting affects visual search. Therefore, in the present study, participants performed a visual search task with and without preceding visual alerting cues. Participants had to report the orientation of a target among several distractors. The target saliency was low in Experiment 1 and high in Experiment 2. In both experiments, we found that visual search was faster when a visual alerting cue was presented before the target display. Performance benefits occurred irrespective of how many distractors had been presented along with the target. Taken together, the findings reveal that visual alerting supports visual search independently of the complexity of the search process and the demands for selective attention.

Weakly Supervised Fixated Object Detection in Traffic Videos based on Driver’s Selective Attention Mechanism

Weakly Supervised Fixated Object Detection in Traffic Videos based on Driver’s Selective Attention Mechanism

FACIAL EMOTION RECOGNITION BASED ON SELECTIVE KERNEL NETWORK

Existing deep learning methods for facial emotion recognition only focus on optimizing network structures, utilizing fixed receptive fields for different images, and relying on feature extraction based on a single scale of receptive fields. However, this approach fails to fully capture the most critical facial regions. To address this limitation, this paper presents a novel technique for facial emotion recognition that employs a selective kernel network. The proposed method introduces a dedicated module called the selective kernel network, which is trained using transfer learning. This module incorporates various components, such as a selective attention mechanism and channel-wise independent feature extraction and fusion. These components allow for the extraction of feature information from key facial regions. Unlike other methods, the selective convolutional kernel network extracts features with multiple scales of receptive fields and adapts to different spatial positions using a multilayer perceptron. This adaptability enhances useful features and suppresses noise. After extracting the features, they are combined, and the classification outcome is computed using the softmax function. Experimental results demonstrate that the suggested approach achieves an accuracy of 88.4 and 92.1% on the RAF-DB and KDEF datasets, respectively. These results confirm the efficacy of the proposed technique in comprehensively capturing the most crucial facial regions. Moreover, compared to alternative methods, this technique exhibits superior accuracy and enhanced resilience.