Multi-level Features Research Articles

A method for named entity recognition in social media texts with syntactically enhanced multiscale feature fusion.

Social media data are characterized by significant noise and non-standardization, thereby posing challenges for existing methods in recognizing named entities owing to the entity sparsity and insufficient semantic richness. Thus, to deal with these issues, this study proposes SEMFF-NER, a named entity recognition (NER) method in social media texts that integrates multi-scale features and syntactic information. First, global features are extracted using a Transformer-based encoder (XLNET) with embedded dependency syntactic relations to enhance semantic representation. Next, sliding windows of different lengths capture local features, which are input into a bi-directional long short-term memory (BiLSTM) to capture multi-level local features. Subsequently, the fusion-attention mechanism effectively integrates global contextual information with multiple local features to predict the optimal entity labels. Extensive experiments conducted on three datasets collected from English social media platforms (WNUT2016, WNUT2017, OntoNotes5.0_English) demonstrate the advantageous performance of our proposed method, and ablation experiments further confirm the method's viability and effectiveness.

The association of limited or painful spinal range of motion with lumbar disc degeneration: the back complaints in older adults (BACE) study.

We currently lack clear definitions for structural and symptomatic spinal osteoarthritis (OA). To define spinal OA and create diagnostic criteria for this condition, it is necessary to determine the relationship between clinical signs and symptoms of back pain and radiographic features of OA. Notably, recent studies suggest a defining sign of spinal OA could be a limited or painful spinal range of motion (ROM). Therefore, our objective was to assess the association between restricted or painful active spinal ROM, and multilevel structural features of lumbar disc degeneration (LDD) (i.e., disc space narrowing, osteophytes) on radiographs. We used the baseline data from the'Back Complaints in Older Adults' (BACE) study. The association between a limited or painful active spinal ROM, and multilevel disc space narrowing or osteophytes was assessed using multivariable logistic regression adjusted for age, mean pain intensity in the previous week, sex, BMI, and the Fear Avoidance Belief Questionnaire score. Primary analyses were performed on imputed datasets. We included 675 patients with a mean age of 66.52years (SD 7.69). Limited latero-flexion (fingertip that at best reached halfway up the upper leg) was associated with increased odds of having multilevel osteophytes (OR 1.85; 95% CI: 1.13 to 3.01). However, a limited or painful ROM in other directions (i.e., rotation, ante-flexion) was not associated with multilevel osteophytes, and a limited or painful active ROM in any direction was found to have no association with multilevel disc space narrowing. Our study indicates that a restricted ROM in latero-flexion could potentially be a defining sign in future definitions of symptomatic spinal OA. However, since our results partially differ from previous studies, further research is needed to explore the association between active ROM and LDD.

Image forgery localization integrating multi-scale and boundary features

Abstract Image forgery localization identifies tampered regions within an image by extracting distinctive forgery features. Current methods mainly use convolutional neural networks (CNNs) to extract features. However, CNNs’ limited receptive field emphasizes local features, impeding the global modeling of crucial lower-level features like edges and textures, leading to decreased precision. Moreover, prior methods use pyramid networks for multi-scale feature extraction but show deficiencies in multi-scale and interlayer modeling, leading to inadequate multi-scale information representation and limiting flexibility to tampered regions of varying sizes. To address these issues, this paper proposes a Transformer-based model integrating multi-scale and boundary features. The model employs a Pyramid Vision Transformer as the encoder, using self-attention over convolution to enhance global context modeling. Building on this, the model incorporates a multi-scale feature enhancement module that enriches forgery features by paralleling various convolutional layers. Features at various encoder stages are integrated through a cross-stage interaction module, enabling multi-level feature correlation for a strong feature representation. Furthermore, the model includes a forgery boundary information-guided branch, which focuses precisely on tampered region structures without introducing irrelevant noise. Experiments demonstrate that our model surpasses previous methods in localization accuracy, with F1 and AUC improving by 8.5% and 2.2% in pre-training, respectively.

HCA-RFLA: A SAR Remote Sensing Ship Detection Based on Hierarchical Collaborative Attention Method and Gaussian Receptive Field-Driven Label Assignment Strategy

Ensuring safety at sea has become a primary focus of marine monitoring, driving the increasing adoption of ship detection technology in the maritime industry. Detecting small ship targets in SAR images presents challenges, as they occupy only a small portion of the image and exhibit subtle features, reducing detection efficiency. To address these challenges, we propose the HCA-RFLA algorithm for ship detection in SAR remote sensing. To better capture small targets, we design a hierarchical collaborative attention (HCA) mechanism that enhances feature representation by integrating multi-level features with contextual information. Additionally, due to the scarcity of positive samples for small targets under IoU and center sampling strategies, we propose a label assignment strategy based on Gaussian receptive fields, known as RFLA. RFLA assigns positive samples to small targets based on the Gaussian distribution between feature points and ground truth, increasing the model’s sensitivity to small samples. The HCA-RFLA was experimentally validated using the SSDD, HRSID, and SSD datasets. Compared to other state-of-the-art methods, HCA-RFLA improves detection accuracy by 6.2%, 4.4%, and 3.6%, respectively. These results demonstrate that HCA-RFLA outperforms existing algorithms in SAR remote sensing ship detection.

Application of CNN Classic Model in Modern Image Processing

As a deep learning model, convolutional neural network (CNN) has been widely used in the field of modern image processing and has shown excellent performance. From LeNet to AlexNet, to classic models such as VGGNet and ResNet, CNN has achieved remarkable success in tasks such as image classification, object detection and segmentation through multi-level feature extraction and automatic learning capabilities. This paper first explores the basic structure and working principle of CNN, analyzes the advantages and limitations of classic models, and reviews its specific applications in image processing. By introducing the optimization strategies of various models, it further explores the improvement path of CNN in the field of image processing, including model compression, lightweight design and the introduction of new network structures. In short, the continuous optimization of CNN has enabled it to show powerful performance in multiple complex tasks, promoted the rapid development of image processing technology, and provided strong support for applications in more fields.

Asymmetric Large Kernel Distillation Network for efficient single image super-resolution

Recently, significant advancements have been made in the field of efficient single-image super-resolution, primarily driven by the innovative concept of information distillation. This method adeptly leverages multi-level features to facilitate high-resolution image reconstruction, allowing for enhanced detail and clarity. However, many existing approaches predominantly emphasize the enhancement of distilled features, often overlooking the critical aspect of improving the feature extraction capabilities of the distillation module itself. In this paper, we address this limitation by introducing an asymmetric large-kernel convolution design. By increasing the size of the convolution kernel, we expand the receptive field, which enables the model to more effectively capture long-range dependencies among image pixels. This enhancement significantly improves the model's perceptual ability, leading to more accurate reconstructions. To maintain a manageable level of model complexity, we adopt a lightweight architecture that employs asymmetric convolution techniques. Building on this foundation, we propose the Lightweight Asymmetric Large Kernel Distillation Network (ALKDNet). Comprehensive experiments conducted on five widely recognized benchmark datasets-Set5, Set14, BSD100, Urban100, and Manga109-indicate that ALKDNet not only preserves efficiency but also demonstrates performance enhancements relative to existing super-resolution methods. The average PSNR and SSIM values show improvements of 0.10 dB and 0.0013, respectively, thereby achieving state-of-the art performance.

Art Pattern Design Based on Visual Semantic Segmentation and Evolutionary Algorithm Optimization

This paper aims to address the issue of traditional art patterns not fully leveraging contextual information in image semantic segmentation. It proposes a multi-level feature aggregation method for image semantic segmentation based on visual Transformer and coordinate attention adjustment (CA Adjustment). Initially, the input image is segmented into slices for linear projection, incorporating learnable positional embeddings to derive an encoded input sequence. Subsequently, employing a visual Transformer-based encoder, the image is transformed into patches to capture global context across the network. CA Adjustment is then introduced to adaptively merge fusion features and visual backbone features using weighted adjustments. Lastly, a multi-objective grasshopper optimization algorithm is designed based on a clustering evolution mechanism to further enhance algorithm performance. Extensive experimental results demonstrate that our proposed algorithm effectively models global contextual information for image feature extraction. Compared to existing advanced algorithms, our method achieves high segmentation accuracy in semantic segmentation tasks, consistently exceeding 95%. Ablation experiments further validate the efficacy of our approach, underscoring its broad applicability in high-precision image semantic segmentation.

Research on recognition of slippery road surface and collision warning system based on deep learning.

Aiming at the problems of slow detection speed, large prediction error and weak environmental adaptability of current vehicle collision warning system, this paper proposes a recognition method of slippery road surface and collision warning system based on deep learning. Firstly, this paper uses the on-board camera to monitor the environment and road conditions in front of the vehicle in real time, and a residual network model FS-ResNet50 is proposed, which integrated SE attention mechanism and multi-level feature information based on the traditional ResNet50 model. The FS-ResNet50 model is used to identify the slippery states of the current road, such as wet and snowy. Secondly, the yolov5 algorithm is used to detect the position of the vehicle in front, and a driving safety distance model with adaptive traffic environment characteristics is established based on different road conditions and driving conditions, and an early warning area that dynamically changed with the speed and the road slippery states is generated. Finally, according to the relationship between the warning area and the position of the vehicle, the possible collision is predicted and timely warned. Experimental results show that the method proposed in this paper improves the overall warning accuracy by 6.72% and reduces the warning false alarm rate for oncoming traffic on both sides by 16.67% compared with the traditional collision warning system. It can ensure safe driving, especially in bad weather conditions and has a high application value.

Elevating Facial Expression Detection: Empowered by VGG-19 and Weight-Normalized Gradient Boost Algorithm

Facial expression recognition termed as FER, is one of the vital tasks which is able in mimicking the human ability and wellness. Face expression and other gestures delivered via face are some of the important aspects of conveying non-verbal communications which plays a vital role in interpersonal relations. This domain has a higher scope of research due to enhancing computer vision and human-computer interaction. With respect and consideration to these domain interest, DL has gained a reasonable approach in performing FER. Some of the state-of-art approaches encompassing the ML approaches have faced several cases of laybacks such as overfitting, computational complexity, less adaptable to higher and big datasets. Thus, considering these laybacks and in achieving accurate FER in aspects of bringing proximal levels of FER, the current approach deployed DL methods for both feature extraction from the input image and in classifying them. Deep multi-level feature extraction is performed using the VGG-19 model and Weight Normalized gradient boosting algorithm is adapted for classifying these expressions using the FER13 dataset. This dataset constitutes the input images, which are in ranges of 28,709 sample image data and about 3,589 image data for test. These input images are initially pre-processed for obtaining better accuracy rates when performing feature extraction and classifications. The complete model in effective FER is evaluated using the performance metrics comprising Accuracy (98%), Recall (99%), F1-score (98%) and the precision rates (97%). This analysis of the performance will aid in affirming the overall efficacy of the proposed system.

DEST: Difference enhanced-Swin Transformer for remote sensing change detection

ABSTRACT Remote sensing (RS) change detection (CD) has recently achieved remarkable success thanks to convolutional neural networks (CNNs). However, due to the limited receptive fields of CNN models, existing methods are prone to generating pseudo detections or missed detections. In this letter, we propose a difference enhanced-Swin Transformer network (DEST) for accurate and robust change detection in RS images. First, we design a difference enhancement module (DEM) in the feature extraction stage to boost the feature learning of differences for dual-temporal images at each level. Second, to enlarge the receptive fields of networks and capture more changed details, we apply a Swin Transformer module to the difference features to model the global contextual information. Third, to avoid the semantic loss and simultaneously solve the problem of uneven contributions of features at different levels, we design a feature weight fusion module (FWFM) to effectively aggregate multi-level feature difference maps. Extensive experimental results on two publicly available benchmarks demonstrate that the proposed method is superior to some state-of-the-art change detection models.

A Transfer Learning Model for Rolling Bearing Fault Diagnosis Based on Texture Loss Strategy and Nuclear Norm Regularization

Abstract In recent years, transfer learning (TL) approaches have seen extensive application in diagnosing bearing faults due to their exceptional performance. However, mechanical noise, equipment aging, and wear lead to notable disparities and differences in the multi-level feature distributions across the source and target domain signals. The issue is addressed by proposing a transfer learning model based on a texture loss strategy and nuclear norm regularization method. First, a Feature-Enhanced Network (MSRnet) is designed, which significantly improves the ability to capture local details and long-range dependencies by combining a multi-scale feature extraction module with a dilated residual module. Next, a texture loss strategy is proposed to align multi-scale features across domains by minimizing the Gram matrix of signal features. Finally, a nuclear norm regularization method is proposed to perform low-rank approximation on the signal matrix, facilitating the extraction of more robust feature data and mitigating the risk of overfitting. The experimental results demonstrate that the proposed method achieved an average accuracy of 98.58% on the University of Ottawa bearing fault dataset and 98.11% on the Jiangnan University (JNU) bearing dataset, surpassing eight other algorithms in bearing fault diagnosis.

Research of anomaly detection based on dynamic anomaly detection enhancement framework

Abstract Anomaly detection plays a crucial role in various fields, from industrial defect inspection to geological detection. However, traditional approaches often struggle with insufficient discriminability and an inability to generalize to unseen anomalies. These limitations stem from the practical difficulty in gathering a comprehensive set of anomalies and the tendency to overlook anomalous instances in favor of normal samples. To address these challenges, we propose a novel Dynamic Anomaly Detection Enhancement Framework, integrating three key innovations: (1) SaliencyAug: An adaptive saliency-guided augmentation method that generates realistic pseudo-samples to enhance learning of rare anomalies, improving model generalization. (2) DynAB: A dynamic attention block that achieves effective multi-level feature fusion while minimizing redundant information, enhancing detection accuracy. (3) DualOM: A dual-head optimization module which employs separate heads for normal and anomalous sample learning, creating more explicit and discriminative decision boundaries. Extensive experiments across multiple real-world datasets demonstrate our framework's superior performance in detecting a wide range of anomalies, demonstrating 2.4% improvement over state-of-the-art methods.

CrackNet: A Hybrid Model for Crack Segmentation with Dynamic Loss Function

Cracks are a common form of damage in infrastructure, posing significant risks to both personal safety and property. Along with the development of deep learning, visual-based crack automatic detection has been widely studied. However, this task is still challenging due to complex crack topology, noisy backgrounds, unbalanced categories, etc. To address these challenges, this research proposes a novel hybrid network, named CrackNet, which leverages the strengths of both CNN and transformer. On the encoder side, CNNs are employed to extract multi-level local features, while transformers are used to model global dependencies. Additionally, a strip pooling module is introduced to suppress irrelevant regions and enhance the network’s ability to segment narrow and elongated cracks. On the decoder side, an attention-based skip connection strategy and a mixed up-sampling module are implemented to restore detailed information. Furthermore, a joint learning loss combining Dice and cross-entropy with dynamic weighting is proposed to mitigate the effects of severe class imbalance. CrackNet is trained and evaluated on three public crack datasets, and experimental results show that the proposed model outperforms several well-known deep neural networks, with a particularly noticeable improvement in recall rate.

ARMNet: A Network for Image Dimensional Emotion Prediction Based on Affective Region Extraction and Multi-Channel Fusion.

Compared with discrete emotion space, image emotion analysis based on dimensional emotion space can more accurately represent fine-grained emotion. Meanwhile, this high-precision representation of emotion requires dimensional emotion prediction methods to sense and capture emotional information in images as accurately and richly as possible. However, the existing methods mainly focus on emotion recognition by extracting the emotional regions where salient objects are located while ignoring the joint influence of objects and background on emotion. Furthermore, in the existing literature, when fusing multi-level features, no consideration has been given to the varying contributions of features from different levels to emotional analysis, which makes it difficult to distinguish valuable and useless features and cannot improve the utilization of effective features. This paper proposes an image emotion prediction network named ARMNet. In ARMNet, a unified affective region extraction method that integrates eye fixation detection and attention detection is proposed to enhance the combined influence of objects and backgrounds. Additionally, the multi-level features are fused with the consideration of their different contributions through an improved channel attention mechanism. In comparison to the existing methods, experiments conducted on the CGnA10766 dataset demonstrate that the performance of valence and arousal, as measured by Mean Squared Error (MSE), Mean Absolute Error (MAE), and Coefficient of Determination (R²), has improved by 4.74%, 3.53%, 3.62%, 1.93%, 6.29%, and 7.23%, respectively. Furthermore, the interpretability of the network is enhanced through the visualization of attention weights corresponding to emotional regions within the images.

GLDBF: Global and local dual-branch fusion network for no-reference point cloud quality assessment

No-reference Point Cloud Quality Assessment (NR-PCQA) is a challenge in the field of media quality assessment, such as inability to accurately capture quality-related features due to the unique scattered structure of points and less considering global features and local features jointly in the existing no-reference PCQA metrics. To address these challenges, we propose a Global and Local Dual-Branch Fusion (GLDBF) network for no-reference point cloud quality assessment. Firstly, sparse convolution is used to extract the global quality feature of distorted Point Clouds (PCs). Secondly, graph weighted PointNet++ is proposed to extract the multi-level local features of point cloud, and the offset attention mechanism is further used to enhance local effective features. Transformer-based fusion module is also proposed to fuse multi-level local features. Finally, we joint the global and local dual branch fusion modules via multilayer perceptron to predict the quality score of distorted PCs. Experimental results show that the proposed algorithm can achieves state-of-the-art performance compared with existing methods in assessing the quality of distorted PCs.

Multilevel hybrid handcrafted feature extraction based depression recognition method using speech

Background and purposeDiagnosis of depression is based on tests performed by psychiatrists and information provided by patients or their relatives. In the field of machine learning (ML), numerous models have been devised to detect depression automatically through the analysis of speech audio signals. While deep learning approaches often achieve superior classification accuracy, they are notably resource-intensive. This research introduces an innovative, multilevel hybrid feature extraction-based classification model, specifically designed for depression detection, which exhibits reduced time complexity. Materials and methodsMODMA dataset consisting of 29 healthy and 23 Major depressive disorder audio signals was used. The constructed model architecture integrates multilevel hybrid feature extraction, iterative feature selection, and classification processes. During the Hybrid Handcrafted Feature (HHF) generation stage, a combination of textural and statistical methods was employed to extract low-level features from speech audio signals. To enhance this process for high-level feature creation, a Multilevel Discrete Wavelet Transform (MDWT) was applied. This technique produced wavelet subbands, which were then input into the hybrid feature extractor, enabling the extraction of both high and low-level features. For the selection of the most pertinent features from these extracted vectors, Iterative Neighborhood Component Analysis (INCA) was utilized. Finally, in the classification phase, a one-dimensional nearest neighbor classifier, augmented with ten-fold cross-validation, was implemented to achieve detailed, results. ResultsThe HHF-based speech audio signal classification model attained excellent performance, with the 94.63 % classification accuracy. ConclusionsThe findings validate the remarkable proficiency of the introduced HHF-based model in depression classification, underscoring its computational efficiency.

A multi-scale, multi-task fusion UNet model for accurate breast tumor segmentation

Background and Objective:Breast cancer is the most common cancer type among women worldwide and a leading cause of female death. Accurately interpreting these complex tumors, involving small size and morphology, requires a significant amount of expertise and time. Developing a breast tumor segmentation model to assist clinicians in treatment, therefore, holds great practical significance. Methods:We propose a multi-scale, multi-task model framework named MTF-UNet. Firstly, we differ from the common approach of using different convolution kernel sizes to extract multi-scale features, and instead use the same convolution kernel size with different numbers of convolutions to obtain multi-scale, multi-level features. Additionally, to better integrate features from different levels and sizes, we extract a new multi-branch feature fusion block (ADF). This block differs from using channel and spatial attention to fuse features, but considers fusion weights between various branches. Secondly, we propose to use the number of pixels predicted to be related to tumors and background to assist segmentation, which is different from the conventional approach of using classification tasks to assist segmentation. Results:We conducted extensive experiments on our proprietary DCE-MRI dataset, as well as two public datasets (BUSI and Kvasir-SEG). In the aforementioned datasets, our model achieved excellent MIoU scores of 90.4516%, 89.8408%, and 92.8431% on the respective test sets. Furthermore, our ablation study has demonstrated the efficacy of each component and the effective integration of our auxiliary prediction branch into other models. Conclusion:Through comprehensive experiments and comparisons with other algorithms, the effectiveness, adaptability, and robustness of our proposed method have been demonstrated. We believe that MTF-UNet has great potential for further development in the field of medical image segmentation. The relevant code and data can be found at https://github.com/LCUDai/MTF-UNet.git.

MABDT: Multi-scale attention boosted deformable transformer for remote sensing image dehazing

Owing to the heterogeneous spatial distribution and non-uniform morphological characteristics of haze in remote sensing images (RSIs), conventional dehazing algorithms struggle to precisely recover the fine-grained details of terrestrial objects. To address this issue, a novel multi-scale attention boosted deformable Transformer (MABDT) tailored for RSI dehazing is proposed. This framework synergizes the multi-receptive field features elicited by convolutional neural network (CNN) with the long-term dependency features derived from Transformer, which facilitates a more adept restitution of texture and intricate detail information within RSIs. Firstly, spatial attention deformable convolution is introduced for computation of multi-head self-attention in the Transformer block, particularly in addressing complex haze scenarios encountered in RSIs. Subsequently, a multi-scale attention feature enhancement (MAFE) block is designed, tailored to capture local and multi-level detailed information features using multi-receptive field convolution operations, thereby accommodating non-uniform haze. Finally, a multi-level feature complementary fusion (MFCF) block is proposed, leveraging both shallow and deep features acquired from all encoding layers to augment each level of reconstructed image. The dehazing performance is evaluated on 6 open-source datasets, and quantitative and qualitative experimental results demonstrate the advancements of the proposed method in both metrical scores and visual quality. The source code is available at https://github.com/ningjin00/MABDT.

Combining multi-level feature extraction algorithm with residual graph convolutional neural network for partial discharge detection

Partial discharge (PD) identification is critical for the insulation diagnosis of cable conductors; however, there is still scope for enhancement in the existing adaptive extraction capabilities and feature utilization for PD signals. In this context, this paper introduces a method that integrates a one-dimensional convolutional neural network (1D-CNN) with a residual graph convolutional neural network (ResGCN) to recognize PD signals. Noise analysis is performed using various combinations of mother wavelets, and Bayesian optimization is employed to mitigate background noise. Key features of PD signals are progressively abstracted through a 1D-CNN-based multilevel automatic feature learning method, while signal timing attributes are maintained to minimize manual intervention. The graph data is constructed using the signal feature matrix and the signal timing feature similarity matrix. This is followed by the development of a ResGCN utilizing a graph attention mechanism to integrate node feature information and the topology of the PD graph data. This approach aims to fully exploit the correlation between local regions of the feature space and the temporal numerical properties of the signals. Additionally, it jointly optimizes feature extraction and model classification to facilitate adaptive diagnosis. The method is validated with extensive real experimental data obtained from medium voltage overhead power lines. It demonstrates exceptional performance and practicality, achieving an accuracy rate of 97.3% and a recognition rate of 96.1% for PD samples, thus offering reliable theoretical support for effective PD detection.

Attention-based CNN model for motor imagery classification from nonlinear EEG signals

Motor imagery (MI)-based brain-computer interface (BCI) provides a promising solution for the limb rehabilitation of stroke patients. For better rehabilitation performance, high-precision classification of MI-related EEG signals plays a critical role. However, this is still a challenging problem for multi-category MI signals. In this paper, we focus on four commonly used stroke rehabilitation actions, and propose a modular temporal-spatial attention-based CNN (MTSACNN) model for MI classification. In detail, we carry out the MI experiments and acquire the EEG signals related to imagining left/right fist clenching and left/right wrist dorsiflexion. MTSACNN model firstly extracts the low-order MI features through the temporal-spatial feature extraction module (TSFE module). Especially, a group attention mechanism is proposed for intra-group information interaction. Secondly, considering the short- and long-term working characteristics of brain, high-order temporal features are further extracted and fused by the multi-level feature fusion module (MLFF module). Finally, four auxiliary losses are arranged in the classification module (C module) to speed up the model optimization process. The experimental results show that MTSACNN model can achieve good performance in decoding rehabilitation-related MI brain intentions, achieving an average classification accuracy of 72.05% for fourteen subjects. This work is beneficial to promote the construction of high-performance stroke rehabilitation BCI system.