Maximum Pooling Research Articles

Research on coal gangue recognition method based on SFD-YOLOv5s

ABSTRACT Aiming at the current coal gangue recognition model’s difficulty in recognizing aggregated coal gangue targets, which leads to the problems of misdetections, omissions, and inaccurate localization, we propose a coal gangue recognition method based on the SFD-YOLOv5s model. The SE attention mechanism is improved in incorporating maximum pooling and introduced into the backbone network of the YOLOv5s model to improve the model’s ability to extract the critical feature information of the coal gangue. Furthermore, to improve the recognition ability of the YOLOv5s model for aggregated targets, we introduce the Focal-EIoU loss function and the Dyhead. The experimental results show that the overall performance of the SFD-YOLOv5s model has surpassed other mainstream object detection models of the YOLO series. The SFD-YOLOv5s model has the highest precision, recall, and mean average precision. The precision reaches 97.9%, the recall is 96.2%, and the mean average precision is 94.5%, which is 8.7%, 8.9%, and 9.0% higher compared with the YOLOv5s model, respectively. The FPS is 96.15, which can fully meet the demand for real-time detection of coal gangue. Meanwhile, the SFD-YOLOv5s model has the best recognition effect of aggregated coal gangue targets.

Semantic Segmentation of Corn Leaf Blotch Disease Images Based on U-Net Integrated with RFB Structure and Dual Attention Mechanism

Northern corn leaf blight (NCLB) is caused by a fungus and can be susceptible to the disease throughout the growing period of corn, posing a significant impact on corn yield. Aiming at the problems of under-segmentation, over-segmentation, and low segmentation accuracy in the traditional segmentation model of northern corn leaf blight, this study proposes a segmentation method based on an improved U-Net network model. By introducing a convolutional layer and maximum pooling layer to a VGG19 network, the channel attention module and spatial attention module (CBAM) are fused, and the squeeze excitation (SE) attention mechanism is combined. This enhances image feature decoding, integrates feature maps of each layer, strengthens the feature extraction process, expands the sensory fields and aggregates context information, and reduces the loss of location and dense semantic information caused by the pooling operation. Findings from the study show that the proposed NCLB-Net has significantly improved the MIoU and PA indexes, reaching 92.43% and 94.71%, respectively. Compared with the traditional methods, U-Net, SETR, DAnet, OCnet, PSPNet, etc., the MIoU is improved by 20.81%, 16.10%, 9.79%, 5.27%, and 11.06%, and the PA is improved by 11.49%, 8.18%, 9.54%, 13.11%, and 6.26%, respectively.

Shufflenetv2UNet: An improved neural network model for grassland sample coverage extraction

AbstractAccurate extraction of grassland sample coverage is crucial for regional ecological environment monitoring. Due to the strong feature learning capability, high flexibility, and scalability of deep learning methods, they have great potential in grassland sample extraction modelling. However, we still lack a model that can achieve both lightweight structure and effective performance for small object segmentation to considering the small target characteristics of grassland vegetation and the requirements for model deployment in later stages. Here, we combined the UNet model, which performs well in small target segmentation, with the lightweight network Shufflenetv2 model, proposing an improved UNet neural network, Shufflenetv2UNet, for grassland sample coverage extraction. The core of Shufflenetv2UNet is the removal of maximum pooling and double‐layer convolution modules from downsampling in the UNet neural network. In addition, the Inverted Residual Block structure module from Shufflenetv2 was added to achieve a lightweight model and improved extraction accuracy. The Shufflenetv2UNet achieves an accuracy of 98.23%, with a parameter size of 50.74 M, and a model inference speed of 0.004 s. Compared to existing extraction methods, this model has advantages in prediction accuracy, parameter size, and model inference speed. Moreover, Shufflenetv2UNet achieved different types of grassland sample coverage extractions, with good robustness, generalization, and universality, enabling investigators to quickly and accurately obtain grassland sample coverage. This allows more dynamic and accurate ground measurement data for regional grassland environmental monitoring.

A Convolution Auto-Encoders Network for Aero-Engine Hot Jet FT-IR Spectrum Feature Extraction and Classification

Aiming at classification and recognition of aero-engines, two telemetry Fourier transform infrared (FT-IR) spectrometers are utilized to measure the infrared spectrum of the areo-engine hot jet, meanwhile a spectrum dataset of six types of areo-engines is established. In this paper, a convolutional autoencoder (CAE) is designed for spectral feature extraction and classification, which is composed of coding network, decoding network, and classification network. The encoder network consists of convolutional layers and maximum pooling layers, the decoder network consists of up-sampling layers and deconvolution layers, and the classification network consists of a flattened layer and a dense layer. In the experiment, data for the spectral dataset were randomly sampled at a ratio of 8:1:1 to produce the training set, validation set, and prediction set, and the performance measures were accuracy, precision, recall, confusion matrix, F1 score, ROC curve, and AUC value. The experimental result of CAE reached 96% accuracy and the prediction running time was 1.57 s. Compared with the classical PCA feature extraction and SVM, XGBoost, AdaBoost, and Random Forest classifier algorithms, as well as AE, CSAE, and CVAE deep learning classification methods, the CAE network can achieve higher accuracy and efficiency and can complete the spectral classification task.

Magnetic resonance imaging diagnosis of ankle joint athletic injury based on machine learning algorithms

The diagnosis of ankle joint athletic injuries using traditional magnetic resonance imaging (MRI) relies on the subjective judgment and experience of doctors, and small structural changes in athletic injuries are difficult to accurately detect and diagnose. By using machine learning (ML) algorithms and image processing techniques to obtain objective and consistent diagnostic results, the accuracy of diagnosing ankle joint athletic injuries can be improved. This article collected a large number of MRI images of ankle joint athletic injuries, and preprocessed the collected images to extract morphological and texture features, and perform feature fusion. The Residual Network (ResNet) was improved, and the Leaky linear rectification function (ReLU, Corrected linear unit) activation function was introduced. The transfer learning was utilized to increase the convergence speed of the model, and the global maximum pooling layer and softmax classifier were used to construct the fully connected layer. After sufficient training on the training set, the findings on the test set indicated that the average accuracy of the improved ResNet model for ankle joint injury classification was 98.3%. The use of an improved ResNet model can effectively improve the diagnostic effectiveness of ankle joint athletic injuries, providing a new method for medical diagnosis of MRI.

ENHANCING CNN PERFORMANCE WITH RIGHT-NEIGHBOR DEVIATION (RND) POOLING: A FOCUS ON MULTI-CLASS BRAIN TUMOR CLASSIFICATION IN MRI IMAGES

In recent years, the field of image processing and computer vision has been deeply transformed by the advent of Convolutional Neural Network (CNN). These deep learning models, inspired by biological processes, have demonstrated remarkable success in tasks such as image classification, object detection, and semantic segmentation. A critical component of this success is feature extraction, where the pooling layer within CNN serves as a nonlinear down-sampling technique. This layer reduces the spatial size of the convolved feature map through operations like average or maximum pooling, significantly impacting the model’s performance in complex tasks. This research introduces a novel pooling algorithm, Right-Neighbor Deviation (RND), designed to enhance the performance of CNN. The RND pooling method aims to capture detailed spatial features and hierarchical representations more effectively, thereby improving the accuracy and resilience of deep learning models. A dataset of multi-class brain tumor classification, incorporating MRI images from the BR35H dataset, is utilized to explore the potential benefits of RND pooling compared to traditional methods. The effectiveness of the proposed method is evaluated using performance metrics including accuracy, precision, recall, and F1 score, achieving generalized values of 98.86%, 98.84%, 98.80%, and 98.80%, respectively. The results highlight the potential of RND pooling to significantly advance the state of the art in brain tumor classification using CNNs, potentially leading to improved diagnosis and treatment outcomes.

A Novel Detection Transformer Framework for Ship Detection in Synthetic Aperture Radar Imagery Using Advanced Feature Fusion and Polarimetric Techniques

Ship detection in synthetic aperture radar (SAR) imagery faces significant challenges due to the limitations of traditional methods, such as convolutional neural network (CNN) and anchor-based matching approaches, which struggle with accurately detecting smaller targets as well as adapting to varying environmental conditions. These methods, relying on either intensity values or single-target characteristics, often fail to enhance the signal-to-clutter ratio (SCR) and are prone to false detections due to environmental factors. To address these issues, a novel framework is introduced that leverages the detection transformer (DETR) model along with advanced feature fusion techniques to enhance ship detection. This feature enhancement DETR (FEDETR) module manages clutter and improves feature extraction through preprocessing techniques such as filtering, denoising, and applying maximum and median pooling with various kernel sizes. Furthermore, it combines metrics like the line spread function (LSF), peak signal-to-noise ratio (PSNR), and F1 score to predict optimal pooling configurations and thus enhance edge sharpness, image fidelity, and detection accuracy. Complementing this, the weighted feature fusion (WFF) module integrates polarimetric SAR (PolSAR) methods such as Pauli decomposition, coherence matrix analysis, and feature volume and helix scattering (Fvh) components decomposition, along with FEDETR attention maps, to provide detailed radar scattering insights that enhance ship response characterization. Finally, by integrating wave polarization properties, the ability to distinguish and characterize targets is augmented, thereby improving SCR and facilitating the detection of weakly scattered targets in SAR imagery. Overall, this new framework significantly boosts DETR’s performance, offering a robust solution for maritime surveillance and security.

Aircraft engine fault diagnosis based on fused convolutional Transformer

Aircraft engines will face corrosion and erosion problems when working in harsh gas path environments for a long time, and the fault parameter characteristics are not obvious. Therefore, accurate aircraft engine fault diagnosis methods are of great significance to ensure the safe operation of aircraft. In order to improve the prediction accuracy, an aircraft engine fault diagnosis method based on fused convolutional Transformer is proposed. The self-attention mechanism is used to extract useful features and suppress redundant information. The maximum pooling layer (MaxPool) is introduced into the Transformer model to further reduce the model memory consumption and parameter quantity, and alleviate the overfitting phenomenon. The simulation data set of turbofan engines based on GasTurb modeling is used for verification. The results show that compared with the Transformer network and other traditional deep learning models Back Propagation Neural Networks (BP network), Convolutional Neural Networks (CNN) and Recurrent Neural Network (RNN), the accuracy rates are improved by 6.552%、28.117%、13.189%and respectively 10.29%, which proves the effectiveness of the proposed method and can provide a certain reference for aircraft engine fault diagnosis.

Comparison of super-resolution deep learning models for flow imaging

The primary goal of this study is to introduce deep learning (DL) methods as a cost-effective alternative to the computationally intensive Direct Numerical Simulation (DNS) simulations. We show that one can obtain a parametric field from a low-resolution input and map it to a fine grid output, significantly reducing the computational burden. We assess five super-resolution models for up-scaling low-resolution flow data into fine-grid numerical simulations’ output for accuracy and efficiency. The proposed architectures employ convolutional neural networks interconnected in encoder/decoder branches. We investigate these models using turbulent velocity fields inside a suddenly expanded channel characterized by complex features, including turbulence, instabilities, asymmetries, separation, and reattachment. Our results reveal that an encoder/decoder model with residual connections delivers the fastest results, a U-Net-based model with skip connections excels at producing sharper edges in regions prone to blurring, while deeper models incorporating maximum and average pooling layers show superior performance in reconstructing velocity profiles. These findings significantly contribute to our understanding of the potential of deep learning in fluid mechanics. The models presented in this study are trained and validated on standard computer hardware and can be easily adapted to other problems. The findings are promising for discovering and analyzing flow physics, highlighting the potential for DL techniques to improve the accuracy of the available fluid mechanics computational tools.

An improved smoking behavior detection algorithm via incorporating an interference information filtering network

Efficient and accurate identification of smoking behavior in public places is crucial for ensuring public health and safety. However, due to various factors like small target size, complex image background, varying cigarette angles and numerous similar objects, current methods still grapple with challenges such as missed detection and false detection when identifying cigarette targets in smoking behavior. This paper presents an enhanced version of the You Only Look Once version5-small algorithm to address these issues effectively. Firstly, to bolster the model's ability for feature extraction of cigarette targets, the Swin Transformer Block structure is integrated into the backbone network to capture long-range dependencies. Secondly, a novel Hybrid Spatial Pyramid Pooling-Fast with Cross Stage Partial Connection module is built based on the foundation of the Spatial Pyramid Pooling-Fast module by integrating both maximum pooling and average pooling to enhance the fusion ability of the multi-scale feature maps. Thirdly, a novel interference information filtering network is introduced to effectively reduce the impact of noise and confusion caused by similar objects, thus enhancing the performance of the model. According to the experimental results, the accuracy of the improved algorithm on the self-made cigarette target image data set reaches 93.5 %, and the recall reaches 89.1 %.

Research on fault diagnosis algorithm of automobile noise based on deep learning

Abstract This study is devoted to improving the accuracy and efficiency of automobile noise fault diagnosis by using deep learning technology. By constructing a convolutional neural network (CNN) model, we deeply analyze and learn the automobile noise data, aiming at realizing the automatic identification of different types of faults. The experimental results show that the deep learning model shows significant improvement in several performance indicators compared with the traditional methods. Different parameter configurations are used to train the deep learning model. The model structure includes a convolution layer, a maximum pooling layer, and a full connection layer. By extracting the hierarchical features of the data, the model can better adapt to the complex characteristics of noise data. Compared with traditional methods, the CNN model has achieved obvious advantages in accuracy, recall, and F1 score. The research results not only verify the effectiveness of deep learning in automobile noise fault diagnosis but also show the robustness and adaptability of the model under more complex parameter configurations. The conclusion of this study provides empirical support for the application of deep learning technology in the field of automobile noise fault diagnosis.

Current Sensor Fault Detection and Identification for PMSM Drives Using Multichannel Global Maximum Pooling CNN

Current Sensor Fault Detection and Identification for PMSM Drives Using Multichannel Global Maximum Pooling CNN

Hydraulic system fault diagnosis decoupling method based on 2D time-series modeling and self-attention fusion

Hydraulic systems play a pivotal and extensive role in mechanics and energy. However, the performance of intelligent fault diagnosis models for multiple components is often hindered by the complexity, variability, strong hermeticity, intricate structures, and fault concealment in real-world conditions. This study proposes a new approach for hydraulic fault diagnosis that leverages 2D temporal modeling and attention mechanisms for decoupling compound faults and extracting features from multisample rate sensor data. Initially, to address the issue of oversampling in some high-frequency sensors within the dataset, variable frequency data sampling is employed during the data preprocessing stage to resample redundant data. Subsequently, two-dimensional convolution simultaneously captures both the instantaneous and long-term features of the sensor signals for the coupling signals of hydraulic system sensors. Lastly, to address the challenge of feature fusion with multisample rate sensor data, where direct merging of features through maximum or average pooling might dilute crucial information, a feature fusion and decoupling method based on a probabilistic sparse self-attention mechanism is designed, avoiding the issue of long-tail distribution in multisample rate sensor data. Experimental validation showed that the proposed model can effectively utilize samples to achieve accurate fault decoupling and classification for different components, achieving a diagnostic accuracy exceeding 97% and demonstrating robust performance in hydraulic system fault diagnosis under noise conditions.

A Divide-and-Rule Combined Learning Method for Truly Multivariate Time Series Prediction

Multivariate time series prediction is a significant research area that aims to forecast future values based on past observations. Deep learning models with attention mechanisms have shown good predictive performance by emphasizing optimal-related sequences in the target series. However, these models ignore mutation information of nontarget sequences and the long short-term dependencies. To this end, a divide-and-rule combined learning method is proposed to address these limitations, which uses differentiated feature extractors to process different implicit features. First, we design a spatial and temporal information extractor to extract the time-dimensional feature information in the separation stage. Then, a multivariate mutation information extractor is constructed by convolution and maximum pooling layer to capture mutation information of nontarget sequences. Subsequently, the decoder component of the encoder-decoder model extracts long short-term dependencies while preserving the information of the target sequence to be predicted. Finally, in the cooperation stage, a feature fusion method based on a point attention mechanism is proposed, which can assign individual weights to each feature point and enhance the ability to focus on local areas. Experimental results on five real datasets in different domains show that the proposed method has better predictive performance compared to other baseline models.

An Improved U-Net Infrared Small Target Detection Algorithm Based on Multi-Scale Feature Decomposition and Fusion and Attention Mechanism.

Infrared small target detection technology plays a crucial role in various fields such as military reconnaissance, power patrol, medical diagnosis, and security. The advancement of deep learning has led to the success of convolutional neural networks in target segmentation. However, due to challenges like small target scales, weak signals, and strong background interference in infrared images, convolutional neural networks often face issues like leakage and misdetection in small target segmentation tasks. To address this, an enhanced U-Net method called MST-UNet is proposed, the method combines multi-scale feature decomposition and fusion and attention mechanisms. The method involves using Haar wavelet transform instead of maximum pooling for downsampling in the encoder to minimize feature loss and enhance feature utilization. Additionally, a multi-scale residual unit is introduced to extract contextual information at different scales, improving sensory field and feature expression. The inclusion of a triple attention mechanism in the encoder structure further enhances multidimensional information utilization and feature recovery by the decoder. Experimental analysis on the NUDT-SIRST dataset demonstrates that the proposed method significantly improves target contour accuracy and segmentation precision, achieving IoU and nIoU values of 80.09% and 80.19%, respectively.

Fetal electrocardiogram signal extraction based on multi-scale residual shrinkage U-Net

In the extraction of fetal electrocardiogram (ECG) signal, due to the unicity of the scale of the U-Net same-level convolution encoder, the size and shape difference of the ECG characteristic wave between mother and fetus are ignored, and the time information of ECG signals is not used in the threshold learning process of the encoder's residual shrinkage module. In this paper, a method of extracting fetal ECG signal based on multi-scale residual shrinkage U-Net model is proposed. First, the Inception and time domain attention were introduced into the residual shrinkage module to enhance the multi-scale feature extraction ability of the same level convolution encoder and the utilization of the time domain information of fetal ECG signal. In order to maintain more local details of ECG waveform, the maximum pooling in U-Net was replaced by Softpool. Finally, the decoder composed of the residual module and up-sampling gradually generated fetal ECG signals. In this paper, clinical ECG signals were used for experiments. The final results showed that compared with other fetal ECG extraction algorithms, the method proposed in this paper could extract clearer fetal ECG signals. The sensitivity, positive predictive value, and F1 scores in the 2013 competition data set reached 93.33%, 99.36%, and 96.09%, respectively, indicating that this method can effectively extract fetal ECG signals and has certain application values for perinatal fetal health monitoring.

Image reconstruction for electrostatic tomography with deep convolutional neural network

Electrostatic tomography (EST) has the characteristics of being radiation-free and high real-time imaging performance. However, due to its passive measurement method, EST only provides limited input data equal to the number of electrode plates, which results in more serious ill-posed inverse problem. As a result, the imaging accuracy of traditional algorithms is low. To address this problem, an improved deep learning model is proposed for image reconstruction of EST, which is based on a convolutional neural network (CNN). The proposed network is built upon the LeNet-5 deep network model, which incorporates two convolution layers to extract data features and two maximum pooling layers to perform dimension reduction. Furthermore, the LeakyReLU activation function is employed to solve the gradient vanishing problem and accelerate the training process by introducing the non-zero gradients. By constructing an EST model, 8 representative distributions were simulated and 15,930 samples were generated. After 250 iterations, more accurate reconstructed images were generated. To verify the noise immunity of the network model, Gaussian white noises of 20 dB, 30 dB, and 50 dB were added to the test set, and the proposed model could still accurately reconstruct the positions and shapes of the samples. The network is further compared with the traditional algorithms, which reconstructs better results. In addition, the reconstruction results by the proposed model are still relatively accurate for several simulated random samples of different number, shapes and positions. Finally, a 16-electrode sensor array experimental system is designed. The experimental results show that the improved CNN algorithm has a better imaging effect than the traditional algorithms and the CNN algorithm, which is consistent with the simulation results, proving that the model has good generalization ability.

Enhancing museum experience through deep learning and multimedia technology

Amidst the swift progression of artificial intelligence (AI) technology, the museum sector has witnessed a notable inclination towards its adoption. This manuscript endeavours to amplify the interactive milieu of contemporary museum patrons by amalgamating a deep learning algorithm with multimedia technology. The crux of our investigation is the exploration of an adaptive convolutional neural network (CNN) to enrich the interactive engagement of museum visitors. Initially, we leverage the adaptive CNN for the image recognition chore pertaining to museum artifacts and exhibits, thereby facilitating automatic recognition and categorization. Furthermore, to surmount the constraints of conventional pooling algorithms in image feature extraction, we suggest an adaptive pooling algorithm, grounded in the maximum pooling algorithm paradigm. Subsequently, multimedia algorithms are amalgamated into the interactive apparatus, enabling visitors to immerse in exhibits and avail more profound information and experiences. Through juxtaposition with traditional image processing algorithms, the efficacy of our proposed algorithm within a museum ambiance is assessed. Experimental outcomes evince that our algorithm attains superior accuracy and robustness in artifact identification and classification endeavours. In comparison to alternative algorithms, our methodology furnishes more precise and comprehensive displays and interpretations, accurately discerning and categorizing a myriad of exhibit types. This research unveils innovative notions for the digital metamorphosis and advancement of modern museums. Through the incorporation of avant-garde deep learning algorithms and multimedia technologies, the museum visitor experience is elevated, proffering more enthralling and interactive displays. The elucidations of this manuscript hold substantial merit for the continual evolution and innovation within the museum industry.

Convolutional Neural Network to Classify Infrared Thermal Images of Fractured Wrists in Pediatrics.

Convolutional neural network (CNN) models were devised and evaluated to classify infrared thermal (IRT) images of pediatric wrist fractures. The images were recorded from 19 participants with a wrist fracture and 21 without a fracture (sprain). The injury diagnosis was by X-ray radiography. For each participant, 299 IRT images of their wrists were recorded. These generated 11,960 images (40 participants × 299 images). For each image, the wrist region of interest (ROI) was selected and fast Fourier transformed (FFT) to obtain a magnitude frequency spectrum. The spectrum was resized to 100 × 100 pixels from its center as this region represented the main frequency components. Image augmentations of rotation, translation and shearing were applied to the 11,960 magnitude frequency spectra to assist with the CNN generalization during training. The CNN had 34 layers associated with convolution, batch normalization, rectified linear unit, maximum pooling and SoftMax and classification. The ratio of images for the training and test was 70:30, respectively. The effects of augmentation and dropout on CNN performance were explored. Wrist fracture identification sensitivity and accuracy of 88% and 76%, respectively, were achieved. The CNN model was able to identify wrist fractures; however, a larger sample size would improve accuracy.

An attention mechanism module with spatial perception and channel information interaction

In the field of deep learning, the attention mechanism, as a technology that mimics human perception and attention processes, has made remarkable achievements. The current methods combine a channel attention mechanism and a spatial attention mechanism in a parallel or cascaded manner to enhance the model representational competence, but they do not fully consider the interaction between spatial and channel information. This paper proposes a method in which a space embedded channel module and a channel embedded space module are cascaded to enhance the model’s representational competence. First, in the space embedded channel module, to enhance the representational competence of the region of interest in different spatial dimensions, the input tensor is split into horizontal and vertical branches according to spatial dimensions to alleviate the loss of position information when performing 2D pooling. To smoothly process the features and highlight the local features, four branches are obtained through global maximum and average pooling, and the features are aggregated by different pooling methods to obtain two feature tensors with different pooling methods. To enable the output horizontal and vertical feature tensors to focus on different pooling features simultaneously, the two feature tensors are segmented and dimensionally transposed according to spatial dimensions, and the features are later aggregated along the spatial direction. Then, in the channel embedded space module, for the problem of no cross-channel connection between groups in grouped convolution and for which the parameters are large, this paper uses adaptive grouped banded matrices. Based on the banded matrices utilizing the mapping relationship that exists between the number of channels and the size of the convolution kernels, the convolution kernel size is adaptively computed to achieve adaptive cross-channel interaction, enhancing the correlation between the channel dimensions while ensuring that the spatial dimensions remain unchanged. Finally, the output horizontal and vertical weights are used as attention weights. In the experiment, the attention mechanism module proposed in this paper is embedded into the MobileNetV2 and ResNet networks at different depths, and extensive experiments are conducted on the CIFAR-10, CIFAR-100 and STL-10 datasets. The results show that the method in this paper captures and utilizes the features of the input data more effectively than the other methods, significantly improving the classification accuracy. Despite the introduction of an additional computational burden (0.5 M), however, the overall performance of the model still achieves the best results when the computational overhead is comprehensively considered.