Deconvolution Layers Research Articles

A Convolution Auto-Encoders Network for Aero-Engine Hot Jet FT-IR Spectrum Feature Extraction and Classification

Aiming at classification and recognition of aero-engines, two telemetry Fourier transform infrared (FT-IR) spectrometers are utilized to measure the infrared spectrum of the areo-engine hot jet, meanwhile a spectrum dataset of six types of areo-engines is established. In this paper, a convolutional autoencoder (CAE) is designed for spectral feature extraction and classification, which is composed of coding network, decoding network, and classification network. The encoder network consists of convolutional layers and maximum pooling layers, the decoder network consists of up-sampling layers and deconvolution layers, and the classification network consists of a flattened layer and a dense layer. In the experiment, data for the spectral dataset were randomly sampled at a ratio of 8:1:1 to produce the training set, validation set, and prediction set, and the performance measures were accuracy, precision, recall, confusion matrix, F1 score, ROC curve, and AUC value. The experimental result of CAE reached 96% accuracy and the prediction running time was 1.57 s. Compared with the classical PCA feature extraction and SVM, XGBoost, AdaBoost, and Random Forest classifier algorithms, as well as AE, CSAE, and CVAE deep learning classification methods, the CAE network can achieve higher accuracy and efficiency and can complete the spectral classification task.

A novel prediction method for low wind output processes under very few samples based on improved W‐DCGAN

AbstractThe threat of long‐term low wind output processes (LWOP) on the supply ability of the power system is escalating with the increasing integration of wind power. Accurate prediction of LWOP is crucial for maintaining the stable operation of the power system. However, the occurrence probability of LWOP is low and the available samples are lacking, limiting the high‐accuracy predictive modeling of LWOP. Therefore, a novel prediction method for LWOP under very few samples based on improved Wasserstein deep convolutional generative adversarial networks (W‐DCGAN) is proposed here. Firstly, a multi‐dimensional identification method is proposed to accurately identify historical LWOP. Then, an LWOP sample generation model based on improved W‐DCGAN is established. The model integrates a long short‐term memory layer into the deconvolutional layer of the generator to enhance the temporal characteristics of generated samples. Finally, three prediction algorithms are used to construct LWOP prediction models based on both generated and actual samples, respectively. The wind power operation data from a province in China is taken as an example to verify the effectiveness of the proposed method. The results show that the prediction accuracy of LWOP can be improved by 14.36%–55.85%.

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing.

Human parsing has attracted considerable research interest due to its broad potential applications in the computer vision community. In this paper, we explore several useful properties, including high-resolution representation, auxiliary guidance, and model robustness, which collectively contribute to a novel method for accurate human parsing in both simple and complex scenes. Starting from simple scenes: we propose the boundary-aware hybrid resolution network (BHRN), an advanced human parsing network. BHRN utilizes deconvolutional layers and multi-scale supervision to generate rich high-resolution representations. Additionally, it includes an edge perceiving branch designed to enhance the fineness of part boundaries. Building on BHRN, we construct a dual-task mutual learning (DTML) framework. It not only provides implicit guidance to assist the parser by incorporating boundary features, but also explicitly maintains the high-order consistency between the parsing prediction and the ground truth. Toward complex scenes: we develop a domain transform method to enhance the model robustness. By transforming the input space from the spatial domain to the polar harmonic Fourier moment domain, the mapping relationship to the output semantic space is highly stable. This transformation yields robust representations for both clean and corrupted data. When evaluated on standard benchmark datasets, our method achieves superior performance compared to state-of-the-art human parsing methods. Furthermore, our domain transform strategy significantly improves the robustness of DTML dramatically in most complex scenes.

Domain wall and magnetic tunnel junction hybrid for on-chip learning in UNet architecture

We present a spintronic device based hardware implementation of UNet for segmentation tasks. Our approach involves designing hardware for convolution, deconvolution, rectified activation function (ReLU), and max pooling layers of the UNet architecture. We designed the convolution and deconvolution layers of the network using the synaptic behavior of the domain wall MTJ. We also construct the ReLU and max pooling functions of the network utilizing the spin hall driven orthogonal current injected MTJ. To incorporate the diverse physics of spin-transport, magnetization dynamics, and CMOS elements in our UNet design, we employ a hybrid simulation setup that couples micromagnetic simulation, non-equilibrium Green’s function, and SPICE simulation along with network implementation. We evaluate our UNet design on the CamVid dataset and achieve segmentation accuracies of 83.71% on test data, on par with the software implementation with 821 mJ of energy consumption for on-chip training over 150 epochs. We further demonstrate nearly one order of magnitude (10×) improvement in the energy requirement of the network using unstable ferromagnet (Δ = 4.58) over the stable ferromagnet (Δ = 45) based ReLU and max pooling functions while maintaining similar accuracy. The hybrid architecture comprising domain wall MTJ and unstable FM-based MTJ leads to an on-chip energy consumption of 85.79 mJ during training, with a testing energy cost of 1.55 µJ.

Residual squeeze-and-excitation convolutional auto-encoder for fault detection and diagnosis in complex industrial processes

Recently, deep learning has attracted increasing attention in process monitoring. However, it is still a big challenge to extract effective features of process data for fault detection and diagnosis (FDD) by using deep learning-based methods. In this study, a novel deep learning-based model, residual squeeze-and-excitation convolutional auto-encoder (RSECAE) is proposed for FDD in complex industrial processes. A hybrid structure that integrates convolution calculation and auto-encoder is proposed to construct multiple convolution layers and deconvolution layers in the encoder and decoder respectively. Thus, RSECAE can learn effective features from the process signals in an unsupervised manner. At the same time, multiple residual squeeze-and-excitation networks (RSENets) are embedded in the deep network, which effectively preserves the critical feature representations of the convolution layer and transmits them to the decoder in the form of residuals. Finally, maximum mean discrepancy (MMD) term is utilized in RSECAE to reduce the distribution difference between the process signals and the learned features. This enables RSECAE to extract effective features with prior distribution information. RSECAE provides a new solution for process FDD for complicated industrial processes. Two industrial cases are adopted to validate the effectiveness of the RSECAE in process FDD. The experimental results demonstrate the effectiveness and superiority of RSECAE in process fault detection and fault diagnosis.

Bearing Fault Vibration Signal Denoising Based on Adaptive Denoising Autoencoder

Vibration signal analysis is regarded as a fundamental approach in diagnosing faults in rolling bearings, and recent advancements have shown notable progress in this domain. However, the presence of substantial background noise often results in the masking of these fault signals, posing a significant challenge for researchers. In response, an adaptive denoising autoencoder (ADAE) approach is proposed in this paper. The data representations are learned by the encoder through convolutional layers, while the data reconstruction is performed by the decoder using deconvolutional layers. Both the encoder and decoder incorporate adaptive shrinkage units to simulate denoising functions, effectively removing interfering information while preserving sensitive fault features. Additionally, dropout regularization is applied to sparsify the network and prevent overfitting, thereby enhancing the overall expressive power of the model. To further enhance ADAE’s noise resistance, shortcut connections are added. Evaluation using publicly available datasets under scenarios with known and unknown noise demonstrates that ADAE effectively enhances the signal-to-noise ratio in strongly noisy backgrounds, facilitating accurate diagnosis of faults in rolling bearings.

Unsteady flow-field forecasting leveraging a hybrid deep-learning architecture

With the rapid development of data-driven technology, deep learning has been widely used to study unsteady flow phenomena, owing to its high-dimensional, nonlinear, and excellent big-data processing capabilities. Rapidly and accurately predicting unsteady flow fields has been a major challenge in fluid mechanics. Therefore, we designed a new U-shaped hybrid deep neural network (UDNN) framework using a multilayer convolution. Through the multilayer learning interaction of high-dimensional flow-field data, the temporal and spatial characteristics of the flow-field flow are captured, and the flow-field characteristics are predicted in an end-to-end form. The UDNN comprises a convolutional neural layer, deconvolutional layer, convolutional long-term and short-term layers, and attention-mechanism layer. First, based on computational fluid dynamics, we generated unsteady flow-field datasets of the flow around fixed and rotating cylinders at different Reynolds numbers, which were used as training samples for the network framework. Second, we designed a U-shaped convolutional layer, added horizontal time-series feature processing and attention-mechanism units, and fused the deep feature information predicted by the model with shallow semantic information to predict the flow-field features. In addition, we compared the UDNN, proper orthogonal decomposition – long short-term memory, and traditional convolutional autoencoder – long short-term memory models in terms of the flow-field prediction error, model training time, and inference speed. The final results showed that the proposed UDNN framework achieved high accuracy and strong robustness in predicting unsteady flow fields.

Dual-Channel Autoencoder with Key Region Feature Enhancement for Video Anomalous Event Detection

Video anomaly event detection is crucial for analyzing surveillance videos. Existing methods have limitations: frame-level detection fails to remove background interference, and object-level methods overlook object-environment interaction. To address these issues, this paper proposes a novel video anomaly event detection algorithm based on a dual-channel autoencoder with key region feature enhancement. The goal is to preserve valuable information in the global context while focusing on regions with a high anomaly occurrence. Firstly, a key region extraction network is proposed to perform foreground segmentation on video frames, eliminating background redundancy. Secondly, a dual-channel autoencoder is designed to enhance the features of key regions, enabling the model to extract more representative features. Finally, channel attention modules are inserted between each deconvolution layer of the decoder to enhance the model’s perception and discrimination of valuable information. Compared to existing methods, our approach accurately locates and focuses on regions with a high anomaly occurrence, improving the accuracy of anomaly event detection. Extensive experiments are conducted on the UCSD ped2, CUHK Avenue, and SHTech Campus datasets, and the results validate the effectiveness of the proposed method.

Why Not Both? An Attention-Guided Transformer with Pixel-Related Deconvolution Network for Face Super-Resolution

Transformer-based encoder-decoder networks for face super-resolution (FSR) have achieved promising success in delivering stunningly clear and detailed facial images by capturing local and global dependencies. However, these methods have certain limitations. Specifically, the deconvolution in upsampling layers neglects the relationship between adjacent pixels, which is crucial in facial structure reconstruction. Additionally, raw feature maps are fed to the transformer blocks directly without mining their potential feature information, resulting in suboptimal face images. To circumvent these problems, we propose an attention-guided transformer with pixel-related deconvolution network for FSR. Firstly, we devise a novel Attention-Guided Transformer Module (AGTM), which is composed of an Attention-Guiding Block (AGB) and a Channel-wise Multi-head Transformer Block (CMTB). AGTM at the top of the encoder-decoder network (AGTM-T) promotes both local facial details and global facial structures, while AGTM at the bottleneck side (AGTM-B) optimizes the encoded features. Secondly, a Pixel-Related Deconvolution (PRD) layer is specially designed to establish direct relationships among adjacent pixels in the upsampling process. Lastly, we develop a Multi-scale Feature Fusion Module (MFFM) to fuse multi-scale features for better network flexibility and reconstruction results. Quantitative and qualitative experimental results on various datasets demonstrate that the proposed method outperforms other state-of-the-art FSR methods.

Research on Methods of Micro-target Detection in Various Application Scenarios

This paper provides a comprehensive introduction and comparison of the research on small target detection algorithms in different application scenarios and systematically explores the application of deep learning algorithms for small target detection in remote sensing imagery, visible imagery, and infrared imagery. In remote sensing images, the Deconvolution R-CNN algorithm is used to improve the accuracy of small target detection by adding a deconvolution layer. In the field of visible images, a Gaussian Mixture Model (GMM)-based approach is introduced to achieve fast detection of small targets with SIFT features and a GMM target detector. In infrared images, a comprehensive algorithm adapted to low signal-to-noise ratio and complex background is proposed to automatically detect tiny targets through background suppression and threshold selection optimization. In this paper, we compare and analyze the performance of these methods in different scenarios, and propose directions for future research, including expanding the training dataset, applying super-resolution methods to improve the image resolution, and enhancing the universality of the algorithms. This paper provides a comprehensive overview of research in the field of small target detection, as well as an outlook on future research directions, which provides a useful reference for the further development of the field.

Rail surface defect data enhancement method based on improved ACGAN.

Rail surface defects present a significant safety concern in railway operations. However, the scarcity of data poses challenges for employing deep learning in defect detection. This study proposes an enhanced ACGAN augmentation method to address these issues. Residual blocks mitigate vanishing gradient problems, while a spectral norm regularization-constrained discriminator improves stability and image quality. Substituting the generator's deconvolution layer with upsampling and convolution operations enhances computational efficiency. A gradient penalty mechanism based on regret values addresses gradient abnormality concerns. Experimental validation demonstrates superior image clarity and classification accuracy compared to ACGAN, with a 17.6% reduction in FID value. MNIST dataset experiments verify the model's generalization ability. This approach offers practical value for real-world applications.

A new surrogate method for the neutron kinetics calculation of nuclear reactor core transients

Reactor core transient calculation is very important for the reactor safety analysis, in which the kernel is neutron kinetics calculation by simulating the variation of neutron density or thermal power over time. Compared with the point kinetics method, the time-space neutron kinetics calculation can provide accurate variation of neutron density in both space and time domain. But it consumes a lot of resources. It is necessary to develop a surrogate model that can quickly obtain the temporal and spatial variation information of neutron density or power with acceptable calculation accuracy. This paper uses the time-varying characteristics of power to construct a time function, parameterizes the time-varying characteristics which contains the information about the spatial change of power. Thereby, the amount of targets to predict in the space domain is compressed. A surrogate method using the machine learning is proposed in this paper. In the construction of a neural network, the input is processed by a convolutional layer, followed by a fully connected layer or a deconvolution layer. For the problem of time sequence disturbance, a structure combining convolutional neural network and recurrent neural network is used. It is verified in the tests of a series of 1D, 2D and 3D reactor models. The predicted values obtained using the constructed neural network models in these tests are in good agreement with the reference values, showing the powerful potential of the surrogate models.

Functional Connectivity Prediction With Deep Learning for Graph Transformation.

Inferring resting-state functional connectivity (FC) from anatomical brain wiring, known as structural connectivity (SC), is of enormous significance in neuroscience for understanding biological neuronal networks and treating mental diseases. Both SC and FC are networks where the nodes are brain regions, and in SC, the edges are the physical fiber nerves among the nodes, while in FC, the edges are the nodes' coactivation relations. Despite the importance of SC and FC, until very recently, the rapidly growing research body on this topic has generally focused on either linear models or computational models that rely heavily on heuristics and simple assumptions regarding the mapping between FC and SC. However, the relationship between FC and SC is actually highly nonlinear and complex and contains considerable randomness; additional factors, such as the subject's age and health, can also significantly impact the SC-FC relationship and hence cannot be ignored. To address these challenges, here, we develop a novel SC-to-FC generative adversarial network (SF-GAN) framework for mapping SC to FC, along with additional metafeatures based on a newly proposed graph neural network-based generative model that is capable of learning the stochasticity. Specifically, a new graph-based conditional generative adversarial nets model is proposed, where edge convolution layers are leveraged to encode the graph patterns in the SC in the form of a graph representation. New edge deconvolution layers are then utilized to decode the representation back to FC. Additional metafeatures of subjects' profile information are integrated into the graph representation with newly designed sparse-regularized layers that can automatically select features that impact FC. Finally, we have also proposed new post hoc explainer of our SF-GAN, which can identify which subgraphs in SC strongly influence which subgraphs in FC by a new multilevel edge-correlation-guided graph clustering problem. The results of experiments conducted to test the new model confirm that it significantly outperforms existing state-of-the-art methods, with additional interpretability for identifying important metafeatures and subgraphs.

Classifying alzheimer's disease from SMRI data using a hybrid deep learning approaches

The chance of developing "Alzheimer's Disease (AD)" increases every 5 years after 65 years of age, making it a particularly common form of neurodegenerative disorder among the older population. The use of "Magnetic Resonance Imaging (MRI)" to diagnose AD has grown in popularity in recent years. A further benefit of MRI is that it provides excellent contrast and exquisite structural detail. As a result, some studies have used biological markers backed by "structural MRI (sMRI)" to separate AD populations, which indicate differences in brain tissue size and degradation of the nervous system. The lack of properly segmented regions and essential features by the existing models might affect classification accuracy for AD. The categorization of AD in this study is based on sMRI. In this research, the hybrid Deep-Learning Models "SegNet and ResNet (SegResNet)" have been proposed for segmentation, feature extraction, and to classify the AD. SegNet network is used to identify and segment specific brain areas. Edges and circles are the SegNet's first levels, whereas the deeper layers acquire more nuanced and useful features. SegNet's last deconvolution layer produces a wide range of segmented images linked to the 3 categorization labels "Cognitive Normal (CN)", "Mild Cognitive Impairment (MCI)", and "AD" which the machine has earlier found out. To increase classification performance, the attributes of each segmented sMRI image serve as strong features of the labels. To enhance the feature information used for classification, a feature vector is built by combining the values of the pixel intensity of the segmented sMRI images. ResNet-101 classifiers are then used for characterizing vectors to identify the presence or absence of AD or MCI in each sMRI image. In terms of detection and classification accuracy, the proposed SegResNet Model is superior to the existing KNN, EFKNN, AANFIS, and ACS approaches

A Novel Method for Monocular Depth Estimation Using an Hourglass Neck Module.

In this paper, we propose a novel method for monocular depth estimation using the hourglass neck module. The proposed method has the following originality. First, feature maps are extracted from Swin Transformer V2 using a masked image modeling (MIM) pretrained model. Since Swin Transformer V2 has a different patch size for each attention stage, it is easier to extract local and global features from images input by the vision transformer (ViT)-based encoder. Second, to maintain the polymorphism and local inductive bias of the feature map extracted from Swin Transformer V2, a feature map is input into the hourglass neck module. Third, deformable attention can be used at the waist of the hourglass neck module to reduce the computation cost and highlight the locality of the feature map. Finally, the feature map traverses the neck and proceeds through a decoder, comprised of a deconvolution layer and an upsampling layer, to generate a depth image. To evaluate the objective reliability of the proposed method in this paper, we used the NYU Depth V2 dataset to compare and evaluate the methods published in other papers. As a result of the experiment, the RMSE value of the novel method for monocular depth estimation using the hourglass neck module proposed in this paper was 0.274, which was lower than those published in other papers. The lower the RMSE value, the better the depth estimation method; therefore, its efficiency compared to other techniques has been proven.

Physics-informed ConvNet: Learning physical field from a shallow neural network

We introduce a novel methodology for solving nonlinear partial differential equation (PDE) on regular or irregular domains using physics-informed ConvNet, which we call the PICN. The network structure consists of three parts: 1) a convolutional neural network for physical field generation, 2) a pre-trained convolutional layer corresponding to the finite-difference filters to estimate differential fields of the generated physical field, and 3) an interpolation network for loss analysis in irregular geometry domains. From a CNN perspective, the physical field is generated by a deconvolution layer and a convolution layer. Unlike the standard Physics-informed Neural Network (PINN) approach, the convolutions corresponding to the finite-difference filters estimate the spatial gradients forming the physical operator and then construct the PDE residual in a PINN-like loss function. The total loss function involving boundary conditions and the physical constraints in irregular geometry domains can be calculated from an efficient linear interpolation network. The theoretical analysis of PICN convergence is performed on a simplified case for solving a one-dimensional physical field, and several examples of nonlinear PDE of solutions with multifrequency characteristics are executed. The theory and examples confirm the effective learning capability of PICN for the physical field solution with high-frequency components, compared to the standard PINN. A series of numerical cases are performed to validate the current PICN, including the solving (and estimation) of nonlinear physical operator equations and recovering physical information from noisy observations. First, the ability of PICN to solve nonlinear PDE has been verified by executing three nonlinear problems including ODE with sine nonlinearity, PDE involving nonlinear sine-square operators, and Schrödinger equation. The proposed PICN has been assessed by solving some nonlinear PDE on irregular domains such as star-shaped domain, bird-like domain, and starfish domain. Moreover, PICN is applied to identify the thermal diffusivity parameters in an anisotropic heat transfer problem from noisy data, and a denoising display of the temperature field from strong noisy data with standard deviations ranging from 0.1 to 0.4. The numerical results demonstrate the high accuracy approximation and fast convergence performance of PICN. The potential advantage in approximating complex physical field with multi-frequency components indicates that PICN may become an alternative efficient neural network solver in physics-informed machine learning. This paper is adapted from the work originally posted on arXiv.com by the same authors (arXiv:2201.10967, Jan 26, 2022). The data and code accompanying this paper are publicly available at https://github.com/zengzhi2015/PICN.

EPolar-UNet: An edge-attending polar UNet for automatic medical image segmentation with small datasets.

Medical image segmentation is one of the most key steps in computer-aided clinical diagnosis, geometric characterization, measurement, image registration, and so forth. Convolutional neural networks especially UNet and its variants have been successfully used in many medical image segmentation tasks. However, the results are limited by the deficiency in extracting high resolution edge information because of the design of the skip connections in UNet and the need for large available datasets. In this paper, we proposed an edge-attending polar UNet (EPolar-UNet), which was trained on the polar coordinate system instead of classic Cartesian coordinate system with an edge-attending construction in skip connectionpath. EPolar-UNet extracted the location information from an eight-stacked hourglass network as the pole for polar transformation and extracted the boundary cues from an edge-attending UNet, which consisted of a deconvolution layer and a subtractionoperation. We evaluated the performance of EPolar-UNet across three imaging modalities for different segmentation tasks: CVC-ClinicDB dataset for polyp, ISIC-2018 dataset for skin lesion, and our private ultrasound dataset for liver tumor segmentation. Our proposed model outperformed state-of-the-art models on all three datasets and needed only 30%-60% of training data compared with the benchmark UNet model to achieve similar performances for medical image segmentationtasks. We proposed an end-to-end EPolar-UNet for automatic medical image segmentation and showed good performance on small datasets, which was critical in the field of medical imagesegmentation.

Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI.

Automated breast tumor segmentation on the basis of dynamic contrast-enhancement magnetic resonance imaging (DCE-MRI) has shown great promise in clinical practice, particularly for identifying the presence of breast disease. However, accurate segmentation of breast tumor is a challenging task, often necessitating the development of complex networks. To strike an optimal tradeoff between computational costs and segmentation performance, we propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers. Specifically, the hybrid network consists of a encoder-decoder architecture by stacking convolution and deconvolution layers. Effective 3D transformer layers are then implemented after the encoder subnetworks, to capture global dependencies between the bottleneck features. To improve the efficiency of hybrid network, two parallel encoder sub-networks are designed for the decoder and the transformer layers, respectively. To further enhance the discriminative capability of hybrid network, a prototype learning guided prediction module is proposed, where the category-specified prototypical features are calculated through online clustering. All learned prototypical features are finally combined with the features from decoder for tumor mask prediction. The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network achieves superior performance than the state-of-the-art (SOTA) methods, while maintaining balance between segmentation accuracy and computation cost. Moreover, we demonstrate that automatically generated tumor masks can be effectively applied to identify HER2-positive subtype from HER2-negative subtype with the similar accuracy to the analysis based on manual tumor segmentation. The source code is available at https://github.com/ZhouL-lab/ PLHN.

Research on improved YOLOx weed detection based on lightweight attention module

Accurate weed detection is essential for precise weed control in farmland, and machine vision serves as an effective method for identifying and targeting these unwanted plants. An advanced YOLOx weed detection model, incorporating a deep network connection lightweight attention mechanism, has been proposed to effectively identify distinct types of weeds in maize seedling fields. The lightweight attention module is connected to the deep network of YOLOx-Darknet, which weakens the channel noise effect of residual computation and thus makes the detection model more efficient. A deconvolution layer has been introduced in the residual module to improve the small size feature extraction capability. The Generalized Intersection over Union (GIoU) has replaced the Intersection over Union (IoU) to minimize the positional discrepancy between the predicted frame and the actual frame, thereby enhancing the learning capacity of the detection model. Compared with the original algorithm, the improved one achieved an average detection accuracy of 94.86% in the performance evaluation, 0.07% better in the F1 value, and 1.16% better in the AP value. The weeding robot with an improved YOLOx algorithm had 92.45% detection rate of maize seedlings and 88.94% detection rate of weed recognition at 0.2 m s−1. The results of this study can provide technical references for real-time weed detection and robotic precision weeding.

Weed–Crop Segmentation in Drone Images with a Novel Encoder–Decoder Framework Enhanced via Attention Modules

The rapid expansion of the world’s population has resulted in an increased demand for agricultural products which necessitates the need to improve crop yields. To enhance crop yields, it is imperative to control weeds. Traditionally, weed control predominantly relied on the use of herbicides; however, the indiscriminate application of herbicides presents potential hazards to both crop health and productivity. Fortunately, the advent of cutting-edge technologies such as unmanned vehicle technology (UAVs) and computer vision has provided automated and efficient solutions for weed control. These approaches leverage drone images to detect and identify weeds with a certain level of accuracy. Nevertheless, the identification of weeds in drone images poses significant challenges attributed to factors like occlusion, variations in color and texture, and disparities in scale. The utilization of traditional image processing techniques and deep learning approaches, which are commonly employed in existing methods, presents difficulties in extracting features and addressing scale variations. In order to address these challenges, an innovative deep learning framework is introduced which is designed to classify every pixel in a drone image into categories such as weed, crop, and others. In general, our proposed network adopts an encoder–decoder structure. The encoder component of the network effectively combines the Dense-inception network with the Atrous spatial pyramid pooling module, enabling the extraction of multi-scale features and capturing local and global contextual information seamlessly. The decoder component of the network incorporates deconvolution layers and attention units, namely, channel and spatial attention units (CnSAUs), which contribute to the restoration of spatial information and enhance the precise localization of weeds and crops in the images. The performance of the proposed framework is assessed using a publicly available benchmark dataset known for its complexity. The effectiveness of the proposed framework is demonstrated via comprehensive experiments, showcasing its superiority by achieving a 0.81 mean Intersection over Union (mIoU) on the challenging dataset.