Atrous Spatial Pyramid Pooling Research Articles

Development and evaluation of a deep learning model for automatic segmentation of non-perfusion area in fundus fluorescein angiography

Diabetic retinopathy (DR) is the most prevalent cause of preventable vision loss worldwide, imposing a significant economic and medical burden on society today, of which early identification is the cornerstones of the management. The diagnosis and severity grading of DR rely on scales based on clinical visualized features, but lack detailed quantitative parameters. Retinal non-perfusion area (NPA) is a pathogenic characteristic of DR that symbolizes retinal hypoxia conditions, and was found to be intimately associated with disease progression, prognosis, and management. However, the practical value of NPA is constrained since it appears on fundus fluorescein angiography (FFA) as distributed, irregularly shaped, darker plaques that are challenging to measure manually. In this study, we propose a deep learning-based method, NPA-Net, for accurate and automatic segmentation of NPAs from FFA images acquired in clinical practice. NPA-Net uses the U-net structure as the basic backbone, which has an encoder-decoder model structure. To enhance the recognition performance of the model for NPA, we adaptively incorporate multi-scale features and contextual information in feature learning and design three modules: Adaptive Encoder Feature Fusion (AEFF) module, Multilayer Deep Supervised Loss, and Atrous Spatial Pyramid Pooling (ASPP) module, which enhance the recognition ability of the model for NPAs of different sizes from different perspectives. We conducted extensive experiments on a clinical dataset with 163 eyes with NPAs manually annotated by ophthalmologists, and NPA-Net achieved better segmentation performance compared to other existing methods with an area under the receiver operating characteristic curve (AUC) of 0.9752, accuracy of 0.9431, sensitivity of 0.8794, specificity of 0.9459, IOU of 0.3876 and Dice of 0.5686. This new automatic segmentation model is useful for identifying NPA in clinical practice, generating quantitative parameters that can be useful for further research as well as guiding DR detection, grading severity, treatment planning, and prognosis.

Application of Instance Segmentation to Identifying Insect Concentrations in Data from an Entomological Radar

Entomological radar is one of the most effective tools for monitoring insect migration, capable of detecting migratory insects concentrated in layers and facilitating the analysis of insect migration behavior. However, traditional entomological radar, with its low resolution, can only provide a rough observation of layer concentrations. The advent of High-Resolution Phased Array Radar (HPAR) has transformed this situation. With its high range resolution and high data update rate, HPAR can generate detailed concentration spatiotemporal distribution heatmaps. This technology facilitates the detection of changes in insect concentrations across different time periods and altitudes, thereby enabling the observation of large-scale take-off, landing, and layering phenomena. However, the lack of effective techniques for extracting insect concentration data of different phenomena from these heatmaps significantly limits detailed analyses of insect migration patterns. This paper is the first to apply instance segmentation technology to the extraction of insect data, proposing a method for segmenting and extracting insect concentration data from spatiotemporal distribution heatmaps at different phenomena. To address the characteristics of concentrations in spatiotemporal distributions, we developed the Heatmap Feature Fusion Network (HFF-Net). In HFF-Net, we incorporate the Global Context (GC) module to enhance feature extraction of concentration distributions, utilize the Atrous Spatial Pyramid Pooling with Depthwise Separable Convolution (SASPP) module to extend the receptive field for understanding various spatiotemporal distributions of concentrations, and refine segmentation masks with the Deformable Convolution Mask Fusion (DCMF) module to enhance segmentation detail. Experimental results show that our proposed network can effectively segment concentrations of different phenomena from heatmaps, providing technical support for detailed and systematic studies of insect migration behavior.

DRA-UNet for Coal Mining Ground Surface Crack Delineation with UAV High-Resolution Images.

Coal mining in the Loess Plateau can very easily generate ground cracks, and these cracks can immediately result in ventilation trouble under the mine shaft, runoff disturbance, and vegetation destruction. Advanced UAV (Unmanned Aerial Vehicle) high-resolution mapping and DL (Deep Learning) are introduced as the key methods to quickly delineate coal mining ground surface cracks for disaster prevention. Firstly, the dataset named the Ground Cracks of Coal Mining Area Unmanned Aerial Vehicle (GCCMA-UAV) is built, with a ground resolution of 3 cm, which is suitable to make a 1:500 thematic map of the ground crack. This GCCMA-UAV dataset includes 6280 images of ground cracks, and the size of the imagery is 256 × 256 pixels. Secondly, the DRA-UNet model is built effectively for coal mining ground surface crack delineation. This DRA-UNet model is an improved UNet DL model, which mainly includes the DAM (Dual Dttention Dechanism) module, the RN (residual network) module, and the ASPP (Atrous Spatial Pyramid Pooling) module. The DRA-UNet model shows the highest recall rate of 77.29% when the DRA-UNet was compared with other similar DL models, such as DeepLabV3+, SegNet, PSPNet, and so on. DRA-UNet also has other relatively reliable indicators; the precision rate is 84.92% and the F1 score is 78.87%. Finally, DRA-UNet is applied to delineate cracks on a DOM (Digital Orthophoto Map) of 3 km2 in the mining workface area, with a ground resolution of 3 cm. There were 4903 cracks that were delineated from the DOM in the Huojitu Coal Mine Shaft. This DRA-UNet model effectively improves the efficiency of crack delineation.

FCT-Net: A dual-encoding-path network fusing atrous spatial pyramid pooling and transformer for pavement crack detection

Cracks are a typical form of road damage, and accurate detection of cracks is of great significance for road maintenance work and ensuring traffic safety. Recently, computer vision has gradually been applied in the field of crack segmentation. However, there are still some extremely challenging problems in crack segmentation, such as complex backgrounds, information loss caused by pooling and convolution operations, and insufficient fusion of global and local semantic information. In response to the above problems, this paper proposes a dual-encoding-path network with U-Net architecture called FCT-Net, by fusing channel atrous spatial pyramid pooling (CASPP) and transformer. Specifically, CASPP obtains multi-scale receptive fields by incorporating spatial and channel attention, while refining and extracting local features. Meanwhile, we introduce long-short distance attention to construct a novel transformer with the prominent characteristic of interaction between local and global attention features. In addition, a residual convolution module is designed to enhance the local features of the transformer. Furthermore, we devise a multi-scale attention weight cross fusion module to aggregate the features of the dual encoding branch, for reducing information loss during downsampling and suppress background information. Eventually, we evaluate the performance of FCT-Net by experiments on three public datasets. Extensive experimental results show that FCT-Net achieves higher F1-score and mean intersection over union (mIoU) than state-of-the-art segmentation networks on the DeepCrack537 and CrackLS315 datasets. Meanwhile, it has excellent segmentation performance for cracks in complex scenes, with the highest recall, F1-score, and mIoU respectively as 85.64%, 81.67%, and 84.05% on the CrackTree260 dataset.

PCB plug-in solder joint defect detection method based on coordinated attention-guided information fusion

Printed Circuit Boards (PCBs) are the foundational component of electronic devices, and the detection of PCB defects is essential for ensuring the quality control of electronic products. Aiming at the problem that the existing PCB plug-in solder defect detection algorithms cannot meet the requirements of high precision, low false alarm rate, and high speed at the same time, this paper proposes a method based on spatial convolution pooling and information fusion. Firstly, on the basis of YOLOv3, an attention-guided pyramid structure is used to fuse context information, and multiple convolutions of different size are used to explore richer high-level semantic information; Secondly, a coordinated attention network structure is introduced to calibrate the fused pyramidal feature information, highlighting the important feature channels, and reducing the adverse impact of redundant parameters generated by feature fusion; Finally, the ASPP (Atrous Spatial Pyramid Pooling) structure is implemented in the original Darknet53 backbone feature extraction network to acquire multi-scale feature information of the detection targets. With these improvements, the average detection accuracy of the enhanced network has been elevated from 94.45 to 96.43%. This experiments shows that the improved network is more suitable for PCB plug-in solder defect detection applications.

ASCEND-UNet: An Improved UNet Configuration Optimized for Rural Settlements Mapping.

Different types of rural settlement agglomerations have been formed and mixed in space during the rural revitalization strategy implementation in China. Discriminating them from remote sensing images is of great significance for rural land planning and living environment improvement. Currently, there is a lack of automatic methods for obtaining information on rural settlement differentiation. In this paper, an improved encoder-decoder network structure, ASCEND-UNet, was designed based on the original UNet. It was implemented to segment and classify dispersed and clustered rural settlement buildings from high-resolution satellite images. The ASCEND-UNet model incorporated three components: firstly, the atrous spatial pyramid pooling (ASPP) multi-scale feature fusion module was added into the encoder, then the spatial and channel squeeze and excitation (scSE) block was embedded at the skip connection; thirdly, the hybrid dilated convolution (HDC) block was utilized in the decoder. In our proposed framework, the ASPP and HDC were used as multiple dilated convolution blocks to expand the receptive field by introducing a series of dilated rate convolutions. The scSE is an attention mechanism block focusing on features both in the spatial and channel dimension. A series of model comparisons and accuracy assessments with the original UNet, PSPNet, DeepLabV3+, and SegNet verified the effectiveness of our proposed model. Compared with the original UNet model, ASCEND-UNet achieved improvements of 4.67%, 2.80%, 3.73%, and 6.28% in precision, recall, F1-score and MIoU, respectively. The contributions of HDC, ASPP, and scSE modules were discussed in ablation experiments. Our proposed model obtained more accurate and stable results by integrating multiple dilated convolution blocks with an attention mechanism. This novel model enriches the automatic methods for semantic segmentation of different rural settlements from remote sensing images.

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid.

Deep learning has recently made significant progress in semantic segmentation. However, the current methods face critical challenges. The segmentation process often lacks sufficient contextual information and attention mechanisms, low-level features lack semantic richness, and high-level features suffer from poor resolution. These limitations reduce the model's ability to accurately understand and process scene details, particularly in complex scenarios, leading to segmentation outputs that may have inaccuracies in boundary delineation, misclassification of regions, and poor handling of small or overlapping objects. To address these challenges, this paper proposes a Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion with the Multi-Scale Dilated Convolutional Pyramid (SDAMNet). Specifically, the Dilated Convolutional Atrous Spatial Pyramid Pooling (DCASPP) module is developed to enhance contextual information in semantic segmentation. Additionally, a Semantic Channel Space Details Module (SCSDM) is devised to improve the extraction of significant features through multi-scale feature fusion and adaptive feature selection, enhancing the model's perceptual capability for key regions and optimizing semantic understanding and segmentation performance. Furthermore, a Semantic Features Fusion Module (SFFM) is constructed to address the semantic deficiency in low-level features and the low resolution in high-level features. The effectiveness of SDAMNet is demonstrated on two datasets, revealing significant improvements in Mean Intersection over Union (MIOU) by 2.89% and 2.13%, respectively, compared to the Deeplabv3+ network.

Adaptive loss-guided multi-stage residual ASPP for lesion segmentation and disease detection in cucumber under complex backgrounds

BackgroundIn complex agricultural environments, the presence of shadows, leaf debris, and uneven illumination can hinder the performance of leaf segmentation models for cucumber disease detection. This is further exacerbated by the imbalance in pixel ratios between background and lesion areas, which affects the accuracy of lesion extraction.ResultsAn original image segmentation framework, the LS-ASPP model, which utilizes a two-stage Atrous Spatial Pyramid Pooling (ASPP) approach combined with adaptive loss to address these challenges has been proposed. The Leaf-ASPP stage employs attention modules and residual structures to capture multi-scale semantic information and enhance edge perception, allowing for precise extraction of leaf contours from complex backgrounds. In the Spot-ASPP stage, we adjust the dilation rate of ASPP and introduce a Convolutional Attention Block Module (CABM) to accurately segment lesion areas.ConclusionsThe LS-ASPP model demonstrates improved performance in semantic segmentation accuracy under complex conditions, providing a robust solution for precise cucumber lesion segmentation. By focusing on challenging pixels and adapting to the specific requirements of agricultural image analysis, our framework has the potential to enhance disease detection accuracy and facilitate timely and effective crop management decisions.

An improved YOLOv8 safety helmet wearing detection network

In the field of industrial safety, wearing helmets plays a vital role in ensuring workers’ health. Aiming at addressing the complex background in the industrial environment, caused by differences in distance, the helmet small target wearing detection methods for misdetection and omission detection problems are needed. An improved YOLOv8 safety helmet wearing detection network is proposed to enhance the capture of details, improve multiscale feature processing and improve the accuracy of small target detection by introducing Dilation-wise residual attention module, atrous spatial pyramid pooling and normalized Wasserstein distance loss function. Experiments were conducted on the SHWD dataset, and the results showed that the mAP of the improved network improved to 92.0%, which exceeded that of the traditional target detection network in terms of accuracy, recall, and other key metrics. These findings further improved the detection of helmet wearing in complex environments and greatly enhanced the accuracy of detection.

Radiological segmentation of knee meniscus ultrasound images based on boundary constraints and multi-scale fusion network

Knee osteoarthritis (KOA) is one of the most popular joint diseases endangering human health because of its high incidence, disability, and younger onset. However, there is no suitable method for early diagnosis, evaluation, and treatment of KOA. In recent years, some clinical studies have found that ultrasound can detect early changes in KOA in advance, and the automatic segmentation of ultrasound images can achieve rapid and effective quantitative research on KOA. However, in ultrasound images, the soft tissue boundaries of the lesion are blurred, making lesion segmentation difficult. Although the U-Net family is one of the best networks for image segmentation, they still have defects such as blurred segmentation boundaries, distorted morphology, and insufficient accuracy when segmenting ultrasound images. To address this issue, we added attention, atrous spatial pyramid pooling (ASSP), and edge loss function terms into the Unet3+ network, which improved the contour clarity and accuracy of output images (the improved Unet3+ Dice acc = 78.74%. Then, we extract the key features of the improved Unet3+ for outputting meniscus images: calculating meniscus area and distance, where the average accuracy of the area is: area_ avg_ acc = 91.12%, with an average distance accuracy of distance_ avg_ acc = 91.14%. This thesis creates a new dataset collection from West China Hospital, Sichuan University, and automated measurement of knee meniscus protrusion area has been achieved for the first time. This article is the first to apply deep learning to ultrasound image segmentation of the knee meniscus, helping doctors conduct qualitative and quantitative analysis of the diagnosis and treatment of early KOA. The results indicate that the improved Unet3+ can assist doctors in automatically diagnosing and evaluating KOA based on meniscus ultrasound images, which is beneficial for guiding early clinical intervention.

Study on a Landslide Segmentation Algorithm Based on Improved High-Resolution Networks

Landslides are a kind of geological hazard with great destructive potential. When a landslide event occurs, a reliable landslide segmentation method is important for assessing the extent of the disaster and preventing secondary disasters. Although deep learning methods have been applied to improve the efficiency of landslide segmentation, there are still some problems that need to be solved, such as the poor segmentation due to the similarity between old landslide areas and the background features and missed detections of small-scale landslides. To tackle these challenges, a proposed high-resolution semantic segmentation algorithm for landslide scenes enhances the accuracy of landslide segmentation and addresses the challenge of missed detections in small-scale landslides. The network is based on the high-resolution network (HR-Net), which effectively integrates the efficient channel attention mechanism (efficient channel attention, ECA) into the network to enhance the representation quality of the feature maps. Moreover, the primary backbone of the high-resolution network is further enhanced to extract more profound semantic information. To improve the network’s ability to perceive small-scale landslides, atrous spatial pyramid pooling (ASPP) with ECA modules is introduced. Furthermore, to address the issues arising from inadequate training and reduced accuracy due to the unequal distribution of positive and negative samples, the network employs a combined loss function. This combined loss function effectively supervises the training of the network. Finally, the paper enhances the Loess Plateau landslide dataset using a fractional-order-based image enhancement approach and conducts experimental comparisons on this enriched dataset to evaluate the enhanced network’s performance. The experimental findings show that the proposed methodology achieves higher accuracy in segmentation performance compared to other networks.

FP-Deeplab: a segmentation model for fabric defect detection

Abstract Deep learning for defect detection has become prevalent to improve fabric production and efficiency and quality. However, fabric defect detection faces challenges such as low recognition ratio, suboptimal classification performance, poor detection inefficiency, and high model complexity. To address these issues, an end-to-end semantic segmentation network is proposed employing an efficient encoder-decoder structure, denoted as Feature Pyramid-Deeplab (FP-Deeplab). The improvements involves enhancing the backbone network by improving the MobileNetV3 network for superior performance, a novel Atrous Spatial Pyramid Pooling with Dilated Strip Pooling (ASPP-DSP) module which combines strip pooling, dilated convolution and ASPP, to ensure an expanded receptive field and the capability to gather distant contextual information. Additionally, a Feature Pyramid module (FP module) is proposed to integrate multiscale features at various stages more efficiently. The incorporating of depth-wise separable convolution in FP-Deeplab enables significant parameter and computational cost reduction, catering to online detection requirements. Experimental results certify the superiority of FP-Deeplab over classical and recent segmentation models. Comparative analysis demonstrates higher segmentation accuracy and reduced parameter quantity. Specifically, compared to the benchmark Deeplabv3+ model with MobileV2 as the backbone, FP-Deeplab achieves a notable increase in segmentation accuracy (F1 score and MIoU) by 4.26% and 5.81%, respectively. Moreover, the model parameters (params) are only one-fifth of the original model, indicating the efficiency and effectiveness of our proposed approach.

Automatic crack segmentation model based on multi-branch aggregation transformer

Crack detection plays a crucial role in evaluating the safety and durability of civil infrastructure. However, detecting cracks of uneven intensity in complex backgrounds is challenging. To overcome this problem, we propose a dual decoder network (CSMT) based on a multi-branch aggregation Transformer, which uses residual atrous spatial pyramid pooling (RASPP) and Transformer dual decoding branches to extract local and global features of different structures. To enhance global feature extraction, we designed a multi-branch aggregation Transformer (MAT) that adaptively weights the features of two attention heads from spatial and channel dimensions to achieve intra block feature aggregation between dimensions. Meanwhile, to obtain multi-scale semantic information, we constructed a new decoding branch, RASPP, which embeds a squeeze-and-excitation (SE) module and residual structures into standard ASPP. Finally, we propose a feature adaptive fusion module (FAM) to enhance feature fusion between adjacent layers and codec layers. Many experiments on three benchmark datasets have shown that the proposed CSMT segmentation network provides excellent performance in a variety of complex scenarios.

Vehicle-infrastructure cooperative 3D target detection based on Feature Prediction Atrous Spatial Pyramid Pooling Net

Vehicle-infrastructure cooperative 3D target detection based on Feature Prediction Atrous Spatial Pyramid Pooling Net

An Identification Method for Mixed Coal Vitrinite Components Based on An Improved DeepLabv3+ Network

To address the high complexity and low accuracy issues of traditional methods in mixed coal vitrinite identification, this paper proposes a method based on an improved DeepLabv3+ network. First, MobileNetV2 is used as the backbone network to reduce the number of parameters. Second, an atrous convolution layer with a dilation rate of 24 is added to the ASPP (atrous spatial pyramid pooling) module to further increase the receptive field. Meanwhile, a CBAM (convolutional block attention module) attention mechanism with a channel multiplier of 8 is introduced at the output part of the ASPP module to better filter out important semantic features. Then, a corrective convolution module is added to the network’s output to ensure the consistency of each channel’s output feature map for each type of vitrinite. Finally, images of 14 single vitrinite components are used as training samples for network training, and a validation set is used for identification testing. The results show that the improved DeepLabv3+ achieves 6.14% and 3.68% improvements in MIOU (mean intersection over union) and MPA (mean pixel accuracy), respectively, compared to the original DeepLabv3+; 12% and 5.3% improvements compared to U-Net; 9.26% and 4.73% improvements compared to PSPNet with ResNet as the backbone; 5.4% and 9.34% improvements compared to PSPNet with MobileNetV2 as the backbone; and 6.46% and 9.05% improvements compared to HRNet. Additionally, the improved ASPP module increases MIOU and MPA by 3.23% and 1.93%, respectively, compared to the original module. The CBAM attention mechanism with a channel multiplier of 8 improves MIOU and MPA by 1.97% and 1.72%, respectively, compared to the original channel multiplier of 16. The data indicate that the proposed identification method significantly improves recognition accuracy and can be effectively applied to mixed coal vitrinite identification.

A deep transfer learning-based algorithm for concrete surface defect detection

The integrity and safety of concrete structures are crucial in modern civil engineering. Traditional image-defect detection methods are significantly affected by light and noise. Methods based on deep learning, particularly convolutional neural networks (CNNs), offer new solutions for automated defect detection. This paper introduces a concrete surface defect detection algorithm based on deep transfer learning. Our model utilizes the ResNet50 architecture as its backbone and incorporates Atrous Spatial Pyramid Pooling (ASPP) to adapt to the diversity of defects and enhance recognition accuracy. In addition, the use of a self-attention mechanism effectively enhances the model’s focus on and analysis of key defect areas, improving its ability to perceive and select features for defects of various sizes, aiding precise localization and classification under complex conditions. Image preprocessing techniques such as resizing, conversion to grayscale, histogram equalization, and noise addition further enhance the robustness of the model in diverse real-world scenarios. On the publicly available COncrete DEfect BRidge IMage Dataset, our model achieved a mean average precision (mAP@0.5) of 0.90, showing a 3.4% improvement over the current best baseline method. Through transfer learning, it reached 0.92 on our custom dataset, significantly outperforming existing methods. These results demonstrate the effectiveness and superiority of the proposed model for detecting concrete defects. Additionally, we evaluated the impact of different architectures on model performance. Compared to traditional models using the VGG16 as the backbone, the ResNet50 architecture used in this study reduces parameter count by 5.41 times while improving performance by 6.1%.

CFNet: Cross-scale fusion network for medical image segmentation

Learning multi-scale feature representations is essential for medical image segmentation. Most existing frameworks are based on U-shape architecture in which the high-resolution representation is recovered progressively by connecting different levels of the decoder with the low-resolution representation from the encoder. However, intrinsic defects in complementary feature fusion inhibit the U-shape from aggregating efficient global and discriminative features along object boundaries. While Transformer can help model the global features, their computation complexity limits the application in real-time medical scenarios. To address these issues, we propose a Cross-scale Fusion Network (CFNet), combining a cross-scale attention module and pyramidal module to fuse multi-stage/global context information. Specifically, we first utilize large kernel convolution to design the basic building block capable of extracting global and local information. Then, we propose a Bidirectional Atrous Spatial Pyramid Pooling (BiASPP), which employs atrous convolution in the bidirectional paths to capture various shapes and sizes of brain tumors. Furthermore, we introduce a cross-stage attention mechanism to reduce redundant information when merging features from two stages with different semantics. Extensive evaluation was performed on five medical image segmentation datasets: a 3D volumetric dataset, namely Brats benchmarks. CFNet-L achieves 85.74% and 90.98% dice score for Enhanced Tumor and Whole Tumor on Brats2018, respectively. Furthermore, our largest model CFNet-L outperformed other methods on 2D medical image. It achieved 71.95%, 82.79%, and 80.79% SE for STARE, DRIVE, and CHASEDB1, respectively. The code will be available at https://github.com/aminabenabid/CFNet

Incremental-based YoloV3 model with hyper-parameter optimization for product image classification in E-commerce sector

Over the past few years, the E-commerce industry has grown tremendously for selling products to consumers. Here, the consumer can easily purchase the products from their residing seats and gets the products at the door step. Also, the image quality is suggested and also the image classification is intruded to meet the consumer prerequisite. Most of the image classification models are developed by machine learning approaches to improve the reliability, scalability, and accuracy level. Due to the heterogeneous nature of images, it restricts the features and lengthy dimensions for datasets which it degrades the performance whereas the classification of products becomes a cumbersome situation. In order to resolve the problem raised by existing methods, a novel product image classification model is proposed for the fashion E-commerce sector. The prime aspect of the proposed model is to build an effective E-commerce sector for a layman, where every individual can purchase the products appropriately. Initially, the dataset is constructed with diverse product images that are obtained from different E-commerce fields with various classes. Consequently, a novel Incremental-based Improved YoloV3 with Hyper-parameter Optimization (II-Yolov3-HO) model is introduced to enhance the classification performance. In the proposed model, some of the hyper parameters like convolution and pooling layers are replaced with the Visual Geometry Group16 (VGG16) model, the remaining convolutional layers are enhanced by the atrous convolution operation, and pooling layers are modified with Atrous Spatial Pyramid Pooling (ASPP). In entire architecture, the weight factor is optimized using Predator-based Squirrel Search Algorithm (PDP-SSA) algorithm. Thus, the new E-commerce sector becomes free to categorize the products, and if it deals with a new product, it is declared as unknown data, which is then trained again in the proposed model. Hence, the concept of classification score matching with the threshold value is accomplished to deal the untrained product and the training weight is updated optimally using the proposed PDP-SSA. Finally, the enhanced model is compared over the state-of-the-art classification, provides the expected result for significantly classifying the multiple classes of products. The developed PDP-SSA-II-YoloV3-HO model is also able to perform recommendations in E-commerce sites even when the input is given as images other than text for searching the items. These uploaded images are analyzed in the developed II-Yolov3-HO model for providing the relevant items to the customer based on their features. The developed PDP-SSA-II-YoloV3-HO model achieves 99.46 % regarding accuracy. Throughout the validation, the developed model outperforms enhanced and reliable performance than the existing approaches.

Multi-scale keypoints detection and motion features extraction in dairy cows using ResNet101-ASPP network

Detecting Keypoints in dairy cows aims to locate and track the motion trajectories of the body's joints, which plays a crucial role in behavior analysis and lameness detection. However, real farming scenarios, characterized by occlusions and large variations in object scale may result in poor detection results. Therefore we introduce the atrous spatial pyramid pooling (ASPP) module into the shallow network of ResNet101, designed to improve the multi-scale feature extraction capability of the model. The ASPP module enhances the robustness of recognition for different dimensional sizes and occluded keypoints using different dilatation rates in the parallel atrous convolutional layers to expand the model's receptive field. Furthermore, seven types of motion features, including tracking up, gait symmetry, step height balance, motion speed variability, head swing amplitude, head-neck slope and back curvature are extracted simultaneously by monitoring and tracking the motion trajectory of distinct keypoints. Several of these features represent innovative extraction models and attributes, first proposed in this study. Multiple models are trained and tested on datasets containing 2385 frames for ablation experiments. The experiments show that, in comparison with the ResNet50, MobileNet_v2_1.0, and EfficientNet-b0 backbone networks, the training error and test error of ResNet101 improve by 4.04–30.12 pixels and 3.81–28.14 pixels. Therefore, ResNet101 is used as the benchmark for subsequent model improvement by adding the ASPP module. The training error and test error of the ResNet101-ASPP network are improved by 0.27 and 0.24 pixels, respectively, compared to the benchmark network. The prediction confidence improves by 1.65-2.50% at three different dairy cow object scales, In addition, the keypoints under different occlusion conditions improve considerably, especially for small-scale keypoints, demonstrating the capability of the ASPP module for multi-scale feature extraction. By analyzing the distribution between the seven features and health, mild lameness, and severe lameness in dairy cows, it is shown that all the different features play an important role in distinguishing between different levels of lameness.

An Improved MonoDepth2 Algorithm for Vehicle Monocular Depth Estimation

Depth estimation algorithms are of great significance for autonomous vehicle ranging. In order to solve the problems of large errors, fuzzy image generation and detail loss in depth estimation algorithms, this paper proposes an improved algorithm of the MonoDepth2 algorithm. First, the feature extraction network of the original algorithm is changed to the ResNeXt block to improve the running speed and enrich feature information. Secondly, the Convolutional Block Attention Module attention mechanism is added to the depth estimation network to improve the algorithm accuracy and promote detail detection effect. Finally, the Atrous Spatial Pyramid Pooling network structure is added between the encoder and decoder of the depth estimation network to optimize feature fusion at different scales and extract more detailed features. Compared with the original MonoDepth2 algorithm, the improved algorithm reduces the Absolute Relative Error by 0.4 %, the Squared Relative Error by 6.1 %, the Root Mean Square Error by 15 %, and the accuracy(thr=1.25), increased by 0.4 %, The generated depth map recovers deeper image details and a more detailed target contour.