Deep Feature Fusion Research Articles

BAHGRF3: Human gait recognition in the indoor environment using deep learning features fusion assisted framework and posterior probability moth flame optimisation

AbstractBiometric characteristics are playing a vital role in security for the last few years. Human gait classification in video sequences is an important biometrics attribute and is used for security purposes. A new framework for human gait classification in video sequences using deep learning (DL) fusion assisted and posterior probability‐based moth flames optimization (MFO) is proposed. In the first step, the video frames are resized and fine‐tuned by two pre‐trained lightweight DL models, EfficientNetB0 and MobileNetV2. Both models are selected based on the top‐5 accuracy and less number of parameters. Later, both models are trained through deep transfer learning and extracted deep features fused using a voting scheme. In the last step, the authors develop a posterior probability‐based MFO feature selection algorithm to select the best features. The selected features are classified using several supervised learning methods. The CASIA‐B publicly available dataset has been employed for the experimental process. On this dataset, the authors selected six angles such as 0°, 18°, 90°, 108°, 162°, and 180° and obtained an average accuracy of 96.9%, 95.7%, 86.8%, 90.0%, 95.1%, and 99.7%. Results demonstrate comparable improvement in accuracy and significantly minimize the computational time with recent state‐of‐the‐art techniques.

A soft robotic system imitating the multimodal sensory mechanism of human fingers for intelligent grasping and recognition

The sensory function is crucial for achieving precise feedback control and environmental interaction in soft robots. Therefore, the multimodal sensory capabilities that mimic human fingers have always been a research hotspot. This study proposes a design method for a soft robotic gripper that can emulate the multimodal perception mechanism of human fingers and achieve high-precision recognition of grasped objects using machine learning algorithms. In addition, a finger texture structure inspired by human fingerprints is designed using a negative pressure-induced buckling method to enhance the soft gripper's ability to perceive minute surface textures. Inspired by slow adapting (SA) receptors and fast adapting (FA) receptors of human fingers, we have innovatively designed a capacitive curvature sensor (CS) and a triboelectric texture sensor (TS) to detect the size, material, and texture of objects. Furthermore, a non-contact medium identification sensor (MIS), having a sensitivity of more than 1300 times higher compared to the traditional MISs, is fabricated using the principle of electromagnetic resonance. It is shown that by employing a deep learning-based multi-channel feature fusion network, the soft grasping system with multimodal sensing has achieved a recognition accuracy of 98.43 % for different objects. This work provides an innovative approach for the application of soft robots in various fields, such as logistics sorting and food safety.

DCFF-Net: Deep Context Feature Fusion Network for High-Precision Classification of Hyperspectral Image

Hyperspectral images (HSI) contain abundant spectral information. Efficient extraction and utilization of this information for image classification remain prominent research topics. Previously, hyperspectral classification techniques primarily relied on statistical attributes and mathematical models of spectral data. Deep learning classification techniques have recently been extensively utilized for hyperspectral data classification, yielding promising outcomes. This study proposes a deep learning approach that uses polarization feature maps for classification. Initially, the polar co-ordinate transformation method was employed to convert the spectral information of all pixels in the image into spectral feature maps. Subsequently, the proposed Deep Context Feature Fusion Network (DCFF-NET) was utilized to classify these feature maps. The model was validated using three open-source hyperspectral datasets: Indian Pines, Pavia University, and Salinas. The experimental results indicated that DCFF-NET achieved excellent classification performance. Experimental results on three public HSI datasets demonstrated that the proposed method accurately recognized different objects with an overall accuracy (OA) of 86.68%, 94.73%, and 95.14% based on the pixel method, and 98.15%, 99.86%, and 99.98% based on the pixel-patch method.

DIWGAN‐WBSN: A novel health monitoring approach for wireless body sensor networks

SummaryWireless body sensor network (WBSN) is essential for monitoring patients' health problems and offers a low‐cost option for various healthcare applications. In this manuscript, a Novel Health Monitoring Approach for WBSNs (DIWGAN‐WBSN) is proposed, which uses Dual Interactive Wasserstein Generative Adversarial Network (DIWGAN) optimized with War Strategy Optimization Algorithm (WSOA). After sensing the aforementioned attribute information, it is the responsibility of WBSN nodes to transfer the sensed data to the sink node. The Volcano Eruption Algorithm (VEA) is applied to select the optimum cluster heads in WBSN. The results from VEA are fed to the target node; it consists of DIWGAN to classify the health records and to portray the patient's health status. Generally, DIWGAN does not adopt any optimization methods for measuring the ideal parameters and guaranteeing accurate health monitoring and risk assessment. So the proposed WSOA is considered to enhance the DIWGAN. The proposed method is activated in MATLAB; its efficacy is estimated under performance metrics, like precision, specificity, accuracy, and energy utilization. The proposed approach attains 23.9%, 21.34%, and 51.09% higher accuracy; 21.45%, 13.94%, and 20.6% higher precision; 31.32%, 29.61%, and 11.03% higher specificity; and 20.9%, 19.87%, and 24.6% lower energy utilization for HD classification using the Cleveland database than the existing methods like back propagation neural network‐based risk detection in WBSN for health monitoring, random forest algorithm–based health monitoring in WBSN, and ensemble deep learning and feature fusion for health monitoring using WBSN methods, respectively.

Estimation of winter wheat yield from sentinel-1A time-series images using ensemble deep learning and a Gaussian process

ABSTRACT Deep learning methods have been widely used in applications of yield estimation using remote sensing data. However, they still face some challenges in terms of accuracy due to their inability to fully utilize the spatiotemporal information of remote sensing data. In response to this problem, a winter wheat yield estimation method based on ensemble deep learning and Gaussian process (GP) was proposed. First, the long-short term memory (LSTM) network and convolutional neural network (CNN) were constructed to explore deep spatiotemporal features from Sentinel-1A time-series images. Then, a GP component was applied for fusion of intraimage deep spatiotemporal features and inter-sample spatial consistency features. Finally, the yield estimation results were obtained. The experimental results showed that the proposed method had higher accuracy than those compared models, with a coefficient of determination ( R 2 ) of 0.698, a root mean square error (RMSE) of 477.045 kg/ha and a mean absolute error (MAE) of 404.377 kg/ha, demonstrating the application potential of the proposed method in crop yield estimation applications.

A deep learning-based method for the detection and segmentation of breast masses in ultrasound images

Objective. Automated detection and segmentation of breast masses in ultrasound images are critical for breast cancer diagnosis, but remain challenging due to limited image quality and complex breast tissues. This study aims to develop a deep learning-based method that enables accurate breast mass detection and segmentation in ultrasound images. Approach. A novel convolutional neural network-based framework that combines the You Only Look Once (YOLO) v5 network and the Global-Local (GOLO) strategy was developed. First, YOLOv5 was applied to locate the mass regions of interest (ROIs). Second, a Global Local-Connected Multi-Scale Selection (GOLO-CMSS) network was developed to segment the masses. The GOLO-CMSS operated on both the entire images globally and mass ROIs locally, and then integrated the two branches for a final segmentation output. Particularly, in global branch, CMSS applied Multi-Scale Selection (MSS) modules to automatically adjust the receptive fields, and Multi-Input (MLI) modules to enable fusion of shallow and deep features at different resolutions. The USTC dataset containing 28 477 breast ultrasound images was collected for training and test. The proposed method was also tested on three public datasets, UDIAT, BUSI and TUH. The segmentation performance of GOLO-CMSS was compared with other networks and three experienced radiologists. Main results. YOLOv5 outperformed other detection models with average precisions of 99.41%, 95.15%, 93.69% and 96.42% on the USTC, UDIAT, BUSI and TUH datasets, respectively. The proposed GOLO-CMSS showed superior segmentation performance over other state-of-the-art networks, with Dice similarity coefficients (DSCs) of 93.19%, 88.56%, 87.58% and 90.37% on the USTC, UDIAT, BUSI and TUH datasets, respectively. The mean DSC between GOLO-CMSS and each radiologist was significantly better than that between radiologists (p < 0.001). Significance. Our proposed method can accurately detect and segment breast masses with a decent performance comparable to radiologists, highlighting its great potential for clinical implementation in breast ultrasound examination.

Deep hierarchical spectral-spatial feature fusion for hyperspectral image classification based on convolutional neural network

Joint spectral-spatial feature extraction has been proven to be the most effective part of hyperspectral image (HSI) classification. But, due to the mixing of informative and noisy bands in HSI, joint spectral-spatial feature extraction using convolutional neural network (CNN) may lead to information loss and high computational cost. More specifically, joint spectral-spatial feature extraction from excessive bands may cause loss of spectral information due to the involvement of convolution operation on non-informative spectral bands. Therefore, we propose a simple yet effective deep learning model, named deep hierarchical spectral-spatial feature fusion (DHSSFF), where spectral-spatial features are exploited separately to reduce the information loss and fuse the deep features to learn the semantic information. It makes use of abundant spectral bands and few informative bands of HSI for spectral and spatial feature extraction, respectively. The spectral and spatial features are extracted through 1D CNN and 3D CNN, respectively. To validate the effectiveness of our model, the experiments have been performed on five well-known HSI datasets. Experimental results demonstrate that the proposed method outperforms other state-of-the-art methods and achieved 99.17%, 98.84%, 98.70%, 99.18%, and 99.24% overall accuracy on Kennedy Space Center, Botswana, Indian Pines, University of Pavia, and Salinas datasets, respectively.

Multi-layer adaptive spatial-temporal feature fusion network for efficient food image recognition

Numerous deep learning methods have been developed to tackle the challenges of recognizing food images, including convolutional neural networks, deep feature extraction, and deep feature fusion methods. This research proposes a new architecture called ASTFF-Net that uses deep feature fusion to tackle various challenges in food recognition, including similarity patterns between two categories, multi-object problems, light conditions, camera position, noise objects, and blurred images. ASTFF-Net is a robust and adaptive spatial–temporal fusion network designed to address these challenges effectively. The ASTFF-Net architecture consisted of three networks. In the spatial feature extraction network, the ResNet50 architecture was used to extract robust spatial features, and the reduction operation was utilized to minimize parameter size. Subsequently, the spatial features were passed through a 1D convolution (Conv1D) to fit the features into the recurrent neural networks. In the temporal feature extraction network, the spatial features were given to the long short-term memory, allowing the network to learn from various long sequence patterns. In the adaptive feature fusion network, the robust spatial and temporal features were fused and assigned to the Conv1D, followed by the softmax function. The ASTFF-Net architecture is also intended to decrease the number of network parameters and prevent overfitting problems. Experimental results on four benchmark food image datasets: Food11, UEC Food-100, UEC Food-256, and ETH Food-101, demonstrate that the proposed ASTFF-Nets, particularly ASTFF-NetB3, were more competitive compared with other existing methods.

A novel simulation-assisted transfer method for bearing unknown fault diagnosis

Abstract Supervised data-driven bearing fault diagnosis methods rely on completed datasets of faults, which can be challenging for signals collected in real engineering. Recognizing unknown faults using a data-driven approach is particularly difficult, as purposefully modeling these faults is complex. To address this challenge, this study proposes a new simulation-assisted transfer bearing unknown fault diagnosis method for realizing unknown compound fault diagnosis of rotating machinery. Firstly, finite element method is used to obtain the compound fault data that does not exist in the historical data, and wavelet packet transform is performed on the simulated and measured signals to enhance the detailed features of the signals. Then, a deep convolutional feature fusion network based on hybrid multi-wavelet spatial attention is constructed to fuse the time-frequency information processed by different wavelet bases. Finally, by integrating the concepts of intra-class splitting and transfer learning, the model is fine-tuned using simulation data to recognize unknown compound faults of rolling bearings. The method validates the simulated signals’ feasibility and the unknown faults’ diagnostic validity under the publicly available rolling bearings dataset. Compared to the comparison methods, the method’s accuracy increased by 2.86%, 2.61%, 5.41%, 4.77%, and 7.07%, respectively.

Deep learning and feature fusion-based lung sound recognition model to diagnoses the respiratory diseases

This paper proposed a novel approach for detecting lung sound disorders using deep learning feature fusion. The lung sound dataset are oversampled and converted into spectrogram images. Then, extracting deep features from CNN architectures, which are pre-trained on large-scale image datasets. These deep features capture rich representations of spectrogram images from the input signals, allowing for a comprehensive analysis of lung disorders. Next, a fusion technique is employed to combine the extracted features from multiple CNN architectures totlaly 8064 feature. This fusion process enhances the discriminative power of the features, facilitating more accurate and robust detection of lung disorders. To further improve the detection performance, an improved CNN Architecture is employed. To evaluate the effectiveness of the proposed approach, an experiments conducted on a large dataset of lung disorder signals. The results demonstrate that the deep feature fusion from different CNN architectures, combined with different CNN Layers, achieves superior performance in lung disorder detection. Compared to individual CNN architectures, the proposed approach achieves higher accuracy, sensitivity, and specificity, effectively reducing false negatives and false positives. The proposed model achieves 96.03% accuracy, 96.53% Sensitivity, 99.424% specificity, 96.52% precision, and 96.50% F1 Score when predicting lung diseases from sound files. This approach has the potential to assist healthcare professionals in the early detection and diagnosis of lung disorders, ultimately leading to improved patient outcomes and enhanced healthcare practices.

Human gender estimation from CT images of skull using deep feature selection and feature fusion

This research endeavors to prognosticate gender by harnessing the potential of skull computed tomography (CT) images, given the seminal role of gender identification in the realm of identification. The study encompasses a corpus of CT images of cranial structures derived from 218 male and 203 female subjects, constituting a total cohort of 421 individuals within the age bracket of 25 to 65 years. Employing deep learning, a prominent subset of machine learning algorithms, the study deploys convolutional neural network (CNN) models to excavate profound attributes inherent in the skull CT images. In pursuit of the research objective, the focal methodology involves the exclusive application of deep learning algorithms to image datasets, culminating in an accuracy rate of 96.4%. The gender estimation process exhibits a precision of 96.1% for male individuals and 96.8% for female individuals. The precision performance varies across different selections of feature numbers, namely 100, 300, and 500, alongside 1000 features without feature selection. The respective precision rates for these selections are recorded as 95.0%, 95.5%, 96.2%, and 96.4%. It is notable that gender estimation via visual radiography mitigates the discrepancy in measurements between experts, concurrently yielding an expedited estimation rate. Predicated on the empirical findings of this investigation, it is inferred that the efficacy of the CNN model, the configurational intricacies of the classifier, and the judicious selection of features collectively constitute pivotal determinants in shaping the performance attributes of the proposed methodology.

Multi-class Breast Cancer Classification Using CNN Features Hybridization

Breast cancer has become the leading cause of cancer mortality among women worldwide. The timely diagnosis of such cancer is always in demand among researchers. This research pours light on improving the design of computer-aided detection (CAD) for earlier breast cancer classification. Meanwhile, the design of CAD tools using deep learning is becoming popular and robust in biomedical classification systems. However, deep learning gives inadequate performance when used for multilabel classification problems, especially if the dataset has an uneven distribution of output targets. And this problem is prevalent in publicly available breast cancer datasets. To overcome this, the paper integrates the learning and discrimination ability of multiple convolution neural networks such as VGG16, VGG19, ResNet50, and DenseNet121 architectures for breast cancer classification. Accordingly, the approach of fusion of hybrid deep features (FHDF) is proposed to capture more potential information and attain improved classification performance. This way, the research utilizes digital mammogram images for earlier breast tumor detection. The proposed approach is evaluated on three public breast cancer datasets: mammographic image analysis society (MIAS), curated breast imaging subset of digital database for screening mammography (CBIS-DDSM), and INbreast databases. The attained results are then compared with base convolutional neural networks (CNN) architectures and the late fusion approach. For MIAS, CBIS-DDSM, and INbreast datasets, the proposed FHDF approach provides maximum performance of 98.706%, 97.734%, and 98.834% of accuracy in classifying three classes of breast cancer severities.

EcoDetect-YOLO: A Lightweight, High-Generalization Methodology for Real-Time Detection of Domestic Waste Exposure in Intricate Environmental Landscapes.

In response to the challenges of accurate identification and localization of garbage in intricate urban street environments, this paper proposes EcoDetect-YOLO, a garbage exposure detection algorithm based on the YOLOv5s framework, utilizing an intricate environment waste exposure detection dataset constructed in this study. Initially, a convolutional block attention module (CBAM) is integrated between the second level of the feature pyramid etwork (P2) and the third level of the feature pyramid network (P3) layers to optimize the extraction of relevant garbage features while mitigating background noise. Subsequently, a P2 small-target detection head enhances the model's efficacy in identifying small garbage targets. Lastly, a bidirectional feature pyramid network (BiFPN) is introduced to strengthen the model's capability for deep feature fusion. Experimental results demonstrate EcoDetect-YOLO's adaptability to urban environments and its superior small-target detection capabilities, effectively recognizing nine types of garbage, such as paper and plastic trash. Compared to the baseline YOLOv5s model, EcoDetect-YOLO achieved a 4.7% increase in mAP0.5, reaching 58.1%, with a compact model size of 15.7 MB and an FPS of 39.36. Notably, even in the presence of strong noise, the model maintained a mAP0.5 exceeding 50%, underscoring its robustness. In summary, EcoDetect-YOLO, as proposed in this paper, boasts high precision, efficiency, and compactness, rendering it suitable for deployment on mobile devices for real-time detection and management of urban garbage exposure, thereby advancing urban automation governance and digital economic development.

Detecting Artificial Intelligence-Generated images via deep trace representations and interactive feature fusion

The detection of Artificial Intelligence-Generated (AIG) images plays an important role in verifying the authenticity and originality of digital images. However, recent advancements in state-of-the-art image generation methods have significantly challenged the ability to differentiate AIG images from natural photographs (NP). To address this issue, a novel approach based on deep trace representations and dual-branch interactive feature fusion is presented. Firstly, a global feature extraction module that leverages attention-based MobileViT (AT-MobileViT) is designed to learn the deep representations of the global trace information. Besides, we apply multiple enhanced residual blocks to extract discriminative multi-scale features. After that, a low-level feature extraction module incorporating a channel-spatial attention (CSA) block is also carefully employed to enhance the learning of trace representations. To facilitate the capture of complementary information between features, a dual-branch interactive feature fusion module is introduced by reshaping feature vectors into interactive matrices. By conducting experiments on both seen and unseen images, results demonstrate the better performance and robustness of the proposed method.

Lightweight Network of Multi-Stage Strawberry Detection Based on Improved YOLOv7-Tiny

The color features of strawberries at different growth stages vary slightly and occluded during growth. To address these challenges, this study proposes a lightweight multi-stage detection method based on You Only Look Once version 7-tiny (YOLOv7-tiny) for strawberries in complex environments. First, the size of the model is reduced by replacing the ordinary convolution of the neck network used for deep feature extraction and fusion with lightweight Ghost convolution. Then, by introducing the Coordinate Attention (CA) module, the model’s focus on the target detection area is enhanced, thereby improving the detection accuracy of strawberries. The Wise Intersection over Union (WIoU) loss function is integrated to accelerate model convergence and enhance the recognition accuracy of occluded targets. The advanced Adaptive nesterov momentum algorithm (Adan) is utilized for gradient descent, processing averaged sample data. Additionally, considering the small size of strawberry targets, a detection head specifically for small targets is added, performing detection on a 160 × 160 × 64 feature map, which significantly improves the detection performance for small strawberries. Experimental results demonstrate that the improved network model achieves an mAP@0.5 of 88.2% for multi-stage strawberry detection, which is 2.44% higher than the original YOLOv7-tiny algorithm. Meanwhile, GFLOPs and Params are reduced by 1.54% and 12.10%, respectively. In practical detection and inference, the improved model outperforms current mainstream target detection models, enabling a quicker and more accurate identification of strawberries at different growth stages, thus providing technical support for intelligent strawberry picking.

Gated Siamese Fusion Network based on multimodal deep and hand-crafted features for personality traits assessment

People tend to judge others assessing their personality traits relying on life experience. This fact is especially evident when making an informed hiring decision, which should consider not only skills, but also match a company’s values and culture. Based on this assumption, we use the Siamese Network (SN) for assessing five personality traits by pairwise analyzing and comparing people simultaneously. For this, we propose the OCEAN-AI framework based on Gated Siamese Fusion Network (GSFN), which comprises six modules and enables the fusion of hand-crafted and deep features across three modalities (video, audio, and text). We use the ChaLearn First Impressions v2 (FIv2) and Multimodal Personality Traits Assessment (MuPTA) corpora and identify that all six feature sets and their combinations due to different information content allow the framework to adjust to heterogeneous input data flexibly. The experimental results show that the pairwise comparison of people with the same or different Personality Traits (PT) during the training enhances the proposed framework performance. The framework outperforms the State-of-the-Art (SOTA) systems based on three modalities (video-face, audio and text) by the relative value of 1.3% (0.928 vs. 0.916) in terms of the mean accuracy (mACC) on the FIv2 corpus. We also outperform the SOTA system in terms of the Concordance Correlation Coefficient (CCC) by the relative value of 8.6% (0.667 vs. 0.614) using two modalities (video and audio) on the MuPTA corpus. We make our framework publicly available to integrate it into various applications such as recruitment, education, and healthcare.

DBHF: A double fusion backbone and bidirectional feature hybrid fusion detector for high-precision inspection of avionics solder joint defects

The quality of avionics thermistor wire solder joints has a critical impact on the performance of in-orbit spacecraft. However, it is still hard to simultaneously realize a high-precision inspection of the multi-scale internal and external defects of avionics solder joints. Herein, in combination with active infrared thermography technique, an innovative DBHF detector with a double fusion backbone and a learnable weighted multi-scale bidirectional feature hybrid fusion pyramid network (BdFPN) is demonstrated based on RT-DETR framework. Specifically, the double fusion backbone framework comprises with two lightweight convolutional neural network-based backbones. Compared with conventional single backbone, the double-backbone design forms a multi-level Resnet-like structure, helping to enrich the extracted multi-dimension feature information and retain rich detail information of small-scale defects. The complex learnable weighted multi-scale BdFPN is designed for cross fusion of deep features. One or more additional multi-scale inputs are added to each node involved in feature fusion to aggregate more features from multiple scales and strengthen the interaction between low-level details and high-level semantic information, enabling the detector to make full use of multi-level feature information. Meanwhile, a learnable weight coefficient is set on each node involved in feature fusion and the importance of the input to each node is estimated by training, so that the effective information can be deeply aggregated at different levels. Our DBHF detector achieves a 92.7 % mAP@0.5 on a self-made avionics solder joint dataset with a body size of only 27.2 MB and FPS of 149, outperforming all the typical advanced real-time detectors.

Hybrid Deep Transfer Learning and Feature Fusion Architecture for Diabetic Retinopathy Classification and Severity Grading

Diabetic Retinopathy (DR) is the leading cause of blindness among individuals with diabetes. Automating the diagnosis of DR has the potential to greatly benefit patients by enabling early detection and intervention, thus reducing the risk of blindness. The primary objective of this research is to develop a robust approach for the classification of DR and to analyze its severity grading. By achieving this, we aim to provide an effective tool for accurate diagnosis and assessment of DR, contributing to improved patient care and outcomes. The current literature review analysis reported the importance of deep learning in computer vision based applications. Moreover, plenty of pre-trained models are also present which can be used for classification tasks. Therefore, we present a hybrid DL classification approach by combining Inception V3, VGG-19 and ResNet 50. The proposed architecture uses transfer learning, and feature fusion model to produce the weighted feature vector which is used for classification analysis. The proposed approach is experimented on publicly available datasets APTOS-2019 and Messidor. The performance is measured in terms of accuracy, precision, recall and F1-score.

MOX-NET: Multi-stage deep hybrid feature fusion and selection framework for monkeypox classification

Background:Monkeypox virus has quickly expanded throughout several nations, raising serious public health concerns. Lack of precautionary measures raises concerns about the possibility of global pandemic. As a result, early detection of monkeypox is essential for efficient diagnosis and treatment before broad community transmission. Artificial intelligence (AI) and machine learning (ML) have recently shown tremendous promise in early monkeypox diagnosis using image-based diagnoses methods. But, challenges such as low contrast lesions, overloaded datasets, high memory complexity, and redundant feature extraction still need to be addressed. Methods:This work proposes a coalesced CAD system for monkeypox classification using a deep learning framework. The proposed approach includes multiple stages: First, the given dataset images are pre-processed by a proposed fusion-based contrast enhancement method. Second, six pre-trained deep learning models i.e., Vision Transformers (ViT), Shifted Windows (Swin) Transformers, ResNet-50, ResNet-101, EfficientNetV2, and ConvNeXt-V2 are modified and transfer learning is used for training. Third, from all the deep learning networks, the deep feature vectors are acquired and integrated through the convolutional sparse image decomposition fusion strategy. Subsequently, an entropy-controlled firefly feature selection approach is applied to identify the most suitable features for classification. Lastly, the multi-class support vector machine is utilized to classify the input data based on the selected features. Results:The proposed algorithm utilized the MSLID dataset and obtained an accuracy of 98.64% which is better than other state-of-the-art works. Conclusions:Experimental outcomes reveals that the proposed monkeypox classification algorithm outperforms well-established existing algorithms in both visual and quantitative evaluations, resulting in improved accuracy.

DMF2Net: Dynamic multi-level feature fusion network for heterogeneous remote sensing image change detection

With the rapid development of remote sensing data fusion technology, heterogeneous remote sensing image (HRSI) change detection (CD) has become a frontier field. The powerful nonlinear information processing capability of deep neural network provides the possibility for image domain conversion of HRSIs. However, the majority of existing methods rely on stacking network layers to extract deep high-level semantic features to accomplish the mutual conversion of image domains. The effective extraction and utilization of shallow features have not been fully considered. At the same time, the dependence between deep and shallow features has not been deeply explored. Therefore, these algorithms severely restrict the performance of CD. A new HRSI-CD network (DMF2Net) based on multi-level feature fusion is proposed in this paper to address these issues. DMF2Net uses central difference convolution to extract fine-grained features from shallow layers of images. It is capable of capturing the intrinsic detail features of image by aggregating intensity and gradient information. The dynamic multi-level feature fusion method is used to learn the fusion weights from the features, which are then used to guide the organic fusion of shallow and deep semantic features. This can preserve more position and detail features of the image, which can prevent the loss of small data during image conversion and enhance the model’s ability to detect subtle changes. On this basis, a new DMF2Net-based method for detecting change in bi-temporal HRSIs is proposed. We conducted extensive experiments on four publicly available HRSI-CD datasets. The experimental results showed that the proposed CD framework achieves significant improvement over the most advanced methods. The project file of the proposed framework will be obtained from https://github.com/cwlnnu/DMF2Net.