Network Classifier Research Articles

Dilated multilevel fused network for virus classification using transmission electron microscopy images

Previous studies have demonstrated significant performance in the field of virus classification; however, they focused on the classification of a small number of virus classes, with a maximum of 16 classes. To address this limitation, this study aims to create a deep learning-based network that outperforms the state-of-the-art (SOTA) models for the classification of 22 different virus classes with the fewest possible trainable parameters. We introduce an automatic identification system for virus classes based on our classification-driven retrieval framework. The proposed dilated multilevel fused network (DMLF-Net) utilizes the multilevel feature fusion concept within a network to exploit more abstract features for microscopic data analysis. A multi-stage training strategy was applied to achieve optimal model convergence without overfitting the training data.We evaluated the performance of the DMLF-Net on three open databases including two virus datasets and one bacteria species dataset. The results demonstrated an accuracy of 89.89%, a weighted harmonic mean of precision and recall (F1-score) of 83.39%, and an area under the curve (AUC) of 92.50% for the 1st virus dataset. For the 2nd virus dataset, the accuracy was 80.70%, the F1-score was 81.20%, and the AUC was 86.20%. For the 3rd bacteria species dataset, the accuracy was 95.93% and the F1-score was 96.24%. DMLF-Net outperforms SOTA methods in terms of classification accuracy while utilizing nearly 5.3 times fewer trainable parameters (25.5 million) compared to the second-best model, visual geometry group (VGG)16 (134.3 million).

Automated Diabetic Retinopathy Detection Using Convolutional Neural Networks For Feature Extraction And Classification (ADRFEC)

Diabetic Retinopathy (DR) is a significant complication of Diabetes Mellitus, leading to various retinal abnormalities that can impair vision and, in severe cases, result in blindness. Approximately 80% of patients with long-standing diabetes for 10–15 years develop DR. The manual process of diagnosing and detecting DR for timely treatment is both time-consuming and unreliable, mainly due to resource constraints and the need for expert opinion. To address this challenge, computerized diagnostic systems utilizing Deep Learning (DL) Convolutional Neural Network (CNN) architectures have been proposed to learn DR patterns from fundus images and assess disease severity. The proposed model performs an exhaustive analysis of these architectures upon fundus images, and derives the best performing DL architecture for DR feature extraction and fundus image classification. Amongst all the models, ResNet50 has achieved the highest training accu- racy whereas VGG-16 has achieved the lowest training accuracy. Again, VGG-16 has achieved lowest validation accuracy whereas ResNet101 has achieved highest validation accuracy.

Investigation of the performances of Support Vector Machine, Random Forest, and 3D-2D Convolutional Neural Network for Hyperspectral Image Classification

Classification of the hyperspectral images (HSIs) is one of the most challenging tasks hyperspectral remote sensing. Various Machine Learning classification algorithms have been implemented to HSI classification. In recent years, several Convolutional Neural Network (CNN) architectures were developed for HSI classification. The aim of this study is to test the performance of CNN, and well-known Support Vector Machine and Random Forest algorithms using the HyRANK Loukia, Houston 2013, and Salinas Scene datasets. The findings indicate that the Modified HybridSN CNN outperformed other algorithms across all datasets, as demonstrated by various performance evaluation metrics.

Collaborative weighting in federated graph neural networks for disease classification with the human-in-the-loop

The authors introduce a novel framework that integrates federated learning with Graph Neural Networks (GNNs) to classify diseases, incorporating Human-in-the-Loop methodologies. This advanced framework innovatively employs collaborative voting mechanisms on subgraphs within a Protein-Protein Interaction (PPI) network, situated in a federated ensemble-based deep learning context. This methodological approach marks a significant stride in the development of explainable and privacy-aware Artificial Intelligence, significantly contributing to the progression of personalized digital medicine in a responsible and transparent manner.

A Self-Supervised Equivariant Refinement Classification Network for Diabetic Retinopathy Classification

A Self-Supervised Equivariant Refinement Classification Network for Diabetic Retinopathy Classification

CPINet: Towards A Novel Cross-Polarimetric Interaction Network for Dual-Polarized SAR Ship Classification

With the rapid development of the modern world, it is imperative to achieve effective and efficient monitoring for territories of interest, especially for the broad ocean area. For surveillance of ship targets at sea, a common and powerful approach is to take advantage of satellite synthetic aperture radar (SAR) systems. Currently, using satellite SAR images for ship classification is a challenging issue due to complex sea situations and the imaging variances of ships. Fortunately, the emergence of advanced satellite SAR sensors has shed much light on the SAR ship automatic target recognition (ATR) task, e.g., utilizing dual-polarization (dual-pol) information to boost the performance of SAR ship classification. Therefore, in this paper we have developed a novel cross-polarimetric interaction network (CPINet) to explore the abundant polarization information of dual-pol SAR images with the help of deep learning strategies, leading to an effective solution for high-performance ship classification. First, we establish a novel multiscale deep feature extraction framework to fully mine the characteristics of dual-pol SAR images in a coarse-to-fine manner. Second, to further leverage the complementary information of dual-pol SAR images, we propose a mixed-order squeeze–excitation (MO-SE) attention mechanism, in which the first- and second-order statistics of the deep features from one single-polarized SAR image are extracted to guide the learning of another polarized one. Then, the intermediate multiscale fused and MO-SE augmented dual-polarized deep feature maps are respectively aggregated by the factorized bilinear coding (FBC) pooling method. Meanwhile, the last multiscale fused deep feature maps for each single-polarized SAR image are also individually aggregated by the FBC. Finally, four kinds of highly discriminative deep representations are obtained for loss computation and category prediction. For better network training, the gradient normalization (GradNorm) method for multitask networks is extended to adaptively balance the contribution of each loss component. Extensive experiments on the three- and five-category dual-pol SAR ship classification dataset collected from the open and free OpenSARShip database demonstrate the superiority and robustness of CPINet compared with state-of-the-art methods for the dual-polarized SAR ship classification task.

Classification of Lung Cancer using Pre-Trained Deep Learning Models

Many Computer Assisted Diagnosis (CAD) systems have been designed and used in recent past for diagnosingdifferenttypes of cancer. Identification of carcinoma at an earlier stage is more important, and it is made possible due to the use modern image processing and deep learning methods.The occurrence of Lung cancer is seen to be increased and Computed Tomography (CT) scan images were utilized in investigation to locate and classify lung cancer, also for determining the severity of those cancer. This study is aimed at employing pre-trained deep neural networks for classification of lung cancer images. A gaussian-based approach is used to segment CT scan images. In this research exploits a transfer learning-based classification method for the chest CT images acquired from Cancer Image Archive and available in the Kaggle platform. Pre- trained models VGG and RESNET were trained using segmented chest CT images, and their performance was evaluated using different optimization algorithms were analyzed. Keywords: Computer Aided Diagnosis, lung cancer, deep learning, CT image, gaussian, transfer learning, pre-trained models, optimization algorithms.

The Geometry of Dynamic Time-Dependent Best–Worst Choice Pairs

There has been increasing interest in best–worst discrete choice experiments (BWDCEs) in health economics, transportation research, and other fields over the last few years. BWDCEs have distinct advantages compared to other measurement approaches in discrete choice experiments (DCEs). A systematic study of best–worst (BW) choice pairs can be traced back to the 1990s. Recently, new ideas have been introduced to the subject. Calculating utility helps measure the attractiveness of BW choices. The goal of this paper is twofold. First, we extend the idea of the BW choice pair to include dynamic, time-dependent transition probability and capture utility at each time and for each choice pair. Second, we used the geometry of BW choice pairs to capture the correlations among them and to characterize and clarify the BW choice pairs in the network, where properties can be derived within each class. This paper discusses BWDCEs, the probability transition matrix of choices over time, and the utility function. The proposed network classification for BW choice pairs is laid out. A detailed simulated example is presented, and the results are compared with the classical K-means classification.

A lightweight parallel attention residual network for tile defect recognition

In modern industrial production, permanent magnet motors are an indispensable part of industrial manufacturing. The quality of the magnetic tiles directly affects the working performance of the permanent magnet motors, making the detection of defects on the surface of magnetic tiles critically important. However, due to the small size of defects on the tile image and the reflectivity of the defective surface, the details of image characteristics are not prominently acquired.These problems bring a lot of difficulties for the recognition of magnetic tile defects. In this paper, a magnetic tile defect detection method is proposed for the probAlems of unclear image features and small defects. First, the image is processed using linear variation to enhance the image detail features. Then, by introducing the inverted bottleneck block structure in MobileNetV2, the Attention Parallel Residual Convolution Block (APR) is proposed, and the Lightweight Parallel Attention Residual Network (LPAR-Net) is built. In APR Block, 7 × 7 convolution is introduced so that the model can extract spatial features from a larger range, and weighted fusion of input images by residual structure. In addition, in this paper, CBAM is improved, split into two parts and inserted into APR Block. Finally, the mainstream image classification models and the LPAR-Net proposed in this paper are used for comparison, respectively. The experimental results show that the method achieves 93.63% accuracy on the adopted dataset, which is better than the existing mainstream image classification network models DenseNet, MobileNet, ConvNext and so on. In addition, this paper introduces a strip steel surface defect dataset and compares it with the above image classification model, which verifies that the detection method proposed in this paper still has strong recognition capability.

Robust Remote Sensing Scene Interpretation Based on Unsupervised Domain Adaptation

Deep learning models excel in interpreting the exponentially growing amounts of remote sensing data; however, they are susceptible to deception and spoofing by adversarial samples, posing catastrophic threats. The existing methods to combat adversarial samples have limited performance in robustness and efficiency, particularly in complex remote sensing scenarios. To tackle these challenges, an unsupervised domain adaptation algorithm is proposed for the accurate identification of clean images and adversarial samples by exploring a robust generative adversarial classification network that can harmonize the features between clean images and adversarial samples to minimize distribution discrepancies. Furthermore, linear polynomial loss as a replacement for cross-entropy loss is integrated to guide robust representation learning. Additionally, we leverage the fast gradient sign method (FGSM) and projected gradient descent (PGD) algorithms to generate adversarial samples with varying perturbation amplitudes to assess model robustness. A series of experiments was performed on the RSSCN7 dataset and SIRI-WHU dataset. Our experimental results illustrate that the proposed algorithm performs exceptionally well in classifying clean images while demonstrating robustness against adversarial perturbations.

Wiener densities for the Airy line ensemble

AbstractThe parabolic Airy line ensemble is a central limit object in the KPZ (Kardar–Parisi–Zhang) universality class and related areas. On any compact set , the law of the recentered ensemble has a density with respect to the law of independent Brownian motions. We show where is an explicit, tractable, non‐negative function of . We use this formula to show that is bounded above by a ‐dependent constant, give a sharp estimate on the size of the set where as , and prove a large deviation principle for . We also give density estimates that take into account the relative positions of the Airy lines, and prove sharp two‐point tail bounds that are stronger than those for Brownian motion. These estimates are a key input in the classification of geodesic networks in the directed landscape. The paper is essentially self‐contained, requiring only tail bounds on the Airy point process and the Brownian Gibbs property as inputs.

SExpHGS-based DBN: Serial exponential hunger games search algorithm-based deep belief network for heartbeat classification using ECG signal

Electrocardiogram (ECG) signal plays an important role in monitoring and diagnosing patients who suffer from several cardiovascular diseases. Numerous conventional techniques designed for cardiovascular disease classification face challenges regarding classification accuracy and also, find difficulty in automatic monitoring and classification techniques. Therefore, this work aspires to design a robust approach, which can precisely classify the ECG even in the presence of noise. Following that, this research introduces the heartbeat classification scheme by utilizing the optimization-based deep learning scheme. Here, the optimization algorithm, called the Serial Exponential Hunger Games Search Algorithm (SExpHGS) is newly designed by integrating the serial exponential weighted moving average concept in the Hunger Games Search (HGS) approach to train deep learning scheme. Initially, the pre-processing is performed by utilizing a median filter and subsequently, wave components are detected by utilizing the resolution wavelet-based scheme. Ultimately, SExpHGS-based Deep Belief Network (SExpHGS-based DBN) recognizes the ECG conditions of individuals. Here, the techniques are analyzed by utilizing the ECG Lead 2 Dataset PhysioNet dataset and analysis is carried out based on performance parameters, namely accuracy, specificity, and sensitivity. The attained values of the aforementioned metrics are 0.954, 0.965, and 0.938, correspondingly.

Automatyczna diagnostyka elementów toru kolejowego z użyciem sieci neuronowych głębokiego uczenia

The article discusses a method for automatic diagnostics of a railway track. It consists in automatic evaluation of the technical condition of selected track elements, such as rails, wooden and concrete sleepers, fasteners and turnouts. It was carried out on the basis of analysis of video images of railroad track elements recorded by two line cameras placed on the diagnostic carriage. The selected FCN-8 deep learning neural network was used to assess the technical condition of the surveyed elements, and the effectiveness of the applied algorithm was determined on the basis of such measures as IoU, Precision, Recall. Conclusions on the application of the FCN-8 network in the automatic classification of features of selected railroad track elements are presented. The results obtained were compared with other methods used in vision diagnostics.

Leukemia detection and classification using computer-aided diagnosis system with falcon optimization algorithm and deep learning

Leukemia is a type of blood tumour that occurs because of abnormal enhancement in WBCs (white blood cells) in the bone marrow of the human body. Blood-forming tissue cancer influences the lymphatic and bone marrow system. The early diagnosis and detection of leukaemia, i.e., the accurate difference of malignant leukocytes with little expense at the beginning of the disease, is a primary challenge in the disease analysis field. Despite the higher occurrence of leukemia, there is a lack of flow cytometry tools, and the procedures accessible at medical diagnostics centres are time-consuming. Distinct researchers have implemented computer-aided diagnostic (CAD) and machine learning (ML) methods for laboratory image analysis, aiming to manage the restrictions of late leukemia analysis. This study proposes a new Falcon optimization algorithm with deep convolutional neural network for Leukemia detection and classification (FOADCNN-LDC) technique. The main objective of the FOADCNN-LDC technique is to classify and recognize leukemia. The FOADCNN-LDC technique utilizes a median filtering (MF) based noise removal process to eradicate the image noise. Besides, the FOADCNN-LDC technique employs the ShuffleNetv2 model for the feature extraction process. Moreover, the detection and classification of the leukemia process are performed by utilizing the convolutional denoising autoencoder (CDAE) model. The FOA is implemented to select the hyperparameter of the CDAE model. The simulation process of the FOADCNN-LDC approach is performed on a benchmark medical dataset. The investigational analysis of the FOADCNN-LDC approach highlighted a superior accuracy value of 99.62% over existing techniques.

Handwritten Character Recognition using Enhanced Artificial Neural Network

This study addresses the concerns regarding the performance of Handwritten Character Recognition (HCR) systems, focusing on the classification stage. It is widely acknowledged that the development of the classification model significantly impacts the overall performance of HCR. The problems identified specifically pertain to the classification model, particularly in the context of the Artificial Neural Network (ANN) learning problem, leading to low accuracy in recognizing handwritten characters. The objective of this study is to improve and refine the ANN classification model to achieve better HCR. To achieve this goal, this study proposed a hybrid Flower Pollination Algorithm with Artificial Neural Network (FPA-ANN) classification model for HCR. The FPA is one of the metaheuristic approaches is utilized as an optimization technique to enhance the performance of ANN, particularly by optimizing the network training process of ANN. The experimentation phase involves using the National Institute of Standards and Technology (NIST) handwritten character database. Finally, the proposed FPA-ANN classification model is analyzed based on generated confusion matrix and evaluated performance of the classification model in terms of precision, sensitivity, specificity, F-score and accuracy.

Recognition of vehicle license plates in highway scenes with deep fusion network and connectionist temporal classification

AbstractLicense plate recognition is crucial in Intelligent Transportation Systems (ITS) for vehicle management, traffic monitoring, and security inspection. In highway scenarios, this task faces challenges such as diversity, blurriness, occlusion, and illumination variation of license plates. This article explores Recurrent Neural Networks based on Connectionist Temporal Classification (RNN‐CTC) for license plate recognition in challenging highway conditions. Four neural network models: ResNet50, ResNeXt, InceptionV3, and SENet, all combined with RNN‐CTC are comparatively evaluated. Furthermore, a novel architecture named ResNet50 Deep Fusion Network using Connectionist Temporal Classification (ResNet50‐DFN‐CTC) is proposed. Comparative and ablation experiments are conducted using the Highway License Plate Dataset of Southeast University (HLPD‐SU). Results demonstrate the superior performance of ResNet50‐DFN‐CTC in challenging highway conditions, achieving 93.158% accuracy with a processing time of 7.91 ms, outperforming other tested models. This research contributes to advancing license plate recognition technology for real‐world highway applications under adverse conditions.

A deep learning deviation-based scheme to defend against false data injection attacks in power distribution systems

Defending against false data injection attacks (FDIAs) in cyber-physical power systems is crucial. Detection in power distribution systems is complex due to load variations, uncertainties, and fewer meters. Defense strategies include model-driven and data-driven approaches, but model-based methods can trigger false alarms due to threshold setting issues. The current research proposes a novel data-driven method to address threshold setting issues in detecting and localizing FDIAs in power distribution systems. First, a dataset is created by recording estimated measurement values using an unscented Kalman filter and weighted least squares across various attack scenarios. These estimated measurements are then fed into a deep artificial neural network (ANN) for binary classification to detect attacks. The output, along with the estimated measurements, is used by another ANN to localize the corrupted meter zone. This deep learning-based approach improves threshold setting over the common chi-square method. Results show that the proposed deep learning method for FDIA detection and localization outperforms a recently proposed ensemble of shallow models. The area under the curve value increases by about 5% with lower training time. The approach is also effective against previously unseen attack strategies and different feeder topologies.

Lightweight omni-dimensional dynamic convolution with spatial-spectral self-attention network for hyperspectral image classification

ABSTRACT Omni-dimensional dynamic convolution can adjust spatial sizes, the amount of input/output channels, and kernel size based on the characteristics of the input, thus improving the capacity to extract characteristics through convolution, resulting in increased computation and model complexity. As a result, it is challenging to deploy these models on resource-limited airborne high-spectral testing systems. This paper proposes a lightweight omni-dimensional dynamic convolution network as a possible solution to this issue. In this network, the LS2CM module is used for spatial-spectral information extraction, and the pyramidal residual network is the basic architecture for extracting features from shallow to deep layers, and lightweight omni-dimensional dynamic convolution is adopted in the convolution module. Overcoming the pyramidal structure can only extract local information, we proposed a new simple spatial-spectral self-attention mechanism to extract global information from hyperspectral. Besides, the Huber function as an activation function. The IP, WHU-Hi-LongKou, SA, and PU datasets were used to verify the accuracy of the suggested network model. The results show that the proposed lightweight network maintains an appropriate equilibrium among model complexity as well as accuracy.

1D and 2D Feature Extraction Based on AAC and DC Protein Descriptors for Classification of Acetylation in Lysine Proteins using Convolutional Neural Network

Post-Translational Modification (PTM) denotes a biochemical alteration observed in an amino acid, playing crucial roles in protein activity, functionality, and the regulation of protein structure. The recognition of associated PTMs serves as a fundamental basis for understanding biological processes, therapeutic interventions for diseases, and the development of pharmaceutical agents. Using computational approaches (in silico) offers an efficient and cost-effective means to identify PTM sites swiftly. The exploration of protein classification commences with extracting protein sequence features that are subsequently transformed into numerical features for utilization in classification algorithms. Feature extraction methodologies involve using protein descriptors like Amino Acid Composition (AAC) and Dipeptide Composition (DC). Yet, these approaches exhibit a limitation by neglecting crucial amino acid sequence details. Moreover, both descriptor techniques generate a limited number of 1-dimensional (1D) features, which may not be ideal for processing through the Convolutional Neural Network (CNN) classification method. This investigation presents a novel approach to enhance feature diversity through protein sequence segmentation techniques, employing adjacent and overlapping segment strategies. Furthermore, the study illustrates the organization of features into 1D and 2D formats to facilitate processing through 1D CNN and 2D CNN classification methodologies. The findings of this research endeavour highlight the potential for enhancing the accuracy of acetylation classification in lysine proteins through the multiplication of protein sequence segments in a 2D configuration. The highest accuracy achieved for AAC and DC-based feature extraction methods is 77.39% and 76.75%, respectively.

An ultra lightweight neural network for automatic modulation classification in drone communications

Unmanned aerial vehicle (UAV)-assisted communication based on automatic modulation classification (AMC) technology is considered an effective solution to improve the transmission efficiency of wireless communication systems, as it can adaptively select the most suitable modulation method according to the current communication environment. However, many existing deep learning (DL)-based AMC methods cannot be directly applied to UAV platform with limited computing power and storage space, because of the contradiction between accuracy and efficiency. This paper mainly studies the lightweight of DL-based AMC networks to improve adaptability in resource-constrained scenarios. To address this challenge, we propose an ultra-lightweight neural network (ULNN). This network incorporates a lightweight convolutional structure, attention mechanism, and cross-channel feature fusion technique. Additionally, we introduce data augmentation (DA) based on signal phase offsets during the model training process, aimed at improving the model’s generalization ability and preventing overfitting. Through experimental validation on the public dataset RML2016.10 A, the ULNN we proposed achieves an average precision of 62.83% with only 8815 parameters and reaches a peak classification accuracy of 92.11% at SNR = 10 dB. The experimental results show that ULNN can achieve high recognition accuracy while keeping the model lightweight, and is suitable for UAV platform with limited resources.