Adaptive Convolutional Neural Network Research Articles

APSSF: Adaptive CNN Pruning Based on Structural Similarity of Filters

Convolutional neural network (CNN) pruning is a technique used to remove redundant parameters from the network. By doing so, it aims to greatly reduce the computational complexity and scale of the network while still preserving its accuracy. In the CNN, the majority of parameters are weights that form filters. When it comes to pruning, it is more effective to focus on removing redundant filters rather than insignificant weights within filters. The essence of filter pruning lies in determining the significance or contribution of each filter. Filters that have a significant contribution are kept, while others are pruned. Current methods for calculating contribution in pruning often rely on weight magnitude or filter similarity. However, approaches based solely on assume that small weights are unimportant and ignore correlation between filters, which leads to a significant loss of network accuracy. Those based on filter similarity flatten filter tensors into a vector when calculating filter similarity, and lose the important structural information of filters, or the superposition information of the weight convolution in the corresponding space position. These limitations can compromise the accuracy and effectiveness of the pruning process. This paper proposes an adaptive CNN pruning method based on the structural similarity of filters (APSSF) by taking both the structural characteristics of and the correlation between filters into the consideration for pruning filters. APSSF efficiently calculates the distance between the filters by factoring in information from all the dimensions of filters, and clusters the filters according to the distance threshold determined adaptively according to the compression rate, and deletes a certain number of filters from each category. On the CIFAR10 and ImageNet datasets, APSSF outperforms several state-of-the-art methods. On the CIFAR100, APSSF reduces parameters of networks by 91.71% and 74.80% on VGG-16 and ResNet-34, respectively. The accuracy was decreased only by 0.03 on VGG-16, while on ResNet-34, it was increased by 0.04.

FACNN: fuzzy-based adaptive convolution neural network for classifying COVID-19 in noisy CXR images.

COVID-19 detection using chest X-rays (CXR) has evolved as a significant method for early diagnosis of the pandemic disease. Clinical trials and methods utilize X-ray images with computer and intelligent algorithms to improve detection and classification precision. This article thus proposes a fuzzy-based adaptive convolution neural network (FACNN) model to improve the detection precision by confining the false rates. The feature extraction process between the successive regions is validated using a fuzzy process that classifies labeled and unknown pixels. The membership functions are derived based on high precision features for detection and false rate suppression process. The convolution neural network process is responsible for increasing detection precision through recurrent training based on feature availability. This availability analysis is verified using fuzzy derivatives under local variances. Based on variance-reduced features, the appropriate regions with labeled and unknown features are used for normal or infected classification. Thus, the proposed FACNN improves accuracy, precision, and feature extraction by 14.36%, 8.74%, and 12.35%, respectively. This model reduces the false rate and extraction time by 10.35% and 10.66%, respectively.

Modified Adaptive CNN for Deep Learning based Histopathological Image Analysis for Cancer Diagnosis

This research on cancer diagnosis is motivated by the need for more accurate and efficient diagnostic tools in the field of oncology. Traditional methods of histopathological examination are time-consuming and can be subject to human error. The adoption of deep learning techniques, particularly Convolutional Neural Networks (CNNs), presents an opportunity to significantly improve the precision and speed of cancer diagnosis through automated analysis of tissue samples. This research addresses current challenges, including variability in samples and limited dataset diversity, with the goal of enhancing the reliability and applicability of the developed models. The ultimate aim is to contribute to the advancement of diagnostic methodologies, providing clinicians with more reliable tools for early and accurate cancer detection and ultimately improving patient outcomes and treatment strategies. Using a modified adaptive CNN algorithm, trained on extensive pathology image datasets, the approach enhances the precision and speed of cancer cell detection in tissue samples. By utilizing these artificial intelligence tools, the diagnostic process becomes not only more accurate but also significantly expeditious. Despite the promising strides, certain challenges persist. Variability in tissue samples, limited availability of diverse datasets, and interpretability of deep learning models pose hurdles to widespread adoption. To address these challenges, this research focuses on developing robust models that can generalize well across diverse datasets. Additionally, efforts are being made to create more comprehensive and diverse datasets to improve model training. Results show accuracy exceeding 97%, sensitivity and specificity at 97% and 95%, F1 score reaching 96%, and precision at 96%.

Modified Adaptive CNN for Deep Learning based Histopathological Image Analysis for Cancer Diagnosis

This research on cancer diagnosis is motivated by the need for more accurate and efficient diagnostic tools in the field of oncology. Traditional methods of histopathological examination are time-consuming and can be subject to human error. The adoption of deep learning techniques, particularly Convolutional Neural Networks (CNNs), presents an opportunity to significantly improve the precision and speed of cancer diagnosis through automated analysis of tissue samples. This research addresses current challenges, including variability in samples and limited dataset diversity, with the goal of enhancing the reliability and applicability of the developed models. The ultimate aim is to contribute to the advancement of diagnostic methodologies, providing clinicians with more reliable tools for early and accurate cancer detection and ultimately improving patient outcomes and treatment strategies. Using a modified adaptive CNN algorithm, trained on extensive pathology image datasets, the approach enhances the precision and speed of cancer cell detection in tissue samples. By utilizing these artificial intelligence tools, the diagnostic process becomes not only more accurate but also significantly expeditious. Despite the promising strides, certain challenges persist. Variability in tissue samples, limited availability of diverse datasets, and interpretability of deep learning models pose hurdles to widespread adoption. To address these challenges, this research focuses on developing robust models that can generalize well across diverse datasets. Additionally, efforts are being made to create more comprehensive and diverse datasets to improve model training. Results show accuracy exceeding 97%, sensitivity and specificity at 97% and 95%, F1 score reaching 96%, and precision at 96%.

A generative adaptive convolutional neural network with attention mechanism for driver fatigue detection with class-imbalanced and insufficient data

Over the past few years, fatigue driving has emerged as one of the main causes of traffic accidents, necessitating the development of driver fatigue detection systems. However, many existing methods involves tedious manual parameter tunings, a process that is both time-consuming and results in task-specific models. On the other hand, most of the researches on fatigue recognition are based on class-balanced and sufficient data, and effectively “mine” meaningful information from class-imbalanced and insufficient data for fatigue recognition is still a challenge. In this paper, we proposed two novel models, the attention-based residual adaptive multiscale fully convolutional network-long short term memory network (ARMFCN-LSTM), and the Generative ARMFCN-LSTM (GARMFCN-LSTM) aiming to address this issue. ARMFCN-LSTM excels at automatically extracting multiscale representations through adaptive multiscale temporal convolutions, while capturing temporal dependency features through LSTM. GARMFCN-LSTM integrates Wasserstein GAN with gradient penalty (WGAN-GP) into ARMFCN-LSTM to improve driver fatigue detection performance by alleviating data scarcity and addressing class imbalances. Experimental results show that ARMFCN-LSTM achieves the highest classification accuracy of 95.84% in driver fatigue detection on the class-balanced EEG dataset (binary classification), and GARMFCN-LSTM attained an improved classification accuracy of 84.70% on the class-imbalanced EOG dataset (triple classification), surpassing the competing methods. Therefore, the proposed models are promising for further implementations in online driver fatigue detection systems.

Hourly load prediction based feature selection scheme and hybrid CNN‐LSTM method for building's smart solar microgrid

AbstractThe short‐term load prediction is the critical operation in the peak demand administration and power generation scheduling of buildings that integrated the smart solar microgrid (SSM). Many research studies have proved that hybrid deep learning strategies achieve more accuracy and feasibility in practical applications than individual algorithms. Moreover, many buildings have integrated the SSM on the rooftop with the battery management system (BMS) to enhance energy efficiency management. However, the traditional methodologies only processed the weather parameters and power demand information for short‐term load prediction, ignoring the collected data from SSM and BMS by the advanced metering infrastructures (AMI), which probably improved prediction accuracy. In this research, many accumulated data of building and SSM are collected before methodology implementation. Considering the diversities of accumulated parameters from SSM and BMS, an adaptive convolution neural network long short‐term memory (CNN‐LSTM) is proposed for hourly electrical load prediction. The CNN could extract the critical large‐scale input feature, while the LSTM could achieve better accurate forecasts. The Pearson correlation matrix is calculated for the feature selection scheme from different data units. The hyperparameter tuning is utilized for obtaining the optimized hybrid CNN‐LSTM algorithm. The K‐fold cross‐validation is employed for deep learning algorithm verification, which includes LSTM, GRU, CNN, and Bi‐LSTM methodologies. The results prove that the hybrid CNN‐LSTM achieved outperformed improvements, which are 20.57%, 29.63%, 19.06% in MSE, MAE, MAPE, and 21.24%, 22.02%, 3.82% in validating MSE, MAE, MAPE, respectively. The hybrid CNN and LSTM combined with the feature selection scheme achieve superior predicting accuracies, proving the adaptability ability for integrating into the energy management system (EMS) of the building's SSM.

Adaptive Global Power-of-Two Ternary Quantization Algorithm Based on Unfixed Boundary Thresholds.

In the field of edge computing, quantizing convolutional neural networks (CNNs) using extremely low bit widths can significantly alleviate the associated storage and computational burdens in embedded hardware, thereby improving computational efficiency. However, such quantization also presents a challenge related to substantial decreases in detection accuracy. This paper proposes an innovative method, called Adaptive Global Power-of-Two Ternary Quantization Based on Unfixed Boundary Thresholds (APTQ). APTQ achieves adaptive quantization by quantizing each filter into two binary subfilters represented as power-of-two values, thereby addressing the accuracy degradation caused by a lack of expression ability of low-bit-width weight values and the contradiction between fixed quantization boundaries and the uneven actual weight distribution. It effectively reduces the accuracy loss while at the same time presenting strong hardware-friendly characteristics because of the power-of-two quantization. This paper extends the APTQ algorithm to propose the APQ quantization algorithm, which can adapt to arbitrary quantization bit widths. Furthermore, this paper designs dedicated edge deployment convolutional computation modules for the obtained quantized models. Through quantization comparison experiments with multiple commonly used CNN models utilized on the CIFAR10, CIFAR100, and Mini-ImageNet data sets, it is verified that the APTQ and APQ algorithms possess better accuracy performance than most state-of-the-art quantization algorithms and can achieve results with very low accuracy loss in certain CNNs (e.g., the accuracy loss of the APTQ ternary ResNet-56 model on CIFAR10 is 0.13%). The dedicated convolutional computation modules enable the corresponding quantized models to occupy fewer on-chip hardware resources in edge chips, thereby effectively improving computational efficiency. This adaptive CNN quantization method, combined with the power-of-two quantization results, strikes a balance between the quantization accuracy performance and deployment efficiency in embedded hardware. As such, valuable insights for the industrial edge computing domain can be gained.

Unsupervised rolling bearing fault diagnosis method across working conditions based on multiscale convolutional neural network

In practical engineering, the features of rolling bearing vibration signals often vary in distribution under different working conditions, and obtaining sample labels for target working conditions can be challenging. Therefore, a multi-scale depth subdomain adaptive convolutional neural network (MS-DSACNN) fault diagnosis method is proposed. The MS-DSACNN method is based on a multi-scale feature extraction method combined with an improved 1D-ConvNeXt architecture, which fuses low- and high-level features into multi-scale fault features. A channel attention mechanism is also introduced to adaptively assign weights to the fused multi-scale features. The local maximum mean discrepancy is constructed by extracting features and their corresponding source and pseudo-label inputs for the source and target working conditions, respectively, to construct the loss function for backpropagation. The MS-DSACNN model was evaluated in experiments with two different loads and one variable speed dataset. The experimental results indicate that MS-DSACNN has higher feature extraction capability and diagnostic accuracy than other unsupervised cross-condition fault diagnosis techniques. Additionally, the scenario where the signal captured by the sensor contains a considerable amount of noise in actual working conditions is considered.

A non-intrusive load recognition method combining adaptive PSO algorithm and CNN model

Real-time monitoring of electricity usage details through load monitoring techniques is a crucial aspect of smart power grid management and monitoring, allowing for the acquisition of information on the electricity usage of individual appliances for power users. Accurate detection of electricity load is essential for refined load management and monitoring of power supply quality, facilitating the improvement of power management at the user side and enhancing power operation efficiency. Non-intrusive load monitoring (NILM) techniques require only the analysis of total load data to achieve load monitoring of electricity usage details, and offer advantages such as low cost, easy implementation, high reliability, and user acceptance. However, with the increasing number of distributed new load devices on the user side and the diversification of device development, simple load recognition algorithms are insufficient to meet the identification needs of multiple devices and achieve high recognition accuracy. To address this issue, a non-intrusive load recognition (NILR) model that combines an adaptive particle swarm optimization algorithm (PSO) and convolutional neural network (CNN) has been proposed. In this model, pixelated images of different electrical V-I trajectories are used as inputs for the CNN, and the optimal network layer and convolutional kernel size are determined by the adaptive PSO optimization algorithm during the CNN training process. The proposed model has been validated on the public dataset PLAID, and experimental results demonstrate that it has achieved a overall recognition accuracy of 97.26% and F-1 score of 96.92%, significantly better than other comparison models. The proposed model effectively reduces the confusion between various devices, exhibiting good recognition and generalization capabilities.

A SENTIMENT ANALYSIS MODEL FOR ELECTROENCEPHALOGRAM SIGNALS OF STUDENTS IN UNIVERSITIES USING A CONVOLUTIONAL NEURAL NETWORK AND SUPPORT VECTOR MACHINE MODELS

Sentiment analysis in teaching evaluation has significant implications. By analyzing students’ sentiments toward instructors, educational institutions can gain valuable insights into teaching effectiveness. These data can guide curriculum development, instructional improvements, and faculty training initiatives. Positive sentiment indicates effective teaching methods, engagement, and student satisfaction; negative sentiment flags areas that need attention. Sentiment analysis can help identify patterns, trends, and outliers, aiding in targeted interventions and personalized support. It also enables comparisons across different courses, instructors, and departments. However, it is crucial to ensure the accuracy and fairness of sentiment analysis algorithms, considering potential biases and the contextual nature of the feedback. This study proposes a sentiment classification model CNN–SVM that combines a convolutional neural network (CNN) and a support vector machine (SVM). Taking students majoring in art in comprehensive colleges and universities as the research object, by collecting the electroencephalogram (EEG) signals of students during teaching evaluation. CNN–SVM is used as the emotional analysis model to obtain the emotional analysis of teaching evaluation results. EEG is a typical physiological signal, and data based on this signal can more truly reflect student emotions. The adaptive CNN feature extraction function and the super generalization classification performance of SVM can reduce the individual differences and data noise between data, thereby improving sentiment classification performance. The experimental results demonstrate that using technology to analyze sentiment can assist educational institutions in more properly comprehending the feedback and opinions of students on instruction. With regard to sentiment analysis, the CNN–SVM method that is derived to produce the fusion algorithm has solid performance.

Deep learning of electromechanical admittance data augmented by generative adversarial networks for flexural performance evaluation of RC beam structure

Deep learning networks facilitate automated damage identification and performance evaluation for concrete structures using electromechanical impedance/admittance (EMI/EMA) technique, while data quantity and quality limit the performance of such a data-driven network. For the first time, this paper proposed a data-augmentation approach using deep-convolutional admittance generative adversarial networks (AdmiGAN) to solve data deficiency and measurement inefficiency for deep learning-based flexural performance evaluation of reinforced concrete (RC) structures. In the approach, a new data normalization procedure was developed to collaboratively foster AdmiGAN-based EMA data synthesis, and synthetic datasets were fed into an adaptive convolutional neural network (CNN) for deep learning. Proof-of-concept experiment was conducted on a four-point bending RC beam structure, which was continuously monitored from initial loading to final failure by three surface-bonded piezoelectric ceramic lead zirconate titanate (PZT) patches. Qualitative detection of stress and damage was performed by traditional feature analysis of EMA signatures, automated performance evaluation was attempted by using CNN approach. Results demonstrated that the AdmiGAN required merely 5 groups of EMA signatures to generate high-accuracy dataset with 174 times of speed faster than conventional measurement method, and the AdmiGAN cooperated with CNN provided a new paradigm of data-driven structural performance evaluation with high accuracy, efficiency, and intelligence.

Intelligent fault diagnosis of worm gearbox based on adaptive CNN using amended gorilla troop optimization with quantum gate mutation strategy

The worm gearbox is a power transmission system that has various applications in industries. Being vital element of machinery, it becomes necessary to develop a robust fault diagnosis scheme for worm gearbox. Due to advancements in sensor technology, researchers from academia and industries prefer deep learning models for fault diagnosis. The optimal selection of hyperparameters (HPs) of deep learning models plays a significant role in stable performance. Existing methods mainly focused on manual tunning of these parameters, which is a troublesome process and sometimes leads to inaccurate results. Thus, exploring more sophisticated methods to optimize the HPs automatically is important. In this work, a novel optimization, i.e. amended gorilla troop optimization (AGTO), has been proposed to make the convolutional neural network (CNN) adaptive for extracting the features to identify the worm gearbox defects. Initially, the vibration and acoustic signals are converted into 2D images by the Morlet wavelet function. Then, the initial model of CNN is developed by setting hyperparameters. The search space of each HP is identified and optimized by the developed AGTO algorithm. The classification accuracy has been evaluated by AGTO-CNN, which is further validated by the confusion matrix. The performance of the developed model has also been compared with other models. It has been observed that the proposed AGTO not only achieved the highest degree of recognition accuracy i.e. 98.95 % but also achieved the least standard of deviation of 0.2145 than that of other classifiers. The AGTO algorithm is examined on twenty-three classical benchmark functions and the Wilcoxon test which demonstrates the effectiveness and dominance of the developed optimization algorithm. The results obtained suggested that the AGTO-CNN has the highest diagnostic accuracy, more stable while diagnosing the worm gearbox.

MM-GLCM-CNN: A multi-scale and multi-level based GLCM-CNN for polyp classification.

Distinguishing malignant from benign lesions has significant clinical impacts on both early detection and optimal management of those early detections. Convolutional neural network (CNN) has shown great potential in medical imaging applications due to its powerful feature learning capability. However, it is very challenging to obtain pathological ground truth, addition to collected in vivo medical images, to construct objective training labels for feature learning, leading to the difficulty of performing lesion diagnosis. This is contrary to the requirement that CNN algorithms need a large number of datasets for the training. To explore the ability to learn features from small pathologically-proven datasets for differentiation of malignant from benign polyps, we propose a Multi-scale and Multi-level based Gray-level Co-occurrence Matrix CNN (MM-GLCM-CNN). Specifically, instead of inputting the lesions' medical images, the GLCM, which characterizes the lesion heterogeneity in terms of image texture characteristics, is fed into the MM-GLCN-CNN model for the training. This aims to improve feature extraction by introducing multi-scale and multi-level analysis into the construction of lesion texture characteristic descriptors (LTCDs). To learn and fuse multiple sets of LTCDs from small datasets for lesion diagnosis, we further propose an adaptive multi-input CNN learning framework. Furthermore, an Adaptive Weight Network is used to highlight important information and suppress redundant information after the fusion of the LTCDs. We evaluated the performance of MM-GLCM-CNN by the area under the receiver operating characteristic curve (AUC) merit on small private lesion datasets of colon polyps. The AUC score reaches 93.99% with a gain of 1.49% over current state-of-the-art lesion classification methods on the same dataset. This gain indicates the importance of incorporating lesion characteristic heterogeneity for the prediction of lesion malignancy using small pathologically-proven datasets.

Transfer multiscale adaptive convolutional neural network for few-shot and cross-domain bearing fault diagnosis

Bearing intelligent fault diagnosis has been researched comprehensively in recent years. However, the scarcity of labeled training samples and various working conditions seriously hinder the widespread application of deep learning based fault diagnosis methods. To address this problem, we propose a transfer multiscale adaptive convolutional neural network (TMACNN), which significantly enhances the performance of deep learning based methods on few-shot and cross-domain bearing fault diagnosis in terms of network architecture and transfer strategy. On the one hand, we design a novel multiscale adaptive convolutional neural network (MACNN) framework that effectively improves the feature extraction and generalization abilities for bearing fault diagnosis by introducing mega-scale convolutions and continuous stacked multiscale convolutions. On the other hand, we propose an innovative transfer strategy for the MACNN that freezes the six stacked multiscale convolutional feature extraction units and fine-tunes the mega-scale convolution unit and the classifier, which are more suitable for few-shot transfer learning. In experiments on the CWRU dataset and Paderborn dataset, our proposed TMACNN outperforms various advanced baseline models for few-shot and cross-domain bearing fault diagnosis.

An evolutionary framework for designing adaptive convolutional neural network

An evolutionary framework for designing adaptive convolutional neural network

A Comparative Study of the CNN Based Models Used for Remote Sensing Image Classification

Remotely sensed images, their classification and accuracy play a vital role in measuring a country’s scientific growth and technological development. Remote Sensing (RS) can be interpreted as a way of assessing the characteristics of a surface or an entity from a distance. This task of identifying and classifying datasets of RS images can be done using Convolutional Neural Network (CNN). For classifying images of large-scale areas, the traditional CNN approach produces coarse maps. For addressing this issue, Object based CNN method can be used. Classifying images with high spatial resolution can be done effectively using Object based image analysis. Deep learning methods offer the strength of auto learning the spatial features of an image. Object scale based adaptive CNN is a novel technique that can improve the accuracy of image classification of high spatial resolution images. For efficient RS image classification, a novel Deep learning approach called distributed CNN can be used which leads to enhanced accuracy of RS image classification. In this paper, three CNN models have been compared while considering the training time and efficiency to classify RS images as parameters of measure to assess the CNN models.

Adaptive Direction-of-Arrival Estimation Using Deep Neural Network in Marine Acoustic Environment

Deep learning is widely used for target detection and direction-of-arrival (DOA) estimation due to its powerful data fitting capability. However, limited by different environments and number of sound sources, it is difficult to be applied to complex underwater environments. We propose a two-stage approach called Beam-Network for underwater acoustic DOA estimation. In the first stage, local beam patterns with different data augmentation methods, carrying the essential information required for target detection, are used as the input feature to our model. In the second stage, an adaptive convolutional neural network (CNN) is proposed to construct a classification model. Only single-source data are required for model training and data from multi sources can be tested. What’s more, the model is suitable for arrays with different numbers of hydrophones in different geometrical arrangements. The performance of the proposed method is evaluated by comparing with mainstream DOA estimation algorithms such as CBF, MUSIC, MVDR, and SBL. In three simulation scenarios and two sets of recorded data from different marine environments, the proposed method has higher directivity and lower angular root-mean-squared error (RMSE).

Development of acoustic source localization with adaptive neural network using distance mating‐based red deer algorithm

AbstractMultichannel, audio processing approaches are widely examined in human–computer interaction, autonomous robots, audio surveillance, and teleconferencing systems. The numerous applications are linked to the speech technology and acoustic analysis area. Much attention is received to the active speakers and spatial localization of acoustic sources on the acoustic sensor arrays. Baseline approaches provide negotiable performance in a real‐world comprised of far‐field/near‐field monitoring, reverberant and noisy environments, and also the outdoor/indoor scenarios. A practical system to detect defects in complex structures is the time difference mapping (TDM) technique. The significant scope of the research is to search the location using the minimum distance point in the time difference database to be apart from the verification point. In the case of the improved “time difference mapping (I‐TDM)” technique and traditional “time difference mapping (T‐TDM)” technique, the denser grids and vast database permit increased accuracy. In the database, if the location points are not present, then the accurate localization of the I‐TDM and T‐TDM techniques is damaged. Hence, to handle these problems, this article plans to develop acoustic source localization according to the deep learning strategy. The audio dataset is gathered from the benchmark source called the SSLR dataset and is initially subjected to preprocessing, which involves artifact removal and smoothing for effective processing. Further, the adaptive convolutional neural network (CNN)‐based feature set creation is performed. Here, the adaptive CNN is accomplished by the improved optimization algorithm called distance mating‐based red deer algorithm (DM‐RDA). With this trained feature set, the acoustic source localization is done by the weight updated deep neural network, in which the same DM‐RDA is used for optimizing the training weight. The simulation outcome proves that the designed model produced enhanced performance compared to other traditional source localization estimators.

A Data-Driven Diagnosis Scheme Based on Deep Learning toward Fault Identification of the Hydraulic Piston Pump

The piston pump is the significant source of motive force in a hydraulic transmission system. Owing to the changeable working conditions and complex structural characteristics, multiple friction pairs in the piston pump are prone to wear and failure. An accurate fault diagnosis method is a crucial guarantee for system reliability. Deep learning provides a great insight into the intelligent exploration of machinery fault diagnosis. Hyperparameters are very important to construct an effective deep model with good performance. This research fully mines the feature component from vibration signals, and converts the failure recognition into a classification issue via establishing a deep model. Furthermore, Bayesian algorithm is introduced for hyperparameter optimization as it considers prior information. An adaptive convolutional neural network is established for typical failure pattern recognition of an axial piston pump. The proposed method can automatically complete fault classification and represents a higher accuracy by experimental verification. Typical failures of an axial piston pump are intelligently diagnosed with reduced subjectivity and preprocessing knowledge. The proposed method achieves an identification accuracy of more than 98% for five typical conditions of an axial piston pump.

Automatic severity grade classification of diabetic retinopathy using deformable ladder Bi attention U-net and deep adaptive CNN.

Long-term exposure to diabetes mellitus leads to the formation of diabetic retinopathy (DR), which can cause vision loss in working-age adults. Early stage diagnosis of DR is highly essential for preventing vision loss and preserving vision in people with diabetes. The motivation behind the severity grade classification of DR is to develop an automated system that can assist ophthalmologists and healthcare professionals in the diagnosis and management of DR. However, existing methods suffer from variability in image quality, similar structures of the normal and lesion regions, high dimensional features, variability in disease manifestations, small datasets, high training loss, model complexity, and overfitting, which leads to high misclassification errors in the severity grading system. Hence, there is a need to develop an automated system using improved deep learning techniques to provide a reliable and consistent grading of DR severity with high classification accuracy using fundus images. To solve these issues, we proposes a Deformable Ladder Bi attention U-shaped encoder-decoder network and Deep Adaptive Convolutional Neural Network (DLBUnet-DACNN) for accurate severity classification of DR. The DLBUnet performs lesion segmentation that can be divided into three parts: the encoder, the central processing module and the decoder. In the encoder part, deformable convolution is used instead of convolution to learn different shapes of the lesion by understanding the offset location. Afterwards, Ladder Atrous Spatial Pyramidal Pooling (LASPP) using variable dilation rates is introduced in the central processing module. LASPP enhance the tiny lesion features and variable dilation rates avoid gridding effects and can learn better global context information. Then the decoder part uses a bi-attention layer contains spatial and channel attention, which can learn contour and edges of the lesion accurately. Finally, the severity of DR is classified using a DACNN by extracting the discriminative features from the segmentation results. Experiments are conducted on the Messidor-2, Kaggle, and Messidor datasets. Our proposed method DLBUnet-DACNN achieves better results in terms of accuracy of 98.2, recall of 0.987, kappa coefficient of 0.993, precision of 0.98, F1-score of 0.981, Matthews Correlation Coefficient (MCC) of 0.93 and Classification Success Index (CSI) of 0.96 when compared to existing methods.