Enhanced Convolutional Neural Network Research Articles

Enhanced convolution neural network and improved SVM to detect and classify diabetic retinopathy

Enhanced convolution neural network and improved SVM to detect and classify diabetic retinopathy

Feature rectification and enhancement for no-reference image quality assessment

The assessment of image is a critical task in computer vision, particularly in a no-referenced context, which presents numerous challenges. Though Deep neural networks have exhibited excellent performance on no-reference quality assessment (NR-IQA), the distortion-aware NR-IQA methods are limited to specific distortion type and struggle to handle realistic distortion scenarios. In this work, we propose a feature rectification and enhancement convolutional neural network namely FREIQA for NR-IQA. Our approach targets to fully utilize the multi-stage semantic features to produce a well fused and rectified score vector for effective image quality regression. Specifically, the multi-stage semantic features extracted by a pre-trained backbone would be rectified with a multi-level channel attention module before integrating to a global score vector. The fused score vector then will be gradually optimized through the perception feature provided by the multi-stage semantic feature, and finally sent to quality regression network to obtain the image quality score. Experimental results on public benchmarks including LIVE, TID2013, CSIQ, LIVEC, KADID-10k, KonIQ-10k and Waterloo exploration database show that our FREIQA achieve the state-of-the-art performance.

Enhanced Convolutional Neural Network for solar radiation nowcasting: All-Sky camera infrared images embedded with exogeneous parameters

Electrical power production by renewable energy sources is unpredictable in nature and this may cause imbalance between power generation and demand. Therefore, an accurate prediction of solar radiation is crucial for the stability and efficient management of electric grid. This study focuses on very short-term forecasts of solar radiation with a horizon in the range of 5–15 min. In this paper, a Convolutional Neural Network is proposed that uses sequences of infrared images captured by an All-Sky Imager to forecast the Global Horizontal Irradiance on different time horizon. A real case study, exploiting six months of high-resolution data, is analyzed. Additionally, an innovative technique, the Enhanced Convolutional Neural Network (ECNN), is proposed in which exogenous data, as the solar radiation measurement, is encoded in terms of colored pixels in the upper corner of the images. Considering the naïve persistence method as a baseline, a clear improvement across the key metrics has been noted with the proposed methodology. A deeper analysis of the results reveals that the proposed models are more accurate than persistence when high fluctuations of solar radiation are experienced. In that case, the ECNN achieves a forecast skill exceeding 19% for all the tested forecast horizons.

Feature Extraction Based Machine Learning Approach for Bone Cancer Detection

Osteosarcoma is a type of cancer that develops in the bones. Though it can happen in any bone, it commonly happens in long bones like the legs and arms. As a result, early detection and categorization of bone cancers have become critical for treating patients. A wavelet-based segmentation algorithm was utilized in this work to detect bone cancers. The segmented bone cancer components were then processed further for categorization. The enhanced convolutional neural network (ECNN) classification was employed in this investigation to differentiate between benign and malignant bone cancers. Collect multiple photos and use wavelet transform features to extract a trained classifier model. Sensitivity (97%), Specificity (97%), Precision (98%), Accuracy (97.5%), and F1Score (97.5) are the performance metrics for the ECNN deep learning (DL) algorithm. According to the results, ECNN deep learning beats deep learning methods, including SVM, ANN, and RNN. As a result, the ECNN deep learning technology can be used to diagnose bone cancer more accurately. Based on histology pictures, our enhanced model performs at the cutting edge of detecting osteosarcoma cancer.

Computer aided detection of leaf disease in agriculture using convolution neural network based squeeze and excitation network

ABSTRACT The support rendered by artificial intelligence in plant disease diagnosis and with drastic progression in the agricultural technology, it is necessary to do pertinent research for the cause of long-term agricultural development. Numerous diseases like early and late blight have a significant influence on the quality and quantity of potatoes. Manual interpretation turns out to be a time-consuming process in sorting out leaf diseases. In order to classify various diseases like fungal, viral and bacterial infections in the potato leaf, an enhanced Convolution Neural Network based on VGG16 is used for potato leaf disease classification. Improved Median filter is also used which eradicates the noise to a greater extent. The convolution layers of VGG16 along with the Inception and the SE block are used in this research for classification. The global average pooling layer is used to reduce model training parameters, layer and Squeeze and Excitation Network attention mechanism is used to improve the model’s ability to extract features. The approximate calculations can be done by using soft computing. Compared with other traditional convolutional neural networks, the proposed model achieved the highest classification accuracy of 99.3%

A Hybrid Algorithm for Feature Selection and Classification

<p>With a recent spread of intelligent information systems, massive data collections with a lot of repeated and unintentional, unwanted interference oriented data are gathered and a huge feature set are being operated. Higher dimensional inputs, on the other hand, contain more correlated variables, which might have a negative impact on model performance. In our model a Hybrid method of selecting feature was developed by combining Binary Gravitational Search Particle Swarm Optimization (HBGSPSO) method with an Enhanced Convolution Neural Network Bidirectional Long Short Term Memory (ECNN-BiLSTM). In our proposed system, the Bidirectional Long Short Term Memory (BiLSTM) is introduced which extracts the hidden dynamic data and utilizes the memory cells to think of long-term historical data after the convolution process. In this paper, thirteen well-defined datasets are used from the machine learning database of UC Irvine to evaluate the efficiency of the proposed system. The experiments are conducted using K Nearest Neighbor (KNN) and Decision Tree (DT) which are used as classifiers to evaluate the outcome of selected features. The outcomes are contrasted and compared with the bio-enlivened calculations like Genetic Algorithm (GA), Grey Wolf Optimizer (GWO), and Optimization protocol using Particle Swarm Optimization (PSO).</p> <p> </p>

Structural Health Monitoring of Composite Pipelines Utilizing Fiber Optic Sensors and an AI-Based Algorithm-A Comprehensive Numerical Study.

In this paper, a structural health monitoring (SHM) system is proposed to provide automatic early warning for detecting damage and its location in composite pipelines at an early stage. The study considers a basalt fiber reinforced polymer (BFRP) pipeline with an embedded Fiber Bragg grating (FBG) sensory system and first discusses the shortcomings and challenges with incorporating FBG sensors for accurate detection of damage information in pipelines. The novelty and the main focus of this study is, however, a proposed approach that relies on designing an integrated sensing-diagnostic SHM system that has the capability to detect damage in composite pipelines at an early stage via implementation of an artificial intelligence (AI)-based algorithm combining deep learning and other efficient machine learning methods using an Enhanced Convolutional Neural Network (ECNN) without retraining the model. The proposed architecture replaces the softmax layer by a k-Nearest Neighbor (k-NN) algorithm for inference. Finite element models are developed and calibrated by the results of pipe measurements under damage tests. The models are then used to assess the patterns of the strain distributions of the pipeline under internal pressure loading and under pressure changes due to bursts, and to find the relationship of strains at different locations axially and circumferentially. A prediction algorithm for pipe damage mechanisms using distributed strain patterns is also developed. The ECNN is designed and trained to identify the condition of pipe deterioration so the initiation of damage can be detected. The strain results from the current method and the available experimental results in the literature show excellent agreement. The average error between the ECNN data and FBG sensor data is 0.093%, thus confirming the reliability and accuracy of the proposed method. The proposed ECNN achieves high performance with 93.33% accuracy (P%), 91.18% regression rate (R%) and a 90.54% F1-score (F%).

Multiple vehicles tracking and detection using weight high order singular value decomposition dimensionality reduction and double classifiers

Controlling and managing city traffic is one of them. In order to use image processing to prevent accidents on the road, vehicle tracking and detection are essential. By following moving objects, surveillance video monitoring and human activity recording are carried out. By taking this into account, a useful technique for image processing that detects automobiles from the image is suggested. For numerous vehicle tracking and detection systems, the ECNN-SVM (Enhanced Convolution Neural Network with Support Vector Machine) has just been introduced. However, the larger dimensional data space and inaccurate edge recognition make this system’s performance difficult. The WHOSVD (Weight High Order Singular Value Decomposition) approach, which reduces the dimension and breaks up the positive and negative training picture samples, is established to improve training speed and visual vehicle recognition. To effectively identify the edges at corners, improved canny edge detection is used for edge detection. Mean Kernel Fuzzy C Means (MKFCM) clustering algorithm-based three-dimensional bounding box estimation is used to identify the vehicle items. By merging the feature value of samples with their class labels, the Speed Factor Based Cuckoo Search Algorithm (SFCSA) is introduced for feature selection. The WHOSVD algorithm was used as the input for the enhanced convolutional neural network (ECNN), which is introduced for low-dimensional space and is used for vehicle detection and tracking. Occlusion problems are resolved and target features are further identified using a machine learning classifier. For common algorithms like CNN+SVM, Support Vector Machine (SVM), and the proposed technique, experimentation is done in regards to the metrics of accuracy, f-measure, precision, and recall for performance evaluation.

An optimized automated recognition of infant sign language using enhanced convolution neural network and deep LSTM

An optimized automated recognition of infant sign language using enhanced convolution neural network and deep LSTM

H. pylori Related Atrophic Gastritis Detection Using Enhanced Convolution Neural Network (CNN) Learner.

Atrophic gastritis (AG) is commonly caused by the infection of the Helicobacter pylori (H. pylori) bacteria. If untreated, AG may develop into a chronic condition leading to gastric cancer, which is deemed to be the third primary cause of cancer-related deaths worldwide. Precursory detection of AG is crucial to avoid such cases. This work focuses on H. pylori-associated infection located at the gastric antrum, where the classification is of binary classes of normal versus atrophic gastritis. Existing work developed the Deep Convolution Neural Network (DCNN) of GoogLeNet with 22 layers of the pre-trained model. Another study employed GoogLeNet based on the Inception Module, fast and robust fuzzy C-means (FRFCM), and simple linear iterative clustering (SLIC) superpixel algorithms to identify gastric disease. GoogLeNet with Caffe framework and ResNet-50 are machine learners that detect H. pylori infection. Nonetheless, the accuracy may become abundant as the network depth increases. An upgrade to the current standards method is highly anticipated to avoid untreated and inaccurate diagnoses that may lead to chronic AG. The proposed work incorporates improved techniques revolving within DCNN with pooling as pre-trained models and channel shuffle to assist streams of information across feature channels to ease the training of networks for deeper CNN. In addition, Canonical Correlation Analysis (CCA) feature fusion method and ReliefF feature selection approaches are intended to revamp the combined techniques. CCA models the relationship between the two data sets of significant features generated by pre-trained ShuffleNet. ReliefF reduces and selects essential features from CCA and is classified using the Generalized Additive Model (GAM). It is believed the extended work is justified with a 98.2% testing accuracy reading, thus providing an accurate diagnosis of normal versus atrophic gastritis.

Autism Spectrum Disorder Detection Using Enhanced Convolutional Neural Network and Wearable Sensors

Stereotypical Motor Movements (SMMs) may seriously impede learning and social relationships are one of the distinctive and typical postural or motor behaviours linked with autism spectrum disorders (ASDs). A reliable infrastructure for automatic and quick SMM detection is provided by wireless retail sensor technology, which would facilitate targeted intervention and perhaps provide early warning of meltdown occurrences. However, because of significant inter- and intra-subject variability that is challenging for handmade features to handle, the detection and quantification of SMM patterns remain challenging. In this work, we suggest using the Enhanced Convolutional Neural Network (ECNN) to extract distinguishing characteristics directly from multi-sensor accelerometer inputs. Parameters of the ECNN are tuned using whale optimization. Results with Enhanced convolutional neural networks produce accurate and robust SMM detectors.

Enhanced Machine-Learning Techniques for Medium-Term and Short-Term Electric-Load Forecasting in Smart Grids

Nowadays, electric load forecasting through a data analytic approach has become one of the most active and emerging research areas. It provides future consumption patterns of electric load. Since there are large fluctuations in both electricity production and use, it is a difficult task to achieve a balance between electric load and demand. By analyzing past electric consumption records to estimate the upcoming electricity load, the issue of fluctuating behavior can be resolved. In this study, a framework for feature selection, extraction, and regression is put forward to carry out the electric load prediction. The feature selection phase uses a combination of extreme gradient boosting (XGB) and random forest (RF) to determine the significance of each feature. Redundant features in the feature extraction approach are removed by applying recursive feature elimination (RFE). We propose an enhanced support vector machine (ESVM) and an enhanced convolutional neural network (ECNN) for the regression component. Hyperparameters of both the proposed approaches are set using the random search (RS) technique. To illustrate the effectiveness of our proposed strategies, a comparison is also performed between the state-of-the-art approaches and our proposed techniques. In addition, we perform statistical analyses to prove the significance of our proposed approaches. Simulation findings illustrate that our proposed approaches ECNN and ESVM achieve higher accuracies of 98.83% and 98.7%, respectively.

Suspicious Actions Detection System Using Enhanced CNN and Surveillance Video

Suspicious pre- and post-activity detection in crowded places is essential as many suspicious activities may be carried out by culprits. Usually, there will be installations of surveillance cameras. These surveillance cameras capture videos or images later investigated by authorities and post-event such suspicious activity would be detected. This leads to high human intervention to detect suspicious activity. However, there are no systems available to protect valuable things from such suspicious incidents. Nowadays machine learning (ML)- and deep learning (DL)-based pre-incident warning alarm systems could be adapted to monitor suspicious activity. Suspicious activity prediction would be based on human gestures and unusual activity detection. Even though some methods based on ML or DL have been proposed, the need for a highly accurate, highly precise, low-false-positive and low-false-negative prediction system can be enhanced by hybrid or enhanced ML- or DL-based systems. This proposed research work has introduced an enhanced convolutional neural network (ECNN)-based suspicious activity detection system. The experiment was carried out and the results were claimed. The results are analyzed with the Statistical Package for the Social Sciences (SPSS) tool. The results showed that the mean accuracy, mean precision, mean false-positive rate, and mean false-negative rate of suspicious activity detections were 97.050%, 96.743%, 2.957%, and 2.927% respectively. This result was also compared with the convolutional neural network (CNN) algorithm. This research work can be applied to enhance the pre-suspicious activity alert security system to avoid risky situations.

An attention-enhanced multi-modal deep learning algorithm for robotic compound fault diagnosis

Compound fault diagnosis plays a critical role in lowering the maintenance time and cost of industrial robots. With the advance of deep learning and industrial big data, a compound fault diagnosis model can be established through a data-driven approach. However, current methods mainly focus on the single fault diagnosis of assets, which cannot achieve satisfactory performance for compound fault diagnosis. This study proposes a compound fault diagnosis algorithm for an industrial robot based on multi-modal feature extraction and fusion. Firstly, the multi-head self-attention enhanced convolution neural network module and long short-term memory network module are adopted to learn the fault-related features from different perspectives simultaneously. The local and global features extracted by the aforementioned modules are then fused for subsequent compound fault classification. An experimental study was implemented based on real-world robotic sensor data. The experimental results indicated that the proposed multi-modal algorithm shows merits in compound fault diagnosis in comparison with other state-of-the-art methods.

Medical Image Fusion using ECNN- and OMBO-based Adaptive Weighted Fusion Rule

Medical imaging and information processing technologies are constantly evolving, resulting in a wide range of multimodality therapeutic pictures for clinical illness investigation. Physicians often require medical images produced using various modalities such as computed tomography (CT), magnetic resonance (MR), and positron emission computed tomography (PET) for clinical diagnosis. Many deep learning-based fusion methods have recently been proposed. In Convolutional Neural Network (CNN)-based fusion methods, only the last layer results are used as the image features, which result in the loss of useful information at middle layers. The fusion rule, based on the weighted averaging, causes noises in the source images and suppresses salient features of the image. In order to solve these issues, this paper proposes medical image fusion using Enhanced CNN (ECNN)- and Opposition-based Monarch Butterfly Optimization (OMBO)-based adaptive weighted fusion rule (AWFR). The ECNN contains feature extraction and reconstruction components. Both these components are trained in order to minimize the pixel loss and structural similarity loss. A pair of multimodal medical image is passed as input to the ECNN model to extract the low level and high level features. For the extracted features from ECNN, weighted fusion rule is applied in which OMBO algorithm is applied to adaptively optimize the weights of the fusion rule.

A Stable Lightweight and Adaptive Feature Enhanced Convolution Neural Network for Efficient Railway Transit Object Detection

Obstacles in front of a train pose a significant threat to traffic safety, and many accidents happen under shunting mode when the speed of a train is below 45 km/h. The existing track object–detection algorithms encounter difficulty in balancing the detection precision and speed in shunting mode. Additionally, their accuracy is insufficient, particularly for small objects in complex environments. To address these problems, we propose a stable lightweight feature extraction and adaptive feature fusion network for real-time detection of obstacles in railway traffic scenarios to ensure driving safety. The proposed network consists of three modules. The stable bottom feature extraction module reduces the computational load and extracts more image information stably. The lightweight feature extraction module improves feature extraction using a simple and effective network. The enhanced adaptive feature fusion module fuses the image and original features, improving the multiscale detection accuracy under complex environments, particularly in the case of small objects. With a default input size of 416 <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\times 416$ </tex-math></inline-formula> pixels (px), the proposed method achieves a detection speed of 81 FPS and a mean average precision of 94.75% for the railway traffic dataset as well as a detection speed of 78 FPS (26 FPS faster and 0.47% higher than those of YOLOv4, respectively) and a mean average precision of 42.5% for MS COCO. This indicates its potential for real-world railway object detection and other multi-target detection tasks. Additionally, the experimental results based on PASCAL VOC2007 and VOC2012 indicate that the proposed approach is considerably better than the state-of-the-art models.

Minimized Computations of Deep Learning Technique for Early Diagnosis of Diabetic Retinopathy Using IoT-Based Medical Devices.

Diabetes mellitus is the main cause of diabetic retinopathy, the most common cause of blindness worldwide. In order to slow down or prevent vision loss and degeneration, early detection and treatment are essential. For the purpose of detecting and classifying diabetic retinopathy on fundus retina images, numerous artificial intelligence-based algorithms have been put forth by the scientific community. Due to its real-time relevance to everyone's lives, smart healthcare is attracting a lot of interest. With the convergence of IoT, this attention has increased. The leading cause of blindness among persons in their working years is diabetic eye disease. Millions of people live in the most populous Asian nations, including China and India, and the number of diabetics among them is on the rise. To provide medical screening and diagnosis for this rising population of diabetes patients, skilled clinicians faced significant challenges. Our objective is to use deep learning techniques to automatically detect blind spots in eyes and determine how serious they may be. We suggest an enhanced convolutional neural network (ECNN) utilizing a genetic algorithm in this paper. The ECNN technique's accuracy results are compared to those of existing approaches like the K-nearest neighbor approach, convolutional neural network, and support vector machine with the genetic algorithm.

Deep learning for size and microscope feature extraction and classification in Oral Cancer: enhanced convolution neural network

Background and Aim: Deep learning technology has not been implemented successfully in oral cancer images classification due to the overfitting problem. Due to the network arrangement and lack of proper data set for training, the network might not produce the required feature map with dimension reduction which result in overfitting problems. This research aims to reduce the overfitting by producing the required feature map with dimension reduction through using Convolutional Neural Network. Methodology: The proposed system uses the Enhanced Convolutional Neural Network and the autoencoder technique to increase the efficiency of feature extraction process and compresses the information. In this technique, unpooling and deconvolution is done to generate the input data to minimize the difference between input and output data. Furthermore, it extracts characteristic features from the input data set which regenerates the input data from those features by learning a network to reduce the overfitting problem. Results: Different value of accuracy and processing time is achieved using different sample group of Confocal Laser Endomicroscopy (CLE) images. Based on result, it shows that the proposed solution is better than the current system. Also, the proposed system has improved the classification accuracy by 5 ~ 5.5% in average and reduced the processing time by 20 ~ 30 milliseconds in average. Conclusion: The proposed system is focused on accurately classifying the oral cancer cells of different anatomical locations from the CLE images. Finally, this study enhances the accuracy and processing time using autoencoder method and solve the problem of overfitting.

A novel enhanced convolution neural network with extreme learning machine: facial emotional recognition in psychology practices

Facial emotional recognition is one of the essential tools used by recognition psychology to diagnose patients. Face and facial emotional recognition are areas where machine learning is excelling. Facial Emotion Recognition in an unconstrained environment is an open challenge for digital image processing due to different environments, such as lighting conditions, pose variation, yaw motion, and occlusions. Deep learning approaches have shown significant improvements in image recognition. However, accuracy and time still need improvements. This research aims to improve facial emotion recognition accuracy during the training session and reduce processing time using a modified Convolution Neural Network Enhanced with Extreme Learning Machine (CNNEELM). The system entails (CNNEELM) improving the accuracy in image registration during the training session. Furthermore, the system recognizes six facial emotions happy, sad, disgust, fear, surprise, and neutral with the proposed CNNEELM model. The study shows that the overall facial emotion recognition accuracy is improved by 2% than the state of art solutions with a modified Stochastic Gradient Descent (SGD) technique. With the Extreme Learning Machine (ELM) classifier, the processing time is brought down to 65ms from 113ms, which can smoothly classify each frame from a video clip at 20fps. With the pre-trained InceptionV3 model, the proposed CNNEELM model is trained with JAFFE, CK+, and FER2013 expression datasets. The simulation results show significant improvements in accuracy and processing time, making the model suitable for the video analysis process. Besides, the study solves the issue of the large processing time required to process the facial images.

Respiratory Prediction Based on Multi-Scale Temporal Convolutional Network for Tracking Thoracic Tumor Movement.

Radiotherapy is one of the important treatments for malignant tumors. The precision of radiotherapy is affected by the respiratory motion of human body, so real-time motion tracking for thoracoabdominal tumors is of great significance to improve the efficacy of radiotherapy. This paper aims to establish a highly precise and efficient prediction model, thus proposing to apply a depth prediction model composed of multi-scale enhanced convolution neural network and temporal convolutional network based on empirical mode decomposition (EMD) in respiratory prediction with different delay times. First, to enhance the precision, the unstable original sequence is decomposed into several intrinsic mode functions (IMFs) by EMD, and then, a depth prediction model of parallel enhanced convolution structure and temporal convolutional network with the characteristics specific to IMFs is built, and finally training on the respiratory motion dataset of 103 patients with malignant tumors is conducted. The prediction precision and time efficiency of the model are compared at different levels with those of the other three depth prediction models so as to evaluate the performance of the model. The result shows that the respiratory motion prediction model determined in this paper has superior prediction performance under different lengths of input data and delay time, and, furthermore, the network update time is shortened by about 60%. The method proposed in this paper will greatly improve the precision of radiotherapy and shorten the radiotherapy time, which is of great application value.