Types Of Deep Learning Algorithms Research Articles

Development of IIOT-Based Pd-Maas Using RNN-LSTM Model with Jelly Fish Optimization in the Indian Ship Building Industry

Building and repair of ships are considered the Evergreen industry nationally as well as globally. The ships are generally gone in by the periodic scheduled repairs by the Indian shipbuilding industries. Sometimes industries lack productivity and lack of modernization some modern methods should be followed. The study focuses on the optimization of predictive maintenance as a service on the industrial Internet of Things by machine learning algorithms. The main contribution of the study is the use of optimization techniques for feature selection and RNN-LSTM for improved accuracy. The selected data set is pre-processed and feature selection for the optimization for the improvement in accuracy, and automation decision making the framework of the convolution neural network along with the ensemble boosted tree classifier developed is optimized using the jellyfish optimization and Recurrent Neural Network and Long Short-Term Memory (RNN-LSTM) model for the recognition of patterns and numerical vectors in the real-world data after processing of output then it is sent back as the input for the recurrent network to make the decision in the shipbuilding process. By evaluating the performance results and confusion matrix through the training and testing output all the metrics for training and testing are classified in the confusion matrix. Our proposed predictive maintenance model with high accuracy for the detection of failures in earlier stages and maintenance of Indian ships can help in the avoidance of accidents in voyages and the loss of goods and money during transportation. The validation of the proposed predictive maintenance model optimization with different types of deep learning algorithms shows that our proposed methodology gives an improved accuracy of 98.9336% which is higher than any other models. The proposed Pd-MaaS helps in early detection of failures in the ships which is the greatest advantage in the Indian shipbuilding industry.

DDOS ATTACK DETECTION USING HYBRID (CCN AND LSTM) ML MODEL

LSTM (Long Short-Term Memory) and CNN (Convolutional Neural Networks) are two types of deep learning algorithms; by combining the strengths of LSTM and CNN, researchers have developed deep learning models that can effectively detect SDN (Software-Defined Network) attacks including Distributed Denial of Service. These models effectively analyze network traffic, encompassing temporal and spatial characteristics, resulting in precise identification of malicious traffic.In this research, a hybrid model composed of CNN and LSTM is used to detect the DDoS attack in SDN network. Where the CNN component of the model can identify spatial patterns in network traffic, such as the characteristics of individual packets, while the LSTM component can capture temporal patterns in traffic over time, such as the timing and frequency of traffic bursts. The proposed model has been trained on a labeled network traffic dataset, with one class representing normal traffic and another class representing DDoS attack traffic. During the training process, the model adjusts its weights and biases to minimize the difference between its predicted output and the actual output for each input sample. Once trained, the hybrid model classifies incoming network traffic in the dataset as either normal or malicious with an initial accuracy of (78.18%) and losses of (39.77%) at the 1st epoch till it reaches an accuracy of (99.99%) with losses of (9.29×10-5) at the epoch number 500. It should be mentioned that the hybrid model of CNN and LSTM for DDoS detection is implemented using Python Anaconda platform with an ETA 28ms/step.

The detection of residential developments in urban areas: Exploring the potentials of deep-learning algorithms

A rich volume of research has detected urban growth by quantifying the land use/land cover (LU/LC) changes based on remote sensing technologies. However, the research has limitations in identifying various formats of urban growth, particularly small-scale urban growth, such as infill development or redevelopment in urban areas, prompted by smart growth and sustainable urban development. This paper aims to design a framework for the accurate detection of residential infill development in the City of Los Angeles by employing a deep-learning method that has been increasingly applied to analyze phenomena in cities. In order to do so, this paper develops six models that reflect the variations of image classification methods, deep-learning algorithms, and estimation types. The results from the models emphasize the potential of the deep-learning models for the detection of micro-urban growth at a city scale. However, there is room for the improvement of estimation accuracy in the cases that detect some new developments and replacements as not developed parcels. The findings suggest that the performance of the models depends primarily on the articulations of the training dataset rather than the types of deep-learning algorithms. Findings from the models provide the city with insights into land use and transportation planning decision-making based on a better understanding of the spatial distribution patterns of urban growth and development.

Deep Learning Approach for Advanced COVID-19 Analysis

Since the spread of the COVID-19 pandemic, the number of patients has increased dramatically, making it difficult for medical staff, including doctors, to cover hospitals and monitor patients. Therefore, this work depends on Computerized Tomography (CT) scan images to diagnose COVID-19. CT scan images are used to diagnose and determine the severity of the disease. On the other hand, Deep Learning (DL) is widely used in medical research, making great progress in medical technologies. For the diagnosis process, the Convolutional Neural Network (CNN) algorithm is used as a type of DL algorithm. Hence, this work focuses on detecting COVID-19 from CT scan images and determining the severity of the illness. The proposed model is as follows: first, classifying CT scan images into infected or not infected using one of the CNN structures, Residual Neural Networks (ResNet50); second, applying a segmentation process for the infected images to identify lungs and pneumonia using the SegNet algorithm (a CNN architecture for semantic pixel-wise segmentation) so that the disease's severity can be determined; finally, applying linear regression to predict the disease's severity for any new image. The proposed approach reached an accuracy of 95.7% in the classification process and lung and pneumonia segmentation of 98.6% and 96.2%, respectively. Furthermore, a regression process reached an accuracy of 98.29%.

Application of Deep Learning for Prediction of Alzheimer's Disease in PET/MR Imaging.

Alzheimer's disease (AD) is a progressive neurodegenerative disorder that affects millions of people worldwide. Positron emission tomography/magnetic resonance (PET/MR) imaging is a promising technique that combines the advantages of PET and MR to provide both functional and structural information of the brain. Deep learning (DL) is a subfield of machine learning (ML) and artificial intelligence (AI) that focuses on developing algorithms and models inspired by the structure and function of the human brain's neural networks. DL has been applied to various aspects of PET/MR imaging in AD, such as image segmentation, image reconstruction, diagnosis and prediction, and visualization of pathological features. In this review, we introduce the basic concepts and types of DL algorithms, such as feed forward neural networks, convolutional neural networks, recurrent neural networks, and autoencoders. We then summarize the current applications and challenges of DL in PET/MR imaging in AD, and discuss the future directions and opportunities for automated diagnosis, predictions of models, and personalized medicine. We conclude that DL has great potential to improve the quality and efficiency of PET/MR imaging in AD, and to provide new insights into the pathophysiology and treatment of this devastating disease.

Potato Blight Classification Android Application using Deep learning

Farmers who grow potatoes suffer from significant financial losses each year due several diseases that affect potato plants. The most common diseases are Early and Late Blight , caused by fungus and specific microorganisms, respectively. Early detection and appropriate treatment can save a lot of waste and prevent economic losses. However, traditional visual inspection methods are time-consuming and prone to errors. To address this challenge, we propose a Convolutional Neural Network ( CNN ) approach for plant disease diagnosis. CNNs are a type of deep learning algorithm widely used for image classification tasks. They can automatically learn features from input image data, making them well-suited for plant disease diagnosis. Our customized CNN has fewer trainable parameters, reducing computation time and minimizing information loss. We used several convolutional and pooling layers, followed by fully connected layers with the ReLU activation function. We also applied dropout regularization to prevent overfitting. In conclusion, accurate and efficient plant disease diagnosis is essential for preventing economic losses. Our customized CNN for plant disease diagnosis has the potential to be an effective tool for farmers. It can help them diagnose plant diseases quickly and accurately, leading to timely treatment and reduced loss.

CNN Based Wildlife Intrusion Detection and Alert System

Wildlife intrusion detection and alert systems are designed to detect and alert wildlife intrusion events, such as animals crossing highways, entering farms or protected areas, and approaching human settlements. This system often uses advanced technologies, such as cameras, sensors, and machine learning algorithms, to detect and identify animal species and behaviors. Convolutional neural networks (CNNs) are a type of deep learning algorithm commonly used for image and video analysis tasks, including object detection and classification. CNNs can learn to extract features from images and videos automatically and accurately, making them well-suited for detecting animals in wildlife intrusion detection systems.

Hybrid Deep Learning Approach for Automatic DoS/DDoS Attacks Detection in Software-Defined Networks

This paper proposes a hybrid deep learning algorithm for detecting and defending against DoS/DDoS attacks in software-defined networks (SDNs). SDNs are becoming increasingly popular due to their centralized control and flexibility, but this also makes them a target for cyberattacks. Detecting DoS/DDoS attacks in SDNs is a challenging task due to the complex nature of the network traffic. To address this problem, we developed a hybrid deep learning approach that combines three types of deep learning algorithms. Our approach achieved high accuracy rates of 99.81% and 99.88% on two different datasets, as demonstrated through both reference-based analysis and practical experiments. Our work provides a significant contribution to the field of network security, particularly in the area of SDN. The proposed algorithm has the potential to enhance the security of SDNs and prevent DoS/DDoS attacks. This is important because SDNs are becoming increasingly important in today’s network infrastructure, and protecting them from attacks is crucial to maintaining the integrity and availability of network resources. Overall, our study demonstrates the effectiveness of a hybrid deep learning approach for detecting DoS/DDoS attacks in SDNs and provides a promising direction for future research in this area.

Comparison of the Diagnostic Performance of Deep Learning Algorithms for Reducing the Time Required for COVID-19 RT-PCR Testing.

(1) Background: Rapid and accurate negative discrimination enables efficient management of scarce isolated bed resources and adequate patient accommodation in the majority of areas experiencing an explosion of confirmed cases due to Omicron mutations. Until now, methods for artificial intelligence or deep learning to replace time-consuming RT-PCR have relied on CXR, chest CT, blood test results, or clinical information. (2) Methods: We proposed and compared five different types of deep learning algorithms (RNN, LSTM, Bi-LSTM, GRU, and transformer) for reducing the time required for RT-PCR diagnosis by learning the change in fluorescence value derived over time during the RT-PCR process. (3) Results: Among the five deep learning algorithms capable of training time series data, Bi-LSTM and GRU were shown to be able to decrease the time required for RT-PCR diagnosis by half or by 25% without significantly impairing the diagnostic performance of the COVID-19 RT-PCR test. (4) Conclusions: The diagnostic performance of the model developed in this study when 40 cycles of RT-PCR are used for diagnosis shows the possibility of nearly halving the time required for RT-PCR diagnosis.

KLASIFIKASI BUAH SEGAR DAN BUSUK MENGGUNAKAN ALGORITMA CONVOLUTIONAL NEURAL NETWORK DENGAN TFLITE SEBAGAI MEDIA PENERAPAN MODEL MACHINE LEARNING

CNN (Convolutional Neural Network) is one of the type of Deep Learning algorithm that can accept input in the form of images, or objects such as fruit, animals, office equipment, and so on. This CNN works is inspired by the neuron system in humans based on visual perception. The CNN model can be implemented into the Android system using TFLite. TFLite is a Machine Learning library specially designed for Android devices to create Machine Learning models in small binary and low latency. This can make it easier for Machine Learning researchers to use smartphones to develop the research system. Current technological advances make the fruit industry no longer use the manual fruit sorting process carried out by humans. The process of sorting fruit that is fit for consumption (fresh) and unfit for consumption (rotten) can reach hundreds and thousands, so it needs the help of machines to increase work speed. This fruit sorting process can be circumvented by creating a Machine Learning model that can classify fresh and rotten fruit which will then be processed by the system based on the desired output requirements. If the model can perform the classification well, then the fruit industry can take steps to make an automatic sorter by implementing the model into its system. This study aims to create a model with the CNN (Convolutional Neural Network) Algorithm and design a prototype system that can classify fresh and rotten fruit (red apples, bananas, and mandarin oranges) and apply the resulting model using TFLite on an Android Smartphone. The results indicated that the resulting prototype model can be used by users in the Android system. The results of the training model obtained an accuracy value of 98.20%. Meanwhile, the results of testing showed that the model can classify images from the same or different sources by 91.65% from 1090 images. These results indicate that the model is included in the excellent classification category.

Biological features between miRNAs and their targets are unveiled from deep learning models

MicroRNAs (miRNAs) are ~ 22 nucleotide ubiquitous gene regulators. They modulate a broad range of essential cellular processes linked to human health and diseases. Consequently, identifying miRNA targets and understanding how they function are critical for treating miRNA associated diseases. In our earlier work, a hybrid deep learning-based approach (miTAR) was developed for predicting miRNA targets. It performs substantially better than the existing methods. The approach integrates two major types of deep learning algorithms: convolutional neural networks (CNNs) and recurrent neural networks (RNNs). However, the features in miRNA:target interactions learned by miTAR have not been investigated. In the current study, we demonstrated that miTAR captures known features, including the involvement of seed region and the free energy, as well as multiple novel features, in the miRNA:target interactions. Interestingly, the CNN and RNN layers of the model perform differently at capturing the free energy feature: the units in RNN layer is more unique at capturing the feature but collectively the CNN layer is more efficient at capturing the feature. Although deep learning models are commonly thought “black-boxes”, our discoveries support that the biological features in miRNA:target can be unveiled from deep learning models, which will be beneficial to the understanding of the mechanisms in miRNA:target interactions.

A systematic literature review of deep learning neural network for time series air quality forecasting.

Rapid progress of industrial development, urbanization and traffic has caused air quality reduction that negatively affects human health and environmental sustainability, especially among developed countries. Numerous studies on the development of air quality forecasting model using machine learning have been conducted to control air pollution. As such, there are significant numbers of reviews on the application of machine learning in air quality forecasting. Shallow architectures of machine learning exhibit several limitations and yield lower forecasting accuracy than deep learning architecture. Deep learning is a new technology in computational intelligence; thus, its application in air quality forecasting is still limited. This study aims to investigate the deep learning applications in time series air quality forecasting. Owing to this, literature search is conducted thoroughly from all scientific databases to avoid unnecessary clutter. This study summarizes and discusses different types of deep learning algorithms applied in air quality forecasting, including the theoretical backgrounds, hyperparameters, applications and limitations. Hybrid deep learning with data decomposition, optimization algorithm and spatiotemporal models are also presented to highlight those techniques' effectiveness in tackling the drawbacks of individual deep learning models. It is clearly stated that hybrid deep learning was able to forecast future air quality with higher accuracy than individual models. At the end of the study, some possible research directions are suggested for future model development. The main objective of this review study is to provide a comprehensive literature summary of deep learning applications in time series air quality forecasting that may benefit interested researchers for subsequent research.

Autism Spectrum Disorder Classification Using Deep Learning

<p class="0abstract">The goal of this paper is to evaluate the deep learning algorithm for people placed in the Autism Spectrum Disorder (ASD) classification. ASD is a developmental disability that causes the affected people to have significant communication, social, and behavioural challenges. People with autism are saddled with communication problems, difficulties in social interaction and displaying repetitive behaviours. Several methods have been used to classify the ASD from non-ASD people. However, there is a need to explore more algorithms that can yield better classification performance. Recently, deep learning methods have significantly sharpened the cutting edge of learning algorithms in a wide range of artificial intelligence tasks. These artificial intelligence tasks refer to object detection, speech recognition, and machine translation. In this research, the convolutional neural network (CNN) is employed. This algorithm is used to find processes that can classify ASD with a higher level of accuracy. The image data is pre-processed; the CNN algorithm is then applied to classify the ASD and non-ASD, and the steps of implementing the CNN algorithm are clearly stated. Finally, the effectiveness of the algorithm is evaluated based on the accuracy performance. The support vector machine (SVM) is utilised for the purpose of comparison. The CNN algorithm produces better results with an accuracy of 97.07%, compared with the SVM algorithm. In the future, different types of deep learning algorithms need to be applied, and different datasets can be tested with different hyper-parameters to produce more accurate ASD classifications.</p>

Assessment of a Spatiotemporal Deep Learning Approach for Soil Moisture Prediction and Filling the Gaps in Between Soil Moisture Observations.

Soil moisture (SM) plays a significant role in determining the probability of flooding in a given area. Currently, SM is most commonly modeled using physically-based numerical hydrologic models. Modeling the natural processes that take place in the soil is difficult and requires assumptions. Besides, hydrologic model runtime is highly impacted by the extent and resolution of the study domain. In this study, we propose a data-driven modeling approach using Deep Learning (DL) models. There are different types of DL algorithms that serve different purposes. For example, the Convolutional Neural Network (CNN) algorithm is well suited for capturing and learning spatial patterns, while the Long Short-Term Memory (LSTM) algorithm is designed to utilize time-series information and to learn from past observations. A DL algorithm that combines the capabilities of CNN and LSTM called ConvLSTM was recently developed. In this study, we investigate the applicability of the ConvLSTM algorithm in predicting SM in a study area located in south Louisiana in the United States. This study reveals that ConvLSTM significantly outperformed CNN in predicting SM. We tested the performance of ConvLSTM based models by using a combination of different sets of predictors and different LSTM sequence lengths. The study results show that ConvLSTM models can predict SM with a mean areal Root Mean Squared Error (RMSE) of 2.5% and mean areal correlation coefficients of 0.9 for our study area. ConvLSTM models can also provide predictions between discrete SM observations, making them potentially useful for applications such as filling observational gaps between satellite overpasses.

Peramalan Data Indeks Harga Konsumen Berbasis Time Series Multivariate Menggunakan Deep Learning

Multivariate Time Series based forecasting is a type of forecasting that has more than one criterion changes from time to time that it can forecast based on historical patterns of data sequences. The Consumer Price Index (CPI) issued regularly every month by the Statistics Indonesia calculated based on data observations. This study is a development of previous research that only used on type of algorithm to predict CPI value resulting poor of accuracy due to lack of architecture variations testing. This study developed a CPI forecasting model with a new approach about using several types of deep learning algorithms, namely LSTM, Bidirectional LSTM, and Multilayer Perceptron with architectural variations of the number of neurons and epochs. Furthermore, this study adapt ADDIE model of Research and Development method. Based on the results, the best accuracy is obtained from the LSTM Bidirectional with 10 neurons and 2000 epoch resulting 3,519 of RMSE value. Meanwhile, based on the average RMSE value for the whole test, LSTM gets the smallest average of RMSE followed Bidirectional LSTM and Multilayer Perceptron with the RMSE value 4,334, 5,630, 6,304 respectively.

Human activity recognition and classification using of convolutional neural networks and recurrent neural networks

Recently, by using the deep learning models, it has become easier to recognize the human activity with more accuracy than before by categorizing the activities that people are doing daily. Nowadays, with the extensive use of modern smartphones that have sensors, it has become easier to capture the data in raw format that has the movement details in three dimensions (X-Y-Z). In this paper, we utilized the open source WIreless Sensor Data Mining (WISDM) dataset which has six activities that are walking, jogging, standing, sitting, upstairs and downstairs. Each type of those activities consists of values in terms of (X, Y and Z) axes. We employed two types of deep learning algorithms that are Convolutional Neural Network (CNN) and Recurrent Neural Network - Long Short-Term Memory (RNN-LSTM). Our objective is to make a comparison between accuracy and loss after implementing the two models. We discovered that, when using the Convolutional Neural Network (CNN), the accuracy was 81%. However, the accuracy was 91% when using Recurrent Neural Network - Long Short-Term Memory (RNN-LSTM) and applying it on the same database. As a result, the Recurrent Neural Network - Long Short-Term Memory (RNN-LSTM) model outperformed the Convolutional Neural Network (CNN) model.

A Survey of Deep Learning for Lung Disease Detection on Medical Images: State-of-the-Art, Taxonomy, Issues and Future Directions.

The recent developments of deep learning support the identification and classification of lung diseases in medical images. Hence, numerous work on the detection of lung disease using deep learning can be found in the literature. This paper presents a survey of deep learning for lung disease detection in medical images. There has only been one survey paper published in the last five years regarding deep learning directed at lung diseases detection. However, their survey is lacking in the presentation of taxonomy and analysis of the trend of recent work. The objectives of this paper are to present a taxonomy of the state-of-the-art deep learning based lung disease detection systems, visualise the trends of recent work on the domain and identify the remaining issues and potential future directions in this domain. Ninety-eight articles published from 2016 to 2020 were considered in this survey. The taxonomy consists of seven attributes that are common in the surveyed articles: image types, features, data augmentation, types of deep learning algorithms, transfer learning, the ensemble of classifiers and types of lung diseases. The presented taxonomy could be used by other researchers to plan their research contributions and activities. The potential future direction suggested could further improve the efficiency and increase the number of deep learning aided lung disease detection applications.

A Survey of Deep Learning for Data Caching in Edge Network

The concept of edge caching provision in emerging 5G and beyond mobile networks is a promising method to deal both with the traffic congestion problem in the core network, as well as reducing latency to access popular content. In that respect, end user demand for popular content can be satisfied by proactively caching it at the network edge, i.e., at close proximity to the users. In addition to model-based caching schemes, learning-based edge caching optimizations have recently attracted significant attention, and the aim hereafter is to capture these recent advances for both model-based and data-driven techniques in the area of proactive caching. This paper summarizes the utilization of deep learning for data caching in edge network. We first outline the typical research topics in content caching and formulate a taxonomy based on network hierarchical structure. Then, many key types of deep learning algorithms are presented, ranging from supervised learning to unsupervised learning, as well as reinforcement learning. Furthermore, a comparison of state-of-the-art literature is provided from the aspects of caching topics and deep learning methods. Finally, we discuss research challenges and future directions of applying deep learning for caching.

Discriminative neural network pruning in a multiclass environment: A case study in spoken emotion recognition

Deep learning has become one of the most widely accepted paradigms regarding machine learning. It focuses on the use of hierarchical data models and builds upon the notion that in order to learn about high level data representations, a better understanding of intermediate level representation is needed. Restricted Boltzmann Machines and deep belief networks are two main types of deep learning algorithms commonly used in a wide array of classification and pattern recognition tasks. Examples of these tasks are natural language recognition, neuroimaging studies, forecasting time series, parametric voice synthesis, and speech emotion recognition among others. Recent machine learning studies suggest that deep learning networks can help map feature problems into a more advantageous position, hence improving the classification process. However, selecting a suitable Deep learning architecture in response to a specific problem can be difficult. In this study, we intend to investigate whether discriminative measures, such as Anova, Pearsonâs Correlation, Fisher score, Gain ratio, ReliefF, OneR among others, could offer pointers to identify useful neural nods in a Deep learning network. This is due to the fact that normally not all hidden neurons provide insightful information for a classification task. Our approach consists in using some of these discriminative measures to rank the hidden neurons based on their output values, and then prune them in accordance to their position within said ranking. Our results indicate that this approach is also helpful in multiclass classification problems and the pruning process seems to have a positive effect in diminishing the resulting error rate.

Using Deep Learning Algorithms to Grade Hydronephrosis Severity: Toward a Clinical Adjunct.

Grading hydronephrosis severity relies on subjective interpretation of renal ultrasound images. Deep learning is a data-driven algorithmic approach to classifying data, including images, presenting a promising option for grading hydronephrosis. The current study explored the potential of deep convolutional neural networks (CNN), a type of deep learning algorithm, to grade hydronephrosis ultrasound images according to the 5-point Society for Fetal Urology (SFU) classification system, and discusses its potential applications in developing decision and teaching aids for clinical practice. We developed a five-layer CNN to grade 2,420 sagittal hydronephrosis ultrasound images [191 SFU 0 (8%), 407 SFU I (17%), 666 SFU II (28%), 833 SFU III (34%), and 323 SFU IV (13%)], from 673 patients ranging from 0 to 116.29 months old (Mage = 16.53, SD = 17.80). Five-way (all grades) and two-way classification problems [i.e., II vs. III, and low (0–II) vs. high (III–IV)] were explored. The CNN classified 94% (95% CI, 93–95%) of the images correctly or within one grade of the provided label in the five-way classification problem. Fifty-one percent of these images (95% CI, 49–53%) were correctly predicted, with an average weighted F1 score of 0.49 (95% CI, 0.47–0.51). The CNN achieved an average accuracy of 78% (95% CI, 75–82%) with an average weighted F1 of 0.78 (95% CI, 0.74–0.82) when classifying low vs. high grades, and an average accuracy of 71% (95% CI, 68–74%) with an average weighted F1 score of 0.71 (95% CI, 0.68–0.75) when discriminating between grades II vs. III. Our model performs well above chance level, and classifies almost all images either correctly or within one grade of the provided label. We have demonstrated the applicability of a CNN approach to hydronephrosis ultrasound image classification. Further investigation into a deep learning-based clinical adjunct for hydronephrosis is warranted.