Deep Neural Network Techniques Research Articles

Prediction of Brain Stroke using Machine Learning Algorithms and Deep Neural Network Techniques

The brain is the human body's primary upper organ. Stroke is a medical disorder in which the blood arteries in the brain are ruptured, causing damage to the brain. When the supply of blood and other nutrients to the brain is interrupted, symptoms might develop. Stroke is considered as medical urgent situation and can cause long-term neurological damage, complications and often death. The World Health Organization (WHO) claims that stroke is the leading cause of death and disability worldwide. Early detection of the numerous stroke warning symptoms can lessen the stroke's severity. The main objective of this study is to forecast the possibility of a brain stroke occurring at an early stage using deep learning and machine learning techniques. To gauge the effectiveness of the algorithm, a reliable dataset for stroke prediction was taken from the Kaggle website. Several classification models, including Extreme Gradient Boosting (XGBoost), Ada Boost, Light Gradient Boosting Machine, Random Forest, Decision Tree, Logistic Regression, K Neighbors, SVM - Linear Kernel, Naive Bayes, and deep neural networks (3-layer and 4-layer ANN) were successfully used in this study for classification tasks. The Random Forest classifier has 99% classification accuracy, which was the highest (among the machine learning classifiers). The three layer deep neural network (4-Layer ANN) has produced a higher accuracy of 92.39% than the three-layer ANN method utilizing the selected features as input. The research's findings showed that machine learning techniques outperformed deep neural networks.

Through-the-Wall Radar under electromagnetic complex wall: A deep learning approach

This paper employed deep learning to do two-dimensional, multi-object locating in Through-the-Wall Radar under conditions where the wall is treated as a complex electromagnetic medium. We made five assumptions about the wall and two about the number of objects. There are two object modes available: single target and double targets. The wall scenarios include a homogeneous wall, a wall with an air gap, an inhomogeneous wall, an anisotropic wall, and an inhomogeneous–anisotropic wall. Target locating is accomplished through the use of a deep neural network technique. We constructed a dataset using the Python FDTD module and then modeled it using deep learning. Assuming the wall is a complex electromagnetic medium, we achieved 97.7% accuracy for single-target 2D locating and 94.1% accuracy for two-target locating. Additionally, we noticed a loss of 10% to 20% inaccuracy when noise was added at low SNRs, although this decrease dropped to less than 10% at high SNRs.

An Exhaustive Study on Deep Neural Network-based Prediction of Heart Diseases and its Interpretations

Cardiovascular disease prediction is important in day-to-day life. A tool to diagnose cardiovascular diseases is an Electrocardiogram (ECG), which records electrical activities happening in the heart through a wave. A determination is made by checking the wave changes in an ECG. Predicting wave changes and diagnosing the disease requires domain expertise like cardiologists/physicians. Deep Neural Network techniques extract the features accurately and automatically predict the type of disease. This article lists different types of cardiac disorders, and parallelly different disease interpretations of all types of diseases are discussed to manually identify the disease type; segmentation of leads, pre-trained models, and different detection techniques are discussed to predict the type of diseases from an ECG image. Finally, this article discussed the different challenges in predicting heart diseases, and solutions to some of the challenges are given.

TRANSFER LEARNING MODELS COMPARISON FOR DETECTING AND DIAGNOSING SKIN CANCER

Skin cancer is a severe problem that is frequently disregarded. In circumstances of manual examination by a clinician, the human eye is occasionally unable to detect disorders precisely from imaging data. Deep learning techniques are increasingly being used nowadays to solve various problems in our daily lives. Therefore, deep neural network techniques are used to create an automated and computerized mechanism for detecting skin illnesses. To identify and diagnose skin illnesses over a range of criteria several neural network algorithms are evaluated and tested in the suggested model to see how well they perform. The networks are constructed to provide better outcomes using the CNN (Convolution neural network) and the Keras Sequential API architectures. The paper also compares the outcomes of the models using several metrics, such as accuracy, precision, f1 score, and recall. The transfer learning model involves seven models like DenseNet201, InseptionResnetV2, MobileNetV2, InceptionV3, ResNet50, DenseNet169, and VGG16. Among the employed models, the DenseNet169 model achieved the highest score of 87.58% in terms of accuracy; also, in terms of sensitivity and F1 score, DenseNet201 achieved the highest scores of 95.28% and 89.09%, respectively. On the other hand, VGG16 gained a score of 89.67% in terms of specificity, and DenseNet169 achieved the highest score of 90.64% in terms of precision.

Pragmatic Evidence on Android Malware Analysis Techniques: A Systematic Literature Review

Alarge number of studies including research articles and surveys on android malware detection and analysis techniques have been presented during the last one and a half decades. The authors proposed different systems and frameworks to identify malware from software applications. However, there is no recent and comprehensive systematic literature review on the detection and analysis of android malware methods, systems, and frameworks. We present a systematic review of literature on android malware detection and analysis techniques and tools by following standard guidelines for Systematic Literature Review methodology from 2010 to 2021. We selected 75 most relevant studies out of 3343 published studies. We found that the prominent malicious datasets are Genome (39%) and Drebin (36%) used by different researchers for the detection of malware. The static, dynamic, and hybrid source code analysis methods are applied by android malware detection techniques. We also identified the limitations and future research directions of existing techniques as research gaps for the community. Based on the pragmatic evidence of this research, we have proposed a hybrid analysis-based multiple feature analysis framework. This framework will not only address the limitations of static and dynamic-based approaches, but it also analyzes evolving android malware datasets using deep neural network and machine learning techniques and improve the accuracy of evolving malware samples.

Deep learning Feedforward Neural Network in predicting model of Environmental risk factors in the Sohar region

AQI (Air Quality Index) is the standard degree that guides us to measure air pollution levels such as PM2.5, O3, NO2, and SO2 to show the state of air quality. Polluted gas causes much damage and problems to people, plants, and the environment because of its negative impact. Data mining successfully examines an enormous cluster of data to recognize associations, determine relations between variables, and predict future values. In this paper, an experimental study was performed on analyzing the previous dataset of (PM2.5 and O3) for accurately predicting AQI using deep learning Feedforward Neural network techniques. The deep learning (Feedforward Neural Network (FFNN) predicting models are employed to evaluate based on R, R², MSE, MAE, and RMSE criteria using historical data from (the Ministry of Environment-Oman). Different epochs and a different number of hidden layers are deployed to improve and boost performance. In FFNN, the epochs number increase by 50,100 and 500 while the hidden layer utilized to 1,5 and 10. This optimization technique exceeds the performance from R=0.892 to R=0.992 in predicting the level of (PM2.5) and the (O3) from R=0.864 to R=0.999. The results show that the Sohar Region in a safe level of AQI.

Real-time debris flow detection using deep convolutional neural network and Jetson Nano

This study aims to develop a potential system for real-time detection of debris flow motion using a deep convolutional neural network (CNN) and image processing techniques. A system consisting of a pre-trained CNN model, NVIDIA Jetson Nano, and a camera was used to identify debris flow movement. The pre-trained CNN model was trained on an image dataset derived from 12 debris flow videos obtained from small flume tests, large flume tests, and several debris flow events. The application results of the proposed system on the flume test in the laboratory reached an F1 score of 72.6 to 100%. The real-time processing speed of the CNN model achieved from 2 to 21 frames per second (FPS) on the Jetson Nano. Both the accuracy and the processing speed of CNN model depend on the size of the video input and the input size of the model CNN. The CNN model of 320 × 320 pixels with a resolution of 800 × 480 pixels gives accuracy (F1 = 99.2%) and processing speed (FPS = 20) considered the optimal model when running the Jetson Nano device; thus, it can be applied for early detection and warning systems.

Analysis and development of brain tumor prediction model using deep neural network

The human brain consists of billions of living organisms and is very difficult to decipher because of its complexity. Brain tumors can be deadly, significantly impacting the quality of life and changing everything for patients and their loved ones. In today’s world, brain tumors are a leading cause of death in both children and adults. A high death percentage is caused due to the invasive properties of tumors. But it is inspiring that the survival rate might increase if the diagnosis is performed at the early stage [9]. Accurate detection of the brain tumor at an early stage can prolong the chance of survival of an infected patient [4]. Magnetic Resonance Imaging (MRI) is the most popular imaging technique used today for detecting brain tumors. Deep Neural Network techniques plays an important role in detecting brain tumors. This manuscript offers a brief analysis of studies conducted by various authors in the field of BT categorization and diagnosis from MRI images using Deep Neural Network (DNN). This paper also suggests a method for classifying and identifying brain tumors based on MRI pictures and supporting text using DNN and DWT.

Secure Convolutional Neural Network-Based Internet-of-Healthcare Applications

Convolutional neural networks (CNNs) have gained popularity for Internet-of-Healthcare (IoH) applications such as medical diagnostics. However, new research shows that adversarial attacks with slight imperceptible changes can undermine deep neural network techniques in healthcare. This raises questions regarding the safety of deploying these IoH devices in clinical situations. In this paper, we review the techniques used in fighting against cyber-attacks. Then, we propose to study the robustness of some well-known CNN architectures’ belonging to sequential, parallel, and residual families, such as LeNet5, MobileNetV1, VGG16, ResNet50, and InceptionV3 against fast gradient sign method (FGSM) and projected gradient descent (PGD) attacks, in the context of classification of chest radiographs (X-rays) based on the IoH application. Finally, we propose to improve the security of these CNN structures by studying standard and adversarial training. The results show that, among these models, smaller models with lower computational complexity are more secure against hostile threats than larger models that are frequently used in IoH applications. In contrast, we reveal that when these networks are learned adversarially, they can outperform standard trained networks. The experimental results demonstrate that the model performance breakpoint is represented by γ = 0.3 with a maximum loss of accuracy tolerated at 2%.

Deep Learning Framework for Landslide Severity Prediction and Susceptibility Mapping

Landslides are a natural hazard that is unpredictable, but we can prevent them. The Landslide Susceptibility Index reduces the uncertainty of living with landslides significantly. Planning and managing landslide-prone areas is critical. Using the most optimistic deep neural network techniques, the proposed work classifies and analyses the severity of the landslide. The selected experimental study area is Kerala’s Idukki district. A total of 3363 points were considered for this experiment using historic landslide points, field surveys, and literature searches. The primary triggering factors slope degree, slope aspect, elevation (altitude), normalized difference vegetation index (NDVI), and distance from road, lithology, and rainfall are considered. A landslide susceptibility map was generated using the Arc geographic information system (GIS) tool for all the triggering factors using frequency ratio method, Shannon entropy method, Relative effect method, and fuzzy logic method. A new Deep Neural Network (DNN) framework has been developed for the multiclass classification and prediction of landslide hazard zones as low, moderate, high, and very high. Existing works are only uses statistical methods, but the proposed work has used DNN to predict landslide severity at four different level even for semi data with over accurately. The training data for deep learning model are generated using the Sentinel Satellite images and field survey. The label for training the data are generated from the Landslide Susceptibility Index which are generated from statistical method. Among all the statistical method generated data the Shannon Entropy data is the most accurate of the four statistical methods achieves 99.16%, accuracy. The frequency ratio method based data achieves 97.08% accuracy, the relative effect method based data achieves 92.72% accuracy, and the Fuzzy logic method based data achieves 86.60% accuracy.

Enhancing image inpainting through image decomposition and deep neural networks

A new approach to inpainting problems that combines domain decomposition methods (DDM) with deep neural networks (DNN) to solve partial differential equations (PDE) is presented. First, this article examines different existing and emerging approaches to inpainting while emphasizing their advantages and disadvantages in a unified framework. After that, we introduce an algorithm that highlights the combination of DDM and DNN techniques for solving PDEs of a proposed mathematical inpainting model. For this model, the modified approach that has been adopted uses the DNN method which is based on convolutional neural networks (CNN) to reduce the computational cost in our algorithm while maintaining accuracy. Finally, the experimental results show that our method significantly outperforms existing ones for high-resolution images in paint stains.

Hybrid Deep-Generative Adversarial Network Based Intrusion Detection Model for Internet of Things Using Binary Particle Swarm Optimization

The applications of internet of things networks extensively increasing which provide ease of data communication among interconnected smart devices. IoT connected with smart devices diverse in a range of fields associated with smart cities, smart-transportation, smart- industrial, healthcare, hospitality etc. The smart devices lack with computational power, energy and inconsistent topology. Due to these factors these are most vulnerable to security attacks which affect the transmission reliability of data between nodes. An IoT network connects heterogeneous devices together and generates high volume of data. To provide security against intrusion attacks, deep neural network (DNN) techniques are adopted to detect malicious attacks. We have proposed on an anomaly Hybrid based deep learning-based approach which is Generative Adversarial Network in accordance with detecting malicious intruders. We designed a distributed IDS controller validated over dataset of NSL-KDD and proven with higher performance in detecting the DDOS Distributed- Denial- of service- attacks. Thus, Experimental Results are calculated with predefined threshold values to detect DDoS-attacks and the resultant proves that HD-GAN model offers better intrusion detection with respect to higher accuracy, recall, precision, f-measure, and lower FPR (False-Positive-Rate).

Animal image identification and classification using deep neural networks techniques

Animal image identification and classification using deep neural networks techniques

A Neural Network-Based Method for Surface Metallization of Polymer Materials

It’s no secret that polymers have been employed extensively in a variety of industries. Polymers, on the other hand, have faced difficulties in their development because of their complicated chemical composition and structure. Data-driven approaches in polymer science and technology have resulted in new directions in research leading to the implementation of deep learning models and vast data assets. In the growing area of polymer informatics, deep learning methods based on factual data are being used to speed up the performance assessment and process improvement of new polymers. Using a deep neural network (DNN), we can now forecast the surface metallization properties of polymer materials, which we describe in this research. First, we collect a raw dataset of polymer materials’ characteristics. The raw data are filtered and normalized using the min–max normalization approach. To convert normalized data into numerical characteristics, principal component analysis (PCA) is employed. Polymer surface metallization characteristics can then be predicted using a suggested DNN technique. The proposed and conventional approaches are also compared so that our research can be done to its full potential.

Accurate classification of lung nodules on CT images using the TransUnet.

Computed tomography (CT) is an effective way to scan for lung cancer. The classification of lung nodules in CT screening is completely doctor dependent, which has drawbacks, including difficulty classifying tiny nodules, subjectivity, and high false-positive rates. In recent years, deep convolutional neural networks, a deep learning technology, have been shown to be effective in medical imaging diagnosis. Herein, we propose a deep convolutional neural network technique (TransUnet) to automatically classify lung nodules accurately. TransUnet consists of three parts: the transformer, the Unet, and global average pooling (GAP). The transformer encodes discriminative features via global self-attention modeling on CT image patches. The Unet, which collects context by constricting route, enables exact lunge nodule localization. The GAP categorizes CT images, assigning each sample a score. Python was employed to pre-process all CT images in the LIDI-IDRI, and the obtained 8,474 images (3,259 benign and 5,215 lung nodules) were used to evaluate the method's performance. The accuracies of TransUnet in the training and testing sets were 87.90 and 84.62%. The sensitivity, specificity, and AUC of the proposed TransUnet on the testing dataset were 70.92, 93.17, and 0.862%, respectively (0.844-0.879). We also compared TransUnet to three well-known methods, which outperformed these methods. The experimental results on LIDI-IDRI demonstrated that the proposed TransUnet has a great performance in classifying lung nodules and has a great potential application in diagnosing lung cancer.

Deep Learning–based Fast Spectral Inversion of Hα and Ca ii 8542 Line Spectra

A multilayer spectral inversion (MLSI) model has recently been proposed for inferring the physical parameters of plasmas in the solar chromosphere from strong absorption lines taken by the Fast Imaging Solar Spectrograph (FISS). We apply a deep neural network (DNN) technique in order to produce the MLSI outputs with reduced computational costs. We train the model using two absorption lines, Hα and Ca ii 8542 Å, taken by FISS, and 13 physical parameters obtained from the application of MLSI to 49 raster scans (∼2,000,000 spectra). We use a fully connected network with skip connections and multi-branch architecture to avoid the problem of vanishing gradients and to improve the model’s performance. Our test shows that the DNN successfully reproduces the physical parameters for each line with high accuracy and a computing time of about 0.3–0.4 ms per line, which is about 250 times faster than the direct application of MLSI. We also confirm that the DNN reliably reproduces the temporal variations of the physical parameters generated by the MLSI inversion. By taking advantage of the high performance of the DNN, we plan to provide physical parameter maps for all the FISS observations, in order to understand the chromospheric plasma conditions in various solar features.

Deep Neural Network Technique Based Field Digitizing Units (FDUs) Instruments Fault Detection and Isolation

Deep Neural Network Technique Based Field Digitizing Units (FDUs) Instruments Fault Detection and Isolation

Predicting shale mineralogical brittleness index from seismic and elastic property logs using interpretable deep learning

The mineralogical brittleness index (MBI) of organic-rich shale formations is one of the key parameters to identify the optimal production well locations and optimize hydraulic fracturing. Since we as a community don't understand the exact physical relationship between the MBI and seismic properties from well logs, we have used traditional approaches like the log-based brittleness index (LBI) and the elastic brittleness index (EBI) to quantify the rock brittleness from seismic data and well logs. The LBI method is easy to use but is empirically derived from the porosity and sonic logs. On the other hand, the EBI method is dependent on the average values of Young's modulus and Poisson's ratio but is not physically meaningful in practice. Therefore, we develop a deep learning approach to obtain a more reliable MBI model from seismic properties and enhance the interpretability with Shapley values. First, we analyze the statistical relationship between the MBI and eight seismic properties from well logs and distinguish the influential input variables for the MBI prediction, such as bulk density, Young's modulus, and Poisson's ratio. Second, we find a multivariate linear regression (MLR) model with three input properties and quantify the relative statistical contribution of each input based on Shapley values. Third, we use a deep neural network technique to derive the nonlinear estimation model with a better fit to the MBI data than the traditional methods. We test and verify our approach on field log and core data from the Wolfcamp shales in the Permian Basin, Texas. In conclusion, this workflow can provide a more interpretable and accurate MBI estimation from seismic properties to enhance unconventional shale reservoir characterization.

Measurement Error Models: From Nonparametric Methods to Deep Neural Networks

The success of deep learning has inspired a lot of recent interests in exploiting neural network structures for statistical inference and learning. In this paper, we review some popular deep neural network structures and techniques under the framework of nonparametric regression with measurement errors. In particular, we demonstrate how to use a fully connected feed-forward neural network to approximate the regression function f(x), explain how to use a normalizing flow to approximate the prior distribution of X, and detail how to construct an inference network to generate approximate posterior samples of X. After reviewing recent advances in variational inference for deep neural networks, such as the importance weighted autoencoder, doubly reparametrized gradient estimator, and nonlinear independent components estimation, we describe an inference procedure built upon these advances. An extensive numerical study is presented to compare the neural network approach with classical nonparametric methods, which suggests that the neural network approach is more flexible in accommodating different classes of regression functions and performs superior or comparable to the best available method in many settings.

Detection of Planting Systems in Olive Groves Based on Open-Source, High-Resolution Images and Convolutional Neural Networks

This paper aims to evaluate whether an automatic analysis with deep learning convolutional neural networks techniques offer the ability to efficiently identify olive groves with different intensification patterns by using very high-resolution aerial orthophotographs. First, a sub-image crop classification was carried out. To standardize the size and increase the number of samples of the data training (DT), the crop images were divided into mini-crops (sub-images) using segmentation techniques, which used a different threshold and stride size to consider the mini-crop as suitable for the analysis. The four scenarios evaluated discriminated the sub-images efficiently (accuracies higher than 0.8), obtaining the largest sub-images (H = 120, W = 120) for the highest average accuracy (0.957). The super-intensive olive plantings were the easiest to classify for most of the sub-image sizes. Nevertheless, although traditional olive groves were discriminated accurately, too, the most difficult task was to distinguish between the intensive plantings and the traditional ones. A second phase of the proposed system was to predict the crop at farm-level based on the most frequent class detected in the sub-images of each crop. The results obtained at farm level were slightly lower than at the sub-images level, reaching the highest accuracy (0.826) with an intermediate size image (H = 80, W = 80). Thus, the convolutional neural networks proposed made it possible to automate the classification and discriminate accurately among traditional, intensive, and super-intensive planting systems.