Deep Learning Neural Network Research Articles

Convolutional neural network for colorimetric glucose detection using a smartphone and novel multilayer polyvinyl film microfluidic device

AbstractDetecting glucose levels is crucial for diabetes patients as it enables timely and effective management, preventing complications and promoting overall health. In this endeavor, we have designed a novel, affordable point-of-care diagnostic device utilizing microfluidic principles, a smartphone camera, and established laboratory colorimetric methods for accurate glucose estimation. Our proposed microfluidic device comprises layers of adhesive poly-vinyl films stacked on a poly methyl methacrylate (PMMA) base sheet, with micro-channel contours precision-cut using a cutting printer. Employing the gold standard glucose-oxidase/peroxidase reaction on this microfluidic platform, we achieve enzymatic glucose determination. The resulting colored complex, formed by phenol and 4-aminoantipyrine in the presence of hydrogen peroxide generated during glucose oxidation, is captured at various glucose concentrations using a smartphone camera. Raw images are processed and utilized as input data for a 2-D convolutional neural network (CNN) deep learning classifier, demonstrating an impressive 95% overall accuracy against new images. The glucose predictions done by CNN are compared with ISO 15197:2013/2015 gold standard norms. Furthermore, the classifier exhibits outstanding precision, recall, and F1 score of 94%, 93%, and 93%, respectively, as validated through our study, showcasing its exceptional predictive capability. Next, a user-friendly smartphone application named “GLUCOLENS AI” was developed to capture images, perform image processing, and communicate with cloud server containing the CNN classifier. The developed CNN model can be successfully used as a pre-trained model for future glucose concentration predictions.

Abstract 4116410: A Novel Deep Learning Approach for Prediction of Right Heart Failure After Left Ventricular Assist Device Implantation using Pulmonary Artery Pressure Tracings

Introduction: Left ventricular assist device (LVAD) offers a lifeline for advanced heart failure patients, but ~30% experience post-operative right heart failure (RHF) with significant morbidity and mortality. Current methods for predicting RHF risk have limited accuracy. This study is the first of its kind to explore the feasibility of using a convolutional neural network (CNN) deep learning model with pulmonary artery pressure (PAP) tracings acquired during pre-operative hemodynamic assessment to identify patients at risk for early RHF. Methods: A CNN model was pre-trained on PAP tracings from the MIMIC-III Waveform Database to leverage transferable knowledge and improve model performance. The model learned general features and temporal relationships in hemodynamic tracing morphology for RHF prediction. It was then adapted for classification by modifying the output layers. Post-LVAD RHF was definitively adjudicated for each instance included from our 246 patient single center LVAD database. RHF was adjudicated using the 2020 Academic Research Consortium defintion. The database included 205 non-RHF instances and 41 RHF instances. We developed a novel signal processing method utilizing computer vision to extract PAP waveform data from pre-operative right heart catheterization reports. Data was reviewed to ensure accurate pressure tracing representation. SMOTE-ENN (synthetic oversampling) and class weighting addressed dataset imbalance during training to enhance model generalizability and RHF prediction accuracy. Results: The model achieved strong performance in classifying RHF from non-RHF outcomes, as evidenced by consistent AUC scores of 0.87 and 0.85 on validation and unseen test data, respectively. These findings indicate the potential for hemodynamic tracings to predict RHF after LVAD implantation. Notably, the model maintained its performance on unseen data, highlighting its generalizability. Conclusions: This study explored the feasibility of using a deep learning model for RHF risk stratification in patients with LVADs. The model, pre-trained on PAP tracings, achieved promising classification performance assessed by AUC. Further validation with larger, more diverse datasets will refine model performance and enhance generalizability for clinical application. Leveraging hemodynamic tracings within a deep learning framework holds promise for improved clinical outcome prediction.

Effects of snake fungal disease (ophidiomycosis) on the skin microbiome across two major experimental scales.

Emerging infectious diseases are increasingly recognized as a significant threat to global biodiversity conservation. Elucidating the relationship between pathogens and the host microbiome could lead to novel approaches for mitigating disease impacts. Pathogens can alter the host microbiome by inducing dysbiosis, an ecological state characterized by a reduction in bacterial alpha diversity, an increase in pathobionts, or a shift in beta diversity. We used the snake fungal disease (SFD;ophidiomycosis), system to examine how an emerging pathogen may induce dysbiosis across two experimental scales. We used quantitative polymerase chain reaction, bacterial amplicon sequencing, and a deep learning neural network to characterize the skin microbiome of free-ranging snakes across a broad phylogenetic and spatial extent. Habitat suitability models were used to find variables associated with fungal presence on the landscape. We also conducted a laboratory study of northern watersnakes to examine temporal changes in the skin microbiome following inoculation with Ophidiomyces ophidiicola. Patterns characteristic of dysbiosis were found at both scales, as were nonlinear changes in alpha and alterations in beta diversity, although structural-level and dispersion changes differed between field and laboratory contexts. The neural network was far more accurate (99.8% positive predictive value [PPV]) in predicting disease state than other analytic techniques (36.4% PPV). The genus Pseudomonas was characteristic of disease-negative microbiomes, whereas, positive snakes were characterized by the pathobionts Chryseobacterium, Paracoccus, and Sphingobacterium. Geographic regions suitable for O. ophidiicola had high pathogen loads (>0.66 maximum sensitivity+specificity). We found that pathogen-induced dysbiosis of the microbiome followed predictable trends, that disease state could be classified with neural network analyses, and that habitat suitability models predicted habitat for the SFD pathogen.

Method of Motion Path Planning Based on a Deep Neural Network with Vector Input

The article deals with the problem of path planning in a two-dimensional environment based on deep learning neural networks. Deep neural networks require large amounts of data and place high computational requirements on computing tools. The lack of sufficient data leads to a decrease in the accuracy of the neural network, and high computational requirements at the learning stage limit the use of this technology in engineering practice. In this paper, the forms of representation of the environment for the input of a neural network are studied. Vector form allows to reduce the amount of information supplied to the input of a neural network, but it leads to the need to use more complex neural networks. In this article, a combined form of representation is proposed, including a vector global and local map layout. The vector part of the map includes the position of the robot, the position of the target point and a description of obstacles. The local raster map describes the area closest to the robot. Using numerical research, the effectiveness of this form of data representation for a precise neural network is shown, compared with the raster representation of the map. In this article, two structures of neural networks are studied, one of which uses 8 possible directions of movement, and the other uses 3 possible directions of movement. It is shown that when using 3 possible directions, the cycling of trajectories planned by the neural network is eliminated, which leads to an increase in accuracy.

Performance Comparison between Deep Neural Network and Machine Learning based Classifiers for Huntington Disease Prediction from Human DNA Sequence.

Huntington Disease (HD) is a type of neurodegenerative disorder which causes problems like psychiatric disturbances, movement problem, weight loss and problem in sleep. It needs to be addressed in earlier stage of human life. Nowadays Deep Learning (DL) based system could help physicians provide second opinion in treating patient's disease. In this work, human Deoxyribo Nucleic Acid (DNA) sequence is analyzed using Deep Neural Network (DNN) algorithm to predict the HD disease. The main objective of this work is to identify whether the human DNA is affected by HD or not. Human DNA sequences are collected from National Center for Biotechnology Information (NCBI) and synthetic human DNA data are also constructed for process. Then numerical conversion of human DNA sequence data is done by Chaos Game Representation (CGR) method. After that, numerical values of DNA data are used for feature extraction. Mean, median, standard deviation, entropy, contrast, correlation, energy and homogeneity are extracted. Additionally, the following features such as counts of adenine, thymine, guanine and cytosine are extracted from the DNA sequence data itself. The extracted features are used as input to the DNN classifier and other machine learning based classifiers such as NN (Neural Network), Support Vector Machine (SVM), Random Forest (RF) and Classification Tree with Forward Pruning (CTWFP). Six performance measures are used such as Accuracy, Sensitivity, Specificity, Precision, F1 score and Mathew Correlation Co-efficient (MCC). The study concludes DNN, NN, SVM, RF achieve 100% accuracy and CTWFP achieves accuracy of 87%.

Improvement of Optimal Human Resource Allocation Algorithm Based on Deep Latent Semantic Model

With the advances of technology, the banking industry faces the challenge of processing large-scale, heterogeneous human resource data. Traditional methods have difficulties in providing efficient and accurate analysis and prediction. This paper proposes an optimized human resource allocation algorithm based on deep latent Semantic Model (DLSM), which improves the accuracy and efficiency of data analysis by integrating deep neural network (DNN) and transfer learning technology. The experimental results show that the DLSM model performs well in text classification and information retrieval tasks, with the accuracy, accuracy, recall and F1 scores improving by 7.5%, 5.5%, 6.0% and 5.8%, respectively. This study confirms the excellent performance of DLSM model in HR data processing, provides an efficient and scientifically based solution for recruitment optimization in the banking industry, and enhances the competitiveness of enterprises.

Exact and Data-Driven Lump Wave Solutions for the (3+1)-Dimensional Hirota–Satsuma–Ito-like Equation

In this paper, the lump wave solutions for (3+1)-dimensional Hirota–Satsuma–Ito-like (HSIl) equation are constructed by employing the Hirota bilinear method and quadratic function approach, and the corresponding propagation behaviors and nonlinear dynamical properties are also investigated. At the same time, the physics informed neural network (PINN) deep learning technique is employed to study the data-driven solutions for the HSIl equation from the derived lump wave solutions. The machine learning results show high effectiveness and accuracy, providing new techniques for discussing more nonlinear dynamics of lump waves and discovering new lump wave solutions.

Predicting removal of arsenic from groundwater by iron based filters using deep neural network models

Arsenic (As) contamination in drinking water has been highlighted for its environmental significance and potential health implications. Iron-based filters are cost-effective and sustainable solutions for As removal from contaminated water. Applying Machine Learning (ML) models to investigate and optimize As removal using iron-based filters is limited. The present study developed Deep Learning Neural Network (DLNN) models for predicting the removal of As and other contaminants by iron-based filters from groundwater. A small Original Dataset (ODS) consisting of 20 data points and 13 groundwater parameters was obtained from the field performances of 20 individual iron-amended ceramic filters. Cubic-spline interpolation (CSI) expanded the ODS, generating 1600 interpolated data points (IDPs) without duplication. The Bayesian optimization algorithm tuned the model hyper-parameters and IDPs in a Stratified fivefold Cross-Validation (CV) setup trained all the models. The models demonstrated reliable performances with the coefficient of determination (R2) 0.990–0.999 for As, 0.774–0.976 for Iron (Fe), 0.934–0.954 for Phosphorus (P), and 0.878–0.998 for predicting manganese (Mn) in the effluent. Sobol sensitivity analysis revealed that As (total order index (ST) = 0.563), P (ST = 0.441), Eh (ST = 0.712), and Temp (ST = 0.371) are the most sensitive parameters for the removal of As, Fe, P, and Mn. The comprehensive approach, from data expansion through DLNN model development, provides a valuable tool for estimating optimal As removal conditions from groundwater.

Seismic and outcrop-based 3D characterization of fault damage zones in sandstones, Rio do Peixe Basin, Brazil

Fault damage zones, composed of sub-seismic deformation structures, are difficult to detect using seismic data. Still, they can be related to fault throw, which is widely measured in the subsurface. This research employs a multiscale approach that integrates outcrop studies with seismic reflection data to investigate the attributes of fault damage zones affecting porous sandstones. We provide an in-depth understanding of the 3D fault zone volume, investigating correlations between geometric attributes of faults (width of damage zone, frequency of subsidiaries structures, and fault termination) in the outcrop and the fault throw in the subsurface, with insights from deformation mechanisms within the fault zone. The methods encompass 1D scanlines to constrain the damage zone width on the outcrop. At the same time, the subsurface analysis uses 3D seismic data, seismic attributes, and deep learning neural network (DNN) fault volumes to interpret fault geometries and quantify fault throw at different depths. Results show that the area presents a complex fault zone with multiple fault sets, deformation bands, and fracture corridors trending mainly NE-SW, NW-SE, and E-W. The integration of surface and subsurface fault data enabled the identification of two portions in each fault set outcropping at the fault tip for E-W/ESE-WNW-striking faults and the central part of the fault for NE-SW-striking faults. Faults with the greatest length do not outcrop with the largest damage zone width since they are outcropping the tip of the fault. The parallel faults overlap their damage zones, increasing the deformation zones in the affected sandstones. Fault throw and damage zone width present a positive correlation. This relation is affected by fault segments and subsidiary faults.

Deep Reinforcement Learning of Graph Convolutional Neural Network for Resilient Production Control of Mass Individualized Prototyping Toward Industry 5.0

Deep Reinforcement Learning of Graph Convolutional Neural Network for Resilient Production Control of Mass Individualized Prototyping Toward Industry 5.0

Physics-based parameters selection and machine learning based prediction of pool boiling bubble departure diameter

For forecasting the bubble departure diameter in pool boiling heat transfer, this study creates a deep-learning neural network based on physics and a variety of working fluids, manufactured surfaces, and materials subjected to different testing situations. This work analyzes nearly 5,000 data points of bubble departure diameters ranging from 0.2-28.7 mm using neural network input parameters such as saturation temperature, pressure, contact angle, surface roughness, surface tension, liquid density, gas density, wall superheat and heat flux, and other thermophysical properties, predicting their impact on the bubble departure diameter, and also uses them for training neural networks. The best Neural network which is designated as Case-4 is selected on the basis of coefficient of determination(R2), mean absolute error (MAE), and mean-square error (MSE) was used to understand the degree of influence of each input parameter and it was found that θ and Q have the greatest impact on the model. A comparison was also done to correlations proposed by researchers and it was found that neural networks have much better efficiency and accuracy than empirical formulas and thus can be an essential tool to predict the bubble diameter in the future.

Diabetic Retinopathy Recognition and Classification Using Transfer Learning Deep Neural Networks

Diabetic Retinopathy Recognition and Classification Using Transfer Learning Deep Neural Networks

Comparative Study of Semi-Active Control Effectiveness of Structures on Soft Soil Using MR Damper: Shaking Table Investigation

The effect of soil-structure interaction (SSI) cannot be neglected in semi-active vibration control of structures located on soft soil. To investigate the mitigating effect of magnetorheological (MR) damper on the semi-active control of structures considering the SSI, shaking table tests were conducted to evaluate the performance of the MR damper-based semi-active control system for structures on soft soil. In addition to a novel fuzzy control method based on online learning deep neural network (OL-DFNN), various control strategies, including passive OFF, passive ON, ON–OFF and deep neural network fuzzy control (DFNN) were systematically evaluated. The test results showed that the OL-DFNN control method exhibited superior adaptability to varying ground motion and structural dynamic characteristics compared to the other control methods. In particular, the OL-DFNN controller effectively mitigated the peak displacement and root mean square displacement, outperforming the passive OFF, passive ON, ON–OFF and DFNN control strategies. The test results highlight the effectiveness of the OL-DFNN control method in addressing the challenges posed by dynamic and time-varying characteristics in structural vibration control systems considering SSI.

A Plantar Pressure Detection and Gait Analysis System Based on Flexible Triboelectric Pressure Sensor Array and Deep Learning.

Gait detection is essential for the assessment of human health status and early diagnosis of diseases. The current gait analysis systems are bulky, limited in the scope of use, and cause interference with the movement of the measured person. Hence, it is necessary to develop a wearable gait detection system that is soft, breathable, lightweight, and self-powered. Here, a plantar pressure sensor array and gait analysis system based on a flexible triboelectric pressure sensor (FTPS) array is developed. Soft, breathable, and wearable electrospinning nanofiber film with excellent triboelectric properties is used as the plantar pressure sensor, achieving a high sensitivity of 45.1 mVkPa-1 in the range of 40-200 kPa and 19.4 mVkPa-1 in the range of 200-400 kpa. 32 FTPSs are integrated into an intelligent insole, which has the characteristics of soft, easy production, good air permeability, long-time stability, no external power supply, and etc. Based on the long short-term memory artificial neural network deep learning model, the accuracy of gait judgment can reach 94.23%. This work provides a feasible solution for real-time gait detection, which will have potential applications in human health assessment and early diagnosis of disease.

Supervised Deep Learning for Detecting and Locating Passive Seismic Events Recorded with DAS: A Case Study.

Exploring shallow mineral resources requires acquiring denser seismic data, for which Distributed Acoustic Sensing is an effective enabler and relevant to mining operations monitoring. Passive seismic can be of interest in characterizing the subsurface; however, dealing with large amounts of data pushes against the limits of existing computational systems and algorithms, especially for continuous monitoring. Hence, more than ever, novel data analysis methods are needed. In this article, we investigate using synthetic seismic data, paired with real noise recordings, as part of a supervised deep-learning neural network methodology to detect and locate induced seismic sources and explore their potential use to reconstruct subsurface properties. Challenges of this methodology were identified and addressed in the context of induced seismicity applications. Data acquisition and modelling were discussed, preparation workflows were implemented, and the method was demonstrated on synthetic data and tested on relevant seismic monitoring field dataset from the Otway CO2 injection site. Conducted tests confirmed the effects of time shifts, signal-to-noise ratios, and geometry mismatches on the performance of trained models. Those promising results showed the method's applicability and paved the way for potential application to more field data, such as seismic while drilling.

Accelerating spin Hall conductivity predictions via machine learning

AbstractAccurately predicting the spin Hall conductivity (SHC) is crucial for designing novel spintronic devices that leverage the spin Hall effect. First‐principles calculations of SHCs are computationally intensive and unsuitable for quick high‐throughput screening. Here, we have developed a residual crystal graph convolutional neural network (Res‐CGCNN) deep learning model to classify and predict SHCs solely based on the structural and compositional information. This is enabled by having access to 9249 instances of SHCs data and incorporating extra residual networks into the standard CGCNN framework. We found that Res‐CGCNN surpasses CGCNN, achieving a mean absolute error of 115.4 (ℏ/e) (S/cm) for regression and an area under the receiver operating characteristic curve of 0.86 for classification. Additionally, we utilized Res‐CGCNN to conduct high‐throughput screenings of materials in the Materials Project database that were absent in the training set. This led to the prediction of several previously unreported materials displaying large SHCs exceeding 1000 (ℏ/e) (S/cm), which were validated through first‐principles calculations. This study represents the inaugural endeavor to construct a machine learning model capable of effectively capturing the intricate nonlinear relationship between SHCs and crystal structure and composition, serving as a useful tool for the efficient screening and design of materials exhibiting high SHCs.

Advances in deep learning-based intelligent receivers

Abstract. This paper presents a summary of the progress of deep learning in the research of intelligent receivers and predicts its future development direction. First, the background of the era of intelligent receivers is introduced. With the rapid development of communication technology, intelligent receivers show insufficient flexibility, low accuracy, and spectral efficiency in detecting current radio signals. This is a challenge that is difficult to overcome in order to meet the needs of modern signal recovery. With the advent of artificial intelligence technologies such as deep learning, academia and industry began to explore the potential of applying these techniques to the field of communication receivers, leading to the emergence of intelligent receivers. This paper then introduces the fundamentals of wireless communication systems and deep learning neural networks, laying the groundwork for a deeper understanding of the subsequent content. Chapter 3 provides a comprehensive overview of the application of intelligent receivers in signal reception, including channel estimation, signal detection, modulation identification, demodulation and decoding. Finally, the paper considers the practical applications of intelligent receivers and speculates on their future development.

Digital rock modeling of deformed multi-scale media in deep hydrocarbon reservoirs based on in-situ stress-loading CT imaging and U-Net deep learning

Deep and ultra-deep hydrocarbon reservoirs are regarded as an attractive target for onshore oil and gas exploration and development in China. The multi-scale fractures are widely distributed in this type of reservoir. The fluid-solid coupling effect is strong, which can greatly affect the fluid flow, resulting in a low hydrocarbon recovery with the average value less than 15%. To explore the underlying flow dynamics during efficient development of deep and ultra-deep hydrocarbon reservoirs, it is of great importance to characterize the multi-scale fracture-pore structure evolution of rock affected by strong geo-stress field variation. To tackle the above issues, an actual rock drilled from a typical ultra-deep reservoir in Tarim Basin are selected to conduct in-situ stress-loading computed tomography (CT) scanning experiments, and the CT gray images of rock microstructure under different dynamic loading conditions are obtained. A fully convolutional neural network (U-Net) deep learning segmentation algorithm is introduced to accurately distinguish the rock skeleton, pore space and fractures in deep rock. The three-dimensional (3-D) digital rock model of deformed multi-scale fracture-porous media under different dynamic loading conditions is ultimately established to investigate the evolution of fracture morphology and deep rock microstructure as the in-situ stress is gradually loaded. It indicates that, the U-Net deep learning semantic segmentation algorithm can accurately segment CT images of deep rocks, and the established 3D digital rock model of fractured porous media can accurately represent the pore-throat distribution, fracture morphology, and pore-scale topological connectivity. At the initial stage of stress loading, there are few micro-fractures inside the rock, and the fracture connectivity is poor. Due to effect of rock compaction, the average pore throat radius increases while pore throat ratio, coordination number and tortuosity greatly decrease. As the effective stress is gradually loaded, the micro-fractures begin to propagate, leading to stronger heterogeneity of micro-fractures’ distribution and better topological connectivity, and both the coordination number and tortuosity gradually increase. After the deep rock is fractured, micro-fractures run through a fracture network and all the above topological parameters increase greatly.

Advancements in the use of AI in the diagnosis and management of inflammatory bowel disease.

Inflammatory bowel disease (IBD) causes chronic inflammation of the colon and digestive tract, and it can be classified as Crohn's disease (CD) and Ulcerative colitis (UC). IBD is more prevalent in Europe and North America, however, since the beginning of the 21st century it has been increasing in South America, Asia, and Africa, leading to its consideration as a worldwide problem. Optical colonoscopy is one of the crucial tests in diagnosing and assessing the progression and prognosis of IBD, as it allows a real-time optical visualization of the colonic wall and ileum and allows for the collection of tissue samples. The accuracy of colonoscopy procedures depends on the expertise and ability of the endoscopists. Therefore, algorithms based on Deep Learning (DL) and Convolutional Neural Networks (CNN) for colonoscopy images and videos are growing in popularity, especially for the detection and classification of colorectal polyps. The performance of this system is dependent on the quality and quantity of the data used for training. There are several datasets publicly available for endoscopy images and videos, but most of them are solely specialized in polyps. The use of DL algorithms to detect IBD is still in its inception, most studies are based on assessing the severity of UC. As artificial intelligence (AI) grows in popularity there is a growing interest in the use of these algorithms for diagnosing and classifying the IBDs and managing their progression. To tackle this, more annotated colonoscopy images and videos will be required for the training of new and more reliable AI algorithms. This article discusses the current challenges in the early detection of IBD, focusing on the available AI algorithms, and databases, and the challenges ahead to improve the detection rate.

A Machine Learning Approach for Modeling the Spatial-temporal Propagation Pattern of COVID-19

Abstract. Predicting infections resulting from epidemiological contagions involves a complex therapeutic endeavor that necessitates the consideration of various factors within the available data. COVID-19, a globally recognized highly dangerous disease, presents an opportunity to effectively understand its patterns and spatial determinants to combat similar ailments. This study seeks to employ a deep neural network and several machine learning techniques to identify the crucial factors influencing COVID-19 infections and to forecast the spatial-temporal spread of the disease. Previous research has focused on predicting outcomes using a limited set of 8 patient variables. To contribute to this field, the current investigation analyzes a dataset comprising 47,029 records of infected individuals who sought medical attention, with 18,433 of them testing positive for the coronavirus and requiring hospitalization. The study explores the prediction of illness and hospitalization needs based on geographical locations by utilizing machine learning algorithms such as Random Forest, Naive Bayes, Decision Tree, and K-Nearest Neighbor. The machine learning process commences with input data (comprising the 47,029 records), enabling the machine to identify patterns within the dataset and subsequently make informed decisions based on these patterns and insights gained. The primary objective is to allow the machine to autonomously learn and refine its predictions without human intervention. Applying these algorithms to COVID-19 data for spatial-temporal prediction revealed that the Random Forest algorithm achieved the highest accuracy of 0.84, while the Simple Bayes algorithm exhibited the lowest accuracy at 0.50. Additionally, the study compared random forest, decision tree, simple bayes, and K-nearest neighbor algorithms to predict the severity of road accidents.