Influence of prefabricated fissure angles on mechanical and infrared properties of red sandstone and failure prediction based on deep learning

This article focuses on the application of deep learning methods for failure prediction. Failure prediction plays a crucial role in various industries to prevent unexpected equipment failures, minimize downtime, and improve maintenance strategies. Deep learning techniques, known for their ability to capture complex patterns and dependencies in data, are explored in this study. The research employs Multi-Layer Perceptron as deep learning architectures. This model is trained on AI4I 2020 Predictive Maintenance data to develop accurate failure prediction models. Data preprocessing involves cleaning, feature engineering, and normalization to ensure the quality and suitability of the data for deep learning models. The dataset is split into training and testing sets for model development and evaluation. Performance evaluation metrics such as accuracy, ROC, and AUC are utilized to assess the models' effectiveness in predicting failures. The experimental results demonstrate the effectiveness of deep learning methods in failure prediction. The models showcase high accuracy and outperform SVM approaches, particularly in capturing intricate patterns and temporal dependencies within the data. The utilization of Multi-Layer Perceptron architecture further enhances the models' ability to capture long-term dependencies. However, challenges such as the availability of diverse and high-quality data, the selection of appropriate architecture and hyperparameters, and the interpretability of deep learning models remain significant considerations. Interpretability remains a challenge due to the inherent complexity and black-box nature of deep learning models. In conclusion, deep learning method offer significant potential for accurate failure prediction. Their ability to capture complex patterns and temporal dependencies makes them well-suited for analyzing operational and sensor data. Future research should focus on addressing challenges related to data quality, interpretability, and model optimization to further enhance the application of deep learning in failure prediction.

Deep cross-modal feature learning applied to predict acutely decompensated heart failure using in-home collected electrocardiography and transthoracic bioimpedance

Digital pathology and artificial intelligence offer new opportunities for automatic histologic scoring. We applied a deep learning approach to IgA nephropathy biopsy images to develop an automatic histologic prognostic score, assessed against ground truth (kidney failure) among patients with IgA nephropathy who were treated over 39 years. We assessed noninferiority in comparison with the histologic component of currently validated predictive tools. We correlated additional histologic features with our deep learning predictive score to identify potential additional predictive features. Training for deep learning was performed with randomly selected, digitalized, cortical Periodic acid-Schiff-stained sections images (363 kidney biopsy specimens) to develop our deep learning predictive score. We estimated noninferiority using the area under the receiver operating characteristic curve (AUC) in a randomly selected group (95 biopsy specimens) against the gold standard Oxford classification (MEST-C) scores used by the International IgA Nephropathy Prediction Tool and the clinical decision supporting system for estimating the risk of kidney failure in IgA nephropathy. We assessed additional potential predictive histologic features against a subset (20 kidney biopsy specimens) with the strongest and weakest deep learning predictive scores. We enrolled 442 patients; the 10-year kidney survival was 78%, and the study median follow-up was 6.7 years. Manual MEST-C showed no prognostic relationship for the endocapillary parameter only. The deep learning predictive score was not inferior to MEST-C applied using the International IgA Nephropathy Prediction Tool and the clinical decision supporting system (AUC of 0.84 versus 0.77 and 0.74, respectively) and confirmed a good correlation with the tubolointerstitial score (r=0.41, P<0.01). We observed no correlations between the deep learning prognostic score and the mesangial, endocapillary, segmental sclerosis, and crescent parameters. Additional potential predictive histopathologic features incorporated by the deep learning predictive score included (1) inflammation within areas of interstitial fibrosis and tubular atrophy and (2) hyaline casts. The deep learning approach was noninferior to manual histopathologic reporting and considered prognostic features not currently included in MEST-C assessment. This article contains a podcast at https://www.asn-online.org/media/podcast/CJASN/2022_07_26_CJN01760222.mp3.

Introduction Early excision and grafting (E&amp;G) remains a mainstay in the treatment of burns. Procedures to remove necrotic tissue from severe burn wounds continue to be challenging and may affect rates of successful grafting. The use of laser speckle imaging (LSI) may help detect necrotic tissue remaining but requires human interpretation. Additional decision-making support is needed, especially in prolonged field care settings. The purpose of this study was to evaluate whether graft success or failure can be predicted from LSI using machine learning (ML) and deep learning (DL) techniques in a porcine burn model of various burn depths. Methods Anesthetized Yorkshire pigs (n=12) were burned with a 5x5 cm square brass block (0.4 kg/cm2) @ 100°C to produce partial, deep partial, or full thickness burns (PT, DPT, FT) at 10 square sections on the back of each pig. Debridement was randomized from 1 (0.030”) to 4 (0.120”) passes performed using a dermatome, and then meshed split thickness skin grafts taken from 4 caudal donor sites were applied to wounds. Post-debridement was denoted as Day 0. Graft success/failure (&amp;gt;70% graft take) was determined at Day 7. Laser speckle images were captured at Days 0, 3, 7, 10, and 14. ML and DL were used to develop models in order to predict graft failure and burn/debridement depth. Model performance was measured using loss, accuracy, and confusion matrices. Results Of 120 sections corresponding to 12 pigs, 7.5% (9/120) were not burned, 41.7% (50/120) were PT, 25.8% (31/120) were DPT, and 25.0% (30/120) were FT burns. Graft failure was 19.2% (23/120), with a 50.0% (10/20) rate for DPT burns involving 1- or 2-pass debridement. Both ML and DL used 600 images for algorithm development; 540 images, for training; and 60 images, for testing. DL was superior over ML in test accuracy (93.3% vs 75.0%, p&amp;lt; 0.05). A three-stage architecture plus image resizing was employed in DL to predict graft failure and burn/debridement depth. A best convolutional neural network for graft failure prediction was obtained, yielding a minimum cross entropy loss of 11.7% and accuracies of 96.5% (training), 93.3% (testing 1), 100.0% (testing 2), and 96.2% (overall). Promising results were also obtained for predicting burn/debridement depth: 97.6% (training), 93.3% (testing). Conclusions This study showed that graft success or failure can be predicted from LSI and DL in a porcine burn model of various debridement depths. Use of this technology may provide a potential approach for accurately assessing early E&amp;G in severely burned patients and may aid providers during prolonged field care scenarios. Applicability of Research to Practice Use of LSI in conjunction with DL may provide a potential approach for accurately assessing early E&amp;G in severely burned patients and may aid providers during prolonged field care scenarios.

The combination of big data and deep learning is a world-shattering technology that can make a great impact on any industry if used in a proper way. With the availability of large volume of health care datasets and progressions in deep learning techniques, systems are now well equipped in diagnosing many health problems. Utilizing the intensity of substantial historical information in electronic health record (EHR), we built up, a conventional predictive temporal model utilizing recurrent neural systems (RNN) like LSTM and connected to longitudinal time stepped EHR. Experience records were contribution to RNN to anticipate the analysis and prescription classes for a resulting visit during heart disappointment (e.g. diagnosis codes, drug codes or method codes). In this paper, we also investigated whether use of deep learning to model temporal relations among events in electronic health records (EHRs) would enhance the model performance in predicting initial diagnosis of heart failure (HF) compared to some of the traditional methods that disregard temporality. By examining these time stamped EHRs, we could recognize the associations between various diagnosis occasions and finally predicate when a patient is being analyzed for a disease. In any case, it is hard to access the current EHR data straightforwardly, since almost all data are sparse and not standardized. Along these lines, we proposed a robust model for prediction of heart failure. The fundamental commitment of this paper is to predict the failure of heart by means of a neural network model based on patient's electronic medicinal information. In order to, demonstrate the diagnosis events and prediction of heart failure, we used the medical concept vectors and the essential standards of a long short-term memory (LSTM) deep network model. The proposed LSTM model uses SiLU and tanh as activation function in the hidden layers and Softmax in output layer in the network. Bridgeout is used as a regularization technique for weight optimization throughout the network. Assessments subject to the real-time data exhibit the favorable effectiveness and feasibility of recommended model in the risk of heart failure prediction. The results showed improved accuracy in heart failure detection and the model performance is compared using the existing deep learning models. Enhanced prior detection could expose novel chances for deferring or anticipating movement to analysis of heart failure and diminish cost.

Failures in optical transport networks usually result in lots of services being interrupted and a huge economic loss. If the failures can be predicted in advance, some actions can be conducted to avoid the above adverse consequences. Deep learning is a good technology of artificial intelligence, which can be used in many scenarios to replace humans’ activities. Event prediction is a typical scenario, where deep learning can be used based on a large dataset. Therefore, deep learning can be used in optical transport networks for failure prediction. However, dataset construction is an important problem for deep learning in optical transport networks, because there may be not enough data in reality. This paper proposes a deep-learning-based failure prediction (DLFP) algorithm that constructs available dataset based on data-augmentation for data training. DLFP algorithm is composed of alarm compression, data augmentation, and fully-connected back-propagation neural network (FCNN) algorithm. Besides, a benchmark algorithm (BA) without data augmentation is introduced. A training model is constructed based on massive real performance data and related alarm data within one month, which are collected from national backbone synchronous digital hierarchy (SDH) network with 274 nodes and 487 links in China. Then the training model is used with test dataset to verify the performance in terms of prediction accuracy. Evaluation results show that the proposed algorithm is able to reach better performance for failure prediction compared with the benchmark without data augmentation.

Predicting maintenance and preventing failures in natural gas pipelines is critical for safety and efficiency in the oil and gas industry. This research utilizes machine learning (ML) and deep learning (DL) methods to predict failures in natural gas transmission pipelines. Using a dataset from the U.S. Department of Transportation’s Pipeline and Hazardous Materials Safety Administration (PHMSA), the study examines failure incidents from 2010-2019 and non-failure data from 2020-2023. The research involves comprehensive data preprocessing, addressing missing values and dataset imbalances. Key pipeline attributes such as diameter, wall thickness, age, and operating pressure are used for failure prediction. The ML approach employs logistic regression, optimized for binary classification tasks, to establish the probability of pipeline failures. For the DL approach, an Artificial Neural Network (ANN) with Feed Forward and Back Propagation algorithms is developed. Key parameters, including activation functions and hyperparameters, are finely tuned to enhance predictive performance. ReLU activation functions are used in input and hidden layers, while the sigmoid function is applied to the output layer. Performance evaluation of both ML and DL models is based on accuracy, F1 Score, and Area Under Curve (AUC). In summary, ML showed better performance than DL, with value of accuracy is 0.74, F1 Score is 0.85, and AUC is 0.55 while the value of accuracy, F1 score, AUC from DL is 0.61, 0.003, and 0.58 respectively. DL offers superior performance in handling complex and huge amounts of data. In the other hand, ML offers more robust models and simpler adjustable models than DL. Because of the amount of computed data in this research, it is better to have ML as a predictive algorithm.

This paper presents a comparative analysis of deep learning techniques for anomaly detection and failure prediction. We explore various deep learning architectures on an IoT dataset, including recurrent neural networks (RNNs, LSTMs and GRUs), convolutional neural networks (CNNs) and transformers, to assess their effectiveness in anomaly detection and failure prediction. It was found that the hybrid transformer-GRU configuration delivers the highest accuracy, albeit at the cost of requiring the longest computational time for training. Furthermore, we employ explainability techniques to elucidate the decision-making processes of these black box models and evaluate their behaviour. By analysing the inner workings of the models, we aim at providing insights into the factors influencing failure predictions. Through comprehensive experimentation and analysis on sensor data collected from a water pump, this study contributes to the understanding of deep learning methodologies for anomaly detection and failure prediction and underscores the importance of model interpretability in critical applications such as prognostics and health management. Additionally, we specify the architecture for deploying these models in a real environment using the RAI4.0 metamodel, meant for designing, configuring and automatically deploying distributed stream-based industrial applications. Our findings will offer valuable guidance for practitioners seeking to deploy deep learning techniques effectively in predictive maintenance systems, facilitating informed decision-making and enhancing reliability and efficiency in industrial operations.

The rapid advancements in urban health infrastructure necessitate robust and proactive maintenance strategies to ensure system reliability, efficiency, and safety. Predictive maintenance, powered by deep learning models, has emerged as a transformative approach, enabling real-time fault detection, failure prediction, and optimization of maintenance schedules. This chapter explores the integration of Internet of Things (IoT) sensors and multi-modal data with deep learning algorithms to address the unique challenges in anomaly detection and predictive maintenance of urban health systems. Key challenges, such as handling heterogeneous data sources, ensuring data quality, and developing hybrid deep learning models for improved accuracy, are examined in detail. Additionally, innovative solutions like data fusion techniques, real-time alert systems, and multimodal predictive frameworks are presented. The chapter emphasizes how these advancements enhance system resilience, minimize downtime, and improve operational efficiency. Through detailed analysis and practical insights, this chapter provides a comprehensive framework for leveraging deep learning in predictive maintenance, ensuring sustainable and reliable urban health infrastructure.

In this paper, the sandstone failure prediction was investigated, based on the deep learning and acoustic emission (AE) monitoring technique under uniaxial compressive loading condition. A deep learning-based prediction model was proposed to establish the relationship between failure time and AE characteristics and predict sandstone failure under uniaxial compressive loading condition. The results shows that the deep learning model is capable in forecasting sandstone failure by remaining time to stress peak (RTSP). Among considered models, mixed model combining convolutional neural networks (CNN) with gated recurrent units (GRU) performed best comprehensively and got higher in the metric of R2. Meanwhile, the optimal combination of input features and optimization of hyper-parameters in the training process of the deep learning model were analyzed and discussed. The work demonstrated that the rock failure prediction methodology realized by the deep learning and AE monitoring technique was capable for early-warning of sandstone failure.

The use of aircraft operation logs to develop a data-driven model to predict probable failures that could cause interruption poses many challenges and has yet to be fully explored. Given that aircraft is high-integrity assets, failures are exceedingly rare. Hence, the distribution of relevant log data containing prior signs will be heavily skewed towards the typical (healthy) scenario. Thus, this study presents a novel deep learning technique based on the auto-encoder and bidirectional gated recurrent unit networks to handle extremely rare failure predictions in aircraft predictive maintenance modelling. The auto-encoder is modified and trained to detect rare failures, and the result from the auto-encoder is fed into the convolutional bidirectional gated recurrent unit network to predict the next occurrence of failure. The proposed network architecture with the rescaled focal loss addresses the imbalance problem during model training. The effectiveness of the proposed method is evaluated using real-world test cases of log-based warning and failure messages obtained from the fleet database of aircraft central maintenance system records. The proposed model is compared to other similar deep learning approaches. The results indicated an 18% increase in precision, a 5% increase in recall, and a 10% increase in G-mean values. It also demonstrates reliability in anticipating rare failures within a predetermined, meaningful time frame.

Connected vehicle fleets have formed significant component of industrial internet of things scenarios as part of Industry 4.0 worldwide. The number of vehicles in these fleets has grown at a steady pace. The vehicles monitoring with machine learning algorithms has significantly improved maintenance activities. Predictive maintenance potential has increased where machines are controlled through networked smart devices. Here, benefits are accrued considering uptimes optimization. This has resulted in reduction of associated time and labor costs. It has also provided significant increase in cost benefit ratios. Considering vehicle fault trends in this research predictive maintenance problem is addressed through hybrid deep learning-based ensemble method (HDLEM). The ensemble framework which acts as predictive analytics engine comprises of three deep learning algorithms viz modified cox proportional hazard deep learning (MCoxPHDL), modified deep learning embedded semi supervised learning (MDLeSSL) and merged LSTM (MLSTM) networks. Both sensor as well as historical maintenance data are collected and prepared using benchmarking methods for HDLEM training and testing. Here, times between failures (TBF) modeling and prediction on multi-source data are successfully achieved. The results obtained are compared with stated deep learning models. This ensemble framework offers great potential towards achieving more profitable, efficient and sustainable vehicle fleet management solutions. This helps better telematics data implementation which ensures preventative management towards desired solution. The ensemble method's superiority is highlighted through several experimental results.

Heart failure is the most common cause of death in both males and females around the world. Cardiovascular diseases (CVDs), in particular, are the main cause of death worldwide, accounting for 30% of all fatalities in the United States and 45% in Europe. Artificial intelligence (AI) approaches such as machine learning (ML) and deep learning (DL) models are playing an important role in the advancement of heart failure therapy. The main objective of this study was to perform a network meta-analysis of patients with heart failure, stroke, hypertension, and diabetes by comparing the ML and DL models. A comprehensive search of five electronic databases was performed using ScienceDirect, EMBASE, PubMed, Web of Science, and IEEE Xplore. The search strategy was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. The methodological quality of studies was assessed by following the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) guidelines. The random-effects network meta-analysis forest plot with categorical data was used, as were subgroups testing for all four types of treatments and calculating odds ratio (OR) with a 95% confidence interval (CI). Pooled network forest, funnel plots, and the league table, which show the best algorithms for each outcome, were analyzed. Seventeen studies, with a total of 285,213 patients with CVDs, were included in the network meta-analysis. The statistical evidence indicated that the DL algorithms performed well in the prediction of heart failure with AUC of 0.843 and CI [0.840–0.845], while in the ML algorithm, the gradient boosting machine (GBM) achieved an average accuracy of 91.10% in predicting heart failure. An artificial neural network (ANN) performed well in the prediction of diabetes with an OR and CI of 0.0905 [0.0489; 0.1673]. Support vector machine (SVM) performed better for the prediction of stroke with OR and CI of 25.0801 [11.4824; 54.7803]. Random forest (RF) results performed well in the prediction of hypertension with OR and CI of 10.8527 [4.7434; 24.8305]. The findings of this work suggest that the DL models can effectively advance the prediction of and knowledge about heart failure, but there is a lack of literature regarding DL methods in the field of CVDs. As a result, more DL models should be applied in this field. To confirm our findings, more meta-analysis (e.g., Bayesian network) and thorough research with a larger number of patients are encouraged.

Prognostics and Remaining Useful Life (RUL) estimations of complex systems are essential to operational safety, increased efficiency, and help to schedule maintenance proactively. Modeling the remaining useful life of a system with many complexities is possible with the rapid development in the field of deep learning as a computational technique for failure prediction. Deep learning can adapt to multivariate parameters complex and nonlinear behavior, which is difficult using traditional time-series models for forecasting and prediction purposes. In this paper, a deep learning approach based on Long Short-Term Memory (LSTM) network is used to predict the remaining useful life of the PCB at different conditions of temperature and vibration. This technique can identify the different underlying patterns in the time series that can predict the RUL. This study involves feature vector identification and RUL estimations for SAC305, SAC105, and Tin Lead solder PCBs under different vibration levels and temperature conditions. The acceleration levels of vibration are fixed at 5g and 10g, while the temperature levels are 55°C and 100°C. The test board is a multilayer FR4 configuration with JEDEC standard dimensions consists of twelve packages arranged in a rectangular pattern. Strain signals are acquired from the backside of the PCB at symmetric locations to identify the failure of all the packages during vibration. The strain signals are resistance values that are acquired simultaneously during the experiment until the failure of most of the packages on the board. The feature vectors are identified from statistical analysis on the strain signals frequency and instantaneous frequency components. The principal component analysis is used as a data reduction technique to identify the different patterns produced from the four strain signals with failures of the packages during vibration. LSTM deep learning method is used to model the RUL of the packages at different individual operating conditions of vibration for all three solder materials involved in this study. A combined model for RUL prediction for a material that can take care of the changes in the operating conditions is also modeled for each material.

Background/Introduction Predicting incident heart failure has been challenging. Deep learning models when applied to rich electronic health records (EHR) offer some theoretical advantages. However, empirical evidence for their superior performance is limited and they remain commonly uninterpretable, hampering their wider use in medical practice. Purpose We developed a deep learning framework for more accurate and yet interpretable prediction of incident heart failure. Methods We used longitudinally linked EHR from practices across England, involving 100,071 patients, 13% of whom had been diagnosed with incident heart failure during follow-up. We investigated the predictive performance of a novel transformer deep learning model, “Transformer for Heart Failure” (BEHRT-HF), and validated it using both an external held-out dataset and an internal five-fold cross-validation mechanism using area under receiver operating characteristic (AUROC) and area under the precision recall curve (AUPRC). Predictor groups included all outpatient and inpatient diagnoses within their temporal context, medications, age, and calendar year for each encounter. By treating diagnoses as anchors, we alternatively removed different modalities (ablation study) to understand the importance of individual modalities to the performance of incident heart failure prediction. Using perturbation-based techniques, we investigated the importance of associations between selected predictors and heart failure to improve model interpretability. Results BEHRT-HF achieved high accuracy with AUROC 0.932 and AUPRC 0.695 for external validation, and AUROC 0.933 (95% CI: 0.928, 0.938) and AUPRC 0.700 (95% CI: 0.682, 0.718) for internal validation. Compared to the state-of-the-art recurrent deep learning model, RETAIN-EX, BEHRT-HF outperformed it by 0.079 and 0.030 in terms of AUPRC and AUROC. Ablation study showed that medications were strong predictors, and calendar year was more important than age. Utilising perturbation, we identified and ranked the intensity of associations between diagnoses and heart failure. For instance, the method showed that established risk factors including myocardial infarction, atrial fibrillation and flutter, and hypertension all strongly associated with the heart failure prediction. Additionally, when population was stratified into different age groups, incident occurrence of a given disease had generally a higher contribution to heart failure prediction in younger ages than when diagnosed later in life. Conclusions Our state-of-the-art deep learning framework outperforms the predictive performance of existing models whilst enabling a data-driven way of exploring the relative contribution of a range of risk factors in the context of other temporal information. Funding Acknowledgement Type of funding source: Private grant(s) and/or Sponsorship. Main funding source(s): National Institute for Health Research, Oxford Martin School, Oxford Biomedical Research Centre