Intelligent Pipeline Research Articles

A phenotype-based AI pipeline outperforms human experts in differentially diagnosing rare diseases using EHRs

Rare diseases, affecting ~350 million people worldwide, pose significant challenges in clinical diagnosis due to the lack of experienced physicians and the complexity of differentiating between numerous rare diseases. To address these challenges, we introduce PhenoBrain, a fully automated artificial intelligence pipeline. PhenoBrain utilizes a BERT-based natural language processing model to extract phenotypes from clinical texts in EHRs and employs five new diagnostic models for differential diagnoses of rare diseases. The AI system was developed and evaluated on diverse, multi-country rare disease datasets, comprising 2271 cases with 431 rare diseases. In 1936 test cases, PhenoBrain achieved an average predicted top-3 recall of 0.513 and a top-10 recall of 0.654, surpassing 13 leading prediction methods. In a human-computer study with 75 cases, PhenoBrain exhibited exceptional performance with a top-3 recall of 0.613 and a top-10 recall of 0.813, surpassing the performance of 50 specialist physicians and large language models like ChatGPT and GPT-4. Combining PhenoBrain’s predictions with specialists increased the top-3 recall to 0.768, demonstrating its potential to enhance diagnostic accuracy in clinical workflows.

Improving Localization Accuracy of Offline Navigation Algorithms for Intelligent Pipeline Inspection Gauges and In‐Line Inspection Robotic Systems

Improving Localization Accuracy of Offline Navigation Algorithms for Intelligent Pipeline Inspection Gauges and In‐Line Inspection Robotic Systems

DSS4EX: A Decision Support System framework to explore Artificial Intelligence pipelines with an application in time series forecasting

DSS4EX: A Decision Support System framework to explore Artificial Intelligence pipelines with an application in time series forecasting

CNS-CLIP: Transforming a Neurosurgical Journal Into a Multimodal Medical Model.

Classical biomedical data science models are trained on a single modality and aimed at one specific task. However, the exponential increase in the size and capabilities of the foundation models inside and outside medicine shows a shift toward task-agnostic models using large-scale, often internet-based, data. Recent research into smaller foundation models trained on specific literature, such as programming textbooks, demonstrated that they can display capabilities similar to or superior to large generalist models, suggesting a potential middle ground between small task-specific and large foundation models. This study attempts to introduce a domain-specific multimodal model, Congress of Neurological Surgeons (CNS)-Contrastive Language-Image Pretraining (CLIP), developed for neurosurgical applications, leveraging data exclusively from Neurosurgery Publications. We constructed a multimodal data set of articles from Neurosurgery Publications through PDF data collection and figure-caption extraction using an artificial intelligence pipeline for quality control. Our final data set included 24 021 figure-caption pairs. We then developed a fine-tuning protocol for the OpenAI CLIP model. The model was evaluated on tasks including neurosurgical information retrieval, computed tomography imaging classification, and zero-shot ImageNet classification. CNS-CLIP demonstrated superior performance in neurosurgical information retrieval with a Top-1 accuracy of 24.56%, compared with 8.61% for the baseline. The average area under receiver operating characteristic across 6 neuroradiology tasks achieved by CNS-CLIP was 0.95, slightly superior to OpenAI's Contrastive Language-Image Pretraining at 0.94 and significantly outperforming a vanilla vision transformer at 0.62. In generalist classification, CNS-CLIP reached a Top-1 accuracy of 47.55%, a decrease from the baseline of 52.37%, demonstrating a catastrophic forgetting phenomenon. This study presents a pioneering effort in building a domain-specific multimodal model using data from a medical society publication. The results indicate that domain-specific models, while less globally versatile, can offer advantages in specialized contexts. This emphasizes the importance of using tailored data and domain-focused development in training foundation models in neurosurgery and general medicine.

Automated video-based pain recognition in cats using facial landmarks

Affective states are reflected in the facial expressions of all mammals. Facial behaviors linked to pain have attracted most of the attention so far in non-human animals, leading to the development of numerous instruments for evaluating pain through facial expressions for various animal species. Nevertheless, manual facial expression analysis is susceptible to subjectivity and bias, is labor-intensive and often necessitates specialized expertise and training. This challenge has spurred a growing body of research into automated pain recognition, which has been explored for multiple species, including cats. In our previous studies, we have presented and studied artificial intelligence (AI) pipelines for automated pain recognition in cats using 48 facial landmarks grounded in cats’ facial musculature, as well as an automated detector of these landmarks. However, so far automated recognition of pain in cats used solely static information obtained from hand-picked single images of good quality. This study takes a significant step forward in fully automated pain detection applications by presenting an end-to-end AI pipeline that requires no manual efforts in the selection of suitable images or their landmark annotation. By working with video rather than still images, this new pipeline approach also optimises the temporal dimension of visual information capture in a way that is not practical to preform manually. The presented pipeline reaches over 70% and 66% accuracy respectively in two different cat pain datasets, outperforming previous automated landmark-based approaches using single frames under similar conditions, indicating that dynamics matter in cat pain recognition. We further define metrics for measuring different dimensions of deficiencies in datasets with animal pain faces, and investigate their impact on the performance of the presented pain recognition AI pipeline.

An investigation on energy-saving scheduling algorithm of wireless monitoring sensors in oil and gas pipeline networks

With the rapid development of the oil and gas industry, monitoring the safety and efficiency of pipeline networks has become particularly important. In this context, Wireless Sensor Networks (WSNs) are widely used for monitoring oil and gas pipelines due to their flexible deployment and cost-effectiveness. However, since sensor nodes typically rely on limited battery power, extending the network’s lifecycle and improving energy utilization efficiency have become focal points of research. Therefore, this paper proposes an energy-saving scheduling algorithm based on transformer networks, aimed at optimizing energy consumption and data transmission efficiency of wireless monitoring sensors in oil and gas pipelines. Firstly, this study designs a deep learning-based Transformer model that learns from historical data on energy consumption patterns and environmental variables to predict the energy and data transmission needs of each sensor node. Secondly, based on the prediction results, this algorithm employs a dynamic scheduling strategy that automatically adjusts the sensor’s operational mode and communication frequency according to the node’s energy status and task urgency. Additionally, we have validated the effectiveness of the proposed algorithm through field tests and simulation experiments. According to the experimental results, our model has higher efficiency in energy saving. Compared with Convolutional Neural Networks, Recurrent Neural Networks and Graph Neural Networks, the total energy consumption of sensor networks under the model scheduling in this paper was reduced by 6.7%, 33.4% and 26.3%, respectively. Our algorithms improve the energy efficiency and stability of the monitoring system and provide important technical support for future intelligent pipeline monitoring systems. We hope this paper will inspire future scientific research in this field.

Research on Automatic Pipe Cleaning Technology for Natural Gas Medium and Low Pressure Pipelines

Abstract As the number of low-production and low-efficiency wells in Chang Qing gas field increases gradually, and the problems of pipeline liquid accumulation, freezing plugging and leakage due to production with liquid are worsening, in view of the low efficiency of manual analysis of abnormal pipeline status, the difficulty of timely detection of potential problems and the labor intensity of manual blockage clearing operation, we study an automatic pipeline clearing technology applicable to medium- and low-pressure gas pipelines in the gas field, which mainly includes pipeline operation status analysis and early warning system and automatic pipeline clearing device. An analysis and warning algorithm module is proposed to analyze, warn and locate the frozen plugging point based on pipeline pressure, differential pressure and flow parameters in real time. A low and medium pressure balling device is designed to achieve the goals of intelligent control, pressure isolation balling and safe operation through mechanical structure design, automatic control system and safety protection system. The device and system are applied in the well field at the end of 1 and 3# trunk pipelines of Shen Mu Gas Field Station 7, which verifies the feasibility, accuracy and stability of the technology. Based on the joint operation of the pipeline analysis and warning system and the automatic pipeline clearing device, it is able to meet the remote intelligent pipeline clearing operation and pipeline maintenance tasks in the process of gas gathering and transmission in the gas field.

Patient-specific surrogate model to predict pelvic floor dynamics during vaginal delivery

Childbirth is a challenging event that can lead to long-term consequences such as prolapse or incontinence. While computational models are widely used to mimic vaginal delivery, their integration into clinical practice is hindered by time constraints. The primary goal of this study is to introduce an artificial intelligence pipeline that leverages patient-specific surrogate modeling to predict pelvic floor injuries during vaginal delivery. A finite element-based machine learning approach was implemented to generate a dataset with information from finite element simulations. Thousands of childbirth simulations were conducted, varying the dimensions of the pelvic floor muscles and the mechanical properties used for their characterization. Additionally, a mesh morphing algorithm was developed to obtain patient-specific models. Machine learning models, specifically tree-based algorithms such as Random Forest (RF) and Extreme Gradient Boosting, as well as Artificial Neural Networks, were trained to predict the nodal coordinates of nodes within the pelvic floor, aiming to predict the muscle stretch during a critical interval. The results indicate that the RF model performs best, with a mean absolute error (MAE) of 0.086 mm and a mean absolute percentage error of 0.38%. Overall, more than 80% of the nodes have an error smaller than 0.1 mm. The MAE for the calculated stretch is equal to 0.0011. The implemented pipeline allows loading the trained model and making predictions in less than 11 s. This work demonstrates the feasibility of implementing a machine learning framework in clinical practice to predict potential maternal injuries and assist in medical-decision making.

Numerical Simulation and Experimental Study of the Pneumo-Electric Hybrid-Driven Pipeline Inspection Robot in Low-Pressure Gas Pipeline

Intelligent pipeline inspection is necessary to operate submarine pipelines safely. At present, speed excursion and blockage are the challenges in the inspection of low-pressure gas pipelines. Accordingly, this study proposes a novel pneumo-electric hybrid-driven scheme to improve the traveling stability of inspection robots. To adapt to different working conditions, building blocks and CFD numerical simulation methods are used to study the throttling pressure control flow field of the robot. The results proved that the flow clearance had the most evident effect. The flow clearance was reduced from 30 to 5 mm, and the differential pressure of the prototype increased from 0.3 to 17 kPa. The skeleton diameter has a small effect on the differential pressure. The differential pressure increases as the gas velocity increases. By analyzing the prototype in different positions, it was found that the differential pressure of the prototype while passing the elbow decreased by 45% at 45°, which quantified the fluid-driven force gap of the prototype while passing through the elbow. Finally, by comparing the speed of prototype with that of fluid-driven pig, it is demonstrated that a pneumo-electric hybrid-driven scheme is an effective solution to the problem of unstable inspection operation of low-pressure gas pipelines.

Model for the Failure Prediction Mechanism of In-Service Pipelines Based on IoT Technology

With the rapid increase in pipeline mileage in China, the accurate prediction of corrosion issues in in-service pipelines has become crucial for ensuring safe pipeline operation. Traditional pipeline leakage monitoring methods are significantly limited by human factors and equipment precision, making it challenging to predict and identify leakage points accurately. Therefore, aligned with the trend of intelligent pipeline development, this study aims to construct a failure pressure prediction mechanism model for corroded pipelines based on IoT technology. This model leverages intelligent sensing and prediction to assess the safety status of corroded pipeline sections. Ultrasonic phased array technology detects specific corrosion points and detailed defect parameters within pipeline sections. The parameters are then utilized in the Simdroid domestic finite element analysis model to simulate the ultimate burst pressure of the pipeline. A single-variable approach is employed to analyze the sensitivity of different parameters to the pipeline’s ultimate burst pressure, with the minimum burst pressure point of multi-point corroded sections selected as the overall segment failure pressure. Finite element simulation data are integrated into a neural network database to predict the pipeline failure pressure. The real-time operational data of the pipeline are monitored using negative-pressure wave sensing. The operational pressure of the corroded points is compared with the algorithm-predicted failure pressure; if the values approach a critical threshold, an alarm is triggered. Moreover, the remote control terminals evaluate the pipeline’s self-rescue time, providing a buffer for pipeline leakage self-rescue. The failure prediction mechanism model for in-service pipelines was applied to the Fujian–Guangdong branch of the West–East Gas Pipeline III to verify its accuracy and feasibility. The research results offer technical support for the maintenance and emergency repair of pipeline leakage scenarios, leveraging intelligent pipeline technology to reduce costs and increase the efficiency of pipeline operations, thereby supporting the sustainable development of China’s oil and gas pipelines with theoretical and technical backing.

Assessing LLMs in malicious code deobfuscation of real-world malware campaigns

The integration of large language models (LLMs) into various cybersecurity pipelines has become increasingly prevalent, enabling the automation of numerous manual tasks and often surpassing human performance. Recognising this potential, cybersecurity researchers and practitioners are actively investigating the application of LLMs to process vast volumes of heterogeneous data for anomaly detection, potential bypass identification, attack mitigation, and fraud prevention. Moreover, LLMs’ advanced capabilities in generating functional code, interpreting code context, and code summarisation present significant opportunities for reverse engineering and malware deobfuscation.In this work, we comprehensively examine the deobfuscation capabilities of state-of-the-art LLMs. Specifically, we conducted a detailed evaluation of four prominent LLMs using real-world malicious scripts from the notorious Emotet malware campaign. Our findings reveal that while current LLMs are not yet perfectly accurate, they demonstrate substantial potential in efficiently deobfuscating payloads. This study highlights the importance of fine-tuning LLMs for specialised tasks, suggesting that such optimisation could pave the way for future AI-powered threat intelligence pipelines to combat obfuscated malware. Our contributions include a thorough analysis of LLM performance in malware deobfuscation, identifying strengths and limitations, and discussing the potential for integrating LLMs into cybersecurity frameworks for enhanced threat detection and mitigation. Our experiments illustrate that LLMs can automatically and accurately extract the necessary indicators of compromise from a real-world campaign with an accuracy of 69.56% and 88.78% for the URLs and the corresponding domains of the droppers, respectively.

Design of intelligent pipeline detection and cleaning robot

Abstract This design focuses on the field of intelligent pipeline cleaning, and proposes a design scheme for an intelligent household multi-functional pipeline cleaning robot that can realize multiple functions such as damage monitoring, cleaning and repair for different pipeline structures and internal multi-physical environments. It is equipped with integrated systems such as visual recognition, pressure sensors, robotic arms, underwater gimbals, and telescopic devices, and has functions such as pipeline cleaning, turbine pushing, crawler crawling, and damage monitoring.

Simulating the sealing performance of the double rubber cylinder assembly in an intelligent pipeline isolation tool

Intelligent pipeline isolation tools (IPITs) are widely used for pipeline maintenance and repair. Therefore, authors mainly study the sealing performance of double rubber cylinder IPIT. This study first analyzed the material and geometric properties of the rubber cylinders in an IPIT to establish a numerical finite element model of cylinder mechanical behavior. The influence of the cylinder hardness, camber angle, and short-side length on the sealing performance was subsequently investigated by systematically altering the established model according to the control variable method. Next, the response surface methodology was employed to evaluate the change in model sealing performance according to the coupled action of multiple rubber cylinder parameters and identify their optimal values.

Intelligent Diagnosis of Urban Underground Drainage Network: From Detection to Evaluation

During the process of urban development, there is large-scale laying of underground pipeline networks and coordinated operation of both new and old networks. The underground concrete drainage pipes have become a focus of operation and maintenance due to their strong concealment and serious corrosion. The current manual inspections for subterranean concrete drainage pipelines involve high workloads and risks, which makes meeting the diagnostic needs of intricate urban pipeline networks challenging. Through advanced information technology, it has reached a consensus to intelligently perceive, accurately identify, and precise prediction of the condition of urban subterranean drainage networks. The development process of detection and evaluation methods for underground concrete drainage pipe networks is the focus of this study. The study discusses common algorithms for classifying, locating, and quantifying pipeline defects by combining the principles of deep learning with typical application examples. The intelligent progression of information collection methods, image processing techniques, damage prediction models, and pipeline diagnostic systems is systematically elaborated upon. Lastly, prospects for future research of intelligent pipeline diagnosis are provided.

Investigation of Wax-Deposit Thickness in Oil and Water Emulsions: Facing the Development Trend of Intelligent Pipeline Operation

Investigation of Wax-Deposit Thickness in Oil and Water Emulsions: Facing the Development Trend of Intelligent Pipeline Operation

Common Metadata Framework: Integrated Framework for Trustworthy Artificial Intelligence Pipelines

Common Metadata Framework: Integrated Framework for Trustworthy Artificial Intelligence Pipelines

Contemporary attitudes and beliefs on coronary artery calcium from social media using artificial intelligence

Coronary artery calcium (CAC) is a powerful tool to refine atherosclerotic cardiovascular disease (ASCVD) risk assessment. Despite its growing interest, contemporary public attitudes around CAC are not well-described in literature and have important implications for shared decision-making around cardiovascular prevention. We used an artificial intelligence (AI) pipeline consisting of a semi-supervised natural language processing model and unsupervised machine learning techniques to analyze 5,606 CAC-related discussions on Reddit. A total of 91 discussion topics were identified and were classified into 14 overarching thematic groups. These included the strong impact of CAC on therapeutic decision-making, ongoing non-evidence-based use of CAC testing, and the patient perceived downsides of CAC testing (e.g., radiation risk). Sentiment analysis also revealed that most discussions had a neutral (49.5%) or negative (48.4%) sentiment. The results of this study demonstrate the potential of an AI-based approach to analyze large, publicly available social media data to generate insights into public perceptions about CAC, which may help guide strategies to improve shared decision-making around ASCVD management and public health interventions.

A multi-step attack path prediction method for oil & gas intelligence pipeline cyber physics system based on CPNE

Owing to the integration of the 5th Generation Mobile Communication Technology (5 G) and industrial internet construction, Oil & Gas intelligent pipeline network has witnessed accelerated construction and development. The Oil & Gas intelligent pipeline network proposed by China National Petroleum Corporation exhibits the advantages such as high integration, data unification, and intelligent decision-making, which helps to greatly reduce manual management costs, optimize risk decision-making by managers, and avoid risks such as human misuse. However, the highly integrated Cyber-physical system of the Internet and the Internet of Things faces various cyber security threats, and traditional intrusion detection systems exhibit drawbacks in the face of complex cyber-attack behaviors. In response to incomplete multi-step attack path prediction in traditional prediction methods, this paper proposes a multi-step attack path prediction method for Oil & Gas intelligence pipeline cyber physics system (CPS) based on Colored Petri nets and mixed strategy Nash equilibrium (CPNE). Taking into account the importance of assets and the dependency relationships between assets within the cyber-physical system of Oil & Gas intelligent pipeline network, CPNE constructs a node dependency model for the cyber-physical system of Oil & Gas intelligent pipeline network, simulates multi-step attack and defense games, calculates the probability of node failure triggering and transfer using mixed strategy Nash equilibrium, and extracts the risk of multi-step attack paths for different attack strategies. With the filtration and separation unit of a certain natural gas station as an example, this paper establishes a CPNE model to rank the risk of the first multi-step attack single attack source path and predict the risk of subsequent multi-step attack source paths, thus predicting multi-step attack paths. Taking three rounds of attacks as an example, compared to the paths predicted by traditional probability attack graph models, the proposed CPNE model is more advantageous in multi attack source path prediction, with a 2.33-fold increase in the relative coverage rate of path predictions.

Real-time glioblastoma tumor microenvironment assessment by SpiderMass for improved patient management

Glioblastoma is a highly heterogeneous and infiltrative form of brain cancer associated with a poor outcome and limited therapeutic effectiveness. The extent of the surgery is related to survival. Reaching an accurate diagnosis and prognosis assessment by the time of the initial surgery is therefore paramount in the management of glioblastoma. To this end, we are studying the performance of SpiderMass, an ambient ionization mass spectrometry technology that can be used invivo without invasiveness, coupled to our recently established artificial intelligence pipeline. We demonstrate that we can both stratify isocitrate dehydrogenase (IDH)-wild-type glioblastoma patients into molecular sub-groups and achieve an accurate diagnosis with over 90% accuracy after cross-validation. Interestingly, the developed method offers the same accuracy for prognosis. In addition, we are testing the potential of an immunoscoring strategy based on SpiderMass fingerprints, showing the association between prognosis and immune cell infiltration, to predict patient outcome.

Quantification of follicles in human ovarian tissue using image processing software and trained artificial intelligence†.

Cancer survival rates in prepubertal girls and young women have risen in recent decades due to increasingly efficient treatments. However, many such treatments are gonadotoxic, causing premature ovarian insufficiency, loss of fertility, and ovarian endocrine function. Implantation of donor ovarian tissue encapsulated in immune-isolating capsules is a promising method to restore physiological endocrine function without immunosuppression or risk of reintroducing cancer cells harbored by the tissue. The success of this approach is largely determined by follicle density in the implanted ovarian tissue, which is analyzed manually from histologic sections and necessitates specialized, time-consuming labor. To address this limitation, we developed a fully automated method to quantify follicle density that does not require additional coding. We first analyzed ovarian tissue from 12 human donors between 16 and 37years old using semi-automated image processing with manual follicle annotation and then trained artificial intelligence program based on follicle identification and object classification. One operator manually analyzed 102 whole slide images from serial histologic sections. Of those, 77 images were assessed by a second manual operator, followed with an automated method utilizing artificial intelligence. Of the 1181 follicles the control operator counted, the comparison operator counted 1178, and the artificial intelligence counted 927 follicles with 80% of those being correctly identified as follicles. The three-stage artificial intelligence pipeline finished 33% faster than manual annotation. Collectively, this report supports the use of artificial intelligence and automation to select tissue donors and grafts with the greatest follicle density to ensure graft longevity for premature ovarian insufficiency treatment.