Conventional Machine Learning Methods Research Articles

Topological Deep Learning Model for Thyroid Multi-Class Categorization

This study presents an innovative method for categorizing thyroid disorders using a topological deep learning (TDL) model. The strategy utilizes supervised learning and places particular emphasis on topological data analysis (TDA). The work employs a dataset obtained from the WEKA simulator, consisting of 32 characteristics and 3897 instances. It creates a predictive model using the WEKA 3.8.4 simulator, deviating from conventional machine learning methods by giving priority to topological features to improve prediction and classification. The TDL model includes the steps of data preprocessing, selecting unique features, and using TDL algorithms such as Naive Bayes, Decision Trees, and Artificial Neural Networks. The model utilizes embedding to extract information, investigates the importance of specific dimensions, and applies an algorithm to make accurate predictions. The results demonstrate excellent performance, with accuracy, recall, F1-score, and ROC values of 0.96, 0.97, 0.95, and 0.96, respectively. The multi-class classification study provides additional validation of the model's effectiveness, demonstrating an exceptional accuracy of 97.83% and a minimal error rate of 0.21. This highlights the model's precision and dependability, making it suitable for possible clinical applications. This study highlights the efficacy of using topological characteristics and topological data analysis (TDA) methods in the classification of thyroid conditions into many classes. This approach shows potential for enhancing accuracy and dependability in intricate classification tasks.

Machine learning-based characterization of friction stir welding in aluminum alloys

This research presents a machine learning (ML) approach that integrates Bayesian theorem to predict residual stress, plastic deformation, and peak temperature in friction stir welding (FSW) of different types of aluminum alloys. The training data was acquired from extensive numerical simulations of FSW conducted across various input parameter configurations. The regression analysis exhibits strong predictive performance for residual stress, peak temperature, and plastic deformation, achieving determination coefficients of 0.969, 0.955, and 0.919, respectively. The high prediction performance of the developed model is primarily attributed to Bayesian optimization, distinguishing it from other conventional ML methods. The results further demonstrate the efficacy of the proposed model in assessing the relevance of input features to prediction efficiency and output targets. For instance, concerning processing parameters, the predictive performance is closely correlated with the significance of preheating, traverse speed, and rotational speed in FSW, compared to welding force and plate thickness. On the other hand, considering material properties, it was observed that the hardness value of aluminum alloys emerged as a crucial predictor in the model so that alloys with moderate hardness values showed greater welding consistency and significantly enhanced prediction accuracy.

Combining LiDAR and Spaceborne Multispectral Data for Mapping Successional Forest Stages in Subtropical Forests

The Brazilian Atlantic Rainforest presents great diversity of flora and stand structures, making it difficult for traditional forest inventories to collect reliable and recurrent information to classify forest succession stages. In recent years, remote sensing data have been explored to save time and effort in classifying successional forest stages. However, there is a need to understand if any of these sensors stand out for this purpose. Here, we evaluate the use of multispectral satellite data from four different platforms (CBERS-4A, Landsat-8/OLI, PlanetScope, and Sentinel-2) and airborne light detection and ranging (LiDAR) to classify three forest succession stages in a subtropical ombrophilous mixed forest located in southern Brazil. Different features extracted from multispectral and LiDAR data, such as spectral bands, vegetation indices, texture features, and the canopy height model (CHM) and LiDAR intensity, were explored using two conventional machine learning methods such as random trees (RT) and support vector machine (SVM). The statistically based maximum likelihood (MLC) algorithm was also compared. The classification accuracy was evaluated by generating a confusion matrix and calculating the kappa index and standard deviation based on field measurements and unmanned aerial vehicle (UAV) data. Our results show that the kappa index ranged from 0.48 to 0.95, depending on the chosen dataset and method. The best result was obtained using the SVM algorithm associated with spectral bands, CHM, LiDAR intensity, and vegetation indices, regardless of the sensor. Datasets with Landsat-8 or Sentinel-2 information performed better results than other optical sensors, which may be due to the higher intraclass variability and less spectral bands in CBERS-4A and PlanetScope data. We found that the height information derived from airborne LiDAR and its intensity combined with the multispectral data increased the classification accuracy. However, the results were also satisfactory when using only multispectral data. These results highlight the potential of using freely available satellite information and open-source software to optimize forest inventories and monitoring, enabling a better understanding of forest structure and potentially supporting forest management initiatives and environmental licensing programs.

Enhancing photovoltaic energy forecasting: a progressive approach using wavelet packet decomposition

Abstract Accurate photovoltaic (PV) energy forecasting plays a crucial role in the efficient operation of PV power stations. This study presents a novel hybrid machine-learning (ML) model that combines Gaussian process regression with wavelet packet decomposition to forecast PV power half an hour ahead. The proposed technique was applied to the PV energy database of a station located in Algeria and its performance was compared to that of traditional forecasting models. Performance evaluations demonstrate the superiority of the proposed approach over conventional ML methods, including Gaussian process regression, extreme learning machines, artificial neural networks and support vector machines, across all seasons. The proposed model exhibits lower normalized root mean square error (nRMSE) (2.116%) and root mean square error (RMSE) (208.233 kW) values, along with a higher coefficient of determination (R2) of 99.881%. Furthermore, the exceptional performance of the model is maintained even when tested with various prediction horizons. However, as the forecast horizon extends from 1.5 to 5.5 hours, the prediction accuracy decreases, evident by the increase in the RMSE (710.839 kW) and nRMSE (7.276%), and a decrease in R2 (98.462%). Comparative analysis with recent studies reveals that our approach consistently delivers competitive or superior results. This study provides empirical evidence supporting the effectiveness of the proposed hybrid ML model, suggesting its potential as a reliable tool for enhancing PV power forecasting accuracy, thereby contributing to more efficient grid management.

Interpretable Trend Analysis Neural Networks for Longitudinal Data Analysis

Cohort study is one of the most commonly used study methods in medical and public health researches, which result in longitudinal data. Conventional statistical models and machine learning methods are not capable of modeling the evolution trend of the variables in longitudinal data. In this article, we propose a Trend Analysis Neural Networks (TANN), which models the evolution trend of the variables by adaptive feature learning. TANN was tested on dataset of Kaiuan research. The task was to predict occurrence of cardiovascular events within 2 and 5 years, with three repeated medical examinations during 2008 and 2013. For 2-year prediction, The AUC of the TANN is 0.7378, which is a significant improvement than that of conventional methods, while that of TRNS, RNN, DNN, GBDT, RF, and LR are 0.7222, 0.7034, 0.7054, 0.7136, 0.7160, and 0.7024, respectively. For 5-year prediction, TANN also shows improvement. The experimental results show that the proposed TANN achieves better prediction performance on cardiovascular events prediction than conventional models. Furthermore, by analyzing the weights of TANN, we could find out important trends of the indicators, which are ignored by conventional machine learning models. The trend discovery mechanism interprets the model well. TANN is an appropriate balance between high performance and interpretability.

Sleep Apnea Detection from Single-Lead ECG: A Comprehensive Analysis of Machine Learning and Deep Learning Algorithms

Sleep apnea, a prevalent sleep breathing disorder, poses significant health risks, necessitating accurate detection for appropriate treatment. This study comprehensively analyzes machine learning and deep learning algorithms using the PhysioNet ECG Sleep Apnea v1.0.0 dataset. Electrocardiogram signals underwent preprocessing and segmentation before applying various algorithms for sleep apnea detection. Conventional machine learning methods such as linear and quadratic discriminate analyses, logistic regression, support-vector machines, and decision trees, along with deep learning techniques including convolutional and recurrent networks, were implemented and modified to suit biosignal processing tasks. The dataset was divided into training, validation, and test sets, with a fivefold cross-validation scheme ensuring robust evaluation. Hybrid deep models demonstrated superior performance, achieving an accuracy of 88.13%, sensitivity of 84.26%, and specificity of 92.27%. This study offers valuable insights into the efficacy of different machine learning and deep learningalgorithms for sleep apnea detection, with potential extensions to other sleep-related events. The developed algorithms are publicly available on GitHub.

Abstract LB396: The power of NetraAI: Precision medicine in oncology through sub-insight learning from small data sets

Abstract The capabilities of artificial intelligence (AI) and machine learning (ML) are pivotal for refining patient stratification and subtype discrimination in clinical trials. Conventional ML methods often rely on large data sets for meaningful discoveries. NetraAI is a novel ML approach designed and trained to work with smaller data sets. The challenge with smaller data sets is that they do not reflect the totality of the disease that they represent. NetraAI employs a novel approach termed “Sub-Insight Learning”, utilizing validated mathematical methods to analyze even small patient data sets. This allows the system to decompose the data sets into high and low confidence patient subpopulations, enhancing predictive model accuracy and reducing overfitting. Further, the system explains what variables are driving the etiology defining the subpopulations of patients. Using two non-small cell lung cancer (NSCLC) data sets (GSE18842 and GSE10245) consisting of only 104 samples from adenocarcinoma (ADC) and squamous cell carcinoma (SCC), NetraAI distinguished the two subtypes through unique genetic signatures. Notably, nine of the ten variables identified correlate with known NSCLC markers, with PIGX emerging as a novel target. Leveraging protein-protein interaction networks (PPI) revealed connections between PIGX and BACE1. BACE1 has been implicated as a driver of NSCLC brain metastasis. These findings shed light on the biology of membrane proteins and their post-translational modifications, a factor implicated in various diseases, prompting further exploration. NetraAI demonstrates a significant breakthrough in precision medicine for oncology, capable of generating meaningful insights from small data sets. The discovery of novel biomarkers and their implications in cancer and other diseases underline the potential of this AI-driven approach in advancing current research paradigms and patient-specific treatments. Citation Format: Bessi Qorri, Mike J. Tsay, Paul Leonchyk, Larry Alphs, Luca Pani, Joseph Geraci. The power of NetraAI: Precision medicine in oncology through sub-insight learning from small data sets [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 2 (Late-Breaking, Clinical Trial, and Invited Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(7_Suppl):Abstract nr LB396.

Breast Tumour Segmentation Using Advanced UNet with Saliency, Channel, and Spatial Attention Models

Cancers are getting pretty common these days and in that the second most common cancer in the world after lung cancer is breast cancer. The primary screening techniques for early diagnosis of cancerous nodules in women breast are Ultrasound, Mammography, and MRI analysis. However, accurately identifying and outlining the boundaries of tumor regions remains challenging due to their unpredictable shapes, random variations, and blurry outlines. Currently, the CAD based image analysis systems have gained huge attention in biomedical image processing systems along with Machine Learning (ML) and Deep Learning (DL) methods. The conventional machine learning methods suffer from accuracy related issues therefore deep learning-based schemes have been adopted. Specifically, UNet based approach is widely employed for biomedical image segmentation. This research focuses on development of a UNet based deep learning architecture for breast cancer image analysis and segmentation. The proposed model improves the segmentation accuracy by adding saliency model, channel and spatial attention model to consider the low- and high-level features. These modules help to achieve the clear boundary during segmentation. The performance of proposed model is evaluated by using publicly available mammogram dataset known as DDSM dataset.

The Prediction of Pervious Concrete Compressive Strength Based on a Convolutional Neural Network

To overcome limitations inherent in existing mechanical performance prediction models for pervious concrete, including material constraints, limited applicability, and inadequate accuracy, this study employs a deep learning approach to construct a Convolutional Neural Network (CNN) model with three convolutional modules. The primary objective of the model is to precisely predict the 28-day compressive strength of pervious concrete. Eight input variables, encompassing coarse and fine aggregate content, water content, admixture content, cement content, fly ash content, and silica fume content, were selected for the model. The dataset utilized for both model training and testing consists of 111 sample sets. To ensure the model’s coverage within the practical range of pervious concrete strength and to enhance its robustness in real-world applications, an additional 12 sets of experimental data were incorporated for training and testing. The research findings indicate that, in comparison to the conventional machine learning method of Backpropagation (BP) neural networks, the developed CNN prediction model in this paper demonstrates a higher coefficient of determination, reaching 0.938, on the test dataset. The mean absolute percentage error is 9.13%, signifying that the proposed prediction model exhibits notable accuracy and universality in predicting the 28-day compressive strength of pervious concrete, regardless of the materials used in its preparation.

Transcriptomic and neuroimaging data integration enhances machine learning classification of schizophrenia.

Schizophrenia is a polygenic disorder associated with changes in brain structure and function. Integrating macroscale brain features with microscale genetic data may provide a more complete overview of the disease etiology and may serve as potential diagnostic markers for schizophrenia. We aim to systematically evaluate the impact of multi-scale neuroimaging and transcriptomic data fusion in schizophrenia classification models. We collected brain imaging data and blood RNA sequencing data from 43 patients with schizophrenia and 60 age- and gender-matched healthy controls, and we extracted multi-omics features of macroscale brain morphology, brain structural and functional connectivity, and gene transcription of schizophrenia risk genes. Multi-scale data fusion was performed using a machine learning integration framework, together with several conventional machine learning methods and neural networks for patient classification. We found that multi-omics data fusion in conventional machine learning models achieved the highest accuracy (AUC ~0.76-0.92) in contrast to the single-modality models, with AUC improvements of 8.88 to 22.64%. Similar findings were observed for the neural network, showing an increase of 16.57% for the multimodal classification model (accuracy71.43%) compared to the single-modal average. In addition, we identified several brain regions in the left posterior cingulate and right frontal pole that made a major contribution to disease classification. We provide empirical evidence for the increased accuracy achieved by imaging genetic data integration in schizophrenia classification. Multi-scale data fusion holds promise for enhancing diagnostic precision, facilitating early detection and personalizing treatment regimens in schizophrenia.

Abstract 4921: A user-friendly R Shiny web app for predicting cancer genetic dependencies using deep learning

Abstract Understanding the genetic vulnerabilities (i.e., genetic dependencies) of cancer cells is crucial for developing novel anti-cancer treatments. The Cancer Dependency Map (DepMap) projects, conducted by the Broad Institute and Wellcome Sanger Institute, have performed comprehensive genome-wide CRISPR-Cas9 knockout screens across diverse cancer cell lines. These data resources have enabled computational biologists to glean insights into cancer genetic dependencies using sophisticated computational models. As different genomic mechanisms govern tumorigenesis and genetic vulnerability, the relationship between cancer genomics and genetic dependencies is nonlinear, making the prediction of genetic dependencies challenging. Addressing this challenge, we previously developed a deep learning model, namely DeepDEP, to predict cancer genetic dependencies using multi-omic profiles (Chiu et al. DOI:10.1126/sciadv.abh1275). DeepDEP has a transfer learning scheme that integrates genomic representations captured from unlabeled tumor samples of the Cancer Genome Atlas (TCGA) and genomic features that are predictive of genetic dependencies in cell lines. Such a design enables the application of DeepDEP to both cell lines and tumors. The model demonstrated superior performance compared to various conventional machine learning methods. Prediction results were validated using independent cell-line datasets and patient clinical data. Here, we developed an intuitive web application for DeepDEP which allows users to easily utilize the model on their in-house data. Users can simply indicate whether the query sample is derived from a cancer cell line or a tumor, upload any combination of mutation, gene expression, DNA methylation, and copy number alteration datasets, and view the predicted dependencies of 1,298 cancer-relevant genes. Along with the genetic dependency predictions, users are provided with model performance metrics, detailed gene annotations, and links to useful resources such as Ensembl and COSMIC. Our web application features a variety of interactive visualizations to guide users to interpret the results at the levels of individual genes and pathways. The tool has two supplemental modules to enhance its functionality. One allows users to search for similar cell lines to the query sample within the DepMap project or for similar tumors within the TCGA project. The other supplemental module provides data exploration tools for pre-calculated predictions across all TCGA tumors. In summary, this user-friendly web application provides researchers with access to deep learning predictions of cancer genetic dependencies with various interactive visualization and analysis tools. It is anticipated that this application will facilitate the study of cancer genetic dependencies and enhance the efficiency of anti-cancer drug discovery. Citation Format: Michael J. Kasper, Li-Ju Wang, Michael Ning, Yufei Huang, Yu-Chiao Chiu. A user-friendly R Shiny web app for predicting cancer genetic dependencies using deep learning [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2024; Part 1 (Regular Abstracts); 2024 Apr 5-10; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2024;84(6_Suppl):Abstract nr 4921.

Simulation-driven fault detection for the gear transmission system in major equipment

Scholars and engineers attach great importance to fault detection in mechanical systems due to the unpredictable faults that arise from long-term operations under complex and extreme conditions. The fact that each type of fault embodies unique characteristics makes it challenging to obtain sufficient fault samples, and conventional machine learning methods fail to provide satisfactory fault diagnosis results. To address this issue, a simulation-driven fault detection method has been proposed in this paper. Firstly, the DT model of the gear transmission system was established. An improved multi-objective sparrow search algorithm (MOSSA) was employed to update the model and obtain an adequate number of simulation fault samples as well. Secondly, a two-stage adversarial domain adaptation model with full-scale feature fusion (ADAM-FF) was utilized to align and integrate the features of simulated and generated fault samples. This enables model training and classification of combined samples, facilitating the detection of unknown faults in actual measurements. Lastly, a simulation-driven equipment health index assessment model which accurately and non-destructively evaluates the degradation status of the equipment was introduced. This model effectively quantifies the extent of equipment degradation, thereby facilitating the transfer from the simulation realm to practical engineering applications. To validate the effectiveness of the proposed fault detection method, an experimental study was conducted on the extruder gear reducer of a petrochemical enterprise. The proposed fault detection method has the potential for widespread application across a range of large-scale mechanical equipment. As such, the utilization of this method will enable proactive maintenance planning, ensure safe and stable equipment operations, and minimize energy loss.

Inversion of winter wheat leaf area index from UAV multispectral images: classical vs. deep learning approaches.

Precise and timely leaf area index (LAI) estimation for winter wheat is crucial for precision agriculture. The emergence of high-resolution unmanned aerial vehicle (UAV) data and machine learning techniques offers a revolutionary approach for fine-scale estimation of wheat LAI at the low cost. While machine learning has proven valuable for LAI estimation, there are still model limitations and variations that impede accurate and efficient LAI inversion. This study explores the potential of classical machine learning models and deep learning model for estimating winter wheat LAI using multispectral images acquired by drones. Initially, the texture features and vegetation indices served as inputs for the partial least squares regression (PLSR) model and random forest (RF) model. Then, the ground-measured LAI data were combined to invert winter wheat LAI. In contrast, this study also employed a convolutional neural network (CNN) model that solely utilizes the cropped original image for LAI estimation. The results show that vegetation indices outperform the texture features in terms of correlation analysis with LAI and estimation accuracy. However, the highest accuracy is achieved by combining both vegetation indices and texture features to invert LAI in both conventional machine learning methods. Among the three models, the CNN approach yielded the highest LAI estimation accuracy (R 2 = 0.83), followed by the RF model (R 2 = 0.82), with the PLSR model exhibited the lowest accuracy (R 2 = 0.78). The spatial distribution and values of the estimated results for the RF and CNN models are similar, whereas the PLSR model differs significantly from the first two models. This study achieves rapid and accurate winter wheat LAI estimation using classical machine learning and deep learning methods. The findings can serve as a reference for real-time wheat growth monitoring and field management practices.

An Intelligent Hybrid Machine Learning Model for Sustainable Forecasting of Home Energy Demand and Electricity Price

Home energy systems (HESs) face challenges, including high energy costs, peak load impact, and reliability issues associated with grid connections. To address these challenges, homeowners can implement solutions such as energy management, renewable resources, and energy storage technologies. Understanding consumption patterns and optimizing HES operations are crucial for effective energy management. As a primary step, addressing these concerns requires an efficient forecasting tool to predict home energy demand and electricity prices. Due to the complexity of big data, and uncertainties involved in forecasting, machine learning (ML) methods are necessary. In this study, we develop a hybrid machine learning approach, utilizing one year of data on home energy demand and prices to address the challenge of forecasting home energy consumption. A comprehensive comparison of different deep and non-deep ML models highlights the superiority of the proposed hybrid approach. The performance of these models, measured using metrics such as RMSE, MAE, R2, and RT (running time), are compared. Finally, an optimized hybrid XGBoost (XGB) ML model that combines price and energy demand forecasting is introduced. The proposed ML method’s parameters are optimally determined using Particle Swarm Optimization. The hybrid ML model’s performance is evaluated in predicting both energy demand and consumption prices using historical data from diverse households with various features and consumption patterns. The results indicate that the hybrid ML model achieves accurate predictions for energy consumption and prices, with improvements in RMSE (up to 36.6%), MAE (up to 36.8%), and R2 (up to 3.9), as compared to conventional ML methods. This research contributes to sustainable energy practices by providing an effective tool for forecasting energy consumption and associated costs in the dynamic landscape of home energy systems.

Sentiment Analysis on a Large Indonesian Product Review Dataset

Background: The publicly available large dataset plays an important role in the development of the natural language processing/computational linguistic research field. However, up to now, there are only a few large Indonesian language datasets accessible for research purposes, including sentiment analysis datasets, where sentiment analysis is considered the most popular task. Objective: The objective of this work is to present sentiment analysis on a large Indonesian product review dataset, employing various features and methods. Two tasks have been implemented: classifying reviews into three classes (positive, negative, neutral), and predicting ratings. Methods: Sentiment analysis was conducted on the FDReview dataset, comprising over 700,000 reviews. The analysis treated sentiment as a classification problem, employing the following methods: Multinomial Naïve Bayes (MNB), Support Vector Machine (SVM), LSTM, and BiLSTM. Result: The experimental results indicate that in the comparison of performance using conventional methods, MNB outperformed SVM in rating prediction, whereas SVM exhibited better performance in the review classification task. Additionally, the results demonstrate that the BiLSTM method outperformed all other methods in both tasks. Furthermore, this study includes experiments conducted on balanced and unbalanced small-sized sample datasets. Conclusion: Analysis of the experimental results revealed that the deep learning-based method performed better only in the large dataset setting. Results from the small balanced dataset indicate that conventional machine learning methods exhibit competitive performance compared to deep learning approaches. Keywords: Indonesian review dataset, Large dataset, Rating prediction, Sentiment analysis

A hybridized feature extraction for COVID-19 multi-class classification on computed tomography images

COVID-19 has killed more than 5 million individuals worldwide within a short time. It is caused by SARS-CoV-2 which continuously mutates and produces more transmissible new different strains. It is therefore of great significance to diagnose COVID-19 early to curb its spread and reduce the death rate. Owing to the COVID-19 pandemic, traditional diagnostic methods such as reverse-transcription polymerase chain reaction (RT-PCR) are ineffective for diagnosis. Medical imaging is among the most effective techniques of respiratory disorders detection through machine learning and deep learning. However, conventional machine learning methods depend on extracted and engineered features, whereby the optimum features influence the classifier's performance. In this study, Histogram of Oriented Gradient (HOG) and eight deep learning models were utilized for feature extraction while K-Nearest Neighbour (KNN) and Support Vector Machines (SVM) were used for classification. A combined feature of HOG and deep learning feature was proposed to improve the performance of the classifiers. VGG-16 + HOG achieved 99.4 overall accuracy with SVM. This indicates that our proposed concatenated feature can enhance the SVM classifier's performance in COVID-19 detection.

Nondestructive detection of fiber content in steel fiber reinforced concrete through percussion method coordinated with a hybrid deep learning network

Accurate inspection of the steel fiber content is necessary to assure the designed performance and required quality of steel fiber reinforced concrete (SFRC). This paper presents a percussion-based nondestructive methodology in detecting the steel fiber content in SFRC components, incorporating a deep neural network capable of intelligent detection and automated classification of steel fiber content without the need for signal transformation or manual feature extraction. This research makes several noteworthy contributions. First of all, the percussion acoustic signals were captured on a smartphone from SFRC cubes with varying fiber volumes in a range of 0–2%. Subsequently, a hybrid deep learning framework named 1D CNN-BiLSTM, which harnesses advantages from both the one-dimensional conventional neural network (1D CNN) and the bidirectional long short-term memory (BiLSTM) network, was established and trained to classify these acoustic signals labeled with specific fiber contents. The results well manifest the excellent performances of the proposed network in classifying the steel fiber content, achieving a testing accuracy of 98%, which outperforms conventional machine learning methods, 1D CNN and 1D CNN-LSTM. Moreover, the noise resilience and adaptability of 1D CNN-BiLSTM were also greatly enhanced in contrast to these baseline methods. The testing accuracy exceeds 90.0% under strong noisy conditions in an SNR range of 2–10 dB. In addition, the trained model also presents an exceptional adaptability to identifying previously unseen signals from SFRC beams, yielding an accuracy of 90.34%.

Improvement of crack detectivity for noisy concrete surface by machine learning methods and infrared images

In order to maintain serviceability and reliability of concrete structures, it is essential to assess their condition as concrete structures deteriorate in time. Cracks develop in concrete due to several reasons such as severe loading, environmental effects, chemical effects etc. and cause durability loss in the structure which may also lead to loss of stability. In this research, crack detection is realized by machine learning and an infrared image. The effects of infrared images on crack detection are confirmed by random forest algorithm to select useful explanatory features. Selected features are applied to random forest algorithm and neural network algorithm. Effective filters are selected as a feature selection technique to improve the accuracy. Crack detection is also conducted by U-Net with RGB and infrared images, and the detection characteristics are compared to conventional methods. The performance of two conventional machine learning methods, random forest and neural network, are evaluated based on F1 score and false positives. Applying selected features improves the accuracy of the crack detection from an infrared image. False positives decreased due to monitoring conditions and camera specifications in the infrared image. The most effective image processing filter is the blur filter for each algorithm. Comparing algorithms for crack detection using selected features, different accuracy values are obtained. U-Net enables more accurate crack detection compared to conventional methods. The number of false positives is reduced compare to conventional method. In the detection results by three algorithms, infrared image affects the balance of false negatives and false positives.

Instantaneous Electricity Peak Load Forecasting Using Optimization and Machine Learning

Accurate instantaneous electricity peak load prediction is crucial for efficient capacity planning and cost-effective electricity network establishment. This paper aims to enhance the accuracy of instantaneous peak load forecasting by employing models incorporating various optimization and machine learning (ML) methods. This study examines the impact of independent inputs on peak load estimation through various combinations and subsets using multilinear regression (MLR) equations. This research utilizes input data from 1980 to 2020, including import and export data, population, and gross domestic product (GDP), to forecast the instantaneous electricity peak load as the output value. The effectiveness of these techniques is evaluated based on error metrics, including mean absolute error (MAE), mean square error (MSE), mean absolute percentage error (MAPE), root mean square error (RMSE), and R2. The comparison extends to popular optimization methods, such as particle swarm optimization (PSO), and the newest method in the field, including dandelion optimizer (DO) and gold rush optimizer (GRO). This comparison is made against conventional machine learning methods, such as support vector regression (SVR) and artificial neural network (ANN), in terms of their prediction accuracy. The findings indicate that the ANN and GRO approaches produce the least statistical errors. Furthermore, the correlation matrix indicates a robust positive linear correlation between GDP and instantaneous peak load. The proposed model demonstrates strong predictive capabilities for estimating peak load, with ANN and GRO performing exceptionally well compared to other methods.

In Silico prediction of inhibitors for multiple transporters via machine learning methods.

Transporters play an indispensable role in facilitating the transport of nutrients, signaling molecules and the elimination of metabolites and toxins in human cells. Contemporary computational methods have been employed in the prediction of transporter inhibitors. However, these methods often focus on isolated endpoints, overlooking the interactions between transporters and lacking good interpretation. In this study, we integrated a comprehensive dataset and constructed models to assess the inhibitory effects on seven transporters. Both conventional machine learning and multi-task deep learning methods were employed. The results demonstrated that the MLT-GAT model achieved superior performance with an average AUC value of 0.882. It is noteworthy that our model excels not only in prediction performance but also in achieving robust interpretability, aided by GNN-Explainer. It provided valuable insights into transporter inhibition. The reliability of our model's predictions positioned it as a promising and valuable tool in the field of transporter inhibition research. Related data and code are available at https://gitee.com/wutiantian99/transporter_code.git.