Machine Learning Classifiers Research Articles

Machine learning identifies the role of SMAD6 in the prognosis and drug susceptibility in bladder cancer.

Bladder cancer (BCa) is among the most prevalent malignant tumors affecting the urinary system. Due to its highly recurrent nature, standard treatments such as surgery often fail to significantly improve patient prognosis. Our research aims to predict prognosis and identify precise therapeutic targets for novel treatment interventions. We collected and screened genes related to the TGF-β signaling pathway and performed unsupervised clustering analysis on TCGA-BLCA samples based on these genes. Our analysis revealed two novel subtypes of bladder cancer with completely different biological characteristics, including immune microenvironment, drug sensitivity, and more. Using machine learning classifiers, we identified SMAD6 as a hub gene contributing to these differences and further investigated the role of SMAD6 in bladder cancer in the single-cell transcriptome data. Additionally, we analyzed the relationship between SMAD6 and immune checkpoint genes. Finally, we performed a series of in vitro assays to verify the function of SMAD6 in bladder cancer cell lines. We have revealed two novel subtypes of bladder cancer, among which C1 exhibits a worse prognosis, lower drug sensitivity, a more complex tumor microenvironment, and a 'colder' immune microenvironment compared to C2. We identified SMAD6 as a key gene responsible for the differences and further explored its impact on the molecular characteristics of bladder cancer. Through in vitro experiments, we found that SMAD6 promoted the prognosis of BCa patients by inhibiting the proliferation and migration of BCa cells. Our study reveals two novel subtypes of BCa and identifies SMAD6 as a highly promising therapeutic target.

StrokeClassifier: ischemic stroke etiology classification by ensemble consensus modeling using electronic health records.

Determining acute ischemic stroke (AIS) etiology is fundamental to secondary stroke prevention efforts but can be diagnostically challenging. We trained and validated an automated classification tool, StrokeClassifier, using electronic health record (EHR) text from 2039 non-cryptogenic AIS patients at 2 academic hospitals to predict the 4-level outcome of stroke etiology adjudicated by agreement of at least 2 board-certified vascular neurologists' review of the EHR. StrokeClassifier is an ensemble consensus meta-model of 9 machine learning classifiers applied to features extracted from discharge summary texts by natural language processing. StrokeClassifier was externally validated in 406 discharge summaries from the MIMIC-III dataset reviewed by a vascular neurologist to ascertain stroke etiology. Compared with vascular neurologists' diagnoses, StrokeClassifier achieved the mean cross-validated accuracy of 0.74 and weighted F1 of 0.74 for multi-class classification. In MIMIC-III, its accuracy and weighted F1 were 0.70 and 0.71, respectively. In binary classification, the two metrics ranged from 0.77 to 0.96. The top 5 features contributing to stroke etiology prediction were atrial fibrillation, age, middle cerebral artery occlusion, internal carotid artery occlusion, and frontal stroke location. We designed a certainty heuristic to grade the confidence of StrokeClassifier's diagnosis as non-cryptogenic by the degree of consensus among the 9 classifiers and applied it to 788 cryptogenic patients, reducing cryptogenic diagnoses from 25.2% to 7.2%. StrokeClassifier is a validated artificial intelligence tool that rivals the performance of vascular neurologists in classifying ischemic stroke etiology. With further training, StrokeClassifier may have downstream applications including its use as a clinical decision support system.

Utilizing Machine Learning for Cone Penetration Test-Based Soil Classification

Utilizing Machine Learning for Cone Penetration Test-Based Soil Classification

Ensemble Machine Learning Classification Models for Predicting Pavement Condition

Ensemble Machine Learning Classification Models for Predicting Pavement Condition

Machine Learning Prediction of Hospitalization Costs for Coronary Artery Bypass Grafting Operations

With the steady rise in health care expenditures, the examination of factors that may influence the costs of care has garnered much attention. Although machine learning models have previously been applied in health economics, their application within cardiac surgery remains limited. We evaluated several machine learning algorithms to model hospitalization costs for coronary artery bypass grafting. All adult hospitalizations for isolated coronary artery bypass grafting were identified in the 2016 to 2020 Nationwide Readmissions Database. Machine learning models were trained to predict expenditures and compared with traditional linear regression. Given the significance of postoperative length of stay, we additionally developed models excluding postoperative length of stay to uncover other drivers of costs. To facilitate comparison, machine learning classification models were also trained to predict patients in the highest decile of costs. Significant factors associated with high cost were identified using SHapley Additive exPlanations beeswarm plots. Among 444,740 hospitalizations included for analysis, the median cost of hospitalization in coronary artery bypass grafting patients was $43,103. eXtreme Gradient Boosting most accurately predicted hospitalization costs, with R2= 0.519 over the validation set. The top predictive features in the eXtreme Gradient Boosting model included elective procedure status, prolonged mechanical ventilation, new-onset respiratory failure or myocardial infarction, and postoperative length of stay. After removing postoperative length of stay, eXtreme Gradient Boosting remained the most accurate model (R2= 0.38). Prolonged ventilation, respiratory failure, and elective status remained important predictive parameters. Machine learning models appear to accurately model total hospitalization costs for coronary artery bypass grafting. Future work is warranted to uncover other drivers of costs and improve the value of care in cardiac surgery.

Enhancing Brain Tumour Identification through Convolutional Neural Network

A tumor is carried on by rapid and uncontrolled cell proliferation in the brain. If it is not treated in the early stages, it could prove fatal. Despite multiple significant efforts and encouraging outcomes, accurate segmentation and classification still pose a difficulty. Detection of brain tumors is extremely complicated by the distinctions in tumor position, structure, and proportions. Using computational intelligence and statistical image processing techniques, proposed in our project provide multiple approaches to detect brain cancer and tumors. Also shows an evaluation matrix for a specific system using particular systems and type of dataset. Also explains the morphology of brain tumors, accessible data sets, augmentation techniques, component extraction, and classification of Deep Learning (DL), Transfer Learning (TL), and Machine Learning (ML) models. Key Words: brain tumour, image classification, image sementation, convolutional neural networks.

Application and Comparison of Machine Learning and Database-Based Methods in Taxonomic Classification of High-Throughput Sequencing Data.

The advent of high-throughput sequencing technologies has not only revolutionized the field of bioinformatics but has also heightened the demand for efficient taxonomic classification. Despite technological advancements, efficiently processing and analysing the deluge of sequencing data for precise taxonomic classification remains a formidable challenge. Existing classification approaches primarily fall into two categories, database-based methods and machine learning methods, each presenting its own set of challenges and advantages. On this basis, the aim of our study was to conduct a comparative analysis between these two methods while also investigating the merits of integrating multiple database-based methods. Through an in-depth comparative study, we evaluated the performance of both methodological categories in taxonomic classification by utilizing simulated datasets. Our analysis revealed that database-based methods excel in classification accuracy when backed by a rich and comprehensive reference database. Conversely, while machine learning methods show superior performance in scenarios where reference sequences are sparse or lacking, they generally show inferior performance compared to database methods under most conditions. Moreover, our study confirms that integrating multiple database-based methods does, in fact, enhance classification accuracy. These findings shed new light on the taxonomic classification of high-throughput sequencing data and bear substantial implications for the future development of computational biology. For those interested in further exploring our methods, the source code of this study is publicly available on https://github.com/LoadStar822/Genome-Classifier-Performance-Evaluator. Additionally, a dedicated webpage showcasing our collected database, datasets, and various classification software can be found at: http://lab.malab.cn/∼tqz/project/taxonomic/.

Multi-class boosting for the analysis of multiple incomplete views on microbiome data

BackgroundMicrobiome dysbiosis has recently been associated with different diseases and disorders. In this context, machine learning (ML) approaches can be useful either to identify new patterns or learn predictive models. However, data to be fed to ML methods can be subject to different sampling, sequencing and preprocessing techniques. Each different choice in the pipeline can lead to a different view (i.e., feature set) of the same individuals, that classical (single-view) ML approaches may fail to simultaneously consider. Moreover, some views may be incomplete, i.e., some individuals may be missing in some views, possibly due to the absence of some measurements or to the fact that some features are not available/applicable for all the individuals. Multi-view learning methods can represent a possible solution to consider multiple feature sets for the same individuals, but most existing multi-view learning methods are limited to binary classification tasks or cannot work with incomplete views.ResultsWe propose irBoost.SH, an extension of the multi-view boosting algorithm rBoost.SH, based on multi-armed bandits. irBoost.SH solves multi-class classification tasks and can analyze incomplete views. At each iteration, it identifies one winning view using adversarial multi-armed bandits and uses its predictions to update a shared instance weight distribution in a learning process based on boosting. In our experiments, performed on 5 multi-view microbiome datasets, the model learned by irBoost.SH always outperforms the best model learned from a single view, its closest competitor rBoost.SH, and the model learned by a multi-view approach based on feature concatenation, reaching an improvement of 11.8% of the F1-score in the prediction of the Autism Spectrum disorder and of 114% in the prediction of the Colorectal Cancer disease.ConclusionsThe proposed method irBoost.SH exhibited outstanding performances in our experiments, also compared to competitor approaches. The obtained results confirm that irBoost.SH can fruitfully be adopted for the analysis of microbiome data, due to its capability to simultaneously exploit multiple feature sets obtained through different sequencing and preprocessing pipelines.

Emergency Department Risk Model: Timely Identification of Patients for Outpatient Care Coordination

Emergency Department Risk Model: Timely Identification of Patients for Outpatient Care Coordination

Machine-learning classifier models for predicting sarcopenia in the elderly based on physical factors.

As the size of the elderly population gradually increases, musculoskeletal disorders, such as sarcopenia, are increasing. Diagnostic techniques such as X-rays, computed tomography, and magnetic resonance imaging are used to predict and diagnose sarcopenia, and methods using machine learning are gradually increasing. This study aimed to create a model that can predict sarcopenia using physical characteristics and activity-related variables without medical diagnostic equipment, such as imaging equipment, for the elderly aged 60 years or older. A sarcopenia prediction model was constructed using public data obtained from the Korea National Health and Nutrition Examination Survey. Models were built using Logistic Regression, Support Vector Machine (SVM), XGBoost, LightGBM, RandomForest, and Multi-layer Perceptron Neural Network (MLP) algorithms, and the feature importance of the models trained with the algorithms, except for SVM and MLP, was analyzed. The sarcopenia prediction model built with the LightGBM algorithm achieved the highest test accuracy, of 0.848. In constructing the LightGBM model, physical characteristic variables such as body mass index, weight, and waist circumference showed high importance, and activity-related variables were also used in constructing the model. The sarcopenia prediction model, which consisted of only physical characteristics and activity-related factors, showed excellent performance. This model has the potential to assist in the early detection of sarcopenia in the elderly, especially in communities with limited access to medical resources or facilities. Geriatr Gerontol Int 2024; ••: ••-••.

Efficient identification of broad absorption line quasars using dimensionality reduction and machine learning

Efficient identification of broad absorption line quasars using dimensionality reduction and machine learning

MRI-based intratumoral and peritumoral radiomics for preoperative prediction of glioma grade: a multicenter study

BackgroundAccurate preoperative prediction of glioma is crucial for developing individualized treatment decisions and assessing prognosis. In this study, we aimed to establish and evaluate the value of integrated models by incorporating the intratumoral and peritumoral features from conventional MRI and clinical characteristics in the prediction of glioma grade.MethodsA total of 213 glioma patients from two centers were included in the retrospective analysis, among which, 132 patients were classified as the training cohort and internal validation set, and the remaining 81 patients were zoned as the independent external testing cohort. A total of 7728 features were extracted from MRI sequences and various volumes of interest (VOIs). After feature selection, 30 radiomic models depended on five sets of machine learning classifiers, different MRI sequences, and four different combinations of predictive feature sources, including features from the intratumoral region only, features from the peritumoral edema region only, features from the fusion area including intratumoral and peritumoral edema region (VOI-fusion), and features from the intratumoral region with the addition of features from peritumoral edema region (feature-fusion), were established to select the optimal model. A nomogram based on the clinical parameter and optimal radiomic model was constructed for predicting glioma grade in clinical practice.ResultsThe intratumoral radiomic models based on contrast-enhanced T1-weighted and T2-flair sequences outperformed those based on a single MRI sequence. Moreover, the internal validation and independent external test underscored that the XGBoost machine learning classifier, incorporating features extracted from VOI-fusion, showed superior predictive efficiency in differentiating between low-grade gliomas (LGG) and high-grade gliomas (HGG), with an AUC of 0.805 in the external test. The radiomic models of VOI-fusion yielded higher prediction efficiency than those of feature-fusion. Additionally, the developed nomogram presented an optimal predictive efficacy with an AUC of 0.825 in the testing cohort.ConclusionThis study systematically investigated the effect of intratumoral and peritumoral radiomics to predict glioma grading with conventional MRI. The optimal model was the XGBoost classifier coupled radiomic model based on VOI-fusion. The radiomic models that depended on VOI-fusion outperformed those that depended on feature-fusion, suggesting that peritumoral features should be rationally utilized in radiomic studies.

Prediction of heart failure patients with distinct left ventricular ejection fraction levels using circadian ECG features and machine learning.

Heart failure (HF) encompasses a diverse clinical spectrum, including instances of transient HF or HF with recovered ejection fraction, alongside persistent cases. This dynamic condition exhibits a growing prevalence and entails substantial healthcare expenditures, with anticipated escalation in the future. It is essential to classify HF patients into three groups based on their ejection fraction: reduced (HFrEF), mid-range (HFmEF), and preserved (HFpEF), such as for diagnosis, risk assessment, treatment choice, and the ongoing monitoring of heart failure. Nevertheless, obtaining a definitive prediction poses challenges, requiring the reliance on echocardiography. On the contrary, an electrocardiogram (ECG) provides a straightforward, quick, continuous assessment of the patient's cardiac rhythm, serving as a cost-effective adjunct to echocardiography. In this research, we evaluate several machine learning (ML)-based classification models, such as K-nearest neighbors (KNN), neural networks (NN), support vector machines (SVM), and decision trees (TREE), to classify left ventricular ejection fraction (LVEF) for three categories of HF patients at hourly intervals, using 24-hour ECG recordings. Information from heterogeneous group of 303 heart failure patients, encompassing HFpEF, HFmEF, or HFrEF classes, was acquired from a multicenter dataset involving both American and Greek populations. Features extracted from ECG data were employed to train the aforementioned ML classification models, with the training occurring in one-hour intervals. To optimize the classification of LVEF levels in coronary artery disease (CAD) patients, a nested cross-validation approach was employed for hyperparameter tuning. HF patients were best classified using TREE and KNN models, with an overall accuracy of 91.2% and 90.9%, and average area under the curve of the receiver operating characteristics (AUROC) of 0.98, and 0.99, respectively. Furthermore, according to the experimental findings, the time periods of midnight-1 am, 8-9 am, and 10-11 pm were the ones that contributed to the highest classification accuracy. The results pave the way for creating an automated screening system tailored for patients with CAD, utilizing optimal measurement timings aligned with their circadian cycles.

Differentiation of benign and malignant parotid gland tumors based on the fusion of radiomics and deep learning features on ultrasound images

ObjectiveThe pathological classification and imaging manifestation of parotid gland tumors are complex, while accurate preoperative identification plays a crucial role in clinical management and prognosis assessment. This study aims to construct and compare the performance of clinical models, traditional radiomics models, deep learning (DL) models, and deep learning radiomics (DLR) models based on ultrasound (US) images in differentiating between benign parotid gland tumors (BPGTs) and malignant parotid gland tumors (MPGTs).MethodsRetrospective analysis was conducted on 526 patients with confirmed PGTs after surgery, who were randomly divided into a training set and a testing set in the ratio of 7:3. Traditional radiomics and three DL models (DenseNet121, VGG19, ResNet50) were employed to extract handcrafted radiomics (HCR) features and DL features followed by feature fusion. Seven machine learning classifiers including logistic regression (LR), support vector machine (SVM), RandomForest, ExtraTrees, XGBoost, LightGBM and multi-layer perceptron (MLP) were combined to construct predictive models. The most optimal model was integrated with clinical and US features to develop a nomogram. Receiver operating characteristic (ROC) curve was employed for assessing performance of various models while the clinical utility was assessed by decision curve analysis (DCA).ResultsThe DLR model based on ExtraTrees demonstrated superior performance with AUC values of 0.943 (95% CI: 0.918-0.969) and 0.916 (95% CI: 0.861-0.971) for the training and testing set, respectively. The combined model DLR nomogram (DLRN) further enhanced the performance, resulting in AUC values of 0.960 (95% CI: 0.940- 0.979) and 0.934 (95% CI: 0.876-0.991) for the training and testing sets, respectively. DCA analysis indicated that DLRN provided greater clinical benefits compared to other models.ConclusionDLRN based on US images shows exceptional performance in distinguishing BPGTs and MPGTs, providing more reliable information for personalized diagnosis and treatment plans in clinical practice.

Faulty cell prediction accuracy comparison of machine learning algorithms using temperature sensor placement optimization approach in immersion cooled Li-ion battery modules

Immersion cooling is a promising thermal management system for LiBs where the cells are submerged in a thermally conductive coolant, thus improving heat dissipation and prolonging battery life. The present study investigates an aligned arranged 4S4P immersion-cooled LiB module to develop a best-fit machine learning (ML) model that could predict the fault position in the module depending on the inputs from the temperature sensors that are optimized under different operating and fault conditions. The Pearson Correlation Coefficient (PCC) feature selection approach is used to optimize the sensors, while the data is generated from numerical simulations on a 4S4P immersion-cooled LiB module. The model validation through internal experimental trials is performed on a 2S2P battery module. The four ML classification algorithms, which include the K Nearest Neighbors, Random Forest (RF), Extreme Gradient, and Long Short Term Memory (LSTM), are trained on the optimized sensors data and are further tested internally and externally to assess their performance on unseen data within and outside the training range. A 5-fold cross-validation process is also implemented, and following a comprehensive comparison of the predictions based on the accuracies and model elapsed time, the best-fit model is identified. The results conclude that while the LSTM model slightly outweighs the other models with an accuracy of 98.18% for the specific external test cases, the RF model is chosen as the best-fit model with a prediction accuracy of 99.7% based on the error metrics and low training time for the internal testing. The outcomes of this present work contribute to the early identification of battery module failures, enhancing safety and reducing costs.

Exploring the Learning Analytics of Skill-based Course using Machine Learning Classification Models

This study explores learning analytics of a skill-based course using various machine learning classification models, including Random Forest, Logistic Regression, CatBoost, Support Vector Classification (SVC), and Naïve Bayes. The objective is to categorize student outcomes into four classes: Pass, Distinction, Withdrawn, and Fail. The research contributes to the growing body of knowledge in learning analytics and machine learning applications in education. The findings from this investigation offer educators and academic institutions a robust framework for early identification of students at risk of underperformance or withdrawal, thereby enabling timely intervention to enhance student success in skill-based courses

HSLE: A Hybrid Ensemble Classifier for Prediction of Heart Disease

Background: Detecting heart disease in a timely manner is vital for preventing its progression, as it is the primary cause of death across the globe. Machine learning has the potential to enhance diagnostic accuracy and enable better clinical decision-making. A machine learningpowered hybrid system for diagnosing heart disease may provide a better optimal solution for heart disease prediction. Objective: The overarching objectives include accuracy improvement, enhanced classification reliability, and the development of high-performance prediction models for heart disease. These objectives indicate a commitment to advancing methodologies and models in the field of machine learning and data science, particularly within the domain of healthcare and disease prediction. Method: The proposed system was developed using the Cleveland dataset that was preprocessed and analyzed using Recursive Feature Elimination with Cross-Validation (RFECV) and Least Absolute Shrinkage and Selection Operator (LASSO) feature extraction techniques. Further, a hybrid feature selection approach using RFECV and K-Best has been proposed for feature selection. Eight machine learning classifiers such as Multilayer Perceptron (MLP), Random Forest (RF), Extreme Gradient Boosting (XGB), K-Nearest Neighbours (KNN), Extra Tree (ET), Support Vector Machine (SVC), Adaboost, Decision Tree (DT) were utilized, and the performance of the system was measured in terms of various metrics. Result: The results showed that the proposed HSLE algorithm with hybrid feature selection led to the highest overall accuracy of 98.76%. Conclusion: As mentioned, the main cause of adult death worldwide is chronic disease. Early detection can stop the condition from getting worse. Our research presents an innovative hybrid machine-learning approach designed to forecast heart disease.

SPOTTING OF CYBERBULLYING ON SOCIAL MEDIA USING MACHINE LEARNING

Cyberbullying occurs when someone harasses, threatens, or mistreats someone else online or on social media. Cyberbullying leads to threats, public embarrassment, and reprimands. Cyberbullying has caused a rise in youth suicide and mental health issues. It has lowered my self-esteem and escalated my suicidal thoughts. If cyberbullying continues, an entire generation of young adults will suffer from low self-esteem and mental health issues. Many machine learning algorithms are used to automatically identify social media cyberbullying. Social media monitoring allows this. These models don't account for all the factors that could make a comment or post bullying. Bullying is still ambiguous. This study presents a cyberbullying diagnosis model based on several factors. Cyberbully is a misuse of technology advantage to bully a person. This project is used Dataset namely,’ Cyberbullying-tweets’. This project used Machine Learning Classifiers such as Support Vector Machine (SVM), Random Forest (RF), Naïve Bayes (NB), and Neural Networks (NN), Logistic Regression(LR) Algorithms and calculated performance results for comparing the performance for dataset. Keywords: Cyberbullying Detection, Social Media Analysis, Machine Learning Models, Natural Language Processing (NLP), Text Classification , Feature Extraction, Sentiment Analysis, Textual Data Mining, Online Harassment, User Profiling, Toxic Language Detection, Hate Speech Detection, Content Moderation, Multi-Layer Perceptron (MLP), Support Vector Machine (SVM), Neural Network Algorithms, Lexicon-based Features, Syntactic Features, N-gram Analysis, Arabic Social Media (if focusing on Arabic language),User Behavior Analysis, Feature Engineering, Cross- Platform Analysis, Real-time Monitoring, Social Network Analysis

Bayesian Networks in the Management of Hospital Admissions: A Comparison between Explainable AI and Black Box AI during the Pandemic

Artificial Intelligence (AI) and Machine Learning (ML) approaches that could learn from large data sources have been identified as useful tools to support clinicians in their decisional process; AI and ML implementations have had a rapid acceleration during the recent COVID-19 pandemic. However, many ML classifiers are “black box” to the final user, since their underlying reasoning process is often obscure. Additionally, the performance of such models suffers from poor generalization ability in the presence of dataset shifts. Here, we present a comparison between an explainable-by-design (“white box”) model (Bayesian Network (BN)) versus a black box model (Random Forest), both studied with the aim of supporting clinicians of Policlinico San Matteo University Hospital in Pavia (Italy) during the triage of COVID-19 patients. Our aim is to evaluate whether the BN predictive performances are comparable with those of a widely used but less explainable ML model such as Random Forest and to test the generalization ability of the ML models across different waves of the pandemic.

Enhancing Classification Accuracy with Integrated Contextual Gate Network: Deep Learning Approach for Functional Near-Infrared Spectroscopy Brain–Computer Interface Application

Brain–computer interface (BCI) systems include signal acquisition, preprocessing, feature extraction, classification, and an application phase. In fNIRS-BCI systems, deep learning (DL) algorithms play a crucial role in enhancing accuracy. Unlike traditional machine learning (ML) classifiers, DL algorithms eliminate the need for manual feature extraction. DL neural networks automatically extract hidden patterns/features within a dataset to classify the data. In this study, a hand-gripping (closing and opening) two-class motor activity dataset from twenty healthy participants is acquired, and an integrated contextual gate network (ICGN) algorithm (proposed) is applied to that dataset to enhance the classification accuracy. The proposed algorithm extracts the features from the filtered data and generates the patterns based on the information from the previous cells within the network. Accordingly, classification is performed based on the similar generated patterns within the dataset. The accuracy of the proposed algorithm is compared with the long short-term memory (LSTM) and bidirectional long short-term memory (Bi-LSTM). The proposed ICGN algorithm yielded a classification accuracy of 91.23 ± 1.60%, which is significantly (p < 0.025) higher than the 84.89 ± 3.91 and 88.82 ± 1.96 achieved by LSTM and Bi-LSTM, respectively. An open access, three-class (right- and left-hand finger tapping and dominant foot tapping) dataset of 30 subjects is used to validate the proposed algorithm. The results show that ICGN can be efficiently used for the classification of two- and three-class problems in fNIRS-based BCI applications.