Effectiveness Of Machine Learning Algorithms Research Articles

An investigation of machine learning algorithms and data augmentation techniques for diabetes diagnosis using class imbalanced BRFSS dataset

Diabetes is a prevalent chronic condition that poses significant challenges to early diagnosis and identifying at-risk individuals. Machine learning plays a crucial role in diabetes detection by leveraging its ability to process large volumes of data and identify complex patterns. However, imbalanced data, where the number of diabetic cases is substantially smaller than non-diabetic cases, complicates the identification of individuals with diabetes using machine learning algorithms. This study focuses on predicting whether a person is at risk of diabetes, considering the individual’s health and socio-economic conditions while mitigating the challenges posed by imbalanced data. We employ several data augmentation techniques, such as oversampling (Synthetic Minority Over Sampling for Nominal Data, i.e.SMOTE-N), undersampling (Edited Nearest Neighbor, i.e. ENN), and hybrid sampling techniques (SMOTE-Tomek and SMOTE-ENN) on training data before applying machine learning algorithms to minimize the impact of imbalanced data. Our study sheds light on the significance of carefully utilizing data augmentation techniques without any data leakage to enhance the effectiveness of machine learning algorithms. Moreover, it offers a complete machine learning structure for healthcare practitioners, from data obtaining to machine learning prediction, enabling them to make informed decisions.

Role of machine learning algorithms in suicide risk prediction: a systematic review-meta analysis of clinical studies

ObjectiveSuicide is a complex and multifactorial public health problem. Understanding and addressing the various factors associated with suicide is crucial for prevention and intervention efforts. Machine learning (ML) could enhance the prediction of suicide attempts.MethodA systematic review was performed using PubMed, Scopus, Web of Science and SID databases. We aim to evaluate the performance of ML algorithms and summarize their effects, gather relevant and reliable information to synthesize existing evidence, identify knowledge gaps, and provide a comprehensive list of the suicide risk factors using mixed method approach.ResultsForty-one studies published between 2011 and 2022, which matched inclusion criteria, were chosen as suitable. We included studies aimed at predicting the suicide risk by machine learning algorithms except natural language processing (NLP) and image processing.The neural network (NN) algorithm exhibited the lowest accuracy at 0.70, whereas the random forest demonstrated the highest accuracy, reaching 0.94. The study assessed the COX and random forest models and observed a minimum area under the curve (AUC) value of 0.54. In contrast, the XGBoost classifier yielded the highest AUC value, reaching 0.97. These specific AUC values emphasize the algorithm-specific performance in capturing the trade-off between sensitivity and specificity for suicide risk prediction.Furthermore, our investigation identified several common suicide risk factors, including age, gender, substance abuse, depression, anxiety, alcohol consumption, marital status, income, education, and occupation. This comprehensive analysis contributes valuable insights into the multifaceted nature of suicide risk, providing a foundation for targeted preventive strategies and intervention efforts.ConclusionsThe effectiveness of ML algorithms and their application in predicting suicide risk has been controversial. There is a need for more studies on these algorithms in clinical settings, and the related ethical concerns require further clarification.

Development and validation of a machine learning-based prediction model for sudden cardiac death in the general population: insights from the community cardiovascular cohort

Abstract Background/Introduction Accurately predicting and managing the risk of sudden cardiac death (SCD) in the general population is a formidable challenge. Purpose This study aimed to develop and validate a machine learning (ML)-based prediction model for SCD using data from the Community Cardiovascular Cohort (CCCC) in Taiwan. Methods A community-based cohort study was used for model construction . Four ML algorithms, including extreme gradient boosting (XGBoost), random forests (RF), logistic regression, and deep neural network (DNN), underwent meticulous evaluation. Performance assessment encompassed receiver operating characteristic (ROC) curves, area under the curves (AUC), and accuracy metrics. Significant risk factors were identified through feature importance analysis. Results We employed a random partitioning strategy, allocating 1744 participants (55%) to the training dataset, 952 participants (30%) to the test dataset, and 476 participants (15%) to the validation dataset. In the data training stage, the XGBoost algorithm demonstrated outstanding prediction performance for SCD (AUC: 1.000); In the validation stage, the XGBoost algorithm demonstrated good prediction performance for SCD prediction (AUC: 0.791, 95%CI: 0.617-0.964; Accuracy: 0.971). Using XGBoost-generated predicted probabilities (P(XGB)), we identified individuals with P(XGB) ≥ 0.5 (Group 1) who displayed significantly higher SCD risk (HR 32.0; 95% CI: 9.29-109.9) compared to those with P(XGB) < 0.5 (Group 0). Conclusions Our study demonstrates the effectiveness of ML algorithms, particularly XGBoost, in predicting event of SCD in the general population. The identification of these pivotal risk factors holds profound implications, empowering the identification of high-risk individuals and facilitating the implementation of precisely tailored preventive strategies.Figure 1:KM sruvival curveFigure 2:Feature importance analysis

Using Machine Learning to Measure Conservatism

This study proposes an approach to measure conservatism using machine learning techniques that are not constrained by functional form restrictions. We extend the differential timeliness model to allow for observable characteristics related to conservatism to follow nonlinear relationships. By developing machine learning measures of conservatism, we draw attention to potential benefits and drawbacks and show how its insights complement conventional measures. Our broader goal is to investigate the effectiveness of machine learning algorithms for filtering noise in traditional archival studies and uncovering more complex empirical patterns. This paper was accepted by Suraj Srinivasan, accounting. Supplemental Material: The online appendix and data files are available at https://doi.org/10.1287/mnsc.2024.4983 .

Precision healthcare analytics: Integrating ML for automated image interpretation, disease detection, and prognosis prediction

This review paper provides an overview of precision healthcare analytics, focusing on the integration of machine learning (ML) techniques for automating image interpretation, disease detection, and prognosis prediction across various medical imaging modalities, including X-rays, MRIs, and CT scans. Drawing upon existing literature and empirical evidence, we assess the impact of ML-driven automated image interpretation on diagnostic accuracy, highlighting its superiority over traditional methods. Additionally, we examine the effectiveness of ML algorithms in disease detection, emphasizing their potential for early intervention and improved patient outcomes. Furthermore, we explore the prognostic capabilities of ML-based models in forecasting disease progression and guiding treatment strategies. Through a comprehensive synthesis of research findings, we identify key factors influencing the performance of ML algorithms in healthcare applications and discuss strategies for addressing challenges related to data quality, interpretability, and scalability. By critically evaluating current trends and advancements in precision healthcare analytics, this review aims to provide insights into the potential benefits and limitations of ML integration in medical practice, contributing to the ongoing discourse on enhancing patient care and healthcare delivery.

A Machine Learning Model for Evaluation of the Corrosion Inhibition Capacity of Quinoxaline Compounds

A Machine Learning Model for Evaluation of the Corrosion Inhibition Capacity of Quinoxaline Compounds

Improvement of Distributed Denial of Service Attack Detection through Machine Learning and Data Processing

The early and accurate detection of Distributed Denial of Service (DDoS) attacks is a fundamental area of research to safeguard the integrity and functionality of organizations’ digital ecosystems. Despite the growing importance of neural networks in recent years, the use of classical techniques remains relevant due to their interpretability, speed, resource efficiency, and satisfactory performance. This article presents the results of a comparative analysis of six machine learning techniques, namely, Random Forest (RF), Decision Tree (DT), AdaBoost (ADA), Extreme Gradient Boosting (XGB), Multilayer Perceptron (MLP), and Dense Neural Network (DNN), for classifying DDoS attacks. The CICDDoS2019 dataset was used, which underwent data preprocessing to remove outliers, and 22 features were selected using the Pearson correlation coefficient. The RF classifier achieved the best accuracy rate (99.97%), outperforming other classifiers and even previously published neural network-based techniques. These findings underscore the feasibility and effectiveness of machine learning algorithms in the field of DDoS attack detection, reaffirming their relevance as a valuable tool in advanced cyber defense.

Enhancements in Radiological Detection of Metastatic Lymph Nodes Utilizing AI-Assisted Ultrasound Imaging Data and the Lymph Node Reporting and Data System Scale.

The paper presents a novel approach for the automatic detection of neoplastic lesions in lymph nodes (LNs). It leverages the latest advances in machine learning (ML) with the LN Reporting and Data System (LN-RADS) scale. By integrating diverse datasets and network structures, the research investigates the effectiveness of ML algorithms in improving diagnostic accuracy and automation potential. Both Multinominal Logistic Regression (MLR)-integrated and fully connected neuron layers are included in the analysis. The methods were trained using three variants of combinations of histopathological data and LN-RADS scale labels to assess their utility. The findings demonstrate that the LN-RADS scale improves prediction accuracy. MLR integration is shown to achieve higher accuracy, while the fully connected neuron approach excels in AUC performance. All of the above suggests a possibility for significant improvement in the early detection and prognosis of cancer using AI techniques. The study underlines the importance of further exploration into combined datasets and network architectures, which could potentially lead to even greater improvements in the diagnostic process.

Achieving high inter-rater reliability in establishing data labels: a retrospective chart review study.

In medical research, the effectiveness of machine learning algorithms depends heavily on the accuracy of labeled data. This study aimed to assess inter-rater reliability (IRR) in a retrospective electronic medical chart review to create high quality labeled data on comorbidities and adverse events (AEs). Six registered nurses with diverse clinical backgrounds reviewed patient charts, extracted data on 20 predefined comorbidities and 18 AEs. All reviewers underwent four iterative rounds of training aimed to enhance accuracy and foster consensus. Periodic monitoring was conducted at the beginning, middle, and end of the testing phase to ensure data quality. Weighted Kappa coefficients were calculated with their associated 95% confidence intervals (CIs). Seventy patient charts were reviewed. The overall agreement, measured by Conger's Kappa, was 0.80 (95% CI: 0.78-0.82). IRR scores remained consistently high (ranging from 0.70 to 0.87) throughout each phase. Our study suggests the detailed manual for chart review and structured training regimen resulted in a consistently high level of agreement among our reviewers during the chart review process. This establishes a robust foundation for generating high-quality labeled data, thereby enhancing the potential for developing accurate machine learning algorithms.

Research on sensor data optimization technology for thermal hydraulic experiment of nuclear reactor

The sensor signals collected by the nuclear reactor thermal hydraulic experimental system are mixed with complex noise information. The uncertainty of sensor data directly affects the analysis and evaluation effect of machine learning algorithms on the operating status of the experimental system. Traditional denoising methods have poor adaptability to different types of noisy data, are highly dependent on researchers and have high design cost. This paper proposes a data optimization technology based on a hybrid adaptive real-time denoising (HART) model, which can realize data distribution self-adaptation and algorithm hyperparameter self-optimization according to the characteristics of noisy source data. Through the joint denoising algorithm with Variational Mode Decomposition (VMD) algorithm as the core, the partition denoising of source data is realized. In addition, the practical application of the source data of thermal hydraulic experiments in the nuclear field and the verification of simulation and noise addition experiments have been completed. The results show that the denoising optimization model proposed in this paper has the characteristics of good adaptability, self-optimization and real-time processing for different sensor signals. It can effectively remove noise information, restrain data uncertainty, and provide high-quality data source for experimental data analysis based on machine learning. At the same time, the optimization technology can be further applied to the optimization of sensor data of nuclear power plants (NPP).

Optimized Machine Learning Model for Fire Consequence Prediction

This article focuses on using machine learning to predict the distance at which a chemical storage tank fire reaches a specified thermal radiation intensity. DNV’s Process Hazard Analysis Software Tool (PHAST) is used to simulate different scenarios of tank leakage and to establish a database of tank accidents. Backpropagation (BP) neural networks, random forest models, and the optimized random forest model K-R are used for model training and consequence prediction. The regression performance of the models is evaluated using the mean squared error (MSE) and R2. The results indicate that the K-R regression prediction model outperforms the other two machine learning algorithms, accurately predicting the distance at which the thermal radiation intensity is reached after a tank fire. Compared with the simulation results, the model demonstrates higher accuracy in predicting the distance of tank fire consequences, proving the effectiveness of machine learning algorithms in predicting the range of consequences of tank storage area fire events.

Implementation of C5.0 Algorithm using Chi-Square Feature Selection for Early Detection of Hepatitis C Disease

Hepatitis C, a significant global health challenge, affects 71 million people worldwide, with severe complications such as cirrhosis and hepatocellular carcinoma. Despite its prevalence and availability in rapid diagnostic tests (RDTs), the need for accurate early detection methods remains critical. This research aims to enhance hepatitis C virus classification accuracy by integrating the C5.0 algorithm with Chi-Square feature selection, addressing the limitations of current diagnostic approaches and potentially reducing diagnostic errors. This research explores the development of a machine learning model for hepatitis C prediction, utilizing a publicly available dataset from Kaggle. It encompasses preprocessing techniques such as label encoding, handling missing values, normalization, feature selection, model development, and evaluation to ensure the model's efficacy and accuracy in diagnosing hepatitis C. The findings of this study reveal that implementing Chi-Square feature selection significantly enhances the effectiveness of machine learning algorithms. Specifically, the combination of the C5.0 algorithm and Chi-Square feature selection yielded a remarkable accuracy of 96.75%, surpassing previous research benchmarks. This highlights the potent synergy between advanced feature selection techniques and machine learning algorithms in improving diagnostic precision. The study conclusively demonstrates that machine learning is an effective tool for detecting hepatitis C, showcasing the potential to enhance diagnostic accuracy significantly. As a future recommendation, adopting AutoML is suggested to periodically automate the selection of the optimal algorithm, promising further improvements in detection capabilities.

Towards a new approach to maximize tax collection using machine learning algorithms

<p>Efficient tax debt collection is a challenge for Moroccan local tax authorities. This article explores the potential of machine learning techniques and novel strategies to enhance efficiency in this process. We present a practical use case demonstrating the application of machine learning for taxpayer segmentation, improving accuracy in identifying high-risk debtors. Using a comprehensive dataset of tax payment behavior, we showcase the effectiveness of machine learning algorithms in segmenting taxpayers based on their likelihood of non-compliance or debt accumulation. We also investigate innovative strategies that integrate behavioral economics principles to enable better targeted interventions. Real-world case studies in local tax debt collection highlight the impact of these strategies. The findings underscore the transformative potential of machine learning techniques and novel strategies in improving the efficiency of local tax debt collection. Accurate identification of high-risk debtors and tailored enforcement actions help maximize revenue while minimizing resource waste. This research contributes to the existing knowledge by providing insights into the implementation of machine learning techniques and novel strategies in tax debt collection. It emphasizes the importance of data-driven approaches and highlights how local tax authorities can drive efficiency and optimize revenue collection by embracing these advancements.</p>

Machine learning for power outage prediction during hurricanes: An extensive review

The surge of machine learning (ML) applications and increasing usage of data driven approach for resilience enhancement provide great opportunities for applying ML techniques to power outage prediction (POP) during hurricanes. Considering the substantial damage that wind hazards can cause to power system network (PSN) in countries such as the USA and China, researchers have devised numerous approaches for disaster prevention to reduce their susceptibility. Since the selection of optimal ML algorithms for POP during hurricanes is a complex task, this paper helps researchers easily comprehend the numerous prediction techniques used worldwide for power outages during hurricanes. The paper provides a brief review of several categories of hurricanes and the damage it causes to the PSN more specifically to distribution side, the necessary measures to improve the PSN resilience, and finally a sequential approach for optimal ML model selection techniques that researchers and engineers can use to improve the POP during hurricanes. In this study the effectiveness of ML algorithms has been explored with the help of performance evaluation metrics which serve as the basic deciding criteria for optimal model selection. This research also highlights some of the key issues and challenges of integrating machine learning algorithms with existing PSN.

Air quality monitoring using statistical learning models for sustainable environment

High levels of air pollutants pose significant health risks, increasing the chances of respiratory infections, lung cancer, and heart complications, particularly for those already susceptible to illness. Modern societal advancements have worsened air quality degradation, with daily activities such as transportation, industrial processes, and domestic operations releasing harmful contaminants. This study addresses the urgent need for air quality monitoring and forecasting, especially in developing nations like India, where machine learning-based prediction technologies play a crucial role in understanding environmental aspects. Our study focuses on analyzing and predicting air quality using data from two distinct areas in Kolkata—Victoria and Rabindra. Thorough pre-processing and data analysis have been conducted to identify essential features and detect undermining patterns in the data. Utilizing five classic machine learning algorithms, we predict the air quality category by categorizing the predicted AQI into six AQI classes, emphasizing extensive hyper-parameter tuning for each model. The Rabindra dataset yields the best-performing Support Vector Machine (SVC) model with a 97.98% accuracy, while the best prediction accuracy for Victoria location is 93.29% from Random Forest Classifier (RFC). This study offers valuable insights into the effectiveness of machine learning algorithms for air quality prediction, with the novelty of the study lying in the focus on hyper-parameter tuning to achieve the highest accuracy.

Effect of Machine Learning Algorithms on Prediction of In-Cylinder Combustion Pressure of Ammonia–Oxygen in a Constant-Volume Combustion Chamber

Road vehicles, particularly cars, are one of the primary sources of CO2 emissions in the transport sector. Shifting to unconventional energy sources such as solar and wind power may reduce their carbon footprints considerably. Consequently, using ammonia as a fuel due to its potential benefits, such as its high energy density, being a carbon-free fuel, and its versatility during storage and transportation, has now grabbed the attention of researchers. However, its slow combustion speed, larger combustion chamber requirements, ignition difficulties, and limited combustion stability are still major challenges. Therefore, authors tried to analyze the combustion pressure of ammonia in a constant-volume combustion chamber across different equivalence ratios by adopting a machine learning approach. While conducting the analysis, the experimental values were assessed and subsequently utilized to predict the induced combustion pressure in a constant-volume combustion chamber across various equivalence ratios. In this research, a two-step prediction process was employed. In the initial step, the Random Forest algorithm was applied to assess the combustion pressure. Subsequently, in the second step, artificial neural network machine learning algorithms were employed to pinpoint the most effective algorithm with a lower root-mean-square error and R2. Finally, Linear Regression illustrated the lowest error in both steps with a value of 1.0, followed by Random Forest.

The effect of machine learning algorithms in the prediction, and diagnosis of meningitis: A systematic review.

This systematic review aimed to evaluating the effectiveness of machine learning (ML) algorithms for the prediction and diagnosis of meningitis. On November 12, 2022, a systematic review was carried out using a keyword search in the reliable scientific databases PubMed, EMBASE, Scopus, and Web of Science. The recommendations of Preferred Reporting for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Studies conducted in English that employed ML to predict and identify meningitis were deemed to match the inclusion criteria. The eligibility requirements were used to independently review the titles and abstracts. The whole text was then obtained and independently reviewed in accordance with the eligibility requirements. After all the research matched the inclusion criteria, a total of 16 studies were added to the systematic review. Studies on the application of ML algorithms in the three categories of disease diagnosis ability (8.16) and disease prediction ability (8.16) (including cases related to identifying patients (50%), risk of death in patients (25%), the consequences of the disease in childhood (12.5%), and its etiology [12.5%]) were placed. Among the ML algorithms used in this study, logistic regression (LR) (4.16, 25%) and multiple logistic regression (MLR) (4.16, 25%) were the most used. All the included studies indicated improvements in the processes of diagnosis, prediction, and disease outbreak with the help of ML algorithms. The results of the study showed that in all included studies, ML algorithms were an effective approach to facilitate diagnosis, predict consequences for risk classification, and improve resource utilization by predicting the volume of patients or services as well as discovering risk factors. The role of ML algorithms in improving disease diagnosis was more significant than disease prediction and prevalence. Meanwhile, the use of combined methods can optimize differential diagnoses and facilitate the decision-making process for healthcare providers.

Resting-state EEG dynamic functional connectivity distinguishes non-psychotic major depression, psychotic major depression and schizophrenia.

This study aims to identify dynamic patterns within the spatiotemporal feature space that are specific to nonpsychotic major depression (NPMD), psychotic major depression (PMD), and schizophrenia (SCZ). The study also evaluates the effectiveness of machine learning algorithms based on these network manifestations in differentiating individuals with NPMD, PMD, and SCZ. A total of 579 participants were recruited, including 152 patients with NPMD, 45 patients with PMD, 185 patients with SCZ, and 197 healthy controls (HCs). A dynamic functional connectivity (DFC) approach was employed to estimate the principal FC states within each diagnostic group. Incremental proportions of data (ranging from 10% to 100%) within each diagnostic group were used for variability testing. DFC metrics, such as proportion, mean duration, and transition number, were examined among the four diagnostic groups to identify disease-related neural activity patterns. These patterns were then used to train a two-layer classifier for the four groups (HC, NPMD, PMD, and SCZ). The four principal brain states (i.e., states 1,2,3, and 4) identified by the DFC approach were highly representative within and across diagnostic groups. Between-group comparisons revealed significant differences in network metrics of state 2 and state 3, within delta, theta, and gamma frequency bands, between healthy individuals and patients in each diagnostic group (p < 0.01, FDR corrected). Moreover, the identified key dynamic network metrics achieved an accuracy of 73.1 ± 2.8% in the four-way classification of HC, NPMD, PMD, and SCZ, outperforming the static functional connectivity (SFC) approach (p < 0.001). These findings suggest that the proposed DFC approach can identify dynamic network biomarkers at the single-subject level. These biomarkers have the potential to accurately differentiate individual subjects among various diagnostic groups of psychiatric disorders or healthy controls. This work may contribute to the development of a valuable EEG-based diagnostic tool with enhanced accuracy and assistive capabilities.

Machine learning to predict unintended pregnancy among reproductive-age women in Ethiopia: evidence from EDHS 2016

BackgroundAn unintended pregnancy is a pregnancy that is either unwanted or mistimed, such as when it occurs earlier than desired. It is one of the most important issues the public health system is currently facing, and it comes at a significant cost to society both economically and socially. The burden of an undesired pregnancy still weighs heavily on Ethiopia. The purpose of this study was to assess the effectiveness of machine learning algorithms in predicting unintended pregnancy in Ethiopia and to identify the key predictors.MethodMachine learning techniques were used in the study to analyze secondary data from the 2016 Ethiopian Demographic and Health Survey. To predict and identify significant determinants of unintended pregnancy using Python software, six machine-learning algorithms were applied to a total sample of 7193 women. The top unplanned pregnancy predictors were chosen using the feature importance technique. The effectiveness of such models was evaluated using sensitivity, specificity, accuracy, and area under the curve.ResultThe ExtraTrees classifier was chosen as the top machine learning model after various performance evaluations. The region, the ideal number of children, religion, wealth index, age at first sex, husband education, refusal sex, total births, age at first birth, and mother’s educational status are identified as contributing factors in that predict unintended pregnancy.ConclusionThe ExtraTrees machine learning model has a better predictive performance for identifying predictors of unintended pregnancies among the chosen algorithms and could improve with better policy decision-making in this area. Using these important features to help direct appropriate policy can significantly increase the chances of mother survival.

Exploring the Effectiveness of Machine Learning Algorithms in Image Forgery Detection

This study investigates the efficacy of various machine learning algorithms for detecting image forgery, a prevalent issue in the realm of digital media manipulation. The research focuses on assessing the performance of these algorithms in accurately identifying instances of image tampering, aiming to contribute valuable insights to the field of digital forensics. The evaluation encompasses a diverse set of machine learning techniques, including but not limited to convolutional neural networks (CNNs), support vector machines (SVMs), and decision trees. Through rigorous experimentation and comparative analysis, the research aims to discern the strengths and limitations of each algorithm in the context of image forgery detection. The findings of this study hold significance for enhancing the capabilities of digital forensics tools, thereby aiding in the mitigation of fraudulent activities, and ensuring the integrity of visual content in the digital' domain.