Traditional Statistical Methods Research Articles

Machine learning in causal inference for epidemiology.

In causal inference, parametric models are usually employed to address causal questions estimating the effect of interest. However, parametric models rely on the correct model specification assumption that, if not met, leads to biased effect estimates. Correct model specification is challenging, especially in high-dimensional settings. Incorporating Machine Learning (ML) into causal analyses may reduce the bias arising from model misspecification, since ML methods do not require the specification of a functional form of the relationship between variables. However, when ML predictions are directly plugged in a predefined formula of the effect of interest, there is the risk of introducing a "plug-in bias" in the effect measure. To overcome this problem and to achieve useful asymptotic properties, new estimators that combine the predictive potential of ML and the ability of traditional statistical methods to make inference about population parameters have been proposed. For epidemiologists interested in taking advantage of ML for causal inference investigations, we provide an overview of three estimators that represent the current state-of-art, namely Targeted Maximum Likelihood Estimation (TMLE), Augmented Inverse Probability Weighting (AIPW) and Double/Debiased Machine Learning (DML).

Introducing GWAStic: A user-friendly, cross-platform solution for genome-wide association studies and genomic prediction

Abstract Motivation Advances in genomics have created an insistent need for accessible tools that simplify complex genetic data analysis, enabling researchers across fields to harness the power of genome-wide association studies and genomic prediction. GWAStic was developed to bridge this gap, providing an intuitive platform that combines artificial intelligence with traditional statistical methods, making sophisticated genomic analysis accessible without requiring deep expertise in statistical software. Results We present GWAStic, an intuitive, cross-platform desktop application designed to streamline genome-wide association studies and genomic prediction for biological and medical researchers. With a user-friendly graphical interface, GWAStic integrates machine learning and traditional statistical approaches to support genetic analysis. The application accepts inputs from standard text-based Variant Call Formats and PLINK binary files, generating clear graphical outputs, including Manhattan plots, quantile-quantile plots, and genomic prediction correlation plots, to enhance data visualization and analysis. Availability and implementation Project page: https://github.com/snowformatics/gwastic_desktop GWAStic documentation: https://snowformatics.gitbook.io/product-docs PyPI: https://pypi.org/project/gwastic-desktop/

More than words: the role of personality in shaping the timeliness of online reviews

Purpose The purpose of this paper is to investigate the potential influence of the big five personality traits − extraversion, neuroticism, agreeableness, openness and conscientiousness − on the time taken by travelers to submit online reviews after their hotel stay. Design/methodology/approach The study analyzed 83,235 TripAdvisor reviews from 415 hotels in six major US tourism cities using random forest algorithms and Poisson regression. The research investigated the influence of the big five personality traits on the time taken by travelers to submit online reviews post-hotel stay, merging personality psychology with consumer behavior research through a combination of machine learning and statistical analysis. Findings The findings reveal significant correlations between certain personality traits and the time taken to post online hotel reviews. Extraversion, neuroticism and agreeableness were found to be negatively correlated with response time, suggesting that individuals scoring higher in these traits tend to submit their reviews more quickly. Conversely, openness exhibited a positive correlation, indicating that those with higher levels of openness tend to delay their feedback. Conscientiousness showed no significant correlation with response time. Originality/value This study represents a novel approach to understanding the relationship between personality traits and online review behavior in the hospitality industry. By leveraging advanced machine learning techniques, such as random forest algorithms, alongside traditional statistical methods like Poisson regression, this research offers a unique perspective on the influence of personality on consumer behavior. The innovative application of these technologies to a large data set of TripAdvisor reviews provides fresh insights that can inform the development of personalized customer engagement strategies. The findings contribute to the growing body of literature on the intersection of personality psychology, consumer behavior and hospitality management in the digital age.

Unravelling the knowledge matrix: exploring knowledge-sharing behaviours on market-based platforms using regression tree analysis

PurposeThis study aims to enhance the effectiveness of knowledge markets and overall knowledge management (KM) practices within organisations. By addressing the challenge of internal knowledge stickiness, it seeks to demonstrate how machine learning and AI approaches, specifically a text-based AI method for personality assessment and regression trees for behavioural analysis, can automate and personalise knowledge market incentivisation mechanisms.Design/methodology/approachThe research employs a novel approach by integrating machine learning methodologies to overcome the limitations of traditional statistical methods. A natural language processing (NLP)-based AI tool is used to assess employees’ personalities, and regression tree analysis is applied to predict and categorise behavioural patterns in knowledge-sharing contexts. This approach is designed to capture the complex interplay between individual personality traits and environmental factors, which traditional methods often fail to adequately address.FindingsCognitive style was confirmed as a key predictor of knowledge-sharing, with extrinsic motivators outweighing intrinsic ones in market-based platforms. These findings underscore the significance of diverse combinations of environmental and individual factors in promoting knowledge sharing, offering key insights that can inform the automatic design of personalised interventions for community managers of such platforms.Originality/valueThis research stands out as it is the first to empirically explore the interaction between the individual and the environment in shaping actual knowledge-sharing behaviours, using advanced methodologies. The increased automation in the process extends the practical contribution of this study, enabling a more efficient, automated assessment process, and thus making critical theoretical and practical advancements in understanding and enhancing knowledge-sharing behaviours.

Abstract 4138355: Machine Learning for Prediction of All-Cause Mortality in Acute Coronary Syndrome

Background: Acute coronary syndrome (ACS) remains one of the leading causes of death globally. Accurate and reliable mortality risk prediction of ACS patients is essential for developing targeted treatment strategies. Existing traditional models offer moderate discriminative value, and do not incorporate contemporary predictors of ACS prognosis. Machine learning (ML) models have emerged as an alternate method that may offer improved risk assessment. This study aims to compare machine learning models with traditional risk scores for predicting all-cause mortality in patients with ACS. Methods: PubMed, EMBASE, Web of Science and Cochrane databases were searched until 1 st November 2023 for studies comparing ML models with traditional statistical methods for event prediction of ACS patients. The primary outcome was comparative discrimination measured by C-statistics with 95% confidence intervals between ML models and traditional methods in estimating the risk of all-cause mortality. Results: Ten studies were included (239627 patients). The summary C-statistic of all ML models across all endpoints was 0.89 (95% CI, 0.86-0.92), compared to traditional methods 0.82 (95% CI, 0.79-0.85). The difference in C-statistic between all ML models and traditional methods was 0.07 (p<0.05). Three models undertook external validation, and calibration was inconsistently reported. Conclusion: ML models demonstrated superior discrimination of all-cause mortality for ACS patients compared to traditional risk scores. Despite outperforming well-established prognostic tools such as the GRACE and TIMI scores, current clinical applications of ML approaches remain uncertain, particularly in view of the methodological limitations of existing studies and the need for greater model validation.

Enhancing High-Availability Database Systems: An AI-Driven Approach to Anomaly Detection

High-availability database systems are critical components in modern IT infrastructure, demanding robust mechanisms for ensuring continuous operation and data integrity. This article explores integrating artificial intelligence (AI) techniques into anomaly detection processes for such systems, addressing the limitations of traditional rule-based and statistical methods. We present a comprehensive analysis of machine learning and deep learning approaches, including supervised and unsupervised learning models, autoencoders, recurrent neural networks, and hybrid solutions that combine AI with conventional techniques. The article examines the challenges of implementing AI-powered anomaly detection in high-availability environments, such as scalability, real-time processing, and the balance between sensitivity and specificity. Through case studies in the financial and e-commerce sectors, we demonstrate these advanced detection methods' practical applications and benefits. Our findings indicate that AI-driven approaches significantly enhance the accuracy and efficiency of anomaly detection, leading to improved system reliability and performance. The article concludes by discussing emerging trends, including edge computing and explainable AI, and their potential impact on the future of database management and anomaly detection.

A novel operational reliability and state prediction method based on degradation hidden Markov model with random threshold

AbstractBearings are widely used as a common mechanical component and significantly impacts the reliability and safety of various engineering equipment. In the field of large‐scale equipment such as wind turbines, statistical data for reliability and state prediction of bearings is usually limited, leading to the inapplicability of traditional statistical methods. Besides, individual differences commonly exist among bearings, and the appropriate failure threshold for a specific bearing is difficult to be determined due to the individual uncertainty, which may induce prediction errors. To address these issues, a novel operational reliability and state prediction method based on random threshold degradation hidden Markov model was proposed in the study. The traditional hidden Markov model was improved by considering the effect of performance degradation on state transition probability matrix. Moreover, random failure thresholds of performance degradation were employed to describe individual differences between bearings. The operational reliability and state of bearings was obtained by comprehensive analysis of prediction results under different failure thresholds. Verification of the proposed operational reliability and state prediction method were conducted using PHM2012 bearing operation data. The results underscored the effectiveness of the proposed method in achieving a comparatively high accuracy in operational reliability prediction without the prerequisite of an exact failure threshold, when contrasted with several established reliability and life prediction techniques.

Boosting Financial Market Prediction Accuracy With Deep Learning and Big Data

The accuracy of financial market trend prediction directly impacts investors' decisions and financial institutions' risk management, making it a focal point of research in the financial domain. While traditional statistical methods lay the foundation for market forecasting, they still face limitations in handling complex, nonlinear, and non-stationary financial time series data with accuracy and adaptability. Time series analysis plays a pivotal role in financial market prediction, revealing historical patterns and future trends within the data. Addressing the limitations of existing methods, this study proposes a deep learning-based CEEMDAN-CNN-LSTM model. Leveraging the CEEMDAN decomposition method to capture the multi-frequency components of time series, CNN extracts spatial features, and LSTM learns temporal dependencies. Experimental results demonstrate that the performance of the CEEMDAN-CNN-LSTM model surpasses traditional models on standardized evaluation metrics such as RMSE, MAE, and MAPE across four major financial datasets.

Grey Relation System Applications in Multi-Attribute Decision-Making and Forecasting in Financial Management

Objective: The objective of the paper is to verify the Grey relation analysis methods and compare them with known models in financial management. The first part is devoted to MADM (multi-attribute decision methods) and the second one to grey forecasting methods. Method: Localization GRA and globalization GRA multi-criteria models are described and compared with the TOPSIS method. The forecasting GRA(1,1) model based on cumulative data is described, derived and compared with the linear growth model. The models are verified on the data set. Results and Discussion: The globalisation model based on a pair-wise comparison of alternatives is different, and the ranking of alternatives is fully different in comparison with the TOPSIS model. It was found that the localisation GRA model and TOPSIS, both constructed on similarity measures, present similar and comparable results. So, the grey relation approach considers the uncertainty of input data. The forecasting model GRA(1,1) is computed and compared with the growth model. Results show that the growth model is the trendy model, and the non-trendy series is overestimated or underestimated, so the GRA model looks more robust. Research Implications: The problem of imprecise data is investigated. And it is a realistic condition for practical decision-making. The problem of lack of data is often a phenomenon in decision-making. Traditional statistical methods cannot be applied. Therefore, grey relation methodology is one approach to overcoming the problem of imprecise data and lack of data. Uncertainty and lack of data problems are topics important for research and the managerial community. Originality/Value: Sometimes, in financial decision-making, high-quality data or long-term time series is not at our disposal, and on the other hand, decisions have to be made. This problem is often neglected and solved by not-relevant traditional statistical models. Therefore, methods that allow the solving of such problems are useful. It was shown that a grey relation methodology for multicriteria financial performance evaluation and forecasting shows more robust and stable results and could be more relevant for imprecise data or short time series data in financial decision-making problems.

The Future of Artificial Intelligence and Genetic Insights in Precision Cardiovascular Medicine: A Comprehensive Review

Abstract A medical condition called cardiovascular disease (CVD) affects the heart or blood vessels, and about 40% of its causes can be attributed to genetic factors. The pathophysiology of CVD is still unknown despite numerous studies identifying important environmental and genetic factors. Genetic data research has significantly increased due to the application of genome-wide association studies. The utilization of artificial intelligence (AI) technology demonstrates clear advantages in managing intricate projects, outperforming traditional statistical methods in processing such data. The use of AI in the status of genetic research on CVD and medicine is briefly reviewed in the opening section of this article. Then, it gives a complete picture of how AI is used in genetic CVD research, including genetic data-driven diagnosis and prognosis, genetic variation analysis, gene expression profiles, gene interactions, and analysis of genes using knowledge bases. Even though much research has yielded significant findings, it is still early. The main disadvantages are database limitations, the underuse of AI in systematic biology analysis, and the lack of a theoretical framework for interpreting analysis results. The paper concludes with future directions and the significance of creating comprehensive, high-quality, large-sample-size data-sharing resources. Much research is going into how to use AI analysis techniques to help with development. Being creative with computers can help make new CVD intervention protocols and develop and test theoretical models.

A review of multimodal deep learning methods for genomic-enabled prediction in plant breeding.

Deep learning methods have been applied when working to enhance the prediction accuracy of traditional statistical methods in the field of plant breeding. Although deep learning seems to be a promising approach for genomic prediction, it has proven to have some limitations, since its conventional methods fail to leverage all available information. Multimodal deep learning methods aim to improve the predictive power of their unimodal counterparts by introducing several modalities (sources) of input information. In this review, we introduce some theoretical basic concepts of multimodal deep learning and provide a list of the most widely used neural network architectures in deep learning, as well as the available strategies to fuse data from different modalities. We mention some of the available computational resources for the practical implementation of multimodal deep learning problems. We finally performed a review of applications of multimodal deep learning to genomic selection in plant breeding and other related fields. We present a meta-picture of the practical performance of multimodal deep learning methods to highlight how these tools can help address complex problems in the field of plant breeding. We discussed some relevant considerations that researchers should keep in mind when applying multimodal deep learning methods. Multimodal deep learning holds significant potential for various fields, including genomic selection. While multimodal deep learning displays enhanced prediction capabilities over unimodal deep learning and other machine learning methods, it demands more computational resources. Multimodal deep learning effectively captures intermodal interactions, especially when integrating data from different sources. To apply multimodal deep learning in genomic selection, suitable architectures and fusion strategies must be chosen. It is relevant to keep in mind that multimodal deep learning, like unimodal deep learning, is a powerful tool but should be carefully applied. Given its predictive edge over traditional methods, multimodal deep learning is valuable in addressing challenges in plant breeding and food security amid a growing global population.

Donor age and ischemic time in heart transplantation –implications for organ preservation

IntroductionThe Organ Care System and Non-ischemic Heart Preservation methods have emerged as significant advancements in heart transplantation, designed to mitigate ischemic injury and extend preservation times. However, their high costs and logistical complexities necessitate strategic utilization. MethodsWe evaluated data from 83,761 heart transplants registered in the International Society for Heart and Lung Transplantation registry from 1988 to 2018. Utilizing a Cox proportional hazards model, we explored the influence of donor age and ischemic time on transplant survival. A key innovation of our study is the development of a nomogram to predict post-transplant survival, incorporating both traditional and advanced statistical methods. ResultsThe median age of recipients was 52 years (22% female) and 33 years (31% female) for donors. Analysis revealed a median ischemic time of 3 hours and median survival of 11.5 years across the cohort. The nomogram showed a decline in survival probabilities with increasing donor age, notably from age 40 and more significantly with ischemic times >4 hours. Ischemic times ≥4 hours versus <2 hours were associated with hazard ratio (HR) of 1.2 (95% CI, 1.1-1.3) for donors aged 40-59, a disparity that escalated for donors aged ≥60 (HR: 2.0; 95% CI, 1.5-2.7). ConclusionThis study highlights the importance of careful donor selection and indicates that certain groups, particularly older donors with prolonged ischemic times, might benefit from ex-vivo preservation techniques. The developed nomogram offers a practical tool for clinicians, enhancing decision-making by providing detailed insights into the relationship between donor age, ischemic time, and post-transplant mortality.

An enhanced machine learning algorithm for type 2 diabetes prognosis with a detailed examination of Key correlates

This study aimed to construct a high-performance prediction and diagnosis model for type 2 diabetic retinopathy (DR) and identify key correlates of DR. This study utilized a cross-sectional dataset of 3,000 patients from the People’s Liberation Army General Hospital in 2021. Logistic regression was used as the baseline model to compare the prediction performance of the machine learning model and the related factors. The recursive feature elimination cross-validation (RFECV) algorithm was used to select features. Four machine learning models, support vector machine (SVM), decision tree (DT), random forest (RF), and gradient boost decision tree (GBDT), were developed to predict DR. The models were optimized using grid search to determine hyperparameters, and the model with superior performance was selected. Shapley-additive explanations (SHAP) were used to analyze the important correlation factors of DR. Among the four machine learning models, the optimal model was GBDT, with predicted accuracy, precision, recall, F1-measure, and AUC values of 0.7883, 0.8299, 0.7539, 0.7901, and 0.8672, respectively. Six key correlates of DR were identified, including rapid micronutrient protein/creatinine measurement, 24-h micronutrient protein, fasting C-peptide, glycosylated hemoglobin, blood urea, and creatinine. The logistic model had 27 risk factors, with an AUC value of 0.8341. A superior prediction model was constructed that identified easily explainable key factors. The number of correlation factors was significantly lower compared to traditional statistical methods, leading to a more accurate prediction performance than the latter.

Modelling behavior of Crested gecko (Correlophus ciliatus) using classification algorithms

Animal behavior plays a crucial role in evolution of many species. Many studies focused on animal behavior enhance the ability to collect large and detailed data. However, this kind of data is surpassing the capability of traditional statistical methods for analysis. In this study we propose to use artificial intelligence (AI) with machine learning models (ML) as tools to study animal behavior and potentially assumed evolution patterns in their behavior. For the Crested gecko (Correlophus ciliatus), some guidelines have been published regarding the breeding of these reptiles, focusing on their behavior. However, little is known about moderating their behavior using AI and advanced ML algorithms. In this study, based on information collected from twenty individuals, we proposed building a supervised classifier model using simple Decision Tree classifier (DT), Gradient Boosting classifier (GB) and Extreme Gradient Boosting classifier (XGBoost). Our results show that the highest accuracy (above 60 %) was achieved for variables which were not complex in terms of animal behavior. The analysis presented in this study, demonstrates that it is possible to model Crested Gecko behavior using ML models.

A Multi-Spatial Scale Ocean Sound Speed Prediction Method Based on Deep Learning

As sound speed is a fundamental parameter of ocean acoustic characteristics, its prediction is a central focus of underwater acoustics research. Traditional numerical and statistical forecasting methods often exhibit suboptimal performance under complex conditions, whereas deep learning approaches demonstrate promising results. However, these methodologies fall short in adequately addressing multi-spatial coupling effects and spatiotemporal weighting, particularly in scenarios characterized by limited data availability. To investigate the interactions across multiple spatial scales and to achieve accurate predictions, we propose the STA-ConvLSTM framework that integrates spatiotemporal attention mechanisms with convolutional long short-term memory neural networks (ConvLSTM). The core concept involves accounting for the coupling effects among various spatial scales while extracting temporal and spatial information from the data and assigning appropriate weights to different spatiotemporal entities. Furthermore, we introduce an interpolation method for ocean temperature and salinity data based on the KNN algorithm to enhance dataset resolution. Experimental results indicate that STA-ConvLSTM provides precise predictions of sound speed. Specifically, relative to the measured data, it achieved a root mean square error (RMSE) of approximately 0.57 m/s and a mean absolute error (MAE) of about 0.29 m/s. Additionally, when compared to single-dimensional spatial analysis, incorporating multi-spatial scale considerations yielded superior predictive performance.

A SYSTEMATIC LITERATURE REVIEW OF PREDICTIVE MODELS AND ANALYTICS IN AI-DRIVEN CREDIT SCORING

This systematic review examines the transformative role of AI-driven models in credit scoring, highlighting their advances over traditional statistical methods in terms of predictive accuracy, adaptability, and inclusivity. By synthesizing findings from 70 studies, this review demonstrates that machine learning techniques, particularly ensemble models such as random forests and gradient boosting, effectively capture complex, non-linear relationships in borrower data, providing more accurate risk assessments across diverse demographics. Deep learning models, especially convolutional and recurrent neural networks, extend credit scoring capabilities to unstructured and alternative data sources, supporting financial inclusion by enabling assessments of individuals without traditional credit histories. Hybrid models that integrate logistic regression with neural networks offer an optimal balance between interpretability and predictive power, addressing regulatory demands for transparency while maintaining robust accuracy. Ensemble techniques like stacking and blending enhance model adaptability, allowing credit scoring systems to integrate multiple perspectives and improve prediction accuracy in varied borrower contexts. Despite these advancements, challenges remain in the form of ethical concerns and the need for model interpretability, particularly with complex deep-learning architectures. The review underscores the importance of developing fairness-aware and explainable AI frameworks to ensure that as AI-driven credit scoring evolves, it remains both transparent and equitable. These insights suggest that with careful attention to ethics and transparency, AI has the potential to create a more inclusive and resilient credit scoring landscape, accommodating the needs of an increasingly diverse global population.

Bayesian modeling for analyzing heterogeneous response in preclinical mouse tumor models.

In anticancer research, tumor growth measured in mouse models is important for assessing treatment efficacy for a treatment to progress to human clinical trials. Statistical analysis of time-to-event tumor volume data is complex because of heterogeneity in response and welfare-related data loss. Traditional statistical methods of testing the mean difference between groups are not robust because they assume common responses across a population. Heterogeneity in response is also seen in the clinic, and consequently, the assessment of the treatment considers the diversity through classification of the individual's response using the RECIST (Response Evaluation Criteria in Solid Tumors). To provide a comparable and translatable assessment of in vivo tumor response, we developed a statistical method called INSPECT (IN vivo reSPonsE Classification of Tumors) for analyzing heterogeneous responses through Bayesian modeling. This method can classify individual tumor behaviors into the categories of nonresponder, modest responder, stable responder, and regressing responder. Using both published and simulated data, we show that INSPECT methodology is more accurate and sensitive than existing methods with respect to balancing false-negative and false-positive rates. A case study demonstrates the value of INSPECT in drug projects for supporting the translation of drug efficacy from the preclinical phase into clinical trials. We also provide a package, "INSPECTumours," that launches a web interface to enable users to conduct the analysis and generate reports.

Simulation of topological data using a stochastic model applied to protein engineering

Topological data analysis (TDA) is a powerful tool used to extract meaningful properties from the topological structure of data, enabling the discovery of complex relationships and patterns within datasets. It provides a unique perspective by focusing on the shape and structure of data rather than traditional statistical methods. In our research, we aim to explore the impact of stochastic processes on TDA. Specifically, we investigate how introducing stochastic calculations can enhance the analysis of topological features, offering a more nuanced understanding of the data. Stochastic processes account for randomness and variability, which are inherent in many real-world datasets. By integrating these processes into TDA, we can uncover more precise relationships between data points and obtain deeper insights into the underlying topological structures. Our work highlights the advantages of this approach, particularly in improving the robustness and accuracy of TDA in the presence of noise and variability. The results of this research have the potential to broaden the applicability of TDA in fields such as biology, neuroscience, and machine learning, where complex data structures are common, and stochastic behavior often plays a critical role in shaping the data’s characteristics.

Dissolved Oxygen Concentration Prediction in the Pearl River Estuary with Deep Learning for Driving Factors Identification: Temperature, pH, Conductivity, and Ammonia Nitrogen

Predicting the dissolved oxygen concentration and identifying its driving factors are essential for improved prevention and management of anoxia in estuaries. However, complex hydrodynamic conditions and the limitations in traditional methods result in challenges in the identification of the driving factors for the low dissolved oxygen (DO) phenomenon. The objective of our study is to develop a robust deep learning model using four-year in situ data collected from an automatic water quality monitoring station (AWQMS) in an estuary, for accurate identification and quantification of the driving factors influencing DO levels. Mitigations in hypoxia were observed during the initial two years, but a subsequent decline in DO concentrations was witnessed recently. The periodicity of DO concentrations in the Pearl River Estuary reduced with the increase in the hypoxic intensity. Maximal information coefficient (MIC) and extreme gradient boosting (XGBoost) were employed to determine the significance of input variables, which were subsequently validated by using the long- and short-term memory networks (LSTMs). The driving factors contributing to the hypoxia problem were shown as temperature, pH, conductivity, and NH4+-N concentrations. Notably, the evaluation index values of the hybrid model are MAPE = 0.0887 and R2 = 0.9208, which have been improved compared with the LSTM model by about 99.34% in MAPE reduction and 16.56% in R2 improvement, indicating that the MixUp-LSTM model was capable of effectively capturing nonlinear relationships between DO and other water quality indicators. Based on existing literature, three traditional statistical methods and four machine learning models were also performed to compare with the proposed MixUp-LSTM model, which outperformed other models in terms of prediction accuracy and robustness. Overall, the successful identification of the driving factors for the deoxygenation phenomenon would have important implications for the governance and regulation of low DO in estuaries.

A machine learning framework to adjust for learning effects in medical device safety evaluation.

Traditional methods for medical device post-market surveillance often fail to accurately account for operator learning effects, leading to biased assessments of device safety. These methods struggle with non-linearity, complex learning curves, and time-varying covariates, such as physician experience. To address these limitations, we sought to develop a machine learning (ML) framework to detect and adjust for operator learning effects. A gradient-boosted decision tree ML method was used to analyze synthetic datasets that replicate the complexity of clinical scenarios involving high-risk medical devices. We designed this process to detect learning effects using a risk-adjusted cumulative sum method, quantify the excess adverse event rate attributable to operator inexperience, and adjust for these alongside patient factors in evaluating device safety signals. To maintain integrity, we employed blinding between data generation and analysis teams. Synthetic data used underlying distributions and patient feature correlations based on clinical data from the Department of Veterans Affairs between 2005 and 2012. We generated 2494 synthetic datasets with widely varying characteristics including number of patient features, operators and institutions, and the operator learning form. Each dataset contained a hypothetical study device, Device B, and a reference device, Device A. We evaluated accuracy in identifying learning effects and identifying and estimating the strength of the device safety signal. Our approach also evaluated different clinically relevant thresholds for safety signal detection. Our framework accurately identified the presence or absence of learning effects in 93.6% of datasets and correctly determined device safety signals in 93.4% of cases. The estimated device odds ratios' 95% confidence intervals were accurately aligned with the specified ratios in 94.7% of datasets. In contrast, a comparative model excluding operator learning effects significantly underperformed in detecting device signals and in accuracy. Notably, our framework achieved 100% specificity for clinically relevant safety signal thresholds, although sensitivity varied with the threshold applied. A machine learning framework, tailored for the complexities of post-market device evaluation, may provide superior performance compared to standard parametric techniques when operator learning is present. Demonstrating the capacity of ML to overcome complex evaluative challenges, our framework addresses the limitations of traditional statistical methods in current post-market surveillance processes. By offering a reliable means to detect and adjust for learning effects, it may significantly improve medical device safety evaluation.