Validation Of Risk Prediction Model Research Articles

Clinical validated risk prediction model for development of heart failure after contemporary breast cancer treatment

Abstract Background Patients receiving breast cancer (BC) treatment are at risk for heart failure and cardiomyopathy (HF/CM). European Society of Cardiology (ESC) cardio-oncology guidelines recommend baseline cardiovascular (CV) assessment, however, there is limited data about cardiotoxicity risk specific to patients with BC. Our aim was to develop and validate model for prediction of HF/CM in women receiving contemporary treatment for invasive early-stage BC. Methods We assembled a cohort women diagnosed with Stage I-III BC from 2008-2020 and followed through 2021 in a large health care plan. Women age >80, with history of HF/CM, and women who received both anthracyclines and trastuzumab were excluded, leaving N=26,044 for analysis. Study cohort was randomly split into derivation (60%) and validation (40%) datasets. Elastic-net penalized Cox proportional hazard model was created using the derivation dataset to select risk factors and to calculate the panelized coefficient which defined the HF/CM risk score. Risk score system was assessed by Hosmer-Lemeshow goodness-of-fit test and area under the ROC curve (AUC). Event rates of <5% constituted low risk; 5-14% moderate; and >15% high risk category. Incident HF/CM events were examined using Kaplan-Meier approach in derivation and validation datasets. Results HF/CM risk score had high discrimination ability and sufficiently good model of fit regarding HF/CM events (P value=0.163 and 0.667 from Hosmer–Lemeshow test;AUC 0.751 and 0.764, in derivation and validation sets, respectively). There were 10% of women in the high risk; 30% in moderate; and 60% in low-risk group. Variables associated with the higher HF/CM risk score included age, receipt of anthracycline-based chemotherapy or anti-HER2 therapy, presence of hypertension, diabetes, or history of other CV conditions at baseline. The score pattern showed major effect of age, with anthracycline and anti-HER2 therapy increasing the risk across all age groups (Figure 1). Kaplan-Meier analysis of incident HF/CM over 14 years after BC diagnosis showed significantly lower number of HF/CM events in low risk compared to moderate and high-risk score groups (p<0.0001, Figure 2). Conclusion Our robust risk prediction model for HF/CM among women with early-stage BC provides a new tool to identify women at higher CV risk and inform cardiac function monitoring during and after BC treatment. Our findings may guide further validation studies and build evidence for the cardiotoxicity risk stratification in patients with BC.Risk Score for HF/CM by Age/ChemoTxK-M curves of freedom from HF/CM

Predicting Admission to Neonatal Care Unit at Mid-Pregnancy and Delivery Using Data from a General Obstetric Population.

Development and validation of risk prediction models at mid-pregnancy and delivery to predict admission to the neonatal care unit. We used data from all singleton deliveries at Cork University Maternity Hospital (CUMH), Ireland during 2019. Admission to the neonatal care unit was assumed if length of stay in the unit was > 24h. Multivariable logistic regression with backward stepwise selection was used to develop the models. Discrimination was assessed using the ROC curve C-statistic, and internal validation was assessed using bootstrapping techniques. We conducted temporal external validation using data from all singleton deliveries at CUMH during 2020. Out of 6,077 women, 5,809 (95.6%) with complete data were included in the analyses. A total of 612 infants (10.54%) were admitted to the neonatal care unit for > 24 hours. Six variables were informative at mid-pregnancy: male infants, maternal smoking, advancing maternal age, maternal overweight/obesity, nulliparity and history of gestational diabetes (C-statistic: 0.600, 95% CI: 0.567, 0.614). Seven variables were informative at delivery: male infants, nulliparity, public antenatal care, gestational age < 39 weeks', non-spontaneous vaginal delivery, premature rupture of membranes and time of birth between 17:01-07.59h (C-statistic: 0.738, 95% CI: 0.715, 0.760). Using these predictors, we developed nomograms to calculate individualised risk of neonatal care unit admission. Bootstrapping indicated good internal performance and external validation suggested good reproducibility. Our nomograms allow the user to quickly estimate individualised risk of neonatal care unit admission. Future research should aim to improve accuracy in early pregnancy to better assist counselling of parents.

WP7.17 - Routine Use of Validated Risk Prediction Model in the Management of Acute Appendicitis in a District General Hospital

Abstract Aim Acute appendicitis is the most common general surgery emergency in the UK. Currently, there is no optimal diagnostic pathway for managing the right iliac fossa (RIF) pain. The right iliac fossa pain treatment (RIFT) study group has previously performed an analysis of different risk prediction models to search for the most specific one and made a website (appy-risk.org) to calculate risk scores on presentation. We aimed to look into our practice in a DGH and see how compliant we are in documenting risk scores on presentation with acute RIF pain. Method A list of patients presenting with acute RIF pain to the surgical assessment unit in September was prepared. Admission clerking notes were reviewed from the electronic patient record to look for the documentation of the appendicitis risk score. Standard statistical packages were used for data analysis. Results A total of 95 patients were presented with RIF pain. Of them, 17 were excluded from the analysis for being over 45 years old. Of the remaining 78 patients' records, only 7 (8.97%) had appendicitis risk scores documented in the clerking notes. Conclusions The RIFT study highlighted a high normal appendicectomy rate (NAR) in the UK in comparison to other European countries. In our hospital, NAR was 9.74% in the first six months of 2023. We are in the process of implementing a pathway to manage acute RIF pain using a risk prediction model as advised by the RIFT group to reduce our NAR to less than 5%.

Development and validation of a risk prediction model for short-term progression of carotid atherosclerosis among early middle age adults

AimWe aimed at creating and validating a prognostic model incorporating easily accessible clinical and laboratory parameters to forecast the likelihood of short-term progression of carotid atherosclerosis. MethodsA prediction model was developed and validated for carotid plaque progression within 2 years in an early middle-age population in China. Progression was defined as the new appearance of carotid plaque or stenosis among participants who had normal carotid status at baseline. Leveraging data from a health check-up chain, predictors were identified using statistical methods including stepwise logistic regression, Markov Chain Monte Carlo (MCMC) simulation, random forest analysis and least absolute shrinkage selection operator (Lasso). Model performance was assessed. Bootstrap internal validation, validation on another check-up population and subgroup analysis were also conducted. ResultsAmong 7765 participants, predictors including age, diastolic blood pressure, uric acid levels, high-density lipoprotein cholesterol (HDL-C), and low-density lipoprotein cholesterol (LDL-C) were identified for carotid plaque progression in 2 years. The developed prediction model demonstrated good discrimination (AUC = 0.755, 95%CI:0.736–0.774) and calibration ability (slope = 0.922 and interception = 0.007) among development data, as well as among validation data (AUC = 0.759, 95%CI:0.674–0.770; slope = 1.076 and intercept = −0.014). Internal validation using bootstrap method yielded an adjusted AUC of 0.753. The model's performance remained consistent across different subgroups. ConclusionsOur study presents a validated risk prediction model for carotid plaque progression in an early middle age population, offering a valuable tool for early identification and monitoring of cardiovascular risks. The model's robustness and applicability across different subgroups highlight its potential utility in preemptive cerebrovascular and cardiovascular disease management.

Establishment and Validation of Risk Prediction Models for Postoperative Pain After Endoscopic Submucosal Dissection: A Retrospective Clinical Study.

Postoperative pain is a common complication in endoscopic submucosal dissection (ESD) patients. This study aimed to develop and validate predictive models for postoperative pain associated ESD. We retrospectively constructed a development cohort comprising 2162 patients who underwent ESD at our hospital between January 2015 and April 2022. The dataset was randomly divided into a training set (n = 1541) and a validation set (n = 621) in a 7:3 ratio. The bidirectional stepwise regression with Akaike's information criterion (AIC) and multivariate logistic regression analysis were used to screen the predictors of post-ESD pain and construct three nomograms. We evaluated the model's discrimination, precision and clinical benefit through receiver operating characteristic (ROC) curves, calibration plots, Hosmer-Lemeshow (HL) goodness-of-fit test and decision curve analysis (DCA) in internal validation. The proportion of patients developing postoperative pain in the training and testing data set was 25.6% and 28.5%, respectively. Three nomograms were constructed according to the final logistic regression models. The clinical prediction models for preoperative risks, preoperative and intraoperative risks, and perioperative risks consisted of seven, nine and six independent predictors, respectively, after bidirectional stepwise elimination. The models demonstrated the AUC of 0.794 (95% CI 0.768-0.820), 0.823 (95% CI 0.799-0.847) and 0.817 (95% CI 0.792-0.842) in the training cohort and 0.702 (95% CI 0.655-0.748), 0.705 (95% CI 0.659-0.752) and 0.747 (95% CI 0.703-0.790) in the validation cohort. The calibration plot, HL and DCA demonstrated the model's favorable clinical applicability. We developed and validated three robust nomogram models, which might identify patients at risk of post-ESD pain and promising for clinical applications.

Symptom-triggered testing detects early stage and low volume resectable advanced stage ovarian cancer

ObjectiveSymptom-triggered testing for ovarian cancer was introduced to the UK whereby symptomatic women undergo an ultrasound scan and serum CA125, and are referred to hospital within 2 weeks if these...

Development and validation of risk prediction model for post-donation renal function in living kidney donors

This study aimed to create and validate a predictive model for renal function following live kidney donation, using pre-donation factors. Accurately predicting remaining renal function post live kidney donation is currently insufficient, necessitating an effective assessment tool. A multicenter retrospective study of 2318 live kidney donors from two independent centers (May 2007–December 2019) was conducted. The primary endpoint was the reduction in eGFR to below 60 mL/min/m2 6 months post-donation. The primary endpoint was achieved in 14.4% of the training cohort and 25.8% of the validation cohort. Sex, age, BMI, hypertension, preoperative eGFR, and remnant kidney proportion (RKP) measured by computerized tomography (CT) volumetry were found significant in the univariable analysis. These variables informed a scoring system based on multivariable analysis: sex (male: 1, female: 0), age at operation (< 30: 0, 30–39: 1, 40–59: 2, ≥ 60: 3), preoperative eGFR (≥ 100: 0, 90–99: 2, 80–89: 4, < 80: 5), and RKP (≥ 52%: 0, < 52%: 1). The total score ranged from 0 to 10. The model showed good discrimination for the primary endpoint in both cohorts. The prediction model provides a useful tool for estimating post-donation renal dysfunction risk, factoring in the side of the donated kidney. It offers potential enhancement to pre-donation evaluations.

International External Validation of Risk Prediction Model of 90-Day Mortality after Gastrectomy for Cancer Using Machine Learning.

Radical gastrectomy remains the main treatment for gastric cancer, despite its high mortality. A clinical predictive model of 90-day mortality (90DM) risk after gastric cancer surgery based on the Spanish EURECCA registry database was developed using a matching learning algorithm. We performed an external validation of this model based on data from an international multicenter cohort of patients. A cohort of patients from the European GASTRODATA database was selected. Demographic, clinical, and treatment variables in the original and validation cohorts were compared. The performance of the model was evaluated using the area under the curve (AUC) for a random forest model. The validation cohort included 2546 patients from 24 European hospitals. The advanced clinical T- and N-category, neoadjuvant therapy, open procedures, total gastrectomy rates, and mean volume of the centers were significantly higher in the validation cohort. The 90DM rate was also higher in the validation cohort (5.6%) vs. the original cohort (3.7%). The AUC in the validation model was 0.716. The externally validated model for predicting the 90DM risk in gastric cancer patients undergoing gastrectomy with curative intent continues to be as useful as the original model in clinical practice.

Analysis of risk factors and construction of a prediction model for posttraumatic stress disorder among Chinese college students during the COVID-19 pandemic

BackgroundTo explore the risk factors of post-traumatic stress disorder (PTSD) among Chinese college students during the COVID-19 pandemic and the construction and validation of risk prediction models. MethodsA total of 10,705 university students were selected for the study. The questionnaire included the Generalized Anxiety Disorder 7 (GAD-7), Patient Health Questionnaire 9 (PHQ-9), PTSD Checklist for DSM-5 (PCL-5), and self-designed questionnaire. These assessments were conducted to facilitate the survey, construct the predictive model and validate the model's validity. ResultsSex, left-behind experience, poverty status, anxiety score, and depression score were identified as independent risk factors influencing psychological trauma among Chinese college students during the COVID-19 pandemic, while COVID-19 infection emerged as a protective factor against psychological trauma. A column chart was constructed to visualize the six independent risk factors derived from logistic regression analysis. The Hosmer–Lemeshow test results (χ2 = 13.021, P = 0.111) indicated that the risk prediction model fitted well. The receiver operating characteristic (ROC) curve showed an area under the curve (AUC) of 0.864 in the model group and 0.855 in the validation group. The calibration curves of the model closely resembled the ideal curve. Decision curve analysis (DCA) revealed that the model provided net benefit and demonstrated good clinical utility. LimitationsThe validation of the model is currently restricted to internal assessments. However, further confirmation through larger sample sizes, multicenter investigations, and prospective studies is necessary. ConclusionsThe model effectively predicted PTSD risk among Chinese college students during the COVID-19 pandemic, indicating strong clinical applicability.

Risk of emergency hospital admission related to adverse events after antibiotic treatment in adults with a common infection: impact of COVID-19 and derivation and validation of risk prediction models

BackgroundWith the global challenge of antimicrobial resistance intensified during the COVID-19 pandemic, evaluating adverse events (AEs) post-antibiotic treatment for common infections is crucial. This study aims to examines the changes in incidence rates of AEs during the COVID-19 pandemic and predict AE risk following antibiotic prescriptions for common infections, considering their previous antibiotic exposure and other long-term clinical conditions.MethodsWith the approval of NHS England, we used OpenSAFELY platform and analysed electronic health records from patients aged 18–110, prescribed antibiotics for urinary tract infection (UTI), lower respiratory tract infections (LRTI), upper respiratory tract infections (URTI), sinusitis, otitis externa, and otitis media between January 2019 and June 2023. We evaluated the temporal trends in the incidence rate of AEs for each infection, analysing monthly changes over time. The survival probability of emergency AE hospitalisation was estimated in each COVID-19 period (period 1: 1 January 2019 to 25 March 2020, period 2: 26 March 2020 to 8 March 2021, period 3: 9 March 2021 to 30 June 2023) using the Kaplan–Meier approach. Prognostic models, using Cox proportional hazards regression, were developed and validated to predict AE risk within 30 days post-prescription using the records in Period 1.ResultsOut of 9.4 million patients who received antibiotics, 0.6% of UTI, 0.3% of URTI, and 0.5% of LRTI patients experienced AEs. UTI and LRTI patients demonstrated a higher risk of AEs, with a noted increase in AE incidence during the COVID-19 pandemic. Higher comorbidity and recent antibiotic use emerged as significant AE predictors. The developed models exhibited good calibration and discrimination, especially for UTIs and LRTIs, with a C-statistic above 0.70.ConclusionsThe study reveals a variable incidence of AEs post-antibiotic treatment for common infections, with UTI and LRTI patients facing higher risks. AE risks varied between infections and COVID-19 periods. These findings underscore the necessity for cautious antibiotic prescribing and call for further exploration into the intricate dynamics between antibiotic use, AEs, and the pandemic.

849 Routine Use of Validated Risk Prediction Model in the Management of Acute Appendicitis in a District General Hospital

849 Routine Use of Validated Risk Prediction Model in the Management of Acute Appendicitis in a District General Hospital

Construction and validation of risk prediction models for pulmonary embolism in hospitalized patients based on different machine learning methods.

This study aims to apply different machine learning (ML) methods to construct risk prediction models for pulmonary embolism (PE) in hospitalized patients, and to evaluate and compare the predictive efficacy and clinical benefit of each model. We conducted a retrospective study involving 332 participants (172 PE positive cases and 160 PE negative cases) recruited from Guangdong Medical University. Participants were randomly divided into a training group (70%) and a validation group (30%). Baseline data were analyzed using univariate analysis, and potential independent risk factors associated with PE were further identified through univariate and multivariate logistic regression analysis. Six ML models, namely Logistic Regression (LR), Decision Tree (DT), Random Forest (RF), Naive Bayes (NB), Support Vector Machine (SVM), and AdaBoost were developed. The predictive efficacy of each model was compared using the receiver operating characteristic (ROC) curve analysis and the area under the curve (AUC). Clinical benefit was assessed using decision curve analysis (DCA). Logistic regression analysis identified lower extremity deep venous thrombosis, elevated D-dimer, shortened activated partial prothrombin time, and increased red blood cell distribution width as potential independent risk factors for PE. Among the six ML models, the RF model achieved the highest AUC of 0.778. Additionally, DCA consistently indicated that the RF model offered the greatest clinical benefit. This study developed six ML models, with the RF model exhibiting the highest predictive efficacy and clinical benefit in the identification and prediction of PE occurrence in hospitalized patients.

External validation and comparison of magnetic resonance imaging-based risk prediction models for prostate biopsy stratification.

Magnetic resonance imaging (MRI) is a promising tool for risk assessment, potentially reducing the burden of unnecessary prostate biopsies. Risk prediction models that incorporate MRI data have gained attention, but their external validation and comparison are essential for guiding clinical practice. The aim is to externally validate and compare risk prediction models for the diagnosis of clinically significant prostate cancer (csPCa). A cohort of 4606 patients across fifteen European tertiary referral centers were identified from a prospective maintained database between January 2016 and April 2023. Transrectal or transperineal image-fusion MRI-targeted and systematic biopsies for PI-RADS score of ≥ 3 or ≥ 2 depending on patient characteristics and physician preferences. Probabilities for csPCa, defined as International Society of Urological Pathology (ISUP) grade ≥ 2, were calculated for each patients using eight models. Performance was characterized by area under the receiver operating characteristic curve (AUC), calibration, and net benefit. Subgroup analyses were performed across various clinically relevant subgroups. Overall, csPCa was detected in 2154 (47%) patients. The models exhibited satisfactory performance, demonstrating good discrimination (AUC ranging from 0.75 to 0.78, p < 0.001), adequate calibration, and high net benefit. The model described by Alberts showed the highest clinical utility for threshold probabilities between 10 and 20%. Subgroup analyses highlighted variations in models' performance, particularly when stratified according to PSA level, biopsy technique and PI-RADS version. We report a comprehensive external validation of risk prediction models for csPCa diagnosis in patients who underwent MRI-targeted and systematic biopsies. The model by Alberts demonstrated superior clinical utility and should be favored when determining the need for a prostate biopsy.

What's New in Dementia Risk Prediction Modelling? An Updated Systematic Review.

Identifying individuals at high risk of dementia is critical to optimized clinical care, formulating effective preventative strategies, and determining eligibility for clinical trials. Since our previous systematic reviews in 2010 and 2015, there has been a surge in dementia risk prediction modelling. The aim of this study was to update our previous reviews to explore, and critically review, new developments in dementia risk modelling. MEDLINE, Embase, Scopus, and Web of Science were searched from March 2014 to June 2022. Studies were included if they were population- or community-based cohorts (including electronic health record data), had developed a model for predicting late-life incident dementia, and included model performance indices such as discrimination, calibration, or external validation. In total, 9,209 articles were identified from the electronic search, of which 74 met the inclusion criteria. We found a substantial increase in the number of new models published from 2014 (>50 new models), including an increase in the number of models developed using machine learning. Over 450 unique predictor (component) variables have been tested. Nineteen studies (26%) undertook external validation of newly developed or existing models, with mixed results. For the first time, models have also been developed in low- and middle-income countries (LMICs) and others validated in racial and ethnic minority groups. The literature on dementia risk prediction modelling is rapidly evolving with new analytical developments and testing in LMICs. However, it is still challenging to make recommendations about which one model is the most suitable for routine use in a clinical setting. There is an urgent need to develop a suitable, robust, validated risk prediction model in the general population that can be widely implemented in clinical practice to improve dementia prevention.

#1584 Development and validation of risk prediction models according to different clinical settings of IgA nephropathy: nationwide multicenter cohort study

Abstract Background and Aims IgA nephropathy (IgAN) is the most common glomerulonephritis with a high risk of progression to end-stage renal disease (ESRD). Because machine learning models developed for research have limited use in clinical settings, this study developed and validated prediction models for IgAN according to different clinical settings. Method In this study, we analyzed data from 1,174 patients in the Japanese Nationwide Retrospective Cohort Study in IgAN, focusing on a 10-year observation period. We defined the derivation data from January 2002 to April 2004, and temporal validation data from May 2004 to December 2004. The composite renal outcome was defined as a 1.5-fold increase in creatinine or progression to ESRD. We developed and evaluated the three prediction models according to the different clinical settings: the primary care model for general physicians in primary care settings, the tertiary care model for specialists in tertiary care hospitals, and the research institute model, a machine learning-based approach for academic research institute settings. Results After excluding 82 patients for missing data, 114 and 14 patients experienced the composite renal outcome in the derivation (n = 874) and validation (n = 218) cohorts, respectively. The primary care model identified three variables—eGFR &amp;lt;45 mL/min/1.73 m², proteinuria ≥0.5 g/day, and non-use of corticosteroids—as significant predictors (C-statistic: 0.796; 95% CI: 0.686-0.895). The tertiary care model composed of three variables including glomerular number, histological severity and tubular/interstitial severity showed a slightly higher C-statistic (0.807; 95% CI: 0.713-0.886). When stratifying patients into risk groups, the primary care model showed a higher incidence of composite renal events in high-risk patients, and the tertiary care model effectively discriminated outcomes in all groups. The research institute model, which included 38 variables including proteinuria level, hypertension, eGFR, and non-use of corticosteroids as key predictors, showed comparable performance (C-statistic: 0.808; 95% CI: 0.689-0.886). Conclusion The primary care and tertiary care models provide simple yet effective predictive tools, competitive with the machine learning-based research institution model. These models are critical for predicting renal outcomes in patients with IgA nephropathy and for patient management according to different clinical settings.

Development and validation of risk prediction model for bacterial infections in acute liver failure patients.

Infections significantly increase mortality in acute liver failure (ALF) patients, and there are no risk prediction models for early diagnosis and treatment of infections in ALF patients. This study aims to develop a risk prediction model for bacterial infections in ALF patients to guide rational antibiotic therapy. The data of ALF patients admitted to the Second Hospital of Hebei Medical University in China from January 2017 to January 2022 were retrospectively analyzed for training and internal validation. Patients were selected according to the updated 2011 American Association for the Study of Liver Diseases position paper on ALF. Serological indicators and model scores were collected within 24 h of admission. New models were developed using the multivariate logistic regression analysis. An optimal model was selected by receiver operating characteristic (ROC) analysis, Hosmer-Lemeshow test, the calibration curve, the Brier score, the bootstrap resampling, and the decision curve analysis. A nomogram was plotted to visualize the results. A total of 125 ALF patients were evaluated and 79 were included in the training set. The neutrophil-to-lymphocyte ratio and sequential organ failure assessment (SOFA) were integrated into the new model as independent predictive factors. The new SOFA-based model outperformed other models with an area under the ROC curve of 0.799 [95% confidence interval (CI): 0.652-0.926], the superior calibration and predictive performance in internal validation. High-risk individuals with a nomogram score ≥26 are recommended for antibiotic therapy. The new SOFA-based model demonstrates high accuracy and clinical utility in guiding antibiotic therapy in ALF patients.

Development and validation of risk prediction model for recurrent cardiovascular events among Chinese: the Personalized CARdiovascular DIsease risk Assessment for Chinese model.

Cardiovascular disease (CVD) is a leading cause of mortality, especially in developing countries. This study aimed to develop and validate a CVD risk prediction model, Personalized CARdiovascular DIsease risk Assessment for Chinese (P-CARDIAC), for recurrent cardiovascular events using machine learning technique. Three cohorts of Chinese patients with established CVD were included if they had used any of the public healthcare services provided by the Hong Kong Hospital Authority (HA) since 2004 and categorized by their geographical locations. The 10-year CVD outcome was a composite of diagnostic or procedure codes with specific International Classification of Diseases, Ninth Revision, Clinical Modification. Multivariate imputation with chained equations and XGBoost were applied for the model development. The comparison with Thrombolysis in Myocardial Infarction Risk Score for Secondary Prevention (TRS-2°P) and Secondary Manifestations of ARTerial disease (SMART2) used the validation cohorts with 1000 bootstrap replicates. A total of 48 799, 119 672 and 140 533 patients were included in the derivation and validation cohorts, respectively. A list of 125 risk variables were used to make predictions on CVD risk, of which 8 classes of CVD-related drugs were considered interactive covariates. Model performance in the derivation cohort showed satisfying discrimination and calibration with a C statistic of 0.69. Internal validation showed good discrimination and calibration performance with C statistic over 0.6. The P-CARDIAC also showed better performance than TRS-2°P and SMART2. Compared with other risk scores, the P-CARDIAC enables to identify unique patterns of Chinese patients with established CVD. We anticipate that the P-CARDIAC can be applied in various settings to prevent recurrent CVD events, thus reducing the related healthcare burden.

Validating Risk Prediction Models for Multiple Primaries and Competing Cancer Outcomes in Families With Li-Fraumeni Syndrome Using Clinically Ascertained Data.

There exists a barrier between developing and disseminating risk prediction models in clinical settings. We hypothesize that this barrier may be lifted by demonstrating the utility of these models using incomplete data that are collected in real clinical sessions, as compared with the commonly used research cohorts that are meticulously collected. Genetic counselors (GCs) collect family history when patients (ie, probands) come to MD Anderson Cancer Center for risk assessment of Li-Fraumeni syndrome, a genetic disorder characterized by deleterious germline mutations in the TP53 gene. Our clinical counseling-based (CCB) cohort consists of 3,297 individuals across 124 families (522 cases of single primary cancer and 125 cases of multiple primary cancers). We applied our software suite LFSPRO to make risk predictions and assessed performance in discrimination using AUC and in calibration using observed/expected (O/E) ratio. For prediction of deleterious TP53 mutations, we achieved an AUC of 0.78 (95% CI, 0.71 to 0.85) and an O/E ratio of 1.66 (95% CI, 1.53 to 1.80). Using the LFSPRO.MPC model to predict the onset of the second cancer, we obtained an AUC of 0.70 (95% CI, 0.58 to 0.82). Using the LFSPRO.CS model to predict the onset of different cancer types as the first primary, we achieved AUCs between 0.70 and 0.83 for sarcoma, breast cancer, or other cancers combined. We describe a study that fills in the critical gap in knowledge for the utility of risk prediction models. Using a CCB cohort, our previously validated models have demonstrated good performance and outperformed the standard clinical criteria. Our study suggests that better risk counseling may be achieved by GCs using these already-developed mathematical models.

Incidence and development of validated mortality prediction model among asphyxiated neonates admitted to neonatal intensive care unit at Felege Hiwot Comprehensive Specialized Hospital, Bahir Dar, Northwest Ethiopia, 2021: retrospective follow-up study

IntroductionPerinatal asphyxia is failure to maintain normal breathing at birth. World Health Organization indicates that perinatal asphyxia is the third major cause of neonatal mortality in developing countries accounting for 23% of neonatal deaths every year. At global and national level efforts have done to reduce neonatal mortality, however fatalities from asphyxia remains high in Ethiopia (24%). And there are no sufficient studies to show incidence and prediction of mortality among asphyxiated neonates. Developing validated risk prediction model is one of the crucial strategies to improve neonatal outcomes with asphyxia. Therefore, this study will help to screen asphyxiated neonate at high-risk for mortality during admission by easily accessible predictors. This study aimed to determine the incidence and develop validated Mortality Prediction model among asphyxiated neonates admitted to the Neonatal Intensive Care Unit at Felege-Hiwot Comprehensive Specialized Hospital, Bahir Dar, Ethiopia.MethodRetrospective follow-up study was conducted at Felege-Hiwot Comprehensive Specialized Hospital from September 1, 2017, to March 31, 2021. Simple random sampling was used to select 774 neonates, and 738 were reviewed. Since was data Secondary, it was collected by checklist. After the description of the data by table and graph, Univariable with p-value < 0.25, and stepwise multivariable analysis with p-value < 0.05 were done to develop final reduced prediction model by likelihood ratio test. To improve clinical utility, we developed a simplified risk score to classify asphyxiated neonates at high or low-risk of mortality. The accuracy of the model was evaluated using area under curve, and calibration plot. To measures all accuracy internal validation using bootstrapping technique were assessed. We evaluated the clinical impact of the model using a decision curve analysis across various threshold probabilities.ResultIncidence of neonatal mortality with asphyxia was 27.2% (95% CI: 24.1, 30.6). Rural residence, bad obstetric history, amniotic fluid status, multiple pregnancy, birth weight (< 2500 g), hypoxic-ischemic encephalopathy (stage II and III), and failure to suck were identified in the final risk prediction score. The area under the curve for mortality using 7 predictors was 0.78 (95% CI 0.74 to 0.82). With ≥ 7 cutoffs the sensitivity and specificity of risk prediction score were 0.64 and 0.82 respectively.Conclusion and recommendationIncidence of neonatal mortality with asphyxia was high. The risk prediction score had good discrimination power built by rural residence, bad obstetric history, stained amniotic fluid, multiple pregnancy, birth weight (< 2500 g), hypoxic-ischemic encephalopathy (stage II and III), and failure to suck. Thus, using this score chart and improve neonatal and maternal service reduce mortality among asphyxiated neonates.

Patient outcomes following medical emergency team review on general wards: Development of predictive models.

To develop and internally validate risk prediction models for subsequent clinical deterioration, unplanned ICU admission and death among ward patients following medical emergency team (MET) review. A retrospective cohort study of 1500 patients who remained on a general ward following MET review at an Australian quaternary hospital. Logistic regression was used to model (1) subsequent MET review within 48 h, (2) unplanned ICU admission within 48 h and (3) hospital mortality. Models included demographic, clinical and illness severity variables. Model performance was evaluated using discrimination and calibration with optimism-corrected bootstrapped estimates. Findings are reported using the TRIPOD guideline for multivariable prediction models for prognosis or diagnosis. There was no patient or public involvement in the development and conduct of this study. Within 48 h of index MET review, 8.3% (n = 125) of patients had a subsequent MET review, 7.2% (n = 108) had an unplanned ICU admission and in-hospital mortality was 16% (n = 240). From clinically preselected predictors, models retained age, sex, comorbidity, resuscitation limitation, acuity-dependency profile, MET activation triggers and whether the patient was within 24 h of hospital admission, ICU discharge or surgery. Models for subsequent MET review, unplanned ICU admission, and death had adequate accuracy in development and bootstrapped validation samples. Patients requiring MET review demonstrate complex clinical characteristics and the majority remain on the ward after review for deterioration. A risk score could be used to identify patients at risk of poor outcomes after MET review and support general ward clinical decision-making. Our risk calculator estimates risk for patient outcomes following MET review using clinical data available at the bedside. Future validation and implementation could support evidence-informed team communication and patient placement decisions.