Real-world Data Sources Research Articles

Implementing Cancer Registry Data With the PCORnet Common Data Model: The Greater Plains Collaborative Experience.

Electronic health records (EHRs) comprise a rich source of real-world data for cancer studies, but they often lack critical structured data elements such as diagnosis date and disease stage. Fortunately, such concepts are available from hospital cancer registries. We describe experiences from integrating cancer registry data with EHR and billing data in an interoperable data model across a multisite clinical research network. After sites implemented cancer registry data into a tumor table compatible with the PCORnet Common Data Model (CDM), distributed queries were performed to assess quality issues. After remediation of quality issues, another query produced descriptive frequencies of cancer types and demographic characteristics. This included linked BMI. We also report two current use cases of the new resource. Eleven sites implemented the tumor table, yielding a resource with data for 572,902 tumors. Institutional and technical barriers were surmounted to accomplish this. Variations in racial and ethnic distributions across the sites were observed; the percent of tumors among Black patients ranged from <1% to 15% across sites, and the percent of tumors among Hispanic patients ranged from 1% to 46% across sites. Current use cases include a pragmatic prospective cohort study of a rare cancer and a retrospective cohort study leveraging body size and chemotherapy dosing. Integrating cancer registry data with the PCORnet CDM across multiple institutions creates a powerful resource for cancer studies. It provides a wider array of structured, cancer-relevant concepts, and it allows investigators to examine variability in those concepts across many treatment environments. Having the CDM tumor table in place enhances the impact of the network's effectiveness for real-world cancer research.

Integrating electronic health records with other data sources for postmarket drug safety signal identification: a review

Electronic health records (EHRs) have emerged as resources for both the identification of adverse drug events (ADEs) and general population health surveillance, however questions remain around how best to utilize EHR data for drug safety signal identification. While the majority of signal identification research has utilized spontaneous reports and health insurance claims, these data also have limitations. Pharmacovigilance approaches combining EHR data with other data sources have the potential to address many of the shortcomings of individual sources. This mini-review seeks to provide an overview of some of the recent research leveraging EHR data in combination with spontaneous reports, claims data, and other pharmacovigilance data sources for drug safety signal identification. Studies have shown that combining EHR data with these and other sources is often beneficial compared to the use of a single source alone, however the synergism or friction introduced is insufficiently explored in current literature. Our review explores how EHR data benefits signal identification when used in combination with other sources, what methods have been applied, and what considerations have previously been noted. Finally, we identify gaps in current research and highlight important considerations for future work using multiple real world data sources for drug safety surveillance.

Abstract 4137925: Long-term Outcome of Initial Thoracic Endovascular Repair or Medical Therapy in Acute Uncomplicated Type B Aortic Dissection: Real-world Data from a Nationwide Claims-Database in Japan.

Introduction: Thoracic endovascular aortic repair (TEVAR) has emerged as a promising treatment option for patients with type B aortic dissection (TBAD). However, there is a lack of evidence regarding the long-term morbidity of initial TEVAR compared to optimal medical therapy (OMT) in acute uncomplicated TBAD (uTBAD). Objective: To evaluate real-world data(RWD) on the long-term outcome of Japanese patients with acute uTBAD using a nationwide claims database. Methods: This retrospective cohort study utilizes JMDC, a nationwide claims database under Japan's universal healthcare system. We included patients who were initially hospitalized with a diagnosis of acute TBAD. We defined acute uTBAD by excluding those who died within one month, suffered aortic rupture, traumatic thoracic aortic injury, underwent open-chest surgery, experienced stroke or paralysis, or had less than six months of history in the JMDC. Patients who underwent TEVAR within three months of the index hospitalization (TEVAR group) were compared with those who received optimal medical therapy (OMT group). Propensity score (PS) matching was performed based on age, sex, and year of hospitalization. Using the Kaplan-Meier method, we calculated the cumulative rate of all-cause mortality and aorta-related events. Results: Of 18,445 patients diagnosed with aortic disease between January 2005 and December 2020, 641 were included in the study (OMT group: n=580, TEVAR group: n=61). After PS-matching, demographics of the groups (OMT_PSM: n=183 vs. TEVAR_PSM: n=61) were female (12.6% vs. 13.1%), median age (54 years [IQR, 48-60] vs. 54 years [IQR, 50-61]) and follow-up time (18 months [8-32] vs. 19 months [9-32]), respectively. Kaplan-Meier curves for the aortic-related events (Figure1, 2) are shown as long-term outcomes. Conclusions: This study successfully demonstrated that the estimated 5-year aortic-related event rate in acute uTBAD patients undergoing OMT is approximately 20%, demonstrating the relevance of the RWD source. However, the number of death events in the TEVAR and OMT groups was not sufficient to provide statistical power. Therefore, further studies are warranted to evaluate the long-term prognosis of initial TEVAR for uTBAD.

The Use of Real-World Data for Estimating Relative Treatment Effects in NICE Health Technology Assessment Submissions: A Review.

This paper investigates the current use of real-world data (RWD) for estimating relative treatment effects in National Institute for Health and Care Excellence (NICE) health technology assessment (HTA) submissions. This review included 64 HTA submissions, which accounted for approximately 11% of the total NICE HTA submissions between January 2016 and December 2023. The main sources of RWD considered in the submissions were disease registries and electronic health records. RWD were primarily used to provide an external control arm to enable comparisons within single-arm trials and to inform long-term treatment effects when extrapolating survival data beyond the trial follow-up. Adjustments for potential systematic differences between treatment groups have improved over time; however, approximately one-third of the submissions still relied on unadjusted treatment comparisons. We found that approximately 10% of NICE HTA submissions used RWD to directly inform treatment effects estimation. Over one-third of the submissions relied on naïve and/or unadjusted treatment comparisons, which may have introduced biases. To ensure that RWD provide sound evidence for HTA, submissions should follow published guidelines, including the NICE real-world evidence (RWE)framework.

Framework for approaching federated causal inference based on real-world observational data sources

Abstract Context Causal inference methods, generally requiring detailed individual information, allow us to evaluate public health interventions in real-world observational settings. When comparing interventions across borders and for this purpose leveraging distributed sensitive individual-level data, a federated approach can be aided. However, reusing such distributed data while maintaining privacy and interoperability, is a challenging endeavor. Methodological framework In the context of the BY-COVID project, a methodological framework to approach federated causal inference was published in October 2023. It is presented as a set of guidelines in the form several consecutive steps, starting with defining a research question, to building a causal model, translating the causal model into data requirements captured within a Common Data Model (CDM), generating synthetic data complying with the requirements captured in the CDM, and developing interoperable analysis scripts which can be distributed for deployment in different federated nodes. The proposed framework was built through implementing and combining existing methodologies and taking into account the principles of legal, organizational, semantic and technical interoperability. Objectives This presentation will provide an overview of the proposed framework, and its demonstration by performing an international comparison of the real-world effectiveness of SARS-CoV-2 primary vaccination campaigns in preventing infections at different federated sites. Challenges encountered (e.g. difficulties in complying with data requirements by linking heterogeneous local data sources) and lessons learned in the course of the demonstrator will be highlighted. Implications We aim to contribute to a public health research field where the rapid assessment of emerging population-health research questions (potentially feeding into evidence-based policy-making) is achievable, in that way contributing to European pandemic preparedness.

The Oncology QCARD Initiative: Fostering efficient evaluation of initial real-world data proposals.

The oncology quality, characterization, and assessment of real-world data (Oncology QCARD) Initiative was formed to develop a set of minimum study design and data elements needed to evaluate the fitness of the real-world data (RWD) source(s) proposed in an initial study concept as part of early interaction with scientific reviewers. A multidisciplinary executive committee (EC) was established to guide the Oncology QCARD Initiative. The EC conducted a landscape review of published literature, guidances, and guidelines to evaluate relevant dimensions of data quality measurement. Guided by the review and informed by expert feedback, the Oncology QCARD Initial Protocol Characterization (IPC) provides a summary of minimum elements needed to adequately describe an initial clinical study concept that involves RWD and is intended to support decision-making. Fit-for-use data and fit-for-purpose design emerged as themes from the landscape analysis. Data that are fit-for-use are both relevant (sufficiently capturing exposure, outcomes, and covariates) and reliable (understanding data accrual and quality control and whether the data represent the underlying concepts they are intended to represent) to answer a specific research question. A fit-for-purpose design takes appropriate steps to ensure internal and external validity and allows for transparency in reporting. The QCARD-IPC focuses on high-level characteristics of RWD sources and study design domains including data temporality, population, medical product exposure, comparators, and covariates, endpoints, statistical analysis, and data quality assurance plans. Evaluation of studies including RWD requires understanding the data source, study design, and potential biases to preliminarily evaluate whether selected RWD are fit-for-use for the research question. The Oncology QCARD-IPC provides a structured, transparent approach to facilitate early review and enhanced communication between study sponsors and scientific reviewers of initial study proposals including RWD.

Overview of Finnish national patient data repository for research on medical risk assessment

The Kanta Patient Data Repository (PDR) contains healthcare data from the population of Finland for more than a decade. The repository is a continuously expanding real world dataset produced by many information systems and healthcare service providers. Kanta data has been available for secondary uses such as scientific research since 2019. The data can be requested from the Finnish authority Findata. However, before a request has been accepted, it is difficult to assess if the accumulated data allows answering a specific research question. Publicly available descriptions of data structures in the Kanta PDR do not tell how much they are used in practice. This publication enables future data use cases by providing a view on the overall availability of types of structured health data in the Kanta PDR based on a sample of 96 200 medical histories of over 18-year-old patients. We conclude that the Kanta PDR is a promising source of real world data for development and evaluation of medical risk calculators within the Finnish population. The wide coverage of the Finnish population and timeliness of the data are its strengths as a source of research data also outside of Finnish context. However, the limitations on data availability in variable level need to be considered on a case-by-case basis. Main challenges in the use of data in the Kanta PDR are multiple code systems for laboratory results, short durations of recorded data for specific data types, and missing or very rarely used structured format e.g., in cases of tobacco and alcohol use.

On the calibration and improvement of human mobility models in intercity transportation system

As one of the research highlights of physics-level modelling, human mobility has generated numerous universal laws over the past decades. However, the majority of research has concentrated on the intracity networks, leaving the intercity mobility systems with insufficient attention despite its increasingly crucial role in the development of urban agglomerations. Related research gaps further extend to the limited understanding of spatiotemporal heterogeneity in intercity human mobility. To bridge these gaps, our study systematically validated and improved the modelling framework of intercity mobility flows utilizing real-world data sources. Specifically, building upon the nationwide Location-based Services (LBS) datasets in China, the applicability of classic human mobility models, including gravity model and intervening opportunities-class models, was extensively explored in the intercity domain by developing fitting models that incorporated multi-class urban attributes. Then, we contributed to proposing improved models that consider the diverse attraction effect of the origin and potential destinations. Moreover, our research scope was expanded to incorporate spatiotemporal heterogeneity through model comparisons among various city sets during both regular period and holiday. The findings suggested that our improved models effectively enhance the modelling accuracy while strengthening the explanatory power. They especially demonstrate a balanced performance even when handling datasets with spatiotemporal heterogeneity. Consequently, this study provides valuable insights into understanding intercity human mobility from the intrinsic mechanism of opportunity attraction. Our models hold practical significance in accurately modelling intercity mobility flows utilizing observable urban attributes and spatial layouts, further providing effective tools for preemptive traffic management.

The impact of different censoring methods for analyzing survival using real-world data with linked mortality information: a simulation study

BackgroundEvaluating outcome reliability is critical in real-world evidence studies. Overall survival is a common outcome in these studies; however, its capture in real-world data (RWD) sources is often incomplete and supplemented with linked mortality information from external sources. Conflicting recommendations exist for censoring overall survival in real-world evidence studies. This simulation study aimed to understand the impact of different censoring methods on estimating median survival and log hazard ratios when external mortality information is partially captured.MethodsWe used Monte Carlo simulation to emulate a non-randomized comparative effectiveness study of two treatments with RWD from electronic health records and linked external mortality data. We simulated the time to death, the time to last database activity, and the time to data cutoff. Death events after the last database activity were attributed to linked external mortality data and randomly set to missing to reflect the sensitivity of contemporary real-world data sources. Two censoring schemes were evaluated: (1) censoring at the last activity date and (2) censoring at the end of data availability (data cutoff) without an observed death. We assessed the performance of each method in estimating median survival and log hazard ratios using bias, coverage, variance, and rejection rate under varying amounts of incomplete mortality information and varying treatment effects, length of follow-up, and sample size.ResultsWhen mortality information was fully captured, median survival estimates were unbiased when censoring at data cutoff and underestimated when censoring at the last activity. When linked mortality information was missing, censoring at the last activity date underestimated the median survival, while censoring at the data cutoff overestimated it. As missing linked mortality information increased, bias decreased when censoring at the last activity date and increased when censoring at data cutoff.ConclusionsResearchers should consider the completeness of linked external mortality information when choosing how to censor the analysis of overall survival using RWD. Substantial bias in median survival estimates can occur if an inappropriate censoring scheme is selected. We advocate for RWD providers to perform validation studies of their mortality data and publish their findings to inform methodological decisions better.

Utilization of Real-World Data in the Intervention to Reduce Early Peanut Allergy in Children (iREACH) Trial

ObjectiveTo demonstrate the use of linked, real-world data in the context of a pediatric practice-based clinical trial. ApproachThe Intervention to Reduce Early Peanut Allergy in Children (iREACH) is a two-arm, cluster randomized, controlled trial. The intervention included clinician education and clinical decision support to increase pediatric clinician adherence to the NIAID’s 2017 Prevention of Peanut Allergy guidelines during infants’ 4- and 6-month well child care visits. Electronic health record (EHR) data were shared with the data coordinating center under a Health Insurance Portability and Accountability Act (HIPAA) waiver. All caregivers of eligible infants were invited to complete two surveys via REDCap, an online survey platform. The consents included an optional HIPAA authorization to link EHR data with survey responses and authorization to collect and link administrative data from the Special Supplemental Nutrition Program for Women, Infants, and Children (WIC) program, if applicable. ResultsOverall, 30 Illinois pediatric practices participated. EHR data was collected for 18,480 infants of whom 4,331 had any caregiver survey data (23.4% response rate). Permission to link survey responses to EHR data was obtained for 3,950 infants among those with any survey data (91.2%). Consent for linking WIC data with study data was obtained for 229 infants and 194 mothers. ConclusionsAuthorization for data linkage in the consent forms allowed investigators to amass data to compare caregiver and clinician responses, generate hypotheses, and propose future research outside the scope of the main trial. ImplicationsMultiple real-world data sources can be effectively combined to extend the findings of clinical trials.

Contemporary Practice and Considerations for Real-World Data Source Identification and Feasibility Assessment.

There has been rapid growth in the variety and number of real-world data (RWD) sources, as well as the number of regulatory documents that provide guidance for assessing the suitability of RWD sources for pharmacoepidemiology studies. This study aims to assess differences in RWD guidance and variability in current practice for identifying and assessing RWD for studies with regulatory purpose. Key criteria for feasibility assessment were mapped against relevant regulatory guidance documents across US, EU, and Asia-Pacific regions. An online survey was designed and deployed to International Society for Pharmacoepidemiology members to understand current practice. Findings were summarized and used to inform key considerations and recommendations. Eleven RWD guidance documents were identified and mapped against 14 RWD assessment criteria. Variability was seen across these documents in guidance for these criteria. Between December 2022 and January 2023, 37 survey respondents reported having used RWD for post-marketing commitments (34, 92%) and/or background epidemiology (28, 76%). RWD were mostly identified through literature (33, 89%) and data landscaping (26, 70%); guidance documents referenced included: Food and Drug Administration (20, 54%), European Network for Centres for Pharmacoepidemiology and Pharmacovigilance (17, 46%), European Medical Agency (16, 43%), and Structured Process to Identify Fit-For-Purpose Data (11, 30%). Challenges for conducting feasibility assessments included RWD accessibility, ability to complete validation, and RWD provider responsiveness. Existing guidelines are used extensively by researchers, but key criteria for RWD identification and feasibility assessment are not reflected consistently and challenges remain. Recommendations have been made reflecting study findings.

Examining the Effect of Missing Data and Unmeasured Confounding on External Comparator Studies: Case Studies and Simulations.

Missing data and unmeasured confounding are key challenges for external comparator studies. This work evaluates bias and other performance characteristics depending on missingness and unmeasured confounding by means of two case studies and simulations. Two case studies were constructed by taking the treatment arms from two randomised controlled trials and an external real-world data source that exhibited substantial missingness. The indications of the randomised controlled trials were multiple myeloma and metastatic hormone-sensitive prostate cancer. Overall survival was taken as the main endpoint. The effects of missing data and unmeasured confounding were assessed for the case studies by reporting estimated external comparator versus randomised controlled trial treatment effects. Based on the two case studies, simulations were performed broadening the settings by varying the underlying hazard ratio, the sample size, the sample size ratio between the experimental arm and the external comparator, the number of missing covariates and the percentage of missingness. Thereby, bias and other performance metrics could be quantified dependent on these factors. For the multiple myeloma external comparator study, results were in line with the randomised controlled trial, despite missingness and potential unmeasured confounding, while for the metastatic hormone-sensitive prostate cancer case study missing data led to a low sample size, leading overall to inconclusive results. Furthermore, for the metastatic hormone-sensitive prostate cancer study, missing data in important eligibility criteria led to further limitations. Simulations were successfully applied to gain a quantitative understanding of the effects of missing data and unmeasured confounding. This exploratory study confirmed external comparator strengths and limitations by quantifying the impact of missing data and unmeasured confounding using case studies and simulations. In particular, missing data in key eligibility criteria were seen to limit the ability to derive the external comparator target analysis population accurately, while simulations demonstrated the magnitude of bias to expect for various settings.

Real-World Data and Real-World Evidence in Healthcare in the United States and Europe Union.

The use of real-world data (RWD) for healthcare decision-making is complicated by concerns regarding whether RWD is fit-for-purpose or is of sufficient validity to support the creation of credible RWE. An efficient mechanism for screening the quality of RWD is needed as regulatory agencies begin to use real-world evidence (RWE) to inform decisions about treatment effectiveness and safety. First, we provide an overview of RWD and RWE. Data quality frameworks (DQFs) in the US and EU were examined, including their dimensions and subdimensions. There is some convergence of the conceptual DQFs on specific assessment criteria. Second, we describe a list of screening criteria for assessing the quality of RWD sources. The curation and analysis of RWD will continue to evolve in light of developments in digital health and artificial intelligence (AI). In conclusion, this paper provides a perspective on the utilization of RWD and RWE in healthcare decision-making. It covers the types and uses of RWD, data quality frameworks (DQFs), regulatory landscapes, and the potential impact of RWE, as well as the challenges and opportunities for the greater leveraging of RWD to create credible RWE.

Metadata for Data dIscoverability aNd Study rEplicability in obseRVAtional Studies (MINERVA): Development and Pilot of a Metadata List and Catalogue in Europe.

Metadata for data dIscoverability aNd study rEplicability in obseRVAtional studies (MINERVA), a European Medicines Agency-funded project (EUPAS39322), defined a set of metadata to describe real-world data sources (RWDSs) and piloted metadata collection in a prototype catalogue to assist investigators from data source discoverability through study conduct. A list of metadata was created from a review of existing metadata catalogues and recommendations, structured interviews, a stakeholder survey, and a technical workshop. The prototype was designed to comply with the FAIR principles (findable, accessible, interoperable, reusable), using MOLGENIS software. Metadata collection was piloted by 15 data access partners (DAPs) from across Europe. A total of 442 metadata variables were defined in six domains: institutions (organizations connected to a data source); data banks (data collections sustained by an organization); data sources (collections of linkable data banks covering a common underlying population); studies; networks (of institutions); and common data models (CDMs). A total of 26 institutions were recorded in the prototype. Each DAP populated the metadata of one data source and its selected data banks. The number of data banks varied by data source; the most common data banks were hospital administrative records and pharmacy dispensation records (10 data sources each). Quantitative metadata were successfully extracted from three data sources conforming to different CDMs and entered into the prototype. A metadata list was finalized, a prototype was successfully populated, and a good practice guide was developed. Setting up and maintaining a metadata catalogue on RWDSs will require substantial effort to support discoverability of data sources and reproducibility of studies in Europe.

Evaluation of Real-World Tumor Response Derived From Electronic Health Record Data Sources: A Feasibility Analysis in Patients With Metastatic Non-Small Cell Lung Cancer Treated With Chemotherapy.

Real-world data (RWD) holds promise for ascribing a real-world (rw) outcome to a drug intervention; however, ascertaining rw-response to treatment from RWD can be challenging. Friends of Cancer Research formed a collaboration to assess available data attributes related to rw-response across RWD sources to inform methods for capturing, defining, and evaluating rw-response. This retrospective noninterventional (observational) study included seven electronic health record data companies (data providers) providing summary-level deidentified data from 200 patients diagnosed with metastatic non-small cell lung cancer (mNSCLC) and treated with first-line platinum doublet chemotherapy following a common protocol. Data providers reviewed the availability and frequency of data components to assess rw-response (ie, images, radiology imaging reports, and clinician response assessments). A common protocol was used to assess and report rw-response end points, including rw-response rate (rwRR), rw-duration of response (rwDOR), and the association of rw-response with rw-overall survival (rwOS), rw-time to treatment discontinuation (rwTTD), and rw-time to next treatment (rwTTNT). The availability and timing of clinician assessments was relatively consistent across data sets in contrast to images and image reports. Real-world response was analyzed using clinician response assessments (median proportion of patients evaluable, 77.5%), which had the highest consistency in the timing of assessments. Relative consistency was observed across data sets for rwRR (median 46.5%), as well as the median and directionality of rwOS, rwTTD, and rwTTNT. There was variability in rwDOR across data sets. This collaborative effort demonstrated the feasibility of aligning disparate data sources to evaluate rw-response end points using clinician-documented responses in patients with mNSCLC. Heterogeneity exists in the availability of data components to assess response and related rw-end points, and further work is needed to inform drug effectiveness evaluation within RWD sources.

Identifying Pediatric Hypertension in Observational Data: Comparing Clinical and Claims Cohorts in Real World Data.

We conducted retrospective public health surveillance using data from 2006 to 2016 in seven integrated delivery systems from FDA's Sentinel System. We identified pediatric hypertensive patients by clinical and claims-based definitions and compared demographics, baseline profiles and follow-up time profiles. Among 3,757,803 pediatric patients aged 3 to 17 years, we identified 781,722 children and 551,246 teens with at least three blood pressure measures over 36-months. Of these, 70,315 children (9%) and 47,928 teens (8.7%) met the clinical definition for hypertension and 22,465 (2.8%) children and 60,952 (11%) of teens met the clinical definition for elevated, non-hypertensive blood pressure. Of the 3.7M patients, we identified 3,246 children and 7,293 teens with any claim for hypertension (claims definition). Evidence of hypertension claims among those meeting our clinical definition was poor; 2.2% and 7.3% of clinically hypertensive children and teens had corresponding claims for hypertension. Baseline profiles for claims-based hypertensive patients suggest greater severity of disease compared to clinical patients. Claims-based patients showed higher rates of all-cause mortality during follow-up. Pediatric hypertension in claims-based data sources is under-captured but may serve as a marker for greater disease severity. Investigators should understand coding practices when selecting real-world data sources for future pediatric hypertension work.

Real-World Research on Retinal Diseases Using Health Claims Database: A Narrative Review.

Real-world data (RWD) has emerged as a crucial component in understanding and improving patient outcomes across various medical conditions, including retinal diseases. Health claims databases, generated from healthcare reimbursement claims, offer a comprehensive source of RWD, providing insights into patient outcomes, healthcare utilization, and treatment effectiveness. However, the use of these databases for research also presents unique challenges. This narrative review explores the role of real-world research on retinal diseases using health claims databases, highlighting their advantages, limitations, and potential contributions to advancing our understanding and management of the diseases. The review examines the applications of health claims databases in retinal disease research, including epidemiological studies, comparative effectiveness and safety analyses, economic burden assessments, and evaluations of patient outcomes and quality of care. Previous findings demonstrate the value of these databases in generating prevalence and incidence estimates, identifying risk factors and predictors, evaluating treatment effectiveness and safety, and understanding healthcare utilization patterns and costs associated with retinal diseases. Despite their strengths, health claims databases face challenges related to data limitations, biases, privacy concerns, and methodological issues. Accordingly, the review also explores future directions and opportunities, including advancements in data collection and analysis, integration with electronic health records, collaborative research networks and consortia, and the evolving regulatory landscape. These developments are expected to enhance the utility of health claims databases for retinal disease research, resulting in more comprehensive and impactful findings across diverse retinal disorders and robust real-world insights from a large population.

A randomized, embedded, pragmatic, Bayesian clinical trial examining clinical decision support for high flow nasal cannula management in children with bronchiolitis: design and statistical analysis plan

BackgroundHigh flow nasal cannula (HFNC) has been increasingly adopted in the past 2 decades as a mode of respiratory support for children hospitalized with bronchiolitis. The growing use of HFNC despite a paucity of high-quality data regarding the therapy’s efficacy has led to concerns about overutilization. We developed an electronic health record (EHR) embedded, quality improvement (QI) oriented clinical trial to determine whether standardized management of HFNC weaning guided by clinical decision support (CDS) results in a reduction in the duration of HFNC compared to usual care for children with bronchiolitis.MethodsThe design and summary of the statistical analysis plan for the REspiratory SupporT for Efficient and cost-Effective Care (REST EEC; “rest easy”) trial are presented. The investigators hypothesize that CDS-coupled, standardized HFNC weaning will reduce the duration of HFNC, the trial’s primary endpoint, for children with bronchiolitis compared to usual care. Data supporting trial design and eventual analyses are collected from the EHR and other real world data sources using existing informatics infrastructure and QI data sources. The trial workflow, including randomization and deployment of the intervention, is embedded within the EHR of a large children’s hospital using existing vendor features. Trial simulations indicate that by assuming a true hazard ratio effect size of 1.27, equivalent to a 6-h reduction in the median duration of HFNC, and enrolling a maximum of 350 children, there will be a > 0.75 probability of declaring superiority (interim analysis posterior probability of intervention effect > 0.99 or final analysis posterior probability of intervention effect > 0.9) and a > 0.85 probability of declaring superiority or the CDS intervention showing promise (final analysis posterior probability of intervention effect > 0.8). Iterative plan-do-study-act cycles are used to monitor the trial and provide targeted education to the workforce.DiscussionThrough incorporation of the trial into usual care workflows, relying on QI tools and resources to support trial conduct, and relying on Bayesian inference to determine whether the intervention is superior to usual care, REST EEC is a learning health system intervention that blends health system operations with active evidence generation to optimize the use of HFNC and associated patient outcomes.Trial registrationClinicalTrials.gov NCT05909566. Registered on June 18, 2023.

Meaningful changes in motor function in Duchenne muscular dystrophy (DMD): A multi-center study.

Evaluations of treatment efficacy in Duchenne muscular dystrophy (DMD), a rare genetic disease that results in progressive muscle wasting, require an understanding of the 'meaningfulness' of changes in functional measures. We estimated the minimal detectable change (MDC) for selected motor function measures in ambulatory DMD, i.e., the minimal degree of measured change needed to be confident that true underlying change has occurred rather than transient variation or measurement error. MDC estimates were compared across multiple data sources, representing >1000 DMD patients in clinical trials and real-world clinical practice settings. Included patients were ambulatory, aged ≥4 to <18 years and receiving steroids. Minimal clinically important differences (MCIDs) for worsening were also estimated. Estimated MDC thresholds for >80% confidence in true change were 2.8 units for the North Star Ambulatory Assessment (NSAA) total score, 1.3 seconds for the 4-stair climb (4SC) completion time, 0.36 stairs/second for 4SC velocity and 36.3 meters for the 6-minute walk distance (6MWD). MDC estimates were similar across clinical trial and real-world data sources, and tended to be slightly larger than MCIDs for these measures. The identified thresholds can be used to inform endpoint definitions, or as benchmarks for monitoring individual changes in motor function in ambulatory DMD.

Increasing acceptance of AI-generated digital twins through clinical trial applications.

Today's approach to medicine requires extensive trial and error to determine the proper treatment path for each patient. While many fields have benefited from technological breakthroughs in computer science, such as artificial intelligence (AI), the task of developing effective treatments is actually getting slower and more costly. With the increased availability of rich historical datasets from previous clinical trials and real-world data sources, one can leverage AI models to create holistic forecasts of future health outcomes for an individual patient in the form of an AI-generated digital twin. This could support the rapid evaluation of intervention strategies in silico and could eventually be implemented in clinical practice to make personalized medicine a reality. In this work, we focus on uses for AI-generated digital twins of clinical trial participants and contend that the regulatory outlook for this technology within drug development makes it an ideal setting for the safe application of AI-generated digital twins in healthcare. With continued research and growing regulatory acceptance, this path will serve to increase trust in this technology and provide momentum for the widespread adoption of AI-generated digital twins in clinical practice.