Clinical Performance Measures Research Articles

Clinical trial capacity building in a pandemic-outcome of a rapid site readiness project in Latin America.

Latin America (Latam) has a tradition of large-scale vaccine trials. Because of fluctuating demand, many sites have downsized their infrastructure. Therefore, BMGF launched a clinical trial site-readiness initiative early in the coronavirus-2019 (COVID-19) pandemic including Latam countries between August and September 2020. This survey evaluated clinical development performance measures pre/post initiative (September 2022). 20/21 prequalified sites participated in COVID-19 vaccine/drug development trials. 156 clinical trials (140 COVID-19 vaccine/drug trials) were initiated in the 2 years since prequalification, compared to 176 in the 5 years before. 33,428/37,810 participants were included in COVID-19 programs. The number of enrolled subjects/day across sites quadrupled from 15 (1-35) to 63 (5-300). The dropout rate was 6.8%. Study approval timelines were reduced from 60 (12-120) to 35 (5-90) days. Mean qualified staff was increased from 24 (6-80) to 88 (22-180). Clinical trial sites across Latam were successfully prequalified to participate in COVID-19 developments. For the 100 days mission of vaccine availability in a new pandemic sufficient and well-trained clinical trial sites readily available are essential. This is only achievable if sites-especially in low/middle-income countries-are maintained active through a constant flow of vaccine studies.

R.I.M.E. and reason: multi-station OSCE enhancement to neutralize grade inflation

ABSTRACT To offset grade inflation, many clerkships combine faculty evaluations with objective assessments including the Medical Examiners Subject Examination (NBME-SE) or Objective Structured Clinical Examination (OSCE), however, standardized methods are not established. Following a curriculum transition removing faculty clinical evaluations from summative grading, final clerkship designations of fail (F), pass (P), and pass-with-distinction (PD) were determined by combined NBME-SE and OSCE performance, with overall PD for the clerkship requiring meeting this threshold in both. At the time, 90% of students achieved PD on the Internal Medicine (IM) OSCE resulting in overall clerkship grades primarily determined by the NBME-SE. The clerkship sought to enhance the OSCE to provide a more thorough objective clinical skills assessment, offset grade inflation, and reduce the NBME-SE primary determination of the final clerkship grade. The single-station 43-point OSCE was enhanced to a three-station 75-point OSCE using the Reporter-Interpreter-Manager-Educator (RIME) framework to align patient encounters with targeted assessments of progressive skills and competencies related to the clerkship rotation. Student performances were evaluated pre- and post-OSCE enhancement. Student surveys provided feedback about the clinical realism of the OSCE and the difficulty. Pre-intervention OSCE scores were more tightly clustered (SD = 5.65%) around a high average performance with scores being highly negatively skewed. Post-intervention OSCE scores were more dispersed (SD = 6.88%) around a lower average with scores being far less skewed resulting in an approximately normal distribution. This lowered the total number of students achieving PD on the OSCE and PD in the clerkship, thus reducing the relative weight of the NMBE-SE in the overall clerkship grade. Student response was positive, indicating the examination was fair and reflective of their clinical experiences. Through structured development, OSCE assessment can provide a realistic and objective measurement of clinical performance as part of the summative evaluation of students.

Use of a SimBox, a Video-Augmented, Newborn Resuscitation Simulation for Prehospital Providers to Measure Clinical Performance and Educational Experience.

Few studies have described the current clinical practices, adherence to guidelines, and outcomes of newborn resuscitations attended by emergency medical services (EMS). SimBox, a novel, video-augmented simulation, was used to describe the adherence of prehospital providers to Neonatal Resuscitation Program guidelines, to measure satisfaction with the simulation intervention, and to describe the self-reported improvement in knowledge, skills, and attitudes after the simulation. A prospective observational cohort study of EMS providers was designed and conducted using SimBox, an open-access simulation platform, and facilitated by EMS educators. Clinical performance measures were collected using a five-item checklist. Simulation satisfaction measures were collected through net promoter scores. Learners' demographics, and self-reported knowledge, skills, and attitudes were measured using a retrospective survey of 25 questions. In total, 33 facilitator and 55 learner surveys were collected across Connecticut, Colorado, and Alaska between July 2021 and September 2022. At least one deviation from clinical guidelines occurred in 22/30 (73.3%) of the sessions, with 10/30 (33.3%) teams inappropriately performing chest compressions, 5/31 (16.1%) teams not warming, drying, stimulating, and suctioning the newborn, and 7/31 (22.6%) teams not performing positive pressure ventilation correctly. Lastly, 10/30 (33.3%) teams administered an incorrect dose of dextrose-containing fluids. Very high levels of satisfaction were reported with net promoter scores of 97 and 82 out of 100 for the facilitator and learner surveys, respectively. Finally, all 55/55 (100%) of the learners strongly or somewhat agreed that the simulation improved their knowledge, teamwork, communication, and psychomotor skills. In this cohort of prehospital providers, clinical management decisions during a newborn resuscitation simulation often deviated from the gold-standard, newborn resuscitation guidelines. Free, online, open-access simulation resources like SimBox can be used to identify and measure practice deviations from standardized resuscitation protocols in the prehospital setting.

Incorporating a situational judgement test in residency selections: clinical, educational and organizational outcomes

BackgroundComputer-based assessment for sampling personal characteristics (Casper), an online situational judgement test, is a broad measure of personal and professional qualities. We examined the impact of Casper in the residency selection process on professionalism concerns, learning interventions and resource utilization at an institution.MethodsIn 2022, admissions data and information in the files of residents in difficulty (over three years pre- and post- Casper implementation) was used to determine the number of residents in difficulty, CanMEDS roles requiring a learning intervention, types of learning interventions (informal learning plans vs. formal remediation or probation), and impact on the utilization of institutional resource (costs and time). Professionalism concerns were mapped to the 4I domains of a professionalism framework, and their severity was considered in mild, moderate, and major categories. Descriptive statistics and between group comparisons were used for quantitative data.ResultsIn the pre- and post- Casper cohorts the number of residents in difficulty (16 vs. 15) and the number of learning interventions (18 vs. 16) were similar. Professionalism concerns as an outcome measure decreased by 35% from 12/16 to 6/15 (p < 0.05), were reduced in all 4I domains (involvement, integrity, interaction, introspection) and in their severity. Formal learning interventions (15 vs. 5) and informal learning plans (3 vs. 11) were significantly different in the pre- and post-Casper cohorts respectively (p < 0.05). This reduction in formal learning interventions was associated with a 96% reduction in costs f(rom hundreds to tens of thousands of dollars and a reduction in time for learning interventions (from years to months).ConclusionsJustifiable from multiple stakeholder perspectives, use of an SJT (Casper) improves a clinical performance measure (professionalism concerns) and permits the institution to redirect its limited resources (cost savings and time) to enhance institutional endeavors and improve learner well-being and quality of programs.

Measures of Clinical Performance and Communication Skills of EM Residents on Simulated Resuscitations are not Correlated

Measures of Clinical Performance and Communication Skills of EM Residents on Simulated Resuscitations are not Correlated

2024 ACC/AHA Clinical Performance and Quality Measures for Adults With Valvular and Structural Heart Disease: A Report of the American Heart Association/American College of Cardiology Joint Committee on Performance Measures.

2024 ACC/AHA Clinical Performance and Quality Measures for Adults With Valvular and Structural Heart Disease: A Report of the American Heart Association/American College of Cardiology Joint Committee on Performance Measures.

Prediction of general practice licensure/certification examination performance by a measure of 'questionable' activities in clinical practice: a retrospective cohort study.

'Low-value' clinical care and medical services are 'questionable' activities, being more likely to cause harm than good or with disproportionately low benefit relative to cost. This study examined the predictive ability of the QUestionable In Training Clinical Activities Index (QUIT-CAI) for general practice (GP) registrars' (trainees') performance in Australian GP Fellowship examinations (licensure/certification examinations for independent GP). The study was nested in ReCEnT, an ongoing cohort study in which Australian GP registrars document their in-consultation clinical practice. Outcome factors in analyses were individual registrars' scores on the three Fellowship examinations ('AKT', 'KFP', and 'OSCE' examinations) and pass/fail rates during 2012-21. Analyses used univariable and multivariable regression (linear or logistic, as appropriate). The study factor in each analysis was 'QUIT-CAI score percentage'-the percentage of times a registrar performed a QUIT-CAI clinical activity when 'at risk' (i.e. when managing a problem where performing a QUIT-CAI activity was a plausible option). A total of 1265, 1145, and 553 registrars sat Applied Knowledge Test, Key Features Problem, and Objective Structured Clinical Exam examinations, respectively. On multivariable analysis, higher QUIT-CAI score percentages (more questionable activities) were significantly associated with poorer Applied Knowledge Test scores (P = .001), poorer Key Features Problem scores (P = .003), and poorer Objective Structured Clinical Exam scores (P = .005). QUIT-CAI score percentages predicted Royal Australian College of General Practitioner exam failure [odds ratio 1.06 (95% CI 1.00, 1.12) per 1% increase in QUIT-CAI, P = .043]. Performing questionable clinical activities predicted poorer performance in the summative Fellowship examinations, thereby validating these examinations as measures of actual clinical performance (by our measure of clinical performance, which is relevant for a licensure/certification examination).

Severe Hypocalcemia With Denosumab Among Older Female Dialysis-Dependent Patients

Dialysis-dependent patients experience high rates of morbidity from fractures, yet little evidence is available on optimal treatment strategies. Chronic kidney disease-mineral and bone disorder is nearly universal in dialysis-dependent patients, complicating diagnosis and treatment of skeletal fragility. To examine the incidence and comparative risk of severe hypocalcemia with denosumab compared with oral bisphosphonates among dialysis-dependent patients treated for osteoporosis. Retrospective cohort study of female dialysis-dependent Medicare patients aged 65 years or older who initiated treatment with denosumab or oral bisphosphonates from 2013 to 2020. Clinical performance measures including monthly serum calcium were obtained through linkage to the Consolidated Renal Operations in a Web-Enabled Network database. Denosumab, 60 mg, or oral bisphosphonates. Severe hypocalcemia was defined as total albumin-corrected serum calcium below 7.5 mg/dL (1.88 mmol/L) or a primary hospital or emergency department hypocalcemia diagnosis (emergent care). Very severe hypocalcemia (serum calcium below 6.5 mg/dL [1.63 mmol/L] or emergent care) was also assessed. Inverse probability of treatment-weighted cumulative incidence, weighted risk differences, and weighted risk ratios were calculated during the first 12 treatment weeks. In the unweighted cohorts, 607 of 1523 denosumab-treated patients and 23 of 1281 oral bisphosphonate-treated patients developed severe hypocalcemia. The 12-week weighted cumulative incidence of severe hypocalcemia was 41.1% with denosumab vs 2.0% with oral bisphosphonates (weighted risk difference, 39.1% [95% CI, 36.3%-41.9%]; weighted risk ratio, 20.7 [95% CI, 13.2-41.2]). The 12-week weighted cumulative incidence of very severe hypocalcemia was also increased with denosumab (10.9%) vs oral bisphosphonates (0.4%) (weighted risk difference, 10.5% [95% CI, 8.8%-12.0%]; weighted risk ratio, 26.4 [95% CI, 9.7-449.5]). Denosumab was associated with a markedly higher incidence of severe and very severe hypocalcemia in female dialysis-dependent patients aged 65 years or older compared with oral bisphosphonates. Given the complexity of diagnosing the underlying bone pathophysiology in dialysis-dependent patients, the high risk posed by denosumab in this population, and the complex strategies required to monitor and treat severe hypocalcemia, denosumab should be administered after careful patient selection and with plans for frequent monitoring.

Development and evaluation of objective trial performance metrics for multisite clinical studies: Experience from the AlcHep Network

BackgroundRecruitment and retention are critical in clinical studies but there are limited objective metrics of trial performance. We tested if development of trial performance metrics will allow for objective evaluation of study quality. Performance metrics were developed using data from the observational cohort (OBS) and randomized clinical trial (RCT) arms of the prospective Alcoholic Hepatitis Network. MethodsYield-rate (%YR; eligible/screened), recruitment index (RI; mean recruitment time/patient), completion index (CI; average number of days to complete the follow-up/patient), and protocol adherence index (AI; average number of deviations/subject recruited) were determined. Results2250 patients (1168 for OBS; 1082 for RCT) were screened across 8 sites. Recruitment in the RCT (57% target) was similar to that in the OBS (59% target). Of those screened, 743 (63.6%) subjects in the OBS and 147 (13.6%) subjects in the RCT were enrolled in the study. In OBS study, 253 (34.1%) subjects, and in the RCT, 68 (46.3%) subjects, completed the study or reached a censoring event. Across all sites (range), YR for OBS was 63.6% (41.3–98.3%) and for RCT was 13.6% (5.5–92.6%); RI for OBS was 1.66 (8.79–19.85) and for RCT was 4.05 (19.76–36.43); CI for OBS was 4.87 (22.6–118.3) and for RCT was 8.75 (27.27–161.5); and AR for OBS was 0.56 (0.08–1.04) and for RCT was 1.55 (0.39–3.21. Factors related to participants, research design, study team, and research sponsors contributed to lower performance metrics. ConclusionsObjective measures of clinical trial performance allow for strategies to enhance study quality and development of site-specific improvement plans.Trial registration number: ClinicalTrials.gov NCT4072822 NCT 3850899.

The effect of a preceptorship programme on newly hired experienced professional nurses’ self-efficacy in nursing clinical competency in Saudi Arabia

AimThis study aimed to determine if participation in a preceptorship programme affected newly hired experienced professional nurses’ self-efficacy in clinical practice and whether their perceived competence was related to respondents’ demographic profiles at a university hospital in Saudi Arabia. BackgroundFormal preceptorship programmes are initiated with the aim of improving the characteristics related to new workplace adaptations, such as reducing stress and anxiety, improving effective communication, enhancing clinical performance and competencies, and learning new clinical skills. These programmes’ effectiveness in improving nurses’ self-efficacy in clinical practice is seldom measured, especially among newly hired experienced professional nurses. MethodsA quasi-experimental, quantitative pre- and post-test one-group study design with convenient sampling was used. ResultsSelf-efficacy post-test scores were significantly higher than pre-test scores (p<0.001). The programme positively influenced the respondents’ self-efficacy scores. As perceived by the respondents, the preceptorship programme had a positive effect and improved their clinical performance in the nursing process. There was no relationship between perceived competence and respondents’ demographic profiles. ConclusionsReporting on self-efficacy in clinical practice may not be the most effective, reliable or accurate measure or evaluation of clinical performance since self-scoring may be affected by existing cultural implications and a strong sense of self-efficacy. The self-scoring results may be followed by qualitative information, like interviews, to determine respondents’ knowledge of the nursing process, direct observation of performance in the clinical area and care outcomes, and confirm if the respondents’ clinical performance matches the obtained results.

Relation Between Cognitive Assessment and Clinical Physical Performance Measures After Mild Traumatic Brain Injury

ObjectivesTo investigate the relation between cognitive and motor performance in individuals with mild traumatic brain injury (mTBI) and examine differences in both cognitive and motor performance between adults after mTBI and healthy controls. DesignMulti-center, cross-sectional study. SettingThree institutional sites (Courage Kenny Research Center, Minneapolis, MN, Oregon Health & Science University, Portland, OR, and University of Utah, Salt Lake City, UT). ParticipantsData were collected from 110 participants (N=110), including those with mTBI and healthy controls, who completed cognitive and physical performance assessments. InterventionsNot applicable. Outcome MeasuresCognitive assessments involved the Automated Neuropsychological Assessment Metrics to evaluate domains of attention, memory, reaction time, processing speed, and executive function. Physical performance was evaluated through clinical performance assessments, such as the 1-min walk test, the modified Illinois Agility Test, the Functional Gait Assessment Tool, the High-Level Mobility Assessment Tool, a complex turning course, and a 4-Item Hybrid Assessment of Mobility for mTBI. Participants also completed additional trials of the 1-min walk test, modified Illinois Agility Test, and complex turning course with a simultaneous cognitive task. ResultsIndividuals with mTBI performed worse on cognitive assessments, as well as several of the physical performance assessments compared with healthy controls. Complex tasks were more strongly related to cognitive assessments compared with simple walking tasks. ConclusionsCombining complex motor tasks with cognitive demands may better demonstrate functional performance in individuals recovering from mTBI. By understanding the relation between cognitive and physical performance in individuals recovering from mTBI, clinicians may be able to improve clinical care and assist in return to activity decision-making.

Validity Evidence for the Physician Oral Language Observation Matrix as a Measure of Medical Spanish Proficiency.

The lack of a standardized language assessment process for medical students and physicians communicating in a non-English language threatens healthcare quality and safety. To evaluate the validity of a new rating tool, the Physician Oral Language Observation Matrix (POLOM)™, in assessing medical students' oral communication with Spanish-speaking standardized patients (SPs). POLOM scores were compared to measures of student medical Spanish proficiency to examine convergent validity and to measures of clinical performance to examine concurrent/criterion validity. Forty-two students at two schools completed SP encounters between January 2021 and April 2022, and POLOM raters scored the videorecorded performances between January and June 2022. Two approaches to generating POLOM total scores were investigated: rater average and strict consensus. Convergent validity was examined via the POLOM's correlations with (1) the phone-based Clinician Cultural and Linguistic Assessment (CCLA) and (2) the self-rated Interagency Language Roundtable scale for healthcare (ILR-H). Concurrent/criterion validity was examined via correlations with (1) the Comunicación y Habilidades Interpersonales (CAI) scale, (2) a checklist completed by the SP, and (3) a faculty rating of the student's post-encounter clinical note. Pearson's correlations of r ≥ 0.5 and r ≥ 0.2 were considered evidence of convergent validity and concurrent/criterion validity, respectively. Both rater average and strict consensus POLOM scores were strongly correlated with ILR-H (r = 0.72) and CCLA (r ≥ 0.60), providing evidence of convergent validity. The POLOM was substantially correlated with the CAI (r ≥ 0.29), the SP Checklist (r = 0.32), and the faculty scoring of the student's clinical note (r ≥ 0.24), providing concurrent/criterion validity evidence. The POLOM has demonstrated evidence of convergent and concurrent/criterion validity as a measure of medical students' Spanish proficiency during SP encounters. Additional research is needed to evaluate how the POLOM can be implemented with resident and practicing physicians, applied to other health professions, and adapted to other languages.

Correction to: 2023 AHA/ACC Clinical Performance and Quality Measures for Coronary Artery Revascularization: A Report of the American College of Cardiology/American Heart Association Joint Committee on Performance Measures.

Correction to: 2023 AHA/ACC Clinical Performance and Quality Measures for Coronary Artery Revascularization: A Report of the American College of Cardiology/American Heart Association Joint Committee on Performance Measures.

The association between care integration and care quality.

The study aims to analyze the relationship between care integration and care quality, and to examine if the relationship varies by patient risk. The key independent variables used validated measures derived from a provider survey of functional (i.e., administrative and clinical systems) and social (i.e., patient integration, professional cooperation, professional coordination) integration. Survey responses represented data from a stratified sample of 59 practice sites from 17 health systems. Dependent variables included three quality measures constructed from patient-level Medicare data: colorectal cancer screening among patients at risk, patient-level 30-day readmission, and a practice-level Healthcare Effectiveness Data and Information Set (HEDIS) composite measure of publicly reported, individual measures of ambulatory clinical quality performance. We obtained quality- and beneficiary-level covariate data for the 41,966 Medicare beneficiaries served by the 59 practices in our survey sample. We estimated hierarchical linear models to examine the association between care integration and care quality andthe moderating effect of patients' clinical risk score. We graphically visualized the moderating effects at ±1 standard deviation of our z-standardized independent and moderating variables and performed simple slope tests. Our analyses uncovered a strong positive relationship between social integration, specifically patient integration, and the quality of care a patient receives (e.g., a 1-point increase in a practice's patient integration was associated with 0.31-point higher HEDIS composite score, p < 0.01). Further, we documented positive and significant associations between aspects of social and functional integration on quality of care based on patient risk. The findings suggest social integration matters for improving the quality of care and that the relationship of integration to quality is not uniform for all patients. Policymakers and practitioners considering structural integrations of health systems should direct attention beyond structure to consider the potential for social integration to impact outcomes and how that might be achieved.

2023 AHA/ACC Clinical Performance and Quality Measures for Coronary Artery Revascularization: A Report of the American College of Cardiology/American Heart Association Joint Committee on Performance Measures.

2023 AHA/ACC Clinical Performance and Quality Measures for Coronary Artery Revascularization: A Report of the American College of Cardiology/American Heart Association Joint Committee on Performance Measures.

Pediatric Rheumatology Care and Outcomes Improvement Network's Quality Measure Set to Improve Care of Children With Juvenile Idiopathic Arthritis.

To describe the selection, development, and implementation of quality measures (QMs) for juvenile idiopathic arthritis (JIA) by the Pediatric Rheumatology Care and Outcomes Improvement Network (PR-COIN), a multihospital learning health network using quality improvement methods and leveraging QMs to drive improved outcomes across a JIA population since 2011. An American College of Rheumatology-endorsed multistakeholder process previously selected initial process QMs. Clinicians in PR-COIN and parents of children with JIA collaboratively selected outcome QMs. A committee of rheumatologists and data analysts developed operational definitions. QMs were programmed and validated using patient data. Measures are populated by registry data, and performance is displayed on automated statistical process control charts. PR-COIN centers use rapid-cycle quality improvement approaches to improve performance metrics. The QMs are revised for usefulness, to reflect best practices, and to support network initiatives. The initial QM set included 13 process measures concerning standardized measurement of disease activity, collection of patient-reported outcome assessments, and clinical performance measures. Initial outcome measures were clinical inactive disease, low pain score, and optimal physical functioning. The revised QM set has 20 measures and includes additional measures of disease activity, data quality, and a balancing measure. PR-COIN has developed and tested JIA QMs to assess clinical performance and patient outcomes. The implementation of robust QMs is important to improve quality of care. PR-COIN's set of JIA QMs is the first comprehensive set of QMs used at the point-of-care for a large cohort of JIA patients in a variety of pediatric rheumatology practice settings.

Care Management Processes Important for High-Quality Diabetes Care.

Identify the improvement in diabetes performance measures and population-based clinical outcomes resulting from changes in care management processes (CMP) in primary care practices over 3 years. This repeated cross-sectional study tracked clinical performance measures for all diabetes patients seen in a cohort of 330 primary care practices in 2017 and 2019. Unit of analysis was patient-year with practice-level CMP exposures. Causal inference is based on dynamic changes in individual CMPs between years by practice. We used the Bayesian method to simultaneously estimate a five-outcome model: A1c, systolic and diastolic blood pressure, guideline-based statin use, and Optimal Diabetes Care (ODC). We control for unobserved time-invariant practice characteristics and secular change. We modeled correlation of errors across outcomes. Statistical significance was identified using 99% Bayesian credible intervals (analogous to P < 0.01). Implementation of 18 of 62 CMPs was associated with statistically significant improvements in patient outcomes. Together, these resulted in 12.1% more patients meeting ODC performance measures. Different CMPs affected different outcomes. Three CMPs accounted for 47% of the total ODC improvement, 68% of A1c decrease, 21% of SBP reduction, and 55% of statin use increase: 1) systems for identifying and reminding patients due for testing, 2) after-visit follow-up by a nonclinician, and 3) guideline-based clinician reminders for preventive services during a clinic visit. Effective quality improvement in primary care focuses on practice redesign that clearly improves diabetes outcomes. Tailoring CMP adoption in primary care provides effective improvement in ODC performance through focused changes in diabetes outcomes.

TRainee Attributable & Automatable Care Evaluations in Real-time (TRACERs): A Scalable Approach for Linking Education to Patient Care.

Competency-based medical education (CBME) is an outcomes-based approach to education and assessment that focuses on what competencies trainees need to learn in order to provide effective patient care. Despite this goal of providing quality patient care, trainees rarely receive measures of their clinical performance. This is problematic because defining a trainee's learning progression requires measuring their clinical performance. Traditional clinical performance measures (CPMs) are often met with skepticism from trainees given their poor individual-level attribution. Resident-sensitive quality measures (RSQMs) are attributable to individuals, but lack the expeditiousness needed to deliver timely feedback and can be difficult to automate at scale across programs. In this eye opener, the authors present a conceptual framework for a new type of measure - TRainee Attributable & Automatable Care Evaluations in Real-time (TRACERs) - attuned to both automation and trainee attribution as the next evolutionary step in linking education to patient care. TRACERs have five defining characteristics: meaningful (for patient care and trainees), attributable (sufficiently to the trainee of interest), automatable (minimal human input once fully implemented), scalable (across electronic health records [EHRs] and training environments), and real-time (amenable to formative educational feedback loops). Ideally, TRACERs optimize all five characteristics to the greatest degree possible. TRACERs are uniquely focused on measures of clinical performance that are captured in the EHR, whether routinely collected or generated using sophisticated analytics, and are intended to complement (not replace) other sources of assessment data. TRACERs have the potential to contribute to a national system of high-density, trainee-attributable, patient-centered outcome measures.

Clinical Performance Measures for Emergency Department Care for Adults With Intracranial Hemorrhage

Though select inpatient-based performance measures exist for the care of patients with nontraumatic intracranial hemorrhage, emergency departments lack measurement instruments designed to support and improve care processes in the hyperacute phase. To address this, we propose a set of measures applying a syndromic (rather than diagnosis-based) approach informed by performance data from a national sample of community EDs participating in the Emergency Quality Network Stroke Initiative. To develop the measure set, we convened a workgroup of experts in acute neurologic emergencies. The group considered the appropriate use case for each proposed measure: internal quality improvement, benchmarking, or accountability, and examined data from Emergency Quality Network Stroke Initiative-participating EDs to consider the validity and feasibility of proposed measures for quality measurement and improvement applications. The initially conceived set included 14 measure concepts, of which 7 were selected for inclusion in the measure set after a review of data and further deliberation. Proposed measures include 2 for quality improvement, benchmarking, and accountability (Last 2 Recorded Systolic Blood Pressure Measurements Under 150 and Platelet Avoidance), 3 for quality improvement and benchmarking (Proportion of Patients on Oral Anticoagulants Receiving Hemostatic Medications, Median ED Length of Stay for admitted patients, and Median Length of Stay for transferred patients), and 2 for quality improvement only (Severity Assessment in the ED and Computed Tomography Angiography Performance). The proposed measure set warrants further development and validation to support broader implementation and advance national health care quality goals. Ultimately, applying these measures may help identify opportunities for improvement and focus quality improvement resources on evidence-based targets.

Abstract WP49: Clinical Performance Measures For Emergency Department Care For Adults With Nontraumatic Intracranial Hemorrhage

Study Objective: Though select inpatient-based performance measures exist for the care of patients with nontraumatic intracranial hemorrhage (ICH), Emergency Departments (EDs) lack measurement instruments designed to support and improve care processes in the hyperacute phase. To address this, we propose a set of measures applying a syndromic (rather than diagnosis-based) approach informed by performance data from a national sample of community EDs participating in the Emergency Quality Network Stroke Initiative (E-QUAL). Methods: We convened a workgroup of experts in acute neurologic emergencies. The group considered the appropriate use case for each proposed measure (internal quality improvement [QI], benchmarking, or accountability) and examined data from E-QUAL-participating EDs to consider the validity and feasibility of proposed measures. The initially conceived set included 14 measure concepts of which 7 were selected for inclusion in the measure set after review of data and further deliberation. To inform the process, we collected data from E-QUAL participating EDs. EDs used a web-based portal to submit data from chart reviews on patients with ICH during 2020-2021. Descriptive statistics characterize performance and identify variation. Results: Proposed measures include 2 for QI, benchmarking, and accountability, 3 for QI and benchmarking and 2 for QI only (Table). Of the E-QUAL participating EDs, 35 had sufficient case volume (≥25) and were included for review of preliminary performance data. Median annual ED volume was 44,000 (IQR 31,337-67,000) and 16 (48%) reported typically transferring patients with ICH. The Table includes available performance data. Conclusion: Application of these measures may identify opportunities for improvement and focus QI resources on evidence-based targets. The proposed measures warrant further development and validation to support broader implementation and advance national healthcare quality goals.