Performance Improvement Continuing Medical Education Research Articles

Performance improvement CME for quality: challenges inherent to the process

The purpose of this paper is to discuss the perspective debates upon the real-time challenges for a three-staged Performance Improvement Continuing Medical Education (PI-CME) model, an innovative and potential approach for future CME, to inform providers to think, prepare and to act proactively. In this discussion, the challenges associated for adopting the American Medical Association's three-staged PI-CME model are reported. Not many institutions in USA are using a three-staged performance improvement model and then customizing it to their own healthcare context for the specific targeted audience. They integrate traditional CME methods with performance and quality initiatives, and linking with CME credits. Overall the US health system is interested in a structured PI-CME model with the potential to improve physicians practicing behaviors. Knowing the dearth of evidence for applying this structured performance improvement methodology into the design of CME activities, and the lack of clarity on challenges inherent to the process that learners and providers encounter. This paper establishes all-important first step to render the set of challenges for a three-staged PI-CME model.

CHAMBER: A Regional Performance Improvement CME Initiative for Breast Cancer Health Care Providers.

CHAMBER was a regional educational initiative for providers of care to patients with HER2+ breast cancer. The study goals were to (1) enhance testing for HER2/neu overexpression in patients with invasive breast cancer; (2) increase the appropriate use of targeted therapy for patients with HER2+ breast cancer; and (3) enhance patients' coping ability. This Performance Improvement Continuing Medical Education (PI-CME) initiative included clinical practice assessment, educational activities, and reassessment. Chart review revealed a high rate of HER2 testing (98%) before and after education. Targeted therapy for patients with HER2+ breast cancer declined after the program (from 96% to 61%), perhaps attributable to an increase in awareness of medical reasons to avoid use of targeted therapy. Assessment for patients' emotional coping ability increased after education (from 55% to 76%; P=.01). Rates of testing for HER2 amplification and assessment of emotional well-being after education were consistent with ASCO Quality Oncology Practice Initiative benchmark values. Documentation of actions to address emotional problems remained an area for improvement.

A performance improvement initiative for enhancing the care of patients with depression.

Depression is a common and potentially disabling condition, yet many patients remain undiagnosed, and many more fail to receive adequate treatment. To address this gap, clinicians must routinely evaluate patient care practices. The purpose of this study was to evaluate the effectiveness of a three-stage performance improvement (PI) continuing medical education (CME) initiative to strengthen evidence-based psychiatric practices for the screening and management of patients with depression. A total of 492 physician participants voluntarily registered to complete a three-stage initiative consisting of self-evaluation, improvement, and reevaluation. Participants were recruited through a series of faxes, e-mails, and direct-mail invitations. Approximately 20% (n=86) of the registrants completed the three-stage initiative. Completers provided chart data on 2,122 patients encountered before and 2,130 patients encountered after engaging in the PI CME activity. Large gains were made in the percentage of patients screened using standardized criteria to assess depression status, particularly the Patient Health Questionnaire-2 (PHQ-2) and the PHQ-9 (26% of 1,378 patients at Stage A vs.68% of 1,711 patients at Stage C; p<0.001). Physicians were also more likely to rescreen patients 4 to 8 weeks after initial screening (48% of 1,961 patients at Stage A vs. 75% of 2,028 patients at Stage C; p<0.001) and to assess patient adherence to antidepressants using standardized measures (10% of 1,909 patients at Stage A vs. 45% of 1,740 patients at Stage C; p<0.001). PI CME provides insight into and aids in improving evidence-based patient care in psychiatric practices.

Improving Foot Examinations in Patients With Diabetes

The purpose of this project was to determine if a Performance-Improvement Continuing Medical Education (PI-CME) project, using the American Medical Association's methodology, would help improve the timeliness and comprehensiveness of foot examinations in patients with diabetes. A PI-CME project was conducted with the Internal Medicine faculty staff physicians (n = 8) and residents (n = 45). Following the 3 steps of PI-CME, participants received baseline reports about their performance defined by the American Diabetes Association's guidelines for foot examinations (stage A). Each group received an educational intervention (stage B) and a reminder tool for use in the practice. Participants received individualized reports about their performance post intervention (stage C) for comparison with preintervention data and reflection on any changes in compliance. In the faculty and resident clinics, the percentage of patients who received an annual foot examination when due increased significantly. Both clinics also showed improvements in the percentage of patients who received all 3 components of the exam, with the greatest improvement in the resident clinic. The PI-CME approach can be successfully used both with faculty staff physicians (who receive CME credits) and residents (who do not receive credits) to improve performance on diabetes quality measures.

Continuing Improvement in Type 2 Diabetes Care Through Performance-Based Evaluations

The timely evidence-based care of type 2 diabetes mellitus (T2DM) is imperative for achieving and maintaining glycemic control, reducing complications, and changing the paradigm of this epidemic. Based largely on results from earlier performance improvement (PI) activities, we conducted a continuing medical education (CME)-certified PI activity to foster improved adherence to guideline recommendations and current evidence for the care of patients with T2DM. Participants engaged in a 3-stage process of self-assessment, goal setting, and reassessment. A total of 64 clinicians completed the entire PI process, abstracting data from 1600 patient charts before and after a period of self-improvement. After the intervention, clinicians were more likely to assess patients for disease-related complications and provide counseling on proper nutrition, exercise, and smoking cessation. Patients with A1C, blood pressure (BP), and low-density lipoprotein cholesterol (LDL-C) values above goal (defined as A1C ≥7, BP ≥130/80 mm Hg, and LDL-C >100 g/dL) were more likely to receive treatment modifications compared with baseline clinician performance. Significant changes observed in patient outcomes included improved mean A1C values (baseline 7.5% vs postintervention 7.3%; P = .027), decreased likelihood of BP at or above 130/80 mm Hg (baseline 37% vs postintervention 30%; P < .001), and decreased likelihood of LDL-C above 100 g/dL (baseline 33% vs postintervention, 27%; P < .001). Significant changes in clinician performance of key quality measures were reported in patients with T2DM after a PI CME activity improved adherence to evidence-based recommendations of care.

Impact of Performance Improvement Continuing Medical Education on Cardiometabolic Risk Factor Control: The COSEHC Initiative

The Consortium for Southeastern Hypertension Control (COSEHC) implemented a study to assess benefits of a performance improvement continuing medical education (PI CME) activity focused on cardiometabolic risk factor management in primary care patients. Using the plan-do-study-act (PDSA) model as the foundation, this PI CME activity aimed at improving practice gaps by integrating evidence-based clinical interventions, physician-patient education, processes of care, performance metrics, and patient outcomes. The PI CME intervention was implemented in a group of South Carolina physician practices, while a comparable physician practice group served as a control. Performance outcomes at 6 months included changes in patients' cardiometabolic risk factor values and control rates from baseline. We also compared changes in diabetic, African American, the elderly (> 65 years), and female patient subpopulations and in patients with uncontrolled risk factors at baseline. Only women receiving health care by intervention physicians showed a statistical improvement in their cardiometabolic risk factors as evidenced by a -3.0 mg/dL and a -3.5 mg/dL decrease in mean LDL cholesterol and non-HDL cholesterol, respectively, and a -7.0 mg/dL decrease in LDL cholesterol among females with uncontrolled baseline LDL cholesterol values. No other statistical differences were found. These data demonstrate that our PI CME activity is a useful strategy in assisting physicians to improve their management of cardiometabolic control rates in female patients with abnormal cholesterol control. Other studies that extend across longer PI CME PDSA periods may be needed to demonstrate statistical improvements in overall cardiometabolic treatment goals in men, women, and various subpopulations.

Impact of Performance-Improvement Strategies on the Clinical Care and Outcomes of Patients With Type 2 Diabetes.

I n 2004, the American Medical Association (AMA) approved the Performance Improvement (PI) educational process as a strategy for improving patient care.1 Through this process, clinicians earn AMA Physician's Recognition Award (PRA) Category 1 Credit ™ by completing three stages: Recognizing the need to improve the care of patients with type 2 diabetes,2–4 an AMA-style PI initiative was developed in 2008, and a second, updated activity was developed in 2009 to promote evidence-based care practices.5 Results from this initiative demonstrated statistically significant changes in clinician behavior.6 Despite this demonstrated change in provider behavior, the effect on outcomes at the patient level remained uncertain. This study sought to answer four questions related to the clinical effectiveness of PI-based continuing medical education (CME): 1. To what extent did participants who completed all three stages of the PI activity achieve improvements in the health of their patients with type 2 diabetes? 2. How did these improvements compare with improvements achieved by clinicians who participated in traditional CME-certified activities? 3. How did patient improvements achieved by PI completers compare with improvements achieved by clinicians who completed the first two stages but did not participate in the final chart review (Stage C) of the PI process? 4. Did PI completers differ from other clinicians in the provision of evidence-based care provided to patients with type 2 diabetes before participation in the PI CME? Understanding the unique clinical impact of PI CME will allow for the development of improved …

A Clinician Performance Initiative to Improve Quality of Care for Patients with Osteoporosis

Osteoporosis is a widespread but largely preventable disease. Improved adherence to screening and treatment recommendations is needed to reduce fracture and mortality rates. Additionally, clinicians face increasing demands to demonstrate proficient quality patient care aligning with evidence-based standards. A three-stage, clinician-focused performance improvement (PI) continuing medical education (CME) initiative was developed to enhance clinician awareness and execution of evidence-based standards of osteoporosis care. Clinician performance was evaluated through a retrospective chart analysis of patients at risk or with a diagnosis of osteoporosis. Seventy-five participants reported their patient practices on a total of 1875 patients before and 1875 patients after completing a PI initiative. Significant gains were made in the use of Fracture Risk Assessment Tool (FRAX) (stage A, 26%, n=1769 vs. stage C, 51%, n=1762; p<0.001), assessment of fall risk (stage A, 46%, n=1276 vs. stage C, 89%, n=1190; p<0.001), calcium levels (stage A, 62%, n=1451 vs. stage C, 89%, n=1443; p<0.001), vitamin D levels (stage A, 79%, n=1438 vs. stage C, 93%, n=1439; p<0.001), and medication adherence (stage A, 88%, n=1136 vs. stage C, 96%, n=1106; p<0.001). Gains in patient screening, treatment, and adherence were associated with an initiative promoting self-evaluation and goal setting. Clinicians must assess their performance to improve patient care and maintain certification. PI CME is a valid, useful educational tool for accomplishing these standards.

Enhancing the quality of care for patients with multiple sclerosis through performance improvement CME.

Multiple sclerosis (MS) is an inflammatory neurodegenerative disease marked by a heterogeneous clinical presentation and disease course. Although improvements in the recognition and management of MS have been made in recent years, challenges remain due to the complex nature of the disease. Clinicians must remain current with their skills as knowledge surrounding MS care continues to advance. Here we report results of a performance improvement (PI) continuing medical education (CME) activity that was designed to promote evidence-based care of patients with MS. Participants demonstrated significant improvements in assessing disease-related complications, treating cognitive dysfunction, assessing adherence, and providing disease-related educational materials. These data support the role of PI CME in improving clinician practices that align with quality MS patient care.

Effect of a performance improvement CME activity on management of patients with diabetes.

Primary care in the United States faces unprecedented challenges from an aging population and the accompanying prevalence of chronic disease. In response, continuing medical education (CME) initiatives have begun to adopt the principles of performance improvement (PI) into their design, although currently there is a dearth of evidence from national initiatives supporting the effectiveness of this methodology. The specific aim of this study was to demonstrate the value of a national PI-CME activity to improve the performance of physicians treating patients with diabetes. We analyzed data from the American Academy of Family Physicians' METRIC® PI-CME activity in a cohort of family physician learners. The study utilized the 3-stage design standard approved for PI-CME. Baseline and follow-up performance data across a range of clinical and systems-based measures were compared in aggregate. Data were assessed for 509 learners who completed the activity. Statistically significant changes occurred both for self-assessment of a range of practice aspects and for diabetes care measures. Learners recognized that the organization of their practices had improved, and mechanisms were in place for better staff feedback, as well as aspects of patient self-management. Based on the clinical data obtained from 11 538 patient charts, 6 out of 8 diabetes measures were significantly improved. The activity appears to have had a positive, measurable impact on the medical practice of learners and suggests that, when appropriately designed and executed, PI-CME on a national scale can be a useful vehicle to influence performance change in physicians and to inform future CME activities.

Improving Clinician Performance of Inpatient Venous Thromboembolism Risk Assessment and Prophylaxis

Clinicians are aware of the importance of thromboprophylaxis, and that the application of measures to prevent venous thromboembolism (VTE) occurrence in hospitalized patients must be improved. To enhance clinician execution of appropriate steps to reduce the risk of inpatient VTE, a performance improvement (PI) continuing medical education (CME) initiative consisting of 3 independent tracks for hospitalized patients–patients who are medically ill, patients receiving oncology treatment, and patients undergoing major orthopedic surgery–was designed and implemented. After a baseline chart review of select evidenced-based performance measures for VTE risk stratification and prevention, participants identified ≥ 1 area of personal improvement. Participants then engaged in a period of self-improvement and reassessed their performance with a second chart review. After participating in the PI CME activity, clinician participants in the medically ill track increased their documentation of VTE risk assessments upon patient admission from baseline (56% vs 93%, n = 250; P < 0.001) and their prescription of low-molecular-weight heparin, low-dose unfractionated heparin, or fondaparinux (72% vs 88%), n = 250; P < 0.001). Orthopedic-track participants were significantly more likely to prescribe 15 to 35 days of VTE prophylaxis after total hip arthroplasty or hip fracture surgery upon patient discharge compared with baseline (51%, n = 123 vs 61%, n = 107; P < 0.001). Oncology-track participants demonstrated a nonsignificant trend for assessing and documenting bleeding risk after participation in the PI CME activity (56% vs 68%, n = 80; P = 0.143). Improvements in evidence-based strategies to reduce the risk of inpatient VTE were associated with PI CME participation. Although areas for improvement remain, increased participant identification and use of prophylactic measures can reduce the risk of VTE in hospitalized patients.

Preventive Intervention in Diabetes

Competence and skills in overcoming clinical inertia for diabetes treatment, and actually supporting and assisting the patient through adherence and compliance (as opposed to just reiterating what they "should" be doing and then assigning them the blame if they fail) is a key component to success in addressing diabetes, and to date it is a component that has received little formal attention. To improve and systematize diabetes care, it is critical to move beyond the "traditional" continuing medical education (CME) model of imparting knowledge as the entirety of the educational effort, and move toward a focus on Performance Improvement CME. This new approach does not just teach new information but also provides support for improvements where needed most within practice systems based on targeted data-based on self-assessments for the entire system of care. Joslin data conclude that this new approach will benefit support, clinical, and office teams as well as the specialist. In short, the Performance Improvement CME structure reflects the needed components of the successful practice today, particularly for chronic conditions such as diabetes, including the focus on interdisciplinary team care and on quality improvement, which is becoming more and more aligned with reimbursement schemes, public and private, in the U.S.

The Long-Term Impact of a Performance Improvement Continuing Medical Education Intervention on Osteoporosis Screening

The purpose of this study is to determine whether a performance improvement continuing medical education (PI CME) initiative that utilizes quality improvement (QI) principles is effective in producing sustainable change in practice to improve the screening of patients at risk for osteoporosis. A health care center participated in a PI CME program designed to increase appropriate osteoporosis screening. There were eight 1-hour educational sessions for this activity over a 9-month period. Thirteen providers completed all 3 stages of the PI CME program. A variety of other clinicians, in addition to the 13 providers, participated in the educational sessions. Data were collected at the beginning and end of the PI CME activity and at three intervals during the 5 years after the completion of the activity. The percentage of tests for osteoporosis ordered and performed increased significantly from Stage A to Stage C of the PI CME activity and continued to increase after the completion of the PI CME activity. Follow-up data at 4 and 40 months (for ordering and performing osteoporosis screening) and 49 months (for performing the screening only) reflect the impact of the PI CME activity plus the continuing QI interventions. The percentage of BMD tests ordered continued to increase substantially over the post-PI CME periods: 4 and 40 months (F(3,46) = 4.04, p < .05). Similarly, the percentage of BMD tests performed continued to increase at 4, 40, and 49 months after the conclusion of the PI CME activity (F(4,55) = 12.55, p < .0001). The data indicate that PI CME utilizing QI principles can be effective in producing sustainable change in practice to improve the screening of patients at risk for osteoporosis. Further research is needed to determine the extent to which such changes can be directly attributed to this type of intervention.

Learning to collaborate: a case study of performance improvement CME.

Performance Improvement Continuing Medical Education (PI CME) is a mechanism for joining quality improvement (QI) in health care to continuing medical education (CME) systems together. Although QI practices and CME approaches have been recognized for years, what emerges from their integration is largely unfamiliar, because it requires the collaboration of CME providers and stakeholders within the health care systems who traditionally have not worked together and may not have the same understanding of QI issues to close performance gaps. This study describes how an academic institution and a community-based primary care practice collaborated to enhance patient care in the area of hypertension. It offers lessons learned from a PI CME activity in the area of hypertension. This was an observational case study. Data were collected through interviews, observations of educational events, and review of documents such as learning logs, which were designed to: (1) help physicians learn and change, (2) satisfy requirements for CME credit, (3) serve as the basis for reimbursement, and (4) provide data for the case study. Nine clinicians from one clinic completed the PI CME activity, achieved measurable improvements in their practice, and contributed to systems change. The study highlighted (1) the value of shared goals and agreement on the process among the participants, planners, and others involved; (2) the advantage of a multidisciplinary approach; (3) the importance of supporting clinicians' continuing motivation to participate; and (4) the need to allow sufficient time to enable the initiative to evolve. PI CME required unprecedented collaboration between CME planners and QI stakeholders to enable change in clinical practice.