Surgical Care Improvement Project Research Articles

E-Measures: insight into the challenges and opportunities of automating publicly reported quality measures

Using electronic health records (EHR) to automate publicly reported quality measures is receiving increasing attention and is one of the promises of EHR implementation. Kaiser Permanente has fully or partly automated six of 13 the joint commission measure sets. We describe our experience with automation and the resulting time savings: a reduction by approximately 50% of abstractor time required for one measure set alone (surgical care improvement project). However, our experience illustrates the gap between the current and desired states of automated public quality reporting, which has important implications for measure developers, accrediting entities, EHR vendors, public/private payers, and government.

Organizational Performance and Regulatory Compliance as Measured by Clinical Pertinence Indicators Before and After Implementation of Anesthesia Information Management System (AIMS)

Previous studies have suggested that electronic medical records (EMR) can lead to a greater reduction of medical errors and better adherence to regulatory compliance than paper medical records (PMR). In order to assess the organizational performance and regulatory compliance, we tracked different clinical pertinence indicators (CPI) in our anesthesia information management system (AIMS) for 5 years. These indicators comprised of the protocols from the Surgical Care Improvement Project (SCIP), elements of performance (EP) from The Joint Commission (TJC), and guidelines from the Centers for Medicare and Medicaid Services (CMS). A comprehensive AIMS was initiated and the CPI were collected from October 5, 2009 to December 31, 2010 (EMR period) and from January 1, 2006 to October 4, 2009 (PMR period). Fourteen CPI were found to be common between the EMR and PMR periods. Based on the statistical analysis of the 14 common CPI, there was a significant increase (p < 0.001) in overall compliance after the introduction of EMR compared to the PMR period. The increase in overall compliance was significantly progressive (p = 0.013) from year to year over 2006 and 2010. Of the 14 CPI, Documentation of a) medication doses, and b) monitoring of postoperative physiological status, mental status, and pain scores showed significant improvement (p < 0.001) during the EMR period compared to the PMR period.

Hyperglycemia after cardiac surgery: improving a quality measure.

The Surgical Care Improvement Project #4 (SCIP#4) performance measure is used to evaluate achievement of target blood glucose control after cardiac surgery. The purpose of this study was to identify patient characteristics and outcomes in patients undergoing cardiac surgery who met the SCIP#4 performance measure versus those who did not. A retrospective case-control design was used. Preoperative hemoglobin A1C (HbA1C) level and history of diabetes were 2 major risk factors for failing to meet the SCIP#4 measure. A trend toward a longer length of stay was observed, mortality was 3 times more prevalent, and renal failure was 4 times more frequent in patients who did not meet the SCIP#4 quality measure. Not meeting the SCIP#4 measure is associated with adverse outcomes. History of diabetes and preoperative HbAIC level should be considered when evaluating strategies for managing postsurgical hyperglycemia.

Optimizing the Safety of Surgery, Before Surgery

Optimizing the Safety of Surgery, Before Surgery

Prevention of surgical site infection in colorectal surgery

SUMMARY The rate of surgical site infection (SSI) for colorectal surgery is among the highest of all operations performed, ranging between 12 and 26% depending on definition applied, surveillance, the prevalence of emergency surgery and the penetration of laparoscopic surgery. With over 135,000 colorectal cancer operations per year, the cost of SSI to the healthcare system are in excess of US$1 billion a year. The Surgical Care Improvement Project (SCIP) has linked hospital reimbursement to compliance with five preventative process measures in colorectal surgery. The success of SCIP in reducing SSI is in doubt, but the addition of other evidence-based measures to SCIP might improve SSI rates. These measures, as well as the contributions of SCIP, are discussed in detail in this review. Implementation of some or all these measures, in addition to SCIP, should be considered by key stakeholders for baseline data collection, monitored for effectiveness and modified as necessary to improve outcomes.

283 * PRACTICE CHANGES IN BLOOD GLUCOSE MANAGEMENT FOLLOWING OPEN HEART SURGERY: FROM A PROSPECTIVE RANDOMIZED STUDY TO EVERYDAY PRACTICE

Objectives: Targeted blood glucose (BG) levels following cardiac surgery continues to be debated. According to STS guidelines BG should be <180 mg/dl following surgery while the Surgical Care Improvement Project recommends <200 mg/dl. However, based on published data, our practice and others shifted to stricter BG control (90-110 mg/dl). Recently, a randomized controlled trial (RCT) published by our group suggested no added value to stricter control over liberal control and we therefore shifted our management accordingly. The purpose of this study was to compare patient outcomes before and after the change to liberal BG management (BGM). Methods: BGM was changed in June 2011 from strict (90-110) to liberal (120-180). Insulin drips managed through a computerized algorithm controlled BG for the first 72 hours post-surgery. Consecutive cardiac surgery patients operated throughout the one year prior to BGM change (n = 934) were propensity score matched to patients operated on throughout one year after the change (n = 927). Results: After matching there were 846 patient pairs. There was no difference between cohorts for length of stay and perioperative complications and both cohorts achieved acceptable outcomes. The incidence of perioperative renal failure (P = 0.02) and renal failure requiring dialysis (P = 0.004) was better for the cohort with liberal BGM. One-year cumulative survival did not differ between cohorts (log-rank = 0.03, P = 0.87). Conclusions: Implementation of liberal BGM into clinical practice did not increase morbidity. The present results confirm our prior findings that a liberal strategy to maintain BG is equal to the stricter target range. These findings are significant for patient care and demonstrate the safety and efficacy of practice change for all patients following a successful RCT.

Urinary Catheter Management

After colorectal resection surgery, early urinary catheter removal has been promoted as a part of the national Surgical Care Improvement Project. However, the decrease in urinary tract infection expected with this strategy must be balanced against an increased risk for urinary retention. A systematic review of the literature was undertaken to summarize the evidence for and against early postoperative urinary catheter removal. For nonpelvic colorectal resection, the evidence supports removal of the catheter on postoperative day 1 for patients who are not at high risk for urinary retention, including patients with thoracic epidurals. For mid-to-low rectal surgery, the risk of urinary retention is increased, and catheter removal on day 3 to day 6 is recommended; however, the exact timing of removal cannot be recommended based on current studies.

Appropriateness of Surgical Antimicrobial Prophylaxis in the Latium Region of Italy, 2008: A Multicenter Study

There is still wide variability in surgical antimicrobial prophylaxis (SAP) practice by different surgical teams and specialties, with potential impact on adverse events and the emergence of antibiotic resistance. We assessed SAP appropriateness in a regional prospective multicenter study on the basis of the agreement of the Surgical Care Improvement Project indicators (SCIP-Inf) with Italian guidelines (GL). Prophylaxis was administered in 2,664 of 2,835 procedures (94%): In 2,346 of 2,468 (95%) as indicated and in 318 of 367 (86.6%) in which they were not indicated. The SCIP-Inf1 (timing), SCIP-Inf2 (antibiotic choice), and SCIP-Inf3 (duration) were in agreement with GL in 1,172 (50%), 1,983 (84.5%), and 1,121 (48%) of 2,346 procedures, respectively. These results suggest the need for implementation of an antimicrobial stewardship program in this surgical setting.

Timing of Surgical Antibiotic Prophylaxis and the Risk of Surgical Site Infection

Timing of prophylactic antibiotic administration for surgical procedures is a nationally mandated and publicly reported quality metric sponsored by the Centers for Medicare and Medicaid Services Surgical Care Improvement Project. Numerous studies have failed to demonstrate that adherence to the Surgical Care Improvement Project prophylactic antibiotic timely administration measure is associated with decreased surgical site infection (SSI). OBJECTIVE; To determine whether prophylactic antibiotic timing is associated with SSI occurrence. Retrospective cohort study using national Veterans Affairs patient-level data on prophylactic antibiotic timing for orthopedic, colorectal, vascular, and gynecologic procedures from 2005 through 2009. National Veterans Affairs Surgical Care Improvement Project data from 112 Veterans Affairs hospitals and matched Veterans Affairs Surgical Quality Improvement Program data. Patients undergoing hip or knee arthroplasty, colorectal surgical procedures, arterial vascular surgical procedures, and hysterectomy. Timing of prophylactic antibiotic administration with respect to surgical incision time. Data for prophylactic antibiotic agent, prophylactic antibiotic timing with respect to surgical incision, and patient and procedure risk variables were assessed for their relationship with the occurrence of a composite superficial or deep incisional SSI within 30 days after the procedure. Nonlinear generalized additive models were used to examine the association between antibiotic timing and SSI. Of the 32,459 operations, prophylactic antibiotics were administered at a median of 28 minutes (interquartile range, 17-39 minutes) prior to surgical incision, and 1497 cases (4.6%) developed an SSI. Compared with procedures with antibiotic administration within 60 minutes prior to incision, higher SSI rates were observed for timing more than 60 minutes prior to incision (unadjusted odds ratio [OR] = 1.34; 95% CI, 1.08-1.66) but not after incision (unadjusted OR = 1.26; 95% CI, 0.92-1.72). In unadjusted generalized additive models, we observed a significant nonlinear relationship between prophylactic antibiotic timing and SSI when considering timing as a continuous variable (P = .01). In generalized additive models adjusted for patient, procedure, and antibiotic variables, no significant association between prophylactic antibiotic timing and SSI was observed. Vancomycin hydrochloride was associated with higher SSI occurrence for orthopedic procedures (adjusted OR = 1.75; 95% CI, 1.16-2.65). Cefazolin sodium and quinolone in combination with an anaerobic agent were associated with fewer SSI events (cefazolin: adjusted OR = 0.49; 95% CI, 0.34-0.71; quinolone: adjusted OR = 0.55; 95% CI, 0.35-0.87) for colorectal procedures. The SSI risk varies by patient and procedure factors as well as antibiotic properties but is not significantly associated with prophylactic antibiotic timing. While adherence to the timely prophylactic antibiotic measure is not bad care, there is little evidence to suggest that it is better care.

Assessment of Prophylactic Antibiotic Use in Patients with Surgical Site Infections

Surgical site infections (SSIs) are the leading cause of hospital-acquired infections and are associated with substantial health care costs, with increased morbidity and death. The Surgical Care Improvement Project (SCIP) contains standards that are nationally reported with the aim of improving patient outcomes after surgery. Our institution's standards for antimicrobial prophylaxis in the perioperative period are more stringent than these measures and may be considered "beyond SCIP." The 4 elements of appropriate antimicrobial prophylaxis are timing, antibiotic selection, dosing, and intraoperative redosing. To quantify antimicrobial SSI prophylaxis compliance in accordance with institutional standards and to identify potential opportunities for improvement. Patients aged 18 years or older were included if they had an SSI between January 1, 2009, and June 30, 2010, according to the database maintained prospectively by the Infection Prevention and Control Unit. Adherence to our institution's practice standards was assessed through analysis of antibiotics administered-timing in relation to the incision, closure, and tourniquet inflation times for the procedure and antibiotic selection, dose, and redosing. Overall noncompliance with all 4 elements of antimicrobial prophylaxis was 75.4% among the 760 cases. Repeat dosing had the greatest noncompliance (45.1%); antibiotic selection had the lowest incidence of noncompliance (10.8%). Noncompliance existed in each element of antimicrobial SSI prophylaxis, with antibiotic redosing leading in noncompliance. With the implementation of tools to assist the surgical team in following institutional standards, noncompliance will likely decline and additional research opportunities will exist.

Surgeon-Specific Performance Reports in General Surgery: An Observational Study of Initial Implementation and Adoption

As national quality initiatives are increasing requirements for individual physician data, our department of surgery initiated a surgeon-specific reporting (SSR) program to assess the value of personal knowledge on individual performance quality. We sought to evaluate the use of SSR as a tool to enable surgeons to assess and improve their clinical performance, and to identify barriers to use of their reports. Qualitative research design involving semistructured interviews of surgeons who received performance reports derived from National Surgical Quality Improvement Program (NSQIP), Surgical Care Improvement Project (SCIP), and the Centers for Medicare and Medicaid Services (CMS) core measures and hospital administrative data. Transcripts were analyzed by the constant comparative method. Twenty-four of 39 surgeons (61.5%) who received their SSRs agreed to be interviewed and 23 were interviewed. About half (11 of 23) demonstrated comprehension of the data validity, accuracy, or complexity. Of these, 6 took steps to validate data or improve performance. Most respondents believed SSR would lead to performance improvement through knowledge of personal outcomes and peer comparison; however, they perceived SSR had limitations, such as small sample size and potential coding errors, and could lead to unintended consequences, such as inaccurate interpretation by others and surgeons' aversion to selecting high-risk patients. Respondents also suggested logistical improvements to reporting methods, such as report format and definitions of metrics. Surgeon-specific reporting has the potential to empower surgeons to improve their practice; however, more surgeons need efficient guidelines to understand the metrics. Our findings can be used to guide development of more SSR programs. Whether SSR programs lead to improvements in surgical outcomes is a matter for future research.

Beyond surgical care improvement program compliance: antibiotic prophylaxis implementation gaps

BackgroundDespite increased compliance with Surgical Care Improvement Project infection measures, surgical-site infections are not decreasing. The aim of this study was to test the hypothesis that documented compliance with antibiotic prophylaxis guidelines on a pediatric surgery service does not reflect implementation fidelity or adherence to guidelines as intended. MethodsA 7-week observational study of elective pediatric surgical cases was conducted. Adherence was evaluated for appropriate administration, type, timing, weight-based dosing, and redosing of antibiotics. ResultsProphylactic antibiotics were administered appropriately in 141 of 143 cases (99%). Of 100 cases (70%) in which antibiotic prophylaxis was indicated, compliance was documented in 100% cases in the electronic medical record, but only 48% of cases adhered to all 5 guidelines. Lack of adherence was due primarily to dosing or timing errors. ConclusionsLack of implementation fidelity in antibiotic prophylaxis guidelines may partly explain the lack of expected reduction in surgical-site infections. Future studies of Surgical Care Improvement Project effectiveness should measure adherence and implementation fidelity rather than just documented compliance.

Perioperative antibiotics for surgical site infection in pancreaticoduodenectomy: Does the SCIP-approved regimen provide adequate coverage?

The Joint Commission Surgical Care Improvement Project (SCIP) includes performance measures aimed at reducing surgical site infections (SSI). One measure defines approved perioperative antibiotics for general operative procedures. However, there may be a subset of procedures not adequately covered with the use of approved antibiotics. We hypothesized that piperacillin-tazobactam is a more appropriate perioperative antibiotic for pancreaticoduodenectomy (PD). In collaboration with hospital epidemiology and the Division of Infectious Diseases, we retrospectively reviewed records of 34 patients undergoing PD between March and May 2008 who received SCIP-approved perioperative antibiotics and calculated the SSI rate. After changing our perioperative antibiotic to piperacillin-tazobactam, we prospectively reviewed PDs performed between June 2008 and March 2009 and compared the SSI rates before and after the change. For 34 patients from March through May 2008, the SSI rate for PD was 32.4 per 100 cases. Common organisms from wound cultures were Enterobacter and Enterococcus (50.0% and 41.7%, respectively), and these were cefoxitin resistant. From June 2008 through March 2009, 106 PDs were performed. During this period, the SSI rate was 6.6 per 100 surgeries, 80% lower than during March through May 2008 (relative risk, 0.204; 95% confidence interval [CI], 0.086-0.485; P = .0004). Use of piperacillin-tazobactam as a perioperative antibiotic in PD may reduce SSI compared with the use of SCIP-approved antibiotics. Continued evaluation of SCIP performance measures in relationship to patient outcomes is integral to sustained quality improvement.

Is the Elimination of Postoperative Antimicrobial Prophylaxis in Thoracic Surgery Ready for Prime Time?

M any retrospective series conclude with the admonition that the findings should be corroborated by a well-designed, randomized clinical trial. With regard to the use of antibiotics following thoracic surgery, that study is now available. Oxman and colleagues provide us with a well-conducted, randomized study suggesting that routinely extending antimicrobial prophylaxis into the postoperative period is of no value in preventing infectious complications following thoracic surgery involving tube thoracostomy. Contemporary perioperative guidelines reflect the growing awareness that, for many operations, exposure to antibiotics postoperatively may be ineffective and increases the risk of adverse events. Procedures involving drainage of sterile body cavities such as the pleural space, however, appear to be qualitatively different. The idea of allowing foreign materials to communicate with the outside world unprotected by systemic antibiotics, particularly in the early postoperative period, provokes at least some anxiety among surgeons. These findings may reduce this anxiety and arguably expose the false solace of postoperative prophylaxis, at least in routine, elective cases involving chest tubes. Although the results are compelling, it is important to note that their study, conducted at a single institution, may not reflect real-world processes of care where preoperative prophylaxis is not consistently timely and antibiotic choice is not always appropriate, especially in areas of the world not exposed to value-based payment strategies such as the Surgical Care Improvement Project in the United States. In addition, the reader will take note of the short median time to chest tube removal and the short median length of hospital stay in comparison with those in published data from large data sets. Perhaps it is meticulous aerostasis during surgery and prompt chest tube removal that make postoperative antimicrobial prophylaxis irrelevant. If so, the findings in this study by Oxman and colleagues may not be immediately generalizable as long as real-world measures continue to fall short of those best practices exemplified by their study.

Surgical Care Improvement Project (SCIP): Has Its Mission Succeeded?

The purpose of this study was to determine if adherence to the surgical care improvement project (SCIP) measures could further reduce rate of surgical site infection (SSI) and venous thromboembolism (VTE) in total joint arthroplasty (TJA) patients. We retrospectively identified all patients who underwent primary or revision TJA at our institution between July 2000 and June 2009. After implementation of SCIP measures, rate of superficial SSI increased (0.42% versus 0.60%, P=0.05) while rate of deep SSI decreased from 0.92% to 0.82% (P=0.46). The rate of DVT was 0.92% before and 0.83% after implementation of SCIP (P=0.51); however, rate of PE increased from 0.87% to 1.30% (P=0.002). Our findings indicated that SCIP has not been successful in reducing complications in TJA patients.

Surgical care improvement project and surgical site infections: can integration in the surgical safety checklist improve quality performance and clinical outcomes?

IntroductionThe World Health Organization Surgical Safety Checklist (SSC) has been shown to decrease surgical site infections (SSI). The Surgical Care Improvement Project (SCIP) SSI reduction bundle (SCIP Inf) contains elements to improve SSI rates. We wanted to determine if integration of SCIP measures within our SSC would improve SCIP performance and patient outcomes for SSI. MethodsAn integrated SSC that included perioperative SCIP Inf measures (antibiotic selection, antibiotic timing, and temperature management) was implemented. We compared SCIP Inf compliance and patient outcomes for 1-y before and 1-y after SSC implementation. Outcomes included number of patients with initial post-anesthesia care unit temperature <98.6°F and SSI rates according to our National Surgical Quality Improvement Program data. ResultsImplementation of a SCIP integrated SSC resulted in a significant improvement in antibiotic infusion timing (92.7% [670/723] versus 95.4% [557/584]; P < 0.05), antibiotic selection (96.2% [707/735] versus 98.7% [584/592]; P < 0.01), and temperature management (93.8% [723/771] versus 97.7% [693/709]; P < 0.001). Furthermore, we found a significant reduction in number of patients with initial post-anesthesia care unit temperature <98.6°F from 9.7% (982/10,126) to 6.9% (671/9676) (P < 0.001). Institutional SSI rates decreased from 3.13% (104/3319) to 2.96% (107/3616), but was not significant (P = 0.72). SSI rates according to specialty service were similar for all groups except colorectal surgery (24.1% [19/79] versus 11.5% [12/104]; P < 0.05). ConclusionImplementation of an integrated SSC can improve compliance of SSI reduction strategies such as SCIP Inf performance and maintenance of normothermia. This did not, however, correlate with an improvement in overall SSI at our institution. Further investigation is required to determine other factors that may influence SSI at an institutional level.

Role of the Pharmacist in Achieving Performance Measures to Improve the Prevention and Treatment of Venous Thromboembolism

Current prescribing practices for venous thromboembolism (VTE) prophylaxis and treatment are suboptimal, particularly regarding the use of appropriate prophylaxis in accordance with evidence-based guidelines. Failure to prevent avoidable VTE is associated with a substantial clinical and economic burden, due not only to the initial event, but also to VTE recurrence and long-term sequelae. Quality improvement initiatives such as the Surgical Care Improvement Project, the Centers for Medicare and Medicaid Services, the National Quality Forum, and The Joint Commission have developed performance measures to address the shortfall and improve adherence with best-practice recommendations. Several studies have highlighted the benefits of pharmacist-led anticoagulation services for reducing the occurrence of VTE and bleeding complications while reducing excess hospitalization and health care costs. By assuming responsibility for anticoagulation management, pharmacists can ensure that at-risk patients receive the correct drug at the correct dose for the correct duration, from initial presentation to outpatient follow-up. Increasing continuity of care in this manner will ultimately improve patient outcomes and reduce costs. Pharmacists can also play a key role in helping hospitals achieve performance measures by aiding in the development and implementation of local VTE guidelines, policies, and other quality improvement initiatives; by helping to establish critical pathways with protocols; and by providing valuable education for other health care professionals and patients alike. Pharmacists are in an ideal position to facilitate achievement of VTE-related performance measures and can thus substantially contribute to the much-needed improvement in current VTE prevention and care.

Antimicrobial prophylaxis may not be the answer: Surgical site infections among patients receiving care per recommended guidelines

It is believed that compliance with all 3 components of perioperative antimicrobial prophylaxis, ie, timing, choice, and duration, yields greater reduction in surgical site infections (SSI). An observational study was performed among patients in the surgical care improvement project at a tertiary public academic hospital in the United States. The rates of SSI among patients who received appropriate antimicrobial agent(s) per current guidelines were compared with patients who did not. Medical record review was performed to compare the clinical characteristics of patients with SSI (cases) and an equal number of patients without SSI (matched controls). From January 2008 to June 2009, 762 patients underwent 763 eligible surgical procedures. Forty-seven (6.2%) developed SSI. The rate of SSI in patients who received appropriate antimicrobial prophylaxis per guidelines was not different from those who did not (42/611, 6.9% vs 5/152, 3.3%, respectively; P value = .13). Patients with SSI were more likely to have an elevated body mass index (median and interquartile range in cases: 28.7 [27.0-34.9] vs 25.0 [22.4-30.4] in controls; P value = .02) and more likely to have diabetes (36% vs 9%, respectively; odds ratio, 5.71; 95% confidence interval: 1.43-22.8; P value = .02). Compliance with timing, choice, and duration of antimicrobial prophylaxis as a whole did not lead to lower SSI. Elevated body mass index and diabetes were associated with a higher rate of SSI.

Antibiotic Choice Is Independently Associated With Risk of Surgical Site Infection After Colectomy

To determine which perioperative care practices are associated with decreased risk of surgical site infection (SSI) after colectomy surgery. Optimization of perioperative care has been a common strategy for improving surgical safety, but the relationship between process measure compliance and surgical complication rates is controversial. This is a retrospective cohort study performed within the Michigan Surgical Quality Collaborative (MSQC), an organization of hospitals that prospectively collects patient data, processes of care, and 30-day outcomes. Patients undergoing colectomy surgery (n = 4331) were studied. Factors potentially associated with SSI were tested using univariate statistical tests, and a hierarchical generalized linear model was created to test for independent associations between processes of care and SSI, while adjusting for patient risk factors and clustering of patients within hospitals. Several perioperative care practices were independently associated with lower risk of SSI after adjustment for patient risk, procedure type/duration, and clustering of patients by hospital site. Best practices include selection of a Surgical Care Improvement Project (SCIP-2)-compliant prophylactic intravenous antibiotic, postoperative normothermia, postoperative day 1 glucose control, and oral antibiotics given when bowel prep used (SCIP-1 was not significant). Further, several specific prophylactic antibiotic choices were independently associated with lower SSI rates, including cefazolin/metronidazole, ciprofloxacin/metronidazole, and ertapenem. In Michigan, several perioperative care practices are independently associated with decreased risk of SSI after colectomy, including SCIP-2-compliant prophylactic antibiotics, postoperative normothermia, glucose control, and oral antibiotics. Furthermore, specific prophylactic antibiotic choices are associated with lower risk of SSI. These results account for patient factors and unmeasured hospital effects, suggesting that dissemination of these perioperative care practices may decrease SSI rates.

Prophylactic Antibiotics for Surgical Site Infection in Pancreaticoduodenectomy: Does The SCIP-approved Regimen Provide Adequate Coverage?

The Joint Commission Surgical Care Improvement Project (SCIP) includes performance measures aimed at reducing surgical site infections (SSI). One measure defines approved prophylactic antibiotics for general surgery procedures. However, there may be a subset of procedures not adequately covered with the use of approved antibiotics. We hypothesized that piperacillin-tazobactam is a more appropriate prophylactic antibiotic for pancreaticoduodenectomy.