Surveillance System Risk Index Research Articles

Performance, Revision, and Extension of the National Nosocomial Infections Surveillance System's Risk Index in Brazilian Hospitals

To assess the benefit of using procedure-specific alternative cutoff points for National Nosocomial Infections Surveillance (NNIS) risk index variables and of extending surgical site infection (SSI) risk prediction models with a postdischarge surveillance indicator. Open, retrospective, validation cohort study. Five private, nonuniversity Brazilian hospitals. Consecutive inpatients operated on between January 1993 and May 2006 (other operations of the genitourinary system [n = 20,723], integumentary system [n = 12,408], or musculoskeletal system [n = 15,714] and abdominal hysterectomy [n = 11,847]). For each procedure category, development and validation samples were defined nonrandomly. In the development samples, alternative SSI prognostic scores were constructed using logistic regression: (i) alternative NNIS scores used NNIS risk index covariates and cutoff points but locally derived SSI risk strata and rates, (ii) revised scores used procedure-specific alternative cutoff points, and (iii) extended scores expanded revised scores with a postdischarge surveillance indicator. Performances were compared in the validation samples using calibration, discrimination, and overall performance measures. The NNIS risk index showed low discrimination, inadequate calibration, and predictions with high variability. The most consistent advantage of alternative NNIS scores was regarding calibration (prevalence and dispersion components). Revised scores performed slightly better than the NNIS risk index for most procedures and measures, mainly in calibration. Extended scores clearly performed better than the NNIS risk index, irrespective of the measure or operative procedure. Locally derived SSI risk strata and rates improved the NNIS risk index's calibration. Alternative cutoff points further improved the specification of the intrinsic SSI risk component. Controlling for incomplete postdischarge SSI surveillance provided consistently more accurate SSI risk adjustment.

Validating a 3-Point Prediction Rule for Surgical Site Infection after Coronary Artery Bypass Surgery

Surgical site infection (SSI) after coronary artery bypass graft (CABG) surgery is an increasing healthcare problem. Investigators from Australia proposed a new, 3-point scale that assesses SSI risk on the basis of diagnosis of diabetes mellitus and body mass index. To validate the Australian Clinical Risk Index among patients undergoing CABG surgery in the United States. Nested case-control study involving patients undergoing CABG surgery at 9 hospitals during 1991-2002. Case patients were those who developed SSIs after CABG surgery. Control subjects were matched to case patients on the basis of hospital, age, and procedure date. Odds ratios (ORs) for SSIs were calculated for the comparison of case patients with control subjects for all risk categories determined using the Australian Clinical Risk Index and National Nosocomial Infections Surveillance System (NNIS) risk index. An adjusted area under the curve was used to compare predictive values among risk indices. Four hundred sixty patients were studied, including 269 patients with SSI and 191 control subjects. NNIS risk group 2 was associated with increased rate of SSI (OR, 1.79; 95% confidence interval [CI], 1.19-2.67). No patient had an NNIS risk index of 3. The remaining NNIS categories were not predictive of infection. In contrast, an increase in Australian Clinical Risk Index was associated with an increase in risk of SSI (category 2: OR, 2.39 [95% CI, 1.33-4.29]; category 3: OR, 4.46 [95% CI, 1.83-10.85]). The NNIS risk index predicts the risk of SSI associated with many procedures, but it has limited use in predicting the risk of SSI after CABG surgery. The new Australian Clinical Risk Index stratified patients into discrete groups associated with increased risk of SSI. Data from our study support the use of this new risk index in the US population.

Accounting for Incomplete Postdischarge Follow-Up During Surveillance of Surgical Site Infection by Use of the National Nosocomial Infections Surveillance System's Risk Index

We examined the usefulness of a simple method to account for incomplete postdischarge follow-up during surveillance of surgical site infection (SSI) by use of the National Nosocomial Infections Surveillance (NNIS) system's risk index. Retrospective cohort study that used data prospectively collected from 1993 through 2006. Five private, nonuniversity healthcare facilities in Belo Horizonte, Brazil. Consecutive patients undergoing the following NNIS operative procedures: 20,981 operations on the genitourinary system, 11,930 abdominal hysterectomies, 7,696 herniorraphies, 6,002 cholecystectomies, and 6,892 laparotomies. For each operative procedure category, 2 SSI risk models were specified. First, a model based on the NNIS system's risk index variables was specified (hereafter referred to as the NNIS-based model). Second, a modified model (hereafter referred to as the modified NNIS-based model), which was also based on the NNIS system's risk index, was specified with a postdischarge surveillance indicator, which was assigned the value of 1 if the patient could be reached during follow-up and a value of 0 if the patient could not be reached. A formal comparison of the capabilities of the 2 models to assess the risk of SSI was conducted using measures of calibration (by use of the Pearson goodness-of-fit test) and discrimination (by use of receiver operating characteristic curves). Goodman-Kruskal correlations (G) were also calculated. The rate of incomplete postdischarge follow-up varied between 29.8% for abdominal hysterectomies and 50.5% for cholecystectomies. The modified NNIS-based model for laparotomy did not show any significant benefit over the NNIS-based model in any measure. For all other operative procedures, the modified NNIS-based model showed a significantly improved discriminatory ability and higher G statistics, compared with the NNIS-based model, with no significant impairment in calibration, except if used to assess the risk of SSI after operations on the genitourinary system or after a cholecystectomy. Compared with the NNIS-based model, the modified NNIS-based model added potentially useful clinical information regarding most of the operative procedures. Further work is warranted to evaluate this method for accounting for incomplete postdischarge follow-up during surveillance of SSI.

Comparative Analysis of 75th Percentile Durations for Neurosurgical Procedures in France and in US National Noscomial Infection Surveillance System Data

The duration of surgical procedures and the 75th percentiles of those durations are considered in calculation of the US National Nosocomial Infection Surveillance (NNIS) system risk index score. To compare the durations of neurosurgical procedures in a hospital in western France with the durations in the NNIS data, 6,136 neurosurgical patients were followed up to determine surgical site infection rates. The surgical site infection rate was 1.9%, and the 75th percentile durations were lower than those in the NNIS data. The values from the NNIS data are thus inadequate for this neurosurgical center.

An approach to the study of potentially preventable nosocomial infections.

To analyze a method that identifies potentially preventable nosocomial infections, as a tool to evaluate the performance of infection control programs through quantification of their potential for reducing nosocomial infections. The database of the Study of the Prevalence of Nosocomial Infections in Spain (EPINE) was reanalyzed. The method was based on the use of false negatives of the classification table obtained from application of a fixed multiple logistic regression model, as an estimator of the number of potentially preventable nosocomial infections. The calculated number of patients with preventable infections was 7,493, which constituted 21.6% of the infected patients. Among hospital areas, intensive care had the lowest preventability rate (4.6%), whereas gynecology and obstetrics had the highest (40.6%). There was a significant inverse exposure-effect relationship between the proportion of preventable infections and the National Nosocomial Infections Surveillance (NNIS) System risk index. No correlation was observed between the prevalence of patients with nosocomial infection and the percentage of preventable infections. This analysis suggests that fewer nosocomial infections may be preventable in Spanish hospitals than previously assumed.

Does the Centers for Disease Control’s NNIS System Risk Index Stratify Patients Undergoing Cardiothoracic Operations by Their Risk of Surgical-Site Infection?

In 1991, the Centers for Disease Control and Prevention devised the National Nosocomial Infection Surveillance (NNIS) System risk index to stratify populations of surgical patients by the risk of acquiring surgical-site infections (SSIs). To determine whether the NNIS risk index adequately stratifies a population of cardiothoracic surgery patients by the risk of developing SSI. Case-control study. The University of Iowa Hospitals and Clinics, a 900-bed, midwestern, tertiary-care hospital. 201 patients with SSIs identified by prospective infection control surveillance and 398 controls matched by age, gender, type of procedure, and date of procedure. All patients underwent cardiothoracic operative procedures between November 1990 and January 1994. The SSI rate was 7.8%. Seventy-four percent of cases and 80% of controls had a NNIS risk index score of 1; 24% of cases and 16% of controls had a score of 2 (P=.05). Patients with a NNIS risk score > or =2 were 1.8 times more likely to develop an SSI than those with a NNIS score <2 (odds ratio, 1.83; 95% confidence interval, 1.14-2.94, P=.01). The duration of the procedure was the only component of the index that stratified the population by risk of SSI. The risk of SSI after cardiothoracic operations increases as the NNIS risk index score increases. However, this index only dichotomized the patient population on the basis of the procedure duration. More research is needed to develop a risk index that adequately stratifies the risk of SSI after cardiothoracic operations.