Effects of a statewide physician-led quality-improvement program on the quality of cardiac care.

BACKGROUND: Several states have implemented mandatory public reporting of outcomes of cardiac revascularization procedures. Washington is the first to develop a nonmandatory, physician-led reporting program with public accountability and universal hospital participation. The purpose of this study was to determine whether quality improvement interventions resulted in the correction of data deficiencies and performance outliers for cardiac revascularization procedures. METHODS: From 1999 through 2003, there were 18 hospitals with coronary bypass surgery and interventional cardiology programs and 12 with only the latter. All patients > or =18 years undergoing 24372 isolated coronary bypass surgeries and 59,656 percutaneous coronary interventions were included. After 1999 to 2001 data were analyzed in early 2002, the Clinical Outcomes Assessment Program implemented a 6-step quality-improvement intervention to measure and remeasure data quality, process compliance, and performance. RESULTS: In 2003, 4 of the 18 surgery programs had 1 statistical outlier with respect to 4 performance measures, whereas 2 of 30 coronary intervention programs were mortality outliers. For bypass surgery, all programs maintained full compliance with program standards by adhering to timely and reliable submission of data, developing plans to address performance outliers, and demonstrating that outlier status did not persist from baseline to remeasurement. For coronary interventions, 1 program was a persistent outlier for mortality in 2002 and 2003. CONCLUSIONS: The Clinical Outcomes Assessment Program has successfully monitored cardiac care patterns in Washington State over a 5-year period. Most hospitals that perform coronary revascularization procedures meet acceptable performance standards.

The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1--coronary artery bypass grafting surgery.

BACKGROUND: The first version of The Society of Thoracic Surgeons National Adult Cardiac Surgery Database (STS NCD) was developed nearly 2 decades ago. Since its inception, the number of participants has grown dramatically, patient acuity has increased, and overall outcomes have consistently improved. To adjust for these and other changes, all STS risk models have undergone periodic revisions. This report provides a detailed description of the 2008 STS risk model for coronary artery bypass grafting surgery (CABG). METHODS: The study population consisted of 774,881 isolated CABG procedures performed on adult patients aged 20 to 100 years between January 1, 2002, and December 31, 2006, at 819 STS NCD participating centers. This cohort was randomly divided into a 60% training (development) sample and a 40% test (validation) sample. The development sample was used to identify predictor variables and estimate model coefficients. The validation sample was used to assess model calibration and discrimination. Model outcomes included operative mortality, renal failure, stroke, reoperation for any cause, prolonged ventilation, deep sternal wound infection, composite major morbidity or mortality, prolonged length of stay (> 14 days), and short length of stay (< 6 days and alive). Candidate predictor variables were selected based on their availability in versions 2.35, 2.41, and 2.52.1 of the STS NCD and their presence in (or ability to be mapped to) version 2.61. Potential predictor variables were screened for overall prevalence in the study population, missing data frequency, coding concerns, bivariate relationships with outcomes, and their presence in previous STS or other CABG risk models. Supervised backwards selection was then performed with input from an expert panel of cardiac surgeons and biostatisticians. After successfully validating the fit of the models, the development and validation samples were subsequently combined, and the final regression coefficients were estimated using the overall combined (development plus validation) sample. RESULTS: The c-index for the mortality model was 0.812, and the c-indices for other endpoints ranged from 0.653 for reoperation to 0.793 for renal failure in the validation sample. Plots of observed versus predicted event rates revealed acceptable calibration in the overall population and in numerous subgroups. When patients were grouped into categories of predicted risk, the absolute difference between the observed and expected event rates was less than 1.5% for each endpoint. The final model intercept and coefficients are provided. CONCLUSIONS: New STS risk models have been developed for CABG mortality and eight other endpoints. Detailed descriptions of model development and testing are provided, together with the final algorithm. Overall model performance is excellent.

The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 2--isolated valve surgery.

BACKGROUND: Adjustment for case-mix is essential when using observational data to compare surgical techniques or providers. That is most often accomplished through the use of risk models that account for preoperative patient factors that may impact outcomes. The Society of Thoracic Surgeons (STS) uses such risk models to create risk-adjusted performance reports for participants in the STS National Adult Cardiac Surgery Database (NCD). Although risk models were initially developed for coronary artery bypass surgery, similar models have now been developed for use with heart valve surgery, particularly as the proportion of such procedures has increased. The last published STS model for isolated valve surgery was based on data from 1994 to 1997 and did not include patients undergoing mitral valve repair. STS has developed new valve surgery models using contemporary data that include both valve repair as well as replacement. Expanding upon existing valve models, the new STS models include several nonfatal complications in addition to mortality. METHODS: Using STS data from 2002 to 2006, isolated valve surgery risk models were developed for operative mortality, permanent stroke, renal failure, prolonged ventilation (> 24 hours), deep sternal wound infection, reoperation for any reason, a major morbidity or mortality composite endpoint, prolonged postoperative length of stay, and short postoperative length of stay. The study population consisted of adult patients who underwent one of three types of valve surgery: isolated aortic valve replacement (n = 67,292), isolated mitral valve replacement (n = 21,229), or isolated mitral valve repair (n = 21,238). The population was divided into a 60% development sample and a 40% validation sample. After an initial empirical investigation, the three surgery groups were combined into a single logistic regression model with numerous interactions to allow the covariate effects to differ across these groups. Variables were selected based on a combination of automated stepwise selection and expert panel review. RESULTS: Unadjusted operative mortality (in-hospital regardless of timing, and 30-day regardless of venue) for all isolated valve procedures was 3.4%, and unadjusted in-hospital morbidity rates ranged from 0.3% for deep sternal wound infection to 11.8% for prolonged ventilation. The number of predictors in each model ranged from 10 covariates in the sternal infection model to 24 covariates in the composite mortality plus morbidity model. Discrimination as measured by the c-index ranged from 0.639 for reoperation to 0.799 for mortality. When patients in the validation sample were grouped into 10 categories based on deciles of predicted risk, the average absolute difference between observed versus predicted events within these groups ranged from 0.06% for deep sternal wound infection to 1.06% for prolonged postoperative stay. CONCLUSIONS: The new STS risk models for valve surgery include mitral valve repair as well as multiple endpoints other than mortality. Model coefficients are provided and an online risk calculator is publicly available from The Society of Thoracic Surgeons website.

The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 3--valve plus coronary artery bypass grafting surgery.

BACKGROUND: Since 1999, The Society of Thoracic Surgeons (STS) has published two risk models that can be used to adjust the results of valve surgery combined with coronary artery bypass graft surgery (CABG). The most recent was developed from data for patients who had surgery between 1994 and 1997 using operative mortality as the only endpoint. Furthermore, this model did not specifically consider mitral valve repair plus CABG, an increasingly common procedure. Consistent with STS policy of periodically updating and improving its risk models, new models for valve surgery combined with CABG have been developed. These models specifically address both perioperative morbidity and mitral valve repair, and they are based on contemporary data. METHODS: The final study population consisted of 101,661 procedures, including aortic valve replacement (AVR) plus CABG, mitral valve replacement (MVR) plus CABG, or mitral valve repair (MVRepair) plus CABG between January 1, 2002, and December 31, 2006. Model outcomes included operative mortality, stroke, deep sternal wound infection, reoperation, prolonged ventilation, renal failure, composite major morbidity or mortality, prolonged postoperative length of stay, and short postoperative length of stay. Candidate variables were screened for frequency of missing data, and imputation techniques were used where appropriate. Stepwise variable selection was employed, supplemented by advice from an expert panel of cardiac surgeons and biostatisticians. Several variables were forced into models to insure face validity (eg, atrial fibrillation for the permanent stroke model, sex for all models). Based on preliminary analyses of the data, a single model was employed for valve plus CABG, with indicator variables for the specific type of procedure. Interaction terms were included to allow for differential impact of predictor variables depending on procedure type. After validating the model in the 40% validation sample, the development and validation samples were then combined, and the final model coefficients were estimated using the overall 100% combined sample. The final logistic regression model was estimated using generalized estimating equations to account for clustering of patients within institutions. RESULTS: The c-index for mortality prediction for the overall valve plus CABG population was 0.75. Morbidity model c-indices for specific complications (permanent stroke, renal failure, prolonged ventilation > 24 hours, deep sternal wound infection, reoperation for any reason, major morbidity or mortality composite, and prolonged postoperative length of stay) for the overall group of valve plus CABG procedures ranged from 0.622 to 0.724, and calibration was excellent. CONCLUSIONS: New STS risk models have been developed for heart valve surgery combined with CABG. These are the first valve plus CABG models that also include risk prediction for individual major morbidities, composite major morbidity or mortality, and short and prolonged length of stay.

The Society of Thoracic Surgeons/American Association for Thoracic Surgery off-pump training program.

BACKGROUND: Opportunities to acquire knowledge and skills in new technology are limited for cardiothoracic surgeons after completion of residency. In 2000 The Society of Thoracic Surgeons/American Association for Thoracic Surgery Joint Committee for New Technology Assessment accepted an educational grant from the Foundation for Advanced Medical Education to implement and test an instructional program for practicing cardiothoracic surgeons in off-pump coronary bypass surgery. METHODS: Twenty-four surgeons were selected for participation. Instruction was provided in three phases: (1) a preliminary video illustrating the techniques; (2) 2-day training sessions at two separate locations linked by videoconference; and (3) visits by trainees to observe preceptor surgeons at their institutions, followed by visits of preceptor surgeons to the institutions of the trainees. Evaluation of the program was made by review of trainee case lists in the year after completion of the program and by written surveys completed by trainees and preceptors. RESULTS: Seventeen surgeons completed all phases of the program. Most of them reported frequently utilizing off-pump bypass surgery in practice with good results. Two surgeons dropped out of the program before the first phase, and 5 surgeons did not complete all preceptor visits. Most survey respondents commented that the program met or exceeded their expectations. CONCLUSIONS: Some trainees were unable to complete proctor visits because of professional responsibilities at home or because of difficulty in advanced scheduling of procedures. More rigorous selection and stronger administrative controls might have reduced program dropouts. The instructional model worked extremely well for properly selected and motivated surgeons.