Reevaluating Congenital Heart Surgery Center Performance Using Operative Mortality.

BACKGROUND: The Society of Thoracic Surgeons Congenital Heart Surgery Database (STS-CHSD) provides observed-to-expected (O/E) operative mortality ratios to more than 100 congenital heart centers in North America. We compared the current approach for estimating O/E ratios to approaches incorporating information on diagnosis as moderators of procedures, other unused risk factors, and additional variation in confidence interval construction to characterize center performance. METHODS: Bayesian additive regression trees (BART) and lasso models linked operative mortality to diagnosis-procedure categories, procedure-specific risk factors, and syndromes/abnormalities. Bootstrapping accounted for variation in the STS-CHSD (STS bootstrap) and lasso CIs. We compared O/E estimates, interquartile range of CI widths, and concordance of center performance categorizations (worse-than-, as-, or better-than-expected mortality) of the new approaches to the STS-CHSD. RESULTS: In 110 surgical centers including 98,822 surgical operative encounters, there were 2818 (2.85%) operative mortalities (center range, 0.37%-10%). Compared with the STS-CHSD, BART- and lasso-estimated O/E ratios varied more and had narrower confidence intervals (interquartile range of confidence interval: STS-CHSD = 1.11, STS bootstrap = 0.98; lasso = 0.80; BART = 0.96). Concordance of performance categorization with the STS-CHSD ranged from 84% (lasso) to 91% (STS Bootstrap); more than 70% of discordant centers improved categories. Discordant centers had smaller volumes, fewer operative mortalities, and treated more patients with congenital lung abnormalities. CONCLUSIONS: Relative to the STS-CHSD, up to 16% of hospitals changed performance categories, most improving performance. Given the significance of quality reports for congenital heart centers, inclusion of additional risk factors and unaddressed variation should be considered.

Mortality Prediction After Cardiac Surgery in Children: An STS Congenital Heart Surgery Database Analysis.

BACKGROUND: The Society of Thoracic Surgeons (STS) Congenital Heart Surgery Database (CHSD) provides risk-adjusted operative mortality rates to approximately 120 North American congenital heart centers. Optimal case-mix adjustment methods for operative mortality risk prediction in this population remain unclear. METHODS: A panel created diagnosis-procedure combinations of encounters in the CHSD. Models for operative mortality using the new diagnosis-procedure categories, procedure-specific risk factors, and syndromes or abnormalities included in the CHSD were estimated using Bayesian additive regression trees and least absolute shrinkage and selector operator (lasso) models. Performance of the new models was compared with the current STS CHSD risk model. RESULTS: Of 98 825 operative encounters (69 063 training; 29 762 testing), 2818 (2.85%) STS-defined operative mortalities were observed. Differences in sensitivity, specificity, and true and false positive predicted values were negligible across models. Calibration for mortality predictions at the higher end of risk from the lasso and Bayesian additive regression trees models was better than predictions from the STS CHSD model, likely because of the new models' inclusion of diagnosis-palliative procedure variables affecting <1% of patients overall but accounting for 27% of mortalities. Model discrimination varied across models for high-risk procedures, hospital volume, and hospitals. CONCLUSIONS: Overall performance of the new models did not differ meaningfully from the STS CHSD risk model. Adding procedure-specific risk factors and allowing diagnosis to modify predicted risk for palliative operations may augment model performance for very high-risk surgical procedures. Given the importance of risk adjustment in estimating hospital quality, a comparative assessment of surgical program quality evaluations using the different models is warranted.

Report from the Society of Thoracic Surgeons National Database Workforce: clarifying the definition of operative mortality.

Several distinct definitions of postoperative death have been used in various quality reporting programs. Some have defined postoperative mortality as the occurrence of death after a surgical procedure when the patient dies while still in the hospital, while others have considered all deaths occurring within a predetermined, standardized time interval after surgery to be postoperative mortality. While mortality data are still collected and reported using both these individual definitions, the Society of Thoracic Surgeons (STS) believes that either approach alone may be inadequate. Accordingly, the STS prefers a more encompassing metric, Operative Mortality. Operative Mortality is defined in all STS databases as (1) all deaths, regardless of cause, occurring during the hospitalization in which the operation was performed, even if after 30 days (including patients transferred to other acute care facilities); and (2) all deaths, regardless of cause, occurring after discharge from the hospital, but before the end of the 30th postoperative day. This article provides clarification for some uncommon but important scenarios in which the correct application of this definition may be challenging.

The society of thoracic surgeons national database.

AIMS: The Society of Thoracic Surgeons (STS) National Database collects detailed clinical information on patients undergoing adult cardiac, paediatric and congenital cardiac, and general thoracic surgical operations. These data are used to support risk-adjusted, nationally benchmarked performance assessment and feedback; voluntary public reporting; quality improvement initiatives; guideline development; appropriateness determination; shared decision making; research using cross-sectional and longitudinal registry linkages; comparative effectiveness studies; government collaborations including postmarket surveillance; regulatory compliance and reimbursement strategies. INTERVENTIONS: All database participants receive feedback reports which they may voluntarily share with their hospitals or payers, or publicly report. STS analyses are regularly used as the basis for local, regional and national quality improvement efforts. POPULATION: More than 90% of adult cardiac programmes in the USA participate, as do the majority of paediatric cardiac programmes, and general thoracic participation continues to increase. Since the inception of the Database in 1989, more than 5 million patient records have been submitted. BASELINE DATA: Each of the three subspecialty databases includes several hundred variables that characterise patient demographics, diagnosis, medical history, clinical risk factors and urgency of presentation, operative details and postoperative course including adverse outcomes. DATA CAPTURE: Data are entered by trained data abstractors and by the care team, using detailed data specifications for each element. DATA QUALITY: Quality and consistency checks assure accurate and complete data, missing data are rare, and audits are performed annually of selected participant sites. ENDPOINTS: All major outcomes are reported including complications, status at discharge and mortality. DATA ACCESS: Applications for STS Database participants to use aggregate national data for research are available at http://www.sts.org/quality-research-patient-safety/research/publications-and-research/access-data-sts-national-database.