The STS Participant-Level, Multiprocedural Composite Measure for Adult Cardiac Surgery.

BACKGROUND: Composite performance measures for the Society of Thoracic Surgeons (STS) Adult Cardiac Surgery Database participants (typically hospital departments or practice groups) are currently available only for individual procedures. To assess overall participant performance, STS has developed a composite metric encompassing the most common adult cardiac procedures. METHODS: Analyses included 1-year (July 1, 2018 to June 30, 2019) and 3-year (July 1, 2016 to June 30, 2019) time windows. Operations included isolated coronary artery bypass grafting (CABG), isolated aortic valve replacement (AVR), isolated mitral valve repair (MVr) or replacement (MVR), AVR + CABG, MVr or MVR + CABG, AVR + MVr or MVR, and AVR + (MVr or MVR) + CABG. The composite was estimated using Bayesian hierarchical models with risk-adjusted mortality and morbidity end points. Star ratings were based upon whether the 95% credible interval of a participant's score was entirely lower than (1 star), overlapping (2 star), or higher than (3 star) the STS average composite score. RESULTS: The North American procedural mix in the 3-year study cohort was as follows: 448 569 CABG, 72 067 AVR, 35 708 MVr, 29 953 MVR, 45 254 AVR + CABG, 12 247 MVr + CABG, 10 118 MVR + CABG, 3743 AVR + MVr, 6846 AVR + MVR, and 3765 AVR + (MVr or MVR) + CABG. Mortality and morbidity weightings were similar for 1- and 3-year analyses (76% and 24% [3-year]), as were composite score distributions (median, 94.7%; interquartile range, 93.6% to 95.6% [3-year]). The 3-year time frame was selected for operational use because of higher model reliability (0.81 [0.78-0.83]) and better outlier discrimination (26%, 3 star; 16%, 1 star). Risk-adjusted outcomes for 1-, 2-, and 3-star programs were 4.3%, 3.0%, and 1.8% mortality and 18.4%, 13.4%, and 9.7% morbidity, respectively. CONCLUSIONS: The STS participant-level, multiprocedural composite measure provides comprehensive, highly reliable, overall quality assessment of adult cardiac surgery practices.

The Society of Thoracic Surgeons 2021 Adult Cardiac Surgery Risk Models for Multiple Valve Operations.

BACKGROUND: The Society of Thoracic Surgeons (STS) Quality Measurement Task Force has developed risk models and composite performance measures for isolated coronary artery bypass grafting (CABG), isolated aortic valve replacement (AVR), isolated mitral valve replacement or repair (MVRR), AVR+CABG, and MVRR+CABG. To further enhance its portfolio of risk-adjusted performance metrics, STS has developed new risk models for multiple valve operations ± CABG procedures. METHODS: Using July 2011 to June 2019 STS Adult Cardiac Surgery Database data, risk models for AVR+MVRR (n = 31,968) and AVR+MVRR+CABG (n = 12,650) were developed with the following endpoints: Operative Mortality, major morbidity (any 1 or more of the following: cardiac reoperation, deep sternal wound infection/mediastinitis, stroke, prolonged ventilation, and renal failure), and combined mortality and/or major morbidity. Data were divided into development (July 2011 to June 2017; n = 35,109) and validation (July 2017 to June 2019; n = 9509) samples. Predictors were selected by assessing model performance and clinical face validity of full and progressively more parsimonious models. Performance of the resulting models was evaluated by assessing discrimination and calibration. RESULTS: C-statistics for the overall population of multiple valve ± CABG procedures were 0.7086, 0.6734, and 0.6840 for mortality, morbidity, and combined mortality and/or morbidity in the development sample, and 0.6953, 0.6561, and 0.6634 for the same outcomes, respectively, in the validation sample. CONCLUSIONS: New STS Adult Cardiac Surgery Database risk models have been developed for multiple valve ± CABG operations, and these models will be used in subsequent STS performance metrics.

Current Penetration, Completeness, and Representativeness of The Society of Thoracic Surgeons Adult Cardiac Surgery Database.

BACKGROUND: The Society of Thoracic Surgeons (STS) Adult Cardiac Surgery Database (ACSD) is the largest cardiac surgical database in the world. Linked data from STS ACSD and the Centers for Medicare and Medicaid Services (CMS) database were used to determine contemporary completeness, penetration, and representativeness of STS ACSD. METHODS: Variables common to both STS and CMS databases were used to link STS procedures to CMS data for all CMS coronary artery bypass grafting surgery (CABG) discharges between 2000 and 2018, inclusive. For each CMS CABG hospitalization, it was determined whether a matching STS record existed. RESULTS: Center-level penetration (number of CMS sites with at least 1 matched STS participant divided by total number of CMS CABG sites) increased from 45% in 2000 to 95% in 2018. In 2018, 949 of 1004 CMS CABG sites (95%) were linked to an STS site. Patient-level penetration (number of CMS CABG hospitalizations at STS sites divided by total number of CMS CABG hospitalizations) increased from 51% in 2000 to 97% in 2018. In 2018, 68,584 of 70,818 CMS CABG hospitalizations (97%) occurred at an STS site. Completeness of case inclusion at STS sites (number of CMS CABG cases at STS sites linked to STS records divided by total number of CMS CABG cases at STS sites) increased from 88% in 2000 to 98% in 2018. In 2018, 66,673 of 68,108 CMS CABG hospitalizations at STS sites (98%) were linked to an STS record. CONCLUSIONS: Linkage of the STS and CMS databases demonstrates high and increasing penetration and completeness of STS ACSD. STS ACSD now includes 97% of CABG in the United States.

The Society of Thoracic Surgeons Coronary Artery Bypass Graft Composite Measure: 2021 Methodology Update.

BACKGROUND: The Society of Thoracic Surgeons (STS) original coronary artery bypass graft surgery (CABG) composite measure uses a 1-year analytic cohort and 98% credible intervals (CrI) to classify better than expected (3-star) performance or worse than expected (1-star) performance. As CABG volumes per STS participant (eg, hospital or practice group) have decreased, it has become more challenging to classify performance categories using this approach, especially for lower volume programs, and alternative approaches have been explored. METHODS: Among 990 STS Adult Cardiac Surgery Database participants, performance classifications for the CABG composite were studied using various analytic cohorts: 1 year (current approach, 2017); 3 years (2015 to 2017); last 450 cases within 3 years; and most recent year (2017) plus additional cases to 450 total. We also compared 98% CrI with 95% CrI (used in other STS composite measures). RESULTS: Using 3 years of data and 95% CrIs, 113 of 990 participants (11.4%) were classified 1-star and 198 (20%) 3-star. Compared with 1-year analytic cohorts and 98% CrI, the absolute and relative increases in the proportion of 3-star participants were 14 percentage points and 233% (n = 198 [20%] vs n = 59 [6%]). Corresponding changes for 1-star participants were 6.5 percentage points and 133% (n = 113 [11.4%] vs n = 48 [4.9%]). These changes were particularly notable among lower volume (fewer than 199 CABG per year) participants. Measure reliability with the 3-year, 95% CrI modification is 0.78. CONCLUSIONS: Compared with current STS CABG composite methodology, a 3-year analytic cohort and 95% CrI increases the number and proportion of better or worse than expected outliers, especially among lower-volume Adult Cardiac Surgery Database participants. This revised methodology is also now consistent with other STS procedure composites.

Using health information technology-related performance measures and tools to improve chronic care.

BACKGROUND: The American Medical Association led a collaborative initiative to explore opportunities for improving the quality of outpatient chronic care through the use of nationally endorsed clinical performance measures and tools. The measures and tools focused on adult diabetes, major depressive disorder, chronic stable coronary artery disease, heart failure, hypertension, and asthma. METHODS: The RAND Corporation conducted an independent, formative assessment of the initiative's four pilot activities using the Context-Input-Process-Product evaluation model. RESULTS: Pilots 1 and 2 demonstrated the feasibility and value of implementing performance measures and tools in practices with electronic health information systems, while highlighting the difficulty of using them in practices with paper-based systems and in community-based models, where multiple stakeholders are expected to share patient data. Pilot 3 illustrated the usefulness of validating performance measures before their use for internal quality improvement or external reporting. Pilot 4 documented the challenges involved in exporting clinical performance data from a physician practice to external entities for multiple potential uses. DISCUSSION: Improving the quality of chronic care through clinical performance measurement, data aggregation, and reporting will require expanded use of clinical performance measures for both internal quality improvement and pay-for-performance; integrating electronic health records (EHRs) or electronic-based registries into more physician offices; more accurate measurement and documentation of diagnoses and care procedures; EHR products that make it easier to capture certain types of information; and simplified, standardized processes for performance data extraction and exporting.