Identifying Population-Level and Within-Hospital Disparities in Surgical Care.

INTRODUCTION: The lack of consensus on equity measurement and its incorporation into quality-assessment programs at the hospital and system levels may be a barrier to addressing disparities in surgical care. This study aimed to identify population-level and within-hospital differences in the quality of surgical care provision. METHODS: The analysis included 657 National Surgical Quality Improvement Program participating hospitals with over 4 million patients (2014-2018). Multi-level random slope, random intercept modeling was used to examine for population-level and in-hospital disparities. Disparities in surgical care by Area Deprivation Index (ADI), race, and ethnicity were analyzed for five measures: all-case inpatient mortality, all-case urgent readmission, all-case postoperative surgical site infection, colectomy mortality, and spine surgery complications. RESULTS: Population-level disparities were identified across all measures by ADI, two measures for Black race (all-case readmissions and spine surgery complications), and none for Hispanic ethnicity. Disparities remained significant in the adjusted models. Prior to risk-adjustment, in all measures examined, within-hospital disparities were detected in: 25.8-99.8% of hospitals for ADI, 0-6.1% of hospitals for Black race, and 0-0.8% of hospitals for Hispanic ethnicity. Following risk-adjustment, in all measures examined, fewer than 1.1% of hospitals demonstrated disparities by ADI, race, or ethnicity. CONCLUSIONS: Following risk adjustment, very few hospitals demonstrated significant disparities in care. Disparities were more frequently detected by ADI than by race and ethnicity. The lack of substantial in-hospital disparities may be due to the use of postoperative metrics, small sample sizes, the risk adjustment methodology, and healthcare segregation. Further work should examine surgical access and healthcare segregation.

National Multi-Institutional Validation of a Surgical Transfusion Risk Prediction Model.

BACKGROUND: Accurate estimation of surgical transfusion risk is important for many aspects of surgical planning, yet few methods for estimating are available for estimating such risk. There is a need for reliable validated methods for transfusion risk stratification to support effective perioperative planning and resource stewardship. STUDY DESIGN: This study was conducted using the American College of Surgeons NSQIP datafile from 2019. S-PATH performance was evaluated at each contributing hospital, with and without hospital-specific model tuning. Linear regression was used to assess the relationship between hospital characteristics and area under the receiver operating characteristic (AUROC) curve. RESULTS: A total of 1,000,927 surgical cases from 414 hospitals were evaluated. Aggregate AUROC was 0.910 (95% CI 0.904 to 0.916) without model tuning and 0.925 (95% CI 0.919 to 0.931) with model tuning. AUROC varied across individual hospitals (median 0.900, interquartile range 0.849 to 0.944), but no statistically significant relationships were found between hospital-level characteristics studied and model AUROC. CONCLUSIONS: S-PATH demonstrated excellent discriminative performance, although there was variation across hospitals that was not well-explained by hospital-level characteristics. These results highlight the S-PATH's viability as a generalizable surgical transfusion risk prediction tool.

Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program: Bariatric Surgical Risk/Benefit Calculator: 1-year comorbidity remission.

BACKGROUND: Clinical calculators can provide patient-personalized estimates of treatment risks and health outcomes. The American College of Surgeons Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) set out to create a publicly available tool to assess both short-term postoperative risk and long-term benefits for prospective adult patients eligible for 1 of 4 primary bariatric procedures. The calculator is comprised of multiple prediction elements: (1) 30-day postoperative risk, (2) 1-year body mass index projections, and (3) 1-year comorbidity remission. OBJECTIVES: To assess the performance of the 1-year comorbidity remission prediction feature of the calculator. SETTING: Not-for-profit organization clinical data registry. METHODS: MBSAQIP data across 4.5 years from 240,227 total patients indicating at least 1 comorbidity of interest present preoperatively and who had a 1-year follow-up record documenting their comorbidity status were included. Six models were constructed, stratified by the presence of the respective preoperative comorbidity: hypertension, hyperlipidemia, gastroesophageal reflux disease, sleep apnea, non-insulin-dependent diabetes, and insulin-dependent diabetes. A multinomial logistic regression model was used to predict 1-year remission (total, partial, or no remission) of insulin-dependent diabetes. All other outcomes were binary (yes or no at 1 yr), and ordinary logistic regression models were used. RESULTS: All models showed adequate discrimination (C statistics ranging from .58 to .68). Plots of observed versus predicted remission (%) showed excellent calibration across all models. CONCLUSION: All remission models were well calibrated with sufficient discrimination. The MBSAQIP Bariatric Surgical Risk/Benefit Calculator is a publicly available tool intended for integration into clinical practice to enhance patient-clinician discussions and informed consent.

The Accuracy of the NSQIP Universal Surgical Risk Calculator Compared to Operation-Specific Calculators.

Objective: To compare the performance of the ACS NSQIP "universal" risk calculator (N-RC) to operation-specific RCs. Background: Resources have been directed toward building operation-specific RCs because of an implicit belief that they would provide more accurate risk estimates than the N-RC. However, operation-specific calculators may not provide sufficient improvements in accuracy to justify the costs in development, maintenance, and access. Methods: For the N-RC, a cohort of 5,020,713 NSQIP patient records were randomly divided into 80% for machine learning algorithm training and 20% for validation. Operation-specific risk calculators (OS-RC) and OS-RCs with operation-specific predictors (OSP-RC) were independently developed for each of 6 operative groups (colectomy, whipple pancreatectomy, thyroidectomy, abdominal aortic aneurysm (open), hysterectomy/myomectomy, and total knee arthroplasty) and 14 outcomes using the same 80%/20% rule applied to the appropriate subsets of the 5M records. Predictive accuracy was evaluated using the area under the receiver operating characteristic curve (AUROC), the area under the precision-recall curve (AUPRC), and Hosmer-Lemeshow (H-L) P values, for 13 binary outcomes, and mean squared error for the length of stay outcome. Results: The N-RC was found to have greater AUROC (P = 0.002) and greater AUPRC (P < 0.001) compared to the OS-RC. No other statistically significant differences in accuracy, across the 3 risk calculator types, were found. There was an inverse relationship between the operation group sample size and magnitude of the difference in AUROC (r = -0.278; P = 0.014) and in AUPRC (r = -0.425; P < 0.001) between N-RC and OS-RC. The smaller the sample size, the greater the superiority of the N-RC. Conclusions: While operation-specific RCs might be assumed to have advantages over a universal RC, their reliance on smaller datasets may reduce their ability to accurately estimate predictor effects. In the present study, this tradeoff between operation specificity and accuracy, in estimating the effects of predictor variables, favors the N-R, though the clinical impact is likely to be negligible.

Piperacillin-Tazobactam Compared With Cefoxitin as Antimicrobial Prophylaxis for Pancreatoduodenectomy: A Randomized Clinical Trial.

Importance: Despite improvements in perioperative mortality, the incidence of postoperative surgical site infection (SSI) remains high after pancreatoduodenectomy. The effect of broad-spectrum antimicrobial surgical prophylaxis in reducing SSI is poorly understood. Objective: To define the effect of broad-spectrum perioperative antimicrobial prophylaxis on postoperative SSI incidence compared with standard care antibiotics. Design, Setting, and Participants: Pragmatic, open-label, multicenter, randomized phase 3 clinical trial at 26 hospitals across the US and Canada. Participants were enrolled between November 2017 and August 2021, with follow-up through December 2021. Adults undergoing open pancreatoduodenectomy for any indication were eligible. Individuals were excluded if they had allergies to study medications, active infections, chronic steroid use, significant kidney dysfunction, or were pregnant or breastfeeding. Participants were block randomized in a 1:1 ratio and stratified by the presence of a preoperative biliary stent. Participants, investigators, and statisticians analyzing trial data were unblinded to treatment assignment. Intervention: The intervention group received piperacillin-tazobactam (3.375 or 4 g intravenously) as perioperative antimicrobial prophylaxis, while the control group received cefoxitin (2 g intravenously; standard care). Main Outcomes and Measures: The primary outcome was development of postoperative SSI within 30 days. Secondary end points included 30-day mortality, development of clinically relevant postoperative pancreatic fistula, and sepsis. All data were collected as part of the American College of Surgeons National Surgical Quality Improvement Program. Results: The trial was terminated at an interim analysis on the basis of a predefined stopping rule. Of 778 participants (378 in the piperacillin-tazobactam group [median age, 66.8 y; 233 {61.6%} men] and 400 in the cefoxitin group [median age, 68.0 y; 223 {55.8%} men]), the percentage with SSI at 30 days was lower in the perioperative piperacillin-tazobactam vs cefoxitin group (19.8% vs 32.8%; absolute difference, -13.0% [95% CI, -19.1% to -6.9%]; P < .001). Participants treated with piperacillin-tazobactam, vs cefoxitin, had lower rates of postoperative sepsis (4.2% vs 7.5%; difference, -3.3% [95% CI, -6.6% to 0.0%]; P = .02) and clinically relevant postoperative pancreatic fistula (12.7% vs 19.0%; difference, -6.3% [95% CI, -11.4% to -1.2%]; P = .03). Mortality rates at 30 days were 1.3% (5/378) among participants treated with piperacillin-tazobactam and 2.5% (10/400) among those receiving cefoxitin (difference, -1.2% [95% CI, -3.1% to 0.7%]; P = .32). Conclusions and Relevance: In participants undergoing open pancreatoduodenectomy, use of piperacillin-tazobactam as perioperative prophylaxis reduced postoperative SSI, pancreatic fistula, and multiple downstream sequelae of SSI. The findings support the use of piperacillin-tazobactam as standard care for open pancreatoduodenectomy. Trial Registration: ClinicalTrials.gov Identifier: NCT03269994.

The past, present and future of ACS NSQIP-Pediatric: Evolution from a quality registry to a comparative quality performance platform.

Quality and process improvement (QI/PI) in children's surgical care require reliable data across the care continuum. Since 2012, the American College of Surgeons' (ACS) National Surgical Quality Improvement Program-Pediatric (NSQIP-Pediatric) has supported QI/PI by providing participating hospitals with risk-adjusted, comparative data regarding postoperative outcomes for multiple surgical specialties. To advance this goal over the past decade, iterative changes have been introduced to case inclusion and data collection, analysis and reporting. New datasets for specific procedures, such as appendectomy, spinal fusion for scoliosis, vesicoureteral reflux procedures, and tracheostomy in children less than 2 years old, have incorporated additional risk factors and outcomes to enhance the clinical relevance of data, and resource utilization to consider healthcare value. Recently, process measures for urgent surgical diagnoses and surgical antibiotic prophylaxis variables have been developed to promote timely and appropriate care. While a mature program, NSQIP-Pediatric remains dynamic and responsive to meet the needs of the surgical community. Future directions include introduction of variables and analyses to address patient-centered care and healthcare equity.

Influence of Perioperative COVID-19 Infection on Surgical Outcomes and Risk Adjustment for Quality Assessment in the American College of Surgeons NSQIP.

BACKGROUND: Surgical patients with perioperative coronavirus disease 19 (COVID-19) infection experience higher rates of adverse events than those without COVID-19, which may lead to imprecision in hospital-level quality assessment. Our objectives were to quantify differences in COVID-19-associated adverse events in a large national sample and examine distortions in surgical quality benchmarking if COVID-19 status is not considered. STUDY DESIGN: Data included 793,280 patient records from the American College of Surgeons NSQIP from April 1, 2020, to March 31, 2021. Models predicting 30-day mortality, morbidity, pneumonia, and ventilator dependency greater than 48 hours, and unplanned intubation were constructed. Risk adjustment variables were selected for these models from standard NSQIP predictors and perioperative COVID-19 status. RESULTS: A total of 5,878 (0.66%) had preoperative COVID-19, and 5,215 (0.58%) had postoperative COVID-19. COVID-19 rates demonstrated some consistency across hospitals (median preoperative 0.84%, interquartile range 0.14% to 0.84%; median postoperative 0.50%, interquartile range 0.24% to 0.78%). Postoperative COVID-19 was always associated with increased adverse events. For postoperative COVID-19 among all cases, there was nearly a 6-fold increase in mortality (1.07% to 6.37%) and15-fold increase in pneumonia (0.92% to 13.57%), excluding the diagnosis of COVID-19 itself. The effects of preoperative COVID-19 were less consistent. Inclusion of COVID-19 in risk-adjustment models had minimal effects on surgical quality assessments. CONCLUSIONS: Perioperative COVID-19 was associated with a dramatic increase in adverse events. However, quality benchmarking was minimally affected. This may be the result of low overall COVID-19 rates or balance in rates established across hospitals during the 1-year observational period. There remains limited evidence for restructuring ACS NSQIP risk-adjustment for the time-limited effects of the COVID-19 pandemic.

Procedure-Level Misutilization of Antimicrobial Prophylaxis in Pediatric Surgery: Implications for Improved Stewardship and More Effective Infection Prevention.

BACKGROUND: The objective of this study was to quantify prophylaxis misutilization to identify high-priority procedures for improved stewardship and SSI prevention. METHODS: This was a multicenter analysis including 90 hospitals participating in the NSQIP-Pediatric Antibiotic Prophylaxis Collaborative from 6/2019 to 6/2020. Prophylaxis data were collected from all hospitals and misutilization measures were developed from consensus guidelines. Overutilization included use of overly broad-spectrum agents, continuation of prophylaxis >24 h after incision closure, and use in clean procedures without implants. Underutilization included omission (clean-contaminated cases), use of inappropriately narrow-spectrum agents, and administration post-incision. Procedure-level misutilization burden was estimated by multiplying NSQIP-derived misutilization rates by case volume data obtained from the Pediatric Health Information System database. RESULTS: 9861 patients were included. Overutilization was most commonly associated with overly broad-spectrum agents (14.0%), unindicated utilization (12.6%), and prolonged duration (8.4%). Procedure groups with the greatest overutilization burden included small bowel (27.2%), cholecystectomy (24.4%), and colorectal (10.7%). Underutilization was most commonly associated with post-incision administration (6.2%), inappropriate omission (4.4%), and overly narrow-spectrum agents (4.1%). Procedure groups with the greatest underutilization burden included colorectal (31.2%), gastrostomy (19.2%), and small bowel (11.1%). CONCLUSION: A relatively small number of procedures account for a disproportionate burden of antibiotic misutilization in pediatric surgery. TYPE OF STUDY: Retrospective Cohort. LEVEL OF EVIDENCE: III.

Truth of Colorectal Enhanced Recovery Programs: Process Measure Compliance in 151 Hospitals.

BACKGROUND: Commonly cited studies have reported substantial improvements (defined as >20%) in process measure compliance after implementation of colorectal enhanced recovery programs (ERPs). However, hospitals have anecdotally reported difficulties in achieving similar improvement gains. This study evaluates improvement uniformity among 151 hospitals exposed to an 18-month implementation protocol for 6 colorectal ERP process measures (oral antibiotics, mechanical bowel preparation, multimodal pain control, early mobilization, early liquid intake, and early solid intake). STUDY DESIGN: One hundred fifty-one hospitals implemented a colorectal ERP with pathway, educational and supporting materials, and data capture protocols; 906 opportunities existed for process compliance improvement across the cohort (151 hospitals × 6 process measures). However, 240 opportunities were excluded due to high starting compliance rates (ie compliance >80%) and 3 opportunities were excluded because compliance rates were recorded for fewer than 2 cases. Thus, 663 opportunities for improvement across 151 hospitals were studied. RESULTS: Of 663 opportunities, minimal improvement (0% to 20% increase in compliance) occurred in 52% of opportunities, substantial improvement (>20% increase in compliance) in 20%, and worsening compliance occurred in 28%. Of the 6 processes, multimodal pain control and use of oral antibiotics improved the most. CONCLUSIONS: Contrary to published ERP literature, the majority of study hospitals had difficulty improving process compliance with 80% of the opportunities not achieving substantial improvement. This discordance between ERP implementation success rates reported in the literature and what is observed in a large sample could reflect differences in hospitals' culture or characteristics, or a publication bias. Attention needs to be directed toward improving ERP adoption across the spectrum of hospital types.

American College of Surgeons NSQIP Risk Calculator Accuracy Using a Machine Learning Algorithm Compared with Regression.

BACKGROUND: The American College of Surgeons NSQIP risk calculator (RC) uses regression to make predictions for fourteen 30-day surgical outcomes. While this approach provides accurate (discrimination and calibration) risk estimates, they might be improved by machine learning (ML). To investigate this possibility, accuracy for regression-based risk estimates were compared to estimates from an extreme gradient boosting (XGB)-ML algorithm. STUDY DESIGN: A cohort of 5,020,713 million NSQIP patient records was randomly divided into 80% for model construction and 20% for validation. Risk predictions using regression and XGB-ML were made for 13 RC binary 30-day surgical complications and one continuous outcome (length of stay [LOS]). For the binary outcomes, discrimination was evaluated using the area under the receiver operating characteristic curve (AUROC) and area under the precision recall curve (AUPRC), and calibration was evaluated using Hosmer-Lemeshow statistics. Mean squared error and a calibration curve analog were evaluated for the continuous LOS outcome. RESULTS: For every binary outcome, discrimination (AUROC and AUPRC) was slightly greater for XGB-ML than for regression (mean [across the outcomes] AUROC was 0.8299 vs 0.8251, and mean AUPRC was 0.1558 vs 0.1476, for XGB-ML and regression, respectively). For each outcome, miscalibration was greater (larger Hosmer-Lemeshow values) with regression; there was statistically significant miscalibration for all regression-based estimates, but only for 4 of 13 when XGB-ML was used. For LOS, mean squared error was lower for XGB-ML. CONCLUSIONS: XGB-ML provided more accurate risk estimates than regression in terms of discrimination and calibration. Differences in calibration between regression and XGB-ML were of substantial magnitude and support transitioning the RC to XGB-ML.

The Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program Bariatric Surgical Risk/Benefit Calculator: 1-year weight.

BACKGROUND: Data-driven tools can be designed to provide patient-personalized estimates of health outcomes. Clinical calculators are commonly built to assess risk, but potential benefits of treatment should be equally considered. The American College of Surgeons Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) sought to create a risk and benefit calculator for adult patients considering primary metabolic and bariatric surgery with multiple prediction features: (1) 30-day risk, (2) 1-year body mass index (BMI) projections, and (3) 1-year co-morbidity remission. OBJECTIVE: To assess the performance of the 1-year BMI projections feature of this tool. SETTING: Not-for-profit organization, clinical data registry. METHODS: MBSAQIP data from 596,024 cases across 4.5 years from 882 centers with ∼2.5 million records through 18 months postoperatively were included. A generalized estimating equation model was used to estimate BMI over time for 4 primary procedures: laparoscopic adjustable gastric band, laparoscopic sleeve gastrectomy, laparoscopic Roux-en-Y gastric bypass, and biliopancreatic diversion with duodenal switch. RESULTS: The mean absolute error (MAE) in BMI predictions through postoperative month 12 was 1.68 units; overall correlation of actual and predicted BMI was .94. MAE of postoperative BMI estimates (1-12 mo) was lowest for laparoscopic sleeve gastrectomy (1.64) and highest for biliopancreatic diversion with duodenal switch (1.99). BMI predictions at 12 months showed MAE = 2.99 units. CONCLUSIONS: Predicted BMI closely aligned with actual BMI values across the 12-month postoperative period. The MBSAQIP Bariatric Surgical Risk/Benefit Calculator is publicly available with the intent to facilitate patient-clinician communication and guide surgical decision making. This tool can aid in evaluating postoperative risk as well as benefits and long-term expectations.

Evaluating agreement between clinic- and patient-reported outcomes for weight and co-morbidities at 1 year after bariatric surgery.

BACKGROUND: Development of patient-reported outcomes (PROs) to include traditionally clinic-reported data has the potential to decrease the data-collection burden for patients and clinicians and increase follow-up rates. However, replacing clinic report by patient report requires that the data reasonably agree. OBJECTIVE: To assess agreement between PROs and clinical registry data at 1 year after bariatric surgery. SETTING: Not-for-profit organization, bariatric surgery data registry, PROs platform. METHODS: Patient- and clinic-reported 1-year postoperative weight and co-morbidities were compared for matched PROs and registry records. The co-morbidities evaluated were diabetes, sleep apnea, hypertension, gastroesophageal reflux disease, and hyperlipidemia. Weight difference in pounds and nominal groupings (binary, 4-level) for co-morbidities were assessed for agreement between data sources using descriptive statistics, Bland-Altman plots, multiple regression, and kappa coefficients. Sensitivity analyses and follow-up by response method were examined. RESULTS: Among 1130 patients with both 1-year PROs and registry weights, 95% of patient-reported weights were within 13 lb of the registry-recorded weight, and patients underreported their weight by ∼2 lb, on average. Percent agreement and kappa coefficients were highest for diabetes (n = 999; binary: 94%, κ = .72; 4-level: 86%, κ = .71) and lowest for gastroesophageal reflux disease (n = 1032; binary: 75%, κ = .40; 4-level: 57%, κ = .35). Of patients eligible for both PROs and registry 1-year follow-up, 21% had PROs only. CONCLUSIONS: One-year patient- and clinic-reported weights and disease status for patients with diabetes and hypertension showed high agreement. The degree of bias from patient report was low. Patient report is a viable alternative to clinic report for certain objective measurements and may increase follow-up.

Incidence and Relative Burden of Surgical Site Infections in Children Undergoing Nonemergent Surgery: Implications for Performance Benchmarking and Prioritization of Prevention Efforts.

OBJECTIVE: To establish surgical site infection (SSI) performance benchmarks in pediatric surgery and to develop a prioritization framework for SSI prevention based on procedure-level SSI burden. BACKGROUND: Contemporary epidemiology of SSI rates and event burden in elective pediatric surgery remain poorly characterized. METHODS: Multicenter analysis using sampled SSI data from 90 hospitals participating in NSQIP-Pediatric and procedural volume data from the Pediatric Health Information System (PHIS) database. Procedure-level incisional and organ space SSI (OSI) rates for 17 elective procedure groups were calculated from NSQIP-Pediatric data and estimates of procedure-level SSI burden were extrapolated using procedural volume data. The relative contribution of each procedure to the cumulative sum of SSI events from all procedures was used as a prioritization framework. RESULTS: A total of 11,689 nonemergent procedures were included. The highest incisional SSI rates were associated with gastrostomy closure (4.1%), small bowel procedures (4.0%), and gastrostomy (3.7%), while the highest OSI rates were associated with esophageal atresia/tracheoesophageal fistula repair (8.1%), colorectal procedures (1.8%), and small bowel procedures (1.5%). 66.1% of the cumulative incisional SSI burden from all procedures were attributable to 3 procedure groups (gastrostomy: 27.5%, small bowel: 22.9%, colorectal: 15.7%), and 72.8% of all OSI events were similarly attributable to 3 procedure groups (small bowel: 28.5%, colorectal: 26.0%, esophageal atresia/tracheoesophageal fistula repair: 18.4%). CONCLUSIONS: A small number of procedures account for a disproportionate burden of SSIs in pediatric surgery. The results of this analysis can be used as a prioritization framework for refocusing SSI prevention efforts where they are needed most.

Correlation Between Postoperative Antimicrobial Prophylaxis Use and Surgical Site Infection in Children Undergoing Nonemergent Surgery.

Importance: Use of postoperative antimicrobial prophylaxis is common in pediatric surgery despite consensus guidelines recommending discontinuation following incision closure. The association between postoperative prophylaxis use and surgical site infection (SSI) in children undergoing surgical procedures remains poorly characterized. Objective: To evaluate whether use of postoperative surgical prophylaxis is correlated with SSI rates in children undergoing nonemergent surgery. Design, Setting, and Participants: This is a multicenter cohort study using 30-day postoperative SSI data from the American College of Surgeons' Pediatric National Surgical Quality Improvement Program (ACS NSQIP-Pediatric) augmented with antibiotic-use data obtained through supplemental medical record review from June 2019 to June 2021. This study took place at 93 hospitals participating in the ACS NSQIP-Pediatric Surgical Antibiotic Prophylaxis Stewardship Collaborative. Participants were children (<18 years of age) undergoing nonemergent surgical procedures. Exclusion criteria included antibiotic allergies, conditions associated with impaired immune function, and preexisting infections requiring intravenous antibiotics at time of surgery. Exposures: Continuation of antimicrobial prophylaxis beyond time of incision closure. Main Outcomes and Measures: Thirty-day postoperative rate of incisional or organ space SSI. Hierarchical regression was used to estimate hospital-level odds ratios (ORs) for SSI rates and postoperative prophylaxis use. SSI measures were adjusted for differences in procedure mix, patient characteristics, and comorbidity profiles, while use measures were adjusted for clinically related procedure groups. Pearson correlations were used to examine the associations between hospital-level postoperative prophylaxis use and SSI measures. Results: Forty thousand six hundred eleven patients (47.3% female; median age, 7 years) were included, of which 41.6% received postoperative prophylaxis (hospital range, 0%-71.2%). Odds ratios (ORs) for postoperative prophylaxis use ranged 190-fold across hospitals (OR, 0.10-19.30) and ORs for SSI rates ranged 4-fold (OR, 0.55-1.90). No correlation was found between use of postoperative prophylaxis and SSI rates overall (r = 0.13; P = .20), and when stratified by SSI type (incisional SSI, r = 0.08; P = .43 and organ space SSI, r = 0.13; P = .23), and surgical specialty (general surgery, r = 0.02; P = .83; urology, r = 0.05; P = .64; plastic surgery, r = 0.11; P = .35; otolaryngology, r = -0.13; P = .25; orthopedic surgery, r = 0.05; P = .61; and neurosurgery, r = 0.02; P = .85). Conclusions and Relevance: Use of postoperative surgical antimicrobial prophylaxis was not correlated with SSI rates at the hospital level after adjusting for differences in procedure mix and patient characteristics.

NSQIP Quality Benchmarking and Evaluation of Potential Bias Associated with Higher- or Lower-Risk Operation Case Mix.

BACKGROUND: To ensure validity and acceptance of NSQIP risk-adjusted benchmarking, it is important that adjustments adequately control for hospitals that vary in their proportions of lower- or higher-risk operations (combined risk for procedure and patient). This issue was addressed in separate empirical and simulation studies. STUDY DESIGN: For the empirical study, potential miscalibration bias favoring hospitals that do lower-risk operations or disfavoring hospitals that do higher-risk operations was evaluated for 14 modeled outcomes using NSQIP data. A determination was also made as to whether there was a relationship between mean hospital operation risk and benchmarking results (log odds ratio). In the simulation study of the same 14 outcomes, hospital benchmarked performance was evaluated when sampled cases were reconstituted to include either a larger proportion of lower-risk operations or a larger proportion of higher-risk operations. RESULTS: Miscalibration favoring either lower- or higher-risk operations was absent, as were important associations between operative risk and hospital log odds ratios (most model R 2 less than 0.01). In the simulation, there were no substantial changes in log odds ratios when greater percentages of either lower- or higher-risk operations were included in a hospital's sample (nonsignificant p values and effect sizes less than 0.1). CONCLUSIONS: These results should enhance NSQIP participants' confidence in the adequacy of NSQIP patient and procedure risk-adjustment methods. NSQIP participants may rely on benchmarking findings, and implement quality improvement efforts based on them, without concern that they are biased by a preponderance of lower or higher risk operations.

Surgical Outcomes in Canada and the United States: An Analysis of the ACS-NSQIP Clinical Registry.

BACKGROUND: There has been longstanding uncertainty over whether lower healthcare spending in Canada might be associated with inferior outcomes for hospital-based care. We hypothesized that mortality and surgical complication rates would be higher for patients who underwent four common surgical procedures in Canada as compared to the US. DESIGN, SETTING, AND PARTICIPANTS: We conducted a retrospective cohort study of all adults who underwent hip fracture repair, colectomy, pancreatectomy, or spine surgery in 96 Canadian and 585 US hospitals participating in the American College of Surgeons National Surgical Quality Improvement Project (ACS-NSQIP) between January 1, 2015 and December 31, 2019. We compared patients with respect to demographic characteristics and comorbidity. We then compared unadjusted and adjusted outcomes within 30-days of surgery for patients in Canada and the US including: (1) Mortality; (2) A composite constituting 1-or-more of the following complications (cardiac arrest; myocardial infarction; pneumonia; renal failure/; return to operating room; surgical site infection; sepsis; unplanned intubation). RESULTS: Our hip fracture cohort consisted of 21,166 patients in Canada (22.3%) and 73,817 in the US (77.7%), for colectomy 21,279 patients in Canada (8.9%) and 218,307 (91.1%), for pancreatectomy 873 (7.8%) in Canada and 12,078 (92.2%) in the US, and for spine surgery 14,088 (5.3%) and 252,029 (94.7%). Patient sociodemographics and comorbidity were clinically similar between jurisdictions. In adjusted analyses odds of death was significantly higher in Canada for two procedures (colectomy (OR 1.22; 95% CI 1.044-1.424; P = .012) and pancreatectomy (OR 2.11; 95% CI 1.26-3.56; P = .005)) and similar for hip fracture and spine surgery. Odds of the composite outcome were significantly higher in Canada for all 4 procedures, largely driven by higher risk of cardiac events and post-operative infections. CONCLUSIONS: We found evidence of higher rates of mortality and surgical complications within 30-days of surgery for patients in Canada as compared to the US.

Successful Implementation of Enhanced Recovery in Elective Colorectal Surgery is Variable and Dependent on the Local Environment.

OBJECTIVE: To evaluate local hospital success with enhanced recovery implementation as measured by colorectal surgery process measure (PM) compliance and characterize local environment factors associated with success within a contemporary quality improvement collaborative. SUMMARY BACKGROUND DATA: Enhanced recovery programs (ERP) have proven an effective perioperative quality improvement strategy, but local variation in implementation can hinder patient outcome improvement. METHODS: Individual hospitals participating in a national colorectal ERP quality improvement program were evaluated with quantitative (patient-level process and outcome) and qualitative (survey and structured interviews with hospital teams) data between 2017 and 2020. Hospitals with implementation success were identified: high performers (80% of elective colorectal surgery patients compliant with >6/9 PMs) and high improvers (top quartile of PM adherence improvement over time). Hospital and implementation characteristics were compared with chi-square tests. Trends in average annual outcome change were estimated with logistic and linear regression. RESULTS: Of 207 total hospitals, 62 were characterized as High Performance and 52 as High Improvement. High Performance hospitals were larger, with more annual colorectal surgeries (128 vs 101, P = 0.039). Qualitative assessment revealed fewer barriers of staff buy-in and competing priorities, and more experience with standardized perioperative care in High Performance hospitals. High Improvement hospitals had lower baseline PM adherence (54.1% vs 69.6%, P < 0.001) and less experience with standardized perioperative care (30.8% vs 58.1%, P < 0.001) but were noted to have a positive trend in annual patient outcomes: annual morbidity (Δ-1.14% vs -0.20%, P = 0.035), readmission (Δ-1.85% vs 0.002%, P = 0.037), and prolonged length of stay (Δ-3.94 vs -1.19, P = 0.037) compared to Low Improvement hospitals. CONCLUSIONS: When evaluating a collection of hospitals implementing ERP, only half of hospitals reached consistent High Performance or high improvement. Characteristics of the local environment need further study to understand the barriers to effective implementation in a pragmatic setting.

Validation study of the ACS NSQIP surgical risk calculator for two procedures in Japan.

INTRODUCTION: The ACS NSQIP Surgical Risk Calculator (SRC) assesses risk to support goal-concordant care. While it accurately predicts US outcomes, its performance internationally is unknown. This study evaluates SRC accuracy in predicting mortality following low anterior resection (LAR) and pancreaticoduodenectomy (PD) in NSQIP patients and accuracy retention when applied to native Japanese patients (National Clinical Database, NCD). METHODS: NSQIP (41,260 LAR; 15,114 PD) and NCD cases (61,220 LAR; 27,901 PD) from 2015 to 2017 were processed through the SRC mortality model. Country-specific calibration and discrimination were assessed with and without an intercept correction applied to the Japanese data. RESULTS: The SRC exhibited acceptable calibration for LAR and PD when applied to NSQIP data but miscalibration for NCD data. A simple correction to the model intercept, motivated by lower mortality rates in the Japanese data, successfully remediated the miscalibration. CONCLUSIONS: The SRC may inaccurately predict surgical risk when applied to the native Japanese population. An intercept correction method is suggested when miscalibration is encountered; it is simple to implement and may permit effective international use of the SRC.

The Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program bariatric surgical risk/benefit calculator: 30-day risk.

BACKGROUND: There is increasing demand for data-driven tools that provide accurate and clearly communicated patient-specific information. These can aid discussions between practitioners and patients, promote shared decision-making, and enhance informed consent. The American College of Surgeons Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) sought to create a risk calculator for adult patients considering primary metabolic and bariatric surgery, with multiple prediction features: (1) 30-day risk; (2) 1-year body mass index projections; and (3) 1-year co-morbidity remission. OBJECTIVES: To evaluate the 30-day risk estimation feature of this tool. SETTING: Not-for-profit organization, international bariatric surgery clinical data registry. METHODS: MBSAQIP data across 5.5 years, 925 hospitals, and 775,291 cases were used to develop the 30-day risk feature. Logistic regression models were employed to estimate postoperative risks for 9 outcomes across 4 procedures: laparoscopic Roux-en-Y gastric bypass, laparoscopic sleeve gastrectomy, laparoscopic adjustable gastric band, and biliopancreatic diversion with duodenal switch. RESULTS: The tool showed good discrimination for mortality and surgical site infection models (c-statistics, .80 and .70, respectively), and was slightly less accurate for the 7 other complications (.62-.69). Graphical representations showed excellent calibration for all 9 outcomes. CONCLUSIONS: Overall, the 30-day risk models were accurate and well calibrated, with acceptable discrimination. The MBSAQIP bariatric surgical risk/benefit calculator is publicly available, with the intent to be integrated into healthcare practice to guide bariatric surgical decision-making and care planning, and to enhance communication between patients and their surgical care team.