Octogenarians unable to return home by postoperative-day 30.

BACKGROUND: For older adults undergoing surgery, returning home is instrumental for functional independence. We quantified octogenarians unable to return home by POD-30, assessed geriatric factors in a predictive model, and identified risk factors to inform decision-making and quality improvement. METHODS: This retrospective cohort study examined patients ≥80 years old from the ACS NSQIP Geriatric Surgery Pilot, using sequential logistic regression modelling. The primary outcome was non-home living location at POD-30. RESULTS: Of 4946 patients, 19.8 â€‹% lived in non-home facilities at POD-30. Increased odds of non-home living location were seen in patients with preoperative fall history (OR 2.92, 95%CI 2.06-4.14) and new postoperative pressure ulcer (OR 2.66, 95%CI 1.50-4.71) Other significant geriatric-specific risk factors included mobility aid use, surrogate-signed consent, and postoperative delirium, with odds ratios ranging from 1.42 (1.19-1.68) to 1.97 (1.53-2.53). CONCLUSIONS: These geriatric-specific risk factors highlight the importance of preoperative vulnerability screening and intervention to inform surgical decision-making.

Social Vulnerability and Receipt of Guideline-Concordant Care among Patients with Colorectal Cancer.

BACKGROUND: Cancer outcome disparities have been reported in highly vulnerable communities. The objective of this study was to evaluate the association of social vulnerability with receipt of guideline-concordant care (GCC) and mortality risk for patients with colorectal cancer. STUDY DESIGN: This retrospective observational study identified patients with stage I-III colon or stage II-III rectal cancer between 2018 and 2020 from the National Program of Cancer Registries Database. Data were merged with the Centers for Disease Control and Prevention Social Vulnerability Index (SVI) at the county level. GCC was defined as stage-appropriate lymphadenectomy, radiation therapy, or systemic therapy. Multivariable logistic regression and Cox proportional hazards regression investigated associations of SVI, as a continuous and categorical variable stratified into quartiles, with GCC and 3-year cancer-specific mortality risk, respectively. RESULTS: Among 124,950 patients (colon, n=102,399; rectal, n=22,551), median SVI was 60.9 (IQR 35.0 to 79.5). Patients in the highest SVI quartile had 21% decreased odds of receiving GCC (95% CI 0.76 - 0.83). Treatment at Commission on Cancer (CoC) accredited hospitals was associated with increased GCC (OR 1.79; 95% CI 1.72 - 1.85). Although there was an inverse, decreasing association between SVI and probability of GCC, probability at non-CoC-accredited hospitals declined faster than at CoC-accredited hospitals (p<0.05). After adjusting for receipt of GCC, highly vulnerable patients treated at CoC-accredited hospitals had decreased mortality risk (HR 0.91; 95% CI 0.83 - 0.98). CONCLUSION: For highly vulnerable patients, treatment at CoC-accredited hospitals was associated with increased receipt of GCC and decreased mortality risk, which may reflect CoC-accreditation requirements for treatment guideline adherence, community engagement, and addressing barriers to care.

Within-hospital Temporal Clustering of Postoperative Complications and Implications for Safety Monitoring and Benchmarking Using ACS-NSQIP Data.

Objective: To determine the extent to which within-hospital temporal clustering of postoperative complications is observed in the American College of Surgeons, National Surgical Quality Improvement Program (ACS-NSQIP). Background: ACS-NSQIP relies on periodic and on-demand reports for quality benchmarking. However, if rapid increases in postoperative complication rates (clusters) are common, other reporting methods might be valuable additions to the program. This article focuses on estimating the incidence of within-hospital temporal clusters. Methods: ACS-NSQIP data from 1,547,440 patients, in 425 hospitals, over a 2-year period was examined. Hospital-specific Cox proportional hazards regression was used to estimate the incidence of mortality, morbidity, and surgical site infection (SSI) over a 30-day postoperative period, with risk adjustment for patient and procedure and with additional adjustments for linear trend, day-of-week, and season. Clusters were identified using scan statistics, and cluster counts were compared, using unpaired and paired t tests, for different levels of adjustment and when randomization of cases across time eliminated all temporal influences. Results: Temporal clusters were rarely observed. When clustering was adjusted only for patient and procedure risk, an annual average of 0.31, 0.85, and 0.51 clusters were observed per hospital for mortality, morbidity, and SSI, respectively. The number of clusters dropped after adjustment for linear trend, day-of-week, and season (0.31-0.24; P = 0.012; 0.85-0.80; P = 0.034; and 0.51-0.36; P < 0.001; using paired t tests) for mortality, morbidity, and SSI, respectively. There was 1 significant difference in the number of clusters when comparing data with all adjustments and after data were randomized (0.24 and 0.25 for mortality; P = 0.853; 0.80 and 0.82 for morbidity; P = 0.529; and 0.36 and 0.46 [randomized data had more clusters] for SSI; P = 0.001; using paired t tests) for mortality, morbidity, and SSI, respectively. Conclusions: Temporal clusters of postoperative complications were rarely observed in ACS-NSQIP data. The described methodology may be useful in assessing clustering in other surgical arenas.

Hospital Accreditation Status and Treatment Differences Among Black Patients With Colon Cancer.

Importance: Hospital-level factors, such as hospital type or volume, have been demonstrated to play a role in treatment disparities for Black patients with cancer. However, data evaluating the association of hospital accreditation status with differences in treatment among Black patients with cancer are lacking. Objective: To evaluate the association of Commission on Cancer (CoC) hospital accreditation status with receipt of guideline-concordant care and mortality among non-Hispanic Black patients with colon cancer. Design, Setting, and Participants: This population-based cohort study used the National Program of Cancer Registries, which is a multicenter database with data from all 50 states and the District of Columbia, and covers 97% of the cancer population in the US. The participants included non-Hispanic Black patients aged 18 years or older diagnosed with colon cancer between January 1, 2018, and December 31, 2020. Race and ethnicity were abstracted from medical records as recorded by health care facilities and practitioners. The data were analyzed from December 7, 2023, to January 17, 2024. Exposure: CoC hospital accreditation. Main Outcome and Measures: Guideline-concordant care was defined as adequate lymphadenectomy during surgery for patients with stages I to III disease or chemotherapy administration for patients with stage III disease. Multivariable logistic regression models investigated associations with receipt of guideline-concordant care and Cox proportional hazards regression models assessed associations with 3-year cancer-specific mortality. Results: Of 17 249 non-Hispanic Black patients with colon cancer (mean [SD] age, 64.8 [12.8] years; 8724 females [50.6%]), 12 756 (74.0%; mean [SD] age, 64.7 [12.8] years) were treated at a CoC-accredited hospital and 4493 (26.0%; mean [SD] age, 65.1 [12.5] years) at a non-CoC-accredited hospital. Patients treated at CoC-accredited hospitals compared with those treated at non-CoC-accredited hospitals had higher odds of receiving guideline-concordant lymphadenectomy (adjusted odds ratio [AOR], 1.89; 95% CI, 1.69-2.11) and chemotherapy (AOR, 2.31; 95% CI, 1.97-2.72). Treatment at CoC-accredited hospitals was associated with lower cancer-specific mortality for patients with stages I to III disease who received surgery (adjusted hazard ratio [AHR], 0.87; 95% CI, 0.76-0.98) and for patients with stage III disease eligible for chemotherapy (AHR, 0.75; 95% CI, 0.59-0.96). Conclusions and Relevance: In this cohort study of non-Hispanic Black patients with colon cancer, patients treated at CoC-accredited hospitals compared with those treated at non-CoC-accredited hospitals were more likely to receive guideline-concordant care and have lower mortality risk. These findings suggest that increasing access to high-quality guideline-concordant care at CoC-accredited hospitals may reduce variations in cancer treatment and outcomes for underserved populations.

A NSQIP-Based Randomized Clinical Trial Evaluating Choice of Prophylactic Antibiotics for Pancreaticoduodenectomy.

Surgical site infection is a common complication following pancreaticoduodenectomy and is a major source of postoperative morbidity. Surgical site infection is more common among patients who undergo preoperative biliary instrumentation, likely because of the introduction of intestinal flora into the normally sterile biliary tree. Frequently, bacterial isolates from surgical site infections after pancreaticoduodenectomy demonstrate resistance to the antibiotic agents typically used for surgical prophylaxis, suggesting that broad-spectrum coverage may be beneficial. This chapter summarizes the current evidence regarding surgical site infection following pancreatic surgery and describes the rationale and methodology underlying a multicenter randomized trial evaluating piperacillin-tazobactam compared with cefoxitin for surgical site infection prevention following pancreaticoduodenectomy. As the first U.S. randomized surgical trial to utilize a clinical registry for data collection, this study serves as proof of concept for registry-based clinical trials. The trial has successfully completed patient accrual, and study results are forthcoming.

Evidence Review for the American College of Surgeons Quality Verification Part III: Standardization, Protocols, and Achieving Better Outcomes for Patient Care.

BACKGROUND: After decades of experience supporting surgical quality and safety by the American College of Surgeons, the ACS Quality Verification Program (ACS QVP) was developed to help hospitals improve surgical quality and safety. This review is the final installment of a three-part review aimed to synthesize evidence supporting the main principles of the ACS QVP. STUDY DESIGN: Evidence was systematically reviewed for three principles: standardized team-based care across five phases of surgical care, disease-based management, and external regulatory review. MEDLINE was searched for articles published from inception to January 2019 and two reviewers independently screened studies for inclusion in a hierarchical fashion, extracted data, and summarized results in a narrative fashion. A total of 5,237 studies across these three topics were identified. Studies were included if they evaluated the relationship between the standard of interest and patient-level or organization measures within the last twenty years. RESULTS: After applying inclusion criteria, a total of 150 studies in systematic reviews and primary studies were included for assessment. Despite institutional variation in standardized clinical pathways, evidence demonstrated improved outcomes such as reduced length of stay (LOS), costs, and complications. Evidence for multidisciplinary disease-based care protocols was mixed, though trended towards improving patient outcomes such as reduced LOS and readmissions. Similarly, the evidence for accreditation and adherence to external process measures was also mixed, though several studies demonstrated the benefit of accreditation programs on patient outcomes. CONCLUSIONS: The identified literature supports the importance of standardized multidisciplinary and disease-based processes and external regulatory systems to improve quality of care.

Adding Patient-reported Outcomes to the American College of Surgeons National Surgical Quality Improvement Program: Results of the First 33,842 Patients From 65 Hospitals.

OBJECTIVE: To investigate the initial set of patient-reported outcomes (PROs) in the American College of Surgeons National Surgical Quality Improvement Program (NSQIP) and their associations with 30-day surgical outcomes. BACKGROUND: PROs provide important information that can be used to improve routine care and facilitate quality improvement. The American College of Surgeons conducted a demonstration project to capture PROs into the NSQIP to complement clinical data. METHODS: From February 2020 to March 2023, 65 hospitals collected Patient-Reported Outcomes Measurement Information System measures assessing global health, pain interference, fatigue, and physical function from patients accrued into the NSQIP. Using multivariable mixed regression, we compared the scores of patients with and without 30-day complications and further analyzed scores exceeding 1-SD worse than national benchmarks. RESULTS: Overall, 33842 patients completed the Patient-Reported Outcomes Measurement Information System measures with a median of 58 days (IQR: 47-72) postoperatively. Among patients without complications (n = 31210), 33.9% had PRO scores 1-SD worse than national benchmarks. Patients with complications were 1.7 times more likely to report worse PROs (95% CI: 1.6-1.8). Patients with complications had lower scores for global physical health [adjusted mean difference (AMD): 2.6, 95% CI: 2.2-3.0], lower for global mental health (AMD: 1.8, 95% CI: 1.4-2.2), higher for pain interference (AMD: 2.4, 95% CI: 2.0-2.8), higher fatigue (AMD: 2.7, 95% CI: 2.3-3.1), and lower physical function (AMD: 3.2, 95% CI: 2.8-3.5). CONCLUSIONS: Postoperative complications negatively affect multiple key dimensions of patients' health-related quality of life. PROs were well below national benchmarks for many patients, even among those without complications. Identifying solutions to improve PROs after surgery remains a tremendous quality improvement opportunity.

Patient-Reported Outcome Measures Within a National Multispecialty Surgical Quality Improvement Program.

Importance: Patient-reported outcome measures (PROMs) are increasingly recognized for their ability to promote patient-centered care, but concerted health information technology (HIT)-enabled PROM implementations have yet to be achieved for national surgical quality improvement. Objective: To evaluate the feasibility of collecting PROMs within a national surgical quality improvement program. Design, Setting, and Participants: This was a pragmatic implementation cohort study conducted from February 2020 to March 2023. Hospitals in the US participating in the American College of Surgeons National Surgical Quality Improvement Program and their patients were included in this analysis. Exposures: Strategies to increase PROM collection rates were identified using the Institute for Healthcare Improvement (IHI) Framework for Spread and the Consolidated Framework for Implementation Research and operationalized with the IHI Model for Improvement's Plan-Do-Study-Act (PDSA) cycles. Main Outcomes and Measures: The primary goal was to accrue more than 30 hospitals and achieve collection rates of 30% or greater in the first 3 years. Logistic regression was used to identify hospital-level factors associated with achieving collection rates of 30% or greater and to identify patient-level factors associated with response to PROMs. Results: At project close, 65 hospitals administered PROMs to 130 365 patients (median [IQR] age, 60.1 [46.2-70.0] years; 77 369 female [59.4%]). Fifteen PDSA cycles were conducted to facilitate implementation, primarily targeting the Consolidated Framework for Implementation Research domains of Inner Setting (ie, HIT platform) and Individuals (ie, patients). The target collection rate was exceeded in quarter 3 (2022). Fifty-eight hospitals (89.2%) achieved collection rates of 30% or greater, and 9 (13.8%) achieved collection rates of 50% or greater. The median (IQR) maximum hospital-level collection rate was 40.7% (34.6%-46.7%). The greatest increases in collection rates occurred when both email and short-message service text messaging were used, communications to patients were personalized with their surgeon's and hospital's information, and the number of reminders increased from 2 to 5. No identifiable hospital characteristic was associated with achieving the target collection rate. Patient age and insurance status contributed to nonresponse. Conclusions and Relevance: Results of this cohort study suggest that the large-scale electronic collection of PROMs into a national multispecialty surgical registry was feasible. Findings suggest that HIT platform functionality and earning patient trust were the keys to success; although, iterative opportunities to increase collection rates and address nonresponse remain. Future work to drive continuous surgical quality improvement with PROMs are ongoing.

Are We Supporting Surgical Quality Improvement in Training and Beyond? A Qualitative Study of Surgical Trainees and Practicing Surgeons.

BACKGROUND: We conducted a qualitative study to describe surgeon and surgical trainee perspectives of quality improvement (QI) in training and practice to elucidate how surgeons and trainees interact with barriers and leverage facilitators to learn and conduct QI. STUDY DESIGN: Surgeons and surgical trainees of the American College of Surgeons were recruited via email and snowball sampling to participate in focus groups. Eligible individuals were English speaking surgical trainees or practicing surgeons. We developed a semi-structured focus group protocol to explore barriers and facilitators of quality training and improvement. An inductive thematic approach was used to identify actionable items. RESULTS: Thirty-two surgical trainees and surgeons participated in six focus groups. 28% of participants were trainees (8 residents, 1 fellow) and 72% were practicing surgeons, representing practice settings in university, community, and Veterans Affairs hospitals in urban and suburban regions. Thematic analysis revealed the central theme among trainees was that they lacked necessary support to effectively learn and conduct QI. Dominant sub-themes included lack of formal education, insufficient time, inconsistent mentorship, and maximizing self-sufficiency to promotes success. The central theme among surgeons was that effective QI initiatives require adequate resources and institutional support; however, surgeons in this study were ultimately constrained by institutional limitations. Sub-themes included difficulties in data acquisition and interpretation, financial limitations, workforce and staffing challenges, misaligned stakeholder priorities, and institutional culture. CONCLUSION: This qualitative evaluation further details gaps in QI demonstrated by previous quantitative studies. There is an opportunity to address these gaps with dedicated QI training and mentorship for surgical trainees and by creating a supportive environment with ample resources for surgeons.

Identifying Population-Level and Within-Hospital Disparities in Surgical Care.

BACKGROUND: The lack of consensus on equity measurement and its incorporation into quality-assessment programs at the hospital and system levels may be a barrier to addressing disparities in surgical care. This study aimed to identify population-level and within-hospital differences in the quality of surgical care provision. STUDY DESIGN: The analysis included 657 NSQIP participating hospitals with more than 4 million patients (2014 to 2018). Multilevel random slope, random intercept modeling was used to examine for population-level and in-hospital disparities. Disparities in surgical care by Area Deprivation Index (ADI), race, and ethnicity were analyzed for 5 measures: all-case inpatient mortality, all-case urgent readmission, all-case postoperative surgical site infection, colectomy mortality, and spine surgery complications. RESULTS: Population-level disparities were identified across all measures by ADI, 2 measures for Black race (all-case readmissions and spine surgery complications), and none for Hispanic ethnicity. Disparities remained significant in the adjusted models. Before risk adjustment, in all measures examined, within-hospital disparities were detected in: 25.8% to 99.8% of hospitals for ADI, 0% to 6.1% of hospitals for Black race, and 0% to 0.8% of hospitals for Hispanic ethnicity. After risk adjustment, in all measures examined, less than 1.1% of hospitals demonstrated disparities by ADI, race, or ethnicity. CONCLUSIONS: After risk adjustment, very few hospitals demonstrated significant disparities in care. Disparities were more frequently detected by ADI than by race and ethnicity. The lack of substantial in-hospital disparities may be due to the use of postoperative metrics, small sample sizes, the risk adjustment methodology, and healthcare segregation. Further work should examine surgical access and healthcare segregation.

Development and preliminary assessment of a machine learning model to predict myocardial infarction and cardiac arrest after major operations.

INTRODUCTION: Accurate prediction of complications often informs shared decision-making. Derived over 10 years ago to enhance prediction of intra/post-operative myocardial infarction and cardiac arrest (MI/CA), the Gupta score has been criticized for unreliable calibration and inclusion of a wide spectrum of unrelated operations. In the present study, we developed a novel machine learning (ML) model to estimate perioperative risk of MI/CA and compared it to the Gupta score. METHODS: Patients undergoing major operations were identified from the 2016-2020 ACS-NSQIP. The Gupta score was calculated for each patient, and a novel ML model was developed to predict MI/CA using ACS NSQIP-provided data fields as covariates. Discrimination (C-statistic) and calibration (Brier score) of the ML model were compared to the existing Gupta score within the entire cohort and across operative subgroups. RESULTS: Of 2,473,487 patients included for analysis, 25,177 (1.0%) experienced MI/CA (55.2% MI, 39.1% CA, 5.6% MI and CA). The ML model, which was fit using a randomly selected training cohort, exhibited higher discrimination within the testing dataset compared to the Gupta score (C-statistic 0.84 vs 0.80, p < 0.001). Furthermore, the ML model had significantly better calibration in the entire cohort (Brier score 0.0097 vs 0.0100). Model performance was markedly improved among patients undergoing thoracic, aortic, peripheral vascular and foregut surgery. CONCLUSIONS: The present ML model outperformed the Gupta score in the prognostication of MI/CA across a heterogenous range of operations. Given the growing integration of ML into healthcare, such models may be readily incorporated into clinical practice and guide benchmarking efforts.

Identifying a common data dictionary across colorectal cancer outcome registries: A mapping exercise to identify opportunities for data dictionary harmonisation.

IMPORTANCE: The development of colorectal cancer outcome registries internationally has been organic, with differing datasets, data definitions and infrastructure across registries which has limited data pooling and international comparison. Currently there is no comprehensive data dictionary identified as a standard. This study is part of an international collaboration that aims to identify areas of data capture and usage which may be optimised to improve understanding of colorectal cancer outcomes. OBJECTIVE: This study aimed to compare and identify commonalities and areas of difference across major colorectal cancer registries. We sought to establish datasets comprising of mutually collected common fields, and a combined comprehensive dataset of all collected fields across major registries to aid in establishing a future colorectal cancer registry database standard. DESIGN AND METHODS: This mixed qualitative and quantitative study compared data dictionaries from three major colorectal cancer outcome registries: Bowel Cancer Outcomes Registry (BCOR) (Australia and New Zealand), National Bowel Cancer Audit (NBOCA) (United Kingdom) and Dutch ColoRectal Audit (DCRA) (Netherlands). Registries were compared and analysed thematically, and a common dataset and combined comprehensive dataset were developed. These generated datasets were compared to data dictionaries from Sweden (SCRCR), Denmark (DCCG), Argentina (BNCCR-A) and the USA (NAACCR and ACS NSQIP). Fields were assessed against prominent quality indicator metrics from the literature and current case-use. RESULTS: We developed a combined comprehensive dataset of 225 fields under seven domains: demographic, pre-operative, operative, post-operative, pathology, neoadjuvant therapy, adjuvant therapy, and follow up/recurrence. A common dataset was developed comprising 38 overlapping fields, showing a low degree of mutually collected data, especially in preoperative, post operative and adjuvant therapy domains. The BNCCR-A, SCRCR and DCCG databases all contained a high percentage of common dataset fields. Fields were poorly comparable when viewed form current quality indicator metrics. CONCLUSION: This study mapped data dictionaries of prominent colorectal cancer registries and highlighted areas of commonality and difference The developed common field dataset provides a foundation for registries to benchmark themselves and work towards harmonisation of data dictionaries. This has the potential to enable meaningful large-scale international outcomes research.

Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program: Bariatric Surgical Risk/Benefit Calculator: 1-year comorbidity remission.

BACKGROUND: Clinical calculators can provide patient-personalized estimates of treatment risks and health outcomes. The American College of Surgeons Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) set out to create a publicly available tool to assess both short-term postoperative risk and long-term benefits for prospective adult patients eligible for 1 of 4 primary bariatric procedures. The calculator is comprised of multiple prediction elements: (1) 30-day postoperative risk, (2) 1-year body mass index projections, and (3) 1-year comorbidity remission. OBJECTIVES: To assess the performance of the 1-year comorbidity remission prediction feature of the calculator. SETTING: Not-for-profit organization clinical data registry. METHODS: MBSAQIP data across 4.5 years from 240,227 total patients indicating at least 1 comorbidity of interest present preoperatively and who had a 1-year follow-up record documenting their comorbidity status were included. Six models were constructed, stratified by the presence of the respective preoperative comorbidity: hypertension, hyperlipidemia, gastroesophageal reflux disease, sleep apnea, non-insulin-dependent diabetes, and insulin-dependent diabetes. A multinomial logistic regression model was used to predict 1-year remission (total, partial, or no remission) of insulin-dependent diabetes. All other outcomes were binary (yes or no at 1 yr), and ordinary logistic regression models were used. RESULTS: All models showed adequate discrimination (C statistics ranging from .58 to .68). Plots of observed versus predicted remission (%) showed excellent calibration across all models. CONCLUSION: All remission models were well calibrated with sufficient discrimination. The MBSAQIP Bariatric Surgical Risk/Benefit Calculator is a publicly available tool intended for integration into clinical practice to enhance patient-clinician discussions and informed consent.

National Multi-Institutional Validation of a Surgical Transfusion Risk Prediction Model.

BACKGROUND: Accurate estimation of surgical transfusion risk is important for many aspects of surgical planning, yet few methods for estimating are available for estimating such risk. There is a need for reliable validated methods for transfusion risk stratification to support effective perioperative planning and resource stewardship. STUDY DESIGN: This study was conducted using the American College of Surgeons NSQIP datafile from 2019. S-PATH performance was evaluated at each contributing hospital, with and without hospital-specific model tuning. Linear regression was used to assess the relationship between hospital characteristics and area under the receiver operating characteristic (AUROC) curve. RESULTS: A total of 1,000,927 surgical cases from 414 hospitals were evaluated. Aggregate AUROC was 0.910 (95% CI 0.904 to 0.916) without model tuning and 0.925 (95% CI 0.919 to 0.931) with model tuning. AUROC varied across individual hospitals (median 0.900, interquartile range 0.849 to 0.944), but no statistically significant relationships were found between hospital-level characteristics studied and model AUROC. CONCLUSIONS: S-PATH demonstrated excellent discriminative performance, although there was variation across hospitals that was not well-explained by hospital-level characteristics. These results highlight the S-PATH's viability as a generalizable surgical transfusion risk prediction tool.

First report of outcomes from the patient-reported outcome measures program in the Metabolic and Bariatric Surgery Accreditation Quality Improvement Program.

BACKGROUND: Health-related quality-of-life (HRQoL) is one of the most important outcomes to metabolic and bariatric surgery (MBS) patients but was not measured by the Metabolic and Bariatric Surgery Accreditation Quality Improvement Program (MBSAQIP). A patient-reported outcome measures (PROMs) program pilot started in 2016 with MBSAQIP implementation in 2019. OBJECTIVES: To measure how MBS impacts patient HRQoL 1 and 2 years after primary laparoscopic Roux-en-Y gastric bypass (bypass) or laparoscopic sleeve gastrectomy (sleeve). SETTING: The 82 centers in the United States participating in the MBSAQIP PROMs program. METHODS: Preoperative HRQoL scores and satisfaction were compared with postoperative scores 1 and 2 years after surgery with univariate comparisons and adjusted regression models. RESULTS: There were 13,901 PROMs responses from 11,146 patients. Patient satisfaction with their MBS decision was 97%. On average, patients had significant improvement in Obesity-related Problem (OP) scores (65.8 preoperatively, 23.0 at 1 yr, and 26.3 at 2 yr; P <.05), Obesity and Weight-Loss Quality-of-Life (OWLQOL) scores (36.7 preoperatively, 77.2 at 1 yr, and 74.6 at 2 yr; P < .05), their physical health (39.2 preoperatively versus 51.7 at 1 yr and 50.0 at 2 yr), and mental health (45.6 preoperatively versus 53.3 at 1 yr and 51.4 at 2 yr). Compared with bypass patients, sleeve patients had significantly lower odds of having low OP scores postoperatively (odds ratio [95% CI) ] .67 [.53, .83]) and lower odds of high OWLQOL (.61 [.48, .77]) at 1 year. CONCLUSION: All patients regardless of procedure on average report significant improvement in their scores for OP, OWLQOL, and physical and mental health after MBS. At 1 and 2 years, bypass patients reported greater improvement in their obesity-related PROMs than sleeve patients.

The Accuracy of the NSQIP Universal Surgical Risk Calculator Compared to Operation-Specific Calculators.

Objective: To compare the performance of the ACS NSQIP "universal" risk calculator (N-RC) to operation-specific RCs. Background: Resources have been directed toward building operation-specific RCs because of an implicit belief that they would provide more accurate risk estimates than the N-RC. However, operation-specific calculators may not provide sufficient improvements in accuracy to justify the costs in development, maintenance, and access. Methods: For the N-RC, a cohort of 5,020,713 NSQIP patient records were randomly divided into 80% for machine learning algorithm training and 20% for validation. Operation-specific risk calculators (OS-RC) and OS-RCs with operation-specific predictors (OSP-RC) were independently developed for each of 6 operative groups (colectomy, whipple pancreatectomy, thyroidectomy, abdominal aortic aneurysm (open), hysterectomy/myomectomy, and total knee arthroplasty) and 14 outcomes using the same 80%/20% rule applied to the appropriate subsets of the 5M records. Predictive accuracy was evaluated using the area under the receiver operating characteristic curve (AUROC), the area under the precision-recall curve (AUPRC), and Hosmer-Lemeshow (H-L) P values, for 13 binary outcomes, and mean squared error for the length of stay outcome. Results: The N-RC was found to have greater AUROC (P = 0.002) and greater AUPRC (P < 0.001) compared to the OS-RC. No other statistically significant differences in accuracy, across the 3 risk calculator types, were found. There was an inverse relationship between the operation group sample size and magnitude of the difference in AUROC (r = -0.278; P = 0.014) and in AUPRC (r = -0.425; P < 0.001) between N-RC and OS-RC. The smaller the sample size, the greater the superiority of the N-RC. Conclusions: While operation-specific RCs might be assumed to have advantages over a universal RC, their reliance on smaller datasets may reduce their ability to accurately estimate predictor effects. In the present study, this tradeoff between operation specificity and accuracy, in estimating the effects of predictor variables, favors the N-R, though the clinical impact is likely to be negligible.

Development and Validation of a Novel Literature-Based Method to Identify Disparity-Sensitive Surgical Quality Metrics.

BACKGROUND: Disparity in surgical care impedes the delivery of uniformly high-quality care. Metrics that quantify disparity in care can help identify areas for needed intervention. A literature-based Disparity-Sensitive Score (DSS) system for surgical care was adapted by the Metrics for Equitable Access and Care in Surgery (MEASUR) group. The alignment between the MEASUR DSS and Delphi ratings of an expert advisory panel (EAP) regarding the disparity sensitivity of surgical quality metrics was assessed. STUDY DESIGN: Using DSS criteria MEASUR co-investigators scored 534 surgical metrics which were subsequently rated by the EAP. All scores were converted to a 9-point scale. Agreement between the new measurement technique (ie DSS) and an established subjective technique (ie importance and validity ratings) were assessed using the Bland-Altman method, adjusting for the linear relationship between the paired difference and the paired average. The limit of agreement (LOA) was set at 1.96 SD (95%). RESULTS: The percentage of DSS scores inside the LOA was 96.8% (LOA, 0.02 points) for the importance rating and 94.6% (LOA, 1.5 points) for the validity rating. In comparison, 94.4% of the 2 subjective EAP ratings were inside the LOA (0.7 points). CONCLUSIONS: Applying the MEASUR DSS criteria using available literature allowed for identification of disparity-sensitive surgical metrics. The results suggest that this literature-based method of selecting quality metrics may be comparable to more complex consensus-based Delphi methods. In fields with robust literature, literature-based composite scores may be used to select quality metrics rather than assembling consensus panels.