Characteristics and Practice Patterns of Non-certified Surgeons Treating Medicare Patients.

OBJECTIVE: The objective of this study is to explore the patient characteristics and practice patterns of non-certified surgeons who treat Medicare patients in the United States. SUMMARY BACKGROUND DATA: While most surgeons in the United States are board-certified, non-certified surgeons are permitted to practice in many locations. At the same time, surgical workforce shortages threaten access to surgical care for many patients. It is possible that non-certified surgeons may be able to help fill these access gaps. However, little is known about the practice patterns of non-certified surgeons. METHODS: A 100% sample of Medicare claims data from 2014-2019 were used to identify practicing general surgeons. Surgeons were categorized as certified or non-certified in general surgery​​ based on data from the American Board of Surgery. Surgeon practice patterns and patient characteristics were analyzed. RESULTS: A total of 2,097,206 patient cases were included in the study. These patients were treated by 16,076 surgeons, of which 6% were identified as non-certified surgeons. Compared to certified surgeons, non-certified surgeons were less frequently fellowship-trained (20.5% vs. 24.2%, P=0.008) and more likely to be a foreign medical graduate (14.5% vs. 9.2%, P<0.001). Non-certified surgeons were more frequently practicing in for-profit hospitals (21.2% vs. 14.2%, P<0.001) and critical access hospitals (2.2% vs. 1.3%, P<0.001), and were less likely to practice in a teaching hospital (63.2% vs. 72.4%, P<0.001). Compared to certified surgeons, non-certified surgeons treated more non-White patients (19.6% vs. 14%, P<0.001) as well as a higher percentage of patients in the two lowest socioeconomic status (SES) quintiles (36.2% vs. 29.2%, P<0.001). Operations related to emergency admissions were more common amongst non-certified surgeons (68.8% vs. 55.7%, P<0.001). There were no differences in gender or age of the patients treated by certified and non-certified surgeons. CONCLUSION: For Medicare patients, non-certified surgeons treated more patients who are non-White, of lower SES, and in more rural, critical-access hospitals.

Evaluating Performance and Autonomy Levels of Previous Preliminary Surgery Interns.

INTRODUCTION: Surgery residents who complete a nondesignated preliminary year have an additional year of training compared to those who begin as categorical residents. While this additional year is sometimes perceived negatively, these more experienced residents may outperform traditional categorical (TC) residents in their first year of training. METHODS: Operative assessment ratings were recorded for first year categorical general surgery residents in the United States between 2015 and 2023 using the Society for Improving Medical and Professional Learning assessment platform. Residents were categorized based on the completion of a nondesignated preliminary year ("Previous Prelim" [PP]) or not ("Traditional Categorical"). Ratings were analyzed using generalized mixed effects models. Performance and autonomy outcomes were dichotomized: "less experience" or "more experience" and "no autonomy" or "some autonomy", respectively. Fixed effects included academic month and case complexity, while random effects included resident, faculty, program, and procedure. RESULTS: A total of 34,353 evaluations from 86 general surgery programs were collected. Of these, 829 were evaluations from PP residents. Faculty ratings of PP versus TC revealed no differences in adjusted probabilities of achieving a "more experience" rating (82% versus 76%, P = 0.26) but a higher adjusted probability of achieving a "some autonomy" rating (88% versus 80%, P = 0.04) for PP compared to TC. Analysis of resident self-reported ratings revealed higher adjusted probabilities of a "more experience" rating (77% versus 50%, P = 0.01) and "some autonomy" rating (87% versus 73%; P = 0.02) for PP compared to TC. CONCLUSIONS: First year general surgery residents who previously completed a preliminary year have similar operative performance faculty ratings when compared to their peers.

Efficacy and Safety of Anti-Xa-Guided Versus Fixed Dosing of Low Molecular Weight Heparin for Prevention of Venous Thromboembolism in Trauma Patients: A Systematic Review and Meta-Analysis.

PURPOSE: Trauma patients are at high risk of venous thromboembolism (VTE). We summarize the comparative efficacy and safety of anti-Xa-guided versus fixed dosing for low molecular weight heparin (LMWH) for the prevention of VTE in adult trauma patients. METHODS: We searched Medline and Embase from inception through June 1, 2022. We included randomized controlled trials or observational studies comparing anti-Xa-guided versus fixed dosing of LMWH for thromboprophylaxis in adult trauma patients. We incorporated primary data from 2 large observational cohorts. We pooled effect estimates using a random-effects model. We assessed risk of bias using the ROBINS-I tool for observational studies and assessed certainty of findings using GRADE methodology. RESULTS: We included 15 observational studies involving 10,348 patients. No randomized controlled trials were identified. determined that, compared to fixed LMWH dosing, anti-Xa-guided dosing may reduce deep vein thrombosis [adjusted odds ratio (aOR); 0.52, 95% CI: 0.40-0.69], pulmonary embolism (aOR: 0.48, 95% CI: 0.30-0.78) or any VTE (aOR: 0.54, 95% CI: 0.42-0.69), though all estimates are based on low certainty evidence. There was an uncertain effect on mortality (aOR: 1.06, 95% CI: 0.85-1.32) and bleeding events (aOR: 0.84, 95% CI: 0.50-1.39), limited by serious imprecision. We used several sensitivity and subgroup analyses to confirm the validity of our assumptions. CONCLUSION: Anti-Xa-guided dosing may be more effective than fixed dosing for prevention of deep vein thrombosis, pulmonary embolism, and VTE for adult trauma patients. These promising findings justify the need for a high-quality randomized study with the potential to deliver practice changing results.

The Demands of Surgery Residency: More Than Just Duty Hours?

INTRODUCTION: Efforts to improve surgical resident well-being could be accelerated with an improved understanding of resident job demands and resources. In this study, we sought to obtain a clearer picture of surgery resident job demands by assessing how residents distribute their time both inside and outside of the hospital. Furthermore, we aimed to elucidate residents' perceptions about current duty hour regulations. METHODS: A cross-sectional survey was sent to 1098 surgical residents at 27 US programs. Responses regarding work hours, demographics, well-being (utilizing the physician well-being index), and perceptions of duty hours in relation to education and rest, were collected. Data were evaluated using descriptive statistics and content analysis. RESULTS: A total of 163 residents (14.8% response rate) were included in the study. Residents reported a median total patient care hours per week of 78.0 h. Trainees spent 12.5 h on other professional activities. Greater than 40% of residents were "at risk" for depression and suicide based on physician well-being index scores. Four major themes associated with education and rest were identified: 1) duty hour definitions and reporting mechanisms do not completely reflect the amount of work residents perform, 2) quality patient care and educational opportunities do not fit neatly within the duty hour framework, 3) resident perceptions of duty hours are impacted the educational environment, and 4) long work hours and lack of adequate rest negatively affect well-being. CONCLUSIONS: The breadth and depth of trainee job demands are not accurately captured by current duty hour reporting mechanisms, and residents do not believe that their current work hours allow for adequate rest or even completion of other clinical or academic tasks outside of the hospital. Many residents are unwell. Duty hour policies and resident well-being may be improved with a more holistic accounting of resident job demands and greater attention to the resources that residents have to offset those demands.

An Ideal System of Assessment to Support Competency-Based Graduate Medical Education: Key Attributes and Proposed Next Steps.

Competency-based medical education (CBME) is the future of medical education and relies heavily on high quality assessment. However, the current assessment practices employed by many general surgery graduate medical education training programs are subpar. Assessments often lack reliability and validity evidence, have low faculty engagement, and differ from program to program. Given the importance of assessment in CBME, it is critical that we build a better assessment system for measuring trainee competency. We propose that an ideal system of assessment is standardized, evidence-based, comprehensive, integrated, and continuously improving. In this article, we explore these characteristics and propose next steps to achieve such a system of assessment in general surgery.

Geographic and demographic trends with the initiation of virtual interviews in general surgery: A 7-program evaluation.

BACKGROUND: Although most general surgery residency interviews remain virtual, the effect of this format remains understudied. Single-institution data have shown an increase in the number of applications received and interviews conducted with virtual interviewing but no change in the geographic backgrounds of interviewed or matched applicants. This study sought to compare national trends in geographic characteristics of general surgery applicants, interviewed applicants, and matched applicants between in-person and virtual application cycles. STUDY DESIGN: A retrospective review of 7 general surgery residency programs from application years 2016-2019 (in-person) and 2020-2021 (virtual) was conducted. Data collected included birth year, sex, race, medical school state, and contact location at the time of application. Data were analyzed using generalized mixed effects linear models. RESULTS: A total of 52,742 applicants, 4,550 interviewed applicants, and 329 matched applicants were included. During virtual application cycles, there were no increases in the average number of applicants (P = .25), interviewed applicants (P = .36), or matched (P = .84) applicants per year. Virtual cycles were associated with a larger proportion of interviews conducted with applicants from out-of-state medical schools (P < .01) and listing out-of-state contact locations (P < .01) compared with in-person application cycles. There were no significant geographic differences in matched applicants between virtual and in-person application cycles. CONCLUSION: Virtual application cycles had greater geographic diversity among interviewed applicants. However, similar differences were not seen in the geographic diversity of matched applicants. Additional efforts should focus on why no changes in the geographic diversity of matched applicants were identified.

How Reliable are Single-Question Workplace-Based Assessments in Surgery?

OBJECTIVE: Workplace-based assessments (WBAs) play an important role in the assessment of surgical trainees. Because these assessment tools are utilized by a multitude of faculty, inter-rater reliability is important to consider when interpreting WBA data. Although there is evidence supporting the validity of many of these tools, inter-reliability evidence is lacking. This study aimed to evaluate the inter-rater reliability of multiple operative WBA tools utilized in general surgery residency. DESIGN: General surgery residents and teaching faculty were recorded during 6 general surgery operations. Nine faculty raters each reviewed 6 videos and rated each resident on performance (using the Society for Improving Medical Professional Learning, or SIMPL, Performance Scale as well as the operative performance rating system (OPRS) Scale), entrustment (using the ten Cate Entrustment-Supervision Scale), and autonomy (using the Zwisch Scale). The ratings were reviewed for inter-rater reliability using percent agreement and intraclass correlations. PARTICIPANTS: Nine faculty members viewed the videos and assigned ratings for multiple WBAs. RESULTS: Absolute intraclass correlation coefficients for each scale ranged from 0.33 to 0.47. CONCLUSIONS: All single-item WBA scales had low to moderate inter-rater reliability. While rater training may improve inter-rater reliability for single observations, many observations by many raters are needed to reliably assess trainee performance in the workplace.

Right Case, Right Time: Which Procedures Best Differentiate General Surgery Trainees' Operative Performance?

OBJECTIVE: Assessing surgical trainee operative performance is time- and resource-intensive. To maximize the utility of each assessment, it is important to understand which assessment activities provide the most information about a trainee's performance. The objective of this study is to identify the procedures that best differentiate performance for each general surgery postgraduate year (PGY)-level, leading to recommendations for targeted assessment. DESIGN: The Society for Improving Medical Professional Learning (SIMPL) operative performance ratings were modeled using a multilevel Rasch model which identified the highest and lowest performing trainees for each PGY-level. For each procedure within each PGY-level, a procedural performance discrimination index was calculated by subtracting the proportion of "practice-ready" ratings of the lowest performing trainees from the proportion of "practice-ready" ratings of the highest performing trainees. Four-quadrant plots were created using the median procedure volume and median discrimination index for each PGY-level. All procedures within the upper right quadrant were considered "highly differentiating, high volume" procedures. SETTING: This study was conducted across 70 general surgical residency programs who are members of the SIMPL collaborative. PARTICIPANTS: A total of 54,790 operative performance evaluations of categorical general surgery trainees were collected between 2015 and 2021. Trainees who had at least 1 procedure in common were included. Procedures with less than 25 evaluations per training year were excluded. RESULTS: The total number of evaluations per procedure ranged from 25 to 2,131. Discrimination values were generated for 51 (PGY1), 54 (PGY2), 92 (PGY3), 105 (PGY4), and 103 (PGY5) procedures. Using the above criteria, a total of 12 (PGY1), 15 (PGY2), 22 (PGY3), 21 (PGY4), and 28 (PGY5) procedures were identified as highly differentiating, high volume procedures. CONCLUSIONS: Our study draws on national data to identify procedures which are most useful in differentiating trainee operative performance at each PGY-level. This list of procedures can be used to guide targeted assessment and improve assessment efficiency.

Thriving as a Surgical Intern: Three Tips From the Collaboration of Surgical Education Fellows (CoSEF).

We are the multi-institutional organization known as the Collaboration of Surgical Education Fellows (CoSEF). We've collectively reflected on our range of experiences across the country and identified 3 principles which promote a successful intern experience: (1) Own your patients; (2) Treat people like people; and (3) Take care of yourself.

Association of Gender and Operative Feedback Quality in Surgical Residents.

OBJECTIVE: Feedback is critical for learning, however, gender differences exist in the quality of feedback that trainees receive. For example, narrative feedback on surgical trainees' end-of-block rotations differs based on trainee-faculty gender dyads, with female faculty giving higher quality feedback and male trainees receiving higher quality feedback. Though this represents evidence of gender bias in global evaluations, there is limited understanding of how much bias might be present in operative workplace-based assessments (WBAs). In this study, we explore the quality of narrative feedback among trainee-faculty gender dyads in an operative WBA. DESIGN: A previously validated natural language processing model was used to examine instances of narrative feedback and assign a probability of being characterized as high quality feedback (defined as feedback which was relevant as well as corrective and/or specific). A linear mixed model was performed, with probability of high quality feedback as the outcome, and resident gender, faculty gender, PGY, case complexity, autonomy rating, and operative performance rating as explanatory variables. PARTICIPANTS: Analyses included 67,434 SIMPL operative performance evaluations (2,319 general surgery residents, 70 institutions) collected from September 2015 through September 2021. RESULTS: Of 36.3% evaluations included narrative feedback. Male faculty were more likely to provide narrative feedback compared to female faculty. Mean probabilities of receiving high quality feedback ranged from 81.6 (female faculty-male resident) to 84.7 (male faculty-female resident). Model-based results demonstrated that female residents were more likely to receive high quality feedback (p < 0.01), however, there was no significant difference in probability of high quality narrative feedback based on faculty-resident gender dyad (p = 0.77). CONCLUSIONS: Our study revealed resident gender differences in the probability of receiving high-quality narrative feedback following a general surgery operation. However, we found no significant differences based on faculty-resident gender dyad. Male faculty were more likely to provide narrative feedback compared to their female colleagues. Further research using general surgery resident-specific feedback quality models may be warranted.

Enoxaparin titrated by anti-Xa levels reduces venous thromboembolism in trauma patients.

BACKGROUND: Trauma is a major risk factor for the development of a venous thromboembolism (VTE). After observing higher than expected VTE rates within our center's Trauma Quality Improvement Program data, we instituted a change in our VTE prophylaxis protocol, moving to enoxaparin dosing titrated by anti-Xa levels. We hypothesized that this intervention would lower our symptomatic VTE rates. METHODS: Adult trauma patients at a single institution meeting National Trauma Data Standard criteria from April 2015 to September 2019 were examined with regards to VTE chemoprophylaxis regimen and VTE incidence. Two groups of patients were identified based on VTE protocol-those who received enoxaparin 30 mg twice daily without routine anti-Xa levels ("pre") versus those who received enoxaparin 40 mg twice daily with dose titrated by serial anti-Xa levels ("post"). Univariate and multivariate analyses were performed to define statistically significant differences in VTE incidence between the two cohorts. RESULTS: There were 1698 patients within the "pre" group and 1406 patients within the "post" group. The two groups were essentially the same in terms of demographics and risk factors for bleeding or thrombosis. There was a statistically significant reduction in VTE rate (p = 0.01) and deep vein thrombosis rate (p = 0.01) but no significant reduction in pulmonary embolism rate (p = 0.21) after implementation of the anti-Xa titration protocol. Risk-adjusted Trauma Quality Improvement Program data showed an improvement in rate of symptomatic pulmonary embolism from fifth decile to first decile. CONCLUSION: A protocol titrating prophylactic enoxaparin dose based on anti-Xa levels reduced VTE rates. Implementation of this type of protocol requires diligence from the physician and pharmacist team. Further research will investigate the impact of protocol compliance and time to appropriate anti-Xa level on incidence of VTE. LEVEL OF EVIDENCE: Therapeutic/care management, Level IV.