Trends in Operative Case Logs of Chief Residents in Surgery by Sex and Race: A 5 - Year National Study.

OBJECTIVES: A recent study of 21 institutions noted significant differences between number of cases reported during general surgery residency by trainees who are Underrepresented in Medicine (URiM) versus trainees who are not Underrepresented in Medicine (non-URiM). This study also identified differences between female residents and male residents. We partnered with the Accreditation Council for Graduate Medical Education to examine case logs reported from all accredited general surgery programs in the United States. This is the first time this data has been examined nationally. METHODS: We examined total case logs submitted by graduating residents between 2017 and 2022. Group differences in mean reported case logs were examined using paired t- tests for female versus male and URiM versus non- URiM overall case numbers. RESULTS: A total of 6,458 residents submitted case logs from 319 accredited programs. Eight-hundred and fifty-four (13%) were URiM and 5,604 (87%) were non-URiM. Over the 5-year study period, URM residents submitted 1096.95 (SD +/- 160.57) major cases versus 1115.96 (+/- 160.53) for non-URiM residents (difference =19 cases, P=0.001). Case logs were submitted by 3,833 (60.1%) male residents and 2,625 (39.9%) female residents over the five-year study period. Male residents reported 1128.56 (SD +/- 168.32) cases versus 1091.38 (+/- 145.98) cases reported by females (difference=37.18, P<0.001). When looking at Surgeon Chief and Teaching Assistant cases, there was no significant difference noted between cases submitted by URiM versus non- URiM residents. However, male residents reported significantly more in both categories than their female peers (P<0.001). CONCLUSIONS: Overall, URiM residents submitted fewer cases in the five- year study period than their non-URiM peers. The gap in submitted cases between male and female residents was more pronounced, with male residents submitting significantly more cases than their female counterparts. This finding was consistent and statistically significant throughout the entire study period, in most case categories, and without narrowing of difference over time. A difference of 30-40 cases can amount to 1-3 months of surgical training and is a concerning national trend deserving the attention of every training program and our governing institutions.

Goals, Structure and Financing of Surgical Residency Training: A Subcommittee Report of the Blue Ribbon Committee II.

OBJECTIVE: As part of the Blue Ribbon Committee II, review current goals, structure and financing of surgical training in Graduate Medical Education (GME) and recommend needed changes. SUMMARY BACKGROUND DATA: Surgical training has continually undergone major transitions with the 80-hour work week, earlier specialization (vascular, plastics and cardiovascular) and now entrustable professional activities (EPAs) as part of competency based medical education (CBME). Changes are needed to ensure the efficiencies of CBME are utilized, that stable graduate medical education funding is secured, and that support for surgeons who teach is made available. METHODS: Convened subcommittee discussions to determine needed focus for recommendations. RESULTS: Five recommendations are offered for changes to GME financing, incorporation of CBME, and support for educators, students and residents in training. CONCLUSIONS: Changes in surgical training related to CBME offer opportunity for change and innovation. Our subcommittee has laid out a potential path forward for improvements in GME funding, training structure, compensation of surgical educators, and support of students and residents in training.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Is Dedicated Research Time During Surgery Residency Associated With Surgeons' Future Career Paths?: A National Study.

OBJECTIVE: We examined associations between participation in ≥1 year of research during general surgery residency and each of full-time academic-medicine faculty appointment and mentored-K and/or Research Project Grant (RPG, including R01 and other) awards. SUMMARY BACKGROUND DATA: Many surgeons participate in ≥1 year of research during residency; however, the relationship between such dedicated research during general surgery residency and surgeons' career paths has not been investigated in a national study. METHODS: We analyzed deidentified data through August 2014 from the Association of American Medical Colleges, American Board of Medical Specialties, and the National Institutes of Health Information for Management, Planning, Analysis, and Coordination II grants database for 1997 to 2004 US medical-school graduates who completed ≥5 years of general surgery graduate medical education (GME) and became board-certified surgeons. Using multivariable logistic regression models, we identified independent predictors of faculty appointment and K/RPG award, reporting adjusted odds ratios (AOR) and 95% confidence intervals (CI) significant at P < 0.05. RESULTS: Of 5328 board-certified surgeons, there were 1848 (34.7%) GME-research participants, 1658 (31.1%) faculty appointees, and 58 (1.1%) K/RPG awardees. Controlling for sex, debt, MD/PhD graduation, and other variables, GME-research participants were more likely to have received faculty appointments (AOR 1.790; 95% CI 1.573-2.037) and federal K/RPG awards (AOR 4.596; 95% CI 2.355-8.969). CONCLUSIONS: Nationally, general surgery GME-research participation was independently associated with faculty appointment and K/RPG award receipt. These findings serve as benchmarks for general surgery residency programs aiming to prepare trainees for careers as academicians and surgeon-scientists.

#SurgEdVidz: Using Social Media to Create a Supplemental Video-Based Surgery Didactic Curriculum.

BACKGROUND: A general surgery resident may have competing clinical responsibilities that limit the ability to participate in educational didactics. Social media is an alternative delivery method for educational content that can be viewed at a resident's convenience. We sought to assess the feasibility of using social media to provide educational content for surgical residents. MATERIALS AND METHODS: We created a novel, supplemental surgical curriculum consisting of two-minute videos based on the This Week in SCORE modules. Videos were posted to Twitter weekly, indexed with the #SurgEdVidz hashtag and uploaded to YouTube to create a catalog of videos. Twitter and YouTube analytics were used to calculate public viewership and impact. RESULTS: A total of 43 videos were disseminated between January 30, 2019 and January 31, 2020. An average of 6.9 h (SD: 1.4; range: 5.0-10.0) was required to generate each video, including 1.5 h (SD: 0.6; range: 0-2.0) for content review and 5.4 h (SD: 1.1; range: 4.0-8.0) for video production. Between the two platforms, videos generated a total of 51,313 views with an average of 1193 views (SD: 715; range: 412-4096) per video. Account followers are geographically distributed across 28 states, 28 countries, and six continents. CONCLUSIONS: Social media can serve as an effective tool for the distribution of surgical educational content. Twitter, in conjunction with YouTube, allows for rapid dissemination of didactic content packaged into brief videos that is flexible in viewership with low time commitment. Social media offers visibility and engagement beyond the classroom without geographical or temporal borders.

Factors influencing the decision of surgery residency graduates to pursue general surgery practice versus fellowship.

OBJECTIVES: Surgery residency serves 2 purposes-prepare graduates for general surgery (GS) practice or postresidency surgical fellowship, leading to specialty surgical practice (SS). This study was undertaken to elucidate factors influencing career choice for these 2 groups. METHODS: All US allopathic surgery residency graduates from 2009 to 2013 (n = 5512) were surveyed by the American Board of Surgery regarding confidence, autonomy, and reasons for career selection between GS and SS. Surveys were distributed by mail in November 2013, with follow-up mailings to initial nonrespondents. RESULTS: Sixty-one percent (3354) of graduates completed the survey; 26% pursued GS, and 74% SS. GS expressed greater levels of confidence than SS across the common surgical procedures queried. Confidence increased with each year after completion of residency for GS but not SS. The decision to pursue GS or SS was made during residency by 77% and 74%, respectively. Fifty-seven percent of those who chose GS indicated that a GS mentor significantly influenced their decision. GS rated procedural variety, opportunity for practice autonomy, choice of practice location, and influence of a mentor as reasons to pursue GS practice. SS listed control over scope of practice, prestige, salary, and specialty interest as reasons to pursue SF. Both groups expressed a high degree of satisfaction with their career choice (GS, 94%; SS, 90%). CONCLUSIONS: Most graduates who pursue GS practice are confident and content. The decision to pursue GS is strongly influenced by a GS mentor. Lack of confidence may be a more significant factor for choosing SS. These findings suggest opportunities for improvements in confidence and mentorship during residency.

Update on Outcomes of a Novel Pathway for Thoracic Surgery Training.

BACKGROUND: The Joint Surgery-Thoracic Surgery (JS-TS) pathway began as a pilot program to grant both general surgery (GS) residency and thoracic surgery (TS) fellowship credit for 12 months of the PGY-4 and 5 years. This review updates the outcomes of this novel program. STUDY DESIGN: GS and TS programs in all approved JS-TS institutions were contacted for data collection, including JS-TS enrollee demographics and GS and TS case logs (CLs). National GS and TS CL data, and program and institutional data were publicly available. Enrollee case numbers were compared with those of their contemporaries. The American Board of Surgery and American Board of Thoracic Surgery provided certification data. Only enrollees who completed GS through 2019 were included. RESULTS: There were 90 JS-TS enrollees in 14 institutions. Two enrollees withdrew and 1 had not completed TS at the time of data collection leaving 87 for analysis. GS CLs were available for all 87 enrollees. TS CLs were available for all 62 enrollees who completed fellowship in 2016 or later. In GS, enrollees recorded fewer cases than their contemporary PGY-5s nationally in all domains except thoracic and endocrine. In TS, mean enrollee case numbers exceeded those of national contemporaries in every major category. Sixty-two JS-TS enrollees have achieved American Board of Surgery certification. Eighty-two enrollees are American Board of Thoracic Surgery certified with 5 currently in the certification process. CONCLUSIONS: The JS-TS pathway has proven a successful alternative route for TS training and could be a blueprint for other specialties considering novel avenues to specialty training.

National ABSITE Preparation Practices: A Survey of General Surgery Residency Program Directors.

OBJECTIVE: The American Board of Surgery In-Training Examination (ABSITE) was designed as a low-stakes, medical knowledge examination for US general surgery residency programs. However, in practice, this exam has been utilized for higher stakes purposes, such as resident promotion or remediation, and fellowship selection. Several studies have demonstrated the efficacy of ABSITE preparation resources, but best practices for ABSITE preparation and national preparatory habits are currently unknown. The aim of this work was to determine current residency programs' strategies for ABSITE preparation. DESIGN: We distributed an electronic survey to program directors or program coordinators of US general surgery programs asking them to anonymously report program ABSITE educational practices and ABSITE scores. We analyzed the proportion of responses using descriptive statistics and compared the effect of various strategies using the Mann-Whitney testing for nonparametric data. An average ABSITE percentile score was calculated for each residency based on program self-reported scores. SETTING: Association of Program Directors (APDS) Listserv PARTICIPANTS: General surgery residency programs participating at the time of distribution (278). RESULTS: Response rate was 24% (66/278); 41 programs (62.1%) identified as university-affiliated, and 25 (37.9%) were community-based. Median intern class size was 8 (range: 3-14), including preliminary interns. Average ABSITE percentile score was 52.8% (range 36.9%-67.6%). There were no significant differences in ABSITE scores based on affiliation or program size. Educational resources utilized for ABSITE preparation included SCORE (89.3%), Q-banks (50%), and surgical textbooks (25.8%). The majority (56.1%) of programs reported using a year-long curriculum for ABSITE preparation, and 66.6% used a time-limited curriculum completed in the months immediately prior to ABSITE. Most programs reported that ABSITE scores were a low priority (63.6%) or not a priority (13.6%). The existence of a year-long curriculum for ABSITE was positively correlated with score as compared to programs without a year-long curricula (53.9% vs 48.5%, p <0.01). Programs using a time-limited curriculum demonstrated lower scores as compared to programs without time-limited curricula (51.3% v 56.1%, p < 0.01). CONCLUSION: General surgery programs use a variety of strategies to prepare residents for the ABSITE. Despite reporting that they utilize ABSITE scores for a variety of high stakes purposes including evaluation for promotion and as a predictor of the preparedness for the ABS QE, many programs reported that they consider ABSITE scores as a low priority. A year-long focused curriculum was the only strategy correlated with increased scores, which may reflect the value of encouraging consistent studying and spaced repetition. Additional work is needed to guide programs in optimal utilization of ABSITE scores for remediation and resident evaluation, as well as understanding how ABSITE preparatory strategies correlate with clinical performance.

Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

General surgery residency training issues.

The practice of general surgery has undergone a marked evolution in the past 20 years, which has been inadequately recognized and minimally addressed. The changes that have occurred have been disruptive to residency training, and to date there has been inadequate compensation for these. Evidence is now emerging of significant issues in the overall performance of recent graduates from at least 3 sources: the evaluation of external agents who incorporate these graduates into their practice or group, the opinions of the residents themselves, and the performance of graduates on the oral examination of the American Board of Surgery during the past 8 years. The environmental and technological causes of the present situation represent improvements in care for patients, and are clearly irreversible. Hence, solutions to the problems must be sought in other areas. To address the issues effectively, greater recognition and engagement are needed by the surgical community so that effective solutions can be crafted. These will need to include improvements in the efficiency of teaching, with the assumption of greater individual resident responsibility for their knowledge, the establishment of more defined standards for knowledge and skills acquisition by level of residency training, with flexible self-assessment available online, greater focus of the curriculum on current rather than historical practice, increased use of structured assessments (including those in a simulated environment), and modifications to the overall structure of the traditional 5-year residency.

The case of the entitled resident: a composite case study of a resident performance problem syndrome with interdisciplinary commentary.

BACKGROUND: Residents with performance problems create substantial burden on programs and institutions. Understanding the nature and quality of performance problems can help in learning to address performance problems. AIM: We sought to illuminate the effects of resident performance problems and the potential solutions for those problems from the perspectives of people with various roles in health care. METHODS: We created a composite portrait from several residents who demonstrated a cluster of common performance characteristics and whose chronic or serious maladaptive behavior and response to situations created problems for themselves, for their clinical colleagues, and for faculty of their residency program. The composite was derived from in-depth interviews of program directors and review of resident records. We solicited practitioners from multiple fields to respond to the portrait by answering a series of questions about severity, prognosis, and how and whether one could reliably remediate a person with these performance characteristics. We present their perspectives in a manner borrowed from the New England Journal of Medicine's "Case Records of the Massachusetts General Hospital." RESULTS: We created a composite portrait of a resident whose behavior suggested he felt entitled to benefits his peers were not entitled to. Experts reflecting on his behavior varied in their opinion about the effect the resident would have on the health care system. They suggested approaches to remediation that required substantial time and effort from the faculty. CONCLUSION: Programs must balance the needs of individual residents to adjust their behaviors with the needs of the health care system and other people within it.

Outcomes of the Early Specialization Program in Vascular Operation.

BACKGROUND: The Early Specialization Program (ESP) in vascular surgery (VS) began as a "pilot program" in 2003. There is only one published report on ESP outcomes. STUDY DESIGN: The general surgery (GS) and VS programs of all institutions using the ESP were contacted. Data gathered included demographics of ESP enrollees, participants' case logs (CLs), and CLs of participants' residency graduating classmates. National CLs, program and institutional data, and participants' certification status were publicly available. RESULTS: Nine institutions have enrolled 34 participants. Four withdrew, and four are in the GS component. Of 26 who have completed ESP, residency CLs were available for 20. Participants' percentile rankings among national contemporaries were lower than 13th for surgeon-junior cases (SJCs), higher than 73rd for surgeon-chief cases (SCCs), and 49th for total major cases (TMCs). They were lower than the 40th percentile in all domains except operative trauma (52; SD 23.8) and vascular (84.7; SD 22.1). As a percentage of the mean (% mean) for their own graduating classes, participants performed 91.8% (SD 16.5) as many SJCs, 143.7% (SD 45.1) as many SCCs, and 105% (SD 11.4) as many TMCs. Participants performed more than 79 % mean in every domain, including 213.4% (SD 82.4) as many vascular cases. As fellows, they ranked higher than the 50th percentile nationally in all but two categories. Twenty-four of 26 certified in GS. GS certification has lapsed for 5, 17 remain initially certified, and 2 have re-certified. All have current VS certification. CONCLUSION: Although infrequently employed, ESP remains an effective option for those who seek both GS and VS certification.

Innovative Social Media Summit: Providing a Path for Physicians on Social Media.

PROBLEM: Physicians' voices are valued in society and should be present in mainstream social media where they can provide valuable public health messaging and patient education as well as increase opportunities for medical education, mentoring, and collaboration. However, lack of formal education on effective use of social media prevents many physicians from using it. APPROACH: The authors developed a physician-led social media training program to address the need for formal instruction on social media use. The program was presented to medical students, trainees, and faculty at an academic medical institution in August and September 2020. The virtual format included 5 hour-long sessions with presentations by peer experts in social media. Peer physicians with experience using social media presented on a range of topics, including introductions to platforms, how to reach and grow audiences, and use of social media to advance patient education, medical education, and advocacy. OUTCOMES: There were 425 cumulative registrations for the 5 sessions of the Social Media Summit. The number of registrants increased for each session, suggesting that interest increased over time. Qualitative and quantitative participant feedback was collected via a brief, voluntary survey. All of the participants who completed the survey (n = 24) reported they were "very satisfied" (58.3%) or "somewhat satisfied" (41.7%) with the Summit. NEXT STEPS: Physician involvement in social media presents opportunities for public health knowledge, medical education, scientific collaboration, and career advancement. Physicians who have been successful in using social media for these purposes are excellent peer educators and can fill the medical education void in social media training. Future plans include building sustainability of the program, collecting additional quantitative and qualitative feedback to guide improvement, and encouraging reproducibility.