Introduction to the Contemporary Assessment and Recommendations to Enhance Surgical Education and Training: Reports of the Subcommittees of the Blue Ribbon Committee II.

BACKGROUND: The BRC II was a panel of 67 experts selected on the basis of experience and leadership in surgical education and training. METHODS: It was organized into subcommittees, each of which was asked to prepare a manuscript on their findings and recommendations. The BRC II Subcommittees were: Blue Ribbon Committee 1 Review and Assessment; Surgical Workforce; Medical Student Education; Work Life Integration; Resident Education; Goals, Structure and Financing of Training; Education Support and Faculty Development; Research Training; Educational Technology and Assessment. BRC II used the Delphi approach with consensus defined as equal to or greater than 80% and identified and recommended 31 priorities for surgical education in 2024. RESULTS: The initial findings were presented to a general surgery and related specialty resident and fellow focus group for comments and written feedback, and they were asked to prepare a manuscript as well. CONCLUSIONS: The reports of the Subcommittees of the BRC II provide an assessment and key recommendations concerning surgical education and training in 2024.

The Blue Ribbon Committee II Report and Recommendations on Surgical Education and Training in the United States: 2024.

OBJECTIVE: An expert panel made recommendations to optimize surgical education and training based on the effects of contemporary challenges. BACKGROUND: The inaugural Blue Ribbon Committee (BRC I) proposed sweeping recommendations for surgical education and training in 2004. In light of those findings, a second BRC (BRC II) was convened to make recommendations to optimize surgical training considering the current landscape in medical education. METHODS: BRC II was a panel of 67 experts selected on the basis of experience and leadership in surgical education and training. It was organized into subcommittees which met virtually over the course of a year. They developed recommendations, along with the Steering Committee, based on areas of focus and then presented them to the entire BRC II. The Delphi method was chosen to obtain consensus, defined as ≥80% agreement among the panel. Cronbach α was computed to assess the internal consistency of 3 Delphi rounds. RESULTS: Of the 50 recommendations, 31 obtained consensus in the following aspects of surgical training (# of consensus recommendation/# of proposed): Workforce (1/5); Medical Student Education (3/8); Work Life Integration (4/6); Resident Education (5/7); Goals, Structure, and Financing of Training (5/8); Education Support and Faculty Development (5/6); Research Training (7/9); and Educational Technology and Assessment (1/1). The internal consistency was good in Rounds 1 and 2 and acceptable in Round 3. CONCLUSIONS: BRC II used the Delphi approach to identify and recommend 31 priorities for surgical education in 2024. We advise establishing a multidisciplinary surgical educational group to oversee, monitor, and facilitate implementation of these recommendations.

Blue Ribbon Committee I Review: Findings and Impact.

OBJECTIVE: Review the subsequent impact of recommendations made by the 2004 American Surgical Association Blue Ribbon Committee (BRC I) Report on Surgical Education. BACKGROUND: Current leaders of the American College of Surgeons and the American Surgical Association convened an expert panel to review the impact of the BRC I report and make recommendations for future improvements in surgical education. METHODS: BRC I members reviewed the 2004 recommendations in light of the current status of surgical education. RESULTS: Some of the recommendations of BRC I have gained traction and have been implemented. There is a well-organized national curriculum and numerous educational offerings. There has been greater emphasis on preparing faculty to teach and there are ample opportunities for professional advancement as an educator. The number of residents has grown, although not at a pace to meet the country's needs either by total number or geographic distribution. The number of women in the profession has increased. There is greater awareness and attention to resident (and faculty) well-being. The anticipated radical change in the educational scheme has not been adopted. Training in surgical research still depends on the resources and interests of individual programs. Financing student and graduate medical education remains a challenge. CONCLUSIONS: The medical landscape has changed considerably since BRC I published its findings in 2005. A contemporary assessment of surgical education and training is needed to meet the future needs of the profession and our patients.

Measuring Chief Resident Skill and Entrustment Progression in An Operative Coaching Program: Four Years' Experience.

OBJECTIVE: Operative coaching (OC) may facilitate improvement of surgery residents' competencies by optimizing learning and teaching. We investigated how residents' operative skills and prospective entrustment (PE) progress throughout the chief year in our OC program, how OC is perceived by participants, and how OC may facilitate learning and teaching. DESIGN, SETTING, AND PARTICIPANTS: This is a mixed-methods study conducted within the Ohio State University Wexner Medical Center General Surgery residency. Validated performance evaluations with procedural-specific skill, general skill (GS), step-specific guidance required (SSG) (an autonomy measure), and PE measures completed by chiefs, faculty coaches, and attending surgeons from 7/2018 to 6/2022 were reviewed. We also interviewed OC participants to understand their experience. Descriptive statistical and qualitative content analysis were applied. RESULTS: 441 evaluations from 147 OC cases completed by 22 chiefs, 5 faculty coaches, and 24 attendings were included. Overall, resident GS (p = 0.036), SSG (p = 0.023), and PE (p = 0.002) significantly improved throughout the year. PE significantly correlated (all p < 0.0001) with SSG (r = 0.73), followed by procedural-specific skill (r = 0.59), then GS (r = 0.57). On average, chiefs underestimated their surgical skills while attendings overestimated autonomy they permitted to residents. Chiefs, coaches, and attendings reached consensus on chiefs' PE upon graduation. Five graduated chiefs and 5 attendings were interviewed. Chiefs described OC as effective in improving their self-regulated learning and particularly valued 3 OC elements: neutral authentic feedback, third-party real-time observation, and actionable feedback. Attendings noted OC promoted their engagement in skills assessment and teaching. CONCLUSIONS: Our findings suggest chief residents' skills, autonomy, and PE progress steadily along their OC journey. Despite differences in residents', coaches', and attendings' perceptions of skill, measures of autonomy reliably correlate with entrustment. OC promotes resident learning, faculty teaching, and assessment of resident skills, autonomy, and PE in the OR.

Cumulative Sum Chart as Complement to Objective Assessment of Graduating Surgical Resident Competency: An Exploratory Study.

BACKGROUND: Rater-based assessment and objective assessment play an important role in evaluating residents' clinical competencies. We hypothesize that a cumulative sum (CUSUM) chart of operative time is a complement to the assessment of chief general surgery residents' competencies with ACGME Milestones, aiding residency programs' determination of graduating residents' practice readiness. STUDY DESIGN: We extracted ACGME Milestone evaluations of performance of operations and procedures (POP) and 3 objective metrics (operative time, case type, and case complexity) from 3 procedures (cholecystectomy, colectomy, and inguinal hernia) performed by 3 cohorts of residents (N = 15) during their PGY4-5. CUSUM charts were computed for each resident on each procedure type. A learning plateau was defined as at least 4 cases consistently locating around the centerline (target performance) at the end of a CUSUM chart with minimal deviations (range 0 to 1). RESULTS: All residents reached the ACGME graduation targets for the overall POP by the end of chief year. A total of 2,446 cases were included (cholecystectomy N = 1234, colectomy N = 507, and inguinal hernia N = 705), and 3 CUSUM chart patterns emerged: skewed distribution, bimodal distribution, and peaks and valleys distribution. Analysis of CUSUM charts revealed surgery residents' development processes in the operating room towards a learning plateau vary, and only 46.7% residents reach a learning plateau in all 3 procedures upon graduation. CONCLUSIONS: CUSUM charts of operative time complement the ACGME Milestones evaluations. The use of both may enable residency programs to holistically determine graduating residents' practice readiness and provide recommendations for their upcoming career/practice transition.

Cost analysis of training residents in robotic-assisted surgery.

INTRODUCTION: Use of robotic-assisted surgery is increasing, and resident involvement may lead to higher costs. We investigated whether senior resident involvement in noncomplex robotic cholecystectomy (RC) and inguinal hernia (RIH) would take more time and cost more when compared to non-robotic cholecystectomy (NRC) and inguinal hernia repair (NRIH). METHODS: We extracted surgery duration and total cost of NRC, NRIH, RC, and RIH from 7/2016 to 6/2020 with senior resident (PGY4-5) involvement. We excluded complex cases as well as prisoner cases and those with new faculty and research residents. We assessed differences between robotic and non-robotic cases in surgery duration and total cost per minute, using one-way ANOVA. RESULTS: We included 1608 cases (non-robotic 1145 vs. robotic 463). On average, RC cases with a senior resident took less time than NRC (179.4 < 185.8, p = 0.401); surgery duration of RIH cases was similar with NRIH cases. The total cost per minute of RC cases with a senior resident on average was $9.30 higher than NRC cases for each minute incurred in the operating room but did not lead to a significant change in overall cost. RIH cases, on the other hand, cost less per minute than NRIH cases (114.1 < 126.5, p = 0.399). CONCLUSION: Training in robotic surgery is important. Noncomplex RC and RIH involving senior residents were not significantly longer nor did they incur significantly more cost than non-robotic procedures. Senior resident training in noncomplex robotic surgery can be efficient and can be included in the residency curriculum.

Surgery Clerkship Directors' Perceptions of the COVID-19 Pandemic's Impact on Medical Student Education.

BACKGROUND: This study assessed the national impact of the COVID-19 pandemic on the education of medical students assigned to surgery clerkship rotations, as reported by surgery clerkship directors(CDs). STUDY DESIGN: In the spring of 2020 and 2021, the authors surveyed 164 CDs from 144 LCME-accredited US medical schools regarding their views of the pandemic's impact on the surgery clerkship curriculum, students' experiences, outcomes, and institutional responses. RESULTS: Overall survey response rates, calculated as no. respondents/no. surveyed were 44.5%(73/164) and 50.6%(83/164) for the spring 2020 and 2021 surveys, respectively. Nearly all CDs(>95%) pivoted to virtual platforms and solutions. Most returned to some form of in-person learning by winter 2020, and pre-pandemic status by spring 2021(46%, 38/83). Students' progression to the next year was delayed by 12%(9/73), and preparation was negatively impacted by 45%(37/83). Despite these data, CDs perceived students' interest in surgical careers was not significantly affected(89% vs. 77.0%, p=0.09). Over the one-year study, the proportion of CDs reporting a severe negative impact on the curriculum dropped significantly(p<0.0001) for most parameters assessed except summative evaluations(40.3% vs. 45.7%,p=0.53). CDs(n=83) also noted the pandemic's positive impact with respect to virtual patient encounters(21.7%), didactics(16.9%), student test performance(16.9%), continuous personal learning(14.5%), engagement in the clerkship(9.6%) and student interest in surgery as a career(7.2%). CONCLUSION: During the pandemic, the severe negative impact on student educational programs lessened and novel virtual curricular solutions emerged. Student interest in surgery as a career was sustained. Measures of student competency and effectiveness of new curriculum, including telehealth, remain areas for future investigation.

One-Year Follow-Up of COVID-19 Impact on Surgical Education: Clinical Training Restored but Surgical Trainee Emotional Well-Being Still at Risk.

BACKGROUND: A previous survey documented the severe disruption of the coronavirus disease 2019 pandemic on surgical education and trainee well-being during the initial surge and systemic lockdowns. Herein, we report the results of a follow-up survey inclusive of the 2020 to 2021 academic year. STUDY DESIGN: A survey was distributed to education leaders across all surgical specialties in summer 2021. We compared the proportion of participants reporting severe disruption in key areas with those of the spring 2020 survey. Aggregated differences by year were assessed using chi-square analysis. RESULTS: In 2021, severe disruption of education programs was reported by 14% compared with 32% in 2020 (p < 0.0001). Severe reductions in nonemergency surgery were reported by 38% compared with 87% of respondents in 2020. Severe disruption of expected progression of surgical trainee autonomy by rank also significantly decreased to 5% to 8% in 2021 from 15% to 23% in 2020 among respondent programs (p < 0.001). In 2021 clinical remediation was reported for postgraduate year 1 to 2 and postgraduate year 3 to 4, typically through revised rotations (19% and 26%) and additional use of simulation (20% and 19%) maintaining trainee promotion and job placement. In 2021, surgical trainees' physical safety and health were reported as less severely impacted compared with 2020; however, negative effects of isolation (77%), burnout (75%), and the severe impact on emotional well-being (17%) were prevalent. CONCLUSIONS: One year after the initial coronavirus disease 2019 outbreak, clinical training and surgical trainee health were less negatively impacted. Disruption of emotional well-being remained high. Future needs include better objective measures of clinical competence beyond case numbers and the implementation of novel programs to promote surgical trainee health and well-being.

Operative Coaching for General Surgery Residents: Review of Implementation Requirements.

Operative coaching offers a unique opportunity to strengthen surgery residents' skill sets and practice readiness. However, institutional organizational capacity may influence the ability to successfully implement and sustain a coaching program. This review concentrates on the implementation requirements as they relate to institutional organizational capacity to help evaluate and determine if adopting such a coaching model is feasible. We searched English-language, peer-reviewed articles concerning operative coaching of general surgery residents between 2000 and 2020 with the MEDLINE database. The abstracts of 267 identified articles were further screened based on the presence of 2 inclusion criteria: general surgery residents and operative coaching. Then we summarized the reported implementation requirements. Findings revealed the implementation requirements (ie people, processes, technology/support resources, physical resources, and organizational systems) of 3 major types of resident operative coaching models were different. Video-assisted coaching faces the most barriers to implementation followed by video-based coaching; in-person coaching encounters the least barriers. Six questions are generated helping residency education leaders assess their readiness for an operative coaching program. Evaluation of the implementation requirements of a desired coaching program using the 5 organizational capacity elements is recommended to ensure the residency's ability to achieve a successful and sustainable program.

Passing the Scalpel: Lessons on retirement planning from retired academic surgeons.

BACKGROUND: Almost half of practicing surgeons in the United States are currently older than 55, but guidelines on how to prepare for retirement are limited. We sought to identify possible facilitators for, and obstacles to, surgeons' preparations for retirement. METHODS: A qualitative study was conducted using semi-structured interviews with clinically inactive academic surgeons. Emergent themes were identified via a grounded theory approach. RESULTS: We interviewed 12 surgeons (83% male; median age 75 years). Major barriers to retirement from surgery included uncertainty about when to retire, limited identity outside of surgery, and perception of retirement as strictly individual/private. Facilitators of a successful retirement identified by the participants included early career financial planning, awareness of career trajectory, development of post-surgery goals, and utilization of collective knowledge. CONCLUSION: There are numerous barriers encountered by surgeons seeking to transition from clinical practice to retirement that could be overcome by dedicated departmental and institutional efforts.

A contemporary reassessment of the US surgical workforce through 2050 predicts continued shortages and increased productivity demands.

BACKGROUND: We aimed to predict practicing surgeon workforce size across ten specialties to provide an up-to-date, national perspective on future surgical workforce shortages or surpluses. METHODS: Twenty-one years of AMA Masterfile data (1997-2017) were used to predict surgeons practicing from 2030 to 2050. Published ratios of surgeons/100,000 population were used to estimate the number of surgeons needed. MGMA median wRVU/surgeon by specialty (2017) was used to determine wRVU demand and capacity based on projected and needed number of surgeons. RESULTS: By 2030, surgeon shortages across nine specialties: Cardiothoracic, Otolaryngology, General Surgery, Obstetrics-Gynecology, Ophthalmology, Orthopedics, Plastics, Urology, and Vascular, are estimated to increase clinical workload by 10-50% additional wRVU. By 2050, shortages in eight specialties are estimated to increase clinical workload by 7-61% additional wRVU. CONCLUSIONS: If historical trends continue, a majority of surgical specialties are estimated to experience workforce deficits, increasing clinical demands substantially.

Impact of the COVID-19 pandemic on surgical trainee education and well-being spring 2020-winter 2020: A path forward.

BACKGROUND: The time course and longitudinal impact of the COVID -19 pandemic on surgical education(SE) and learner well-being (LWB)is unknown. MATERIAL AND METHODS: Check-in surveys were distributed to Surgery Program Directors and Department Chairs, including general surgery and surgical specialties, in the summer and winter of 2020 and compared to a survey from spring 2020. Statistical associations for items with self-reported ACGME Stage and the survey period were assessed using categorical analysis. RESULTS: Stage 3 institutions were reported in spring (30%), summer (4%) [p < 0.0001] and increased in the winter (18%). Severe disruption (SD) was stage dependent (Stage 3; 45% (83/184) vs. Stages 1 and 2; 26% (206/801)[p < 0.0001]). This lessened in the winter (23%) vs. spring (32%) p = 0.02. LWB severe disruption was similar in spring 27%, summer 22%, winter 25% and was associated with Stage 3. CONCLUSIONS: Steps taken during the pandemic reduced SD but did not improve LWB. Systemic efforts are needed to protect learners and combat isolation pervasive in a pandemic.

Education Morbidity and Mortality: Reviving Intraoperative Teaching and Learning.

BACKGROUND: Using the platform of morbidity and mortality conference, we developed and executed a combined faculty-resident intervention called "Education M&M" to discuss challenges faced by both parties in the operating room (OR), identify realistic solutions, and implement action plans. This study aimed to investigate the impact of this intervention on resident OR training. MATERIALS AND METHODS: Two resident case presentations were followed by audience discussion and recommendations regarding actionable solutions aimed at improving resident OR training from an expert faculty panel. Postintervention surveys were completed by participants immediately and 2 mo later to assess perceived short and long-term impact on OR teaching and/or learning and the execution of two recommended solutions. Descriptive statistical analysis was applied. RESULTS: Immediate post-intervention surveys (n = 44) indicated that 81.8% of participants enjoyed the M&M "a lot"; 90.1% said they would use some or a lot of the ideas presented. Awareness of OR teaching/learning challenges before and after the M&M improved from 3.0 to 3.7 (P = 0.00001) for faculty and 3.0 to 3.9 for trainees (P = 0.00004). Understanding of OR teaching and/or learning approaches improved from 3.1 to 3.7 for faculty (P = 0.00004) and 2.7 to 3.9 for trainees (P = 0.00001). In 2-mo post-intervention surveys, most residents had experienced two recommended solutions (71% and 88%) in the OR, but self-reported changes to faculty behavior did not reach statistical significance. CONCLUSIONS: A department-wide education M&M could be an effective approach to enhance mutual communication between faculty members and residents around OR teaching/learning by identifying program-specific challenges and potential actionable solutions.

Efficiency of Increasing Prospective Resident Entrustment in the Operating Room.

BACKGROUND: Prospective resident entrustment (i.e., trust an attending surgeon intends to give to a resident in the near future) in the operating room (OR) closely associates with granted future autonomy. However, the process of determining resident entrustment takes time and effort. Thus, this study aimed to assess the efficiency of granting incremental resident entrustment for upcoming surgical cases. METHODS: We analyzed prospective resident entrustment of 6 chief residents in 76 cases of laparoscopic cholecystectomy, laparoscopic colectomy, ventral hernia, and inguinal hernia scored by attending surgeon, resident, and a surgeon observer. Matched direct costs and operative time were extracted from hospital billing. We assessed the efficiency of granting incremental prospective resident entrustment with direct cost per minute incurred in the evaluated case. Effect size was computed to assess the differences between groups. RESULTS: Sixty-three cases (82.9%) were matched; 47.6% (30/63) of matched cases received prospective resident entrustment score ≥ 4. The direct cost per minute increased in three procedures (laparoscopic cholecystectomy, laparoscopic colectomy, and ventral hernia) with increased intention of granting incremental resident entrustment. Inguinal hernia was the only procedure in which chiefs were entrusted with future independence while the direct cost per minute decreased. CONCLUSIONS: Our findings demonstrate more time and effort are required (except for inguinal hernia) for residents to be entrusted with increased independence in the future. Faculty and resident development programs are recommended to improve the efficiency of the process of granting incremental operative entrustment to optimize resident training quality and cost of care delivery.

Predicting prospective resident entrustment: From evaluation to action.

OBJECTIVE: We aimed to identify potential variables predictive of a resident achieving faculty future entrustment as a way to enhance attending surgeons' planning of teaching in the operating room leading to improved resident operative autonomy in practice. METHODS: We reviewed 273 resident performance evaluations from 91 surgical cases that were collected from 11 general surgery chief residents and 16 attending surgeons between April 2018 and June 2019 using a validated evaluation instrument. The primary outcome measure was prospective resident entrustment estimated by the rater for future similar cases. We used descriptive statistics and the boosted tree analysis model to find potential predictors for the outcome measure and examine test-retest reliability by procedure. RESULTS: Step-specific guidance (r = 0.77, p < 0.0001) was the variable most highly associated with prospective resident entrustment in bivariate linear analysis. The boosted tree analysis demonstrated step-specific guidance was the strongest predictor for prospective resident entrustment in the OR, and its predictive importance was much higher than the overall guidance (0.64 > 0.18). Test-retest reliability was from 0.93 to 0.98 across procedures, indicating the likelihood that attending surgeons granted future autonomy complied with their evaluation of prospective resident entrustment was high. CONCLUSIONS: By assessing step-specific guidance, attending surgeons can reliably judge residents' future entrustment and potentially better plan for operative teaching/supervision that may lead to granting a surgical resident operative autonomy on similar cases in the future. Our findings provide insight into prospective faculty development of surgical teaching aimed at improving resident readiness for independent practice.