How Does the Sequence of the American Board of Surgery Examinations Impact Pass/Fail Outcomes?

OBJECTIVE: Historically, the American Board of Surgery required surgeons to pass the qualifying examination (QE) before taking the certifying examination (CE). However, in the 2020-2021 academic year, with mitigating circumstances related to COVID-19, the ABS removed this sequencing requirement to facilitate the certification process for those candidates who were negatively impacted by a QE delivery failure. This decoupling of the traditional order of exam delivery has provided a natural comparator to the traditional route and an analysis of the impact of examination sequencing on candidate performance. METHODS: All candidates who applied for the canceled July 2020 QE were allowed to take the CE before passing the QE. The sample was then reduced to include only first-time candidates to ensure comparable groups for performance outcomes. Logistic regression was used to analyze the relationship between the order of taking the QE and the CE, controlling for other examination performance, international medical graduate status, and gender. RESULTS: Only first-time candidates who took both examinations were compared (n=947). Examination sequence was not a significant predictor of QE pass/fail outcomes, OR=0.54; 95% CI, 0.19-1.61, P =0.26. However, examination sequence was a significant predictor of CE pass/fail outcomes, OR=2.54; 95% CI, 1.46-4.68, P =0.002. CONCLUSIONS: This important study suggests that preparation for the QE increases the probability of passing the CE and provides evidence that knowledge may be foundational for clinical judgment. The ABS will consider these findings for examination sequencing moving forward.

The Blue Ribbon Committee II Report and Recommendations on Surgical Education and Training in the United States: 2024.

OBJECTIVE: An expert panel made recommendations to optimize surgical education and training based on the effects of contemporary challenges. BACKGROUND: The inaugural Blue Ribbon Committee (BRC I) proposed sweeping recommendations for surgical education and training in 2004. In light of those findings, a second BRC (BRC II) was convened to make recommendations to optimize surgical training considering the current landscape in medical education. METHODS: BRC II was a panel of 67 experts selected on the basis of experience and leadership in surgical education and training. It was organized into subcommittees which met virtually over the course of a year. They developed recommendations, along with the Steering Committee, based on areas of focus and then presented them to the entire BRC II. The Delphi Method was chosen to obtain consensus, defined as>80% agreement amongst the panel. Cronbach alpha was computed to assess the internal consistency of three Delphi rounds. RESULTS: Of 50 recommendations, 31 obtained consensus in the following aspects of surgical training (# consensus recommendation /# proposed): Workforce (1/5), Medical Student Education (3/8), Work Life Integration (4/6), Resident Education (5/7), Goals, Structure and Financing of Training (5/8), Education Support and Faculty Development (5/6), Research Training (7/9), and Educational Technology and Assessment (1/1). The internal consistency was good in Rounds 1 and 2 and acceptable in Round 3. CONCLUSIONS: BRC II used the Delphi approach to identify and recommend 31 priorities for surgical education in 2024. We advise establishing a multidisciplinary surgical educational group to oversee, monitor and facilitate implementation of these recommendations.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Association Between American Board of Surgery Initial Certification and Medical Malpractice Payments.

OBJECTIVE: To measure associations between surgeons' examination performance and obtaining American Board of Surgery certification with the likelihood of having medical malpractice payments. BACKGROUND: Further research is needed to establish a broader understanding of the association of board certification and patient and practice outcomes. METHODS: Retrospective analysis using propensity score-matched surgeons who attempted to obtain American Board of Surgery certification. Surgeons who completed residency between 2000 and 2019 (n=910) and attempted to become certified were categorized as certified or failing to obtain certification. In addition, groups were categorized as either passing or failing their first attempt on the qualifying and certifying examinations. Malpractice payment reports were dichotomized for surgeons who either had a payment report or not. RESULTS: The hazard rate (HR) of malpractice payment reports was significantly greater for surgeons who attempted and failed to obtain certification [HR=1.87; 95% confidence interval (CI), 1.28-2.74] than for surgeons who were certified. Moreover, surgeons who failed either the qualifying (HR=1.64; 95% CI, 1.14-2.37) or certifying examination (HR=1.72; 95% CI, 1.14-2.60) had significantly higher malpractice payment HRs than those who passed the examinations on their first attempt. CONCLUSIONS: Failing to obtain board certification was associated with a higher rate of medical malpractice payments. In addition, failing examinations in the certification examination process on the first attempt was also associated with higher rates of medical malpractice payments. This study provides further evidence that board certification is linked to potential indicators for patient outcomes and practice quality.

Discrimination, Abuse, Harassment, and Burnout in Surgical Residency Training.

BACKGROUND: Physicians, particularly trainees and those in surgical subspecialties, are at risk for burnout. Mistreatment (i.e., discrimination, verbal or physical abuse, and sexual harassment) may contribute to burnout and suicidal thoughts. METHODS: A cross-sectional national survey of general surgery residents administered with the 2018 American Board of Surgery In-Training Examination assessed mistreatment, burnout (evaluated with the use of the modified Maslach Burnout Inventory), and suicidal thoughts during the past year. We used multivariable logistic-regression models to assess the association of mistreatment with burnout and suicidal thoughts. The survey asked residents to report their gender. RESULTS: Among 7409 residents (99.3% of the eligible residents) from all 262 surgical residency programs, 31.9% reported discrimination based on their self-identified gender, 16.6% reported racial discrimination, 30.3% reported verbal or physical abuse (or both), and 10.3% reported sexual harassment. Rates of all mistreatment measures were higher among women; 65.1% of the women reported gender discrimination and 19.9% reported sexual harassment. Patients and patients' families were the most frequent sources of gender discrimination (as reported by 43.6% of residents) and racial discrimination (47.4%), whereas attending surgeons were the most frequent sources of sexual harassment (27.2%) and abuse (51.9%). Proportion of residents reporting mistreatment varied considerably among residency programs (e.g., ranging from 0 to 66.7% for verbal abuse). Weekly burnout symptoms were reported by 38.5% of residents, and 4.5% reported having had suicidal thoughts during the past year. Residents who reported exposure to discrimination, abuse, or harassment at least a few times per month were more likely than residents with no reported mistreatment exposures to have symptoms of burnout (odds ratio, 2.94; 95% confidence interval [CI], 2.58 to 3.36) and suicidal thoughts (odds ratio, 3.07; 95% CI, 2.25 to 4.19). Although models that were not adjusted for mistreatment showed that women were more likely than men to report burnout symptoms (42.4% vs. 35.9%; odds ratio, 1.33; 95% CI, 1.20 to 1.48), the difference was no longer evident after the models were adjusted for mistreatment (odds ratio, 0.90; 95% CI, 0.80 to 1.00). CONCLUSIONS: Mistreatment occurs frequently among general surgery residents, especially women, and is associated with burnout and suicidal thoughts.

Outcomes of the First Virtual General Surgery Certifying Exam of the American Board of Surgery.

OBJECTIVE: To Study the Outcomes of the First Virtual General Surgery Certifying Exam of the American Board of Surgery. SUMMARY OF BACKGROUND DATA: The ABS General Surgery CE is normally an in-person oral examination. Due to the COVID-19 outbreak, the ABS was required to reschedule these. After 2 small pilots, the CE's October administration represented the first large-scale remote virtual exam. The purpose of this report is to compare the outcomes of this virtual and the previous in-person CEs. METHODS: CE candidates were asked to provide feedback on their experience via a survey. The passing rate was compared to the 1025 candidates who took the 2019-2020 in-person CEs. RESULTS: Of the 308 candidates who registered for the virtual CE, 306 completed the exam (99.4%) and 188 completed the survey (61.4%). The majority had a very positive experience. They rated the virtual CE as very good/excellent in security (90%), ease of exam platform (77%), audio quality (71%), video quality (69%), and overall satisfaction (86%). Notably, when asked their preference, 78% preferred the virtual exam. There were no differences in the passing rates between the virtual or in-person exams. CONCLUSIONS: The first virtual CE by the ABS was completed using available internet technology. There was high satisfaction, with the majority preferring the virtual platform. Compared to past in-person CEs, there was no difference in outcomes as measured by passing rates. These data suggest that expansion of the virtual CE may be desirable.

Is Initial Board Certification Associated With Better Early Career Surgical Outcomes?

OBJECTIVE: To determine if initial American Board of Surgery certification in general surgery is associated with better risk-adjusted patient outcomes for Medicare patients undergoing partial colectomy by an early career surgeon. BACKGROUND: Board certification is a voluntary commitment to professionalism, continued learning, and delivery of high-quality patient care. Not all surgeons are certified, and some have questioned the value of certification due to limited evidence that board-certified surgeons have better patient outcomes. In response, we examined the outcomes of certified versus noncertified early career general surgeons. METHODS: We identified Medicare patients who underwent a partial colectomy between 2008 and 2016 and were operated on by a non-subspecialty trained surgeon within their first 5 years of practice. Surgeon certification status was determined using the American Board of Surgery data. Generalized linear mixed models were used to control for patient-, procedure-, and hospital-level effects. Primary outcomes were the occurrence of severe complications and occurrence of death within 30 days. RESULTS: We identified 69,325 patients who underwent a partial colectomy by an early career general surgeon. The adjusted rate of severe complications after partial colectomy by certified (n = 4239) versus noncertified (n = 191) early-career general surgeons was 9.1% versus 10.7% (odds ratio 0.83, P = 0.03). Adjusted mortality rate for certified versus noncertified early-career general surgeons was 4.9% versus 6.1% (odds ratio 0.79, P = 0.01). CONCLUSION: Patients undergoing partial colectomy by an early career general surgeon have decreased odds of severe complications and death when their surgeon is board certified.

An Empirical National Assessment of the Learning Environment and Factors Associated With Program Culture.

OBJECTIVES: To empirically describe surgical residency program culture and assess program characteristics associated with program culture. SUMMARY BACKGROUND DATA: Despite concerns about the impact of the learning environment on trainees, empirical data have not been available to examine and compare program-level differences in residency culture. METHODS: Following the 2018 American Board of Surgery In-Training Examination, a cross-sectional survey was administered to all US general surgery residents. Survey items were analyzed using principal component analysis to derive composite measures of program culture. Associations between program characteristics and composite measures of culture were assessed. RESULTS: Analysis included 7387 residents at 260 training programs (99.3% response rate). Principal component analysis suggested that program culture may be described by 2 components: Wellness and Negative Exposures. Twenty-six programs (10.0%) were in the worst quartile for both Wellness and Negative Exposure components. These programs had significantly higher rates of duty hour violations (23.3% vs 11.1%), verbal/physical abuse (41.6% vs 28.6%), gender discrimination (78.7% vs 64.5%), sexual harassment (30.8% vs 16.7%), burnout (54.9% vs 35.0%), and thoughts of attrition (21.6% vs 10.8%; all P < 0.001). Being in the worst quartile of both components was associated with percentage of female residents in the program (P = 0.011), but not program location, academic affiliation, size, or faculty demographics. CONCLUSIONS: Residency culture was characterized by poor resident wellness and frequent negative exposures and was generally not associated with structural program characteristics. Additional qualitative and quantitative studies are needed to explore unmeasured local social dynamics that may underlie measured differences in program culture.

Global Surgery: Effective Involvement of US Academic Surgery: Report of the American Surgical Association Working Group on Global Surgery.

: There is an unacceptably high burden of death and disability from conditions that are treatable by surgery, worldwide and especially in low- and middle-income countries (LMICs). The major actions to improve this situation need to be taken by the surgical communities, institutions, and governments of the LMICs. The US surgical community, including the US academic surgical community, has, however, important roles to play in addressing this problem. The American Surgical Association convened a Working Group to address how US academic surgery can most effectively decrease the burden from surgically treatable conditions in LMICs. The Working Group believes that the task will be most successful (1) if the epidemiologic pattern in a given country is taken into account by focusing on those surgically treatable conditions with the highest burdens; (2) if emphasis is placed on those surgical services that are most cost-effective and most feasible to scale up; and (3) if efforts are harmonized with local priorities and with existing global initiatives, such as the World Health Assembly with its 2015 resolution on essential surgery. This consensus statement gives recommendations on how to achieve those goals through the tools of academic surgery: clinical care, training and capacity building, research, and advocacy. Through all of these, the ethical principles of maximally and transparently engaging with and deferring to the interests and needs of local surgeons and their patients are of paramount importance. Notable benefits accrue to US surgeons, trainees, and institutions that engage in global surgical activities.

Development of a Unifying Target and Consensus Indicators for Global Surgical Systems Strengthening: Proposed by the Global Alliance for Surgery, Obstetric, Trauma, and Anaesthesia Care (The G4 Alliance).

After decades on the margins of primary health care, surgical and anaesthesia care is gaining increasing priority within the global development arena. The 2015 publications of the Disease Control Priorities third edition on Essential Surgery and the Lancet Commission on Global Surgery created a compelling evidenced-based argument for the fundamental role of surgery and anaesthesia within cost-effective health systems strengthening global strategy. The launch of the Global Alliance for Surgical, Obstetric, Trauma, and Anaesthesia Care in 2015 has further coordinated efforts to build priority for surgical care and anaesthesia. These combined efforts culminated in the approval of a World Health Assembly resolution recognizing the role of surgical care and anaesthesia as part of universal health coverage. Momentum gained from these milestones highlights the need to identify consensus goals, targets and indicators to guide policy implementation and track progress at the national level. Through an open consultative process that incorporated input from stakeholders from around the globe, a global target calling for safe surgical and anaesthesia care for 80% of the world by 2030 was proposed. In order to achieve this target, we also propose 15 consensus indicators that build on existing surgical systems metrics and expand the ability to prioritize surgical systems strengthening around the world.

General surgery education: a systematic review of training worldwide.

BACKGROUND: Surgical care is an essential component of health management worldwide. As the prevalence of injuries and non-communicable diseases increases, the provision of effective surgical care will become an increasingly important priority to reduce death and disability. To assess the ability of health systems to meet current surgical needs, we did a review of surgical training programmes worldwide. METHODS: We searched Medline, EMBASE, and the Global Health Library databases with the search terms "surgical training" and "surgeon training" for abstracts and citations in all languages published between Jan 1, 1998, and Dec 31, 2013, describing a national general surgery training system. We extracted the following data: a brief description of the programme, years of training required, year after medical school graduation when training begins, name of national oversight organisation(s), in-country opportunities for subspecialty training, and whether programmes self-identified as being similar to or affected by the surgical education system in the USA or the UK. FINDINGS: We identified 5229 abstracts (3888 from Medline, 971 from EMBASE, and 726 from the Global Health Library databases). 228 (4·4%) articles underwent full text review. 60 articles were included for data extraction. We identified descriptions of general surgery training programmes in 52 countries. Data from an additional 17 countries represented by a regional college of surgeons were also recorded. Training duration ranged from 2-8 years (median total training, 6 years; median surgical training, 5 years), and lasted on average 6 years after medical school graduation. 19 countries self-identified as being similar to or affected by the US or UK training model. Many low-income and middle-income countries (LMICs) are working to expand access to surgical care through programmes, often focusing on training non-physician clinicians. Programmes in high-income countries have also undergone substantial reforms, affected by evolving practice environments, trainee preferences, and training bottlenecks. INTERPRETATION: General surgery training programmes are often responsive to national health care needs. We show a global trend towards standardisation of curricula and competency-based training. Countries expanding or developing their programmes show benefit from association or partnership with larger surgical organisations and academic institutions, but there are questions of sustainability. Both LMICs and high-income countries stand to benefit from coordinating development of global training standards and educational exchanges. Although more research is needed to understand the role of surgical education in meeting the demand for surgical care, it is clear that a cross-nationally coordinated strategy will be important to address the burden of surgical disease. FUNDING: None.

Faculty and Resident Perspectives on the Implementation of Entrustable Professional Activities in General Surgery Residency.

OBJECTIVE: This study aimed to identify what best practices facilitate implementation of Entrustable Professional Activities (EPAs) into surgical training programs. DESIGN: This is a mixed methods study utilizing both survey data as well as semi-structured interviews of faculty and residents involved in the American Board of Surgery (ABS) EPA pilot study. SETTING: From 2018 to 2020, the ABS conducted a pilot that introduced five EPAs across 28 general surgery training programs. PARTICIPANTS: All faculty members and residents at the 28 pilot programs were invited to participate in the study. RESULTS: About 117 faculty members and 79 residents responded to the survey. The majority of faculty (81%) and residents (66%) felt that EPAs were useful and were a valuable addition to training. While neither group felt that EPAs were overly time consuming to complete, residents did report difficulty incorporating them into their daily workflow (44%). Semi-structured interviews found that programs that focused on faculty and resident -development and utilized frequent reminders about the importance and necessity of EPAs tended to perform better. CONCLUSIONS: EPA implementation is feasible in general surgery training programs but requires significant effort and engagement from all levels of program personnel. As EPAs are implemented by the ABS nationally a focus on resident and faculty development will be critical to success.

Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

Pregnancy and Parenthood Among US Surgical Residents.

Importance: The ability to pursue family planning goals is integral to gender equity in any field. Procedural specialties pose occupational risks to pregnancy. As the largest procedural specialty, general surgery provides an opportunity to understand family planning, workplace support for parenthood, obstetric outcomes, and the impact of these factors on workforce well-being, gender equity, and attrition. Objective: To examine pregnancy and parenthood experiences, including mistreatment and obstetric outcomes, among a cohort of US general surgical residents. Design, Setting, and Participants: This cohort study involved a cross-sectional national survey of general surgery residents in all programs accredited by the Accreditation Council for Graduate Medical Education after the 2021 American Board of Surgery In-Training Examination. Female respondents who reported a pregnancy and male respondents whose partners were pregnant during clinical training were queried about pregnancy- and parenthood-based mistreatment, obstetric outcomes, and current well-being (burnout, thoughts of attrition, suicidality). Main Outcomes and Measures: Primary outcomes included obstetric complications and postpartum depression compared between female residents and partners of male residents. Secondary outcomes included perceptions about support for family planning, pregnancy, or parenthood; assisted reproductive technology use; pregnancy/parenthood-based mistreatment; neonatal complications; and well-being, compared between female and male residents. Results: A total of 5692 residents from 325 US general surgery programs participated (81.2% response rate). Among them, 957 residents (16.8%) reported a pregnancy during clinical training (692/3097 [22.3%] male vs 265/2595 [10.2%] female; P < .001). Compared with male residents, female residents more frequently delayed having children because of training (1201/2568 [46.8%] females vs 1006/3072 [32.7%] males; P < .001) and experienced pregnancy/parenthood-based mistreatment (132 [58.1%] females vs 179 [30.5%] males; P < .001). Compared with partners of male residents, female residents were more likely to experience obstetric complications (odds ratio [OR], 1.42; 95% CI, 1.04-1.96) and postpartum depression (OR, 1.63; 95% CI, 1.11-2.40). Pregnancy/parenthood-based mistreatment was associated with increased burnout (OR, 2.03; 95% CI, 1.48-2.78) and thoughts of attrition (OR, 2.50; 95% CI, 1.61-3.88). Postpartum depression, whether in female residents or partners of male residents, was associated with resident burnout (OR, 1.93; 95% CI, 1.27-2.92), thoughts of attrition (OR, 2.32; 95% CI, 1.36-3.96), and suicidality (OR, 5.58; 95% CI, 2.59-11.99). Conclusions and Relevance: This study found that pregnancy/parenthood-based mistreatment, obstetric complications, and postpartum depression were associated with female gender, likely driving gendered attrition. Systematic change is needed to protect maternal-fetal health and advance gender equity in procedural fields.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

Evaluating Educational Outcomes Using Patient Outcomes of New Surgeons Performing Partial Colectomy Compared to Cholecystectomy.

PURPOSE: Despite ongoing efforts to improve surgical education, surgical residents face gaps in their training. However, it is unknown if differences in the training of surgeons are reflected in the patient outcomes of those surgeons once they enter practice. This study aimed to compare the patient outcomes among new surgeons performing partial colectomy-a common procedure for which training is limited-and cholecystectomy-a common procedure for which training is robust. METHOD: The authors retrospectively analyzed all adult Medicare claims data for patients undergoing inpatient partial colectomy and inpatient cholecystectomy between 2007 and 2018. Generalized additive mixed models were used to investigate the associations between surgeon years in practice and risk-adjusted rates of 30-day serious complications and death for patients undergoing partial colectomy and cholecystectomy. RESULTS: A total of 14,449 surgeons at 4,011 hospitals performed 340,114 partial colectomy and 355,923 cholecystectomy inpatient operations during the study period. Patients undergoing a partial colectomy by a surgeon in their 1st vs 15th year of practice had higher rates of serious complications (5.22% [95% CI, 4.85%-5.60%] vs 4.37% [95% CI, 4.22%-4.52%]; P < .01) and death (3.05% [95% CI, 2.92%-3.17%] vs 2.83% [95% CI, 2.75%-2.91%]; P < .01). Patients undergoing a cholecystectomy by a surgeon in their 1st vs 15th year of practice had similar rates of 30-day serious complications (4.11% vs 3.89%; P = .11) and death (1.71% vs 1.70%; P = .93). CONCLUSIONS: Patients undergoing partial colectomy faced a higher risk of serious complications and death when the operation was performed by a new surgeon compared to an experienced surgeon. Conversely, patient outcomes following cholecystectomy were similar for new and experienced surgeons. More attention to partial colectomy during residency training may benefit patients.