Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

An Executive Summary of the National Trauma Research Action Plan (NTRAP).

ABSTRACT: The National Trauma Research Action Plan (NTRAP) project successfully engaged multidisciplinary experts to define opportunities to advance trauma research and has fulfilled the recommendations related to trauma research from the National Academies of Sciences, Engineering and Medicine (NASEM) report. These panels identified more than 4,800 gaps in our knowledge regarding injury prevention and the optimal care of injured patients and laid out a priority framework and tools to support researchers to advance this field. Trauma research funding agencies and researchers can use this executive summary and supporting manuscripts to strategically address and close the highest priority research gaps. Given that this is the most significant public health threat facing our children, young adults, and military service personnel, we must do better in prioritizing these research projects for funding and providing grant support to advance this work. Through the Coalition for National Trauma Research (CNTR), the trauma community is committed to a coordinated, collaborative approach to address these critical knowledge gaps and ultimately reduce the burden of morbidity and mortality faced by our patients.

Faculty Entrustment and Resident Entrustability.

Importance: As the surgical education paradigm transitions to entrustable professional activities, a better understanding of the factors associated with resident entrustability are needed. Previous work has demonstrated intraoperative faculty entrustment to be associated with resident entrustability. However, larger studies are needed to understand if this association is present across various surgical training programs. Objective: To assess intraoperative faculty-resident behaviors and determine if faculty entrustment is associated with resident entrustability across 4 university-based surgical training programs. Design, Setting, and Participants: This cross-sectional study was conducted at 4 university-based surgical training programs from October 2018 to May 2022. OpTrust, a validated tool designed to assess both intraoperative faculty entrustment and resident entrustability behaviors independently, was used to assess faculty-resident interactions. A total of 94 faculty and 129 residents were observed. Purposeful sampling was used to create variation in type of operation performed, case difficulty, faculty-resident pairings, faculty experience, and resident training level. Main Outcomes and Measures: Observed resident entrustability scores (scale 1-4, with 4 indicating full entrustability) were compared with reported measures (faculty level, case difficulty, resident postgraduate year [PGY], resident gender, observation month) and observed faculty entrustment scores (scale 1-4, with 4 indicating full entrustment). Path analysis was used to explore direct and indirect effects of the predictors. Associations between resident entrustability and faculty entrustment scores were assessed by pairwise Pearson correlation coefficients. Results: A total of 338 cases were observed. Cases observed were evenly distributed by faculty experience (1-5 years' experience: 67 [20.9%]; 6-14 years' experience: 186 [58%]; ≥15 years' experience: 67 [20.9%]), resident PGY (PGY 1: 28 [8%]; PGY 2: 74 [22%]; PGY 3: 64 [19%]; PGY 4: 40 [12%]; PGY 5: 97 [29%]; ≥PGY 6: 36 [11%]), and resident gender (female: 183 [54%]; male: 154 [46%]). At the univariate level, PGY (mean [SD] resident entrustability score range, 1.44 [0.46] for PGY 1 to 3.24 [0.65] for PGY 6; F = 38.92; P < .001) and faculty entrustment (2.55 [0.86]; R2 = 0.94; P < .001) were significantly associated with resident entrustablity. Path analysis demonstrated that faculty entrustment was associated with resident entrustability and that the association of PGY with resident entrustability was mediated by faculty entrustment at all 4 institutions. Conclusions and Relevance: Faculty entrustment remained associated with resident entrustability across various surgical training programs. These findings suggest that efforts to develop faculty entrustment behaviors may enhance intraoperative teaching and resident progression by promoting resident entrustability.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Pediatric emergency resuscitative thoracotomy: A Western Trauma Association, Pediatric Trauma Society, and Eastern Association for the Surgery of Trauma collaborative critical decisions algorithm.

LEVEL OF EVIDENCE: Literature synthesis and expert opinion, Level V.

Integrating Surgical Palliative Care Into the Full Spectrum of Medical Education.

We describe our institutional approach to incorporating surgical palliative care education into the Undergraduate Medical Education, Graduate Medical Education and Continuing Medical Education spaces as a model to help guide similarly interested educators. We had a well-established Ethics and Professionalism Curriculum, but an educational needs assessment revealed that both the residents and faculty felt that additional training in palliative care principles was crucial. We describe our full spectrum palliative care curriculum, which begins with the medical students on their surgical clerkship and continues with a 4 week surgical palliative care rotation for categorical general surgery PGY-1 residents, as well as a Mastering Tough Conversations course over several months at the end of the first year. Surgical Critical Care rotations, Intensive Care Unit debriefs after major complications, deaths, and other high-stress events are described, as is the CME domain, which includes routine Department of Surgery Death Rounds and a focus on palliative care concepts in Departmental Morbidity and Mortality conference. The Peer Support program and Surgical Palliative Care Journal Club round out our current educational endeavor. We describe our plans to create a full spectrum surgical palliative care curriculum that is fully integrated with the 5 clinical years of surgical residency, and include our proposed educational goals and year-specific objectives. The development of a Surgical Palliative Care Service is also described.

Blunt pancreatic trauma: A Western Trauma Association critical decisions algorithm.

BACKGROUND: The Western Trauma Association (WTA) has undertaken publication of best practice clinical practice guidelines on multiple trauma topics. These guidelines are based on scientific evidence, case reports, and best practices per expert opinion. Some of the topics covered by this consensus group do not have the ability to have randomized controlled studies completed because of complexity, ethical issues, financial considerations, or scarcity of experience and cases. Blunt pancreatic trauma falls under one of these clinically complex and rare scenarios. This algorithm is the result of an extensive literature review and input from the WTA membership and WTA Algorithm Committee members. METHODS: Multiple evidence-based guideline reviews, case reports, and expert opinion were compiled and reviewed. RESULTS: The algorithm is attached with detailed explanation of each step, supported by data if available. CONCLUSION: Blunt pancreatic trauma is rare and presents many treatment challenges.

Developing a National Trauma Research Action Plan: Results from the postadmission critical care research gap Delphi survey.

INTRODUCTION: The 2016 National Academies of Science, Engineering and Medicine report included a proposal to establish a National Trauma Research Action Plan. In response, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care from prehospital care to rehabilitation as part of an overall strategy to achieve zero preventable deaths and disability after injury. The Postadmission Critical Care Research panel was 1 of 11 panels constituted to develop this research agenda. METHODS: We recruited interdisciplinary experts in surgical critical care and recruited them to identify current gaps in clinical critical care research, generate research questions, and establish the priority of these questions using a consensus-driven Delphi survey approach. The first of four survey rounds asked participants to generate key research questions. On subsequent rounds, we asked survey participants to rank the priority of each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Twenty-five subject matter experts generated 595 questions. By Round 3, 249 questions reached ≥60% consensus. Of these, 22 questions were high, 185 were medium, and 42 were low priority. The clinical states of hypovolemic shock and delirium were most represented in the high-priority questions. Traumatic brain injury was the only specific injury pattern with a high-priority question. CONCLUSION: The National Trauma Research Action Plan critical care research panel identified 22 high-priority research questions, which, if answered, would reduce preventable death and disability after injury. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Developing a National Trauma Research Action Plan: Results from the long-term outcomes research gap Delphi survey.

BACKGROUND: In the National Academies of Sciences, Engineering, and Medicine 2016 report on trauma care, the establishment of a National Trauma Research Action Plan to strengthen and guide future trauma research was recommended. To address this recommendation, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care. We describe the gap analysis and high-priority research questions generated from the National Trauma Research Action Plan panel on long-term outcomes. METHODS: Experts in long-term outcomes were recruited to identify current gaps in long-term trauma outcomes research, generate research questions, and establish the priority for these questions using a consensus-driven, Delphi survey approach from February 2021 to August 2021. Panelists were identified using established Delphi recruitment guidelines to ensure heterogeneity and generalizability including both military and civilian representation. Panelists were encouraged to use a PICO format to generate research questions: Patient/Population, Intervention, Compare/Control, and Outcome model. On subsequent surveys, panelists were asked to prioritize each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Thirty-two subject matter experts generated 482 questions in 17 long-term outcome topic areas. By Round 3 of the Delphi, 359 questions (75%) reached consensus, of which 107 (30%) were determined to be high priority, 252 (70%) medium priority, and 0 (0%) low priority. Substance abuse and pain was the topic area with the highest number of questions. Health services (not including mental health or rehabilitation) (64%), mental health (46%), and geriatric population (43%) were the topic areas with the highest proportion of high-priority questions. CONCLUSION: This Delphi gap analysis of long-term trauma outcomes research identified 107 high-priority research questions that will help guide investigators in future long-term outcomes research. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Developing and leading a sustainable organization for early career acute care surgeons: Lessons from the inaugural American Association for the Surgery of Trauma Associate Member Council.

ABSTRACT: The associate membership of the American Association for the Surgery of Trauma (AAST) was established in 2019 to create a defined but incorporated entity within the larger AAST for the next generation of acute care surgeons. The Associate Member Council (AMC) was subsequently established in 2020 to provide the new AM with an elected group of leaders who would represent them within the AAST. In its inaugural year, this cohort of junior faculty and surgical trainees had developed for the AM a set of bylaws, a mission statement, a strategic vision, and a succession plan. The experience of the AAST AMC is exemplary of what can be accomplished with collaboration, mentorship, innovation, and tenacity. It has the potential to serve as a template for the creation and vitalization of future professional groups. In this piece, the AMC proposes a blueprint for the successful conception of a new organization.

Evaluation and management of traumatic pneumothorax: A Western Trauma Association critical decisions algorithm.

ABSTRACT: This is a recommended algorithm of the Western Trauma Association for the management of a traumatic pneumothorax. The current algorithm and recommendations are based on available published prospective cohort, observational, and retrospective studies and the expert opinion of the Western Trauma Association members. The algorithm and accompanying text represents a safe and reasonable approach to this common problem. We recognize that there may be variability in decision making, local resources, institutional consensus, and patient-specific factors that may require deviation from the algorithm presented. This annotated algorithm is meant to serve as a basis from which protocols at individual institutions can be developed or serve as a quick bedside reference for clinicians. LEVEL OF EVIDENCE: Consensus algorithm from the Western Trauma Association, Level V.

Identification of Leadership Behaviors that Impact General Surgery Junior Residents' Well-being: A Needs Assessment in a Single Academic Center.

OBJECTIVE: Emerging literature has started to link leadership with the well-being of team members; however, this link during residency training has not been studied. The objective of this study was to perform a needs assessment to identify leadership behaviors among senior residents and evaluate the impact that these behaviors have on junior residents' well-being. DESIGN: A semi-structured question script was developed and ∼60 minute virtual focus groups were held during protected educational time, until data saturation was reached. Data analysis was performed in the tradition of grounded theory. SETTING: This study was performed at Oregon Health & Science University, one of the largest general surgery programs. PARTICIPANTS: Participants enrolled in the general surgery residency program from July 2020 to February 2021 were included. 35 general surgery residents participated in the focus groups. RESULTS: Two major themes resulted from the data analysis: (1) Effective leadership behaviors and their positive consequences, and (2) Ineffective leadership behaviors and their negative consequences. Effective and ineffective leadership were characterized by the presence or absence of 6 main behaviors: supportive and empowering, team building, management skills, emotional intelligence, effective communication, and teaching. Effective and ineffective leadership positively and negatively impacted residents' well-being, individual growth, and psychological safety. CONCLUSIONS: The results from this study identified leadership behaviors from senior residents and demonstrated that those behaviors have a significant short-term and long-term positive and negative impact on junior residents' well-being. These results fill a gap in the literature, and can serve as a guide for surgical educators to develop evidence-based leadership curricula.

Surgical Trainees and The Geriatric Patient: A Scoping Review.

OBJECTIVE: There is an increasing emphasis on surgical trainees learning how to appropriately provide care for the geriatric patient. We hypothesized that little published formal curriculum on the topic exists. We sought to perform a scoping review to test this hypothesis. DESIGN: PubMed, OVID Medline, and EMBASE databases were queried from inception, supplemented by hand search of references and the grey literature. Included English language abstracts and articles described trainee perceptions of geriatric patients and/or description of dedicated geriatric curricula for trainees. RESULTS: There were 21 included abstracts or papers, which were categorized into 8 survey-based studies, 6 descriptions of curricular design, and 7 interventional studies with pre- and post-intervention knowledge tests. General surgery residents were most frequently included. Self-rated confidence and comfort were typically higher than objective measures of resident performance in the care of geriatric patients. Residents were commonly unaware of the standardized assessment tools and recommendations that exist. Medication and delirium management were frequently-identified topics posing the widest gaps in resident knowledge. CONCLUSION: There are few published examples of curricula on the care of geriatric patients for surgical trainees. More work is needed for the creation of specialty-specific and needs-based geriatric surgical curricula.