Decision-Making Confidence of Clinical Competency Committees for Entrustable Professional Activities.

Importance: A competency-based assessment framework using entrustable professional activities (EPAs) was endorsed by the American Board of Surgery following a 2-year feasibility pilot study. Pilot study programs' clinical competency committees (CCCs) rated residents on EPA entrustment semiannually using this newly developed assessment tool, but factors associated with their decision-making are not yet known. Objective: To identify factors associated with variation in decision-making confidence of CCCs in EPA summative entrustment decisions. Design, Setting, and Participants: This cohort study used deidentified data from the EPA Pilot Study, with participating sites at 28 general surgery residency programs, prospectively collected from July 1, 2018, to June 30, 2020. Data were analyzed from September 27, 2022, to February 15, 2023. Exposure: Microassessments of resident entrustment for pilot EPAs (gallbladder disease, inguinal hernia, right lower quadrant pain, trauma, and consultation) collected within the course of routine clinical care across four 6-month study cycles. Summative entrustment ratings were then determined by program CCCs for each study cycle. Main Outcomes and Measures: The primary outcome was CCC decision-making confidence rating (high, moderate, slight, or no confidence) for summative entrustment decisions, with a secondary outcome of number of EPA microassessments received per summative entrustment decision. Bivariate tests and mixed-effects regression modeling were used to evaluate factors associated with CCC confidence. Results: Among 565 residents receiving at least 1 EPA microassessment, 1765 summative entrustment decisions were reported. Overall, 72.5% (1279 of 1765) of summative entrustment decisions were made with moderate or high confidence. Confidence ratings increased with increasing mean number of EPA microassessments, with 1.7 (95% CI, 1.4-2.0) at no confidence, 1.9 (95% CI, 1.7-2.1) at slight confidence, 2.9 (95% CI, 2.6-3.2) at moderate confidence, and 4.1 (95% CI, 3.8-4.4) at high confidence. Increasing number of EPA microassessments was associated with increased likelihood of higher CCC confidence for all except 1 EPA phase after controlling for program effects (odds ratio range: 1.21 [95% CI, 1.07-1.37] for intraoperative EPA-4 to 2.93 [95% CI, 1.64-5.85] for postoperative EPA-2); for preoperative EPA-3, there was no association. Conclusions and Relevance: In this cohort study, the CCC confidence in EPA summative entrustment decisions increased as the number of EPA microassessments increased, and CCCs endorsed moderate to high confidence in most entrustment decisions. These findings provide early validity evidence for this novel assessment framework and may inform program practices as EPAs are implemented nationally.

An Executive Summary of the National Trauma Research Action Plan (NTRAP).

ABSTRACT: The National Trauma Research Action Plan (NTRAP) project successfully engaged multidisciplinary experts to define opportunities to advance trauma research and has fulfilled the recommendations related to trauma research from the National Academies of Sciences, Engineering and Medicine (NASEM) report. These panels identified more than 4,800 gaps in our knowledge regarding injury prevention and the optimal care of injured patients and laid out a priority framework and tools to support researchers to advance this field. Trauma research funding agencies and researchers can use this executive summary and supporting manuscripts to strategically address and close the highest priority research gaps. Given that this is the most significant public health threat facing our children, young adults, and military service personnel, we must do better in prioritizing these research projects for funding and providing grant support to advance this work. Through the Coalition for National Trauma Research (CNTR), the trauma community is committed to a coordinated, collaborative approach to address these critical knowledge gaps and ultimately reduce the burden of morbidity and mortality faced by our patients.

Faculty Entrustment and Resident Entrustability.

Importance: As the surgical education paradigm transitions to entrustable professional activities, a better understanding of the factors associated with resident entrustability are needed. Previous work has demonstrated intraoperative faculty entrustment to be associated with resident entrustability. However, larger studies are needed to understand if this association is present across various surgical training programs. Objective: To assess intraoperative faculty-resident behaviors and determine if faculty entrustment is associated with resident entrustability across 4 university-based surgical training programs. Design, Setting, and Participants: This cross-sectional study was conducted at 4 university-based surgical training programs from October 2018 to May 2022. OpTrust, a validated tool designed to assess both intraoperative faculty entrustment and resident entrustability behaviors independently, was used to assess faculty-resident interactions. A total of 94 faculty and 129 residents were observed. Purposeful sampling was used to create variation in type of operation performed, case difficulty, faculty-resident pairings, faculty experience, and resident training level. Main Outcomes and Measures: Observed resident entrustability scores (scale 1-4, with 4 indicating full entrustability) were compared with reported measures (faculty level, case difficulty, resident postgraduate year [PGY], resident gender, observation month) and observed faculty entrustment scores (scale 1-4, with 4 indicating full entrustment). Path analysis was used to explore direct and indirect effects of the predictors. Associations between resident entrustability and faculty entrustment scores were assessed by pairwise Pearson correlation coefficients. Results: A total of 338 cases were observed. Cases observed were evenly distributed by faculty experience (1-5 years' experience: 67 [20.9%]; 6-14 years' experience: 186 [58%]; ≥15 years' experience: 67 [20.9%]), resident PGY (PGY 1: 28 [8%]; PGY 2: 74 [22%]; PGY 3: 64 [19%]; PGY 4: 40 [12%]; PGY 5: 97 [29%]; ≥PGY 6: 36 [11%]), and resident gender (female: 183 [54%]; male: 154 [46%]). At the univariate level, PGY (mean [SD] resident entrustability score range, 1.44 [0.46] for PGY 1 to 3.24 [0.65] for PGY 6; F = 38.92; P < .001) and faculty entrustment (2.55 [0.86]; R2 = 0.94; P < .001) were significantly associated with resident entrustablity. Path analysis demonstrated that faculty entrustment was associated with resident entrustability and that the association of PGY with resident entrustability was mediated by faculty entrustment at all 4 institutions. Conclusions and Relevance: Faculty entrustment remained associated with resident entrustability across various surgical training programs. These findings suggest that efforts to develop faculty entrustment behaviors may enhance intraoperative teaching and resident progression by promoting resident entrustability.

Risk of motor vehicle collision associated with cannabis and alcohol use among patients presenting for emergency care.

BACKGROUND: The objective of this study was to examine the relationship between cannabis and alcohol use and occurrence of motor vehicle collision (MVC) among patients in the emergency department (ED). METHODS: This was a cross-sectional study of visits to EDs in Denver, CO, Portland, OR, and Sacramento, CA by drivers who were involved in MVCs and presented with injuries (cases) and non-injured drivers (controls) who presented for medical care. We obtained blood samples and measured delta-9-THC and its metabolites. Alcohol levels were determined by breathalyzer or samples taken in the course of clinical care. Participants completed a research-assistant-administered interview consisting of questions about drug and alcohol use prior to their visit, context of use, and past-year drug and alcohol use. Multiple logistic regression was used to estimate the association between MVC and cannabis/alcohol use, adjusted for demographic characteristics. We then stratified participants based on levels of cannabis use and calculated the odds of MVC across these levels, first using self-report and then using blood levels for delta-9-THC in separate models. We conducted a case-crossover analysis, using 7-day look-back data to allow each participant to serve as their own control. Sensitivity analyses examined the influence of usual use patterns and driving in a closed (car, truck, van) versus open (motorcycle, motorbike, all-terrain vehicle) vehicle. RESULTS: Cannabis alone was not associated with higher odds of MVC, while acute alcohol use alone, and combined use of alcohol and cannabis were both independently associated with higher odds of MVC. Stratifying by level of self-reported or measured cannabis use, higher levels were not associated with higher odds for MVC, with or without co-use of alcohol; in fact, high self-reported acute cannabis use was associated with lower odds of MVC (odds ratio [OR] 0.18, 95% confidence interval [CI] 0.05-0.65). In the case-crossover analysis, alcohol use alone or in combination with cannabis was associated with higher odds of MVC, while cannabis use alone was again associated with decreased odds of MVC. CONCLUSIONS: Alcohol use alone or in conjunction with cannabis was consistently associated with higer odds for MVC. However, the relationship between measured levels of cannabis and MVC was not as clear. Emphasis on actual driving behaviors and clinical signs of intoxication to determine driving under the influence has the strongest rationale.

Validity of Entrustable Professional Activities in a National Sample of General Surgery Residency Programs.

BACKGROUND: The American Board of Surgery has endorsed competency-based education as vital to the assessment of surgical training. From 2018 to 2020, a national pilot study was conducted at 28 general surgery programs to evaluate feasibility of implementing entrustable professional activities (EPAs) for 5 common general surgical conditions. ACGME core competency Milestones were also rated for each resident by program clinical competency committees. This study aimed to evaluate the validity of general surgery EPAs compared with Milestones. STUDY DESIGN: Prospectively collected, de-identified EPA Pilot Study data were analyzed. EPAs studied were EPA-1 (gallbladder), EPA-2 (inguinal hernia), EPA-3 (right lower quadrant pain), EPA-4 (trauma), and EPA-5 (consult). Variables abstracted included levels of EPA entrustment (1 to 5) and corresponding ACGME Milestone subcompetency ratings (1 to 5) for the same study cycle. Spearman's correlations were used to evaluate the relationship between summative EPA scores and corresponding Milestone ratings. RESULTS: A total of 493 unique residents received a summative entrustment decision. EPA summative entrustment scores had moderate-to-strong positive correlation with mapped Milestone subcompetencies, with median rho value of 0.703. Among operation-focused EPAs, median rho values were similar between EPA-1 (0.688) and EPA-2 (0.661), but higher for EPA-3 (0.833). EPA-4 showed a strong positive correlation with diagnosis and communication competencies (0.724), whereas EPA-5, mapped to the most Milestone subcompetencies, had the lowest median rho value (0.455). CONCLUSIONS: Moderate-to-strong positive correlation was noted between EPAs and patient care, medical knowledge, and communication Milestones. These findings support the validity of EPAs in general surgery and suggest that EPA assessments can be used to inform Milestone ratings by clinical competency committees.

Implementation of Entrustable Professional Activities in General Surgery: Results of a National Pilot Study.

OBJECTIVE: The ongoing complexity of general surgery training has led to an increased focus on ensuring the competence of graduating residents. Entrustable professional activities (EPAs) are units of professional practice that provide an assessment framework to drive competency-based education. The American Board of Surgery convened a group from the American College of Surgeons, Accreditation Council for Graduate Medical Education (ACGME) Surgery Review Committee, and Association of Program Directors in Surgery to develop and implement EPAs in a pilot group of residency programs across the country. The objective of this pilot study was to determine the feasibility and utility of EPAs in general surgery resident training. METHODS: 5 EPAs were chosen based on the most common procedures reported in ACGME case logs and by practicing general surgeons (right lower quadrant pain, biliary disease, inguinal hernia), along with common activities covering additional ACGME milestones (performing a consult, care of a trauma patient). Levels of entrustment assigned (1 to 5) were observation only, direct supervision, indirect supervision, unsupervised, and teaching others. Participating in site recruitment and faculty development occurred from 2017 to 2018. EPA implementation at individual residency programs began on July 1, 2018, and was completed on June 30, 2020. Each site was assigned 2 EPAs to implement and collected EPA microassessments on residents for those EPAs. The site clinical competency committees (CCC) used these microassessments to make summative entrustment decisions. Data submitted to the independent deidentified data repository every 6 months included the number of microassessments collected per resident per EPA and CCC summative entrustment decisions. RESULTS: Twenty-eight sites were selected to participate in the program and represented geographic and size variability, community, and university-based programs. Over the course of the 2-year pilot programs reported on 14 to 180 residents. Overall, 6,272 formative microassessments were collected (range, 0 to 1144 per site). Each resident had between 0 and 184 microassessments. The mean number of microassessments per resident was 5.6 (SD = 13.4) with a median of 1 [interquartile range (IQR) = 6]. There were 1,763 summative entrustment ratings assigned to 497 unique residents. The average number of observations for entrustment was 3.24 (SD 3.61) with a median of 2 (IQR 3). In general, PGY1 residents were entrusted at the level of direct supervision and PGY5 residents were entrusted at unsupervised practice or teaching others. For each EPA other than the consult EPA, the degree of entrustment reported by the CCC increased by resident level. CONCLUSIONS: These data provide evidence that widespread implementation of EPAs across general surgery programs is possible, but variable. They provide meaningful data that graduating chief residents are entrusted by their faculty to perform without supervision for several common general surgical procedures and highlight areas to target for the successful widespread implementation of EPAs.

Pediatric emergency resuscitative thoracotomy: A Western Trauma Association, Pediatric Trauma Society, and Eastern Association for the Surgery of Trauma collaborative critical decisions algorithm.

LEVEL OF EVIDENCE: Literature synthesis and expert opinion, Level V.

Integrating Surgical Palliative Care Into the Full Spectrum of Medical Education.

We describe our institutional approach to incorporating surgical palliative care education into the Undergraduate Medical Education, Graduate Medical Education and Continuing Medical Education spaces as a model to help guide similarly interested educators. We had a well-established Ethics and Professionalism Curriculum, but an educational needs assessment revealed that both the residents and faculty felt that additional training in palliative care principles was crucial. We describe our full spectrum palliative care curriculum, which begins with the medical students on their surgical clerkship and continues with a 4 week surgical palliative care rotation for categorical general surgery PGY-1 residents, as well as a Mastering Tough Conversations course over several months at the end of the first year. Surgical Critical Care rotations, Intensive Care Unit debriefs after major complications, deaths, and other high-stress events are described, as is the CME domain, which includes routine Department of Surgery Death Rounds and a focus on palliative care concepts in Departmental Morbidity and Mortality conference. The Peer Support program and Surgical Palliative Care Journal Club round out our current educational endeavor. We describe our plans to create a full spectrum surgical palliative care curriculum that is fully integrated with the 5 clinical years of surgical residency, and include our proposed educational goals and year-specific objectives. The development of a Surgical Palliative Care Service is also described.

Blunt pancreatic trauma: A Western Trauma Association critical decisions algorithm.

BACKGROUND: The Western Trauma Association (WTA) has undertaken publication of best practice clinical practice guidelines on multiple trauma topics. These guidelines are based on scientific evidence, case reports, and best practices per expert opinion. Some of the topics covered by this consensus group do not have the ability to have randomized controlled studies completed because of complexity, ethical issues, financial considerations, or scarcity of experience and cases. Blunt pancreatic trauma falls under one of these clinically complex and rare scenarios. This algorithm is the result of an extensive literature review and input from the WTA membership and WTA Algorithm Committee members. METHODS: Multiple evidence-based guideline reviews, case reports, and expert opinion were compiled and reviewed. RESULTS: The algorithm is attached with detailed explanation of each step, supported by data if available. CONCLUSION: Blunt pancreatic trauma is rare and presents many treatment challenges.

Increased identification of cannabis use among drivers involved in motor vehicle collisions using an expanded cannabis inventory.

OBJECTIVES: The objectives of this study were to implement and examine the potential capture rate of a novel instrument, the Expanded Cannabis Inventory, in a population of emergency department (ED) patients presenting after motor vehicle collisions (MVC). METHODS: Study participants who presented to the ED after MVC were recruited from three hospitals in cannabis-legal states (Denver, CO; Portland, OR; and Sacramento, CA). Research assistants (RAs) administered the Expanded Cannabis Inventory, which includes a wide variety of products that have become readily available in states where cannabis is legal, in addition to assessments related to patient demographic characteristics, general health, cannabis attitudes, and dependency measures. RAs also obtained blood samples for delta-9-THC and metabolites. RESULTS: Among 692 participants who provided responses to questions about cannabis use, 292 (42%) reported past-year use. Seventy-eight (27%) of those identified as using cannabis were only captured due to items in the expanded instrument. These patients were more likely to be White and were more likely to perceive daily use to be of high risk. Fewer had Cannabis Use Disorder Inventory Test (CUDIT) scores consistent with hazardous cannabis use. However, more of the patients only captured by the expanded instrument had high measured blood levels of delta-9-THC on samples obtained in the ED. CONCLUSIONS: Changing cannabis use patterns must be reflected in our measurements for clinical practice, research, and surveillance. Instruments that are the current standard in clinical practice capture limited data and may no longer perform well enough to identify a complete cohort or to provide insight into the health behaviors of patients.

Developing a National Trauma Research Action Plan: Results from the postadmission critical care research gap Delphi survey.

INTRODUCTION: The 2016 National Academies of Science, Engineering and Medicine report included a proposal to establish a National Trauma Research Action Plan. In response, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care from prehospital care to rehabilitation as part of an overall strategy to achieve zero preventable deaths and disability after injury. The Postadmission Critical Care Research panel was 1 of 11 panels constituted to develop this research agenda. METHODS: We recruited interdisciplinary experts in surgical critical care and recruited them to identify current gaps in clinical critical care research, generate research questions, and establish the priority of these questions using a consensus-driven Delphi survey approach. The first of four survey rounds asked participants to generate key research questions. On subsequent rounds, we asked survey participants to rank the priority of each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Twenty-five subject matter experts generated 595 questions. By Round 3, 249 questions reached ≥60% consensus. Of these, 22 questions were high, 185 were medium, and 42 were low priority. The clinical states of hypovolemic shock and delirium were most represented in the high-priority questions. Traumatic brain injury was the only specific injury pattern with a high-priority question. CONCLUSION: The National Trauma Research Action Plan critical care research panel identified 22 high-priority research questions, which, if answered, would reduce preventable death and disability after injury. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Developing a National Trauma Research Action Plan: Results from the long-term outcomes research gap Delphi survey.

BACKGROUND: In the National Academies of Sciences, Engineering, and Medicine 2016 report on trauma care, the establishment of a National Trauma Research Action Plan to strengthen and guide future trauma research was recommended. To address this recommendation, the Department of Defense funded the Coalition for National Trauma Research to generate a comprehensive research agenda spanning the continuum of trauma and burn care. We describe the gap analysis and high-priority research questions generated from the National Trauma Research Action Plan panel on long-term outcomes. METHODS: Experts in long-term outcomes were recruited to identify current gaps in long-term trauma outcomes research, generate research questions, and establish the priority for these questions using a consensus-driven, Delphi survey approach from February 2021 to August 2021. Panelists were identified using established Delphi recruitment guidelines to ensure heterogeneity and generalizability including both military and civilian representation. Panelists were encouraged to use a PICO format to generate research questions: Patient/Population, Intervention, Compare/Control, and Outcome model. On subsequent surveys, panelists were asked to prioritize each research question on a 9-point Likert scale, categorized to represent low-, medium-, and high-priority items. Consensus was defined as ≥60% of panelists agreeing on the priority category. RESULTS: Thirty-two subject matter experts generated 482 questions in 17 long-term outcome topic areas. By Round 3 of the Delphi, 359 questions (75%) reached consensus, of which 107 (30%) were determined to be high priority, 252 (70%) medium priority, and 0 (0%) low priority. Substance abuse and pain was the topic area with the highest number of questions. Health services (not including mental health or rehabilitation) (64%), mental health (46%), and geriatric population (43%) were the topic areas with the highest proportion of high-priority questions. CONCLUSION: This Delphi gap analysis of long-term trauma outcomes research identified 107 high-priority research questions that will help guide investigators in future long-term outcomes research. LEVEL OF EVIDENCE: Diagnostic Tests or Criteria; Level IV.

Developing and leading a sustainable organization for early career acute care surgeons: Lessons from the inaugural American Association for the Surgery of Trauma Associate Member Council.

ABSTRACT: The associate membership of the American Association for the Surgery of Trauma (AAST) was established in 2019 to create a defined but incorporated entity within the larger AAST for the next generation of acute care surgeons. The Associate Member Council (AMC) was subsequently established in 2020 to provide the new AM with an elected group of leaders who would represent them within the AAST. In its inaugural year, this cohort of junior faculty and surgical trainees had developed for the AM a set of bylaws, a mission statement, a strategic vision, and a succession plan. The experience of the AAST AMC is exemplary of what can be accomplished with collaboration, mentorship, innovation, and tenacity. It has the potential to serve as a template for the creation and vitalization of future professional groups. In this piece, the AMC proposes a blueprint for the successful conception of a new organization.

Circulating endocannabinoids and genetic polymorphisms as predictors of posttraumatic stress disorder symptom severity: heterogeneity in a community-based cohort.

The endocannabinoid signaling system (ECSS) regulates fear and anxiety. While ECSS hypoactivity can contribute to symptoms of established post-traumatic stress disorder (PTSD), the role of the ECSS in PTSD development following trauma is unknown. A prospective, longitudinal cohort study of 170 individuals (47% non-Hispanic Caucasian and 70% male) treated at a level 1 trauma center for traumatic injury was carried out. PTSD symptom assessments and blood were obtained during hospitalization and at follow-up (6-8 months post injury). Serum concentrations of the endocannabinoids N-arachidonoylethanolamine (AEA) and 2-arachidonoylglycerol (2-AG) were determined at both time points and selected genetic polymorphisms in endocannabinoid genes, including rs324420 in fatty acid amide hydrolase, were assessed. For the entire sample, serum concentrations of AEA at hospitalization were significantly higher in those diagnosed with PTSD at follow-up (p = 0.030). Serum concentrations of 2-AG were significantly, positively correlated with PTSD symptom severity at follow-up only in minorities (p = 0.014). Minority participants (mostly Black/African American) also demonstrated significant, negative correlations between serum AEA concentrations and PTSD symptom severity both measured at hospitalization (p = 0.015). The A/A genotype at rs324420 was associated with significantly higher PTSD symptom severity (p = 0.025) and occurred exclusively in the Black participants. Collectively, these results are contrary to our hypothesis and find positive associations between circulating endocannabinoids and risk for PTSD. Minority status is an important modulator of the association between endocannabinoids and risk for PTSD, suggesting that the ECSS contributes to risk most significantly in these individuals and the contextual factors related to these findings should be further explored.