Development of entrustable professional activities for emergency medicine medical education fellowships: A modified Delphi study.

Background: It is essential that medical education (MedEd) fellows achieve desired outcomes prior to graduation. Despite the increase in postgraduate MedEd fellowships in emergency medicine (EM), there is no consistently applied competency framework. We sought to develop entrustable professional activities (EPAs) for EM MedEd fellows. Methods: From 2021 to 2022, we used a modified Delphi method to achieve consensus for EPAs. EM education experts generated an initial list of 173 EPAs after literature review. In each Delphi round, panelists were asked to make a binary choice of whether to include the EPA. We determined an inclusion threshold of 70% agreement a priori. After the first round, given the large number of EPAs meeting inclusion threshold, panelists were instructed to vote whether each EPA should be included in the "20 most important" EPAs for a MedEd fellowship. Modifications were made between rounds based on expert feedback. We calculated descriptive statistics. Results: Seventeen experts completed four Delphi rounds each with 100% response. After Round 1, 87 EPAs were eliminated and two were combined. Following Round 2, 46 EPAs were eliminated, seven were combined, and three were included in the final list. After the third round, one EPA was eliminated and 13 were included. After the fourth round, 11 EPAs were eliminated. The final list consisted of 16 EPAs in domains of career development, education theory and methods, research and scholarship, and educational program administration. Conclusions: We developed a list of 16 EPAs for EM MedEd fellowships, the first step in implementing competency-based MedEd.

Progression of Self-Directed Learning in Health Professions Education: Clarifying Terms and Processes.

As the complexity ofmedical knowledge and clinical practice continues to grow, physicians and physicians-intrainingmust learn to identify gaps in their knowledge and understand and engage in self-directed learning (SDL) in pursuit of academic goals and improved clinical performance. There is a lack of consensus, however, on the precise definition of SDL and how it relates to self-regulated learning (SRL) and co-regulated learning (CRL). We propose a conceptual framework for understanding the progression of a self-directed learner in the health professions and describe the interplay of SRL and CRL.

Making decisions "in the dark": Learning through uncertainty in clinical practice during Covid-19.

Purpose: The purpose of this study was to explore how decision making and informal and incidental learning (IIL) emerged in the clinical learning environment (CLE) during the height of the Covid-19 pandemic. The authors' specific interest was to better understand the IIL that took place among frontline physicians who had to navigate a CLE replete with uncertainty and complexity with the future goal of creating experiences for medical students that would simulate IIL and use uncertainty as a catalyst for learning. Method: Using a modified constructivist, grounded theory approach, we describe physicians' IIL while working during times of heightened uncertainty. Using the critical incident technique, we conducted 45-min virtual interviews with seven emergency department (ED) and five intensive care unit (ICU) physicians, who worked during the height of the pandemic. The authors transcribed and restoried each interview before applying inductive, comparative analysis to identify patterns, assertions, and organizing themes. Results: Findings showed that the burden of decision making for physicians was influenced by the physical, emotional, relational, and situational context of the CLE. The themes that emerged for decision making and IIL were interdependent. Prominent among the patterns for decision making were ways to simplify the problem by applying prior knowledge, using pattern recognition, and cross-checking with team members. Patterns for IIL emerged through trial and error, which included thoughtful experimentation, consulting alternative sources of information, accumulating knowledge, and "poking at the periphery" of clinical practice. Conclusions: Complexity and uncertainty are rife in clinical practice and this study made visible decision-making patterns and IIL approaches that can be built into formal curricula. Making implicit uncertainty explicit by recognizing it, naming it, and practicing navigating it may better prepare learners for the uncertainty posed by the clinical practice environment.

An Interactive Module to Enhance Clinical and Non-clinical Communication Skills With LGBTQIA2S+ Patients.

The Lesbian, Gay, Transgender, Queer, Intersex, Asexual, Two-Spirit, and all others (LGBTQIA2S+) community comprises a diverse array of people who challenge conventional norms regarding sexual orientation and/or gender identity. This group possesses a distinct set of social and cultural principles that necessitate personalized and all-encompassing medical attention. In light of the increase in the number of individuals openly sharing their LGBTQIA2S+ identity and a growing societal openness toward this community, most healthcare providers do not feel prepared with the requisite knowledge and skills to appropriately care for the needs of this community. We describe the development of an educational intervention, the LGBTQIA2S+ Healthcare Module, to address this significant gap in health professions education. It offers current and future clinicians just-in-time training on the language and cultural context to adequately provide patient-centered care to this community.

Navigating Uncertainty in Clinical Practice: A Workshop to Prepare Medical Students to Problem-Solve During Complex Clinical Challenges.

Introduction: Uncertainty is an inherent part of medicine. Prior work has trained medical students to better communicate diagnostic uncertainty; however, this work touches on only one aspect of the uncertainty students will face in practice. We developed a session to provide them with a taxonomy for categorizing the various types of uncertainty, as well as a framework to apply when navigating uncertainty during clinical challenges. These tools can help students make sense of uncertainty and determine actions in a complex health system. Methods: We designed a virtual workshop for third-year medical students at the end of their core clerkships. It included a didactic session followed by a small-group immersive unfolding case experience with several challenge points during which we tasked students with applying the framework, classifying the uncertainty domain, and discussing how they would problem-solve each scenario. Results: We conducted the workshop with 128 third-year medical students. We collected data through an anonymous postsession survey (86% response rate; 110 of 128 students). Most found the workshop useful (64%; 54 of 85), and a large number found the framework helpful in appraising uncertainty (47%; 42 of 89). A majority felt their perspectives on uncertainty changed after the workshop (66%; 73 of 110). Students integrated prior health systems science knowledge in their strategies to problem-solve each challenge. Discussion: This session provides a novel application of a sense-making framework and taxonomy for medical students to classify uncertainty. It offers a simple, low-cost, interactive, virtual activity that can be implemented at other institutions.

The Longitudinal and Vertical Integration of Health Systems Science in an Undergraduate Medical Education Program: A Means to Support "Curricular Elasticity".

Although health systems science (HSS) has become increasingly included as requisite curricular content in undergraduate medical education (UME), educators have many implementation options for integrating HSS content into medical school training. Learning from medical schools' authentic experiences and lessons learned for the successful and sustainable implementation of HSS would be valuable. We share our experience with the longitudinal and vertical integration of HSS at the Sidney Kimmel Medical College (SKMC) at Thomas Jefferson University in Philadelphia over the past six years. We posit that our approach to curricular design has afforded us the "curricular elasticity" needed to keep our educational program current and flexible in the rapidly changing healthcare and geopolitical landscape.

Disaster Triage Skills Training: An Introductory Virtual Simulation for Medical Students.

Background Disaster triage training equips learners with the critical skills to rapidly evaluate patients, yet few medical schools include formal triage training in their curriculum. Simulation exercises can successfully teach triage skills, but few studies have specifically evaluated online simulation to teach these skills to medical students. Aims We sought to develop and evaluate a largely asynchronous activity for senior medical students to practice their triage skills in an online format. Methods We developed an online, interactive triage exercise for fourth-year medical students. For the exercise, the student participants acted as triage officers for an emergency department (ED) at a large tertiary care center during an outbreak of a severe respiratory illness. Following the exercise, a faculty member led a debriefing session using a structured debriefing guide. Pre- and post-test educational assessments used a five-point Likert scale to capture the helpfulness of the exercise and their self-reported pre- and post-competency in triage. Change in self-reported competency was analyzed for statistical significance and effect size. Results Since May 2021, 33 senior medical students have completed this simulation and pre- and post-test educational assessments. Most students found the exercise "very" or "extremely" helpful for learning, with a mean of 4.61 (SD: ±0.67). Most students rated their pre-exercise competency as "beginner" or "developing" and their post-exercise competency as "developing" or "proficient" on a four-point rubric. The average increase in self-reported competency was 1.17 points (SD: ±0.62), yielding a statistically significant difference (p < 0.001) and large effect size (Hedges' g: 1.94). Conclusions We conclude that a virtual simulation can increase students' sense of competence in triage skills, using fewer resources than in-person simulation of disaster triage. As a next step, the simulation and the source code are publicly available for anyone to engage with the simulation or adapt it for their respective learners.

Practical tips for moving your patient panel online.

Patient panels are an inspiring, highly rated educational tool to complement course goals and objectives for students in medical education programs. The COVID-19 pandemic brought challenges on the ability to successfully host in-person patient panels. These challenges resulted in the need to pivot in-person patient panels to online platforms, while still ensuring the quality and intimacy of patient narratives. In this 12 tips article, we share lessons learned in transitioning patient panels in our health systems science curriculum to an online experience for students enrolled in a pre-clinical medical education program.

Intolerance of uncertainty and attitudes towards persons living with disabilities in medical students: Is there a correlation?

Introduction: Patients living with a disability experience an illness trajectory that may be uncertain. While navigating clinical uncertainty has been well-researched, health professionals' intolerance of uncertainty for patients living with disabilities has yet to be explored. We examined the relationship between medical students' intolerance of uncertainty with their attitudes towards people living with disabilities to better inform curricular efforts. Methods: We employed a survey-based design consisting of the Intolerance of Uncertainty Scale (IUS) and Disability Attitudes in Healthcare (DAHC) Scale to medical students upon completion of core clerkships (end of third-year of training). Data were de-identified. Mean DAHC and IUS scores were compared with published values via t-test. Linear regression was used to examine IUS/DAHC scores for anonymized students. Pearson correlation coefficient was calculated to assess correlation between IUS and DAHC scores. Results: Response rate was 97% (268/275 students). Mean IUS score did not differ from previously cited medical student scores, but mean DAHC score was significantly higher than previously cited scores. We observed a statistically-significant relationship between IUS and DAHC scores. Students with greater intolerance of uncertainty had lower scores for disability attitudes [F(1,243) = 8.05, value of p < 0.01], with an R 2-value of 0.032, suggesting that 3% of DAHC score variance can be explained by IUS score changes. Conclusion: We identified a weak negative correlation between IUS and DAHC scores in medical students. Further research is needed to clarify findings and identify best practices that equip trainees with skills to care for patients with uncertain illness trajectories and patients living with disabilities.

An Interactive Module to Teach Common Biostatistical Tests to Learners in the Health Professions.

Biostatistics are ubiquitous in medicine, providing quantitative insights into trials and experiments that shape the healthcare field. Despite training in evidence-based medicine, medical students and residents struggle to master biostatistical concepts and apply biostatistics to appraise research. There are limited resources available for students to quickly and cost-effectively learn biostatistical tests. From this problem, a two-part biostatistical educational module was created using Rise Articulate 360® software, an interactive module platform. The study aimed to assess the effectiveness of an educational biostatistics module's ability to improve learners' knowledge and application of commonly used biostatistical tests, as well as their confidence in biostatistics. Each part of the module contained five biostatistical test tutorials. Each biostatistical test was explained, as well as how the test was typically applied in healthcare. Knowledge acquisition, test application, and confidence regarding biostatistical tests were assessed using a pretest and a posttest. The module was completed by 33 first- and second-year medical students.  Knowledge acquisition improved from a mean of 2.41 to 3.53 (P <= 0.001). Participants expressed that the biostatistical educational module was easy to use and improved both their confidence and knowledge of specific biostatistical tests. Most students found that the biostatistical educational module applied to their future work. In summary, our module was successful in exposing learners in the health professions to commonly used biostatistical tests and tests' applications to the medical literature and their future research. Biostatistics is a pillar of medical research and education, and students' mastery of the concept will prove to be of longitudinal valuable, whether they pursue careers as clinicians and/or researchers.

Communicating Diagnostic Uncertainty at Emergency Department Discharge: A Simulation-Based Mastery Learning Randomized Trial.

PURPOSE: There are no standardized approaches for communicating with patients discharged from the emergency department with diagnostic uncertainty. This trial tested efficacy of the Uncertainty Communication Education Module, a simulation-based mastery learning curriculum designed to establish competency in communicating diagnostic uncertainty. METHOD: Resident physicians at 2 sites participated in a 2-arm waitlist randomized controlled trial from September 2019 to June 2020. After baseline (T1) assessment of all participants via a standardized patient encounter using the Uncertainty Communication Checklist (UCC), immediate access physicians received training in the Uncertainty Communication Education Module, which included immediate feedback, online educational modules, a smartphone-based application, and telehealth deliberate practice with standardized patients. All physicians were retested 16-19 weeks later (T2) via in-person standardized patient encounters; delayed access physicians then received the intervention. A final test of all physicians occurred 11-15 weeks after T2 (T3). The primary outcome measured the percentage of physicians in the immediate versus delayed access groups meeting or exceeding the UCC minimum passing standard at T2. RESULTS: Overall, 109 physicians were randomized, with mean age 29 years (range 25-46). The majority were male (n = 69, 63%), non-Hispanic/Latino (n = 99, 91%), and White (n = 78, 72%). At T2, when only immediate access participants had received the curriculum, immediate access physicians demonstrated increased mastery (n = 29, 52.7%) compared with delayed access physicians (n = 2, 3.7%, P < .001; estimated adjusted odds ratio of mastery for the immediate access participants, 31.1 [95% CI, 6.8-143.1]). There were no significant differences when adjusting for training site or stage of training. CONCLUSIONS: The Uncertainty Communication Education Module significantly increased mastery in communicating diagnostic uncertainty at the first postintervention test among emergency physicians in standardized patient encounters. Further work should assess the impact of clinical implementation of these communication skills.

Toward Unity and Inclusion in the Clinical Workplace: An Evaluation of Healthcare Workforce Belonging During the COVID-19 Pandemic.

INTRODUCTION: In a challenging time for the healthcare workforce responding to the coronavirus disease 2019 (COVID-19) pandemic, it is critical to identify factors contributing to team members' feelings of "belonging" in the workplace. The Institute for Healthcare Improvement's Quintuple Aim's principle of improving healthcare worker well-being could be applied to explore the implications of the increased turnover and stress, which connect to components of belonging. This study applies a qualitative approach to the organizational issues impacting healthcare teams, particularly during a complex and uncertain time. METHODS: To elucidate factors contributing to belonging, we conducted a series of semi-structured interviews with an interdisciplinary cross-sectional sample of healthcare workers. Interviews were conducted with 23 total staff members in two clinical settings, the emergency department and hospital medicine groups at a large urban teaching hospital, to evaluate team members' perspectives of the work environment. RESULTS: Participants discuss their degree of inclusion, excitement, challenges, and respective needs from the organization. Perspectives of workers representing varied professional roles of the healthcare team were gathered to provide robust and unique insights into initiatives that can enhance belonging in the clinical workplace. CONCLUSION: Our findings provide a preliminary framework to identify strategies that can potentially reinforce collective team member belonging and consequently improve staff well-being, morale, and retention.

From the ground up: Creating and leading fellowship programs in emergency medicine.

Background: A methodical and evidence-based approach to the creation and implementation of fellowship programs is not well described in the graduate medical education literature. The Society for Academic Emergency Medicine (SAEM) convened an expert panel to promote standardization and excellence in fellowship training. The purpose of the expert panel was to develop a fellowship guide to give prospective fellowship directors the necessary skills to successfully implement and maintain a fellowship program. Methods: Under direction of the SAEM Board of Directors, SAEM Education Committee, and SAEM Fellowship Approval Committee, a panel of content experts convened to develop a fellowship guide using an evidence-based approach and best practices content method. The resource guide was iteratively reviewed by all panel members. Results: Utilizing Kern's six-step model as a conceptual framework, the fellowship guide summarizes the construction, implementation, evaluation, and dissemination of a novel fellowship curriculum to meet the needs of trainees, educators, and sponsoring institutions. Other key areas addressed include Accreditation Council for Graduate Medical Education and nonaccredited fellowships, programmatic assessment, finances, and recruitment. Conclusions: The fellowship guide summarizes the conceptual framework, best practices, and strategies to create and implement a new fellowship program.

Intolerance of Uncertainty and Self-Compassion in Medical Students: Is There a Relationship and Why Should We Care?

Managing the uncertainty of clinical practice represents a significant source of stress for clinicians, including medical students transitioning into the clinical workplace. Self-compassion, a strategy to better cope with stress and burnout, may represent a skill that can be leveraged to better prepare learners for the uncertainty inherent in clinical practice. A negative correlation between intolerance of uncertainty and self-compassion has been demonstrated in undergraduate students and in the general population. An examination of this relationship in medical students may help inform future curricular development for addressing burnout in undergraduate medical education. We electronically administered the Intolerance of Uncertainty Short Scale and the Self-Compassion Short Form to 273 third-year medical students from a single institution and analyzed data via regression. A significant negative correlation was found between intolerance of uncertainty and self-compassion (p < 0.0001). Students with higher levels of self-compassion showed lower levels of intolerance of uncertainty. This is consistent with findings in other populations. Our findings offer a starting point for designing training experiences that strengthen student self-compassion to enhance their ability to reconcile the uncertainty they will encounter in clinical practice.

Analyzing the effect of interview time and day on emergency medicine residency interview scores.

BACKGROUND: When it comes to scheduling interviews, medical students may wonder if they need a strategy to increase their likelihood of matching. Previous studies examined the temporal effects of the residency interview on overall match rate; however, there are additional factors that affect the match process, including board examination scores and letters of recommendation. Only few studies have examined the effect interview time of day has on match success. The current study examines the impact date and time of interview during the interview season have on candidates' respective interview scores. METHODS: Interview data over a three-year period (i.e., three interview cycles) was examined at a PGY-1-3, ACGME-accredited EM residency program in Philadelphia. Date of interview and time of day of interview (i.e., morning versus afternoon) was examined. A linear regression analysis was performed to determine if there is a statistically-significant difference in overall interview scores based on date during the interview season and time of day. RESULTS: There is no statistically-significant effect of time of day or date on residency interview scores. CONCLUSIONS: Our findings are congruent with other studies on the temporal effects of residency interviews on overall match rate. Findings should provide reassurance to students scheduling interviews, as time slots have not been found to have a significant relationship with overall interview score. Future studies should more holistically analyze the residency application process.

Informal and Incidental Learning in the Clinical Learning Environment: Learning Through Complexity and Uncertainty During COVID-19.

In the time of the COVID-19 pandemic, where clinical environments are plagued by both uncertainty and complexity, the importance of the informal and social aspects of learning among health care teams cannot be exaggerated. While there have been attempts to better understand the nuances of informal learning in the clinical environment through descriptions of the tacit or hidden curriculum, incidental learning in medical education has only been partially captured in the research. Understood through concepts borrowed from the Cynefin conceptual framework for sensemaking, the early stages of the pandemic immersed clinical teams in complex and chaotic situations where there was no immediately apparent relationship between cause and effect. Health care teams had to act quickly amidst the chaos: they had to first act, make sense of, and respond with intentionality. Informal and incidental learning (IIL) emerged as a byproduct of acting with the tools and knowledge available in the moment. To integrate the informal, sometimes haphazard nature of emergence among health care teams, educators require an understanding of IIL. This understanding can help medical educators prepare health professions learners for the cognitive dissonance that accompanies uncertainty in clinical practice. The authors introduce IIL as an explanatory framework to describe how teams navigate complexity in the clinical learning environment and to better inform curricular development for health professions training that prepares learners for uncertainty. While further research in IIL is needed to illuminate tacit knowledge that makes learning explicit for all audiences in the health professions, there are opportunities to cultivate learners' skills in formal curricula through various learning interventions to prime them for IIL when they enter complex clinical learning environments.