The MIDAS touch: Frameworks for procedural model innovation and validation.

Background: Simulation-based procedural practice is crucial to emergency medicine skills training and maintenance. However, many commercial procedural models are either nonexistent or lacking in key elements. Simulationists often create their own novel models with minimal framework for designing, building, and validation. We propose two interlinked frameworks with the goal to systematically build and validate models for the desired educational outcomes. Methods: Simulation Academy Research Committee and members with novel model development expertise assembled as the MIDAS (Model Innovation, Development and Assessment for Simulation) working group. This working group focused on improving novel model creation and validation beginning with a preconference workshop at 2023 Society for Academic Emergency Medicine Annual Meeting. The MIDAS group sought to (1) assess the current state of novel model validation and (2) develop frameworks for the broader simulation community to create, improve, and validate procedural models. Findings: Workshop participants completed 17 surveys for a response rate of 100%. Many simulationists have created models but few have validated them. The most common barriers to validation were lack of standardized guidelines and familiarity with the validation process.We have combined principles from education and engineering fields into two interlinked frameworks. The first is centered on steps involved with model creation and refinement. The second is a framework for novel model validation processes. Implications: These frameworks emphasize development of models through a deliberate, form-follows-function methodology, aimed at ensuring training quality through novel models. Following a blueprint of how to create, test, and improve models can save innovators time and energy, which in turn can yield greater and more plentiful innovation at lower time and financial cost. This guideline allows for more standardized approaches to model creation, thus improving future scholarship on novel models.

Workshop in Simulation Debriefing for Educators in Medicine: Creation, implementation, and evaluation of a debriefing curriculum for novice simulation educators.

Objectives: Debriefing is an integral component of simulation education, and effective debriefing education is required to maintain effective simulation programs. However, many educators report financial and logistical barriers to accessing formal debriefing training. Due to limited educator development opportunities, simulation program leaders are often compelled to utilize educators with insufficient debriefing training, which can limit the impact of simulation-based education. To address these concerns, the SAEM Simulation Academy Debriefing Workgroup authored the Workshop in Simulation Debriefing for Educators in Medicine (WiSDEM), a freely available, concise, and ready-to-deploy debriefing curriculum with a target audience of novice educators without formal debriefing training. In this study, we describe the development, initial implementation, and evaluation of the WiSDEM curriculum. Methods: The Debriefing Workgroup iteratively developed the WiSDEM curriculum by expert consensus. The targeted level of content expertise was introductory. The curriculum's educational impact was assessed by surveying participants on their impressions of the curriculum and their confidence and self-efficacy in mastery of the material. Additionally, facilitators of the WiSDEM curriculum were surveyed on its content, usefulness, and future applicability. Results: The WiSDEM curriculum was deployed during the SAEM 2022 Annual Meeting as a didactic presentation. Thirty-nine of 44 participants completed the participant survey, and four of four facilitators completed the facilitator survey. Participant and facilitator feedback on the curriculum content was positive. Additionally, participants agreed that the WiSDEM curriculum improved their confidence and self-efficacy in future debriefing. All surveyed facilitators agreed that they would recommend the curriculum to others. Conclusions: The WiSDEM curriculum was effective at introducing basic debriefing principles to novice educators without formal debriefing training. Facilitators felt that the educational materials would be useful for providing debriefing training at other institutions. Consensus-driven, ready-to-deploy debriefing training materials such as the WiSDEM curriculum can address common barriers to developing basic debriefing proficiency in educators.

Procedural task trainer gaps in emergency medicine: A rift in the simulation universe.

Objectives: We identified and quantified the gap between emergency medicine (EM) procedures currently taught using simulation versus those that educators would teach if they had better procedural task trainers. Additionally, we endeavored to describe which procedures were taught using homemade models and the barriers to creation and use of additional homemade models. Methods: Using a modified Delphi process, we developed a survey and distributed it to a convenience sample of EM simulationists via the Society for Academic Emergency Medicine Simulation Academy listserv. Survey items asked participants to identify procedures they thought should be taught using simulation ("most important"), do teach using simulation ("most frequent"), would teach if a simulator or model were available ("most needed"), and do teach using simulation with "homemade" models ("most frequent homemade"). Results: Thirty-seven surveys were completed. The majority of respondents worked at academic medical centers and were involved in simulation-based education for at least 6 years. Three procedures ranked highly in overall teaching importance and currently taught categories. We identified four procedures that ranked highly as both important techniques to teach and would teach via simulation. Two procedures were selected as the most important procedures that the participants do teach via simulation but would like to teach in an improved way. We found 14 procedures that simulationists would teach if an adequate model was available, four of which are of high importance. Conclusions: This study captured data to illuminate the procedural model gap and inform future interventions that may address it and meet the overarching objective to create better and more readily available procedure models for EM simulation educators in the future. It offers an informed way of prioritizing procedures for which additional homemade models should be created and disseminated as well as barriers to be aware of and to work to overcome. Our work has implications for learners, educators, administrators, and industry.

Rapid Dissemination of a COVID-19 Airway Management Simulation Using a Train-the-Trainers Curriculum.

PROBLEM: The most effective way to train clinicians to safely don and doff personal protective equipment (PPE) and perform aerosol-generating procedures (AGPs), such as intubations, is unknown when clinician educators are unavailable, as they have been during the COVID-19 pandemic. Proper PPE and airway management techniques are critical to prevent the transmission of respiratory illnesses such as COVID-19. APPROACH: In March 2020, the authors implemented a structured train-the-trainers curriculum to teach PPE techniques and a modified airway management algorithm for suspected COVID-19 patients. A single emergency medicine physician trainer taught 17 subsequent emergency medicine and critical care physician trainers the proper PPE and airway management techniques. The initial trainer and 7 of the subsequent trainers then instructed 99 other emergency medicine resident and attending physicians using in situ simulation. Trainers and learners completed retrospective pre-post surveys to assess their comfort teaching the material and performing the techniques, respectively. OUTCOMES: The surveys demonstrated a significant increase in the trainers' comfort in teaching simulation-based education, from 4.00 to 4.53 on a 5-point Likert scale (P < .005), and in teaching the airway management techniques through simulation, from 2.47 to 4.47 (P < .001). There was no difference in the change in comfort level between those learners who were taught by the initial trainer and those who were taught by the subsequent trainers. These results suggest that the subsequent trainers were as effective in teaching the simulation material as the initial trainer. NEXT STEPS: Work is ongoing to investigate clinician- and patient-specific outcomes, including PPE adherence, appropriate AGP performance, complication rate, and learners' skill retention. Future work will focus on implementing similar train-the-trainers strategies for other health professions, specialties, and high-risk or rare procedures.

An Ultrasound-Guided Regional Anesthesia Elective for Emergency Medicine Residents.

Audience: This ultrasound-guided regional anesthesia elective is designed for emergency medicine residents. Length of Curriculum: The proposed length of this curriculum is over one week. Introduction: Ultrasound-guided regional anesthesia (UGRA) is a useful tool in the emergency department (ED) for managing painful conditions, and many programs have identified that these are useful skills for emergency providers; however, only about 53% of programs report teaching UGRA as part of their core curriculum, and there currently are no widely available or peer reviewed nerve block curricula designed for emergency medicine residents. Educational Goals: To deliver an immersive 1-week elective to provide residents a strong foundation in principles of UGRA and an introduction to 14 nerve block procedures applicable to care provided in the ED. Educational Methods: The educational strategies used in this curriculum include: instructional videos, written and online independent learning materials, one-on-one teaching at the bedside with an emergency ultrasound fellow, simulation of nerve block techniques using a femoral nerve block task trainer, and performance of supervised nerve block procedures on patients in the ED. Research Methods: All residents provided feedback through an online survey after completing the elective. Results: Eight residents completed the elective in the first year of implementation. Following completion of the UGRA curriculum, 8/8 (100%) of residents reported increased level of confidence in performing UGRA. In addition, 8/8 (100%) of residents reported they were "likely" or "very likely" to incorporate UGRA into their future EM practice. All 8 (100%) residents responded they were "very likely" to recommend the elective to other trainees. The elective received high ratings for overall quality with an average rating of 9.4 out of 10 (±0.7). Discussion: An elective in ultrasound-guided regional anesthesia can be successfully incorporated into an emergency medicine training program. The curriculum was successful in providing focused training in UGRA and resulted in increased resident confidence in performing nerve block procedures. Topics: Ultrasound-guided regional anesthesia, nerve block, resident, elective, pain.

A Social Network Analysis of the Western Journal of Emergency Medicine Special Issue in Educational Research and Practice.

INTRODUCTION: Scholarship and academic networking are essential for promotion and productivity. To develop education scholarship, the Council of Emergency Medicine Directors (CORD) and Clerkship Directors of Emergency Medicine (CDEM) created an annual Special Issue in Educational Research and Practice of the Western Journal of Emergency Medicine. The objective of this study was to evaluate the network created by the special Issue, and explore changes within the network over time. METHODS: Researchers used bibliometric data from Web of Science to create a social network analysis of institutions publishing in the first four years of the special issue using UCINET software. We analyzed whole-network and node-level metrics to describe variations and changes within the network. RESULTS: One hundred and three (56%) Accreditation Council for Graduate Medical Education-accredited emergency medicine programs were involved in 136 articles. The majority of institutions published in one or two issues. Nearly 25% published in three or four issues. The network analysis demonstrated that the mean number of connections per institution increased over the four years (mean of 5.34; standard deviation [SD] 1.27). Mean degree centralization was low at 0.28 (SD 0.05). Network density was low (mean of 0.09; SD 0.01) with little change across four issues. Five institutions scored consistently high in betweenness centrality, demonstrating a role as connectors between institutions within the network and the potential to connect new members to the network. CONCLUSION: Network-wide metrics describe a consistently low-density network with decreasing degree centralization over four years. A small number of institutions within the network were persistently key players in the network. These data indicate that, aside from core institutions that publish together, the network is not widely connected. There is evidence that new institutions are coming into the network, but they are not necessarily connected to the core publishing groups. There may be opportunities to intentionally increase connections across the network and create new connections between traditionally high-performing institutions and newer members of the network. Through informal discussions with authors from high-performing institutions, there are specific behaviors that departments may use to promote education scholarship and forge these new connections.

In-situ Simulation Use for Rapid Implementation and Process Improvement of COVID-19 Airway Management.

INTRODUCTION: The coronavirus disease 2019 (COVID-19) pandemic presents unique challenges to frontline healthcare workers. In order to safely care for patients new processes, such as a plan for the airway management of a patient with COVID-19, must be implemented and disseminated in a rapid fashion. The use of in-situ simulation has been used to assist in latent problem identification as part of a Plan-Do-Study-Act cycle. Additionally, simulation is an effective means for training teams to perform high-risk procedures before engaging in the actual procedure. This educational advance seeks to use and study in-situ simulation as a means to rapidly implement a process for airway management in patients with COVID-19. METHODS: Using an airway algorithm developed by the authors, we designed an in-situ simulation scenario to train physicians, nurses, and respiratory therapists in best practices for airway management of patients with COVID-19. Physician participants were surveyed using a five-point Likert scale with regard to their comfort level with various aspects of the airway algorithm both before and after the simulation in a retrospective fashion. Additionally, we obtained feedback from all participants and used it to refine the airway algorithm. RESULTS: Over a two-week period, 93 physicians participated in the simulation. We received 81 responses to the survey (87%), which showed that the average level of comfort with personal protective equipment procedures increased significantly from 2.94 (95% confidence interval, 2.71-3.17) to 4.36 (4.24-4.48), a difference of 1.42 (1.20-1.63, p < 0.001). There was a significant increase in average comfort level in understanding the physician role with scores increasing from 3.51 (3.26-3.77) to 4.55 (2.71-3.17), a difference of 1.04 (0.82-1.25, p < 0.001). There was also increased comfort in performing procedural tasks such as intubation, from 3.08 (2.80-3.35) to 4.38 (4.23-4.52) after the simulation, a difference of 1.30 points (1.06-1.54, p < 0.001). Feedback from the participants also led to refinement of the airway algorithm. CONCLUSION: We successfully implemented a new airway management guideline for patients with suspected COVID-19. In-situ simulation is an essential tool for both dissemination and onboarding, as well as process improvement, in the context of an epidemic or pandemic.

Kratom (Mitragynine) Ingestion Requiring Naloxone Reversal.

Kratom (mitragynine) is a naturally occurring opioid agonist whose use has been escalating. Its suppliers advertise it as a safe alternative for opioids and a safe treatment for opioid-withdrawal symptoms. There has been controversy in the past two years regarding the legal status and lack of regulation surrounding kratom. Currently, kratom is legal and unregulated, leaving users at risk from unpredictable potencies and effects. We present the first case of successful naloxone reversal of opioid toxidrome from recreationally used kratom. We advocate further research and regulation to ensure standardized dosing to protect patients.

Medical Student- and Resident-Authored Publications in Academic Medicine From 2002 to 2016: A Growing Trend and Its Implications.

PURPOSE: The extent of medical trainees' engagement in scholarly medical education publication is not well described. This study sought to quantify the prevalence of medical student- and resident-authored medical education publications over 15 years, a benchmark essential for understanding current and future trends in trainee scholarship. METHOD: Of 91 identified journals, 16 met inclusion criteria as indexed general medical education journals. Only Academic Medicine provided complete author role information, allowing identification of medical student and resident authors. The authors retrospectively compiled and analyzed citation records from Academic Medicine from 2002 to 2016, tracking trainee authorship, author position, and publication type. RESULTS: A total of 6,280 publications were identified, of which 4,635 publications, by 16,068 authors, met inclusion criteria. Trainees were 6.0% (966/16,068) of all authors and authored 14.5% (673/4,635) of all publications. Trainee authorship rates varied by publication type: Trainees authored 33.3% (160/480) of medical humanities publications versus 6.9% (27/392) of commentaries. From 2002-2004 to 2014-2016, the proportion of authors who were trainees increased from 3.9% (73/1,853) to 7.1% (330/4,632) (P < .001 for trend). Over the same period, the percentage of trainee-authored publications increased: 9.4% (58/620) to 18.8% (225/1,199) (P < .001 for trend), driven primarily by increased trainee first authorship. CONCLUSIONS: Trainees constitute a small but growing proportion of authors and authored publications in Academic Medicine. Further work is needed to understand what trainee-, institutional-, and journal-level factors contribute to this trend, and whether similar increases in trainee authorship are occurring in other journals and fields.

#DidacticsRevolution: Applying Kotter's 8-Step Change Management Model to Residency Didactics.

INTRODUCTION: Leading change effectively is critical to advancing medical education. Residency didactics often require change in order to meet stakeholder's needs. Kotter's change management model (KCMM) is an 8-step method for implementing change that can be applied to educational initiatives. This innovation improved an emergency medicine residency didactics curriculum through application of KCMM. METHODS: An initiative to improve residency didactics curriculum was titled the "Didactics Revolution" and implemented according to KCMM: establish a sense of urgency, form a powerful guiding coalition, create a vision, communicate the vision, empower others to act on the vision, plan for and create short-term wins, consolidate improvements and produce still more change, and institutionalize new approaches. Data from the Annual Program Review was utilized to assess the impact of the KCMM strategy. RESULTS: The percentage of residents who agreed or strongly agreed that lectures provide a valuable learning experience increased from 39.1% in the year prior to 88.0% in the year during the implementation (p < .001), and remained relatively high at 73.5% in the year following. The percentage of residents who agreed or strongly agreed that they felt well-prepared for the written boards increased from 60.9% in the year prior to 92.0% in the year during the implementation (p = .01) and remained high at 73.5% in the year following. CONCLUSION: Residency didactics can be improved through the use of KCMM, a change management model originally developed in the corporate context.

Early Impact of the Western Journal of Emergency Medicine CDEM/CORD Special Issue in Educational Research & Practice.

INTRODUCTION: In 2015, with a stated goal of disseminating best teaching practices and developing a community of educational scholars, the Council of Emergency Medicine Directors (CORD) and the Clerkship Directors of Emergency Medicine (CDEM) created an annual Special Issue in Educational Research and Practice (Special Issue) in cooperation with the Western Journal of Emergency Medicine. The intention of this study was to analyze the impact of this effort to date. METHODS: Bibliometric data was gathered on all four special issues, 2015-2019, from the Web of Science and then verified with the eScholarship website. Authorship, academic affiliation, date published, article type, and format were tabulated for descriptive analysis. Using metrics from Google Scholar, alternative scholarly impact metrics (altmetrics), and the eScholarship website, the authors identified top articles and grouped them into themes. RESULTS: Of the 136 articles included in the first four years of the Special Issue, 126 represented peer-reviewed publications with an overall acceptance rate of 25.0% (126/505). Authors from this cohort represented 103 of the 182 (56.6%) Accreditation Council for Graduate Medical Education (ACGME) programs in existence at the time of the inaugural issue. Multi-institutional studies represented 34.9% (44/126) of the peer-reviewed publications. Traditional and alternative publication metrics are reported to assess the impact of articles from the Special Issues. CONCLUSION: The Special Issue is a proven outlet to share best practices, innovations, and research related to education. Additionally, the infrastructure of this process promotes the development of individual faculty and a community of teaching scholars.

An Analysis of the Top-cited Articles in Anesthesiology Education Literature.

BACKGROUND: In the same way that impact factor is calculated for journals, the number of citations an article receives can indicate its influence or value to a particular field. This study was designed to identify the most frequently cited articles in anesthesiology education to yield insight into which articles have been most useful for researchers in ongoing research and publication. METHODS: The Web of Science database was searched to capture the top-cited articles in anesthesiology education both in anesthesiology and nonanesthesiology journals. Results were sorted by the most frequently cited. The top 40 cited articles were identified. Articles were included if they (1) related to anesthesiology or included anesthesiologists as subjects and (2) were related to the education of current or future anesthesiologists. The full text was analyzed, and themes were identified. RESULTS: There was a total of 2923 citations of articles in anesthesiology journals and 924 citations of articles in nonanesthesiology journals. Thirty-two of 40 articles (80%) were research studies. Twenty-four of 40 (60%) were about teaching methods. Twenty-five of 40 (63%) focused on simulation, and 31 of 40 (78%) had residents as the subjects. Twenty-eight of 40 (70%) articles were about either case management (15) or learning procedures (13). CONCLUSIONS: This study identifies the most widely cited articles in anesthesiology education. Common themes included procedural learning, interventional research study designs, simulation, and studies involving residents as subjects. This article may be a resource to anesthesiology education researchers to identify what articles are widely cited by other researchers.

A Cognitive Apprenticeship-Based Faculty Development Intervention for Emergency Medicine Educators.

In just a few years of preparation, emergency medicine (EM) trainees must achieve expertise across the broad spectrum of skills critical to the practice of the specialty. Though education occurs in many contexts, much learning occurs on the job, caring for patients under the guidance of clinical educators. The cognitive apprenticeship framework, originally described in primary and secondary education, has been applied to workplace-based medical training. The framework includes a variety of teaching methods: scaffolding, modeling, articulation, reflection, and exploration, applied in a safe learning environment. Without understanding these methods within a theoretical framework, faculty may not apply the methods optimally. Here we describe a faculty development intervention during which participants articulate, share, and practice their own applications of cognitive-apprenticeship methods to learners in EM. We summarize themes identified by workshop participants, and provide suggestions for tailoring the application of these methods to varying levels of EM learners. The cognitive-apprenticeship framework allows for a common understanding of the methods used in clinical teaching toward independence. Clinical educators should be encouraged to reflect critically on their methods, while being offered the opportunity to share and learn from others.

Programmatic Assessment in Emergency Medicine: Implementation of Best Practices.

BACKGROUND: Programmatic assessment is the intentional collection of key data from multiple sources for both assessment of learning and assessment for learning. OBJECTIVE: We developed a system of programmatic assessment (PA) to identify competency progression (summative) and assessment for learning to assist residents in their formative development. METHODS: The programmatic assessment was designed iteratively from 2014 through 2016. All assessments were first categorized by competency domain and source of assessment. The number of assessment modalities for each competency domain was collected. These multisource assessments were then mapped by program leadership to the milestones to develop a master PA blueprint. A resident learning management system provided the platform for aggregating formative and summative data, allowing residents and faculty ongoing access to guide learning and assessment. A key component of programmatic assessment was to support resident integration of assessment information through feedback by faculty after shifts and during monthly formal assessments, semiannual resident reviews, and summative judgments by the Clinical Competency Committee. RESULTS: Through the PA, the 6 competency domains are assessed through multiple modalities: patient care (22 different assessments), professionalism (18), systems-based practice (17), interprofessional and communication skills (16), medical knowledge (11), and practice-based learning and improvement (6). Each assessment provides feedback to the resident in various formats. Our programmatic assessment has been utilized for more than 2 years with iterative improvements. CONCLUSIONS: The implementation of programmatic assessment allowed our program to organize diverse, multisourced feedback to drive both formative and summative assessments.

An Analysis of the Top-cited Articles in Emergency Medicine Education Literature.

INTRODUCTION: Dissemination of educational research is critical to improving medical education, promotion of faculty and ultimately patient care. The objective of this study was to identify the top 25 cited education articles in the emergency medicine (EM) literature and the top 25 cited EM education articles in all journals, as well as report on the characteristics of the articles. METHODS: Two searches were conducted in the Web of Science in June 2016 using a list of education-related search terms. We searched 19 EM journals for education articles as well as all other literature for EM education-related articles. Articles identified were reviewed for citation count, article type, journal, authors, and publication year. RESULTS: With regards to EM journals, the greatest number of articles were classified as articles/reviews, followed by research articles on topics such as deliberate practice (cited 266 times) and cognitive errors (cited 201 times). In contrast in the non-EM journals, research articles were predominant. Both searches found several simulation and ultrasound articles to be included. The most common EM journal was Academic Emergency Medicine (n = 18), and Academic Medicine was the most common non-EM journal (n=5). A reasonable number of articles included external funding sources (6 EM articles and 13 non-EM articles.). CONCLUSION: This study identified the most frequently cited medical education articles in the field of EM education, published in EM journals as well as all other journals indexed in Web of Science. The results identify impactful articles to medical education, providing a resource to educators while identifying trends that may be used to guide EM educational research and publishing efforts.