Handoffs and Nurse Calls: Overnight Call Simulation for Fourth-Year Medical Students.

Introduction: Interns must be able to give and receive handoffs and use handoff information to respond to calls from nursing staff regarding patient concerns. Medical students may not receive adequate instruction in these tasks and often feel unprepared in this aspect of transitioning to residency. This program simulated an overnight call experience for fourth-year medical students emphasizing handoffs, nurse calls, and medical emergency response. Methods: The program utilized a combination of traditional didactics and simulated handoffs, nurse calls, and patient scenarios to allow groups of fourth-year medical students to independently manage a simulated overnight call. The program was designed for students as part of a larger Transition to Residency capstone course. Results: We ran four sessions over 3 years, with a total of 105 medical student participants. All students reported increased confidence or comfort in their ability to manage handoffs and respond to nurse calls. Students reported that the sessions were helpful and realistic. Discussion: This program provided fourth-year medical students with a realistic and useful opportunity to simulate handoffs and response to nurse calls, which increased their confidence and comfort. Minor changes were made between iterations of the course with continued positive feedback from medical students. The course is generalizable and can be adapted to the needs and resources of different institutions.

Development of a Simulation Scenario Evaluation Tool (SSET): modified Delphi study.

Introduction: One critical aspect of successful simulation facilitation is development of written scenarios. However, there are no validated assessment tools dedicated to the evaluation of written simulation scenarios available. Our aim was to develop a tool to evaluate the quality of written simulation demonstrating content validity. Methods: A comprehensive literature search did not yield a validated assessment tool dedicated for the evaluation of written simulation scenarios. A subsequent search yielded six templates published for written simulation scenario design. From these templates, critical scenario elements were identified to create an evaluation instrument with six components of scenario quality with corresponding anchors and rating scale. Subsequently, a national group of simulation experts were engaged via survey methodology to rate the content of the proposed instrument. Ultimately, a modified two-round Delphi approach was implemented to demonstrate consensus of the final assessment tool. Results: 38 responses were obtained in round 1, while 22 complete responses were obtained in round 2. Round 1 kappa values ranged from 0.44 to 1.0, indicating moderate to almost perfect rater agreement for inclusion of the six proposed components. Kappa values specifically regarding scale and anchors ranged from 0 to 0.49. After revisions, there was a significant level of agreement (p<0.05) of all items of the proposed assessment tool in the second-round survey except for item 10. Of note, all initial respondents indicated that they had never evaluated written scenarios with an assessment tool. Conclusions: The Simulation Scenario Evaluation Tool, developed using a national consensus of content experts, is an instrument demonstrating content validity that assesses the quality of written simulation scenarios. This tool provides a basis to guide structured feedback regarding the quality of written simulation scenarios.

Practice Makes Perfect: Simulation in Emergency Medicine Risk Management.

Simulation has been steadily changing the safety culture in the healthcare industry and allowing individual clinicians and interdisciplinary teams to be proactive in the culture of risk reduction and improved patient safety. Literature has demonstrated improved patient outcomes, improved team based skills, systems testing and mitigation of latent safety threats. Simulation may be incorporated into practice via different modalities. The simulation lab is helpful for individual procedures, in situ simulation (ISS) for system testing and teamwork, community outreach ISS for sharing of best practices and content resource experts. Serious medical gaming is developing into a useful training adjunct for the future.

Applying Educational Theory and Best Practices to Solve Common Challenges of Simulation-based Procedural Training in Emergency Medicine.

OBJECTIVES: Procedural competency is an essential prerequisite for the independent practice of emergency medicine. Multiple studies demonstrate that simulation-based procedural training (SBPT) is an effective method for acquiring and maintaining procedural competency and preferred over traditional paradigms ("see one, do one, teach one"). Although newer paradigms informing SBPT have emerged, educators often face circumstances that challenge and undermine their implementation. The goal of this paper is to identify and report on best practices and theory-supported solutions to some of these challenges as derived using a process of expert consensus building and reviews of the existing literature on SBPT. METHODS: The Society for Academic Emergency Medicine (SAEM) Simulation Academy SBPT Workgroup convened approximately 8 months prior to the 2019 SAEM Annual Meeting to perform a review of the literature and participate in a consensus-building process to identify solutions (in the form of best practices and educational theory) to these challenges faced by educators engaging in SBPT. RESULTS AND ANALYSIS: Thirteen distinct educational challenges to SBPT emerged from the expert group's primary literature reviews and consensus-building processes. Three domains emerged upon further analysis of the 13 challenges: learner, educator, and curriculum. Six challenges within the "learner" domain were selected for comprehensive discussion in this paper, as they were deemed representative of the most common and most significant threats to ideal SBPT. Each of the six challenges aligns with one of the following themes: 1) maximizing active learning, 2) maintaining learner engagement, 3) embracing learner diversity, 4) optimizing cognitive load, 5) promoting mindfulness and reflection, and 6) emphasizing deliberate practice for mastery learning. Over 20 "special treatments" for mitigating the impact of the 13 challenges were derived from the secondary literature search and consensus-building process prior to and during the preconference workshop; 11 of these that best address the six learner-centered challenges are explored, including implications for educators involved in SBPT. CONCLUSIONS/IMPLICATIONS FOR EDUCATORS: We propose multiple consensus-generated solutions (in the form of best practices and applied educational theory) that we believe are suitable and well aligned to overcome commonly encountered learner-centered challenges and threats to optimal SBPT.

Training for Failure: A Simulation Program for Emergency Medicine Residents to Improve Communication Skills in Service Recovery.

OBJECTIVES: Service failures such as long waits, testing delays, and medical errors are daily occurrences in every emergency department (ED). Service recovery refers to the immediate response of an organization or individual to resolve these failures. Effective service recovery can improve the experience of both the patient and the physician. This study investigated a simulation-based program to improve service recovery skills in postgraduate year 1 emergency medicine (PGY-1 EM) residents. METHODS: Eighteen PGY-1 EM residents participated in six cases that simulated common ED service failures. The patient instructors (PIs) participating in each case and two independent emergency medicine (EM) faculty observers used the modified Master Interview Rating Scale to assess the communication skills of each resident in three simulation cases before and three simulation cases after a service recovery debriefing. For each resident, the mean scores of the first three cases and those of the last three cases were termed pre- and postintervention scores, respectively. The means and standard deviations of the pre- and postintervention scores were calculated by the type of rater and compared using paired t-tests. Additionally, the mean scores of each case were summarized. In the framework of the linear mixed-effects model, the variance in scores from the PIs and faculty observers was decomposed into variance contributed by PIs/cases, the program effect on individual residents, and the unexplained variance. In reliability analyses, the intraclass correlation coefficient between rater types and the 95% confidence interval were reported before and after the intervention. RESULTS: When rated by the PIs, the pre- and postintervention scores showed no difference (p = 0.852). In contrast, when scored by the faculty observers, the postintervention score was significantly improved compared to the preintervention score (p < 0.001). In addition, for the faculty observers, the program effect was a significant contributor to the variation in scores. Low intraclass correlation was observed between rater groups. CONCLUSIONS: This innovative simulation-based program was effective at teaching service recovery communication skills to residents as evaluated by EM faculty, but not PIs. This study supports further exploration into programs to teach and evaluate service recovery communication skills in EM residents.

Development of an Emergency Medicine Simulation Fellowship Consensus Curriculum: Initiative of the Society for Academic Emergency Medicine Simulation Academy.

OBJECTIVES: There is currently no consolidated list of existing simulation fellowship programs in emergency medicine (EM). In addition, there are no universally accepted or expected standards for core curricular content. The objective of this project is to develop consensus-based core content for EM simulation fellowships to help frame the critical components of such training programs. METHODS: This paper delineates the process used to develop consensus curriculum content for EM simulation fellowships. EM simulation fellowship curricula were collected. Curricular content was reviewed and compiled by simulation experts and validated utilizing survey methodology, and consensus was obtained using a modified Delphi methodology. RESULTS: Fifteen EM simulation fellowship curricula were obtained and analyzed. Two rounds of a modified Delphi survey were conducted. The final proposed core curriculum content contains 47 elements in nine domains with 14 optional elements. CONCLUSION: The proposed consensus content will provide current and future fellowships a foundation on which to build their own specific and detailed fellowship curricula. Such standardization will ultimately increase the transparency of training programs for future trainees and potential employers.