Healthcare Simulation Training Guidelines and Literature Reviews From the Third Society for Simulation in Healthcare Research Summit.

ABSTRACT: The Society for Simulation in Healthcare held its third research summit in January 2023 with the aim of establishing evidence-based guidelines for healthcare simulation training. A panel of researchers, clinicians, and subject-matter experts conducted reviews of the literature addressing 12 key topics and followed a formal process to generate 16 guidelines for simulation-based training in healthcare. Eleven peer-reviewed literature reviews accompany these guidelines. Over the last 12 years, the Society for Simulation in Healthcare research summits have evolved with a consistent aim to advance simulation research, culminating in the formal set of guidelines published in this special issue.

Examining the Effect of Interruptions at Different Breakpoints and Frequencies Within a Task.

OBJECTIVE: The purpose was to explore how event segmentation theory (EST) can be used to determine optimal moments for an interruption relying on hierarchical task analysis (HTA) to identify coarse and fine event boundaries. BACKGROUND: Research on the effects of interruptions shows that they can be either disruptive or beneficial, depending on which aspects of an interruption are manipulated. Two important aspects that contribute to these conflicting results concern when and how often interruptions occur. METHOD: Undergraduates completed a trip planning task divided into three subtasks. The within-subjects factor was interruption timing with three levels: none, coarse breakpoints, and fine breakpoints. The between-subjects factor was interruption frequency with two levels: one and three. The dependent measures included resumption lag, number of errors, mental workload, and frustration. RESULTS: Participants took longer to resume the primary task and reported higher mental workload when interruptions occurred at fine breakpoints. The effect of interruptions at coarse breakpoints was similar to completing the task without interruption. Interruption frequency had no effect on performance; however, participants spent significantly longer attending to interruptions in the initial task, and within a task, the first and second interruptions were attended to significantly longer than the third interruption. CONCLUSION: The disruptiveness of an interruption is tied to the point within the task hierarchy where it occurs. APPLICATION: The performance cost associated with interruptions must be considered within the task structure. Interruptions occurring at coarse breakpoints may not be disruptive or have a negative effect on mental workload.

Preparing and Presenting Validation Studies: A Guide for the Perplexed.

SUMMARY STATEMENT: Simulated environments are frequently used for learner assessment, and a wide array of assessment instruments have been created to assist with this process. It is important, therefore, that clear, compelling evidence for the validity of these assessments be established. Contemporary theory recognizes instrument validity as a unified construct that links a construct to be assessed with a population, an environment of assessment, and a decision to be made using the scores. In this article, we present a primer on 2 current frameworks (Messick and Kane), define the elements of each, present a rubric that can be used by potential authors to structure their work, and offer examples of published studies showing how each framework has been successfully used to make a validity argument. We offer this with the goal of improving the quality of validity-related publications, thereby advancing the quality of assessment in healthcare simulation.

Medical Students' Experiences and Outcomes Using a Virtual Human Simulation to Improve Communication Skills: Mixed Methods Study.

BACKGROUND: Attending to the wide range of communication behaviors that convey empathy is an important but often underemphasized concept to reduce errors in care, improve patient satisfaction, and improve cancer patient outcomes. A virtual human (VH)-based simulation, MPathic-VR, was developed to train health care providers in empathic communication with patients and in interprofessional settings and evaluated through a randomized controlled trial. OBJECTIVE: This mixed methods study aimed to investigate the differential effects of a VH-based simulation developed to train health care providers in empathic patient-provider and interprofessional communication. METHODS: We employed a mixed methods intervention design, involving a comparison of 2 quantitative measures-MPathic-VR-calculated scores and the objective structured clinical exam (OSCE) scores-with qualitative reflections by medical students about their experiences. This paper is a secondary, focused analysis of intervention arm data from the larger trial. Students at 3 medical schools in the United States (n=206) received simulation to improve empathic communication skills. We conducted analysis of variance, thematic text analysis, and merging mixed methods analysis. RESULTS: OSCE scores were significantly improved for learners in the intervention group (mean 0.806, SD 0.201) compared with the control group (mean 0.752, SD 0.198; F1,414=6.09; P=.01). Qualitative analysis revealed 3 major positive themes for the MPathic-VR group learners: gaining useful communication skills, learning awareness of nonverbal skills in addition to verbal skills, and feeling motivated to learn more about communication. Finally, the results of the mixed methods analysis indicated that most of the variation between high, middle, and lower performers was noted about nonverbal behaviors. Medium and high OSCE scorers most often commented on the importance of nonverbal communication. Themes of motivation to learn about communication were only present in middle and high scorers. CONCLUSIONS: VHs are a promising strategy for improving empathic communication in health care. Higher performers seemed most engaged to learn, particularly nonverbal skills.

The Second Society for Simulation in Healthcare Research Summit: Beyond our Boundaries.

STATEMENT: In this article, we report on the Second Society for Simulation in Healthcare Research Summit held in 2017. This meeting succeeded the First Research Summit from 2011 with the goal of advancing the scope of healthcare simulation research. During the one and a half day summit, some of the world's leading experts in simulation, healthcare, and simulation in healthcare convened to discuss ideas about what research goals would be most beneficial to the healthcare simulation community, and what could be done to achieve them. We describe the rationale for the meeting, the organization, the program, and the articles that emerged from the Summit, which are found in this supplemental issue of Simulation in Healthcare.

Human Factors and Simulation in Emergency Medicine.

This consensus group from the 2017 Academic Emergency Medicine Consensus Conference "Catalyzing System Change through Health Care Simulation: Systems, Competency, and Outcomes" held in Orlando, Florida, on May 16, 2017, focused on the use of human factors (HF) and simulation in the field of emergency medicine (EM). The HF discipline is often underutilized within EM but has significant potential in improving the interface between technologies and individuals in the field. The discussion explored the domain of HF, its benefits in medicine, how simulation can be a catalyst for HF work in EM, and how EM can collaborate with HF professionals to effect change. Implementing HF in EM through health care simulation will require a demonstration of clinical and safety outcomes, advocacy to stakeholders and administrators, and establishment of structured collaborations between HF professionals and EM, such as in this breakout group.

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.

BACKGROUND: Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. METHODS: We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test. RESULTS: Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. CONCLUSION: Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.

Learner Improvement From a Simulation-Enhanced Ultrasonography Curriculum for First-Year Medical Students.

OBJECTIVES: We describe a simulation-enhanced ultrasonography (US) curriculum for first-year medical students as part of a comprehensive curricular integration of US skills. Our goal was to assess student knowledge and performance of US and determine their satisfaction with the integrated curriculum. METHODS: A committee of basic science, clinical, and interinstitutional faculty developed 7 educational US modules integrated into existing anatomy and physiology courses. First-year students in years 2012 through 2014 were administered a demographic survey and a knowledge-based pretest at the outset of the US program and assessed with a posttest, satisfaction survey, and their image acquisition abilities in an objective structured clinical examination with standardized patients on completion of the program. RESULTS: Data from 390 students showed a significant increase in knowledge from the pretest to the posttest [t(389) = 58.027; P < .0001]. Students with higher spatial abilities or some previous US experience performed better on the posttest. The objective structured clinical examination results showed that about 83% of the students were able to capture acceptable or marginally acceptable images. Ninety-five percent of students indicated that the US educational experience enhanced their medical education. CONCLUSIONS: Initial results show that we were able to successfully develop, implement, and evaluate performance of first-year medical students on their fundamental knowledge and performance of basic US using a model that emphasized hands-on simulation-enhanced training. Furthermore, most students found the experience to be a beneficial component of their education and indicated a desire for more US training in the medical curricula.

Effects of a retention interval and refresher session on intracorporeal suturing and knot tying skill and mental workload.

BACKGROUND: The effects of refraining from practice for different intervals on laparoscopic suturing and mental workload was assessed with a secondary task developed by the authors. We expected the inability to practice to produce a decrease in performance on the suturing, knot tying, and secondary task and skills to rebound after a single refresher session. METHODS: In total, 22 surgical assistant and premedical students trained to Fundamentals of Laparoscopic Surgery proficiency in intracorporeal suturing and knot tying were assessed on that task using a secondary task. Participants refrained from practicing any Fundamentals of Laparoscopic Surgery tasks for 1 or 5 months. At the time of their return, they were assessed immediately on suturing and knot tying with the secondary task, practiced suturing and knot tying for 40 minutes, and then were reassessed. RESULTS: The mean suture times from the initial reassessment were greater than the proficiency times but returned to proficiency levels after one practice session, F(2, 40) = 14.5, P < .001, partial η2 = .420. Secondary task scores mirrored the results of suturing time, F(2, 40) = 6.128, P < .005, partial η2 = .235, and were moderated by retention interval. CONCLUSION: When participants who reached proficiency in suturing and knot tying were reassessed after either 1or 5 months without practice, their performance times increased by 35% and secondary task scores decreased by 30%. These deficits, however, were nearly reversed after a single refresher session.

Using a computer simulation for teaching communication skills: A blinded multisite mixed methods randomized controlled trial.

OBJECTIVES: To assess advanced communication skills among second-year medical students exposed either to a computer simulation (MPathic-VR) featuring virtual humans, or to a multimedia computer-based learning module, and to understand each group's experiences and learning preferences. METHODS: A single-blinded, mixed methods, randomized, multisite trial compared MPathic-VR (N=210) to computer-based learning (N=211). Primary outcomes: communication scores during repeat interactions with MPathic-VR's intercultural and interprofessional communication scenarios and scores on a subsequent advanced communication skills objective structured clinical examination (OSCE). Multivariate analysis of variance was used to compare outcomes. SECONDARY OUTCOMES: student attitude surveys and qualitative assessments of their experiences with MPathic-VR or computer-based learning. RESULTS: MPathic-VR-trained students improved their intercultural and interprofessional communication performance between their first and second interactions with each scenario. They also achieved significantly higher composite scores on the OSCE than computer-based learning-trained students. Attitudes and experiences were more positive among students trained with MPathic-VR, who valued its providing immediate feedback, teaching nonverbal communication skills, and preparing them for emotion-charged patient encounters. CONCLUSIONS: MPathic-VR was effective in training advanced communication skills and in enabling knowledge transfer into a more realistic clinical situation. PRACTICE IMPLICATIONS: MPathic-VR's virtual human simulation offers an effective and engaging means of advanced communication training.

Differences in mental workload between traditional and single-incision laparoscopic procedures measured with a secondary task.

INTRO: The mental workload associated with laparoscopic suturing can be assessed with a secondary task that requires the same visual-spatial attentional resources. The purpose of this study was to use a secondary task to measure the incremental workload demands of single-incision laparoscopic surgery (SILS) procedures versus traditional laparoscopic procedures. METHOD: 12 surgery residents and surgical assistants who had met FLS criteria on an FLS and SILS simulator performed one trial each of peg transfer, cutting, and intracorporeal suturing tasks simultaneously with the secondary task and provided subjective workload ratings using the NASA-TLX. RESULTS: SILS procedures resulted in lower primary and secondary task scores, p < 0.001 and higher workload ratings, p < 0.0001. Suturing resulted in lower primary (p < 0.003) and secondary task scores (p < 0.017) and higher workload ratings (p < 0.017) compared to the other tasks. CONCLUSIONS: SILS procedures were significantly more mentally demanding than traditional laparoscopic procedures corroborated by primary and secondary tasks scores and subjective ratings.

Running Memory for Clinical Handoffs: A Look at Active and Passive Processing.

OBJECTIVE: The goal of the present study was to examine the effects of domain-relevant expertise on running memory and the ability to process handoffs of information. In addition, the role of active or passive processing was examined. BACKGROUND: Currently, there is little research that addresses how individuals with different levels of expertise process information in running memory when the information is needed to perform a real-world task. METHOD: Three groups of participants differing in their level of clinical expertise (novice, intermediate, and expert) performed an abstract running memory span task and two tasks resembling real-world activities, a clinical handoff task and an air traffic control (ATC) handoff task. For all tasks, list length and the amount of information to be recalled were manipulated. RESULTS: Regarding processing strategy, all participants used passive processing for the running memory span and ATC tasks. The novices also used passive processing for the clinical task. The experts, however, appeared to use more active processing, and the intermediates fell in between. CONCLUSION: Overall, the results indicated that individuals with clinical expertise and a developed mental model rely more on active processing of incoming information for the clinical task while individuals with little or no knowledge rely on passive processing. APPLICATION: The results have implications about how training should be developed to aid less experienced personnel identify what information should be included in a handoff and what should not.

Categorizing Fetal Heart Rate Variability with and without Visual Aids.

Objective This study examined the ability of clinicians to correctly categorize images of fetal heart rate (FHR) variability with and without the use of exemplars. Study Design A sample of 33 labor and delivery clinicians inspected static FHR images and categorized them into one of four categories defined by the National Institute of Child Health and Human Development (NICHD) based on the amount of variability within absent, minimal, moderate, or marked ranges. Participants took part in three conditions: two in which they used exemplars representing FHR variability near the center or near the boundaries of each range, and a third control condition with no exemplars. The data gathered from clinicians were compared with those from a previous study using novices. Results Clinicians correctly categorized more images when the FHR variability fell near the center rather than the boundaries of each range, F (1,32) = 71.69, p < 0.001, partial η2 = 0.69. They also correctly categorized more images when exemplars were available, F (2,64) = 5.44, p = 0.007, partial η2 = 0.15. Compared with the novices, the clinicians were more accurate and quicker in their category judgments, but this difference was limited to the condition without exemplars. Conclusion The results suggest that categorizing FHR variability is more difficult when the examples fall near the boundaries of each NICHD-defined range. Thus, clinicians could benefit from training with visual aids to improve judgments about FHR variability and potentially enhance safety in labor and delivery.