Impact of the PEARLS Healthcare Debriefing cognitive aid on facilitator cognitive load, workload, and debriefing quality: a pilot study.

BACKGROUND: The Promoting Excellence and Reflective Learning in Simulation (PEARLS) Healthcare Debriefing Tool is a cognitive aid designed to deploy debriefing in a structured way. The tool has the potential to increase the facilitator's ability to acquire debriefing skills, by breaking down the complexity of debriefing and thereby improving the quality of a novice facilitator's debrief. In this pilot study, we aimed to evaluate the impact of the tool on facilitators' cognitive load, workload, and debriefing quality. METHODS: Fourteen fellows from the New York City Health + Hospitals Simulation Fellowship, novice to the PEARLS Healthcare Debriefing Tool, were randomized to two groups of 7. The intervention group was equipped with the cognitive aid while the control group did not use the tool. Both groups had undergone an 8-h debriefing course. The two groups performed debriefings of 3 videoed simulated events and rated the cognitive load and workload of their experience using the Paas-Merriënboer scale and the raw National Aeronautics and Space Administration task load index (NASA-TLX), respectively. The debriefing performances were then rated using the Debriefing Assessment for Simulation in Healthcare (DASH) for debriefing quality. Measures of cognitive load were measured as Paas-Merriënboer scale and compared using Wilcoxon rank-sum tests. Measures of workload and debriefing quality were analyzed using mixed-effect linear regression models. RESULTS: Those who used the tool had significantly lower median scores in cognitive load in 2 out of the 3 debriefings (median score with tool vs no tool: scenario A 6 vs 6, p=0.1331; scenario B: 5 vs 6, p=0.043; and scenario C: 5 vs 7, p=0.031). No difference was detected in the tool effectiveness in decreasing composite score of workload demands (mean difference in average NASA-TLX -4.5, 95%CI -16.5 to 7.0, p=0.456) or improving composite scores of debriefing qualities (mean difference in DASH 2.4, 95%CI -3.4 to 8.1, p=0.436). CONCLUSIONS: The PEARLS Healthcare Debriefing Tool may serve as an educational adjunct for debriefing skill acquisition. The use of a debriefing cognitive aid may decrease the cognitive load of debriefing but did not suggest an impact on the workload or quality of debriefing in novice debriefers. Further research is recommended to study the efficacy of the cognitive aid beyond this pilot; however, the design of this research may serve as a model for future exploration of the quality of debriefing.

Learning practices of experienced healthcare teams and dyads in acute care settings: a scoping review.

OBJECTIVES: To map the evidence on learning practices currently used by experienced healthcare teams and dyads. The hypothesis is that through reviewing the literature we will identify the number and array of current learning practices. Through the lens of collaboration, the authors' goal is to map current practice to guide future research, policy and practice. SETTING: The review included studies from North America, Europe, Australasia and Asia. All studies were conducted in acute care settings such as operating rooms, emergency rooms, intensive care units and simulation centres. PARTICIPANTS: The participants were experienced healthcare professionals who work in acute care settings of any age or any sex. The group was interprofessional including two or more disciplines and/or professions. Characteristics of the participants who were excluded were students, novices, healthcare professionals who work in non-acute care settings and single profession studies. PRIMARY AND SECONDARY OUTCOME MEASURES: Aligned to the protocol quantitative and qualitative analyses were conducted. Thematic analysis was used to evaluate and categorise the study findings. Secondary outcome measures were the different types of learning practices used together to produce excellence. RESULTS: Most empirical studies were qualitative studies (46%), 31% were mixed methods and 23% were quantitative studies. There were also 24 reviews and 10 commentaries. The most frequent learning practices were structured observation and case scenarios (21%) followed by audio/video analysis and surveys (17%). Next was interviews and didactic presentations (12%) followed by prebriefing/debriefing and checklists (11%). Other learning practices accounted for less than 10%. Overall, 84 of the 86 publications, examined learning practices of teams larger than two participants. CONCLUSIONS: While the quality of studies was high, and there was a broad range of empirical studies, reviews and commentaries, there was no consensus on best practice in determining which learning practices to use and measurement of the effect of these practices.

Hospital-wide cardiac arrest in situ simulation to identify and mitigate latent safety threats.

BACKGROUND: Cardiac arrest resuscitation requires well-executed teamwork to produce optimal outcomes. Frequency of cardiac arrest events differs by hospital location, which presents unique challenges in care due to variations in responding team composition and comfort levels and familiarity with obtaining and utilizing arrest equipment. The objective of this initiative is to utilize unannounced, in situ, cardiac arrest simulations hospital wide to educate, evaluate, and maximize cardiac arrest teams outside the traditional simulation lab by systematically assessing and capturing areas of opportunity for improvement, latent safety threats (LSTs), and key challenges by hospital location. METHODS: Unannounced in situ simulations were performed at a city hospital with multidisciplinary cardiac arrest teams responding to a presumed real cardiac arrest. Participants and facilitators identified LSTs during standardized postsimulation debriefings that were classified into equipment, medication, resource/system, or technical skill categories. A hazard matrix was used by multiplying occurrence frequency of LST in simulation and real clinical events (based on expert opinion) and severity of the LST based on agreement between two evaluators. RESULTS: Seventy-four in situ cardiac arrest simulations were conducted hospital wide. Hundreds of safety threats were identified, analyzed, and categorized yielding 106 unique latent safety threats: 21 in the equipment category, 8 in the medication category, 41 in the resource/system category, and 36 in the technical skill category. The team worked to mitigate all LSTs with priority mitigation to imminent risk level threats, then high risk threats, followed by non-imminent risk LSTs. Four LSTs were deemed imminent, requiring immediate remediation post debriefing. Fifteen LSTs had a hazard ratio greater than 8 which were deemed high risk for remediation. Depending on the category of threat, a combination of mitigating steps including the immediate fixing of an identified problem, leadership escalation, and programmatic intervention recommendations occurred resulting in mitigation of all identified threats. CONCLUSIONS: Hospital-wide in situ cardiac arrest team simulation offers an effective way to both identify and mitigate LSTs. Safety during cardiac arrest care is improved through the use of a system in which LSTs are escalated urgently, mitigated, and conveyed back to participants to provide closed loop debriefing. Lastly, this hospital-wide, multidisciplinary initiative additionally served as an educational needs assessment allowing for informed, iterative education and systems improvement initiatives targeted to areas of LSTs and areas of opportunity.

Accreditation of Simulation Fellowships and Training Programs: More Checkboxes or Elevating the Field?

SUMMARY STATEMENT: As the field of healthcare simulation matures, formal accreditation for simulation fellowships and training programs has become increasingly available and touted as a solution to standardize the education of those specializing in healthcare simulation. Some simulation experts hold opposing views regarding the potential value of simulation fellowship program accreditation. We report on the proceedings of a spirited debate at the 20th International Meeting on Simulation in Healthcare in January 2020. Pro arguments view accreditation as the logical evolution of a maturing profession: improving training quality through standard setting, providing external validation for individual programs, and enhancing the program's return on investment. Con arguments view accreditation as an incompletely formulated construct; burdensome to the "financially strapped" fellowship director, misaligned with simulation fellows' needs and expectations, and confusing to administrators mistakenly equating accreditation with credentialing. In addition, opponents of accreditation postulate that incorporating curricular standards, practice guidelines, and strategies derived and implemented without rigor, supporting evidence and universal consensus is premature. This narrative review of our debate compares and contrasts contemporary perspectives on simulation fellowship program accreditation, concluding with formal recommendations for learners, administrators, sponsors, and accrediting bodies.

Optimising expert dyad performance in acute care settings: a scoping review protocol.

INTRODUCTION: When there is miscommunication and poor coordination between experienced clinician dyads, teamwork suffers. Research on expert learning practices for the smallest team, and arguably the most important team, the healthcare dyad, is limited. The objective of this study is to map the extent and range of evidence available on learning practices which experienced dyads use, to achieve excellent performance, and to identify the gaps in effective practice. This will guide future research, policy and practice. METHODS AND ANALYSIS: We are using the JBI methodology for scoping reviews and the Preferred Reporting Items for Systematic Reviews and Meta-analyses extension for Scoping Reviews Extension Fillable Checklist, searching for literature that meets the inclusion criteria. The searches will be conducted using Maastricht University's Libsearch, which includes MEDLINE, Education Resources Information Center and PsycINFO and a second search on Web of Science online databases. We will search grey literature and references of selected sources. Search limits include sources from 2016 to 2021, using English language only. A data extraction tool was developed, and charting will use a thematic analysis approach. IMPLICATIONS AND DISSEMINATION: This review will be the first to examine the learning practices that experienced dyads use, which ensures excellent performance in acute care settings. The findings will be used to develop best-practices and shared with New York City hospital system. Dissemination will occur through peer-reviewed publications and at healthcare conferences.

Fundamental underpinnings of simulation education: describing a four-component instructional design approach to healthcare simulation fellowships.

Although in 2020, there are more than 120 healthcare simulation fellowships established globally, there is a paucity of literature on how to design fellowship programs most effectively, to equip graduates with the knowledge, skills, and attitudes of a competent simulation educator. Offering a systematic structure to approach simulation fellowship programmatic design may aid in better achieving program goals. In this manuscript, we present the application of the 4-component instructional design model as a blueprint to the development of Simulation Education Fellowships. We offer examples used at the NYC Health + Hospitals simulation fellowship to illustrate how the 4-component model informs fellowship program design which promotes the development of a simulation educator. This manuscript will provide a roadmap to designing curricula and assessment practices including self-reflective logbooks to focus the path toward achieving desired skills and shape future conversations around programmatic development.

Debrief it all: a tool for inclusion of Safety-II.

Safety science in healthcare has historically focused primarily on reducing risk and minimizing harm by learning everything possible from when things go wrong (Safety-I). Safety-II encourages the study of all events, including the routine and mundane, not only bad outcomes. While debriefing and learning from positive events is not uncommon or new to simulation, many common debriefing strategies are more focused on Safety-I. The lack of inclusion of Safety-II misses out on the powerful analysis of everyday work.A debriefing tool highlighting Safety-II concepts was developed through expert consensus and piloting and is offered as a guide to encourage and facilitate inclusion of Safety-II analysis into debriefings. It allows for debriefing expansion from the focus on error analysis and "what went wrong" or "could have gone better" to now also capture valuable discussion of high yield Safety-II concepts such as capacities, adjustments, variation, and adaptation for successful operations in a complex system. Additionally, debriefing inclusive of Safety-II fosters increased debriefing overall by encouraging debriefing when "things go right", not historically what is most commonly debriefed.

Early lessons learnt using simulation to rapidly deploy a trained observer programme during the COVID-19 pandemic in New York City.

New York City became one of the epicentres of the COVID-19 pandemic in 2020. Simulation was used to establish the COVID-19 trained observer programme to mitigate healthcare workers' infection risk during patient care. The members of the trained observer group consisted of 32 staff members. At the start of the training programme, they were provided donning and doffing guides with a step-by-step description of personal protective equipment (PPE) usage, followed by in-situ PPE simulation training. Later on, as PPE protocols evolved, additional educational modalities were used and included training videos, picture demonstrations of common PPE mistakes and repeated in-situ simulations. The early lessons which emerged from using simulation to train observers during the COVID-19 pandemic were the following: address PPE shortages during presimulation planning, prepare to perform updates for trained observers and use multiple educational modalities to train observers. Adequate amounts of PPE should be available to train observers. Repeated simulations are necessary to update observers on PPE protocols. Multiple learning modalities should educate the trained observers and equip them for their role in COVID-19 units.

Managing psychological safety in debriefings: a dynamic balancing act.

Debriefings should promote reflection and help learners make sense of events. Threats to psychological safety can undermine reflective learning conversations and may inhibit transfer of key lessons from simulated cases to the general patient care context. Therefore, effective debriefings require high degrees of psychological safety-the perception that it is safe to take interpersonal risks and that one will not be embarrassed, rejected or otherwise punished for speaking their mind, not knowing or asking questions. The role of introductions, learning contracts and prebriefing in establishing psychological safety is well described in the literature. How to maintain psychological safety, while also being able to identify and restore psychological safety during debriefings, is less well understood. This review has several aims. First, we provide a detailed definition of psychological safety and justify its importance for debriefings. Second, we recommend specific strategies debriefers can use throughout the debriefing to build and maintain psychological safety. We base these recommendations on a literature review and on our own experiences as simulation educators. Third, we examine how debriefers might actively address perceived breaches to restore psychological safety. Re-establishing psychological safety after temporary threats or breaches can seem particularly daunting. To demystify this process, we invoke the metaphor of a 'safe container' for learning; a space where learners can feel secure enough to work at the edge of expertise without threat of humiliation. We conclude with a discussion of limitations and implications, particularly with respect to faculty development.

A Conceptual Framework for the Development of Debriefing Skills: A Journey of Discovery, Growth, and Maturity.

STATEMENT: Despite the critical importance of debriefing in simulation-based education, existing literature offers little guidance on how debriefing skills develop over time. An elaboration of the trajectory through which debriefing expertise evolves would help inform educators looking to enhance their skills. In this article, we present a new conceptual framework for the development of debriefing skills based on a modification of Dreyfus and Dreyfus' model of skill development. For each of the 3 stages of debriefing skill development-discovery, growth, and maturity, we highlight characteristics of debriefers, requisite knowledge, and key skills. We propose how faculty development experiences map to each stage of debriefing skill development. We hope the new conceptual framework will advance the art and science of debriefing by shaping future faculty development initiatives, research, and innovation in debriefing.

Simulation Fellowships: Survey of Current Summative Assessment Practices.

INTRODUCTION: The simulation fellowship training community has commenced efforts toward the development of core curricular elements for healthcare simulation fellowships but has not deployed the same effort to create evaluation strategies to monitor fellows' progress. The authors present a current view of simulation fellowship assessment strategies, their relative validity evidence using Kane's theoretical framework, and consider new approaches for defining expertise after training. METHODS: Fellowship directors in North America were surveyed to identify what competencies are being used by the simulation fellowship community to monitor fellows' progress. A follow-up survey was sent to further clarify which tools with published validity evidence were being applied by current programs. RESULTS: Of the 61 programs contacted, 44 (72.1%) responded and completed the first survey. Of the 44 programs, 32 (72.7%) reported using some formal assessment of their fellows. The most commonly assessed skill was debriefing. Twenty-three (37.7%) of the 61 programs contacted responded to the secondary survey. These reported that the most common published tool used was the Debriefing Assessment for Simulation in Healthcare, with only a few other tools mentioned. CONCLUSIONS: There is a paucity of tools with published validity evidence being used to monitor a fellow's progression. The authors agree that further research needs to focus on creating validated assessment tools to assist in refining fellowship training.

Evaluation of cognitive load and emotional states during multidisciplinary critical care simulation sessions.

BACKGROUND: The simulation in critical care setting involves a heterogeneous group of participants with varied background and experience. Measuring the impacts of simulation on emotional state and cognitive load in this setting is not often performed. The feasibility of such measurement in the critical care setting needs further exploration. METHODS: Medical and nursing staff with varying levels of experience from a tertiary intensive care unit participated in a standardised clinical simulation scenario. The emotional state of each participant was assessed before and after completion of the scenario using a validated eight-item scale containing bipolar oppositional descriptors of emotion. The cognitive load of each participant was assessed after the completion of the scenario using a validated subjective rating tool. RESULTS: A total of 103 medical and nursing staff participated in the study. The participants felt more relaxed (-0.28±1.15 vs 0.14±1, P<0.005; d=0.39), excited (0.25±0.89 vs 0.55±0.92, P<0.005, d=0.35) and alert (0.85±0.87 vs 1.28±0.73, P<0.00001, d=0.54) following simulation. There was no difference in the mean scores for the remaining five items. The mean cognitive load for all participants was 6.67±1.41. There was no significant difference in the cognitive loads among medical staff versus nursing staff (6.61±2.3 vs 6.62±1.7; P>0.05). CONCLUSION: A well-designed complex high fidelity critical care simulation scenario can be evaluated to identify the relative cognitive load of the participants' experience and their emotional state. The movement of learners emotionally from a more negative state to a positive state suggests that simulation can be an effective tool for improved knowledge transfer and offers more opportunity for dynamic thinking.

"No-Go Considerations" for In Situ Simulation Safety.

STATEMENT: In situ simulation is the practice of simulation in the actual clinical environment and has demonstrated utility in the assessment of system processes, identification of latent safety threats, and improvement in teamwork and communication. Nonetheless, performing simulated events in a real patient care setting poses potential risks to patient and staff safety. One integral aspect of a comprehensive approach to ensure the safety of in situ simulation includes the identification and establishment of "no-go considerations," that is, key decision-making considerations under which in situ simulations should be canceled, postponed, moved to another area, or rescheduled. These considerations should be modified and adjusted to specific clinical units. This article provides a framework of key essentials in developing no-go considerations.

Cognitive Load Theory for debriefing simulations: implications for faculty development.

The debriefing is an essential component of simulation-based training for healthcare professionals, but learning this complex skill can be challenging for simulation faculty. There are multiple competing priorities for a debriefer's attention that can contribute to a high mental workload, which may adversely affect debriefer performance and consequently learner outcomes. In this paper, we conceptualize the debriefer as a learner of debriefing skills and we discuss Cognitive Load Theory to categorize the many potential mental loads that can affect the faculty debriefer as learner. We then discuss mitigation strategies that can be considered by faculty development programmes to enhance professional development of debriefing staff.

Working memory is limited: improving knowledge transfer by optimising simulation through cognitive load theory.

This analysis explores how to optimise knowledge transfer in healthcare simulation by applying cognitive load theory to curriculum design and delivery for both novice and expert learners. This is particularly relevant for interprofessional learning which is team-based, as each participant comes to the simulation experience with different levels of expertise. Healthcare simulation can offer opportunities to create complex and dynamic experiences that replicate real clinical situations. Understanding Cognitive Load Theory can foster the acquisition of complex knowledge, skills and abilities required to deliver excellence in patient care without overwhelming a learner's ability to handle new materials due to working memory limitations. The 2 aspects of working memory that will be explored in this paper are intrinsic load and extrinsic load. These will be addressed in terms of the learner's level of expertise and how to consider these elements to enhance the learning environment in simulation scenario development and delivery. By applying the concepts of Cognitive Load Theory, this paper offers educators a method to tailor their curricula to navigate working memory and optimise the opportunity for knowledge transfer.

Social pairing and female mating fidelity predicted by restriction fragment length polymorphism similarity at the major histocompatibility complex in a songbird.

Female birds often copulate outside the pair-bond to produce broods of mixed paternity, but despite much recent attention the adaptive significance of this behaviour remains elusive. Although several studies support the idea that extra-pair copulations (EPCs) allow females to obtain 'good genes' for their offspring, many others have found no relationship between female mating fidelity and traits likely to reflect male quality. A corollary to the good genes hypothesis proposes that females do use EPCs to increase the quality of young, but it is the interaction between maternal and paternal genomes - and not male quality per se - that is the target of female choice. We tested this 'genetic compatibility' hypothesis in a free-living population of Savannah sparrows (Passerculus sandwichensis) by determining whether females mated nonrandomly with respect to the major histocompatibility complex (Mhc). During both the 1994 and 1995 breeding seasons, female yearlings (but not older birds) avoided pairing with Mhc-similar males (P < 0.005). The Mhc similarity between mates also predicted the occurrence of extra-pair young in first broods (P < 0.007) and covaried with estimates of genome-wide levels of similarity derived from multilocus DNA fingerprinting profiles (P = 0.007). The overall genetic similarity between adults tended to predict female mating fidelity, but with less precision than their Mhc similarity (P = 0.09). In contrast, females appeared insensitive to the size, weight or age of males, none of which explained variation in female mating fidelity. Taken together, these results are consistent with the hypothesis that females sought complementary genes for their offspring and suggest either that the benefits of heterozygosity (at the Mhc) drive female mating patterns or that the avoidance of inbreeding is an ultimate cause of social and genetic mate choice in Savannah sparrows.