Development and Evaluation of a Rural Longitudinal NRP® Telesimulation Program (MOOSE: Maine Ongoing Outreach Simulation Education).

OBJECTIVES: Neonatal resuscitation is a high acuity, low-occurrence (HALO) event and many rural pediatricians report feeling underprepared for these events. We piloted a longitudinal telesimulation (TS) program with a rural hospital's interprofessional delivery room teams aimed at improving adherence to Neonatal Resuscitation Program (NRP®) guidelines and teamwork. STUDY DESIGN: A TS study was conducted monthly in one rural hospital over a ten month period from November 2020 to August 2021. TS sessions were remotely viewed and debriefed by experts. Sessions were video recorded and assessed using a scoring tool with validity evidence for NRP® adherence. Teamwork was assessed using both TeamSTEPPS 2.0 Team Performance Observation Tool and Mayo High-Performance Teamwork Scale. RESULTS: We conducted ten TS sessions in one rural hospital. There were 24 total participants, who rotated through monthly sessions, ensuring interdisciplinary team composition was reflective of realistic staffing. NRP® adherence rate for full code scenarios improved from a baseline of 39% to 95%. Compared with baseline data for efficiency, multiple NRP® skills improved (e.g. cardiac lead placement occurred 12x faster). Teamwork scores showed improvement in all domains. CONCLUSIONS: Our results demonstrate that a TS program aimed at improving NRP® and team performance is possible to implement in a rural setting. Our pilot study showed a trend towards improved NRP® adherence, increased skill efficiency, and higher quality teamwork and communication in one rural hospital. Additional research is needed to analyze program efficacy on a larger scale and to understand the impact of training on patient outcomes.

Factors associated with interprofessional engagement in debriefing following pediatric simulation-based team training.

Simulation offers a high fidelity modality to deliver and study team-based interprofessional education. Debriefing the following simulated scenarios is a critical component of this training. Little data exist to inform best practices to optimize interprofessional engagement during debriefing. This pilot study analyzed interprofessional debriefing events following 20 pediatric simulation-based team trainings to identify associations between modifiable factors and learner engagement. Reviewers observed a total of 236 learners, using a previously published tool to assess learner engagement. Data related to the scenario, debriefing, learners, and facilitators were collected. Spearman's correlation was used to analyze the association between factors of interest and average learner engagement scores for each debriefing event. Mean engagement did not differ between physicians and nurses, but was lower for other professionals. Average learner engagement was inversely related to learner group size, but not to the proportion of learners in each profession. Oral participation differed significantly between professions for both learners and co-facilitators, with physicians speaking more in both groups. Students of all professions had lower engagement and spoke less frequently. This study identifies several modifiable factors, including total group size, learner level, and facilitator behavior that were associated with interprofessional engagement during debriefing following simulation-based team training.

Development and Implementation of a Pediatric Telesimulation Intervention for Nurses in Community Emergency Departments.

The need for virtual education for nursing staff has dramatically increased because of social distancing measures after the coronavirus disease pandemic. Emergency departments in particular need to educate staff on caring for patients with coronavirus disease while concurrently continuing to ensure education related to core topic areas such as pediatric assessment and stabilization. Unfortunately, many nurse educators are currently unable to provide traditional in-person education and training to their nursing staff. Our inter-professional team aimed to address this through the rapid development and implementation of an emergency nursing telesimulation curriculum. This curriculum focused on the nursing assessment and initial stabilization of a child presenting to the emergency department in status epilepticus. This article describes the rapid development and implementation of a pediatric emergency nursing telesimulation. Our objectives in this article are (1) to describe the rapid creation of this curriculum using Kern's framework, (2) to describe the implementation of a fully online simulation-based pediatric emergency training intervention for nurse learners, and (3) to report learners' satisfaction with and feedback on this intervention.

Assessing Team Performance in a Longitudinal Neonatal Resuscitation Simulation Training Program: Comparing Validity Evidence to Select the Best Tool.

Introduction Neonatal resuscitation is a high-acuity, low-occurrence event that requires ongoing practice by interprofessional teams to maintain proficiency. Simulation provides an ideal platform for team training and evaluation of team performance. Our simulation center supports a longitudinal in situ simulation training program for delivery room teams. In addition to adherence to the Neonatal Resuscitation Program standards, team performance assessment is an essential component of program evaluation and participant feedback. Multiple published teamwork assessment tools exist. Our objective was to select the tool with the best validity evidence for our program's needs. Methods We used Messick's framework to assess the validity of evidence for potential teamwork assessment tools. Four possible tools were identified from the literature: the Mayo High Performance Teamwork Scale (Mayo), Team Performance Observation Tool (TPOT), Clinical Teamwork Scale (CTS), and Team Emergency Assessment Measure (TEAM). Relevant context included team versus individual focus, external evaluator versus self-evaluation, and ease of use (which included efficiency, clarity of interpretation, and overall assessment). Three simulation experts identified consensus anchors for each tool and independently reviewed and scored 10 pre-recorded neonatal resuscitation simulations. Raters assigned each tool a rating according to efficiency, ease of interpretation, and completeness of teamwork assessment. Interrater reliability (IRR) was calculated using intraclass correlation for each tool across the three raters. Average team performance scores for each tool were correlated with neonatal resuscitation adherence scores for each video using Spearman's rank coefficient. Results There was a range of IRR between the tools, with Mayo having the best (single 0.55 and multi 0.78). Each of the three raters ranked Mayo optimally in terms of efficiency (mean 4.66 + 0.577) and ease of use (4+1). However, TPOT and CTS scored highest (mean 4.66 ± 0.577) for overall completeness of teamwork assessment. There was no significant correlation to NRP adherence scores for any teamwork tool. Conclusion Of the four tools assessed, Mayo demonstrated moderate IRR and scored highest for its ease of use and efficiency, though not completeness of assessment. The remaining three tools had poor IRR, which is not an uncommon problem with teamwork assessment tools. Our process emphasizes the fact that assessment tool validity is contextual. Factors such as a relatively narrow (and high) performance distribution and clinical context may have contributed to reliability challenges for tools that offered a more complete teamwork assessment.

Engagement Across Professions: A Mixed Methods Study of Debriefing After Interprofessional Team Training.

INTRODUCTION: Simulation is an ideal tool for interprofessional (IP) team training. Debriefing after simulation is key to IP learning, although engagement and participation may be adversely influenced by cultural and hierarchical barriers. This mixed-methods study explored factors influencing learner engagement and participation in IP debriefing and the experience of "silent but apparently engaged" participants. METHODS: Semistructured profession-specific focus groups were conducted with participants from a weekly IP pediatric simulation program. Focus groups were recorded, transcribed, and thematically analyzed. Eligible participants were assigned to "silent" or "verbal" groups according to observed behavior and received a questionnaire. Participants' self-rated engagement scores were compared using a t test. RESULTS: Thirty-six of 81 eligible participants were included, 13 completed a questionnaire, and 23 (8 physicians, 10 nursing staff, 4 pharmacists, 1 respiratory therapist) participated in 13 focus groups. Twenty-two subthemes were grouped into 6 themes: psychological safety, realism, distractors, stress, group characteristics, and facilitator behavior, with differences in perspective according to profession. Of the 36 respondents, 18 were "silent" and 18 "verbal." Self-rated engagement scores differed between groups (3.65 vs. 4.17, P = 0.06); however, "silent" participants described themselves as engaged. CONCLUSIONS: Themes identified that influenced learner engagement in debriefing included aspects of prebriefing and the simulation. Some aligned with general simulation best practices, such as psychological safety, prebriefing, and facilitator behavior. Findings unique to IP simulation included importance of realism to nonphysician professions, protecting time for training, group composition, and direct probing by cofacilitators to decrease physician bias and emphasize IP contributions. Silent participants reported engagement.

Simulation-Based Outreach Program Improves Rural Hospitals' Team Confidence in Neonatal Resuscitation.

INTRODUCTION: Neonatal resuscitation is a high acuity, low occurrence event (HALO), and in rural community hospitals, low birth rates prevent providers from regular opportunities to maintain essential resuscitation skills. Simulation is an effective training modality for medical education, although resources for simulation are often limited in rural hospitals. Our primary objective was to test the hypothesis that in situ neonatal resuscitation simulation training improves rural hospitals' delivery room team confidence in performing key Neonatal Resuscitation Program® (NRP®) skills. Our secondary objective was to compare confidence to performance as measured by adherence to NRP® guidelines. METHODS: We conducted a quasi-experimental pre-training survey and post-training survey of delivery room team confidence in NRP® skills at five level one delivery hospitals before and after an in situ simulation training program. Participants included rural hospitals' usual delivery room team members. Participants rated their confidence on a five-point Likert scale. Simulations were analyzed using an adapted version of a validated scoring tool for NRP® adherence and presented as overall percentage scores. RESULTS: Our data demonstrate a significant improvement in self-assessed confidence levels pre- and post-simulation training in key areas of neonatal resuscitation. Participants reported higher confidence in airway management (4 vs. 3, p=0.003), emergency intravenous access (3 vs. 2, p=0.007), and the ability to manage a code in the delivery room (4 vs. 3, p=0.013) and the operating room (4 vs. 3, p=0.028). Improvements were also noted in their team member's knowledge and skills to perform neonatal resuscitation. While improvements were appreciated in confidence, the performance of skills (NRP® adherence scores) was often in the sub-optimal performance range. CONCLUSIONS: An in situ-based neonatal resuscitation outreach simulation program improves self-confidence among rural delivery room teams. Additional research is needed to understand how to translate improved confidence into actual improved performance.

A Simulation Systems Testing Program Using HFMEA Methodology Can Effectively Identify and Mitigate Latent Safety Threats for a New On-Site Helipad.

BACKGROUND: Fundamental changes in critical systems within hospitals present safety risks. Some threats can be identified prospectively, others are only uncovered when the system goes live. Simulation and Healthcare Failure Mode and Effect Analysis (HFMEA) can be used together to prospectively test a system without endangering patients. The research team combined iterative simulations and HFMEA methodologies to conduct simulation-based clinical systems testing (SbCST) to detect and mitigate latent safety threats (LSTs) prior to opening a hospital helipad. METHODS: This study was conducted in three phases. In Phase I, an interprofessional team created a process map and conducted a tabletop exercise, identifying LSTs that could theoretically occur during patient transfer from the new helipad. Using HFMEA methodology, steps predicted to be affected by the new helipad were probed. Identified LSTs were assigned a hazard score. Mitigation solutions were proposed. Results from Phase I were used to plan Phase II, which used low-fidelity simulation to test communication processes and travel paths. High-fidelity simulation was used in Phase III to test previously identified LSTs. RESULTS: Over three testing phases, 31 LSTs were identified: 15 in Phase I, 7 in Phase II, and 9 in Phase III. LSTs fell under the categories of care coordination, facilities, and equipment, and devices. Eighteen (58.1%) were designated "critical" (hazard score ≥ 8). CONCLUSION: A three-phase SbCST program using HFMEA methodology was an effective tool to identify LSTs. An iterative approach, using results of each phase to inform the structure of the next, facilitated testing of proposed mitigation strategies.

Can hospital adult code-teams and individual members perform high-quality CPR? A multicenter simulation-based study incorporating an educational intervention with CPR feedback.

AIMS: A multicenter simulation-based research study to assess the ability of interprofessional code-teams and individual members to perform high-quality CPR (HQ-CPR) at baseline and following an educational intervention with a CPR feedback device. METHODS: Five centers recruited ten interprofessional teams of AHA-certified adult code-team members with a goal of 200 participants. Baseline testing of chest compression (CC) quality was measured for all individuals. Teams participated in a baseline simulated cardiac arrest (SCA) where CC quality, chest compression fraction (CCF), and peri-shock pauses were recorded. Teams participated in a standardized HQ-CPR and abbreviated TeamSTEPPS® didactic, then engaged in deliberate practice with a CPR feedback device. Individuals were assessed to determine if they could achieve ≥80% combined rate and depth within 2020 AHA guidelines. Teams completed a second SCA and CPR metrics were recorded. Feedback was disabled for assessments except at one site where real-time CPR feedback was the institutional standard. Linear regression models were used to test for site effect and paired t-tests to evaluate significant score changes. Logistic univariate regression models were used to explore characteristics associated with the individual achieving competency. RESULTS: Data from 184 individuals and 45 teams were analyzed. Baseline HQ-CPR mean score across all sites was 18.5% for individuals and 13.8% for teams. Post-intervention HQ-CPR mean score was 59.8% for individuals and 37.0% for teams. There was a statistically significant improvement in HQ-CPR mean scores of 41.3% (36.1, 46.5) for individuals and 23.2% (17.1, 29.3) for teams (p < 0.0001). CCF increased at 3 out of 5 sites and there was a mean 5-s reduction in peri-shock pauses (p < 0.0001). Characteristics with a statistically significant association were height (p = 0.01) and number of times performed CPR (p = 0.01). CONCLUSION: Code-teams and individuals struggle to perform HQ-CPR but show improvement after deliberate practice with feedback as part of an educational intervention. Only one site that incorporated real-time CPR feedback devices routinely achieved ≥80% HQ-CPR.