A Comparison of Telesimulation Using the Virtual Resus Room and In Situ Simulation in Pediatric Emergency Medicine.

OBJECTIVES: During the COVID-19 pandemic, there was a marked shift toward telesimulation in medical education. Limited studies exist comparing the effectiveness of online and offline simulation education. The goals of this study are to evaluate active learners' perceived effectiveness of telesimulation versus in situ simulation and to identify potential shortcomings of existing online teaching platforms. METHODS: Through participant evaluations after a simulation, we compared telesimulation using the Virtual Resus Room (VRR) to in situ simulation in the domains of (1) self-efficacy, (2) fidelity, (3) educational value, and (4) teaching quality. Study subjects included medical and pharmacy residents and medical students completing their pediatric emergency medicine rotation at two children's hospitals as well as nurses, nurse practitioners, and physician assistants who were recently hired and orienting to their new roles in the emergency department. Learners used a modified Michigan Standard Simulation Experience Scale to evaluate either a telesimulation or in situ simulation case. Survey responses were compared using Wilcoxon rank sum tests with Bonferroni correction for multiple comparisons. RESULTS: In overall assessment, in situ simulation was rated higher than telesimulation. There were significant differences noted related to perceived realism, utility in training device-related skills, and utility in training team-building skills. All P values were less than 0.0036. There were no significant differences between simulation types in perception of physical examination fidelity, instructor adequacy, or self-efficacy. CONCLUSIONS: Telesimulation using the VRR is comparable to in situ simulation in learners' perception of improvement in self-efficacy and of teaching quality for pediatric emergency medicine topics. However, participants felt less able to practice tactile and communication skills virtually. Further innovation is needed to improve learners' experience with fidelity and educational value.

Usability Testing Via Simulation: Optimizing the NEAR4PEM Preintubation Checklist With a Human Factors Approach.

OBJECTIVES: To inform development of a preintubation checklist for pediatric emergency departments via multicenter usability testing of a prototype checklist. METHODS: This was a prospective, mixed methods study across 7 sites in the National Emergency Airway Registry for Pediatric Emergency Medicine (NEAR4PEM) collaborative. Pediatric emergency medicine attending physicians and senior fellows at each site were first oriented to a checklist prototype, including content previously identified using a modified Delphi approach. Each site used the checklist in 2 simulated cases: an "easy airway" and a "difficult airway" scenario. Facilitators recorded verbalization, completion, and timing of checklist items. After each simulation, participants completed an anonymous usability survey. Structured debriefings were used to gather additional feedback on checklist usability. Comments from the surveys and debriefing were qualitatively analyzed using a framework approach. Responses informed human factors-based optimization of the checklist. RESULTS: Fifty-five pediatric emergency medicine physicians/fellows (4-13 per site) participated. Participants found the prototype checklist to be helpful, easy to use, clear, and of appropriate length. During the simulations, 93% of checklist items were verbalized and more than 80% were completed. Median time to checklist completion was 6.2 minutes (interquartile range, 4.8-7.1) for the first scenario and 4.2 minutes (interquartile range, 2.7-5.8) for the second. Survey and debriefing data identified the following strengths: facilitating a shared mental model, cognitively offloading the team leader, and prompting contingency planning. Suggestions for checklist improvement included clarifying specific items, providing more detailed prompts, and allowing institution-specific customization. Integration of these data with human factors heuristic inspection resulted in a final checklist. CONCLUSIONS: Simulation-based, human factors usability testing of the National Emergency Airway Registry for Pediatric Emergency Medicine Preintubation Checklist allowed optimization prior to clinical implementation. Next steps involve integration into real-world settings utilizing rigorous implementation science strategies, with concurrent evaluation of the impact on patient outcomes and safety.

Perspectives on preparedness for pediatric emergencies after residency: A needs assessment.

Background: General emergency physicians provide most pediatric emergency care in the United States yet report more challenges managing emergencies in children than adults. Recommendations for standardized pediatric emergency medicine (PEM) curricula to address educational gaps due to variations in pediatric exposure during emergency medicine (EM) training lack learner input. This study surveyed senior EM residents and recent graduates about their perceived preparedness to manage pediatric emergencies to better inform PEM curricula design. Methods: In 2021, senior EM residents and graduates from the classes of 2020 and 2019 across eight EM programs with PEM rotations at the same children's hospital were recruited and surveyed electronically to assess perceived preparedness for 42 pediatric emergencies and procedures by age: infants under 1 year, toddlers, and children over 4 years. Preparedness was reported on a 5-point Likert scale with 1 or 2 defined as "unprepared." A chi-square test of independence compared the proportion of respondents unprepared to manage each condition across age groups, and a p-value < 0.05 demonstrated significance. Results: The response rate was 53% (129/242), with a higher response rate from senior residents (65%). Respondents reported feeling unprepared to manage more emergency conditions in infants compared to other age groups. Respondents felt least prepared to manage inborn errors of metabolism and congenital heart disease, with 45%-68% unprepared for these conditions across ages. A heat map compared senior residents to recent graduates. More graduates reported feeling unprepared for major trauma, impending respiratory failure, and pediatric advanced life support algorithms. Conclusions: This study, describing the perspective of EM senior residents and recent graduates, offers unique insights into PEM curricular needs during EM training. Future PEM curricula should target infant complaints and conditions with lower preparedness scores across ages. Other centers training EM residents could use our findings and methods to bolster PEM curricula.

Factors Associated With Improved Pediatric Resuscitative Care in General Emergency Departments.

OBJECTIVES: To describe the quality of pediatric resuscitative care in general emergency departments (GEDs) and to determine hospital-level factors associated with higher quality. METHODS: Prospective observational study of resuscitative care provided to 3 in situ simulated patients (infant seizure, infant sepsis, and child cardiac arrest) by interprofessional GED teams. A composite quality score (CQS) was measured and the association of this score with modifiable and nonmodifiable hospital-level factors was explored. RESULTS: A median CQS of 62.8 of 100 (interquartile range 50.5-71.1) was noted for 287 resuscitation teams from 175 emergency departments. In the unadjusted analyses, a higher score was associated with the modifiable factor of an affiliation with a pediatric academic medical center (PAMC) and the nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. In the adjusted analyses, a higher CQS was associated with modifiable factors of an affiliation with a PAMC and the designation of both a nurse and physician pediatric emergency care coordinator, and nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. A weak correlation was noted between quality and pediatric readiness scores. CONCLUSIONS: A low quality of pediatric resuscitative care, measured using simulation, was noted across a cohort of GEDs. Hospital factors associated with higher quality included: an affiliation with a PAMC, designation of a pediatric emergency care coordinator, higher pediatric volume, and geographic location. A weak correlation was noted between quality and pediatric readiness scores.

Who Trains the Trainers?: Development of a Faculty Bootcamp for Pediatric Emergency Medicine Resuscitation Procedures.

OBJECTIVES: Attending physicians in pediatric emergency medicine (PEM) must be able to perform lifesaving procedures, yet guidelines for maintaining procedural competency do not exist. We implemented a biannual 2-hour "bootcamp" designed to help PEM faculty maintain procedural competency. METHODS: A survey-based needs assessment was used to create a set of goals and objectives for the session and determine which procedural skills to include. Sessions of 4 simulated skills were held twice a year and limited to 12 faculty. Post-bootcamp evaluations were administered at the 1-year and 6-year marks to evaluate the usefulness of the training. RESULTS: Twenty-eight of our 55 current faculty members (50%) responded to the 6-year follow-up evaluation. Overall, the bootcamp was felt to be beneficial, with 64% of faculty rating it "great" (5) or "highly useful" (6) on a 6-point Likert scale. The majority of participants also rated the airway, vascular access, and cardiopulmonary resuscitation/defibrillator training favorably. Faculty who later had the opportunity to perform specific resuscitation procedures clinically felt that the circulation (cardiopulmonary resuscitation/defibrillator) and airway stations contributed to the success of their procedure performance. CONCLUSIONS: The clinical setting alone may be insufficient in maintaining procedural competency in lifesaving skills in PEM. Giving faculty the opportunity to practice these skills is feasible and can be effective in increasing confidence. Future training sessions should aim toward practicing to a defined mastery level.

Augmented Reality in Pediatric Septic Shock Simulation: Randomized Controlled Feasibility Trial.

BACKGROUND: Septic shock is a low-frequency but high-stakes condition in children requiring prompt resuscitation, which makes it an important target for simulation-based education. OBJECTIVE: In this study, we aimed to design and implement an augmented reality app (PediSepsisAR) for septic shock simulation, test the feasibility of measuring the timing and volume of fluid administration during septic shock simulation with and without PediSepsisAR, and describe PediSepsisAR as an educational tool. We hypothesized that we could feasibly measure our desired data during the simulation in 90% of the participants in each group. With regard to using PediSepsisAR as an educational tool, we hypothesized that the PediSepsisAR group would report that it enhanced their awareness of simulated patient blood flow and would more rapidly verbalize recognition of abnormal patient status and desired management steps. METHODS: We performed a randomized controlled feasibility trial with a convenience sample of pediatric care providers at a large tertiary care pediatric center. Participants completed a prestudy questionnaire and were randomized to either the PediSepsisAR or control (traditional simulation) arms. We measured the participants' time to administer 20, 40, and 60 cc/kg of intravenous fluids during a septic shock simulation using each modality. In addition, facilitators timed how long participants took to verbalize they had recognized tachycardia, hypotension, or septic shock and desired to initiate the sepsis pathway and administer antibiotics. Participants in the PediSepsisAR arm completed a poststudy questionnaire. We analyzed data using descriptive statistics and a Wilcoxon rank-sum test to compare the median time with event variables between groups. RESULTS: We enrolled 50 participants (n=25 in each arm). The timing and volume of fluid administration were captured in all the participants in each group. There was no statistically significant difference regarding time to administration of intravenous fluids between the two groups. Similarly, there was no statistically significant difference between the groups regarding time to verbalized recognition of patient status or desired management steps. Most participants in the PediSepsisAR group reported that PediSepsisAR enhanced their awareness of the patient's perfusion. CONCLUSIONS: We developed an augmented reality app for use in pediatric septic shock simulations and demonstrated the feasibility of measuring the volume and timing of fluid administration during simulation using this modality. In addition, our findings suggest that PediSepsisAR may enhance participants' awareness of abnormal perfusion.

Preparedness for Pediatric Office Emergencies: A Multicenter, Simulation-Based Study.

OBJECTIVES: Pediatric emergencies can occur in pediatric primary care offices. However, few studies have measured emergency preparedness, or the processes of emergency care, provided in the pediatric office setting. In this study, we aimed to measure emergency preparedness and care in a national cohort of pediatric offices. METHODS: This was a multicenter study conducted over 15 months. Emergency preparedness scores were calculated as a percentage adherence to 2 checklists on the basis of the American Academy of Pediatrics guidelines (essential equipment and supplies and policies and protocols checklists). To measure the quality of emergency care, we recruited office teams for simulation sessions consisting of 2 patients: a child with respiratory distress and a child with a seizure. An unweighted percentage of adherence to checklists for each case was calculated. RESULTS: Forty-eight teams from 42 offices across 9 states participated. The mean emergency preparedness score was 74.7% (SD: 12.9). The mean essential equipment and supplies subscore was 82.2% (SD: 15.1), and the mean policies and protocols subscore was 57.1% (SD: 25.6). Multivariable analyses revealed that independent practices and smaller total staff size were associated with lower preparedness. The median asthma case performance score was 63.6% (interquartile range: 43.2-81.2), whereas the median seizure case score was 69.2% (interquartile range: 46.2-80.8). Offices that had a standardized process of contacting emergency medical services (EMS) had a higher rate of activating EMS during the simulations. CONCLUSIONS: Pediatric office preparedness remains suboptimal in a multicenter cohort, especially in smaller, independent practices. Academic and community partnerships using simulation can help address gaps and implement important processes like contacting EMS.

How to Use TeleSimBox "Off the Shelf" to Connect Remote Content Experts With In-Person Simulation Participants.

In this technical report, we describe how to use TeleSimBox to run a remotely facilitated simulation to connect the facilitator with learners at a distant site. This method was developed to comply with safety measures imposed during the coronavirus disease-19 (COVID-19) pandemic to reduce the risk of viral exposure and transmission. Here, we present one example where a telesimulation naïve facilitator was trained as an in-person facilitator to enable the in-situ medical student and resident learners to participate in a pediatric emergency simulation exercise remotely guided by an off-site content expert. The case of neonatal shock was run five times during a half-day emergency department (ED) educational program with one to four participants per session. 14/15 (93%) participants completed evaluations and felt that the simulation met the case learning objectives and that connecting with the remote facilitator was useful for their learning. Feedback from the one newly trained in-person facilitator was that the tool was easy to learn how to use quickly, and the process of connecting with a remote expert was worthwhile for learners. To grab this web-based toolkit off the proverbial shelf and successfully run a telesimulation session from start to finish took approximately one hour; 20 minutes were spent in preparation the day prior and 40 minutes to set up and run the simulations the day of. We believe that this is a low-cost, efficient, and perceived to be an effective method to connect remotely located content experts and learners to engage in a simulation-based education activity when access to in-person resources and personnel is limited.

Operations and outcomes of a Hospital-wide Emergency Airway Response Team (HEART) in a quaternary academic children's hospital.

BACKGROUND: To improve pediatric airway management outside of the operating room, a Hospital-wide Emergency Airway Response Team (HEART) program composed of anesthesiology, otorhinolaryngology, and respiratory therapy clinicians was developed. AIMS: To report processes and outcomes of HEART activations in a quaternary academic children's hospital. METHODS: A retrospective observational cohort study between January 2017 and December 2019. Local airway emergency database was reviewed for HEART activations. Additional safety data was obtained from patients' electronic health records. PRIMARY OUTCOME: Adverse airway outcomes, either adverse tracheal intubation-associated events or oxygen desaturation (SpO2 <80%). We compared airway management by primary teams before HEART arrival and by HEART after arrival. RESULTS: Of 96 HEART activations, 36 were from neonatal intensive care unit, 35 from pediatric and cardiac intensive care units, 14 from emergency department, and 11 from inpatient wards. 56 (62%) children had airway anomalies and 41/96 (43%) were invasively ventilated. Median HEART arrival time was 5 min (interquartile range, 3-5). 56/96 (58%) required insertion of an advanced airway (supra/extra-glottic airway, endotracheal tube, tracheostomy tube). HEART succeeded in establishing a definitive airway in 53/56 (94%). Adverse airway outcomes were more common before (56/96, 58%) versus after HEART arrival (28/96, 29%; absolute risk difference 29%; 95% confidence interval 16, 41%; p < .001). Oxygen desaturation occurred more frequently before (46/96, 48%) versus after HEART arrival (24/96, 25%; absolute risk difference 23%; 95% confidence interval 11, 35%; p = .02). Cardiac arrests were more common before (9/96, 9%) versus after HEART arrival (3/96, 3%). Multiple (≥3) intubation attempts were more frequent before (14/42, 33%) versus after HEART arrival (9/46, 20%; absolute risk difference -14%; 95% confidence interval -32, 5%; p = .15). CONCLUSIONS: A multidisciplinary emergency airway response team plays an important role in pediatric airway management outside of the operating room. Adverse airway outcomes were more frequent before compared to after HEART arrival.

Simulation as a Dynamic Tool to Reorganize Pediatric Emergency Department Resuscitation During the Coronavirus Disease 2019 Pandemic and Beyond.

BACKGROUND: The coronavirus disease 2019 pandemic has challenged hospitals and pediatric emergency department (PED) providers to rapidly adjust numerous facets of the care of critically ill or injured children to minimize health care worker (HCW) exposure to severe acute respiratory syndrome coronavirus 2. OBJECTIVE: We aimed to iteratively devise protocols and processes that minimized HCW exposure while safely and effectively caring for children who may require unanticipated aerosol-generating procedures. METHODS: As part of our PED's initiative to optimize clinical care and HCW safety during the coronavirus disease 2019 pandemic, regular multidisciplinary systems and process simulation sessions were conducted. These sessions allowed us to evaluate and reorganize patient flow, test and improve communication modalities, alter the process for consultation in resuscitations, and teach and reinforce the appropriate donning and use of personal protective equipment. RESULTS: Simulation was a highly effective method to disseminate new practices to PED staff. Numerous workflow modifications were implemented as a result of our in situ systems and process simulations. Total number of persons in the resuscitation room was minimized, use of a "command post" with remote providers was initiated, communication devices and strategies were trialed and adopted, and personal protective equipment standards that optimized HCW safety and communication were enacted. CONCLUSIONS: Simulation can be an effective and agile tool in restructuring patient workflow and care of the most critically ill or injured patients in a PED during a novel pandemic.