The Impact of a Multifaceted Simulation Education and Feedback Program for Community Emergency Departments on Pediatric Diabetic Ketoacidosis Management.

OBJECTIVES: We sought to determine if general emergency departments (GEDs) were managing pediatric diabetic ketoacidosis (DKA) correctly and if management could be improved using a multilayered educational initiative. We hypothesized that a multifaceted program of in situ simulation education and formal feedback on actual patient management would improve community GED management of pediatric DKA. METHODS: This study combined a prospective simulation-based performance evaluation and a retrospective chart review. A community outreach simulation education initiative was developed followed by a formal patient feedback process. RESULTS: Fifteen hospitals participated in simulation sessions and the feedback process. All hospitals were scored for readiness to provide care for critically ill pediatric patients using the Emergency Medical Services for Children (EMSC) Pediatric Readiness Assessment. Six of the 15 have had a second hospital visit that included a DKA scenario with an average performance score of 60.3%. A total of 158 pediatric patients with DKA were included in the chart review. The GEDs with higher patient volumes provided best practice DKA management more often (63%) than those with lower patient volumes (40%). Participating in a DKA simulated scenario showed a trend toward improved care, with 47.2% before participation and 68.2% after participation ( P = 0.091). Participating in the formal feedback process improved best practice management provided to 68.6%. Best practice management was further improved to 70.3% if the GED participated in both a DKA simulation and the feedback process ( P = 0.04). CONCLUSIONS: A multifaceted program of in situ simulation education and formal feedback on patient management can improve community GED management of pediatric patients with DKA.

Evaluation of Pediatric Readiness Using Simulation in General Emergency Departments in a Medically Underserved Region.

BACKGROUND: Regionalization of pediatric care in the United States was developed to improve care by directing patients to hospitals with optimal pediatric resources and experience, leading to less pediatric-trained providers in medically underserved areas. Children with emergencies, however, continue to present to local general emergency departments (GEDs), where pediatric emergencies are low-frequency, high-risk events. OBJECTIVE: The goals of this project were to: increase exposure of GEDs in the southeast United States to pediatric emergencies through simulation, assess pediatric emergency clinical care processes with simulation, describe factors associated with readiness including volume of pediatric patients and ED location (urban/rural), and compare these findings to the 2013 National Pediatric Readiness Project. METHODS: This prospective in situ simulation study evaluated GED readiness using the Emergency Medical Services for Children Pediatric Readiness Score (PRS) and team performance in caring for 4 simulated pediatric emergencies. Comparisons between GED and pediatric ED (PED) performance and PRS, GED performance, and PRS based on pediatric patient volume and hospital location were evaluated. A Composite Quality Score (CQS) was calculated for each ED. RESULTS: Seventy-five teams from 40 EDs participated (39 GED; 1 PED). The PED had a significantly higher volume of pediatric patients (73,000 vs 4492; P = 0.003). The PRS for GEDs was significantly lower (57% [SD, 17] vs 98%; P = 0.022). The CQSs for all GEDs were significantly lower than the PED (55% vs 87%; P < 0.004). Among GEDs, there was no statistically significant difference in PRS or CQS based on pediatric patient volume, but urban GEDs had significantly higher CQSs versus rural GEDs (59.8% vs 50.6%, P = 0.001). CONCLUSIONS: This study shows a significant disparity in the performance and readiness of GEDs versus a PED in a medically underserved area. More education and better access to resources is needed in these areas to adequately care for critically ill pediatric patients.

Suicide Simulation in Primary Care.

OBJECTIVES: This project was developed because residents need to gain knowledge and experience in promptly recognizing patients with suicidal ideation. Our study allowed pediatric interns the opportunity to manage a simulated 16-year-old actively suicidal patient in the resident continuity clinic for a well-child visit. METHODS: During their first year, each resident receives simulation training. The simulation scenario for this study involves the use of a standardized patient (SP). Sessions take place in the pediatric simulation center and are recorded for observation and review. The scenario was scripted and piloted to ensure standardization in educational intervention. Postscenario, participants have a nonjudgmental debriefing with the attending physician and the SP. An anonymous survey is completed after training. Enrollment was June 2016-September 2019, with two to three 1-hour cases monthly. RESULTS: Seventy-one postgraduate year-1 residents participated. Sixty-one residents left the suicidal patient alone/unobserved. Fifteen participants never learned of the intent of suicide during their initial intake with the patient but believed that she was depressed. The mean time to ask about suicidal ideation, when applicable, was 8:32 minutes (standard deviation 4:10 minutes, range 2:15-24:48 minutes). Common learning themes included realistic exposure to an actively suicidal patient and simulation debriefing/direct feedback from the SP. CONCLUSIONS: Practicing this crucial but somewhat rare primary care mental health emergency for all interns was possible when structured monthly. Feedback was extremely positive, with learners' feeling more prepared postsimulation. Our simulation experience also allows supervisors to assess intern's individual abilities to communicate in a difficult patient scenario which is an important physician competency as defined by the Accreditation Council for Graduate Medical Education.

Travel Histories in Children: How Well Do Interns and Medical Students Do?

OBJECTIVE: To evaluate the knowledge of obtaining travel histories in medical students and interns. METHODS: Medical students and interns participated in a high-fidelity pediatric simulation with two cases (malaria or typhoid fever) that hinged on travel history. After the simulation, appropriate methods of obtaining travel histories were discussed. Participants completed surveys regarding their previous education and comfort with obtaining travel histories. If and how a travel history was obtained was derived from simulation observation. RESULTS: From June 2016 to July 2017, 145 medical trainees participated in 24 simulation sessions; 45% reported no prior training in obtaining travel histories. Participants asked for a travel history in all but 2 simulations; however, in 9 of 24 simulations (38%), they required prompting by either a simulation confederate or laboratory results. Participants were more comfortable diagnosing/treating conditions acquired from US domestic travel than from international travel (32.9% vs 22.4%, P < 0.001). Previous education in obtaining travel histories and past international travel did not significantly influence the level of comfort that participants felt with travel histories. CONCLUSIONS: This study highlights the lack of knowledge regarding the importance of travel histories as part of basic history taking. Medical students and interns had low levels of comfort in obtaining adequate travel histories and diagnosing conditions acquired from international travel.

A Simulation Course Focusing on Forensic Evidence Collection Improves Pediatric Knowledge and Standardizes Curriculum for Child Abuse.

OBJECTIVES: Our hypothesis was that pediatric residents and medical students who participated in a structured forensic evidence collection course would have improved knowledge of prepubertal evidence collection practices and pubertal genital anatomy. METHODS: The course curriculum included a forensic evidence collection video created by the sexual assault nurse examiner directors. After watching the video, the participants simulated forensic evidence collection using forensic evidence collection kits and chain of evidence protocols in a hybrid simulation setting under the supervision of a pediatric sexual assault nurse examiner. The participants completed a multiple-choice test and a fill-in-the-blank anatomical diagram test before and after the course. RESULTS: Of an eligible 48 participants, 42 completed the course; therefore, our participant response rate was 87.5%. There was significant improvement in knowledge, with an average pretest score of 62% ± 20% and the average posttest score of 86% ± 9% (P < 0.001). Qualitative evaluations were overwhelmingly positive, with consistent scoring of 6/6 in a 6-point agree scale. Learning themes, which emerged from open-ended questions on the evaluations, included knowledge gained on evidence collection processes (n = 26), how to appropriately interact with abused patients (n = 8), hands-on nature of the experience and the benefits of walking through the examination (n = 7), and pubertal genital anatomy knowledge (n = 3). Participants suggested that more instruction on anatomy would be helpful. CONCLUSIONS: We found that pediatric residents' and medical students' knowledge of pediatric sexual abuse may be improved with a short simulation course focusing on forensic evidence collection.

Observational Study on the Effect of Duration from Pediatric Advanced Life Support (PALS) Certification on PALS Performance in Pediatric Interns in Simulated Cardiopulmonary Arrest.

Pediatric advanced life support (PALS) training is critical for pediatric residents. It is unclear how well PALS skills are developed during this course or maintained overtime. This study evaluated PALS skills of pediatric interns using a validated PALS performance score following their initial PALS certification. All pediatric interns were invited to a 45-minute rapid cycle deliberate practice (RCDP) training session following their initial PALS certification from July 2017 to June 2019. The PALS score and times for key events were recorded for participants prior to RCDP training. We then compared performance scores for those who took PALS ≥3 months, between 3 days to 3 months and 3 days after PALS. There were 72 participants, 30 (of 30) in 3 days, 18 in 3 days to 3 months, and 24 in ≥3 months groups (42 total of 52 residents, 81%). The average PALS performance score was 53 ± 20%. There was no significant difference between the groups (3 days, 53 ± 15%; 3 days-3 months, 51 ± 19%; ≥3 months, 54 ± 26%, p = 0.922). Chest compressions started later in the ≥3 months groups compared with the 3 days or ≤3 months groups ( p = 0.036). Time to defibrillation was longer in the 3 days group than the other groups ( p = 0.008). Defibrillation was asked for in 3 days group at 97%, 73% in 3 days to 3 months and 68% in ≥3 months groups. PALS performance skills were poor in pediatric interns after PALS certification and was unchanged regardless of when training occurred. Our study supports the importance of supplemental resuscitation training in addition to the traditional PALS course.

Professional Success: Utilizing Simulation to Remediate and Retain Nursing Staff.

Nursing education focuses on nursing theory and the ability to perform tasks. There is a lack of education related to prioritization of nursing tasks. Therefore, new nurses transitioning into their roles sometimes struggle and, as a result, leave their units or, often enough, our facility. We developed a Professional Success Program that includes cognitive prioritization exercises and simulation scenarios to assist these nurses. After utilizing the program, our facility has seen an increase in nurse retention.

Factors Associated With Improved Pediatric Resuscitative Care in General Emergency Departments.

OBJECTIVES: To describe the quality of pediatric resuscitative care in general emergency departments (GEDs) and to determine hospital-level factors associated with higher quality. METHODS: Prospective observational study of resuscitative care provided to 3 in situ simulated patients (infant seizure, infant sepsis, and child cardiac arrest) by interprofessional GED teams. A composite quality score (CQS) was measured and the association of this score with modifiable and nonmodifiable hospital-level factors was explored. RESULTS: A median CQS of 62.8 of 100 (interquartile range 50.5-71.1) was noted for 287 resuscitation teams from 175 emergency departments. In the unadjusted analyses, a higher score was associated with the modifiable factor of an affiliation with a pediatric academic medical center (PAMC) and the nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. In the adjusted analyses, a higher CQS was associated with modifiable factors of an affiliation with a PAMC and the designation of both a nurse and physician pediatric emergency care coordinator, and nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. A weak correlation was noted between quality and pediatric readiness scores. CONCLUSIONS: A low quality of pediatric resuscitative care, measured using simulation, was noted across a cohort of GEDs. Hospital factors associated with higher quality included: an affiliation with a PAMC, designation of a pediatric emergency care coordinator, higher pediatric volume, and geographic location. A weak correlation was noted between quality and pediatric readiness scores.

The Impact of a 9-Month Booster Training Using Rapid Cycle Deliberate Practice on Pediatric Resident PALS Skills.

INTRODUCTION: The impact of booster training on pediatric resuscitation skills is not well understood. Rapid cycle deliberate practice (RCDP) to supplement pediatric advanced life support (PALS) training is beginning to be used to improve resuscitation skills. We tested the impact of booster RCDP training performed at 9 months after initial RCDP training on pediatric resuscitation skills of pediatric residents. OBJECTIVE: This study evaluated the impact of a 9-month RCDP booster training on PALS skills compared with usual practice debriefing (plus/delta) after an initial RCDP training session for PALS-certified pediatric interns. METHODS: All pediatric interns at a single institution were invited to a 45-minute RCDP training session after their initial PALS certification. The PALS performance score and times for key events were recorded for participants immediately before and after the RCDP training as well as 6, 9, and 12 months after the RCDP training. Learners were randomized to an RCDP intervention and usual practice (plus/delta) group. The intervention group received booster RCDP training after their 9-month assessment. RESULTS: Twenty eight of 30 residents participated in the initial training with 22 completing randomization at 9 months. There was no significant difference in 12-month PALS median performance scores after the booster training between the intervention and usual practice groups (83% vs. 94%, P = 0.31). There was significant improvement in PALS performance score from 51 ± 27% pre-initial RCDP assessment to 93 ± 5% post-initial RCDP training (P < 0.001). There were significant improvements in individual skills from pre- to post-initial RCDP testing, including time to verbalize pulseless, start compressions, and attach defibrillation pads (P < 0.001). CONCLUSIONS: Rapid cycle deliberate practice booster training versus plus/delta training at 9-month post-initial RCDP training did not alter 12-month performance. However, RCDP is effective at improving PALS performance skills, and this effect is maintained at 6, 9, and 12 months. Our study supports the importance of supplemental resuscitation training in addition to the traditional PALS course.

Using natural language processing to compare task-specific verbal cues in coached versus noncoached cardiac arrest teams during simulated pediatrics resuscitation.

OBJECTIVES: Coaches improve cardiopulmonary (CPR) outcomes in real-world and simulated settings. To explore verbal feedback that targets CPR quality, we used natural language processing (NLP) methodologies on transcripts from a published pediatric randomized trial (coach vs. no coach in simulated CPR). Study objectives included determining any differences by trial arm in (1) overall communication and (2) metrics over minutes of CPR and (3) exploring overall frequencies and temporal patterns according to degrees of CPR excellence. METHODS: A human-generated transcription service produced 40 team transcripts. Automated text search with manual review assigned semantic category; word count; and presence of verbal cues for general CPR, compression depth or rate, or positive feedback to transcript utterances. Resulting cue counts per minute (CPM) were corresponded to CPR quality based on compression rate and depth per minute. CPMs were compared across trial arms and over the 18 min of CPR. Adaptation to excellence was analyzed across four patterns of CPR excellence determined by k-shape methods. RESULTS: Overall coached teams experienced more rate-directive, depth-directive, and positive verbal cues compared with noncoached teams. The frequency of coaches' depth cues changed over minutes of CPR, indicating adaptation. In coached teams, the number of depth-directive cues differed among the four patterns of CPR excellence. Noncoached teams experienced fewer utterances by type, with no adaptation over time or to CPR performance. CONCLUSION: NLP extracted verbal metrics and their patterns in resuscitation sessions provides insight into communication patterns and skills used by CPR coaches and other team members. This could help to further optimize CPR training, feedback, excellence, and outcomes.

Rapid cycle deliberate practice improves and sustains paediatric resident PALS performance.

Objectives: Paediatric cardiopulmonary arrest resuscitation is a critically important skill but infrequently used in clinical practice. Therefore, resuscitation knowledge relies heavily on formal training which is vulnerable to rapid knowledge decay. We evaluate knowledge and skill retention post-training using rapid cycle deliberate practice (RCDP). Design: Pilot, non-blinded, single-arm study. Setting: Pediatric Simulation Center at Children's of Alabama. Participants: 42 paediatric residents at a large, tertiary care, academic children's hospital were enrolled in this simulation-based resuscitation study. Interventions: Each participant led a 7 min preintervention arrest scenario as a baseline test. After testing, participants were trained individually in the paediatric advanced life support (PALS) skills necessary for resuscitation of a patient in pulseless electrical activity and ventricular fibrillation using RCDP-a simulation method using frequent expert feedback and repeated opportunities for the learner to incorporate new learning. Immediately post-training, participants were retested as leaders of a different paediatric arrest scenario. 3 months post-training participants returned to complete a final simulation scenario. Main outcome measures: To evaluate knowledge and skill retention following PALS training. Results: Preintervention data demonstrated poor baseline resident performance with an average PALS score of 52%. Performance improved to 94% immediately post-training and this improvement largely persisted at 3 months, with an average performance of 81%. In addition to improvements in performance, individual skills improved including communication, recognition of rhythms, early chest compressions and rapid administration of epinephrine or defibrillation. Conclusions: RCDP training was associated with significant improvements in resident performance during simulated paediatric resuscitation and high retention of those improvements.

Development of a "First Five Minutes" Program to Improve Staff Response to Pediatric Codes.

BACKGROUND: Delayed or inadequate cardiopulmonary resuscitation during cardiopulmonary arrest is associated with adverse resuscitation outcomes in pediatric patients. Therefore, a "First Five Minutes" program was developed to train all inpatient acute care nurses in resuscitation skills. The program focused on steps to take during the first 5 minutes. OBJECTIVE: To improve response of bedside personnel in the first few minutes of a cardiopulmonary emergency. METHODS: A simulation-based in situ educational program was developed that focused on the components of the American Heart Association's "Get With the Guidelines" recommendations. The program was implemented in several phases to improve instruction and focus on necessary skills. RESULTS: The program garnered positive feedback from participants and was deemed helpful in preparing nurses and other staff members to respond to a patient in cardiopulmonary arrest. Time to chest compressions improved after training, and postintervention responses to questions regarding future code performance indicated participant recognition of the priority of the interventions addressed, such as backboard use, timely initiation of chest compressions, and timely administration of medications. Preliminary data show staff improvements in mock code performance. CONCLUSIONS: The First Five Minutes program has proved to be a successful educational initiative and is expected to be continued indefinitely, with additional phases incorporated as needed. A rigorous study on best teaching methods for the program is planned.

Nurse Vigilance: A Three-Part Simulation Course to Decrease Cardiopulmonary Arrests Outside Intensive Care Units.

Early recognition of and prompt intervention for the deteriorating pediatric patient remains paramount in preventing cardiac arrests from occurring outside intensive care units. To decrease these events, we developed a three-part simulation-based blended learning course consisting of a computer-based training module, a simulation scenario, and follow-up in situ scenarios for inpatient nurses. After initiation of the course, our facility has seen a decrease in the number of codes outside critical care areas.