The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations.

AIM: The aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations. METHODS: This is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument. RESULTS: Content validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability. CONCLUSIONS: These results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Defibrillation in the movies: a missed opportunity for public health education.

AIM: To characterize defibrillation and cardiac arrest survival outcomes in movies. METHODS: Movies from 2003 to 2012 with defibrillation scenes were reviewed for patient and rescuer characteristics, scene characteristics, defibrillation characteristics, additional interventions, and cardiac arrest survival outcomes. Resuscitation actions were compared with chain of survival actions and the American Heart Association (AHA) Emergency Cardiovascular Care (ECC) 2020 Impact Goals. Cardiac arrest survival outcomes were compared with survival rates reported in the literature and targeted by the AHA ECC 2020 Impact Goals. RESULTS: Thirty-five scenes were identified in 32 movies. Twenty-five (71%) patients were male, and 29 (83%) rescuers were male. Intent of defibrillation was resuscitation in 29 (83%) scenes and harm in 6 (17%) scenes. Cardiac arrest was the indication for use in 23 (66%) scenes, and the heart rhythm was made known in 18 scenes (51%). When the heart rhythm was known, defibrillation was appropriately used for ventricular tachycardia or ventricular fibrillation in 5 (28%) scenes and inappropriately used for asystole in 7 (39%) scenes. In 8 scenes with in-hospital cardiac arrest, 7 (88%) patients survived, compared to survival rates of 23.9% reported in the literature and 38% targeted by an AHA ECC 2020 Impact Goal. In 12 movie scenes with out-of-hospital cardiac arrest, 8 (67%) patients survived, compared to survival rates of 7.9-9.5% reported in peer-reviewed literature and 15.8% targeted by an AHA ECC 2020 Impact Goal. CONCLUSION: In movies, defibrillation and cardiac arrest survival outcomes are often portrayed inaccurately, representing missed opportunities for public health education.

Use of automated external defibrillators in US federal buildings: implementation of the Federal Occupational Health public access defibrillation program.

OBJECTIVE: Federal Occupational Health (FOH) administers a nationwide public access defibrillation program in US federal buildings. We describe the use of automated external defibrillators (AEDs) in federal buildings and evaluate survival after cardiac arrest. METHODS: Using the FOH database, we examined reported events in which an AED was brought to a medical emergency in federal buildings over a 14-year period, from 1999 to 2012. RESULTS: There were 132 events involving an AED, 96 (73%) of which were due to cardiac arrest of cardiac etiology. Of 54 people who were witnessed to experience a cardiac arrest and presented with ventricular fibrillation or ventricular tachycardia, 21 (39%) survived to hospital discharge. CONCLUSIONS: Public access defibrillation, along with protocols to install, maintain, and deploy AEDs and train first responders, benefits survival after cardiac arrest in the workplace.

Evaluation of multidisciplinary simulation training on clinical performance and team behavior during tracheal intubation procedures in a pediatric intensive care unit.

OBJECTIVE: Tracheal intubation in the pediatric intensive care unit is often performed in emergency situations with high risks. Simulation has been recognized as an effective methodology to train both technical and teamwork skills. Our objectives were to develop a feasible tool to evaluate team performance during tracheal intubation in the pediatric intensive care unit and to apply the tool in the clinical setting to determine whether multidisciplinary teams with a higher number of simulation-trained providers exhibit more proficient performance. DESIGN: Prospective, observational pilot study. SETTING: Single tertiary children's hospital pediatric intensive care unit. SUBJECTS: Pediatric and emergency medicine residents, pediatric intensive care unit nurses, and respiratory therapists from October 2007 to June 2008. INTERVENTIONS: A pediatric intensive care unit on-call resident, a pediatric intensive care unit nurse, and a respiratory therapist received simulation-based multidisciplinary airway management training every morning. An assessment tool for team technical and behavioral skills was developed. Independent trained observers rated actual intubations in the pediatric intensive care unit by using this tool. MEASUREMENTS AND MAIN RESULTS: For observer training, two independent raters (research assistants 1 and 2) evaluated a total of 53 training sessions (research assistant 1, 16; research assistant 2, 37). The correlation coefficient with the facilitator expert (surrogate standard) was .73 for research assistant 1 and .88 for research assistant 2 (p ≤ .001 for both) in the total score, .84 for research assistant 1 and .77 for research assistant 2 (p < .001 for both) in the technical domain, and .63 for research assistant 1 (p = .009) and .84 for research assistant 2 (p < .001) in the behavioral domain. The correlation coefficient was lower in video-based observation (.62 vs. .88, on-site). For clinical observation, 15 intubations were observed in real time by raters. The performance by a team with two or more simulation-trained members was rated higher compared with the team with fewer than two trained members (total score: 127 ± 6 vs. 116 ± 9, p = .012, mean ± sd). CONCLUSIONS: It is feasible to rate the technical and behavioral performance of multidisciplinary airway management teams during real intensive care unit intubation events by using our assessment tool. The presence of two or more multidisciplinary simulation-trained providers is associated with improved performance during real events.