The Concise Assessment of Leader Management Tool: Evaluation of Healthcare Provider Leadership During Real-Life Pediatric Emergencies.

INTRODUCTION: Resuscitation events in pediatric critical and emergency care are high risk, and strong leadership is an important component of an effective response. The Concise Assessment of Leadership Management (CALM) tool, designed to assess the strength of leadership skills during pediatric crises, has shown promising validity and reliability in simulated settings. The objective of this study was to generate further validity and reliability evidence for the CALM by applying it to real-life emergency events. METHODS: A prospective, video-based study was conducted in an academic pediatric emergency department. Three reviewers independently applied the CALM tool to the assessment of pediatric emergency department physicians as they led both a cardiac arrest and a sepsis event. Time to critical event (epinephrine, fluid, and antibiotic administration) was collected via video review. Based on Kane's framework, we conducted fully crossed, person × event × rater generalizability (G) and decision (D) studies. Interrater reliability was calculated using Gwet AC 2 and intraclass correlation coefficients. Time to critical events was correlated with CALM scores using Spearman coefficient. RESULTS: Nine team leaders were assessed in their leadership of 2 resuscitations each. The G coefficient was 0.68, with 26% subject variance, 20% rater variance, and no case variance. Thirty-three percent of the variance (33%) was attributed to third-order interactions and unknown factors. Gwet AC 2 was 0.3 and intraclass correlation was 0.58. The CALM score and time to epinephrine correlated at -0.79 ( P = 0.01). The CALM score and time to fluid administration correlated at -0.181 ( P = 0.64). CONCLUSIONS: This study provides additional validity evidence for the CALM tool's use in this context if used with multiple raters, aligning with data from the previous simulation-based CALM validity study. Further development may improve reliability. It also serves as an exemplar of the rigors of conducting validity work within medical simulation.

Identification of the Physiologically Difficult Airway in the Pediatric Emergency Department.

BACKGROUND: The risk factors for peri-intubation cardiac arrest in critically ill children are incompletely understood. The study objective was to derive physiologic risk factors for deterioration during tracheal intubation in a pediatric emergency department (PED). METHODS: This was a retrospective cohort study of patients undergoing emergency tracheal intubation in a PED. Using the published literature and expert opinion, a multidisciplinary team developed high-risk criteria for peri-intubation arrest: 1) hypotension, 2) concern for cardiac dysfunction, 3) persistent hypoxemia, 4) severe metabolic acidosis (pH < 7.1), 5) post-return of spontaneous circulation (ROSC), and 6) status asthmaticus. We completed a structured review of the electronic health record for a historical cohort of patients intubated in the PED. The primary outcome was peri-intubation arrest. Secondary outcomes included tracheal intubation success rate, extracorporeal membrane oxygenation (ECMO) activation, and in-hospital mortality. We compared outcomes between patients meeting one or more versus no high-risk criteria. RESULTS: Peri-intubation cardiac arrest occurred in 5.6% of patients who met at least one high-risk criterion compared to 0% in patients meeting none (5.6% difference, 95% confidence interval [CI] = 1.0 to 18.1, p = 0.028). Patients meeting at least one criterion had higher rates of any postintubation cardiac arrest in the PED (11.1% vs. 0%, 11.1% difference, 95% CI = 4.1 to 25.3, p = 0.0007), in-hospital mortality (25% vs. 2.3%, 22.7% difference, 95% CI = 11.0 to 38.9, p < 0.0001), ECMO activation (8.3% vs. 0%, 8.3% difference, 95% CI = 2.5 to 21.8, p = 0.004), and lower likelihood of first-pass intubation success (47.2% vs. 66.1%, -18.9% difference, 95% CI = -35.5 to -1.5, p = 0.038), respectively. CONCLUSIONS: We have developed criteria that successfully identify physiologically difficult airways in the PED. Children with hypotension, persistent hypoxemia, concern for cardiac dysfunction, severe metabolic acidosis, status asthmaticus or who are post-ROSC are at higher risk for peri-intubation cardiac arrest and in-hospital mortality. Further multicenter investigation is needed to validate our findings.

Videography in Pediatric Emergency Research: Establishing a Multicenter Collaborative and Resuscitation Registry.

OBJECTIVES: High-quality clinical research of resuscitations in a pediatric emergency department is challenging because of the limitations of traditional methods of data collection (chart review, self-report) and the low frequency of cases in a single center. To facilitate valid and reliable research for resuscitations in the pediatric emergency department, investigators from 3 pediatric centers, each with experience completing successful single-center, video-based studies, formed the Videography In Pediatric Emergency Research (VIPER) collaborative. METHODS: Our initial effort was the development of a multicenter, video-based registry and simulation-based testing of the feasibility and reliability of the VIPER registry. Feasibility of data collection was assessed by the frequency of an indeterminate response for all data elements in the registry. Reliability was assessed by the calculation of Cohen κ for dichotomous data elements and intraclass correlation coefficients for continuous data elements. RESULTS: Video-based data collection was completed for 8 simulated pediatric resuscitations, with at least 2 reviewers per case. Data were labeled as indeterminate by at least 1 reviewer for 18 (3%) of 524 relevant data fields. The Cohen κ for all dichotomous data fields together was 0.81 (95% confidence interval, 0.61-1.0). For all continuous (time-based) variables combined, the intraclass correlation coefficient was 0.88 (95% confidence interval, 0.70-0.96). CONCLUSIONS: Initial simulation-based testing suggests video-based data collection using the VIPER registry is feasible and reliable. Our next step is to assess feasibility and reliability for actual pediatric resuscitations and to complete several prospective, hypothesis-based studies of specific aspects of resuscitative care, including of cardiopulmonary resuscitation, tracheal intubation, and teamwork and communication.

Reducing the incidence of oxyhaemoglobin desaturation during rapid sequence intubation in a paediatric emergency department.

OBJECTIVES: Rapid sequence intubation (RSI) is the standard for definitive airway management in emergency medicine. In a video-based study of RSI in a paediatric emergency department (ED), we reported a high degree of process variation and frequent adverse effects, including oxyhaemoglobin desaturation (SpO2<90%). This report describes a multidisciplinary initiative to improve the performance and safety of RSI in a paediatric ED. METHODS: We conducted a local improvement initiative in a high-volume academic paediatric ED. We simultaneously tested: (1) an RSI checklist, (2) a pilot/copilot model for checklist execution, (3) the use of a video laryngoscope and (4) the restriction of laryngoscopy to specific providers. Data were collected primarily by video review during the testing period and the historical period (2009-2010, baseline). We generated statistical process control charts (G-charts) to measure change in the performance of six key processes, attempt failure and the occurrence of oxyhaemoglobin desaturation during RSI. We iteratively revised the four interventions through multiple plan-do-study-act cycles within the Model for Improvement. RESULTS: There were 75 cases of RSI during the testing period (July 2012-September 2013). Special cause variation occurred on the G-charts for three of six key processes, attempt failure and desaturation, indicating significant improvement. The frequency of desaturation was 50% lower in the testing period than the historical (16% vs 33%). When all six key processes were performed, only 6% of patients experienced desaturation. CONCLUSIONS: Following the simultaneous introduction of four interventions in a paediatric ED, RSI was performed more reliably, successfully and safely.