Factors Associated With Improved Pediatric Resuscitative Care in General Emergency Departments.

OBJECTIVES: To describe the quality of pediatric resuscitative care in general emergency departments (GEDs) and to determine hospital-level factors associated with higher quality. METHODS: Prospective observational study of resuscitative care provided to 3 in situ simulated patients (infant seizure, infant sepsis, and child cardiac arrest) by interprofessional GED teams. A composite quality score (CQS) was measured and the association of this score with modifiable and nonmodifiable hospital-level factors was explored. RESULTS: A median CQS of 62.8 of 100 (interquartile range 50.5-71.1) was noted for 287 resuscitation teams from 175 emergency departments. In the unadjusted analyses, a higher score was associated with the modifiable factor of an affiliation with a pediatric academic medical center (PAMC) and the nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. In the adjusted analyses, a higher CQS was associated with modifiable factors of an affiliation with a PAMC and the designation of both a nurse and physician pediatric emergency care coordinator, and nonmodifiable factors of higher pediatric volume and location in the Northeast and Midwest. A weak correlation was noted between quality and pediatric readiness scores. CONCLUSIONS: A low quality of pediatric resuscitative care, measured using simulation, was noted across a cohort of GEDs. Hospital factors associated with higher quality included: an affiliation with a PAMC, designation of a pediatric emergency care coordinator, higher pediatric volume, and geographic location. A weak correlation was noted between quality and pediatric readiness scores.

Using Rapid Cycle Deliberate Practice to Up-Train Pediatric Providers for Adult COVID-19 Patients.

The SARS CoV-2 pandemic brought unique challenges to healthcare workers and systems. Simulation teams improvised and scaled up to meet new educational needs. Children's hospitals worked to address the many issues surrounding COVID-19, including how to prepare facilities and staff to care for adult patients in the event of COVID patient overflow. This technical report describes the use of the teaching method rapid cycle deliberate practice (RCDP) to train interprofessional teams unaccustomed to working together. We detail how sessions were developed and implemented, particularly noting the need for an extended pre-briefing to optimize psychological safety. The RCDP model allowed for a high level of interaction throughout the simulations and the incorporation of new knowledge "on the go" during the sessions.

Improving Pediatric Readiness in General Emergency Departments: A Prospective Interventional Study.

OBJECTIVE: To describe the impact of a national interventional collaborative on pediatric readiness within general emergency departments (EDs). STUDY DESIGN: A prospective, multicenter, interventional study measured pediatric readiness in general EDs before and after participation in a pediatric readiness improvement intervention. Pediatric readiness was assessed using the weighted pediatric readiness score (WPRS) on a 100-point scale. The study protocol extended over 6 months and involved 3 phases: (1) a baseline on-site assessment of pediatric readiness and simulated quality of care; (2) pediatric readiness interventions; and (3) a follow-up on-site assessment of WPRS. The intervention phase included a benchmarking performance report, resources toolkits, and ongoing interactions between general EDs and academic medical centers. RESULTS: Thirty-six general EDs were enrolled, and 34 (94%) completed the study. Four EDs (11%) were located in Canada, and the rest were in the US. The mean improvement in WPRS was 16.3 (P < .001) from a baseline of 62.4 (SEM = 2.2) to 78.7 (SEM = 2.1), with significant improvement in the domains of administration/coordination of care; policies, protocol, and procedures; and quality improvement. Six EDs (17%) were fully adherent to the protocol timeline. CONCLUSIONS: Implementing a collaborative intervention model including simulation and quality improvement initiatives is associated with improvement in WPRS when disseminated to a diverse group of general EDs partnering with their regional pediatric academic medical centers. This work provides evidence that innovative collaboration facilitated by academic medical centers can serve as an effective strategy to improve pediatric readiness and processes of care.

Development of a Simulation-Based Interprofessional Teamwork Assessment Tool.

BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME) Milestone projects required each specialty to identify essential skills and develop means of assessment with supporting validity evidence for trainees. Several specialties rate trainees on a milestone subcompetency related to working in interprofessional teams. A tool to assess trainee competence in any role on an interprofessional team in a variety of scenarios would be valuable and suitable for simulation-based assessment. OBJECTIVE: We developed a tool for simulation settings that assesses interprofessional teamwork in trainees. METHODS: In 2015, existing tools that assess teamwork or interprofessionalism using direct observation were systematically reviewed for appropriateness, generalizability, adaptability, ease of use, and resources required. Items from these tools were included in a Delphi method with multidisciplinary pediatrics experts using an iterative process from June 2016 to January 2017 to develop an assessment tool. RESULTS: Thirty-one unique tools were identified. A 2-stage review narrowed this list to 5 tools, and 81 items were extracted. Twenty-two pediatrics experts participated in 4 rounds of Delphi surveys, with response rates ranging from 82% to 100%. Sixteen items reached consensus for inclusion in the final tool. A global 4-point rating scale from novice to proficient was developed. CONCLUSIONS: A novel tool to assess interprofessional teamwork for individual trainees in a simulated setting was developed using a systematic review and Delphi methodology. This is the first step to establish the validity evidence necessary to use this tool for competency-based assessment.

Script Concordance Testing to Determine Infant Lumbar Puncture Practice Variation.

OBJECTIVES: Script concordance testing (SCT) is used to assess clinical decision-making. We explore the use of SCT to (1) quantify practice variations in infant lumbar puncture (LP) and (2) analyze physician's characteristics affecting LP decision making. METHODS: Using standard SCT processes, a panel of pediatric subspecialty physicians constructed 15 infant LP case vignettes, each with 2 to 4 SCT questions (a total of 47). The vignettes were distributed to pediatric attending physicians and fellows at 10 hospitals within the INSPIRE Network. We determined both raw scores (tendency to perform LP) and SCT scores (agreement with the reference panel) as well as the variation with participant factors. RESULTS: Two hundred twenty-six respondents completed all 47 SCT questions. Pediatric emergency medicine physicians tended to select LP more frequently than did general pediatricians, with pediatric emergency medicine physicians showing significantly higher raw scores (20.2 ± 10.2) than general pediatricians (13 ± 15; 95% confidence interval for difference, 1, 13). Concordance with the reference panel varied among subspecialties and by the frequency with which practitioners perform LPs in their practices. CONCLUSION: Script concordance testing questions can be used as a tool to detect subspecialty practice variation. We are able to detect significant practice variation in the self-report of use of LP for infants among different pediatric subspecialties.

The Correlation of Workplace Simulation-Based Assessments With Interns' Infant Lumbar Puncture Success: A Prospective, Multicenter, Observational Study.

INTRODUCTION: Little data are available to guide supervisors' decisions regarding when trainees are prepared to safely perform their first procedure on a patient. We aimed to describe the correlation of simulation-based assessments, in the workplace, with interns' first clinical infant lumbar puncture (ILP) success. METHODS: This is a prospective, observational subcomponent of a larger study of incoming interns at 33 academic medical centers (July 2010 to June 2012) assessing the impact of just-in-time training. When an intern's patient required an ILP, a just-in-time simulation-based skills refresher was conducted with his or her supervisor. At the end of the refresher, supervisors assessed interns' ILP skills on a simulator in the workplace before clinical performance using a four point anchored scale. The primary outcome was the correlation of supervisors' assessment and interns' procedural success. The number needed to assess for this instrument (1 / absolute risk reduction) was calculated. RESULTS: A total of 1600 interns were eligible to participate, and 1215 were enrolled. A total of 297 completed an assessment and a subsequent clinical ILP. Success rates for each scale rating were 29% (18/63) for novice, 39% (51/130) for beginner, 55% (46/83) for competent, and 43% (9/21) for proficient. The correlation coefficient was 0.161 (95% confidence interval, 0.057-0.265), indicating a weak correlation between supervisor rating and success. Success rate was 53% for the ratings of competent or proficient compared with 35% for the ratings of novice or beginner. Using the global rating scale for the summative assessment to determine procedural readiness could lead to 1 fewer patient experiencing a failed ILP for every 6 interns tested (6.2; 95% confidence interval, 4.0-8.5). CONCLUSIONS: A simulation-based assessment of interns conducted in the workplace before their first ILP has some value in predicting clinical ILP success.

The Harada score in the US population of children with Kawasaki disease.

OBJECTIVE: To describe and quantify the presentations of Kawasaki disease (KD) in a children's hospital over 10 years to assess the Harada score in a US population. METHODS: A retrospective chart review from 2001 to 2011 of children discharged from Cleveland Clinic with the diagnosis of KD. Demographic and clinical data were collected and Harada scores were derived to evaluate efficacy in predicting risk for coronary artery aneurysms (CAAs). RESULTS: A total of 105 children met diagnostic criteria for KD, and 97 of 105 had long-term follow-up. Full criteria for KD were found in 67 of 105 (64%); 38 had incomplete presentations. CAA developed in 10 children, 5 during follow-up despite treatment with intravenous immunoglobulin (IVIG.) Children with incomplete presentations had a higher risk of developing CAA (20% vs 5%, P = .03) and a delayed diagnosis (median days from fever to diagnosis 8.0 vs 5.0 days, P < .001). Of children who developed CAA, 9 of 10 had a positive Harada score (sensitivity of 90%). All children who developed CAA after IVIG were in the high-risk group, but 1 child with an incomplete presentation who had a CAA at presentation was missed by the score. Overall, the negative predictive value was 98%. CONCLUSIONS: As in Japanese studies, a positive Harada score in a US population could be used to identify a high-risk population for CAA development. All children who developed CAA after treatment with IVIG would have been assigned to a high-risk category. Though not specific enough to select initial therapy, the score might be useful in identifying high-risk children for evaluation of new therapies and more frequent follow-up.

Script concordance testing: assessing residents' clinical decision-making skills for infant lumbar punctures.

PURPOSE: Residents must learn which infants require a lumbar puncture (LP), a clinical decision-making skill (CDMS) difficult to evaluate because of considerable practice variation. The authors created an assessment model of the CDMS to determine when an LP is indicated, taking practice variation into account. The objective was to detect whether script concordance testing (SCT) could measure CDMS competency among residents for performing infant LPs. METHOD: In 2011, using a modified Delphi technique, an expert panel of 14 attending physicians constructed 15 case vignettes (each with 2 to 4 SCT questions) that represented various infant LP scenarios. The authors distributed the vignettes to residents at 10 academic pediatric centers within the International Simulation in Pediatric Innovation, Research, and Education Network. They compared SCT scores among residents of different postgraduate years (PGYs), specialties, training in adult medicine, LP experience, and practice within an endemic Lyme disease area. RESULTS: Of 730 eligible residents, 102 completed 47 SCT questions. They could earn a maximum score of 47. Median SCT scores were significantly higher in PGY-3s compared with PGY-1s (difference: 3.0; 95% confidence interval [CI] 1.0-4.9; effect size d = 0.87). Scores also increased with increasing LP experience (difference: 3.3; 95% CI 1.1-5.5) and with adult medicine training (difference: 2.9; 95% CI 0.6-5.0). Residents in Lyme-endemic areas tended to perform more LPs than those in nonendemic areas. CONCLUSIONS: SCT questions may be useful as an assessment tool to determine CDMS competency among residents for performing infant LPs.