Using an eLearning Module to Facilitate Sepsis Knowledge Acquisition Across Multiple Institutions and Learner Disciplines.

OBJECTIVE: Guidelines exist for care of pediatric sepsis, but no study has assessed the benefit of electronic learning (eLearning) in this topic area. The objective of this multicenter study was to assess knowledge acquisition and retention for pediatric sepsis across multiple health care provider roles, using an adaptive and interactive eLearning module. METHODS: The study used pretest, posttest, and 90-day delayed test scores to evaluate provider knowledge after an adaptive and interactive eLearning module intervention. The eLearning module contained conditional logic-based assessments that allowed real-time adjustments of the displayed content according to each participant's demonstrated knowledge. Physicians, nurses, and advanced practice providers, primarily emergency department based, at 9 pediatric institutions were included. Changes in test scores were stratified by provider role. RESULTS: A total of 574 participants completed the posttest, and 296 (51.6%) of those completed the delayed test. Across all providers, there was an increase in test scores of 15.7% between the pretest and posttest (P < 0.001) with a large effect size as measured by Cramer's V. Across all providers, there was an overall test score increase of 5.2% (P < 0.001) between the pretest and delayed test, with a small effect size. CONCLUSIONS: An eLearning module improved immediate and delayed pediatric sepsis knowledge in pediatric health care providers across multiple institutions and provider roles. Immediate knowledge gain was meaningful as indicated by effect sizes, although by the time of the delayed test, the effect was smaller. This module fills an important gap in currently available pediatric sepsis education.

Evaluating the reliability of gestalt quality ratings of medical education podcasts: A METRIQ study.

INTRODUCTION: Podcasts are increasingly being used for medical education. Studies have found that the assessment of the quality of online resources can be challenging. We sought to determine the reliability of gestalt quality assessment of education podcasts in emergency medicine. METHODS: An international, interprofessional sample of raters was recruited through social media, direct contact, and the extended personal network of the study team. Each participant listened to eight podcasts (selected to include a variety of accents, number of speakers, and topics) and rated the quality of that podcast on a seven-point Likert scale. Phi coefficients were calculated within each group and overall. Decision studies were conducted using a phi of 0.8. RESULTS: A total of 240 collaborators completed all eight surveys and were included in the analysis. Attendings, medical students, and physician assistants had the lowest individual-level variance and thus the lowest number of required raters to reliably evaluate quality (phi >0.80). Overall, 20 raters were required to reliably evaluate the quality of emergency medicine podcasts. DISCUSSION: Gestalt ratings of quality from approximately 20 health professionals are required to reliably assess the quality of a podcast. This finding should inform future work focused on developing and validating tools to support the evaluation of quality in these resources.

Creating Consensus Educational Goals for Pediatric Sepsis via Multicenter Modified Delphi.

Clinical care of pediatric sepsis depends on early recognition and basic initial steps and thus focused educational materials for providers in these early phases of care are needed. The authors sought to identify educational goals and establish a framework for those materials. The authors conducted a Delphi process to create consensus educational goals for the recognition and treatment of pediatric sepsis, focused on the needs of emergency and acute care providers. Experts in pediatric sepsis quality improvement and education were recruited. In each round the experts determined if a particular goal was appropriate for inclusion and provided edits if required. Free-text responses and additional goals were accepted. The primary author deidentified and collated the responses and distributed an updated list of goals prior to each round. Five experts participated in the Delphi process. After three rounds the panelists unanimously agreed on 14 educational goals. These goals include three on recognition, five on early treatment, three on treatment response, and three on continued treatment. Using a Delphi process the authors established a list of educational goals for pediatric sepsis care. The experts largely agreed upon the initial set of goals and quickly came to consensus on the majority of topics. This highlights a foundation for any future educational interventions. In addition to creating content standards for pediatric sepsis education, this Delphi process represents a useful tool that may be adaptable to educational content development in other topics.

The prevalence and diagnostic utility of systemic inflammatory response syndrome vital signs in a pediatric emergency department.

OBJECTIVES: This study sought to determine the prevalence, test characteristics, and severity of illness of pediatric patients with systemic inflammatory response syndrome (SIRS) vital signs among pediatric emergency department (ED) visits. METHODS: This was a retrospective descriptive cohort study of all visits to the ED of a tertiary academic free-standing pediatric hospital over 1 year. Visits were included if the patient was <18 years of age and did not leave before full evaluation or against medical advice. Exclusion criteria were trauma diagnoses or missing documentation of vital signs. Data were electronically extracted from the medical record. The primary predictor was presence of vital signs meeting pediatric SIRS definitions. Specific vital sign pairs comprising SIRS were evaluated as predictors (temperature-heart rate, temperature-respiratory rate, and temperature-corrected heart rate, in which a formula was used to correct heart rate for degree of temperature elevation). The primary outcome measure was requirement for critical care (receipt of a vasoactive agent or intubation) within 24 hours of ED arrival. RESULTS: There were 56,210 visits during the study period; 40,356 met inclusion criteria. Of these, 6,596 (16.3%) visits had fever >38.5°C, and 6,122 (15.2% of included visits) met SIRS vital sign criteria. Among included visits, those with SIRS vital signs accounted for 92.8% of all visits with fever >38.5°C. Among patients with SIRS vital signs, 4993 (81.6%) were discharged from the ED without intravenous (IV) therapy and without 72-hour readmission. Critical care within the first 24 hours was present in 99 (0.25%) patients: 23 patients with and 76 without SIRS vital signs. Intensive care unit (ICU) admission was present in 126 (2.06%) with SIRS vital signs and 487 (1.42%) without SIRS vital signs. SIRS vital signs were associated with increased risk of critical care within 24 hours (relative risk [RR] = 1.69, 95% confidence interval [CI] = 1.06 to 2.70), ICU admission (RR = 1.45, 95% CI = 1.19 to 1.76), ED laboratory tests (RR = 1.41, 95% CI = 1.37 to 1.45), ED IV medication/fluid administration (RR = 2.54, 95% CI = 2.29 to 2.82), hospital admission (RR = 1.52, 95% CI = 1.42 to 1.63), and 72-hour readmission (RR = 1.31, 95% CI = 1.01 to 1.69). SIRS vital signs were not associated with 30-day in-hospital mortality (RR = 0.37, 95% CI = 0.05 to 2.82). SIRS vital signs had a low sensitivity for critical care requirement (23.2%, 95% CI = 15.3% to 32.8%). The pair of SIRS vital signs with the strongest association with critical care requirement was temperature and corrected heart rate (positive likelihood ratio = 2.74, 95% CI = 1.87 to 4.01). CONCLUSIONS: Systemic inflammatory response syndrome vital signs are common among medical pediatric patients presenting to an ED, and critical illness is rare. The majority of patients with SIRS vital signs were discharged without IV therapy and without readmission. Patients with SIRS vital signs had a statistically significant increased risk of critical care requirement, ED IV treatment, ED laboratory tests, admission, and readmission. However, SIRS vital sign criteria did not identify the majority of patients with mortality or need for critical care. SIRS vital signs had low sensitivity for critical illness, making it poorly suited for use in isolation in this setting as a test to detect children requiring sepsis resuscitation.