Sepsis Prediction in Hospitalized Children: Model Development and Validation.

BACKGROUND AND OBJECTIVES: Early recognition and treatment of pediatric sepsis remain mainstay approaches to improve outcomes. Although most children with sepsis are diagnosed in the emergency department, some are admitted with unrecognized sepsis or develop sepsis while hospitalized. Our objective was to develop and validate a prediction model of pediatric sepsis to improve recognition in the inpatient setting. METHODS: Patients with sepsis were identified using intention-to-treat criteria. Encounters from 2012 to 2018 were used as a derivation to train a prediction model using variables from an existing model. A 2-tier threshold was determined using a precision-recall curve: an "Alert" tier with high positive predictive value to prompt bedside evaluation and an "Aware" tier with high sensitivity to increase situational awareness. The model was prospectively validated in the electronic health record in silent mode during 2019. RESULTS: A total of 55 980 encounters and 793 (1.4%) episodes of sepsis were used for derivation and prospective validation. The final model consisted of 13 variables with an area under the curve of 0.96 (95% confidence interval 0.95-0.97) in the validation set. The Aware tier had 100% sensitivity and the Alert tier had a positive predictive value of 14% (number needed to alert of 7) in the validation set. CONCLUSIONS: We derived and prospectively validated a 2-tiered prediction model of inpatient pediatric sepsis designed to have a high sensitivity Aware threshold to enable situational awareness and a low number needed to Alert threshold to minimize false alerts. Our model was embedded in our electronic health record and implemented as clinical decision support, which is presented in a companion article.

Sepsis Prediction in Hospitalized Children: Clinical Decision Support Design and Deployment.

BACKGROUND: Following development and validation of a sepsis prediction model described in a companion article, we aimed to use quality improvement and safety methodology to guide the design and deployment of clinical decision support (CDS) tools and clinician workflows to improve pediatric sepsis recognition in the inpatient setting. METHODS: CDS tools and sepsis huddle workflows were created to implement an electronic health record-based sepsis prediction model. These were proactively analyzed and refined using simulation and safety science principles before implementation and were introduced across inpatient units during 2020-2021. Huddle compliance, alerts per non-ICU patient days, and days between sepsis-attributable emergent transfers were monitored. Rapid Plan-Do-Study-Act (PDSA) cycles based on user feedback and weekly metric data informed improvement throughout implementation. RESULTS: There were 264 sepsis alerts on 173 patients with an 89% bedside huddle completion rate and 10 alerts per 1000 non-ICU patient days per month. There was no special cause variation in the metric days between sepsis-attributable emergent transfers. CONCLUSIONS: An automated electronic health record-based sepsis prediction model, CDS tools, and sepsis huddle workflows were implemented on inpatient units with a relatively low rate of interruptive alerts and high compliance with bedside huddles. Use of CDS best practices, simulation, safety tools, and quality improvement principles led to high utilization of the sepsis screening process.