Risk Factors for Deterioration Events in the Pediatric Acute Care Setting.

OBJECTIVES: Rapid response system (RRS) activations resulting in emergency transfers (ETs) and codes outside the ICU are associated with increased mortality and length of stay. We aimed to evaluate the patient and care team characteristics of RRS activations resulting in ETs and codes outside the ICU (together classified as "deterioration events") versus those that did not result in a deterioration event. METHODS: For each RRS activation at our institution from 2019 to 2021, data were gathered on patient demographics and medical diagnoses, care team and treatment factors, and ICU transfer. Descriptive statistics, bivariate analyses, and multivariable logistic regression using a backward elimination model selection method were performed to assess potential risk factors for deterioration events. RESULTS: Over the 3-year period, 1765 RRS activations were identified. Fifty-three (3%) activations were deemed acute care codes, 64 (4%) were noncode ETs, 921 (52%) resulted in nonemergent transfers to an ICU, and 727 (41%) patients remained in an acute care unit. In a multivariable model, any complex chronic condition (adjusted odds ratio, 6.26; 95% confidence interval, 2.83-16.60) and hematology/oncology service (adjusted odds ratio, 2.19; 95% confidence interval, 1.28-3.74) were independent risk factors for a deterioration event. CONCLUSIONS: Patients with medical complexity and patients on the hematology/oncology service had a higher risk of deterioration events than other patients with RRS activations. Further analyzing how our hospital evaluates and treats these specific patient populations is critical as we develop targeted interventions to reduce deterioration events.

Continuous pulse oximetry monitoring in children hospitalized with bronchiolitis: A qualitative analysis of clinicians' justifications.

Continuous pulse oximetry (cSpO2) monitoring use outside established guidelines is common in children hospitalized with bronchiolitis. We analyzed clinicians' real-time rationale for continuous monitoring in stable children with bronchiolitis not requiring supplemental oxygen. Data for this study were collected as part a multicenter deimplementation trial for cSpO2 in children hospitalized with bronchiolitis. We analyzed 371 clinician responses across 36 hospitals; 258 (70%) responses did not include a clinical reason for monitoring ("nonclinical"; e.g., respondent forgot to discontinue monitoring, did not know why the patient was monitored, or was following an order). The remaining 113 (30%) responses contained a clinical reason for monitoring ("clinical"; e.g., recently requiring oxygen, physical exam concerns, or concerns relating to patient condition or history). Strategies to reduce unnecessary monitoring should include changes in workflow to facilitate shared understanding of monitoring goals and timely discontinuation of monitoring.

Sepsis Prediction in Hospitalized Children: Model Development and Validation.

BACKGROUND AND OBJECTIVES: Early recognition and treatment of pediatric sepsis remain mainstay approaches to improve outcomes. Although most children with sepsis are diagnosed in the emergency department, some are admitted with unrecognized sepsis or develop sepsis while hospitalized. Our objective was to develop and validate a prediction model of pediatric sepsis to improve recognition in the inpatient setting. METHODS: Patients with sepsis were identified using intention-to-treat criteria. Encounters from 2012 to 2018 were used as a derivation to train a prediction model using variables from an existing model. A 2-tier threshold was determined using a precision-recall curve: an "Alert" tier with high positive predictive value to prompt bedside evaluation and an "Aware" tier with high sensitivity to increase situational awareness. The model was prospectively validated in the electronic health record in silent mode during 2019. RESULTS: A total of 55 980 encounters and 793 (1.4%) episodes of sepsis were used for derivation and prospective validation. The final model consisted of 13 variables with an area under the curve of 0.96 (95% confidence interval 0.95-0.97) in the validation set. The Aware tier had 100% sensitivity and the Alert tier had a positive predictive value of 14% (number needed to alert of 7) in the validation set. CONCLUSIONS: We derived and prospectively validated a 2-tiered prediction model of inpatient pediatric sepsis designed to have a high sensitivity Aware threshold to enable situational awareness and a low number needed to Alert threshold to minimize false alerts. Our model was embedded in our electronic health record and implemented as clinical decision support, which is presented in a companion article.

Sepsis Prediction in Hospitalized Children: Clinical Decision Support Design and Deployment.

BACKGROUND: Following development and validation of a sepsis prediction model described in a companion article, we aimed to use quality improvement and safety methodology to guide the design and deployment of clinical decision support (CDS) tools and clinician workflows to improve pediatric sepsis recognition in the inpatient setting. METHODS: CDS tools and sepsis huddle workflows were created to implement an electronic health record-based sepsis prediction model. These were proactively analyzed and refined using simulation and safety science principles before implementation and were introduced across inpatient units during 2020-2021. Huddle compliance, alerts per non-ICU patient days, and days between sepsis-attributable emergent transfers were monitored. Rapid Plan-Do-Study-Act (PDSA) cycles based on user feedback and weekly metric data informed improvement throughout implementation. RESULTS: There were 264 sepsis alerts on 173 patients with an 89% bedside huddle completion rate and 10 alerts per 1000 non-ICU patient days per month. There was no special cause variation in the metric days between sepsis-attributable emergent transfers. CONCLUSIONS: An automated electronic health record-based sepsis prediction model, CDS tools, and sepsis huddle workflows were implemented on inpatient units with a relatively low rate of interruptive alerts and high compliance with bedside huddles. Use of CDS best practices, simulation, safety tools, and quality improvement principles led to high utilization of the sepsis screening process.

Sustainment of continuous pulse oximetry deimplementation: Analysis of Eliminating Monitor Overuse study data from six hospitals.

Using continuous pulse oximetry (cSpO2 ) to monitor children with bronchiolitis who are not receiving supplemental oxygen is a form of medical overuse. In this longitudinal analysis from the Eliminating Monitor Overuse (EMO) study, we aimed to assess changes in cSpO2 overuse before, during, and after intensive cSpO2 -deimplementation efforts in six hospitals. Monitoring data were collected during three phases: "P1" baseline, "P2" active deimplementation (all sites engaged in education and audit and feedback strategies), and "P3" sustainment (a new baseline measured after strategies were withdrawn). Two thousand and fifty-three observations were analyzed. We found that each hospital experienced reductions during active deimplementation (P2), with overall adjusted cSpO2 overuse decreasing from 53%, 95% confidence interval (CI): (49-57) to 22%, 95% CI: (19-25) between P1 and P2. However, following the withdrawal of deimplementation strategies, overuse rebounded in all six sites, with overall adjusted cSpO2 overuse increasing to 37%, 95% CI: (33-41) in P3.

EHR-Integrated Monitor Data to Measure Pulse Oximetry Use in Bronchiolitis.

BACKGROUND AND OBJECTIVES: Continuous pulse oximetry (oxygen saturation [Spo2]) monitoring in hospitalized children with bronchiolitis not requiring supplemental oxygen is discouraged by national guidelines, but determining monitoring status accurately requires in-person observation. Our objective was to determine if electronic health record (EHR) data can accurately estimate the extent of actual Spo2 monitoring use in bronchiolitis. METHODS: This repeated cross-sectional study included infants aged 8 weeks through 23 months hospitalized with bronchiolitis. In the validation phase at 3 children's hospitals, we calculated the test characteristics of the Spo2 monitor data streamed into the EHR each minute when monitoring was active compared with in-person observation of Spo2 monitoring use. In the application phase at 1 children's hospital, we identified periods when supplemental oxygen was administered using EHR flowsheet documentation and calculated the duration of Spo2 monitoring that occurred in the absence of supplemental oxygen. RESULTS: Among 668 infants at 3 hospitals (validation phase), EHR-integrated Spo2 data from the same minute as in-person observation had a sensitivity of 90%, specificity of 98%, positive predictive value of 88%, and negative predictive value of 98% for actual Spo2 monitoring use. Using EHR-integrated data in a sample of 317 infants at 1 hospital (application phase), infants were monitored in the absence of oxygen supplementation for a median 4.1 hours (interquartile range 1.4-9.4 hours). Those who received supplemental oxygen experienced a median 5.6 hours (interquartile range 3.0-10.6 hours) of monitoring after oxygen was stopped. CONCLUSIONS: EHR-integrated monitor data are a valid measure of actual Spo2 monitoring use that may help hospitals more efficiently identify opportunities to deimplement guideline-inconsistent use.

Evaluation of an Educational Outreach and Audit and Feedback Program to Reduce Continuous Pulse Oximetry Use in Hospitalized Infants With Stable Bronchiolitis: A Nonrandomized Clinical Trial.

Importance: National guidelines recommend against continuous pulse oximetry use for hospitalized children with bronchiolitis who are not receiving supplemental oxygen, yet guideline-discordant use remains high. Objectives: To evaluate deimplementation outcomes of educational outreach and audit and feedback strategies aiming to reduce guideline-discordant continuous pulse oximetry use in children hospitalized with bronchiolitis who are not receiving supplemental oxygen. Design, Setting, and Participants: A nonrandomized clinical single-group deimplementation trial was conducted in 14 non-intensive care units in 5 freestanding children's hospitals and 1 community hospital from December 1, 2019, through March 14, 2020, among 847 nurses and physicians caring for hospitalized children with bronchiolitis who were not receiving supplemental oxygen. Interventions: Educational outreach focused on communicating details of the existing guidelines and evidence. Audit and feedback strategies included 2 formats: (1) weekly aggregate data feedback to multidisciplinary teams with review of unit-level and hospital-level use of continuous pulse oximetry, and (2) real-time 1:1 feedback to clinicians when guideline-discordant continuous pulse oximetry use was discovered during in-person data audits. Main Outcomes and Measures: Clinician ratings of acceptability, appropriateness, feasibility, and perceived safety were assessed using a questionnaire. Guideline-discordant continuous pulse oximetry use in hospitalized children was measured using direct observation of a convenience sample of patients with bronchiolitis who were not receiving supplemental oxygen. Results: A total of 847 of 1193 eligible clinicians (695 women [82.1%]) responded to a Likert scale-based questionnaire (71% response rate). Most respondents rated the deimplementation strategies of education and audit and feedback as acceptable (education, 435 of 474 [92%]; audit and feedback, 615 of 664 [93%]), appropriate (education, 457 of 474 [96%]; audit and feedback, 622 of 664 [94%]), feasible (education, 424 of 474 [89%]; audit and feedback, 557 of 664 [84%]), and safe (803 of 847 [95%]). Sites collected 1051 audit observations (range, 47-403 per site) on 709 unique patient admissions (range, 31-251 per site) during a 3.5-month period of continuous pulse oximetry use in children with bronchiolitis not receiving supplemental oxygen, which were compared with 579 observations (range, 57-154 per site) from the same hospitals during the baseline 4-month period (prior season) to determine whether the strategies were associated with a reduction in use. Sites conducted 148 in-person educational outreach and aggregate data feedback sessions and provided real-time 1:1 feedback 171 of 236 times (72% of the time when guideline-discordant monitoring was identified). Adjusted for age, gestational age, time since weaning from supplemental oxygen, and other characteristics, guideline-discordant continuous pulse oximetry use decreased from 53% (95% CI, 49%-57%) to 23% (95% CI, 20%-25%) (P < .001) during the intervention period. There were no adverse events attributable to reduced monitoring. Conclusions and Relevance: In this nonrandomized clinical trial, educational outreach and audit and feedback deimplementation strategies for guideline-discordant continuous pulse oximetry use among hospitalized children with bronchiolitis who were not receiving supplemental oxygen were positively associated with clinician perceptions of feasibility, acceptability, appropriateness, and safety. Evaluating the sustainability of deimplementation beyond the intervention period is an essential next step. Trial Registration: ClinicalTrials.gov Identifier: NCT04178941.