Quality Tool School: Improving the Delivery of Quality Improvement Education in a Children's Hospital.

Background: In 2013, Nationwide Children's Hospital's (NCH) Quality Tool School (QTS) was created as an initial Quality Improvement educational series, composed of three separate classes, totaling 5.5 hours of hands-on QI training. QTS complemented the NCH 40-hour Quality Improvement Essentials course. Methods: Over 10 years, the series went through three phases of aims: Phase 1: develop and implement three core courses (Project Tools, Excel, and Control Charts); Phase 2: have participants complete the entire series of all three classes; Phase 3: have participants who complete the entire series of all three classes demonstrate the application of learning through involvement in a quality improvement project. Results: Since initiation, QTS has provided an educational entry point for 1428 NCH employees to participate in QI projects and teams. QTS has shown statistically significant improvement in 2 of the 3 principal aims. The Phase 1 metric of average monthly one-class participation completion percentage showed a statistically significant centerline shift from 9 to 16 students in October 2018. The Phase 3 metric Percentage of QTS participants completing the QTS series of classes and then participating in a QI team began in 2016 with a baseline of 42%. A centerline shift from 42% to 63% occurred in Q4 2018. Conclusions: QTS can provide QI education to healthcare system employees using limited resources. Organizations that strategically integrate a culture of QI into core beliefs can realize substantial improvement gains.

Predicting emergency department visits among children with asthma in two academic medical systems.

Objective: To develop and validate a predictive algorithm that identifies pediatric patients at risk of asthma-related emergencies, and to test whether algorithm performance can be improved in an external site via local retraining.Methods: In a retrospective cohort at the first site, data from 26 008 patients with asthma aged 2-18 years (2012-2017) were used to develop a lasso-regularized logistic regression model predicting emergency department visits for asthma within one year of a primary care encounter, known as the Asthma Emergency Risk (AER) score. Internal validation was conducted on 8634 patient encounters from 2018. External validation of the AER score was conducted using 1313 pediatric patient encounters from a second site during 2018. The AER score components were then reweighted using logistic regression using data from the second site to improve local model performance. Prediction intervals (PI) were constructed via 10 000 bootstrapped samples.Results: At the first site, the AER score had a cross-validated area under the receiver operating characteristic curve (AUROC) of 0.768 (95% PI: 0.745-0.790) during model training and an AUROC of 0.769 in the 2018 internal validation dataset (p = 0.959). When applied without modification to the second site, the AER score had an AUROC of 0.684 (95% PI: 0.624-0.742). After local refitting, the cross-validated AUROC improved to 0.737 (95% PI: 0.676-0.794; p = 0.037 as compared to initial AUROC).Conclusions: The AER score demonstrated strong internal validity, but external validity was dependent on reweighting model components to reflect local data characteristics at the external site.

The Autonomy Toolbox: A Multicenter Collaborative to Promote Resident Autonomy.

OBJECTIVES: Autonomy is necessary for resident professional development and well-being. A recent focus on patient safety has increased supervision and decreased trainee autonomy. Few validated interventions exist to improve resident autonomy. We aimed to use quality improvement methods to increase our autonomy metric, the Resident Autonomy Score (RAS), by 25% within 1 year and sustain for 6 months. METHODS: We developed a bundled-intervention approach to improve senior resident (SR) perception of autonomy on Pediatric Hospital Medicine (PHM) services at 5 academic children's hospitals. We surveyed SR and PHM faculty perceptions of autonomy and targeted interventions toward areas with the highest discordance. Interventions included SR and faculty development, expectation-setting huddles, and SR independent rounding. We developed a Resident Autonomy Score (RAS) index to track SR perceptions over time. RESULTS: Forty-six percent of SRs and 59% of PHM faculty completed the needs assessment survey querying how often SRs were afforded opportunities to provide autonomous medical care. Faculty and SR ratings were discordant in these domains: SR input in medical decisions, SR autonomous decision-making in straightforward cases, follow-through on SR plans, faculty feedback, SR as team leader, and level of attending oversight. The RAS increased by 19% (3.67 to 4.36) 1 month after SR and faculty professional development and before expectation-setting and independent rounding. This increase was sustained throughout the 18-month study period. CONCLUSIONS: SRs and faculty perceive discordant levels of SR autonomy. We created an adaptable autonomy toolbox that led to sustained improvement in perception of SR autonomy.

In-Office Amoxicillin to Increase Graded-Dose Challenges at Initial Evaluation for Penicillin Allergy.

BACKGROUND: More than 90% of pediatric patients labeled with a penicillin allergy can tolerate subsequent treatment courses without reaction. Graded-dose challenges (GDCs) are an important tool to clarify reported penicillin allergy. OBJECTIVE: To increase the use of same-day amoxicillin GDCs among patients with a low-risk penicillin allergy history who presented for outpatient allergy office evaluation from 2% to 15% and sustain for 6 months. METHODS: New patients evaluated in an academic pediatric allergy clinic with a documented penicillin allergy were included, regardless of reason for referral. The percentage of these patients who were administered a GDC to amoxicillin at the initial evaluation was assessed over time. Multiple interventions were implemented to increase same-day GDC: amoxicillin, previously only available from pharmacy, was made available in clinic, and penicillin-allergic patients were scheduled earlier in the clinic session. RESULTS: The baseline rate of new patients with penicillin allergy who received a GDC increased from 2% to 18% after amoxicillin was stocked in the allergy clinic. GDCs further increased to 34% after penicillin-allergic patients were scheduled at a time conducive to challenge. CONCLUSIONS: Amoxicillin availability in the clinic setting increased the percentage of eligible patients who completed same-day GDCs. Scheduling adjustments further increased the ability to conduct GDCs. Proactive penicillin allergy delabeling efforts can be assisted through practical approaches in the outpatient setting.

"Help Me Sleep": A Quality Initiative to Reduce Overnight Vital Signs.

BACKGROUND AND OBJECTIVES: Sleep is an essential part of the recovery process, yet inpatient sleep quality is poor. Patients and families report that vital signs are the most bothersome overnight disruption. Obtaining vital signs every 4 hours (Q4H) is not evidence-based and is frequently ordered indiscriminately. We aimed to decrease the percentage of patient nights with vital sign checks between 12 am and 6 am in a low-risk population from 98% to 70% within 12 months to minimize overnight sleep disruptions and improve inpatient sleep. METHODS: We conducted a quality improvement project on 3 pediatric hospital medicine teams at a large free-standing children's hospital. Our multidisciplinary team defined low-risk patients as those admitted for hyperbilirubinemia and failure to thrive. Interventions were focused around education, electronic health record decision support, and patient safety. The outcome measure was the percentage of patient nights without a vital sign measurement between 12 am and 6 am and was analyzed by using statistical process control charts. Our process measure was the use of an appropriate vital sign order. Balancing measures included adverse patient events, specifically code blues outside the ICU and emergent transfers. RESULTS: From March 2020 to April 2021, our pediatric hospital medicine (PHM) services admitted 449 low-risk patients for a total of 1550 inpatient nights. The percentage of patient nights with overnight vital signs decreased from 98% to 38%. There were no code blues or emergent transfers. CONCLUSION: Our improvement interventions reduced the frequency of overnight vital sign monitoring in 2 low-risk groups without any adverse events.

Unexpected decline in pediatric asthma morbidity during the coronavirus pandemic.

The Coronavirus disease 2019 (COVID-19) pandemic profoundly impacted health care utilization. We evaluated asthma-related emergency department (ED) and inpatient health care utilization by a county-specific Medicaid population, ages 2-18, during the COVID-19 pandemic and compared it to utilization from a 3-year average including 2017-2019. All-cause ED utilization and asthma medication fill rates were evaluated during the same timeframes. Relative to the 2017-2019 3-year average, cumulative asthma-related ED visits from January through June decreased by 45.8% (p = .03) and inpatient admission rates decreased by 50.5% (p = .03). The decline in asthma-related ED utilization was greater than the reduction of overall ED use during the same time period, suggesting that the decline involved factors specific to asthma and was not due solely to avoidance of health care facilities. Fill rates for asthma controller medications decreased during this time (p = .03) and quick relief medication fill rates had no significant change (p = .31). Multiple factors may have contributed to the decrease in acute asthma health care visits. Locally, decreased air pollution and viral exposures coincided with the "Stay-at-home" order in Ohio, and increased utilization of telehealth for assessment during exacerbations may have impacted outcomes. Identification of the cause of the decline in visit rates could spur new interventions to limit the need for ED and inpatient visits for asthma patients, leading to both economic and health-associated benefits.

Pediatric Inpatient Problem List Review and Accuracy Improvement.

BACKGROUND AND OBJECTIVES: The problem list (PL) is a meaningful use-incentivized criterion for electronic health record documentation. Inconsistent use or inaccuracy of the PL can create communication gaps among providers, potentially leading to diagnostic delays and serious safety events. The objective of the study was to increase the rate of PL review by attending physicians for inpatients discharged from hospital pediatrics and infectious disease services from a baseline of 70% to 80% by June 2018 and to sustain the rate for 6 months. The secondary aim was to improve PL accuracy by decreasing the rate of duplicate codes and red code diagnoses that should resolve before discharge from a baseline of 12% and 11%, respectively, to 5% and sustaining the rate for 6 months. METHODS: A quality improvement team used the Institute for Healthcare Improvement Model for Improvement. We tracked duplicate codes and red codes as surrogate markers of PL quality. Rates of PL review and PL quality were analyzed monthly via statistical process control charts (p-charts) with 3-σ control limits to identify special cause variation. RESULTS: PL review improved from a baseline of 70% to 90%, and the change was sustained for 1 year. PL quality improved as duplicate codes at the time of discharge decreased from 12% to 6% and as red codes decreased from a baseline of 11% to 6%. CONCLUSIONS: The PL is an important communication tool that is underused. By engaging and educating stakeholders, incentivizing compliance, standardizing PL management, leveraging electronic health record enhancements, and providing physician feedback, we improved PL meaningful use and quality.

Improving Early Discharges With an Electronic Health Record Discharge Optimization Tool.

INTRODUCTION: Delays in hospital discharge can negatively impact patient care, bed availability, and patient satisfaction. There are limited studies examining how the electronic health record (EHR) can be used to improve discharge timeliness. This study aimed to implement an EHR discharge optimization tool (DOT) successfully and achieve a discharge before noon (DBN) percentage of 25%. METHODS: We conducted a single-center quality improvement study of patients discharged from 3 pediatric hospital medicine teaching service teams at a quaternary care academic children's hospital. The multidisciplinary team created a DOT centrally embedded within the care team standard workflow to communicate anticipated time until discharge. The primary outcome was the monthly percentage of patients discharged before noon. Secondary outcomes included provider utilization of the DOT, tool accuracy, and patient length of stay. Balancing measures were 7- and 30-day readmission rates. RESULTS: The DBN percentage increased from 16.4% to an average of 19.3% over the 13-month intervention period (P = 0.0005). DOT utilization was measured at 87.2%, and the overall accuracy of predicting time until discharge was 75.6% (P < 0.0001). Median length of stay declined from 1.75 to 1.68 days (P = 0.0033), and there was no negative impact on 7- or 30-day readmission rates. CONCLUSION: This initiative demonstrated that a highly utilized and accurate discharge tool could be created in the EHR to assist medical care teams with improving DBN percentage on busy, academic teaching services.