Prognostic clinical decision support for pneumonia in the emergency department: A randomized trial.

BACKGROUND: Hospitalization rates for childhood pneumonia vary widely. Risk-based clinical decision support (CDS) interventions may reduce unwarranted variation. METHODS: We conducted a pragmatic randomized trial in two US pediatric emergency departments (EDs) comparing electronic health record (EHR)-integrated prognostic CDS versus usual care for promoting appropriate ED disposition in children (<18 years) with pneumonia. Encounters were randomized 1:1 to usual care versus custom CDS featuring a validated pneumonia severity score predicting risk for severe in-hospital outcomes. Clinicians retained full decision-making authority. The primary outcome was inappropriate ED disposition, defined as early transition to lower- or higher-level care. Safety and implementation outcomes were also evaluated. RESULTS: The study enrolled 536 encounters (269 usual care and 267 CDS). Baseline characteristics were similar across arms. Inappropriate disposition occurred in 3% of usual care encounters and 2% of CDS encounters (adjusted odds ratio: 0.99, 95% confidence interval: [0.32, 2.95]). Length of stay was also similar and adverse safety outcomes were uncommon in both arms. The tool's custom user interface and content were viewed as strengths by surveyed clinicians (>70% satisfied). Implementation barriers include intrinsic (e.g., reaching the right person at the right time) and extrinsic factors (i.e., global pandemic). CONCLUSIONS: EHR-based prognostic CDS did not improve ED disposition decisions for children with pneumonia. Although the intervention's content was favorably received, low subject accrual and workflow integration problems likely limited effectiveness. Clinical Trials Registration: NCT06033079.

User-Centered Design and Implementation of an Interoperable FHIR Application for Pediatric Pneumonia Prognostication in a Randomized Trial.

OBJECTIVES: To support a pragmatic, electronic health record (EHR)-based randomized controlled trial, we applied user-centered design (UCD) principles, evidence-based risk communication strategies, and interoperable software architecture to design, test, and deploy a prognostic tool for children in emergency departments (EDs) with pneumonia. METHODS: Risk for severe in-hospital outcomes was estimated using a validated ordinal logistic regression model to classify pneumonia severity. To render the results usable for ED clinicians, we created an integrated SMART on Fast Healthcare Interoperability Resources (FHIR) web application built for interoperable use in two pediatric EDs using different EHR vendors: Epic and Cerner. We followed a UCD framework, including problem analysis and user research, conceptual design and early prototyping, user interface development, formative evaluation, and postdeployment summative evaluation. RESULTS: Problem analysis and user research from 39 clinicians and nurses revealed user preferences for risk aversion, accessibility, and timing of risk communication. Early prototyping and iterative design incorporated evidence-based design principles, including numeracy, risk framing, and best-practice visualization techniques. After rigorous unit and end-to-end testing, the application was successfully deployed in both EDs, which facilitated enrollment, randomization, model visualization, data capture, and reporting for trial purposes. CONCLUSION: The successful implementation of a custom application for pneumonia prognosis and clinical trial support in two health systems on different EHRs demonstrates the importance of UCD, adherence to modern clinical data standards, and rigorous testing. Key lessons included the need for understanding users' real-world needs, regular knowledge management, application maintenance, and the recognition that FHIR applications require careful configuration for interoperability.

Antibiotic clinical decision support for pneumonia in the ED: A randomized trial.

BACKGROUND: Electronic health record-based clinical decision support (CDS) is a promising antibiotic stewardship strategy. Few studies have evaluated the effectiveness of antibiotic CDS in the pediatric emergency department (ED). OBJECTIVE: To compare the effectiveness of antibiotic CDS vs. usual care for promoting guideline-concordant antibiotic prescribing for pneumonia in the pediatric ED. DESIGN: Pragmatic randomized clinical trial. SETTING AND PARTICIPANTS: Encounters for children (6 months-18 years) with pneumonia presenting to two tertiary care children s hospital EDs in the United States. INTERVENTION: CDS or usual care was randomly assigned during 4-week periods within each site. The CDS intervention provided antibiotic recommendations tailored to each encounter and in accordance with national guidelines. MAIN OUTCOME AND MEASURES: The primary outcome was exclusive guideline-concordant antibiotic prescribing within the first 24 h of care. Safety outcomes included time to first antibiotic order, encounter length of stay, delayed intensive care, and 3- and 7-day revisits. RESULTS: 1027 encounters were included, encompassing 478 randomized to usual care and 549 to CDS. Exclusive guideline-concordant prescribing did not differ at 24 h (CDS, 51.7% vs. usual care, 53.3%; odds ratio [OR] 0.94 [95% confidence interval [CI]: 0.73, 1.20]). In pre-specified stratified analyses, CDS was associated with guideline-concordant prescribing among encounters discharged from the ED (74.9% vs. 66.0%; OR 1.53 [95% CI: 1.01, 2.33]), but not among hospitalized encounters. Mean time to first antibiotic was shorter in the CDS group (3.0 vs 3.4 h; p = .024). There were no differences in safety outcomes. CONCLUSIONS: Effectiveness of ED-based antibiotic CDS was greatest among those discharged from the ED. Longitudinal interventions designed to target both ED and inpatient clinicians and to address common implementation challenges may enhance the effectiveness of CDS as a stewardship tool.

A multi-site randomized trial of a clinical decision support intervention to improve problem list completeness.

OBJECTIVE: To improve problem list documentation and care quality. MATERIALS AND METHODS: We developed algorithms to infer clinical problems a patient has that are not recorded on the coded problem list using structured data in the electronic health record (EHR) for 12 clinically significant heart, lung, and blood diseases. We also developed a clinical decision support (CDS) intervention which suggests adding missing problems to the problem list. We evaluated the intervention at 4 diverse healthcare systems using 3 different EHRs in a randomized trial using 3 predetermined outcome measures: alert acceptance, problem addition, and National Committee for Quality Assurance Healthcare Effectiveness Data and Information Set (NCQA HEDIS) clinical quality measures. RESULTS: There were 288 832 opportunities to add a problem in the intervention arm and the problem was added 63 777 times (acceptance rate 22.1%). The intervention arm had 4.6 times as many problems added as the control arm. There were no significant differences in any of the clinical quality measures. DISCUSSION: The CDS intervention was highly effective at improving problem list completeness. However, the improvement in problem list utilization was not associated with improvement in the quality measures. The lack of effect on quality measures suggests that problem list documentation is not directly associated with improvements in quality measured by National Committee for Quality Assurance Healthcare Effectiveness Data and Information Set (NCQA HEDIS) quality measures. However, improved problem list accuracy has other benefits, including clinical care, patient comprehension of health conditions, accurate CDS and population health, and for research. CONCLUSION: An EHR-embedded CDS intervention was effective at improving problem list completeness but was not associated with improvement in quality measures.

Impact of Updating Pharmacogenetic Results: Lessons Learned from the PREDICT Program.

Pharmacogenomic (PGx) evidence for selective serotonin reuptake inhibitors (SSRIs) continues to evolve. For sites offering testing, maintaining up-to-date interpretations and implementing new clinical decision support (CDS) driven by existing results creates practical and technical challenges. Vanderbilt University Medical Center initiated panel testing in 2010, added CYP2D6 testing in 2017, and released CDS for SSRIs in 2020. We systematically reinterpreted historic CYP2C19 and CYP2D6 genotypes to update phenotypes to current nomenclature and to launch provider CDS and patient-oriented content for SSRIs. Chart review was conducted to identify and recontact providers caring for patients with current SSRI therapy and new actionable recommendations. A total of 15,619 patients' PGx results were reprocessed. Of the non-deceased patients reprocessed, 21% (n = 3278) resulted in CYP2C19*1/*17 reinterpretations. Among 289 patients with an actionable recommendation and SSRI medication prescription, 31.8% (n = 92) did not necessitate contact of a clinician, while 43.2% (n = 125) resulted in clinician contacted, and for 25% (n = 72) no appropriate clinician was able to be identified. Maintenance of up-to-date interpretations and recommendations for PGx results over the lifetime of a patient requires continuous effort. Reprocessing is a key strategy for maintenance and expansion of PGx content to be periodically considered and implemented.

A Tutorial for Pharmacogenomics Implementation Through End-to-End Clinical Decision Support Based on Ten Years of Experience from PREDICT.

Vanderbilt University Medical Center implemented pharmacogenomics (PGx) testing with the Pharmacogenomic Resource for Enhanced Decisions in Care and Treatment (PREDICT) initiative in 2010. This tutorial reviews the laboratory considerations, technical infrastructure, and programmatic support required to deliver panel-based PGx testing across a large health system with examples and experiences from the first decade of the PREDICT initiative. From the time of inception, automated clinical decision support (CDS) has been a critical capability for delivering PGx results to the point-of-care. Key features of the CDS include human-readable interpretations and clinical guidance that is anticipatory, actionable, and adaptable to changes in the scientific literature. Implementing CDS requires that structured results from the laboratory be encoded in standards-based messages that are securely ingested by electronic health records. Translating results to guidance also requires an informatics infrastructure with multiple components: (1) to manage the interpretation of raw genomic data to "star allele" results to expected phenotype, (2) to define the rules that associate a phenotype with recommended changes to clinical care, and (3) to manage and update the knowledge base. Knowledge base management is key to processing new results with the latest guidelines, and to ensure that historical genomic results can be reinterpreted with revised CDS. We recommend that these components be deployed with institutional authorization, programmatic support, and clinician education to govern the CDS content and policies around delivery.

Is the Climb Worth the View? The Savings/Alert Ratio for Reducing Vitamin D Testing.

BACKGROUND: Despite guideline recommendations, vitamin D testing has increased substantially. Clinical decision support (CDS) presents an opportunity to reduce inappropriate laboratory testing. OBJECTIVES AND METHODS: To reduce inappropriate testing of vitamin D at the Vanderbilt University Medical Center, a CDS assigned providers to receive or not receive an electronic alert each time a 25-hydroxyvitamin D assay was ordered for an adult patient unless the order was associated with a diagnosis in the patient's chart for which vitamin D testing is recommended. The CDS ran for 80 days, collecting data on number of tests, provider information, and basic patient demographics. RESULTS: During the 80 days, providers placed 12,368 orders for 25-hydroxyvitamin D. The intervention group ordered a vitamin D assay and received the alert for potentially inappropriate testing 2,181 times and completed the 25-hydroxyvitamin D order in 89.9% of encounters, while the control group ordered a vitamin D assay (without receiving an alert) 2,032 times and completed the order in 98.1% of encounters, for an absolute reduction of testing of 8% (p < 0.001). CONCLUSION: This CDS reduced vitamin D ordering by utilizing a soft-stop approach. At a charge of $179.00 per test and a cost to the laboratory of $4.20 per test, each display of the alert led to an average reduction of $14.70 in charges and of $0.34 in spending by the laboratory (the savings/alert ratio). By describing the effectiveness of an electronic alert in terms of the savings/alert ratio, the impact of this intervention can be better appreciated and compared with other interventions.