Impact of Local Tailoring on Acute Stroke Care in 21 Disparate Emergency Departments: A Prospective Stepped Wedge Type III Hybrid Effectiveness-Implementation Study.

BACKGROUND: Faster delivery of tPA (tissue-type plasminogen activator) results in better health outcomes for eligible patients with stroke. Standardization of stroke protocols in emergency departments (EDs) has been difficult, especially in nonstroke centers. We measured the effectiveness of a centrally led implementation strategy with local site tailoring to sustain adherence to an acute stroke protocol to improve door-to-needle (DTN) times across disparate EDs in a multihospital health system. METHODS: Prospective, type III hybrid effectiveness-implementation cohort study measuring performance at 21 EDs in Utah and Idaho (stroke centers [4]/nonstroke centers [17]) from January 2018 to February 2020 using a nonrandomized stepped-wedge design, monthly repeated site measures and multilevel hierarchical modeling. Each site received the implementation strategies in 1 of 6 steps providing control and intervention data. Co-primary outcomes were percentage of DTN times ≤60 minutes and median DTN time. Secondary outcomes included percentage of door-to-activation of neurological consult times ≤10 minutes and clinical effectiveness outcomes. Results were stratified between stroke and nonstroke centers. RESULTS: A total of 855 474 ED patient encounters occurred with 5325 code stroke activations (median age, 69 [IQR, 56-79] years; 51.8% female patients]. Percentage of door-to-activation times ≤10 minutes increased from 47.5% to 59.9% (adjusted odds ratio, 1.93 [95% CI, 1.40-2.67]). A total of 615 patients received tPA of ≤3 hours from symptom onset (median age, 71 [IQR, 58-80] years; 49.6% female patients). The percentage of DTN times ≤60 minutes increased from 72.5% to 86.1% (adjusted odds ratio, 3.38, [95% CI, 1.47-7.78]; stroke centers (77.4%-90.0%); nonstroke centers [59.3%-72.1%]). Median DTN time declined from 46 to 38 minutes (adjusted median difference, -9.68 [95% CI, -17.17 to -2.20]; stroke centers [41-35 minutes]; nonstroke centers [55-52 minutes]). No differences were observed in clinical effectiveness outcomes. CONCLUSIONS: A centrally led implementation strategy with local site tailoring led to faster delivery of tPA across disparate EDs in a multihospital system with no change in clinical effectiveness outcomes including rates of complication. Disparities in performance persisted between stroke and nonstroke centers.

Identifying Patients for Intensive Blood Pressure Treatment Based on Cognitive Benefit: A Secondary Analysis of the SPRINT Randomized Clinical Trial.

Importance: Intensive vs standard treatment to lower systolic blood pressure (SBP) reduces risk of mild cognitive impairment (MCI) or dementia; however, the magnitude of cognitive benefit likely varies among patients. Objective: To estimate the magnitude of cognitive benefit of intensive vs standard systolic BP (SBP) treatment. Design, Setting, and Participants: In this ad hoc secondary analysis of the Systolic Blood Pressure Intervention Trial (SPRINT), 9361 randomized clinical trial participants 50 years or older with high cardiovascular risk but without a history of diabetes, stroke, or dementia were followed up. The SPRINT trial was conducted between November 1, 2010, and August 31, 2016, and the present analysis was completed on October 31, 2022. Intervention: Systolic blood pressure treatment to an intensive (<120 mm Hg) vs standard (<140 mm Hg) target. Main Outcomes and Measures: The primary outcome was a composite of adjudicated probable dementia or amnestic MCI. Results: A total of 7918 SPRINT participants were included in the analysis; 3989 were in the intensive treatment group (mean [SD] age, 67.9 [9.2] years; 2570 [64.4%] men; 1212 [30.4%] non-Hispanic Black) and 3929 were in the standard treatment group (mean [SD] age, 67.9 [9.4] years; 2570 [65.4%] men; 1249 [31.8%] non-Hispanic Black). Over a median follow-up of 4.13 (IQR, 3.50-5.88) years, there were 765 and 828 primary outcome events in the intensive treatment group and standard treatment group, respectively. Older age (hazard ratio [HR] per 1 SD, 1.87 [95% CI, 1.78-1.96]), Medicare enrollment (HR per 1 SD, 1.42 [95% CI, 1.35-1.49]), and higher baseline serum creatinine level (HR per 1 SD, 1.24 [95% CI, 1.19-1.29]) were associated with higher risk of the primary outcome, while better baseline cognitive functioning (HR per 1 SD, 0.43 [95% CI, 0.41-0.44]) and active employment status (HR per 1 SD, 0.44 [95% CI, 0.42-0.46]) were associated with lower risk of the primary outcome. Risk of the primary outcome by treatment goal was estimated accurately based on similar projected and observed absolute risk differences (C statistic = 0.79). Higher baseline risk for the primary outcome was associated with greater benefit (ie, larger absolute reduction of probable dementia or amnestic MCI) of intensive vs standard treatment across the full range of estimated baseline risk. Conclusions and Relevance: In this secondary analysis of the SPRINT trial, participants with higher baseline projected risk of probable dementia or amnestic MCI gained greater absolute cognitive benefit from intensive vs standard SBP treatment in a monotonic fashion. Trial Registration: ClinicalTrials.gov Identifier: NCT01206062.

An efficient approach for optimizing the cost-effective individualized treatment rule using conditional random forest.

Evidence from observational studies has become increasingly important for supporting healthcare policy making via cost-effectiveness analyses. Similar as in comparative effectiveness studies, health economic evaluations that consider subject-level heterogeneity produce individualized treatment rules that are often more cost-effective than one-size-fits-all treatment. Thus, it is of great interest to develop statistical tools for learning such a cost-effective individualized treatment rule under the causal inference framework that allows proper handling of potential confounding and can be applied to both trials and observational studies. In this paper, we use the concept of net-monetary-benefit to assess the trade-off between health benefits and related costs. We estimate cost-effective individualized treatment rule as a function of patients' characteristics that, when implemented, optimizes the allocation of limited healthcare resources by maximizing health gains while minimizing treatment-related costs. We employ the conditional random forest approach and identify the optimal cost-effective individualized treatment rule using net-monetary-benefit-based classification algorithms, where two partitioned estimators are proposed for the subject-specific weights to effectively incorporate information from censored individuals. We conduct simulation studies to evaluate the performance of our proposals. We apply our top-performing algorithm to the NIH-funded Systolic Blood Pressure Intervention Trial to illustrate the cost-effectiveness gains of assigning customized intensive blood pressure therapy.

Analysis of Therapeutic Inertia and Race and Ethnicity in the Systolic Blood Pressure Intervention Trial: A Secondary Analysis of a Randomized Clinical Trial.

Importance: Therapeutic inertia may contribute to racial and ethnic differences in blood pressure (BP) control. Objective: To determine the association between race and ethnicity and therapeutic inertia in the Systolic Blood Pressure Intervention Trial (SPRINT). Design, Setting, and Participants: This cross-sectional study was a secondary analysis of data from SPRINT, a randomized clinical trial comparing intensive (<120 mm Hg) vs standard (<140 mm Hg) systolic BP treatment goals. Participants were enrolled between November 8, 2010, and March 15, 2013, with a median follow-up 3.26 years. Participants included adults aged 50 years or older at high risk for cardiovascular disease but without diabetes, previous stroke, or heart failure. The present analysis was restricted to participant visits with measured BP above the target goal. Analyses for the present study were performed in from October 2020 through March 2021. Exposures: Self-reported race and ethnicity, mutually exclusively categorized into groups of Hispanic, non-Hispanic Black, or non-Hispanic White participants. Main Outcomes and Measures: Therapeutic inertia, defined as no antihypertensive medication intensification at each study visit where the BP was above target goal. The association between self-reported race and ethnicity and therapeutic inertia was estimated using generalized estimating equations and stratified by treatment group. Antihypertensive medication use was assessed with pill bottle inventories at each visit. Blood pressure was measured using an automated device. Results: A total of 8556 participants, including 4141 in the standard group (22 844 participant-visits; median age, 67.0 years [IQR, 61.0-76.0 years]; 1467 women [35.4%]) and 4415 in the intensive group (35 453 participant-visits; median age, 67.0 years [IQR, 61.0-76.0 years]; 1584 women [35.9%]) with at least 1 eligible study visit were included in the present analysis. Among non-Hispanic White, non-Hispanic Black, and Hispanic participants, the overall prevalence of therapeutic inertia in the standard vs intensive groups was 59.8% (95% CI, 58.9%-60.7%) vs 56.0% (95% CI, 55.2%-56.7%), 56.8% (95% CI, 54.4%-59.2%) vs 54.5% (95% CI, 52.4%-56.6%), and 59.7% (95% CI, 56.5%-63.0%) vs 51.0% (95% CI, 47.4%-54.5%), respectively. The adjusted odds ratios in the standard and intensive groups for therapeutic inertia associated with non-Hispanic Black vs non-Hispanic White participants were 0.85 (95% CI, 0.79-0.92) and 0.94 (95% CI, 0.88-1.01), respectively. The adjusted odds ratios for therapeutic inertia comparing Hispanic vs non-Hispanic White participants were 1.00 (95% CI, 0.90-1.13) and 0.89 (95% CI, 0.79-1.00) in the standard and intensive groups, respectively. Conclusions and Relevance: Among SPRINT participants above BP target goal, this cross-sectional study found that therapeutic inertia prevalence was similar or lower for non-Hispanic Black and Hispanic participants compared with non-Hispanic White participants. These findings suggest that a standardized approach to BP management, as used in SPRINT, may help ensure equitable care and could reduce the contribution of therapeutic inertia to disparities in hypertension. Trial Registration: ClinicalTrials.gov identifier: NCT01206062.

Estimating the optimal individualized treatment rule from a cost-effectiveness perspective.

Optimal individualized treatment rules (ITRs) provide customized treatment recommendations based on subject characteristics to maximize clinical benefit in accordance with the objectives in precision medicine. As a result, there is growing interest in developing statistical tools for estimating optimal ITRs in evidence-based research. In health economic perspectives, policy makers consider the tradeoff between health gains and incremental costs of interventions to set priorities and allocate resources. However, most work on ITRs has focused on maximizing the effectiveness of treatment without considering costs. In this paper, we jointly consider the impact of effectiveness and cost on treatment decisions and define ITRs under a composite-outcome setting, so that we identify the most cost-effective ITR that accounts for individual-level heterogeneity through direct optimization. In particular, we propose a decision-tree-based statistical learning algorithm that uses a net-monetary-benefit-based reward to provide nonparametric estimations of the optimal ITR. We provide several approaches to estimating the reward underlying the ITR as a function of subject characteristics. We present the strengths and weaknesses of each approach and provide practical guidelines by comparing their performance in simulation studies. We illustrate the top-performing approach from our simulations by evaluating the projected 15-year personalized cost-effectiveness of the intensive blood pressure control of the Systolic Blood Pressure Intervention Trial (SPRINT) study.

Factors That Contribute to Cost Differences Based on ICU of Admission in Neonates Undergoing Congenital Heart Surgery: A Novel Decomposition Analysis.

OBJECTIVES: We leveraged decomposition analysis, commonly used in labor economics, to understand determinants of cost differences related to location of admission in children undergoing neonatal congenital heart surgery. DESIGN: A retrospective cohort study. SETTING: Pediatric Health Information Systems database. PATIENTS: Neonates (<30 d old) undergoing their index congenital heart surgery between 2004 and 2013. MEASUREMENTS AND MAIN RESULTS: A decomposition analysis with bootstrapping determined characteristic (explainable by differing covariate levels) and structural effects (if covariates are held constant) related to cost differences. Covariates included center volume, age at admission, prematurity, sex, race, genetic or major noncardiac abnormality, Risk Adjustment for Congenital Heart Surgery-1 score, payor, admission year, cardiac arrest, infection, and delayed sternal closure.Of 19,984 infants included (10,491 [52%] to cardiac ICU/PICU and 9,493 [48%] to neonatal ICU), admission to the neonatal ICU had overall higher average costs ($24,959 ± $3,260; p < 0.001) versus cardiac ICU/PICU admission. Characteristic effects accounted for higher costs in the neonatal ICU ($28,958 ± $2,044; p < 0.001). Differing levels of prematurity, genetic syndromes, hospital volume, age at admission, and infection contributed to higher neonatal ICU costs, with infection rate providing the most significant contribution ($13,581; p < 0.001). Aggregate structural effects were not associated with cost differences for those admitted to the neonatal ICU versus cardiac ICU/PICU (p = 0.1). Individually, prematurity and age at admission were associated with higher costs due to structural effects for infants admitted to the neonatal ICU versus cardiac ICU/PICU. CONCLUSIONS: The difference in cost between neonatal ICU and cardiac ICU/PICU admissions is largely driven by differing prevalence of risk factors between these units. Infection rate was a modifiable factor that accounted for the largest difference in costs between admitting units.

Implementation of a Value-Driven Outcomes Program to Identify High Variability in Clinical Costs and Outcomes and Association With Reduced Cost and Improved Quality.

IMPORTANCE: Transformation of US health care from volume to value requires meaningful quantification of costs and outcomes at the level of individual patients. OBJECTIVE: To measure the association of a value-driven outcomes tool that allocates costs of care and quality measures to individual patient encounters with cost reduction and health outcome optimization. DESIGN, SETTING, AND PARTICIPANTS: Uncontrolled, pre-post, longitudinal, observational study measuring quality and outcomes relative to cost from 2012 to 2016 at University of Utah Health Care. Clinical improvement projects included total hip and knee joint replacement, hospitalist laboratory utilization, and management of sepsis. EXPOSURES: Physicians were given access to a tool with information about outcomes, costs (not charges), and variation and partnered with process improvement experts. MAIN OUTCOMES AND MEASURES: Total and component inpatient and outpatient direct costs across departments; cost variability for Medicare severity diagnosis related groups measured as coefficient of variation (CV); and care costs and composite quality indexes. RESULTS: From July 1, 2014, to June 30, 2015, there were 1.7 million total patient visits, including 34 000 inpatient discharges. Professional costs accounted for 24.3% of total costs for inpatient episodes ($114.4 million of $470.4 million) and 41.9% of total costs for outpatient visits ($231.7 million of $553.1 million). For Medicare severity diagnosis related groups with the highest total direct costs, cost variability was highest for postoperative infection (CV = 1.71) and sepsis (CV = 1.37) and among the lowest for organ transplantation (CV ≤ 0.43). For total joint replacement, a composite quality index was 54% at baseline (n = 233 encounters) and 80% 1 year into the implementation (n = 188 encounters) (absolute change, 26%; 95% CI, 18%-35%; P < .001). Compared with the baseline year, mean direct costs were 7% lower in the implementation year (95% CI, 3%-11%; P < .001) and 11% lower in the postimplementation year (95% CI, 7%-14%; P < .001). The hospitalist laboratory testing mean cost per day was $138 (median [IQR], $113 [$79-160]; n = 2034 encounters) at baseline and $123 (median [IQR], $99 [$66-147]; n = 4276 encounters) in the evaluation period (mean difference, -$15; 95% CI, -$19 to -$11; P < .001), with no significant change in mean length of stay. For a pilot sepsis intervention, the mean time to anti-infective administration following fulfillment of systemic inflammatory response syndrome criteria in patients with infection was 7.8 hours (median [IQR], 3.4 [0.8-7.8] hours; n = 29 encounters) at baseline and 3.6 hours (median [IQR], 2.2 [1.0-4.5] hours; n = 76 encounters) in the evaluation period (mean difference, -4.1 hours; 95% CI, -9.9 to -1.0 hours; P = .02). CONCLUSIONS AND RELEVANCE: Implementation of a multifaceted value-driven outcomes tool to identify high variability in costs and outcomes in a large single health care system was associated with reduced costs and improved quality for 3 selected clinical projects. There may be benefit for individual physicians to understand actual care costs (not charges) and outcomes achieved for individual patients with defined clinical conditions.

Variation in pediatric outpatient adenotonsillectomy costs in a multihospital network.

OBJECTIVES/HYPOTHESIS: Identify hospital costs for same-day pediatric adenotonsillectomy (T&A) surgery, and evaluate surgeon, hospital, and patient factors influencing variation in costs, and compare relationship of costs to complications for T&A. STUDY DESIGN: Observational retrospective cohort study. METHODS: A multihospital network's standardized activity-based accounting system was used to determine hospital costs per T&A from 1998 to 2012. Children 1 to 18 years old who underwent same-day T&A surgery were included. Subjects with additional procedures were excluded. Mixed effects analyses were performed to identify variation in mean costs due to surgeon, hospital, and patient factors. Surgeons' mean cost/case was related to subsequent complications, defined as any unplanned visit within 21 days in the healthcare system. RESULTS: The study cohort included 26,626 T&As performed by 66 surgeons at 18 hospitals. Mean cost per T&A was $1,355 ± $505. Mixed effects analysis using patient factors as fixed effects and surgeon and hospital as a random effect identified significant variation in mean costs per surgeon, with 95% of surgeons having a mean cost/case between 67% and 150% of the overall mean (range, $874-$2,232/case). Similar variability was found among hospitals, with 95% of the facilities having mean costs between 64% to 156% of the mean (range, $1,029-$2,385/case). Severity of illness and several other patient factors exhibited small but statistically significant associations with cost. Surgeons' mean cost/case was moderately associated with an increased complication rate. CONCLUSIONS: Significant variation in same-day pediatric T&A surgery costs exists among different surgeons and hospitals within a multihospital network. Reducing variation in costs while maintaining outcomes may improve healthcare value and eliminate waste. LEVEL OF EVIDENCE: 4.