Development and Validation of the Hospital Medicine Safety Sepsis Initiative Mortality Model.

BACKGROUND: When comparing outcomes after sepsis, it is essential to account for patient case mix to make fair comparisons. We developed a model to assess risk-adjusted 30-day mortality in the Michigan Hospital Medicine Safety sepsis initiative (HMS-Sepsis). RESEARCH QUESTION: Can HMS-Sepsis registry data adequately predict risk of 30-day mortality? Do performance assessments using adjusted vs unadjusted data differ? STUDY DESIGN AND METHODS: Retrospective cohort of community-onset sepsis hospitalizations in the HMS-Sepsis registry (April 2022-September 2023), with split-derivation (70%) and validation (30%) cohorts. We fit a risk-adjustment model (HMS-Sepsis mortality model) incorporating acute physiologic, demographic, and baseline health data and assessed model performance using concordance (C) statistics, Brier's scores, and comparisons of predicted vs observed mortality by deciles of risk. We compared hospital performance (first quintile, middle quintiles, fifth quintile) using observed vs adjusted mortality to understand the extent to which risk adjustment impacted hospital performance assessment. RESULTS: Among 17,514 hospitalizations from 66 hospitals during the study period, 12,260 hospitalizations (70%) were used for model derivation and 5,254 hospitalizations (30%) were used for model validation. Thirty-day mortality for the total cohort was 19.4%. The final model included 13 physiologic variables, two physiologic interactions, and 16 demographic and chronic health variables. The most significant variables were age, metastatic solid tumor, temperature, altered mental status, and platelet count. The model C statistic was 0.82 for the derivation cohort, 0.81 for the validation cohort, and ≥ 0.78 for all subgroups assessed. Overall calibration error was 0.0%, and mean calibration error across deciles of risk was 1.5%. Standardized mortality ratios yielded different assessments than observed mortality for 33.9% of hospitals. INTERPRETATION: The HMS-Sepsis mortality model showed strong discrimination and adequate calibration and reclassified one-third of hospitals to a different performance category from unadjusted mortality. Based on its strong performance, the HMS-Sepsis mortality model can aid in fair hospital benchmarking, assessment of temporal changes, and observational causal inference analysis.

Improving Appropriate Use of Peripherally Inserted Central Catheters Through a Statewide Collaborative Hospital Initiative: A Cost-Effectiveness Analysis.

BACKGROUND: Quality improvement (QI) programs require significant financial investment. The authors evaluated the cost-effectiveness of a physician-led, performance-incentivized, QI intervention that increased appropriate peripherally inserted central catheter (PICC) use. METHODS: The authors used an economic evaluation from a health care sector perspective. Implementation costs included incentive payments to hospitals and costs for data abstractors and the coordinating center. Effectiveness was calculated from propensity score-matched observations across two time periods for complications (venous thromboembolism [VTE], central line-associated bloodstream infection [CLABSI], and catheter occlusion): preintervention period (January 2015 through December 2016) and intervention period (January 2017 through December 2021). Cost-effectiveness was presented as the cost-offset per averted complication, reflecting the health care costs avoided due to having lower complication rates. RESULTS: Across 35 hospitals, this study sampled 17,418 PICCs placed preintervention and 26,004 placed during the intervention period. PICC complications decreased significantly following the intervention. CLABSIs decreased from 2.1% to 1.5%, VTEs from 3.2% to 2.3%, and catheter occlusions from 10.8% to 7.0% (all p < 0.01). Estimated number of complications prevented included 871 CLABSIs, 2,535 VTEs, and 8,743 catheter occlusions. Project implementation costs were $31.8 million, and the cost-offset related to avoided complications was $64.4 million. Each participating hospital averaged $932,073 in cost-offset over seven years, and the average cost-offset per complication averted was $2,614 (95% CI [confidence interval] $2,314-$3,003). CONCLUSION: A large-scale, multihospital QI initiative to improve appropriate PICC use yielded substantial return on investment from cost-offset of prevented complications.

Protocol for a parallel cluster randomized trial of a participatory tailored approach to reduce overuse of antibiotics at hospital discharge: the ROAD home trial.

BACKGROUND: Antibiotic overuse at hospital discharge is common, costly, and harmful. While discharge-specific antibiotic stewardship interventions are effective, they are resource-intensive and often infeasible for hospitals with resource constraints. This weakness impacts generalizability of stewardship interventions and has health equity implications as not all patients have access to the benefits of stewardship based on where they receive care. There may be different pathways to improve discharge antibiotic prescribing that vary widely in feasibility. Supporting hospitals in selecting interventions tailored to their context may be an effective approach to feasibly reduce antibiotic overuse at discharge across diverse hospitals. The objective of this study is to evaluate the effectiveness of the Reducing Overuse of Antibiotics at Discharge Home multicomponent implementation strategy ("ROAD Home") on antibiotic overuse at discharge for community-acquired pneumonia and urinary tract infection. METHODS: This 4-year two-arm parallel cluster-randomized trial will include three phases: baseline (23 months), intervention (12 months), and postintervention (12 months). Forty hospitals recruited from the Michigan Hospital Medicine Safety Consortium will undergo covariate-constrained randomization with half randomized to the ROAD Home implementation strategy and half to a "stewardship as usual" control. ROAD Home is informed by the integrated-Promoting Action on Research Implementation in Health Services Framework and includes (1) a baseline needs assessment to create a tailored suite of potential stewardship interventions, (2) supported decision-making in selecting interventions to implement, and (3) external facilitation following an implementation blueprint. The primary outcome is baseline-adjusted days of antibiotic overuse at discharge. Secondary outcomes include 30-day patient outcomes and antibiotic-associated adverse events. A mixed-methods concurrent process evaluation will identify contextual factors influencing the implementation of tailored interventions, and assess implementation outcomes including acceptability, feasibility, fidelity, and sustainment. DISCUSSION: Reducing antibiotic overuse at discharge across hospitals with varied resources requires tailoring of interventions. This trial will assess whether a multicomponent implementation strategy that supports hospitals in selecting evidence-based stewardship interventions tailored to local context leads to reduced overuse of antibiotics at discharge. Knowledge gained during this study could inform future efforts to implement stewardship in diverse hospitals and promote equity in access to the benefits of quality improvement initiatives. TRIAL REGISTRATION: Clinicaltrials.gov NCT06106204 on 10/30/23.

Bacteremia From a Presumed Urinary Source in Hospitalized Adults With Asymptomatic Bacteriuria.

Importance: Guidelines recommend withholding antibiotics in asymptomatic bacteriuria (ASB), including among patients with altered mental status (AMS) and no systemic signs of infection. However, ASB treatment remains common. Objectives: To determine prevalence and factors associated with bacteremia from a presumed urinary source in inpatients with ASB with or without AMS and estimate antibiotics avoided if a 2% risk of bacteremia were used as a threshold to prompt empiric antibiotic treatment of ASB. Design, Setting, and Participants: This cohort study assessed patients hospitalized to nonintensive care with ASB (no immune compromise or concomitant infections) in 68 Michigan hospitals from July 1, 2017, to June 30, 2022. Data were analyzed from August 2022 to January 2023. Main Outcomes and Measures: The primary outcome was prevalence of bacteremia from a presumed urinary source (ie, positive blood culture with matching organisms within 3 days of urine culture). To determine factors associated with bacteremia, we used multivariable logistic regression models. We estimated each patient's risk of bacteremia and determined what percentage of patients empirically treated with antibiotics had less than 2% estimated risk of bacteremia. Results: Of 11 590 hospitalized patients with ASB (median [IQR] age, 78.2 [67.7-86.6] years; 8595 female patients [74.2%]; 2235 African American or Black patients [19.3%], 184 Hispanic patients [1.6%], and 8897 White patients [76.8%]), 8364 (72.2%) received antimicrobial treatment for UTI, and 161 (1.4%) had bacteremia from a presumed urinary source. Only 17 of 2126 patients with AMS but no systemic signs of infection (0.7%) developed bacteremia. On multivariable analysis, male sex (adjusted odds ratio [aOR], 1.45; 95% CI, 1.02-2.05), hypotension (aOR, 1.86; 95% CI, 1.18-2.93), 2 or more systemic inflammatory response criteria (aOR, 1.72; 95% CI, 1.21-2.46), urinary retention (aOR, 1.87; 95% CI, 1.18-2.96), fatigue (aOR, 1.53; 95% CI, 1.08-2.17), log of serum leukocytosis (aOR, 3.38; 95% CI, 2.48-4.61), and pyuria (aOR, 3.31; 95% CI, 2.10-5.21) were associated with bacteremia. No single factor was associated with more than 2% risk of bacteremia. If 2% or higher risk of bacteremia were used as a cutoff for empiric antibiotics, antibiotic exposure would have been avoided in 78.4% (6323 of 8064) of empirically treated patients with low risk of bacteremia. Conclusions and Relevance: In patients with ASB, bacteremia from a presumed urinary source was rare, occurring in less than 1% of patients with AMS. A personalized, risk-based approach to empiric therapy could decrease unnecessary ASB treatment.

Inappropriate Diagnosis of Pneumonia Among Hospitalized Adults.

Importance: Little is known about incidence of, risk factors for, and harms associated with inappropriate diagnosis of community-acquired pneumonia (CAP). Objective: To characterize inappropriate diagnosis of CAP in hospitalized patients. Design, Setting, and Participants: This prospective cohort study, including medical record review and patient telephone calls, took place across 48 Michigan hospitals. Trained abstractors retrospectively assessed hospitalized patients treated for CAP between July 1, 2017, and March 31, 2020. Patients were eligible for inclusion if they were adults admitted to general care with a discharge diagnostic code of pneumonia who received antibiotics on day 1 or 2 of hospitalization. Data were analyzed from February to December 2023. Main Outcomes and Measures: Inappropriate diagnosis of CAP was defined using a National Quality Forum-endorsed metric as CAP-directed antibiotic therapy in patients with fewer than 2 signs or symptoms of CAP or negative chest imaging. Risk factors for inappropriate diagnosis were assessed and, for those inappropriately diagnosed, 30-day composite outcomes (mortality, readmission, emergency department visit, Clostridioides difficile infection, and antibiotic-associated adverse events) were documented and stratified by full course (>3 days) vs brief (≤3 days) antibiotic treatment using generalized estimating equation models adjusting for confounders and propensity for treatment. Results: Of the 17 290 hospitalized patients treated for CAP, 2079 (12.0%) met criteria for inappropriate diagnosis (median [IQR] age, 71.8 [60.1-82.8] years; 1045 [50.3%] female), of whom 1821 (87.6%) received full antibiotic courses. Compared with patients with CAP, patients inappropriately diagnosed were older (adjusted odds ratio [AOR], 1.08; 95% CI, 1.05-1.11 per decade) and more likely to have dementia (AOR, 1.79; 95% CI, 1.55-2.08) or altered mental status on presentation (AOR, 1.75; 95% CI, 1.39-2.19). Among those inappropriately diagnosed, 30-day composite outcomes for full vs brief treatment did not differ (25.8% vs 25.6%; AOR, 0.98; 95% CI, 0.79-1.23). Full vs brief duration of antibiotic treatment among patients was associated with antibiotic-associated adverse events (31 of 1821 [2.1%] vs 1 of 258 [0.4%]; P = .03). Conclusions and Relevance: In this cohort study, inappropriate diagnosis of CAP among hospitalized adults was common, particularly among older adults, those with dementia, and those presenting with altered mental status. Full-course antibiotic treatment of those inappropriately diagnosed with CAP may be harmful.

Development of Patient Safety Measures to Identify Inappropriate Diagnosis of Common Infections.

BACKGROUND: Inappropriate diagnosis of infections results in antibiotic overuse and may delay diagnosis of underlying conditions. Here we describe the development and characteristics of 2 safety measures of inappropriate diagnosis of urinary tract infection (UTI) and community-acquired pneumonia (CAP), the most common inpatient infections on general medicine services. METHODS: Measures were developed from guidelines and literature and adapted based on data from patients hospitalized with UTI and CAP in 49 Michigan hospitals and feedback from end-users, a technical expert panel (TEP), and a patient focus group. Each measure was assessed for reliability, validity, feasibility, and usability. RESULTS: Two measures, now endorsed by the National Quality Forum (NQF), were developed. Measure reliability (derived from 24 483 patients) was excellent (0.90 for UTI; 0.91 for CAP). Both measures had strong validity demonstrated through (a) face validity by hospital users, the TEPs, and patient focus group, (b) implicit case review (ĸ 0.72 for UTI; ĸ 0.72 for CAP), and (c) rare case misclassification (4% for UTI; 0% for CAP) due to data errors (<2% for UTI; 6.3% for CAP). Measure implementation through hospital peer comparison in Michigan hospitals (2017 to 2020) demonstrated significant decreases in inappropriate diagnosis of UTI and CAP (37% and 32%, respectively, P < .001), supporting usability. CONCLUSIONS: We developed highly reliable, valid, and usable measures of inappropriate diagnosis of UTI and CAP for hospitalized patients. Hospitals seeking to improve diagnostic safety, antibiotic use, and patient care should consider using these measures to reduce inappropriate diagnosis of CAP and UTI.

The role of hospital-based vascular access teams and implications for patient safety: A multi-methods study.

BACKGROUND: Peripherally inserted central catheters (PICCs) and midline catheters are often placed by nurse-led vascular access teams (VATs). While some data regarding the effectiveness of these teams exists, less is known about their structure and function. OBJECTIVES: To examine the roles, functions, and composition of VATs related to the use and management of PICC and midline catheters. METHODS: A descriptive, multi-method study that included an online survey of 62 hospitals participating in a quality improvement consortium and qualitative interviews with 74 hospital-based clinicians in 10 sites. Interviews were recorded, transcribed, and analyzed using a rapid analysis and matrix approach. The survey, which contained closed-ended, categorical questions, was analyzed using frequencies and percentages. RESULTS: More than 77% (n = 48) of hospitals had an on-site VAT. The average team size was seven nurses; their primary function was device insertion. Interview findings revealed that teams varied in characteristics and functions. Interviewees described the broad role that teams play in device insertion, care and removal, and in educating/training hospital staff. However, we found that teams' role in decision making, particularly related to appropriate device selection, was limited and, in some cases, met with physician resistance. CONCLUSIONS: To realize the full benefit of VATs, changes in hospital culture, along with an increased willingness from physicians to integrate VAT nurses in decision making, may be needed. Future interventions aimed at engaging and empowering teams appear necessary.