A learning health system approach to the COVID-19 pandemic: System-wide changes in clinical practice and 30-day mortality among hospitalized patients.

Introduction: Rapid, continuous implementation of credible scientific findings and regulatory approvals is often slow in large, diverse health systems. The coronavirus disease 2019 (COVID-19) pandemic created a new threat to this common "slow to learn and adapt" model in healthcare. We describe how the University of Pittsburgh Medical Center (UPMC) committed to a rapid learning health system (LHS) model to respond to the COVID-19 pandemic. Methods: A treatment cohort study was conducted among 11 429 hospitalized patients (pediatric/adult) from 22 hospitals (PA, NY) with a primary diagnosis of COVID-19 infection (March 19, 2020 - June 6, 2021). Sociodemographic and clinical data were captured from UPMC electronic medical record (EMR) systems. Patients were grouped into four time-defined patient "waves" based on nadir of daily hospital admissions, with wave 3 (September 20, 2020 - March 10, 2021) split at its zenith due to high volume with steep acceleration and deceleration. Outcomes included changes in clinical practice (eg, use of corticosteroids, antivirals, and other therapies) in relation to timing of internal system analyses, scientific publications, and regulatory approvals, along with 30-day rate of mortality over time. Results: The mean (SD) daily number of admissions across hospitals was 26 (29) with a maximum 7-day moving average of 107 patients. System-wide implementation of the use of dexamethasone, remdesivir, and tocilizumab occurred within days of release of corresponding seminal publications and regulatory actions. After adjustment for differences in patient clinical profiles over time, each month of hospital admission was associated with an estimated 5% lower odds of 30-day mortality (adjusted odds ratio [OR] = 0.95, 95% confidence interval: 0.93-0.97, P < .001). Conclusions: In our large LHS, near real-time changes in clinical management of COVID-19 patients happened promptly as scientific publications and regulatory approvals occurred throughout the pandemic. Alongside these changes, patients with COVID-19 experienced lower adjusted 30-day mortality following hospital admission over time.

Effectiveness of Casirivimab-Imdevimab and Sotrovimab During a SARS-CoV-2 Delta Variant Surge: A Cohort Study and Randomized Comparative Effectiveness Trial.

Importance: The effectiveness of monoclonal antibodies (mAbs), casirivimab-imdevimab and sotrovimab, is unknown in patients with mild to moderate COVID-19 caused by the SARS-CoV-2 Delta variant. Objective: To evaluate the effectiveness of mAb against the Delta variant compared with no mAb treatment and to ascertain the comparative effectiveness of casirivimab-imdevimab and sotrovimab. Design, Setting, and Participants: This study comprised 2 parallel studies: (1) a propensity score-matched cohort study of mAb treatment vs no mAb treatment and (2) a randomized comparative effectiveness trial of casirivimab-imdevimab and sotrovimab. The cohort consisted of patients who received mAb treatment at the University of Pittsburgh Medical Center outpatient infusion centers and emergency departments from July 14 to September 29, 2021. Participants were patients with a positive SARS-CoV-2 test result who were eligible to receive mAbs according to emergency use authorization criteria. Exposure: For the trial, patients were randomized to either intravenous casirivimab-imdevimab or sotrovimab according to a system therapeutic interchange policy. Main Outcomes and Measures: For the cohort study, risk ratio (RR) estimates for the primary outcome of hospitalization or death by 28 days were compared between mAb treatment and no mAb treatment using propensity score-matched models. For the comparative effectiveness trial, the primary outcome was hospital-free days (days alive and free of hospitalization) within 28 days after mAb treatment, where patients who died were assigned -1 day in a bayesian cumulative logistic model adjusted for treatment location, age, sex, and time. Inferiority was defined as a 99% posterior probability of an odds ratio (OR) less than 1. Equivalence was defined as a 95% posterior probability that the OR was within a given bound. Results: A total of 3069 patients (1023 received mAb treatment: mean [SD] age, 53.2 [16.4] years; 569 women [56%]; 2046 had no mAb treatment: mean [SD] age, 52.8 [19.5] years; 1157 women [57%]) were included in the prospective cohort study, and 3558 patients (mean [SD] age, 54 [18] years; 1919 women [54%]) were included in the randomized comparative effectiveness trial. In propensity score-matched models, mAb treatment was associated with reduced risk of hospitalization or death (RR, 0.40; 95% CI, 0.28-0.57) compared with no treatment. Both casirivimab-imdevimab (RR, 0.31; 95% CI, 0.20-0.50) and sotrovimab (RR, 0.60; 95% CI, 0.37-1.00) were associated with reduced hospitalization or death compared with no mAb treatment. In the clinical trial, 2454 patients were randomized to receive casirivimab-imdevimab and 1104 patients were randomized to receive sotrovimab. The median (IQR) hospital-free days were 28 (28-28) for both mAb treatments, the 28-day mortality rate was less than 1% (n = 12) for casirivimab-imdevimab and less than 1% (n = 7) for sotrovimab, and the hospitalization rate by day 28 was 12% (n = 291) for casirivimab-imdevimab and 13% (n = 140) for sotrovimab. Compared with patients who received casirivimab-imdevimab, those who received sotrovimab had a median adjusted OR for hospital-free days of 0.88 (95% credible interval, 0.70-1.11). This OR yielded 86% probability of inferiority for sotrovimab vs casirivimab-imdevimab and 79% probability of equivalence. Conclusions and Relevance: In this propensity score-matched cohort study and randomized comparative effectiveness trial, the effectiveness of casirivimab-imdevimab and sotrovimab against the Delta variant was similar, although the prespecified criteria for statistical inferiority or equivalence were not met. Both mAb treatments were associated with a reduced risk of hospitalization or death in nonhospitalized patients with mild to moderate COVID-19 caused by the Delta variant. Trial Registration: ClinicalTrials.gov Identifier: NCT04790786.

The comparative effectiveness of COVID-19 monoclonal antibodies: A learning health system randomized clinical trial.

BACKGROUND: Monoclonal antibodies (mAb) that neutralize SARS-CoV-2 decrease hospitalization and death compared to placebo in patients with mild to moderate COVID-19; however, comparative effectiveness is unknown. We report the comparative effectiveness of bamlanivimab, bamlanivimab-etesevimab, and casirivimab-imdevimab. METHODS: A learning health system platform trial in a U.S. health system enrolled patients meeting mAb Emergency Use Authorization criteria. An electronic health record-embedded application linked local mAb inventory to patient encounters and provided random mAb allocation. Primary outcome was hospital-free days to day 28. Primary analysis was a Bayesian model adjusting for treatment location, age, sex, and time. Inferiority was defined as 99% posterior probability of an odds ratio < 1. Equivalence was defined as 95% posterior probability the odds ratio is within a given bound. FINDINGS: Between March 10 and June 25, 2021, 1935 patients received treatment. Median hospital-free days were 28 (IQR 28, 28) for each mAb. Mortality was 0.8% (1/128), 0.8% (7/885), and 0.7% (6/922) for bamlanivimab, bamlanivimab-etesevimab, and casirivimab-imdevimab, respectively. Relative to casirivimab-imdevimab (n = 922), median adjusted odds ratios were 0.58 (95% credible interval [CI] 0.30-1.16) and 0.94 (95% CI 0.72-1.24) for bamlanivimab (n = 128) and bamlanivimab-etesevimab (n = 885), respectively. These odds ratios yielded 91% and 94% probabilities of inferiority of bamlanivimab versus bamlanivimab-etesevimab and casirivimab-imdevimab, and an 86% probability of equivalence between bamlanivimab-etesevimab and casirivimab-imdevimab. INTERPRETATION: Among patients with mild to moderate COVID-19, bamlanivimab-etesevimab or casirivimab-imdevimab treatment resulted in 86% probability of equivalence. No treatment met prespecified criteria for statistical equivalence. Median hospital-free days to day 28 were 28 (IQR 28, 28) for each mAb. FUNDING AND REGISTRATION: This work received no external funding. The U.S. government provided the reported mAb. This trial is registered at ClinicalTrials.gov, NCT04790786.

Association of Subcutaneous or Intravenous Administration of Casirivimab and Imdevimab Monoclonal Antibodies With Clinical Outcomes in Adults With COVID-19.

Importance: Monoclonal antibody (mAb) treatment decreases hospitalization and death in high-risk outpatients with mild to moderate COVID-19; however, only intravenous administration has been evaluated in randomized clinical trials of treatment. Subcutaneous administration may expand outpatient treatment capacity and qualified staff available to administer treatment, but the association with patient outcomes is understudied. Objectives: To evaluate whether subcutaneous casirivimab and imdevimab treatment is associated with reduced 28-day hospitalization and death compared with nontreatment among mAb-eligible patients and whether subcutaneous casirivimab and imdevimab treatment is clinically and statistically similar to intravenous casirivimab and imdevimab treatment. Design, Setting, and Participants: This prospective cohort study evaluated high-risk outpatients in a learning health system in the US with mild to moderate COVID-19 symptoms from July 14 to October 26, 2021, who were eligible for mAb treatment under emergency use authorization. A nontreated control group of eligible patients was also studied. Exposures: Subcutaneous injection or intravenous administration of the combined single dose of 600 mg of casirivimab and 600 mg of imdevimab. Main Outcomes and Measures: The primary outcome was the 28-day adjusted risk ratio or adjusted risk difference for hospitalization or death. Secondary outcomes included 28-day adjusted risk ratios and differences in hospitalization, death, a composite end point of emergency department admission and hospitalization, and rates of adverse events. Among 1959 matched adults with mild to moderate COVID-19, 969 patients (mean [SD] age, 53.8 [16.7] years; 547 women [56.4%]) who received casirivimab and imdevimab subcutaneously had a 28-day rate of hospitalization or death of 3.4% (22 of 653 patients) compared with 7.0% (92 of 1306 patients) in nontreated controls (risk ratio, 0.48; 95% CI, 0.30-0.80; P = .002). Among 2185 patients treated with subcutaneous (n = 969) or intravenous (n = 1216; mean [SD] age, 54.3 [16.6] years; 672 women [54.4%]) casirivimab and imdevimab, the 28-day rate of hospitalization or death was 2.8% vs 1.7%, which resulted in an adjusted risk difference of 1.5% (95% CI, -0.6% to 3.5%; P = .16). Among all infusion patients, there was no difference in intensive care unit admission (adjusted risk difference, 0.7%; 95% CI, -3.5% to 5.0%) or need for mechanical ventilation (adjusted risk difference, 0.2%; 95% CI, -5.8% to 5.5%). Conclusions and Relevance: In this cohort study of high-risk outpatients with mild to moderate COVID-19 symptoms, subcutaneously administered casirivimab and imdevimab was associated with reduced hospitalization and death when compared with no treatment. These results provide preliminary evidence of potential expanded use of subcutaneous mAb treatment, particularly in areas that are facing treatment capacity and/or staffing shortages.

Launching a comparative effectiveness adaptive platform trial of monoclonal antibodies for COVID-19 in 21 days.

Outpatient treatments that limit progression to severe coronavirus disease 2019 (COVID-19) are of vital importance to optimise patient outcomes and public health. Monoclonal antibodies (mAb) demonstrated ability to decrease hospitalizations in randomized, clinical trials. However, there are many barriers to mAb treatment such as patient access and clinician education. There are no data comparing efficacy or safety of available mAbs. We sought to rapidly launch an adaptive platform trial with the goals of enhancing access to treatment, regardless of geography and socioeconomic status, and evaluating comparative efficacy and safety of available mAbs. Within 21 days from idea genesis, we allocated mAb treatment to all patients within the context of this clinical trial. Within 2 months, we closed the gap of the likelihood of receiving mAb, conditional on background positivity rate, between Black and White patients (Black patients 0.238; White patients 0.241). We describe trial infrastructure, lessons learned, and future directions for a culture of learning while doing.

Emergency department implementation of monoclonal antibody infusion for the treatment of coronavirus disease 2019: A template for rapid deployment.

Monoclonal antibody (mAb) therapy can improve coronavirus disease 2019 outcomes when infused early in select patients. We sought to rapidly create and implement a program for emergency department (ED) mAb infusion to aid care. Using multiple strategies and actions-education, selection criteria, screening tools, rapid testing, compounding, and delivery-we infused 832 ED patients with a mAb. The screening tool identified 94.5% of these patients as potential candidates. Length of stay was nearly identical for patients who tested positive for coronavirus disease 2019 versus those requiring testing. Mild adverse reactions occurred in 2.3% of mAb infusions, and severe reactions occurred in 0.5% of infusions. We highlight a strategic approach for using the ED as a key coronavirus disease 2019 therapeutic site for this intervention and with high utility and low disruption.

The UPMC OPTIMISE-C19 (OPtimizing Treatment and Impact of Monoclonal antIbodieS through Evaluation for COVID-19) trial: a structured summary of a study protocol for an open-label, pragmatic, comparative effectiveness platform trial with response-adaptive randomization.

OBJECTIVES: The primary objective is to evaluate the comparative effectiveness of COVID-19 specific monoclonal antibodies (mABs) with US Food and Drug Administration (FDA) Emergency Use Authorization (EUA), alongside UPMC Health System efforts to increase patient access to these mABs. TRIAL DESIGN: Open-label, pragmatic, comparative effectiveness platform trial with response-adaptive randomization PARTICIPANTS: We will evaluate patients who meet the eligibility criteria stipulated by the COVID-19 mAB EUAs who receive mABs within the UPMC Health System, including infusion centers and emergency departments. EUA eligibility criteria include patients with mild to moderate COVID-19, <10 days of symptoms, and who are at high risk for progressing to severe COVID-19 and/or hospitalization (elderly, obese, and/or with specific comorbidities). The EUA criteria exclude patients who require oxygen for the treatment of COVID-19 and patients already hospitalized for the treatment of COVID-19. We will use data collected for routine clinical care, including data entered into the electronic medical record and from follow-up calls. INTERVENTION AND COMPARATOR: The interventions are the COVID-19 specific mABs authorized by the EUAs. All aspects of mAB treatment, including eligibility criteria, dosing, and post-infusion monitoring, are as per the EUAs. As a comparative effectiveness trial, all patients receive mAB treatment, and the interventions are compared against each other. When U.S. government mAB policies change (e.g., FDA grants or revokes EUAs), UPMC Health System policies and the evaluated mAB interventions will accordingly change. From November 2020 to February 2021, FDA issued EUAs for three mAB treatments (bamlanivimab; bamlanivimab and etesevimab; and casirivimab and imdevimab), and at trial launch on March 10, 2021 we evaluated all three. Due to a sustained increase in SARS-CoV-2 variants in the United States resistant to bamlanivimab administered alone, on March 24, 2021 the U.S. Government halted distribution of bamlanivimab alone, and UPMC accordingly halted bamlanivimab monotherapy on March 31, 2021. On April 16, 2021, FDA revoked the EUA for bamlanivimab monotherapy. At the time of manuscript submission, we are therefore evaluating the two mAB treatments authorized by EUAs (bamlanivimab and etesevimab; and casirivimab and imdevimab). MAIN OUTCOMES: The primary outcome is total hospital free days (HFD) at 28 days after mAB administration, calculated as 28 minus the number of days during the index stay (if applicable - e.g., for patients admitted to hospital after mAB administration in the emergency department) minus the number of days readmitted during the 28 days after treatment. This composite endpoint captures the number of days from the day of mAB administration to the 28 days thereafter, during which the patient is alive and free of hospitalization. Death within 28 days is recorded as -1 HFD, as the worst outcome. RANDOMISATION: We will start with equal allocation. Due to uncertainty in sample size, we will use a Bayesian adaptive design and response adaptive randomization to ensure ability to provide statistical inference despite variable sample size. When mABs are ordered by UPMC physicians as a generic referral order, the order is filled by UPMC pharmacy via therapeutic interchange. OPTIMISE-C19 provides the therapeutic interchange via random allocation. Infusion center operations teams and pharmacists use a mAB assignment application embedded in the electronic medical record to determine the random allocation. BLINDING (MASKING): This trial is open-label. However, outcome assessors conducting follow-up calls at day 28 are blinded to mAB assignment, and investigators are blinded to by-mAB aggregate outcome data until a statistical platform trial conclusion is reached. NUMBERS TO BE RANDOMISED (SAMPLE SIZE): Sample size will be determined by case volume throughout the course of the pandemic, supply of FDA authorized mABs, and by that needed to reach a platform trial conclusion of inferiority, superiority, or futility of a given mAB. The trial will continue as long as more than one mAB type is available under EUA, and their comparative effectiveness is uncertain. TRIAL STATUS: Protocol Version 1.0, February 24, 2021. Recruitment began March 10, 2021 and is ongoing at the time of manuscript submission. The estimated recruitment end date is February 22, 2022, though the final end date is dependent on how the pandemic evolves, mAB availability, and when final platform trial conclusions are reached. As noted above, due to U.S. Government decisions, UPMC Health System halted bamlanivimab monotherapy on March 31, 2021. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04790786 . Registered March 10, 2021 FULL PROTOCOL: The full protocol is attached as an additional file, accessible from the Trials website (Additional file 1). In the interest in expediting dissemination of this material, the familiar formatting has been eliminated; this Letter serves as a summary of the key elements of the full protocol.