Meaningful Endpoints for Idiopathic Pulmonary Fibrosis (IPF) Clinical Trials: Emphasis on 'Feels, Functions, Survives'. Report of a Collaborative Discussion in a Symposium with Direct Engagement from Representatives of Patients, Investigators, the National Institutes of Health, a Patient Advocacy Organization, and a Regulatory Agency.

Background: Idiopathic pulmonary fibrosis (IPF) carries significant mortality and unpredictable progression, with limited therapeutic options. Designing trials with patient-meaningful endpoints, enhancing the reliability and interpretability of results, and streamlining the regulatory approval process are of critical importance to advancing clinical care in IPF. Methods: A landmark in-person symposium in June 2023 assembled 43 participants from the US and internationally, including patients with IPF, investigators, and regulatory representatives, to discuss the immediate future of IPF clinical trial endpoints. Patient advocates were central to discussions, which evaluated endpoints according to regulatory standards and the FDA's 'feels, functions, survives' criteria. Results: Three themes emerged: 1) consensus on endpoints mirroring the lived experiences of patients with IPF; 2) consideration of replacing forced vital capacity (FVC) as the primary endpoint, potentially by composite endpoints that include 'feels, functions, survives' measures or FVC as components; 3) support for simplified, user-friendly patient-reported outcomes (PROs) as either components of primary composite endpoints or key secondary endpoints, supplemented by functional tests as secondary endpoints and novel biomarkers as supportive measures (FDA Guidance for Industry (Multiple Endpoints in Clinical Trials) available at: https://www.fda.gov/media/162416/download). Conclusions: This report, detailing the proceedings of this pivotal symposium, suggests a potential turning point in designing future IPF clinical trials more attuned to outcomes meaningful to patients, and documents the collective agreement across multidisciplinary stakeholders on the importance of anchoring IPF trial endpoints on real patient experiences-namely, how they feel, function, and survive. There is considerable optimism that clinical care in IPF will progress through trials focused on patient-centric insights, ultimately guiding transformative treatment strategies to enhance patients' quality of life and survival.

SARS-CoV-2 Variants and Vaccines.

Viral variants of concern may emerge with dangerous resistance to the immunity generated by the current vaccines to prevent coronavirus disease 2019 (Covid-19). Moreover, if some variants of concern have increased transmissibility or virulence, the importance of efficient public health measures and vaccination programs will increase. The global response must be both timely and science based.

An introduction to the Marburg virus vaccine consortium, MARVAC.

The emergence of Marburg virus (MARV) in Guinea and Ghana triggered the assembly of the MARV vaccine "MARVAC" consortium representing leaders in the field of vaccine research and development aiming to facilitate a rapid response to this infectious disease threat. Here, we discuss current progress, challenges, and future directions for MARV vaccines.

Methods for the estimation of direct and indirect vaccination effects by combining data from individual- and cluster-randomized trials.

Both individually and cluster randomized study designs have been used for vaccine trials to assess the effects of vaccine on reducing the risk of disease or infection. The choice between individually and cluster randomized designs is often driven by the target estimand of interest (eg, direct versus total), statistical power, and, importantly, logistic feasibility. To combat emerging infectious disease threats, especially when the number of events from one single trial may not be adequate to obtain vaccine effect estimates with a desired level of precision, it may be necessary to combine information across multiple trials. In this article, we propose a model formulation to estimate the direct, indirect, total, and overall vaccine effects combining data from trials with two types of study designs: individual-randomization and cluster-randomization, based on a Cox proportional hazards model, where the hazard of infection depends on both vaccine status of the individual as well as the vaccine status of the other individuals in the same cluster. We illustrate the use of the proposed model and assess the potential efficiency gain from combining data from multiple trials, compared to using data from each individual trial alone, through two simulation studies, one of which is designed based on a cholera vaccine trial previously carried out in Matlab, Bangladesh.

Finding the (biomarker-defined) subgroup of patients who benefit from a novel therapy: No time for a game of hide and seek.

An important element of precision medicine is the ability to identify, for a specific therapy, those patients for whom benefits of that therapy meaningfully exceed the risks. To achieve this goal, treatment effect usually is examined across subgroups defined by a variety of factors, including demographic, clinical, or pathologic characteristics or by molecular attributes of patients or their disease. Frequently such subgroups are defined by the measurement of biomarkers. Even though such examination is necessary when pursuing this goal, the evaluation of treatment effect across a variety of subgroups is statistically fraught due to both the danger of inflated false-positive error rate from multiple testing and the inherent insensitivity to how treatment effects differ across subgroups.Pre-specification of subgroup analyses with appropriate control of false-positive (i.e. type I) error is recommended when possible. However, when subgroups are specified by biomarkers, which could be measured by different assays and might lack established interpretation criteria, such as cut-offs, it might not be possible to fully specify those subgroups at the time a new therapy is ready for definitive evaluation in a Phase 3 trial. In these situations, further refinement and evaluation of treatment effect in biomarker-defined subgroups might have to take place within the trial. A common scenario is that evidence suggests that treatment effect is a monotone function of a biomarker value, but optimal cut-offs for therapy decisions are not known. In this setting, hierarchical testing strategies are widely used, where testing is first conducted in a particular biomarker-positive subgroup and then is conducted in the expanded pool of biomarker-positive and biomarker-negative patients, with control for multiple testing. A serious limitation of this approach is the logical inconsistency of excluding the biomarker-negatives when evaluating effects in the biomarker-positives, yet allowing the biomarker-positives to drive the assessment of whether a conclusion of benefit could be extrapolated to the biomarker-negative subgroup.Examples from oncology and cardiology are described to illustrate the challenges and pitfalls. Recommendations are provided for statistically valid and logically consistent subgroup testing in these scenarios as alternatives to reliance on hierarchical testing alone, and approaches for exploratory assessment of continuous biomarkers as treatment effect modifiers are discussed.

Reliably Assessing Duration of Protection for Coronavirus Disease 2019 Vaccines.

Decision making about vaccination and boosting schedules for coronavirus disease 2019 (COVID-19) hinges on reliable methods for evaluating the longevity of vaccine protection. We show that modeling of protection as a piecewise linear function of time since vaccination for the log hazard ratio of the vaccine effect provides more reliable estimates of vaccine effectiveness at the end of an observation period and also detects plateaus in protective effectiveness more reliably than the standard method of estimating a constant vaccine effect over each time period. This approach will be useful for analyzing data pertaining to COVID-19 vaccines and other vaccines for which rapid and reliable understanding of vaccine effectiveness over time is desired.

Evaluating group-sequential non-inferiority clinical trials following interim stopping: The HIV Prevention Trials Network 083 trial.

BACKGROUND/AIMS: The HIV Prevention Trials Network 083 trial was a group-sequential non-inferiority trial designed to compare HIV incidence under a novel experimental regimen for HIV prevention, long-acting injectable cabotegravir, with an active-control regimen of daily oral tenofovir disoproxil fumarate/emtricitabine (brand name Truvada). In March of 2020, just as the trial had completed enrollment, the COVID-19 pandemic threatened to prevent trial participants from attending study visits and obtaining study medication, motivating the study team to update the interim monitoring plan. The Data and Safety Monitoring Board subsequently stopped the trial at the first interim review due to strong early evidence of efficacy. METHODS: Here we describe some unique aspects of the trial's design, monitoring, analysis, and interpretation. We illustrate the importance of computing point estimates, confidence intervals, and p values based on the sampling distribution induced by sequential monitoring. RESULTS: Accurate analysis, decision-making and interpretation of trial results rely on pre-specification of a stopping boundary, including the scale on which the stopping rule will be implemented, the specific test statistics to be calculated, and how the boundary will be adjusted if the available information fraction at interim review is different from planned. After appropriate adjustment for the sampling distribution and overrun, the HIV Prevention Trials Network 083 trial provided strong evidence that the experimental regimen was superior to the active control. CONCLUSIONS: For the HIV Prevention Trials Network 083 trial, the difference between corrected inferential statistics and naive results was quite small-as will often be the case-nevertheless, it is appropriate to report and publish the most accurate and unbiased statistical results.

A platform trial design for preventive vaccines against Marburg virus and other emerging infectious disease threats.

BACKGROUND: The threat of a possible Marburg virus disease outbreak in Central and Western Africa is growing. While no Marburg virus vaccines are currently available for use, several candidates are in the pipeline. Building on knowledge and experiences in the designs of vaccine efficacy trials against other pathogens, including SARS-CoV-2, we develop designs of randomized Phase 3 vaccine efficacy trials for Marburg virus vaccines. METHODS: A core protocol approach will be used, allowing multiple vaccine candidates to be tested against controls. The primary objective of the trial will be to evaluate the effect of each vaccine on the rate of virologically confirmed Marburg virus disease, although Marburg infection assessed via seroconversion could be the primary objective in some cases. The overall trial design will be a mixture of individually and cluster-randomized designs, with individual randomization done whenever possible. Clusters will consist of either contacts and contacts of contacts of index cases, that is, ring vaccination, or other transmission units. RESULTS: The primary efficacy endpoint will be analysed as a time-to-event outcome. A vaccine will be considered successful if its estimated efficacy is greater than 50% and has sufficient precision to rule out that true efficacy is less than 30%. This will require approximately 150 total endpoints, that is, cases of confirmed Marburg virus disease, per vaccine/comparator combination. Interim analyses will be conducted after 50 and after 100 events. Statistical analysis of the trial will be blended across the different types of designs. Under the assumption of a 6-month attack rate of 1% of the participants in the placebo arm for both the individually and cluster-randomized populations, the most likely sample size is about 20,000 participants per arm. CONCLUSION: This event-driven design takes into the account the potentially sporadic spread of Marburg virus. The proposed trial design may be applicable for other pathogens against which effective vaccines are not yet available.

Clinical Endpoints for Evaluating Efficacy in COVID-19 Vaccine Trials.

Several vaccine candidates to protect against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection or coronavirus disease 2019 (COVID-19) have entered or will soon enter large-scale, phase 3, placebo-controlled randomized clinical trials. To facilitate harmonized evaluation and comparison of the efficacy of these vaccines, a general set of clinical endpoints is proposed, along with considerations to guide the selection of the primary endpoints on the basis of clinical and statistical reasoning. The plausibility that vaccine protection against symptomatic COVID-19 could be accompanied by a shift toward more SARS-CoV-2 infections that are asymptomatic is highlighted, as well as the potential implications of such a shift.

A Deferred-Vaccination Design to Assess Durability of COVID-19 Vaccine Effect After the Placebo Group Is Vaccinated.

Multiple candidate vaccines to prevent COVID-19 have entered large-scale phase 3 placebo-controlled randomized clinical trials, and several have demonstrated substantial short-term efficacy. At some point after demonstration of substantial efficacy, placebo recipients should be offered the efficacious vaccine from their trial, which will occur before longer-term efficacy and safety are known. The absence of a placebo group could compromise assessment of longer-term vaccine effects. However, by continuing follow-up after vaccination of the placebo group, this study shows that placebo-controlled vaccine efficacy can be mathematically derived by assuming that the benefit of vaccination over time has the same profile for the original vaccine recipients and the original placebo recipients after their vaccination. Although this derivation provides less precise estimates than would be obtained by a standard trial where the placebo group remains unvaccinated, this proposed approach allows estimation of longer-term effect, including durability of vaccine efficacy and whether the vaccine eventually becomes harmful for some. Deferred vaccination, if done open-label, may lead to riskier behavior in the unblinded original vaccine group, confounding estimates of long-term vaccine efficacy. Hence, deferred vaccination via blinded crossover, where the vaccine group receives placebo and vice versa, would be the preferred way to assess vaccine durability and potential delayed harm. Deferred vaccination allows placebo recipients timely access to the vaccine when it would no longer be proper to maintain them on placebo, yet still allows important insights about immunologic and clinical effectiveness over time.

COVID-19 vaccine trials: The use of active controls and non-inferiority studies.

BACKGROUND: Recently emerging results from a few placebo-controlled randomized trials of COVID-19 vaccines revealed estimates of 62%-95% relative reductions in risk of virologically confirmed symptomatic COVID-19 disease, over approximately 2-month average follow-up period. Additional safe and effective COVID-19 vaccines are needed in a timely manner to adequately address the pandemic on an international scale. Such safe and effective vaccines would be especially appealing for international deployment if they also have favorable stability, supply, and potential for implementation in mass vaccination campaigns. Randomized trials provide particularly reliable insights about vaccine efficacy and safety. While enhanced efficiency and interpretability can be obtained from placebo-controlled trials, in settings where their conduct is no longer possible, randomized non-inferiority trials may enable obtaining reliable evaluations of experimental vaccines through direct comparison with active comparator vaccines established to have worthwhile efficacy. METHODS: The usual objective of non-inferiority trials is to reliably assess whether the efficacy of an experimental vaccine is not unacceptably worse than that of an active control vaccine previously established to be effective, likely in a placebo-controlled trial. This is formally achieved by ruling out a non-inferiority margin identified to be the minimum threshold for what would constitute an unacceptable loss of efficacy. This article not only investigates non-inferiority margins, denoted by δ, that address the usual objective of determining whether the experimental vaccine is "at least similarly effective to" the active comparator vaccine in the non-inferiority trial, but also develops non-inferiority margins, denoted by δo, intended to address the worldwide need for multiple safe and effective vaccines by satisfying the less stringent requirement that the experimental vaccine be "at least similarly effective to" an active comparator vaccine having efficacy that satisfies the widely accepted World Health Organization-Food and Drug Administration criteria for "worthwhile" vaccine efficacy. RESULTS: Using the margin δ enables non-inferiority trials to reliably evaluate experimental vaccines that truly are similarly effective to an active comparator vaccine having any level of "worthwhile" efficacy. When active comparator vaccines have efficacy in the range of 50%-70%, non-inferiority trials designed to use the margin δo have appealing properties, especially for experimental vaccines having true efficacy of approximately 60%. CONCLUSION: Non-inferiority trials using the proposed margins may enable reliable randomized evaluations of efficacy and safety of experimental COVID-19 vaccines. Such trials often require approximately two- to three-fold the person-years follow-up than a placebo-controlled trial. This could be achieved, without substantive increases in sample size, by increasing the average duration of follow-up from 2 months to approximately 4-6 months, assuming efficacy of the active comparator vaccine has been reliably evaluated over that longer duration.

COVID-19 vaccine trials: The potential for "hybrid" analyses.

BACKGROUND: Although several COVID-19 vaccines have been found to be effective in rigorous evaluation and have emerging availability in parts of the world, their supply will be inadequate to meet international needs for a considerable period of time. There also will be continued interest in vaccines that are more effective or have improved scalability to facilitate mass vaccination campaigns. Ongoing clinical testing of new vaccines also will be needed as variant strains continue to emerge that may elude some aspects of immunity induced by current vaccines. Randomized clinical trials meaningfully enhance the efficiency and reliability of such clinical testing. In clinical settings with limited or no access to known effective vaccines, placebo-controlled randomized trials of new vaccines remain a preferred approach to maximize the reliability, efficiency and interpretability of results. When emerging availability of licensed vaccines makes it no longer possible to use a placebo control, randomized active comparator non-inferiority trials may enable reliable insights. METHODS: In this article, "hybrid" methods are proposed to address settings where, during the conduct of a placebo-controlled trial, a judgment is made to replace the placebo arm by a licensed COVID-19 vaccine due to emerging availability of effective vaccines in regions participating in that trial. These hybrid methods are based on proposed statistics that aggregate evidence to formally test as well as to estimate the efficacy of the experimental vaccine, by combining placebo-controlled data during the first period of trial conduct with active-controlled data during the second period. RESULTS: Application of the proposed methods is illustrated in two important scenarios where the active control vaccine would become available in regions engaging in the experimental vaccine's placebo-controlled trial: in the first, the active comparator's vaccine efficacy would have been established to be 50%-70% for the 4- to 6-month duration of follow-up of its placebo-controlled trial; in the second, the active comparator's vaccine efficacy would have been established to be 90%-95% during that duration. These two scenarios approximate what has been seen with adenovirus vaccines or mRNA vaccines, respectively, assuming the early estimates of vaccine efficacy for those vaccines would hold over longer-term follow-up. CONCLUSION: The proposed hybrid methods could readily play an important role in the near future in the design, conduct and analysis of randomized clinical trials performed to address the need for multiple additional vaccines reliably established to be safe and have worthwhile efficacy in reducing the risk of symptomatic disease from SARS-CoV-2 infections.

Antiretroviral Therapy for the Prevention of HIV-1 Transmission.

BACKGROUND: An interim analysis of data from the HIV Prevention Trials Network (HPTN) 052 trial showed that antiretroviral therapy (ART) prevented more than 96% of genetically linked infections caused by human immunodeficiency virus type 1 (HIV-1) in serodiscordant couples. ART was then offered to all patients with HIV-1 infection (index participants). The study included more than 5 years of follow-up to assess the durability of such therapy for the prevention of HIV-1 transmission. METHODS: We randomly assigned 1763 index participants to receive either early or delayed ART. In the early-ART group, 886 participants started therapy at enrollment (CD4+ count, 350 to 550 cells per cubic millimeter). In the delayed-ART group, 877 participants started therapy after two consecutive CD4+ counts fell below 250 cells per cubic millimeter or if an illness indicative of the acquired immunodeficiency syndrome (i.e., an AIDS-defining illness) developed. The primary study end point was the diagnosis of genetically linked HIV-1 infection in the previously HIV-1-negative partner in an intention-to-treat analysis. RESULTS: Index participants were followed for 10,031 person-years; partners were followed for 8509 person-years. Among partners, 78 HIV-1 infections were observed during the trial (annual incidence, 0.9%; 95% confidence interval [CI], 0.7 to 1.1). Viral-linkage status was determined for 72 (92%) of the partner infections. Of these infections, 46 were linked (3 in the early-ART group and 43 in the delayed-ART group; incidence, 0.5%; 95% CI, 0.4 to 0.7) and 26 were unlinked (14 in the early-ART group and 12 in the delayed-ART group; incidence, 0.3%; 95% CI, 0.2 to 0.4). Early ART was associated with a 93% lower risk of linked partner infection than was delayed ART (hazard ratio, 0.07; 95% CI, 0.02 to 0.22). No linked infections were observed when HIV-1 infection was stably suppressed by ART in the index participant. CONCLUSIONS: The early initiation of ART led to a sustained decrease in genetically linked HIV-1 infections in sexual partners. (Funded by the National Institute of Allergy and Infectious Diseases; HPTN 052 ClinicalTrials.gov number, NCT00074581 .).

Data Monitoring Committees: Current issues.

Maintaining confidentiality of emerging data and ensuring the independence of Data Monitoring Committees are best practices of considerable importance to the ability of these committees to achieve their mission of safeguarding the interests of study participants and enhancing the integrity and credibility of clinical trials. Even with the wide recognition of these principles, there are circumstances where confidentiality issues remain challenging, controversial or inconsistently addressed. First, consider settings where a clinical trial's interim data could provide the evidence regulatory authorities require for decisions about marketing approval, yet where such a trial would be continued post-approval to provide more definitive evidence about principal safety and/or efficacy outcomes. In such settings, data informative about the longer term objectives of the trial should remain confidential until pre-specified criteria for trial completion have been met. Second, for those other than Data Monitoring Committee members, access to safety and efficacy outcomes during trial conduct, even when presented as data pooled across treatment arms, should be on a limited "need to know" basis relating to the ability to carry out ethical or scientific responsibilities in the conduct of the trial. Third, Data Monitoring Committee members should have access to unblinded efficacy and safety data throughout the trial to enable timely and informed judgments about risks and benefits. Fourth, it should be recognized that a mediator potentially could be useful in rare settings where the Data Monitoring Committee would have serious ethical or scientific concerns about the sponsor's dissemination or lack of dissemination of information. Data Monitoring Committee Contract Agreements, Indemnification Agreements and Charters should be developed in a manner to protect Data Monitoring Committee members and their independence, in order to enhance the Data Monitoring Committee's ability to effectively address their mission.

Data monitoring committees: Promoting best practices to address emerging challenges.

BACKGROUND AND PURPOSE: Data monitoring committees are responsible for safeguarding the interests of study participants and assuring the integrity and credibility of clinical trials. The independence of data monitoring committees from sponsors and investigators is essential in achieving this mission. Creative approaches are needed to address ongoing and emerging challenges that potentially threaten data monitoring committees' independence and effectiveness. METHODS: An expert panel of representatives from academia, industry and government sponsors, and regulatory agencies discussed these challenges and proposed best practices and operating principles for effective functioning of contemporary data monitoring committees. RESULTS AND CONCLUSIONS: Prospective data monitoring committee members need better training. Options could include didactic instruction as well as apprenticeships to provide real-world experience. Data monitoring committee members should be protected against legal liability arising from their service. While avoiding breaches in confidentiality of interim data remains a high priority, data monitoring committees should have access to unblinded efficacy and safety data throughout the trial to enable informed judgments about risks and benefits. Because overly rigid procedures can compromise their independence, data monitoring committees should have the flexibility necessary to best fulfill their responsibilities. Data monitoring committee charters should articulate principles that guide the data monitoring committee process rather than list a rigid set of requirements. Data monitoring committees should develop their recommendations by consensus rather than through voting processes. The format for the meetings of the data monitoring committee should maintain the committee's independence and clearly establish the leadership of the data monitoring committee chair. The independent statistical group at the Statistical Data Analysis Center should have sufficient depth of knowledge about the study at hand and experience with trials in general to ensure that the data monitoring committee has access to timely, reliable, and readily interpretable insights about emerging evidence in the clinical trial. Contracts engaging data monitoring committee members for industry-sponsored trials should have language customized to the unique responsibilities of data monitoring committee members rather than use language appropriate to consultants for product development. Regulatory scientists would benefit from experiencing data monitoring committee service that does not conflict with their regulatory responsibilities.