Radiographic Progression-Free Survival and Clinical Progression-Free Survival as Potential Surrogates for Overall Survival in Men With Metastatic Hormone-Sensitive Prostate Cancer.

PURPOSE: Despite major increases in the longevity of men with metastatic hormone-sensitive prostate cancer (mHSPC), most men still die of prostate cancer. Phase III trials assessing new therapies in mHSPC with overall survival (OS) as the primary end point will take approximately a decade to complete. We investigated whether radiographic progression-free survival (rPFS) and clinical PFS (cPFS) are valid surrogates for OS in men with mHSPC and could potentially be used to expedite future phase III clinical trials. METHODS: We obtained individual patient data (IPD) from 9 eligible randomized trials comparing treatment regimens (different androgen deprivation therapy [ADT] strategies or ADT plus docetaxel in the control or research arms) in mHSPC. rPFS was defined as the time from random assignment to radiographic progression or death from any cause whichever occurred first; cPFS was defined as the time from random assignment to the date of radiographic progression, symptoms, initiation of new treatment, or death, whichever occurred first. We implemented a two-stage meta-analytic validation model where conditions of patient-level and trial-level surrogacy had to be met. We then computed the surrogate threshold effect (STE). RESULTS: IPD from 6,390 patients randomly assigned from 1994 to 2012 from 13 units were pooled for a stratified analysis. The median OS, rPFS, and cPFS were 4.3 (95% CI, 4.2 to 4.5), 2.4 (95% CI, 2.3 to 2.5), and 2.3 years (95% CI, 2.2 to 2.4), respectively. The STEs were 0.80 and 0.81 for rPFS and cPFS end points, respectively. CONCLUSION: Both rPFS and cPFS appear to be promising surrogate end points for OS. The STE of 0.80 or higher makes it viable for either rPFS or cPFS to be used as the primary end point that is surrogate for OS in phase III mHSPC trials with testosterone suppression alone as the backbone therapy and would expedite trial conduct.

Use of multiple covariates in assessing treatment-effect modifiers: A methodological review of individual participant data meta-analyses.

Individual participant data (IPD) meta-analyses of randomised trials are considered a reliable way to assess participant-level treatment effect modifiers but may not make the best use of the available data. Traditionally, effect modifiers are explored one covariate at a time, which gives rise to the possibility that evidence of treatment-covariate interaction may be due to confounding from a different, related covariate. We aimed to evaluate current practice when estimating treatment-covariate interactions in IPD meta-analysis, specifically focusing on involvement of additional covariates in the models. We reviewed 100 IPD meta-analyses of randomised trials, published between 2015 and 2020, that assessed at least one treatment-covariate interaction. We identified four approaches to handling additional covariates: (1) Single interaction model (unadjusted): No additional covariates included (57/100 IPD meta-analyses); (2) Single interaction model (adjusted): Adjustment for the main effect of at least one additional covariate (35/100); (3) Multiple interactions model: Adjustment for at least one two-way interaction between treatment and an additional covariate (3/100); and (4) Three-way interaction model: Three-way interaction formed between treatment, the additional covariate and the potential effect modifier (5/100). IPD is not being utilised to its fullest extent. In an exemplar dataset, we demonstrate how these approaches lead to different conclusions. Researchers should adjust for additional covariates when estimating interactions in IPD meta-analysis providing they adjust their main effects, which is already widely recommended. Further, they should consider whether more complex approaches could provide better information on who might benefit most from treatments, improving patient choice and treatment policy and practice.

Effects of oral anticoagulation in people with atrial fibrillation after spontaneous intracranial haemorrhage (COCROACH): prospective, individual participant data meta-analysis of randomised trials.

BACKGROUND: The safety and efficacy of oral anticoagulation for prevention of major adverse cardiovascular events in people with atrial fibrillation and spontaneous intracranial haemorrhage are uncertain. We planned to estimate the effects of starting versus avoiding oral anticoagulation in people with spontaneous intracranial haemorrhage and atrial fibrillation. METHODS: In this prospective meta-analysis, we searched bibliographic databases and trial registries using the strategies of a Cochrane systematic review (CD012144) on June 23, 2023. We included clinical trials if they were registered, randomised, and included participants with spontaneous intracranial haemorrhage and atrial fibrillation who were assigned to either start long-term use of any oral anticoagulant agent or avoid oral anticoagulation (ie, placebo, open control, another antithrombotic agent, or another intervention for the prevention of major adverse cardiovascular events). We assessed eligible trials using the Cochrane Risk of Bias tool. We sought data for individual participants who had not opted out of data sharing from chief investigators of completed trials, pending completion of ongoing trials in 2028. The primary outcome was any stroke or cardiovascular death. We used individual participant data to construct a Cox regression model of the time to the first occurrence of outcome events during follow-up in the intention-to-treat dataset supplied by each trial, followed by meta-analysis using a fixed-effect inverse-variance model to generate a pooled estimate of the hazard ratio (HR) with 95% CI. This study is registered with PROSPERO, CRD42021246133. FINDINGS: We identified four eligible trials; three were restricted to participants with atrial fibrillation and intracranial haemorrhage (SoSTART [NCT03153150], with 203 participants) or intracerebral haemorrhage (APACHE-AF [NCT02565693], with 101 participants, and NASPAF-ICH [NCT02998905], with 30 participants), and one included a subgroup of participants with previous intracranial haemorrhage (ELDERCARE-AF [NCT02801669], with 80 participants). After excluding two participants who opted out of data sharing, we included 412 participants (310 [75%] aged 75 years or older, 249 [60%] with CHA2DS2-VASc score ≤4, and 163 [40%] with CHA2DS2-VASc score >4). The intervention was a direct oral anticoagulant in 209 (99%) of 212 participants who were assigned to start oral anticoagulation, and the comparator was antiplatelet monotherapy in 67 (33%) of 200 participants assigned to avoid oral anticoagulation. The primary outcome of any stroke or cardiovascular death occurred in 29 (14%) of 212 participants who started oral anticoagulation versus 43 (22%) of 200 who avoided oral anticoagulation (pooled HR 0·68 [95% CI 0·42-1·10]; I2=0%). Oral anticoagulation reduced the risk of ischaemic major adverse cardiovascular events (nine [4%] of 212 vs 38 [19%] of 200; pooled HR 0·27 [95% CI 0·13-0·56]; I2=0%). There was no significant increase in haemorrhagic major adverse cardiovascular events (15 [7%] of 212 vs nine [5%] of 200; pooled HR 1·80 [95% CI 0·77-4·21]; I2=0%), death from any cause (38 [18%] of 212 vs 29 [15%] of 200; 1·29 [0·78-2·11]; I2=50%), or death or dependence after 1 year (78 [53%] of 147 vs 74 [51%] of 145; pooled odds ratio 1·12 [95% CI 0·70-1·79]; I2=0%). INTERPRETATION: For people with atrial fibrillation and intracranial haemorrhage, oral anticoagulation had uncertain effects on the risk of any stroke or cardiovascular death (both overall and in subgroups), haemorrhagic major adverse cardiovascular events, and functional outcome. Oral anticoagulation reduced the risk of ischaemic major adverse cardiovascular events, which can inform clinical practice. These findings should encourage recruitment to, and completion of, ongoing trials. FUNDING: British Heart Foundation.

Which patients with metastatic hormone-sensitive prostate cancer benefit from docetaxel: a systematic review and meta-analysis of individual participant data from randomised trials.

BACKGROUND: Adding docetaxel to androgen deprivation therapy (ADT) improves survival in patients with metastatic, hormone-sensitive prostate cancer, but uncertainty remains about who benefits most. We therefore aimed to obtain up-to-date estimates of the overall effects of docetaxel and to assess whether these effects varied according to prespecified characteristics of the patients or their tumours. METHODS: The STOPCAP M1 collaboration conducted a systematic review and meta-analysis of individual participant data. We searched MEDLINE (from database inception to March 31, 2022), Embase (from database inception to March 31, 2022), the Cochrane Central Register of Controlled Trials (from database inception to March 31, 2022), proceedings of relevant conferences (from Jan 1, 1990, to Dec 31, 2022), and ClinicalTrials.gov (from database inception to March 28, 2023) to identify eligible randomised trials that assessed docetaxel plus ADT compared with ADT alone in patients with metastatic, hormone-sensitive prostate cancer. Detailed and updated individual participant data were requested directly from study investigators or through relevant repositories. The primary outcome was overall survival. Secondary outcomes were progression-free survival and failure-free survival. Overall pooled effects were estimated using an adjusted, intention-to-treat, two-stage, fixed-effect meta-analysis, with one-stage and random-effects sensitivity analyses. Missing covariate values were imputed. Differences in effect by participant characteristics were estimated using adjusted two-stage, fixed-effect meta-analysis of within-trial interactions on the basis of progression-free survival to maximise power. Identified effect modifiers were also assessed on the basis of overall survival. To explore multiple subgroup interactions and derive subgroup-specific absolute treatment effects we used one-stage flexible parametric modelling and regression standardisation. We assessed the risk of bias using the Cochrane Risk of Bias 2 tool. This study is registered with PROSPERO, CRD42019140591. FINDINGS: We obtained individual participant data from 2261 patients (98% of those randomised) from three eligible trials (GETUG-AFU15, CHAARTED, and STAMPEDE trials), with a median follow-up of 72 months (IQR 55-85). Individual participant data were not obtained from two additional small trials. Based on all included trials and patients, there were clear benefits of docetaxel on overall survival (hazard ratio [HR] 0·79, 95% CI 0·70 to 0·88; p<0·0001), progression-free survival (0·70, 0·63 to 0·77; p<0·0001), and failure-free survival (0·64, 0·58 to 0·71; p<0·0001), representing 5-year absolute improvements of around 9-11%. The overall risk of bias was assessed to be low, and there was no strong evidence of differences in effect between trials for all three main outcomes. The relative effect of docetaxel on progression-free survival appeared to be greater with increasing clinical T stage (pinteraction=0·0019), higher volume of metastases (pinteraction=0·020), and, to a lesser extent, synchronous diagnosis of metastatic disease (pinteraction=0·077). Taking into account the other interactions, the effect of docetaxel was independently modified by volume and clinical T stage, but not timing. There was no strong evidence that docetaxel improved absolute effects at 5 years for patients with low-volume, metachronous disease (-1%, 95% CI -15 to 12, for progression-free survival; 0%, -10 to 12, for overall survival). The largest absolute improvement at 5 years was observed for those with high-volume, clinical T stage 4 disease (27%, 95% CI 17 to 37, for progression-free survival; 35%, 24 to 47, for overall survival). INTERPRETATION: The addition of docetaxel to hormone therapy is best suited to patients with poorer prognosis for metastatic, hormone-sensitive prostate cancer based on a high volume of disease and potentially the bulkiness of the primary tumour. There is no evidence of meaningful benefit for patients with metachronous, low-volume disease who should therefore be managed differently. These results will better characterise patients most and, importantly, least likely to gain benefit from docetaxel, potentially changing international practice, guiding clinical decision making, better informing treatment policy, and improving patient outcomes. FUNDING: UK Medical Research Council and Prostate Cancer UK.

Using individual participant data to improve network meta-analysis projects.

A network meta-analysis combines the evidence from existing randomised trials about the comparative efficacy of multiple treatments. It allows direct and indirect evidence about each comparison to be included in the same analysis, and provides a coherent framework to compare and rank treatments. A traditional network meta-analysis uses aggregate data (eg, treatment effect estimates and standard errors) obtained from publications or trial investigators. An alternative approach is to obtain, check, harmonise and meta-analyse the individual participant data (IPD) from each trial. In this article, we describe potential advantages of IPD for network meta-analysis projects, emphasising five key benefits: (1) improving the quality and scope of information available for inclusion in the meta-analysis, (2) examining and plotting distributions of covariates across trials (eg, for potential effect modifiers), (3) standardising and improving the analysis of each trial, (4) adjusting for prognostic factors to allow a network meta-analysis of conditional treatment effects and (5) including treatment-covariate interactions (effect modifiers) to allow relative treatment effects to vary by participant-level covariate values (eg, age, baseline depression score). A running theme of all these benefits is that they help examine and reduce heterogeneity (differences in the true treatment effect between trials) and inconsistency (differences in the true treatment effect between direct and indirect evidence) in the network. As a consequence, an IPD network meta-analysis has the potential for more precise, reliable and informative results for clinical practice and even allows treatment comparisons to be made for individual patients and targeted populations conditional on their particular characteristics.

Estimating interactions and subgroup-specific treatment effects in meta-analysis without aggregation bias: A within-trial framework.

Estimation of within-trial interactions in meta-analysis is crucial for reliable assessment of how treatment effects vary across participant subgroups. However, current methods have various limitations. Patients, clinicians and policy-makers need reliable estimates of treatment effects within specific covariate subgroups, on relative and absolute scales, in order to target treatments appropriately-which estimation of an interaction effect does not in itself provide. Also, the focus has been on covariates with only two subgroups, and may exclude relevant data if only a single subgroup is reported. Therefore, in this article we further develop the "within-trial" framework by providing practical methods to (1) estimate within-trial interactions across two or more subgroups; (2) estimate subgroup-specific ("floating") treatment effects that are compatible with the within-trial interactions and make maximum use of available data; and (3) clearly present this data using novel implementation of forest plots. We described the steps involved and apply the methods to two examples taken from previously published meta-analyses, and demonstrate a straightforward implementation in Stata based upon existing code for multivariate meta-analysis. We discuss how the within-trial framework and plots can be utilised with aggregate (or "published") source data, as well as with individual participant data, to effectively demonstrate how treatment effects differ across participant subgroups.

Duplicated network meta-analysis in advanced prostate cancer: a case study and recommendations for change.

BACKGROUND: Research overlap and duplication is a recognised problem in the context of both pairwise and network systematic reviews and meta-analyses. As a case study, we carried out a scoping review to identify and examine duplicated network meta-analyses (NMAs) in a specific disease setting where several novel therapies have recently emerged: hormone-sensitive metastatic prostate cancer (mHSPC). METHODS: MEDLINE and EMBASE were systematically searched, in January 2020, for indirect or mixed treatment comparisons or network meta-analyses of the systemic treatments docetaxel and abiraterone acetate in the mHSPC setting, with a time-to-event outcome reported on the hazard-ratio scale. Eligibility decisions were made, and data extraction performed, by two independent reviewers. RESULTS: A total of 13 eligible reviews were identified, analysing between 3 and 8 randomised comparisons, and comprising between 1773 and 7844 individual patients. Although the included trials and treatments showed a high degree of overlap, we observed considerable variation between identified reviews in terms of review aims, eligibility criteria and included data, statistical methodology, reporting and inference. Furthermore, crucial methodological details and specific source data were often unclear. CONCLUSIONS AND RECOMMENDATIONS: Variation across duplicated NMAs, together with reporting inadequacies, may compromise identification of best-performing treatments. Particularly in fast-moving fields, review authors should be aware of all relevant studies, and of other reviews with potential for overlap or duplication. We recommend that review protocols be published in advance, with greater clarity regarding the specific aims or scope of the project, and that reports include information on how the work builds upon existing knowledge. Source data and results should be clearly and completely presented to allow unbiased interpretation.

Association between tocilizumab, sarilumab and all-cause mortality at 28 days in hospitalised patients with COVID-19: A network meta-analysis.

BACKGROUND: A recent prospective meta-analysis demonstrated that interleukin-6 antagonists are associated with lower all-cause mortality in hospitalised patients with COVID-19, compared with usual care or placebo. However, emerging evidence suggests that clinicians are favouring the use of tocilizumab over sarilumab. A new randomised comparison of these agents from the REMAP-CAP trial shows similar effects on in-hospital mortality. Therefore, we initiated a network meta-analysis, to estimate pairwise associations between tocilizumab, sarilumab and usual care or placebo with 28-day mortality, in COVID-19 patients receiving concomitant corticosteroids and ventilation, based on all available direct and indirect evidence. METHODS: Eligible trials randomised hospitalised patients with COVID-19 that compared tocilizumab or sarilumab with usual care or placebo in the prospective meta-analysis or that directly compared tocilizumab with sarilumab. Data were restricted to patients receiving corticosteroids and either non-invasive or invasive ventilation at randomisation. Pairwise associations between tocilizumab, sarilumab and usual care or placebo for all-cause mortality 28 days after randomisation were estimated using a frequentist contrast-based network meta-analysis of odds ratios (ORs), implementing multivariate fixed-effects models that assume consistency between the direct and indirect evidence. FINDINGS: One trial (REMAP-CAP) was identified that directly compared tocilizumab with sarilumab and supplied results on all-cause mortality at 28-days. This network meta-analysis was based on 898 eligible patients (278 deaths) from REMAP-CAP and 3710 eligible patients from 18 trials (1278 deaths) from the prospective meta-analysis. Summary ORs were similar for tocilizumab [0·82 [0·71-0·95, p = 0·008]] and sarilumab [0·80 [0·61-1·04, p = 0·09]] compared with usual care or placebo. The summary OR for 28-day mortality comparing tocilizumab with sarilumab was 1·03 [95%CI 0·81-1·32, p = 0·80]. The p-value for the global test of inconsistency was 0·28. CONCLUSIONS: Administration of either tocilizumab or sarilumab was associated with lower 28-day all-cause mortality compared with usual care or placebo. The association is not dependent on the choice of interleukin-6 receptor antagonist.

Implications of analysing time-to-event outcomes as binary in meta-analysis: empirical evidence from the Cochrane Database of Systematic Reviews.

BACKGROUND: Systematic reviews and meta-analysis of time-to-event outcomes are frequently published within the Cochrane Database of Systematic Reviews (CDSR). However, these outcomes are handled differently across meta-analyses. They can be analysed on the hazard ratio (HR) scale or can be dichotomized and analysed as binary outcomes using effect measures such as odds ratios (OR) or risk ratios (RR). We investigated the impact of reanalysing meta-analyses from the CDSR that used these different effect measures. METHODS: We extracted two types of meta-analysis data from the CDSR: either recorded in a binary form only ("binary"), or in binary form together with observed minus expected and variance statistics ("OEV"). We explored how results for time-to-event outcomes originally analysed as "binary" change when analysed using the complementary log-log (clog-log) link on a HR scale. For the data originally analysed as HRs ("OEV"), we compared these results to analysing them as binary on a HR scale using the clog-log link or using a logit link on an OR scale. RESULTS: The pooled HR estimates were closer to 1 than the OR estimates in the majority of meta-analyses. Important differences in between-study heterogeneity between the HR and OR analyses were also observed. These changes led to discrepant conclusions between the OR and HR scales in some meta-analyses. Situations under which the clog-log link performed better than logit link and vice versa were apparent, indicating that the correct choice of the method does matter. Differences between scales arise mainly when event probability is high and may occur via differences in between-study heterogeneity or via increased within-study standard error in the OR relative to the HR analyses. CONCLUSIONS: We identified that dichotomising time-to-event outcomes may be adequate for low event probabilities but not for high event probabilities. In meta-analyses where only binary data are available, the complementary log-log link may be a useful alternative when analysing time-to-event outcomes as binary, however the exact conditions need further exploration. These findings provide guidance on the appropriate methodology that should be used when conducting such meta-analyses.

Sharing individual participant data: through a systematic reviewer lens.

An increasing prevalence of data-sharing models, aimed at making individual participant data (IPD) from clinical trials widely available, should facilitate the conduct of systematic reviews and meta-analyses based on IPD. We have assessed these different data-sharing approaches, from the perspective of experienced IPD reviewers, to examine their utility for conducting systematic reviews based on IPD, and to highlight any challenges. We present an overview of the range of different models, including the traditional, single question approach, topic-based repositories, and the newer generic data platforms, and show that there are benefits and drawbacks to each. In particular, not all of the new models allow researchers to fully realise the well-documented advantages of using IPD for meta-analysis, and we offer potential solutions that can help improve both data quantity and utility. However, to achieve the "nirvana" of an ideal clinical data sharing environment, both for IPD meta-analysis and other secondary research purposes, we propose that data providers, data requestors, funders, and platforms need to adopt a more joined-up and standardised approach.

Coenzyme Q10 to manage chronic heart failure with a reduced ejection fraction: a systematic review and economic evaluation.

BACKGROUND: Chronic heart failure is a debilitating condition that accounts for an annual NHS spend of £2.3B. Low levels of endogenous coenzyme Q10 may exacerbate chronic heart failure. Coenzyme Q10 supplements might improve symptoms and slow progression. As statins are thought to block the production of coenzyme Q10, supplementation might be particularly beneficial for patients taking statins. OBJECTIVES: To assess the clinical effectiveness and cost-effectiveness of coenzyme Q10 in managing chronic heart failure with a reduced ejection fraction. METHODS: A systematic review that included randomised trials comparing coenzyme Q10 plus standard care with standard care alone in chronic heart failure. Trials restricted to chronic heart failure with a preserved ejection fraction were excluded. Databases including MEDLINE, EMBASE and CENTRAL were searched up to March 2020. Risk of bias was assessed using the Cochrane Risk of Bias tool (version 5.2). A planned individual participant data meta-analysis was not possible and meta-analyses were mostly based on aggregate data from publications. Potential effect modification was examined using meta-regression. A Markov model used treatment effects from the meta-analysis and baseline mortality and hospitalisation from an observational UK cohort. Costs were evaluated from an NHS and Personal Social Services perspective and expressed in Great British pounds at a 2019/20 price base. Outcomes were expressed in quality-adjusted life-years. Both costs and outcomes were discounted at a 3.5% annual rate. RESULTS: A total of 26 trials, comprising 2250 participants, were included in the systematic review. Many trials were reported poorly and were rated as having a high or unclear risk of bias in at least one domain. Meta-analysis suggested a possible benefit of coenzyme Q10 on all-cause mortality (seven trials, 1371 participants; relative risk 0.68, 95% confidence interval 0.45 to 1.03). The results for short-term functional outcomes were more modest or unclear. There was no indication of increased adverse events with coenzyme Q10. Meta-regression found no evidence of treatment interaction with statins. The base-case cost-effectiveness analysis produced incremental costs of £4878, incremental quality-adjusted life-years of 1.34 and an incremental cost-effectiveness ratio of £3650. Probabilistic sensitivity analyses showed that at thresholds of £20,000 and £30,000 per quality-adjusted life-year coenzyme Q10 had a high probability (95.2% and 95.8%, respectively) of being more cost-effective than standard care alone. Scenario analyses in which the population and other model assumptions were varied all found coenzyme Q10 to be cost-effective. The expected value of perfect information suggested that a new trial could be valuable. LIMITATIONS: For most outcomes, data were available from few trials and different trials contributed to different outcomes. There were concerns about risk of bias and whether or not the results from included trials were applicable to a typical UK population. A lack of individual participant data meant that planned detailed analyses of effect modifiers were not possible. CONCLUSIONS: Available evidence suggested that, if prescribed, coenzyme Q10 has the potential to be clinically effective and cost-effective for heart failure with a reduced ejection fraction. However, given important concerns about risk of bias, plausibility of effect sizes and applicability of the evidence base, establishing whether or not coenzyme Q10 is genuinely effective in a typical UK population is important, particularly as coenzyme Q10 has not been subject to the scrutiny of drug-licensing processes. Stronger evidence is needed before considering its prescription in the NHS. FUTURE WORK: A new independent, well-designed clinical trial of coenzyme Q10 in a typical UK heart failure with a reduced ejection fraction population may be warranted. STUDY REGISTRATION: This study is registered as PROSPERO CRD42018106189. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 26, No. 4. See the NIHR Journals Library website for further project information.

People living with chronic heart failure suffer from shortness of breath, ankle swelling, tiredness, frequent stays in hospital and reduced quality of life and have shorter lives. The NHS spends over £2 billion each year managing chronic heart failure. Coenzyme Q10 is a vitamin-like substance made by the body that helps cells produce energy. Low levels of coenzyme Q10 in heart muscle may lead to, or exacerbate, chronic heart failure. Taking coenzyme Q10 supplements might improve symptoms or slow deterioration. To the best of our knowledge, we found all randomised clinical trials of coenzyme Q10 in patients with the type of chronic heart failure caused by muscle weakness (i.e. heart failure with reduced ejection fraction, where the heart's pumping function is weaker than normal). We asked the research groups responsible for these trials to provide the patient data that they had collected in their trials. Most research groups did not share their data and so we mainly used information from published trial reports. This limited our planned analyses. We found that taking coenzyme Q10 alongside usual treatment for heart failure with reduced ejection fraction potentially reduced deaths by approximately one-third and reduced readmission to hospital by around 40%. However, these results were uncertain. Side effects were not increased. We had some concerns about how reliable the data were, and it is not clear how well the results apply to UK patients. We also worked out what the benefits and costs to the NHS would be if coenzyme Q10 became available on prescription for patients with heart failure with reduced ejection fraction. Our model found that prescription could be worthwhile; however, a new trial is needed first to make sure that coenzyme Q10 improves outcomes for patients. A new trial would be particularly important because coenzyme Q10 has not been assessed in the same way as prescribed medicines. A new trial could make sure that there is better evidence about whether or not prescribing would be a good use of NHS resources.

A framework for prospective, adaptive meta-analysis (FAME) of aggregate data from randomised trials.

BACKGROUND: The vast majority of systematic reviews are planned retrospectively, once most eligible trials have completed and reported, and are based on aggregate data that can be extracted from publications. Prior knowledge of trial results can introduce bias into both review and meta-analysis methods, and the omission of unpublished data can lead to reporting biases. We present a collaborative framework for prospective, adaptive meta-analysis (FAME) of aggregate data to provide results that are less prone to bias. Also, with FAME, we monitor how evidence from trials is accumulating, to anticipate the earliest opportunity for a potentially definitive meta-analysis. METHODOLOGY: We developed and piloted FAME alongside 4 systematic reviews in prostate cancer, which allowed us to refine the key principles. These are to: (1) start the systematic review process early, while trials are ongoing or yet to report; (2) liaise with trial investigators to develop a detailed picture of all eligible trials; (3) prospectively assess the earliest possible timing for reliable meta-analysis based on the accumulating aggregate data; (4) develop and register (or publish) the systematic review protocol before trials produce results and seek appropriate aggregate data; (5) interpret meta-analysis results taking account of both available and unavailable data; and (6) assess the value of updating the systematic review and meta-analysis. These principles are illustrated via a hypothetical review and their application to 3 published systematic reviews. CONCLUSIONS: FAME can reduce the potential for bias, and produce more timely, thorough and reliable systematic reviews of aggregate data.

Adjuvant or early salvage radiotherapy for the treatment of localised and locally advanced prostate cancer: a prospectively planned systematic review and meta-analysis of aggregate data.

BACKGROUND: It is unclear whether adjuvant or early salvage radiotherapy following radical prostatectomy is more appropriate for men who present with localised or locally advanced prostate cancer. We aimed to prospectively plan a systematic review of randomised controlled trials (RCTs) comparing these radiotherapy approaches. METHODS: We used a prospective framework for adaptive meta-analysis (FAME), starting the review process while eligible trials were ongoing. RCTs were eligible if they aimed to compare immediate adjuvant radiotherapy versus early salvage radiotherapy, following radical prostatectomy in men (age ≥18 years) with intermediate-risk or high-risk, localised or locally advanced prostate cancer. We searched trial registers and conference proceedings until July 8, 2020, to identify eligible RCTs. By establishing the ARTISTIC collaboration with relevant trialists, we were able to anticipate when eligible trial results would emerge, and we developed and registered a protocol with PROSPERO before knowledge of the trial results (CRD42019132669). We used a harmonised definition of event-free survival, as the time from randomisation until the first evidence of either biochemical progression (prostate-specific antigen [PSA] ≥0·4 ng/mL and rising after completion of any postoperative radiotherapy), clinical or radiological progression, initiation of a non-trial treatment, death from prostate cancer, or a PSA level of at least 2·0 ng/mL at any time after randomisation. We predicted when we would have sufficient power to assess whether adjuvant radiotherapy was superior to early salvage radiotherapy. Investigators supplied results for event-free survival, both overall and within predefined patient subgroups. Hazard ratios (HRs) for the effects of radiotherapy timing on event-free survival and subgroup interactions were combined using fixed-effect meta-analysis. FINDINGS: We identified three eligible trials and were able to obtain updated results for event-free survival for 2153 patients recruited between November, 2007, and December, 2016. Median follow-up ranged from 60 months to 78 months, with a maximum follow-up of 132 months. 1075 patients were randomly assigned to receive adjuvant radiotherapy and 1078 to a policy of early salvage radiotherapy, of whom 421 (39·1%) had commenced treatment at the time of analysis. Patient characteristics were balanced within trials and overall. Median age was similar between trials at 64 or 65 years (with IQRs ranging from 59 to 68 years) across the three trials and most patients (1671 [77·6%]) had a Gleason score of 7. All trials were assessed as having low risk of bias. Based on 270 events, the meta-analysis showed no evidence that event-free survival was improved with adjuvant radiotherapy compared with early salvage radiotherapy (HR 0·95, 95% CI 0·75-1·21; p=0·70), with only a 1 percentage point (95% CI -2 to 3) change in 5-year event-free survival (89% vs 88%). Results were consistent across trials (heterogeneity p=0·18; I2=42%). INTERPRETATION: This collaborative and prospectively designed systematic review and meta-analysis suggests that adjuvant radiotherapy does not improve event-free survival in men with localised or locally advanced prostate cancer. Until data on long-term outcomes are available, early salvage treatment would seem the preferable treatment policy as it offers the opportunity to spare many men radiotherapy and its associated side-effects. FUNDING: UK Medical Research Council.

Comparison of aggregate and individual participant data approaches to meta-analysis of randomised trials: An observational study.

BACKGROUND: It remains unclear when standard systematic reviews and meta-analyses that rely on published aggregate data (AD) can provide robust clinical conclusions. We aimed to compare the results from a large cohort of systematic reviews and meta-analyses based on individual participant data (IPD) with meta-analyses of published AD, to establish when the latter are most likely to be reliable and when the IPD approach might be required. METHODS AND FINDINGS: We used 18 cancer systematic reviews that included IPD meta-analyses: all of those completed and published by the Meta-analysis Group of the MRC Clinical Trials Unit from 1991 to 2010. We extracted or estimated hazard ratios (HRs) and standard errors (SEs) for survival from trial reports and compared these with IPD equivalents at both the trial and meta-analysis level. We also extracted or estimated the number of events. We used paired t tests to assess whether HRs and SEs from published AD differed on average from those from IPD. We assessed agreement, and whether this was associated with trial or meta-analysis characteristics, using the approach of Bland and Altman. The 18 systematic reviews comprised 238 unique trials or trial comparisons, including 37,082 participants. A HR and SE could be generated for 127 trials, representing 53% of the trials and approximately 79% of eligible participants. On average, trial HRs derived from published AD were slightly more in favour of the research interventions than those from IPD (HRAD to HRIPD ratio = 0.95, p = 0.007), but the limits of agreement show that for individual trials, the HRs could deviate substantially. These limits narrowed with an increasing number of participants (p < 0.001) or a greater number (p < 0.001) or proportion (p < 0.001) of events in the AD. On average, meta-analysis HRs from published AD slightly tended to favour the research interventions whether based on fixed-effect (HRAD to HRIPD ratio = 0.97, p = 0.088) or random-effects (HRAD to HRIPD ratio = 0.96, p = 0.044) models, but the limits of agreement show that for individual meta-analyses, agreement was much more variable. These limits tended to narrow with an increasing number (p = 0.077) or proportion of events (p = 0.11) in the AD. However, even when the information size of the AD was large, individual meta-analysis HRs could still differ from their IPD equivalents by a relative 10% in favour of the research intervention to 5% in favour of control. We utilised the results to construct a decision tree for assessing whether an AD meta-analysis includes sufficient information, and when estimates of effects are most likely to be reliable. A lack of power at the meta-analysis level may have prevented us identifying additional factors associated with the reliability of AD meta-analyses, and we cannot be sure that our results are generalisable to all outcomes and effect measures. CONCLUSIONS: In this study we found that HRs from published AD were most likely to agree with those from IPD when the information size was large. Based on these findings, we provide guidance for determining systematically when standard AD meta-analysis will likely generate robust clinical conclusions, and when the IPD approach will add considerable value.

A Systematic Review and Recommendation for Reporting of Surrogate Endpoint Evaluation Using Meta-analyses.

BACKGROUND: Meta-analysis of randomized controlled trials (RCTs) has been widely conducted for the evaluation of surrogate endpoints in oncology, but little attention has been given to the adequacy of reporting and interpretation. This review evaluated the reporting quality of published meta-analyses on surrogacy evaluation and developed recommendations for future reporting. METHODS: We searched PubMed through August 2017 to identify studies that evaluated surrogate endpoints using the meta-analyses of RCTs in oncology. Both individual patient data (IPD) and aggregate data (AD) meta-analyses were included for the review. RESULTS: Eighty meta-analyses were identified: 22 used IPD and 58 used AD from multiple RCTs. We observed variability and reporting deficiencies in both IPD and AD meta-analyses, especially on reporting of trial selection, endpoint definition, study and patient characteristics for included RCTs, and important statistical methods and results. Based on these findings, we proposed a checklist and recommendations to improve completeness, consistency, and transparency of reports of meta-analytic surrogacy evaluation. We highlighted key aspects of the design and analysis of surrogate endpoints and presented explanations and rationale why these items should be clearly reported in surrogacy evaluation. CONCLUSIONS: Our reporting of surrogate endpoint evaluation using meta-analyses (ReSEEM) guidelines and recommendations will improve the quality in reporting and facilitate the interpretation and reproducibility of meta-analytic surrogacy evaluation. Also, they should help promote greater methodological consistency and could also serve as an evaluation tool in the peer review process for assessing surrogacy research.

Prostate Radiotherapy for Metastatic Hormone-sensitive Prostate Cancer: A STOPCAP Systematic Review and Meta-analysis.

BACKGROUND: Many trials are evaluating therapies for men with metastatic hormone-sensitive prostate cancer (mHSPC). OBJECTIVE: To systematically review trials of prostate radiotherapy. DESIGN, SETTING, AND PARTICIPANTS: Using a prospective framework (framework for adaptive meta-analysis [FAME]), we prespecified methods before any trial results were known. We searched extensively for eligible trials and asked investigators when results would be available. We could then anticipate that a definitive meta-analysis of the effects of prostate radiotherapy was possible. We obtained prepublication, unpublished, and harmonised results from investigators. INTERVENTION: We included trials that randomised men to prostate radiotherapy and androgen deprivation therapy (ADT) or ADT only. OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS: Hazard ratios (HRs) for the effects of prostate radiotherapy on survival, progression-free survival (PFS), failure-free survival (FFS), biochemical progression, and subgroup interactions were combined using fixed-effect meta-analysis. RESULTS AND LIMITATIONS: We identified one ongoing (PEACE-1) and two completed (HORRAD and STAMPEDE) eligible trials. Pooled results of the latter (2126 men; 90% of those eligible) showed no overall improvement in survival (HR=0.92, 95% confidence interval [CI] 0.81-1.04, p=0.195) or PFS (HR=0.94, 95% CI 0.84-1.05, p=0.238) with prostate radiotherapy. There was an overall improvement in biochemical progression (HR=0.74, 95% CI 0.67-0.82, p=0.94×10-8) and FFS (HR=0.76, 95% CI 0.69-0.84, p=0.64×10-7), equivalent to ∼10% benefit at 3yr. The effect of prostate radiotherapy varied by metastatic burden-a pattern consistent across trials and outcome measures, including survival (<5, ≥5; interaction HR=1.47, 95% CI 1.11-1.94, p=0.007). There was 7% improvement in 3-yr survival in men with fewer than five bone metastases. CONCLUSIONS: Prostate radiotherapy should be considered for men with mHSPC with a low metastatic burden. PATIENT SUMMARY: Prostate cancer that has spread to other parts of the body (metastases) is usually treated with hormone therapy. In men with fewer than five bone metastases, addition of prostate radiotherapy helped them live longer and should be considered.

Evidence Synthesis to Accelerate and Improve the Evaluation of Therapies for Metastatic Hormone-sensitive Prostate Cancer.

There are many ongoing randomised trials of promising therapies for metastatic hormone-sensitive prostate cancer (mHSPC), but standard systematic reviews may not synthesise these in a timely or reliable way. We demonstrate how a novel approach to evidence synthesis is being used to speed up and improve treatment evaluations for mHSPC. This more prospective, dynamic, and collaborative approach to systematic reviews of both trial results and individual participant data (IPD) is helping in establishing quickly and reliably which treatments are most effective and for which men. However, mHSPC is a complex disease and trials can be lengthy. Thus, parallel efforts will synthesise further IPD to identify early surrogate endpoints for overall survival and prognostic factors, to reduce the duration and improve the design of future trials. The STOPCAP M1 repository of IPD will be made available to other researchers for tackling new questions that might arise. The associated global, collaborative forum will aid strategic and harmonised development of the next generation of mHSPC trials (STOPCAP M1; http://www.stopcapm1.org). PATIENT SUMMARY: We report how a worldwide research effort will review results and anonymised data from advanced prostate cancer trials in new and different ways. We will work out, as quickly as possible, which advanced prostate cancer treatments are best and for which men. We will also find which measures of prostate cancer control and which cancer and patient characteristics can be used to shorten and improve trials of newer treatments. Finally, we describe how the data will help answer new questions about advanced prostate cancer and its treatments.

The Accuracy of Clinical Staging of Stage I-IIIa Non-Small Cell Lung Cancer: An Analysis Based on Individual Participant Data.

BACKGROUND: Clinical staging of non-small cell lung cancer (NSCLC) helps determine the prognosis and treatment of patients; few data exist on the accuracy of clinical staging and the impact on treatment and survival of patients. We assessed whether participant or trial characteristics were associated with clinical staging accuracy as well as impact on survival. METHODS: We used individual participant data from randomized controlled trials (RCTs), supplied for a meta-analysis of preoperative chemotherapy (± radiotherapy) vs surgery alone (± radiotherapy) in NSCLC. We assessed agreement between clinical TNM (cTNM) stage at randomization and pathologic TNM (pTNM) stage, for participants in the control group. RESULTS: Results are based on 698 patients who received surgery alone (± radiotherapy) with data for cTNM and pTNM stage. Forty-six percent of cases were cTNM stage I, 23% were cTNM stage II, and 31% were cTNM stage IIIa. cTNM stage disagreed with pTNM stage in 48% of cases, with 34% clinically understaged and 14% clinically overstaged. Agreement was not associated with age (P = .12), sex (P = .62), histology (P = .82), staging method (P = .32), or year of randomization (P = .98). Poorer survival in understaged patients was explained by the underlying pTNM stage. Clinical staging failed to detect T4 disease in 10% of cases and misclassified nodal disease in 38%. CONCLUSIONS: This study demonstrates suboptimal agreement between clinical and pathologic staging. Discrepancies between clinical and pathologic T and N staging could have led to different treatment decisions in 10% and 38% of cases, respectively. There is therefore a need for further research into improving staging accuracy for patients with stage I-IIIa NSCLC.