Handling missing data when estimating causal effects with targeted maximum likelihood estimation.

Targeted maximum likelihood estimation (TMLE) is increasingly used for doubly robust causal inference, but how missing data should be handled when using TMLE with data-adaptive approaches is unclear. Based on data (1992-1998) from the Victorian Adolescent Health Cohort Study, we conducted a simulation study to evaluate 8 missing-data methods in this context: complete-case analysis, extended TMLE incorporating an outcome-missingness model, the missing covariate missing indicator method, and 5 multiple imputation (MI) approaches using parametric or machine-learning models. We considered 6 scenarios that varied in terms of exposure/outcome generation models (presence of confounder-confounder interactions) and missingness mechanisms (whether outcome influenced missingness in other variables and presence of interaction/nonlinear terms in missingness models). Complete-case analysis and extended TMLE had small biases when outcome did not influence missingness in other variables. Parametric MI without interactions had large bias when exposure/outcome generation models included interactions. Parametric MI including interactions performed best in bias and variance reduction across all settings, except when missingness models included a nonlinear term. When choosing a method for handling missing data in the context of TMLE, researchers must consider the missingness mechanism and, for MI, compatibility with the analysis method. In many settings, a parametric MI approach that incorporates interactions and nonlinearities is expected to perform well.

Cardiac glycosides inhibit early and late vaccinia virus protein expression.

Cardiac glycosides (CGs) are natural steroid glycosides, which act as inhibitors of the cellular sodium-potassium ATPase pump. Although traditionally considered toxic to human cells, CGs are widely used as drugs for the treatment of cardiovascular-related medical conditions. More recently, CGs have been explored as potential anti-viral drugs and inhibit replication of a range of RNA and DNA viruses. Previously, a compound screen identified CGs that inhibited vaccinia virus (VACV) infection. However, no further investigation of the inhibitory potential of these compounds was performed, nor was there investigation of the stage(s) of the poxvirus lifecycle they impacted. Here, we investigated the anti-poxvirus activity of a broad panel of CGs. We found that all CGs tested were potent inhibitors of VACV replication. Our virological experiments showed that CGs did not impact virus infectivity, binding, or entry. Rather, experiments using recombinant viruses expressing reporter proteins controlled by VACV promoters and arabinoside release assays demonstrated that CGs inhibited early and late VACV protein expression at different concentrations. Lack of virus assembly in the presence of CGs was confirmed using electron microscopy. Thus, we expand our understanding of compounds with anti-poxvirus activity and highlight a yet unrecognized mechanism by which poxvirus replication can be inhibited.

Sample-to-Answer Detection of SARS-CoV-2 Viremia Using Thermally Responsive Alkane Partitions.

The diagnosis of bloodborne viral infections (viremia) is currently relegated to central laboratories because of the complex procedures required to detect viruses in blood samples. The development of point-of-care diagnostics for viremia would enable patients to receive a diagnosis and begin treatment immediately instead of waiting days for results. Point-of-care systems for viremia have been limited by the challenges of integrating multiple precise steps into a fully automated (i.e., sample-to-answer), compact, low-cost system. We recently reported the development of thermally responsive alkane partitions (TRAPs), which enable the complete automation of diagnostic assays with complex samples. Here we report the use of TRAPs for the sample-to-answer detection of viruses in blood using a low-cost portable device and easily manufacturable cassettes. Specifically, we demonstrate the detection of SARS-CoV-2 in spiked blood samples, and we show that our system detects viremia in COVID-19 patient samples with good agreement to conventional RT-qPCR. We anticipate that our sample-to-answer system can be used to rapidly diagnose SARS-CoV-2 viremia at the point of care, leading to better health outcomes for patients with severe COVID-19 disease, and that our system can be applied to the diagnosis of other life-threatening bloodborne viral diseases, including Hepatitis C and HIV.

Determining sample size in a personalized randomized controlled (PRACTical) trial.

In clinical settings with no commonly accepted standard-of-care, multiple treatment regimens are potentially useful, but some treatments may not be appropriate for some patients. A personalized randomized controlled trial (PRACTical) design has been proposed for this setting. For a network of treatments, each patient is randomized only among treatments which are appropriate for them. The aim is to produce treatment rankings that can inform clinical decisions about treatment choices for individual patients. Here we propose methods for determining sample size in a PRACTical design, since standard power-based methods are not applicable. We derive a sample size by evaluating information gained from trials of varying sizes. For a binary outcome, we quantify how many adverse outcomes would be prevented by choosing the top-ranked treatment for each patient based on trial results rather than choosing a random treatment from the appropriate personalized randomization list. In simulations, we evaluate three performance measures: mean reduction in adverse outcomes using sample information, proportion of simulated patients for whom the top-ranked treatment performed as well or almost as well as the best appropriate treatment, and proportion of simulated trials in which the top-ranked treatment performed better than a randomly chosen treatment. We apply the methods to a trial evaluating eight different combination antibiotic regimens for neonatal sepsis (NeoSep1), in which a PRACTical design addresses varying patterns of antibiotic choice based on disease characteristics and resistance. Our proposed approach produces results that are more relevant to complex decision making by clinicians and policy makers.

An evaluation of sample size requirements for developing risk prediction models with binary outcomes.

BACKGROUND: Risk prediction models are routinely used to assist in clinical decision making. A small sample size for model development can compromise model performance when the model is applied to new patients. For binary outcomes, the calibration slope (CS) and the mean absolute prediction error (MAPE) are two key measures on which sample size calculations for the development of risk models have been based. CS quantifies the degree of model overfitting while MAPE assesses the accuracy of individual predictions. METHODS: Recently, two formulae were proposed to calculate the sample size required, given anticipated features of the development data such as the outcome prevalence and c-statistic, to ensure that the expectation of the CS and MAPE (over repeated samples) in models fitted using MLE will meet prespecified target values. In this article, we use a simulation study to evaluate the performance of these formulae. RESULTS: We found that both formulae work reasonably well when the anticipated model strength is not too high (c-statistic < 0.8), regardless of the outcome prevalence. However, for higher model strengths the CS formula underestimates the sample size substantially. For example, for c-statistic = 0.85 and 0.9, the sample size needed to be increased by at least 50% and 100%, respectively, to meet the target expected CS. On the other hand, the MAPE formula tends to overestimate the sample size for high model strengths. These conclusions were more pronounced for higher prevalence than for lower prevalence. Similar results were drawn when the outcome was time to event with censoring. Given these findings, we propose a simulation-based approach, implemented in the new R package 'samplesizedev', to correctly estimate the sample size even for high model strengths. The software can also calculate the variability in CS and MAPE, thus allowing for assessment of model stability. CONCLUSIONS: The calibration and MAPE formulae suggest sample sizes that are generally appropriate for use when the model strength is not too high. However, they tend to be biased for higher model strengths, which are not uncommon in clinical risk prediction studies. On those occasions, our proposed adjustments to the sample size calculations will be relevant.

Mesenchymal stem cell therapy for Crohn's perianal fistula-a real-world experience.

AIM: Remission rates of medically and surgically treated complex perianal fistulas in Crohn's disease are low. Recently, trials have demonstrated the potential for long-term remission with local injection of allogeneic adipose-derived mesenchymal stem cells (darvadstrocel). Our aim was to analyse outcomes from our real-world experience with this new treatment. METHODS: All patients with Crohn's disease suffering complex perianal fistulas who consecutively underwent administration of darvadstrocel at two centres were followed up and evaluated. Patients were assessed for clinical remission, response, failure, and any complications during follow-up. The results of all patients with a minimum of 3 months' follow-up are presented. RESULTS: Thirty-three patients with Crohn's disease and complex perianal fistulas were included. Of these, 20 (61%) experienced clinical remission that was maintained for a mean follow-up of 14 (3-32) months. A total of 24 of 33 (73%) experienced at least 3 months of clinical remission, with four later having recurrence (3-12 months). Among the remaining nine patients who did not experience clinical remission, two (6%) had partial remission (such as one of two fistulas closing), two (6%) showed signs of response but not remission, and five (15%) showed no signs of healing. The mean time to maintained clinical remission was 6 weeks (range 2 weeks to 6 months), and there were no severe adverse events. CONCLUSION: In this real-world experience, treatment of Crohn's disease complex perianal fistulas with darvadstrocel had a 61% success rate for maintained clinical remission.

When should factorial designs be used for late-phase randomised controlled trials?

BACKGROUND: A 2×2 factorial design evaluates two interventions (A versus control and B versus control) by randomising to control, A-only, B-only or both A and B together. Extended factorial designs are also possible (e.g. 3×3 or 2×2×2). Factorial designs often require fewer resources and participants than alternative randomised controlled trials, but they are not widely used. We identified several issues that investigators considering this design need to address, before they use it in a late-phase setting. METHODS: We surveyed journal articles published in 2000-2022 relating to designing factorial randomised controlled trials. We identified issues to consider based on these and our personal experiences. RESULTS: We identified clinical, practical, statistical and external issues that make factorial randomised controlled trials more desirable. Clinical issues are (1) interventions can be easily co-administered; (2) risk of safety issues from co-administration above individual risks of the separate interventions is low; (3) safety or efficacy data are wanted on the combination intervention; (4) potential for interaction (e.g. effect of A differing when B administered) is low; (5) it is important to compare interventions with other interventions balanced, rather than allowing randomised interventions to affect the choice of other interventions; (6) eligibility criteria for different interventions are similar. Practical issues are (7) recruitment is not harmed by testing many interventions; (8) each intervention and associated toxicities is unlikely to reduce either adherence to the other intervention or overall follow-up; (9) blinding is easy to implement or not required. Statistical issues are (10) a suitable scale of analysis can be identified; (11) adjustment for multiplicity is not required; (12) early stopping for efficacy or lack of benefit can be done effectively. External issues are (13) adequate funding is available and (14) the trial is not intended for licensing purposes. An overarching issue (15) is that factorial design should give a lower sample size requirement than alternative designs. Across designs with varying non-adherence, retention, intervention effects and interaction effects, 2×2 factorial designs require lower sample size than a three-arm alternative when one intervention effect is reduced by no more than 24%-48% in the presence of the other intervention compared with in the absence of the other intervention. CONCLUSIONS: Factorial designs are not widely used and should be considered more often using our issues to consider. Low potential for at most small to modest interaction is key, for example, where the interventions have different mechanisms of action or target different aspects of the disease being studied.

Increasing non-cosmetic exposure and sensitization to isothiazolinones require action for prevention: Review.

Frequent use of methylchloroisothiazolinone/methylisothiazolinone (MCI/MI) and MI in cosmetic products has been the main cause of widespread sensitization and allergic contact dermatitis to these preservatives (biocides). Their use in non-cosmetic products is also an important source of sensitization. Less is known about sensitization rates and use of benzisothiazolinone (BIT), octylisothiazolinone (OIT), and dichlorooctylisothiazolinone (DCOIT), which have never been permitted in cosmetic products in Europe. BIT and OIT have occasionally been routinely patch-tested. These preservatives are often used together in chemical products and articles. In this study, we review the occurrence of contact allergy to MI, BIT, OIT, and DCOIT over time, based on concomitant patch testing in large studies, and case reports. We review EU legislations, and we discuss the role of industry, regulators, and dermatology in prevention of sensitization and protection of health. The frequency of contact allergy to MI, BIT, and OIT has increased. The frequency of contact allergy to DCOIT is not known because it has seldom been patch-tested. Label information on isothiazolinones in chemical products and articles, irrespective of concentration, is required for assessment of relevance, information to patients, and avoidance of exposure and allergic contact dermatitis.

Severely compromised supply of patch test allergens in Europe hampers adequate diagnosis of occupational and non-occupational contact allergy. A European Society of Contact Dermatitis (ESCD), European Academy of Allergy and Clinical Immunology (EAACI), European Academy of Dermatology and Venereology (EADV) task forces 'Contact Dermatitis' and 'Occupational Skin Disease' position paper.

Patch testing is the only clinically applicable diagnostic method for Type IV allergy. The availability of Type IV patch test (PT) allergens in Europe, however, is currently scarce. This severely compromises adequate diagnostics of contact allergy, leading to serious consequences for the affected patients. Against this background, the European Society of Contact Dermatitis (ESCD) has created a task force (TF) (i) to explore the current availability of PT substances in different member states, (ii) to highlight some of the unique characteristics of Type IV vs. other allergens and (iii) to suggest ways forward to promote and ensure availability of high-quality patch testing substances for the diagnosis of Type IV allergies throughout Europe. The suggestions of the TF on how to improve the availability of PT allergens are supported by the ESCD, the European Academy of Allergy and Clinical Immunology, and the European Academy of Dermatology and Venereology and intend to provide potential means to resolve the present medical crisis.

Phases of methodological research in biostatistics-Building the evidence base for new methods.

Although new biostatistical methods are published at a very high rate, many of these developments are not trustworthy enough to be adopted by the scientific community. We propose a framework to think about how a piece of methodological work contributes to the evidence base for a method. Similar to the well-known phases of clinical research in drug development, we propose to define four phases of methodological research. These four phases cover (I) proposing a new methodological idea while providing, for example, logical reasoning or proofs, (II) providing empirical evidence, first in a narrow target setting, then (III) in an extended range of settings and for various outcomes, accompanied by appropriate application examples, and (IV) investigations that establish a method as sufficiently well-understood to know when it is preferred over others and when it is not; that is, its pitfalls. We suggest basic definitions of the four phases to provoke thought and discussion rather than devising an unambiguous classification of studies into phases. Too many methodological developments finish before phase III/IV, but we give two examples with references. Our concept rebalances the emphasis to studies in phases III and IV, that is, carefully planned method comparison studies and studies that explore the empirical properties of existing methods in a wider range of problems.

Comment on Oberman & Vink: Should we fix or simulate the complete data in simulation studies evaluating missing data methods?

For simulation studies that evaluate methods of handling missing data, we argue that generating partially observed data by fixing the complete data and repeatedly simulating the missingness indicators is a superficially attractive idea but only rarely appropriate to use.

A comparison of strategies for selecting auxiliary variables for multiple imputation.

Multiple imputation (MI) is a popular method for handling missing data. Auxiliary variables can be added to the imputation model(s) to improve MI estimates. However, the choice of which auxiliary variables to include is not always straightforward. Several data-driven auxiliary variable selection strategies have been proposed, but there has been limited evaluation of their performance. Using a simulation study we evaluated the performance of eight auxiliary variable selection strategies: (1, 2) two versions of selection based on correlations in the observed data; (3) selection using hypothesis tests of the "missing completely at random" assumption; (4) replacing auxiliary variables with their principal components; (5, 6) forward and forward stepwise selection; (7) forward selection based on the estimated fraction of missing information; and (8) selection via the least absolute shrinkage and selection operator (LASSO). A complete case analysis and an MI analysis using all auxiliary variables (the "full model") were included for comparison. We also applied all strategies to a motivating case study. The full model outperformed all auxiliary variable selection strategies in the simulation study, with the LASSO strategy the best performing auxiliary variable selection strategy overall. All MI analysis strategies that we were able to apply to the case study led to similar estimates, although computational time was substantially reduced when variable selection was employed. This study provides further support for adopting an inclusive auxiliary variable strategy where possible. Auxiliary variable selection using the LASSO may be a promising alternative when the full model fails or is too burdensome.

Which patients with metastatic hormone-sensitive prostate cancer benefit from docetaxel: a systematic review and meta-analysis of individual participant data from randomised trials.

BACKGROUND: Adding docetaxel to androgen deprivation therapy (ADT) improves survival in patients with metastatic, hormone-sensitive prostate cancer, but uncertainty remains about who benefits most. We therefore aimed to obtain up-to-date estimates of the overall effects of docetaxel and to assess whether these effects varied according to prespecified characteristics of the patients or their tumours. METHODS: The STOPCAP M1 collaboration conducted a systematic review and meta-analysis of individual participant data. We searched MEDLINE (from database inception to March 31, 2022), Embase (from database inception to March 31, 2022), the Cochrane Central Register of Controlled Trials (from database inception to March 31, 2022), proceedings of relevant conferences (from Jan 1, 1990, to Dec 31, 2022), and ClinicalTrials.gov (from database inception to March 28, 2023) to identify eligible randomised trials that assessed docetaxel plus ADT compared with ADT alone in patients with metastatic, hormone-sensitive prostate cancer. Detailed and updated individual participant data were requested directly from study investigators or through relevant repositories. The primary outcome was overall survival. Secondary outcomes were progression-free survival and failure-free survival. Overall pooled effects were estimated using an adjusted, intention-to-treat, two-stage, fixed-effect meta-analysis, with one-stage and random-effects sensitivity analyses. Missing covariate values were imputed. Differences in effect by participant characteristics were estimated using adjusted two-stage, fixed-effect meta-analysis of within-trial interactions on the basis of progression-free survival to maximise power. Identified effect modifiers were also assessed on the basis of overall survival. To explore multiple subgroup interactions and derive subgroup-specific absolute treatment effects we used one-stage flexible parametric modelling and regression standardisation. We assessed the risk of bias using the Cochrane Risk of Bias 2 tool. This study is registered with PROSPERO, CRD42019140591. FINDINGS: We obtained individual participant data from 2261 patients (98% of those randomised) from three eligible trials (GETUG-AFU15, CHAARTED, and STAMPEDE trials), with a median follow-up of 72 months (IQR 55-85). Individual participant data were not obtained from two additional small trials. Based on all included trials and patients, there were clear benefits of docetaxel on overall survival (hazard ratio [HR] 0·79, 95% CI 0·70 to 0·88; p<0·0001), progression-free survival (0·70, 0·63 to 0·77; p<0·0001), and failure-free survival (0·64, 0·58 to 0·71; p<0·0001), representing 5-year absolute improvements of around 9-11%. The overall risk of bias was assessed to be low, and there was no strong evidence of differences in effect between trials for all three main outcomes. The relative effect of docetaxel on progression-free survival appeared to be greater with increasing clinical T stage (pinteraction=0·0019), higher volume of metastases (pinteraction=0·020), and, to a lesser extent, synchronous diagnosis of metastatic disease (pinteraction=0·077). Taking into account the other interactions, the effect of docetaxel was independently modified by volume and clinical T stage, but not timing. There was no strong evidence that docetaxel improved absolute effects at 5 years for patients with low-volume, metachronous disease (-1%, 95% CI -15 to 12, for progression-free survival; 0%, -10 to 12, for overall survival). The largest absolute improvement at 5 years was observed for those with high-volume, clinical T stage 4 disease (27%, 95% CI 17 to 37, for progression-free survival; 35%, 24 to 47, for overall survival). INTERPRETATION: The addition of docetaxel to hormone therapy is best suited to patients with poorer prognosis for metastatic, hormone-sensitive prostate cancer based on a high volume of disease and potentially the bulkiness of the primary tumour. There is no evidence of meaningful benefit for patients with metachronous, low-volume disease who should therefore be managed differently. These results will better characterise patients most and, importantly, least likely to gain benefit from docetaxel, potentially changing international practice, guiding clinical decision making, better informing treatment policy, and improving patient outcomes. FUNDING: UK Medical Research Council and Prostate Cancer UK.

Fecal Calprotectin and Quality of Life Questionnaires Are Responsive to Change in Pouch Disease Activity After Antibiotic Therapy: Results From a Prospective Clinical Trial.

INTRODUCTION: Whether fecal calprotectin (FC) and quality of life (QoL) questionnaires reflect change in disease activity in patients with a J-pouch is unknown. METHODS: Patients with acute pouchitis were prospectively treated with a 2-week course of antibiotics. The full Pouchitis Disease Activity Index, FC, and QoL questionnaires were measured at baseline and after antibiotic therapy. RESULTS: Twenty patients were prospectively enrolled. After 2 weeks of antibiotic treatment, the Pouchitis Disease Activity Index decreased from a median of 9 to 5 ( P = 0.007). FC decreased from a median of 661 ug/g to 294 ug/g ( P = 0.02), and QoL questionnaires improved significantly. DISCUSSION: FC and QoL questionnaires reflect real-time changes in inflammatory pouch activity.

The Personalised Randomized Controlled Trial: Evaluation of a new trial design.

In some clinical scenarios, for example, severe sepsis caused by extensively drug resistant bacteria, there is uncertainty between many common treatments, but a conventional multiarm randomized trial is not possible because individual participants may not be eligible to receive certain treatments. The Personalised Randomized Controlled Trial design allows each participant to be randomized between a "personalised randomization list" of treatments that are suitable for them. The primary aim is to produce treatment rankings that can guide choice of treatment, rather than focusing on the estimates of relative treatment effects. Here we use simulation to assess several novel analysis approaches for this innovative trial design. One of the approaches is like a network meta-analysis, where participants with the same personalised randomization list are like a trial, and both direct and indirect evidence are used. We evaluate this proposed analysis and compare it with analyses making less use of indirect evidence. We also propose new performance measures including the expected improvement in outcome if the trial's rankings are used to inform future treatment rather than random choice. We conclude that analysis of a personalized randomized controlled trial can be performed by pooling data from different types of participants and is robust to moderate subgroup-by-intervention interactions based on the parameters of our simulation. The proposed approach performs well with respect to estimation bias and coverage. It provides an overall treatment ranking list with reasonable precision, and is likely to improve outcome on average if used to determine intervention policies and guide individual clinical decisions.

Measuring the performance of prediction models to personalize treatment choice.

When data are available from individual patients receiving either a treatment or a control intervention in a randomized trial, various statistical and machine learning methods can be used to develop models for predicting future outcomes under the two conditions, and thus to predict treatment effect at the patient level. These predictions can subsequently guide personalized treatment choices. Although several methods for validating prediction models are available, little attention has been given to measuring the performance of predictions of personalized treatment effect. In this article, we propose a range of measures that can be used to this end. We start by defining two dimensions of model accuracy for treatment effects, for a single outcome: discrimination for benefit and calibration for benefit. We then amalgamate these two dimensions into an additional concept, decision accuracy, which quantifies the model's ability to identify patients for whom the benefit from treatment exceeds a given threshold. Subsequently, we propose a series of performance measures related to these dimensions and discuss estimating procedures, focusing on randomized data. Our methods are applicable for continuous or binary outcomes, for any type of prediction model, as long as it uses baseline covariates to predict outcomes under treatment and control. We illustrate all methods using two simulated datasets and a real dataset from a trial in depression. We implement all methods in the R package predieval. Results suggest that the proposed measures can be useful in evaluating and comparing the performance of competing models in predicting individualized treatment effect.

Practical approaches to Bayesian sample size determination in non-inferiority trials with binary outcomes.

Bayesian analysis of a non-inferiority trial is advantageous in allowing direct probability statements to be made about the relative treatment difference rather than relying on an arbitrary and often poorly justified non-inferiority margin. When the primary analysis will be Bayesian, a Bayesian approach to sample size determination will often be appropriate for consistency with the analysis. We demonstrate three Bayesian approaches to choosing sample size for non-inferiority trials with binary outcomes and review their advantages and disadvantages. First, we present a predictive power approach for determining sample size using the probability that the trial will produce a convincing result in the final analysis. Next, we determine sample size by considering the expected posterior probability of non-inferiority in the trial. Finally, we demonstrate a precision-based approach. We apply these methods to a non-inferiority trial in antiretroviral therapy for treatment of HIV-infected children. A predictive power approach would be most accessible in practical settings, because it is analogous to the standard frequentist approach. Sample sizes are larger than with frequentist calculations unless an informative analysis prior is specified, because appropriate allowance is made for uncertainty in the assumed design parameters, ignored in frequentist calculations. An expected posterior probability approach will lead to a smaller sample size and is appropriate when the focus is on estimating posterior probability rather than on testing. A precision-based approach would be useful when sample size is restricted by limits on recruitment or costs, but it would be difficult to decide on sample size using this approach alone.

A new approach to evaluating loop inconsistency in network meta-analysis.

In network meta-analysis, studies evaluating multiple treatment comparisons are modeled simultaneously, and estimation is informed by a combination of direct and indirect evidence. Network meta-analysis relies on an assumption of consistency, meaning that direct and indirect evidence should agree for each treatment comparison. Here we propose new local and global tests for inconsistency and demonstrate their application to three example networks. Because inconsistency is a property of a loop of treatments in the network meta-analysis, we locate the local test in a loop. We define a model with one inconsistency parameter that can be interpreted as loop inconsistency. The model builds on the existing ideas of node-splitting and side-splitting in network meta-analysis. To provide a global test for inconsistency, we extend the model across multiple independent loops with one degree of freedom per loop. We develop a new algorithm for identifying independent loops within a network meta-analysis. Our proposed models handle treatments symmetrically, locate inconsistency in loops rather than in nodes or treatment comparisons, and are invariant to choice of reference treatment, making the results less dependent on model parameterization. For testing global inconsistency in network meta-analysis, our global model uses fewer degrees of freedom than the existing design-by-treatment interaction approach and has the potential to increase power. To illustrate our methods, we fit the models to three network meta-analyses varying in size and complexity. Local and global tests for inconsistency are performed and we demonstrate that the global model is invariant to choice of independent loops.

How important is the linearity assumption in a sample size calculation for a randomised controlled trial where treatment is anticipated to affect a rate of change?

BACKGROUND: For certain conditions, treatments aim to lessen deterioration over time. A trial outcome could be change in a continuous measure, analysed using a random slopes model with a different slope in each treatment group. A sample size for a trial with a particular schedule of visits (e.g. annually for three years) can be obtained using a two-stage process. First, relevant (co-) variances are estimated from a pre-existing dataset e.g. an observational study conducted in a similar setting. Second, standard formulae are used to calculate sample size. However, the random slopes model assumes linear trajectories with any difference in group means increasing proportionally to follow-up time. The impact of these assumptions failing is unclear. METHODS: We used simulation to assess the impact of a non-linear trajectory and/or non-proportional treatment effect on the proposed trial's power. We used four trajectories, both linear and non-linear, and simulated observational studies to calculate sample sizes. Trials of this size were then simulated, with treatment effects proportional or non-proportional to time. RESULTS: For a proportional treatment effect and a trial visit schedule matching the observational study, powers are close to nominal even for non-linear trajectories. However, if the schedule does not match the observational study, powers can be above or below nominal levels, with the extent of this depending on parameters such as the residual error variance. For a non-proportional treatment effect, using a random slopes model can lead to powers far from nominal levels. CONCLUSIONS: If trajectories are suspected to be non-linear, observational data used to inform power calculations should have the same visit schedule as the proposed trial where possible. Additionally, if the treatment effect is expected to be non-proportional, the random slopes model should not be used. A model allowing trajectories to vary freely over time could be used instead, either as a second line analysis method (bearing in mind that power will be lost) or when powering the trial.

Using modified intention-to-treat as a principal stratum estimator for failure to initiate treatment.

BACKGROUND: A common intercurrent event affecting many trials is when some participants do not begin their assigned treatment. For example, in a double-blind drug trial, some participants may not receive any dose of study medication. Many trials use a 'modified intention-to-treat' approach, whereby participants who do not initiate treatment are excluded from the analysis. However, it is not clear (a) the estimand being targeted by such an approach and (b) the assumptions necessary for such an approach to be unbiased. METHODS: Using potential outcome notation, we demonstrate that a modified intention-to-treat analysis which excludes participants who do not begin treatment is estimating a principal stratum estimand (i.e. the treatment effect in the subpopulation of participants who would begin treatment, regardless of which arm they were assigned to). The modified intention-to-treat estimator is unbiased for the principal stratum estimand under the assumption that the intercurrent event is not affected by the assigned treatment arm, that is, participants who initiate treatment in one arm would also do so in the other arm (i.e. if someone began the intervention, they would also have begun the control, and vice versa). RESULTS: We identify two key criteria in determining whether the modified intention-to-treat estimator is likely to be unbiased: first, we must be able to measure the participants in each treatment arm who experience the intercurrent event, and second, the assumption that treatment allocation will not affect whether the participant begins treatment must be reasonable. Most double-blind trials will satisfy these criteria, as the decision to start treatment cannot be influenced by the allocation, and we provide an example of an open-label trial where these criteria are likely to be satisfied as well, implying that a modified intention-to-treat analysis which excludes participants who do not begin treatment is an unbiased estimator for the principal stratum effect in these settings. We also give two examples where these criteria will not be satisfied (one comparing an active intervention vs usual care, where we cannot identify which usual care participants would have initiated the active intervention, and another comparing two active interventions in an unblinded manner, where knowledge of the assigned treatment arm may affect the participant's choice to begin or not), implying that a modified intention-to-treat estimator will be biased in these settings. CONCLUSION: A modified intention-to-treat analysis which excludes participants who do not begin treatment can be an unbiased estimator for the principal stratum estimand. Our framework can help identify when the assumptions for unbiasedness are likely to hold, and thus whether modified intention-to-treat is appropriate or not.