Advancing randomized controlled trial methodologies: The place of innovative trial design in eating disorders research.

Randomized controlled trials can be used to generate evidence on the efficacy and safety of new treatments in eating disorders research. Many of the trials previously conducted in this area have been deemed to be of low quality, in part due to a number of practical constraints. This article provides an overview of established and more innovative clinical trial designs, accompanied by pertinent examples, to highlight how design choices can enhance flexibility and improve efficiency of both resource allocation and participant involvement. Trial designs include individually randomized, cluster randomized, and designs with randomizations at multiple time points and/or addressing several research questions (master protocol studies). Design features include the use of adaptations and considerations for pragmatic or registry-based trials. The appropriate choice of trial design, together with rigorous trial conduct, reporting and analysis, can establish high-quality evidence to advance knowledge in the field. It is anticipated that this article will provide a broad and contemporary introduction to trial designs and will help researchers make informed trial design choices for improved testing of new interventions in eating disorders. PUBLIC SIGNIFICANCE: There is a paucity of high quality randomized controlled trials that have been conducted in eating disorders, highlighting the need to identify where efficiency gains in trial design may be possible to advance the eating disorder research field. We provide an overview of some key trial designs and features which may offer solutions to practical constraints and increase trial efficiency.

The staircase cluster randomised trial design: A pragmatic alternative to the stepped wedge.

This article introduces the 'staircase' design, derived from the zigzag pattern of steps along the diagonal of a stepped wedge design schematic where clusters switch from control to intervention conditions. Unlike a complete stepped wedge design where all participating clusters must collect and provide data for the entire trial duration, clusters in a staircase design are only required to be involved and collect data for a limited number of pre- and post-switch periods. This could alleviate some of the burden on participating clusters, encouraging involvement in the trial and reducing the likelihood of attrition. Staircase designs are already being implemented, although in the absence of a dedicated methodology, approaches to sample size and power calculations have been inconsistent. We provide expressions for the variance of the treatment effect estimator when a linear mixed model for an outcome is assumed for the analysis of staircase designs in order to enable appropriate sample size and power calculations. These include explicit variance expressions for basic staircase designs with one pre- and one post-switch measurement period. We show how the variance of the treatment effect estimator is related to key design parameters and demonstrate power calculations for examples based on a real trial.

The impact of iterative removal of low-information cluster-period cells from a stepped wedge design.

BACKGROUND: Standard stepped wedge trials, where clusters switch from the control to the intervention condition in a staggered manner, can be costly and burdensome. Recent work has shown that the amount of information contributed by each cluster in each period differs, with some cluster-periods contributing a relatively small amount of information. We investigate the patterns of the information content of cluster-period cells upon iterative removal of low-information cells, assuming a model for continuous outcomes with constant cluster-period size, categorical time period effects, and exchangeable and discrete-time decay intracluster correlation structures. METHODS: We sequentially remove pairs of "centrosymmetric" cluster-period cells from an initially complete stepped wedge design which contribute the least amount of information to the estimation of the treatment effect. At each iteration, we update the information content of the remaining cells, determine the pair of cells with the lowest information content, and repeat this process until the treatment effect cannot be estimated. RESULTS: We demonstrate that as more cells are removed, more information is concentrated in the cells near the time of the treatment switch, and in "hot-spots" in the corners of the design. For the exchangeable correlation structure, removing the cells from these hot-spots leads to a marked reduction in study precision and power, however the impact of this is lessened for the discrete-time decay structure. CONCLUSIONS: Removing cluster-period cells distant from the time of the treatment switch may not lead to large reductions in precision or power, implying that certain incomplete designs may be almost as powerful as complete designs.

Mental health and wellbeing of health and aged care workers in Australia, May 2021 - June 2022: a longitudinal cohort study.

OBJECTIVES: To assess the mental health and wellbeing of health and aged care workers in Australia during the second and third years of the coronavirus disease 2019 (COVID-19) pandemic, overall and by occupation group. DESIGN, SETTING, PARTICIPANTS: Longitudinal cohort study of health and aged care workers (ambulance, hospitals, primary care, residential aged care) in Victoria: May-July 2021 (survey 1), October-December 2021 (survey 2), and May-June 2022 (survey 3). MAIN OUTCOME MEASURES: Proportions of respondents (adjusted for age, gender, socio-economic status) reporting moderate to severe symptoms of depression (Patient Health Questionnaire-9, PHQ-9), anxiety (Generalized Anxiety Disorder scale, GAD-7), or post-traumatic stress (Impact of Event Scale-6, IES-6), burnout (abbreviated Maslach Burnout Inventory, aMBI), or high optimism (10-point visual analogue scale); mean scores (adjusted for age, gender, socio-economic status) for wellbeing (Personal Wellbeing Index-Adult, PWI-A) and resilience (Connor Davidson Resilience Scale 2, CD-RISC-2). RESULTS: A total of 1667 people responded to at least one survey (survey 1, 989; survey 2, 1153; survey 3, 993; response rate, 3.3%). Overall, 1211 survey responses were from women (72.6%); most respondents were hospital workers (1289, 77.3%) or ambulance staff (315, 18.9%). The adjusted proportions of respondents who reported moderate to severe symptoms of depression (survey 1, 16.4%; survey 2, 22.6%; survey 3, 19.2%), anxiety (survey 1, 8.8%; survey 2, 16.0%; survey 3, 11.0%), or post-traumatic stress (survey 1, 14.6%; survey 2, 35.1%; survey 3, 14.9%) were each largest for survey 2. The adjusted proportions of participants who reported moderate to severe symptoms of burnout were higher in surveys 2 and 3 than in survey 1, and the proportions who reported high optimism were smaller in surveys 2 and 3 than in survey 1. Adjusted mean scores for wellbeing and resilience were similar at surveys 2 and 3 and lower than at survey 1. The magnitude but not the patterns of change differed by occupation group. CONCLUSION: Burnout was more frequently reported and mean wellbeing and resilience scores were lower in mid-2022 than in mid-2021 for Victorian health and aged care workers who participated in our study. Evidence-based mental health and wellbeing programs for workers in health care organisations are needed. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry: ACTRN12621000533897 (observational study; retrospective).

Evaluating the performance of Bayesian and restricted maximum likelihood estimation for stepped wedge cluster randomized trials with a small number of clusters.

BACKGROUND: Stepped wedge trials are an appealing and potentially powerful cluster randomized trial design. However, they are frequently implemented with a small number of clusters. Standard analysis methods for these trials such as a linear mixed model with estimation via maximum likelihood or restricted maximum likelihood (REML) rely on asymptotic properties and have been shown to yield inflated type I error when applied to studies with a small number of clusters. Small-sample methods such as the Kenward-Roger approximation in combination with REML can potentially improve estimation of the fixed effects such as the treatment effect. A Bayesian approach may also be promising for such multilevel models but has not yet seen much application in cluster randomized trials. METHODS: We conducted a simulation study comparing the performance of REML with and without a Kenward-Roger approximation to a Bayesian approach using weakly informative prior distributions on the intracluster correlation parameters. We considered a continuous outcome and a range of stepped wedge trial configurations with between 4 and 40 clusters. To assess method performance we calculated bias and mean squared error for the treatment effect and correlation parameters and the coverage of 95% confidence/credible intervals and relative percent error in model-based standard error for the treatment effect. RESULTS: Both REML with a Kenward-Roger standard error and degrees of freedom correction and the Bayesian method performed similarly well for the estimation of the treatment effect, while intracluster correlation parameter estimates obtained via the Bayesian method were less variable than REML estimates with different relative levels of bias. CONCLUSIONS: The use of REML with a Kenward-Roger approximation may be sufficient for the analysis of stepped wedge cluster randomized trials with a small number of clusters. However, a Bayesian approach with weakly informative prior distributions on the intracluster correlation parameters offers a viable alternative, particularly when there is interest in the probability-based inferences permitted within this paradigm.

How many times should a cluster randomized crossover trial cross over?

Trial planning requires making efficient yet practical design choices. In a cluster randomized crossover trial, clusters of subjects cross back and forth between implementing the control and intervention conditions over the course of the trial, with each crossover marking the start of a new period. If it is possible to set up such a trial with more crossovers, a pertinent question is whether there are efficiency gains from clusters crossing over more frequently, and if these gains are substantial enough to justify the added complexity and cost of implementing more crossovers. We seek to determine the optimal number of crossovers for a fixed trial duration, and then identify other highly efficient designs by allowing the total number of clusters to vary and imposing thresholds on maximum cost and minimum statistical power. Our results pertain to trials with continuous recruitment and a continuous primary outcome, with the treatment effect estimated using a linear mixed model. To account for the similarity between subjects' outcomes within a cluster, we assume a correlation structure in which the correlation decays gradually in a continuous manner as the time between subjects' measurements increases. The optimal design is characterized by crossovers between the control and intervention conditions with each successive subject. However, this design is neither practical nor cost-efficient to implement, nor is it necessary: the gains in efficiency increase sharply in moving from a two-period to a four-period trial design, but approach an asymptote for the scenarios considered as the number of crossovers continues to increase.

Accounting for a decaying correlation structure in cluster randomized trials with continuous recruitment.

A requirement for calculating sample sizes for cluster randomized trials (CRTs) conducted over multiple periods of time is the specification of a form for the correlation between outcomes of subjects within the same cluster, encoded via the within-cluster correlation structure. Previously proposed within-cluster correlation structures have made strong assumptions; for example, the usual assumption is that correlations between the outcomes of all pairs of subjects are identical ("uniform correlation"). More recently, structures that allow for a decay in correlation between pairs of outcomes measured in different periods have been suggested. However, these structures are overly simple in settings with continuous recruitment and measurement. We propose a more realistic "continuous-time correlation decay" structure whereby correlations between subjects' outcomes decay as the time between these subjects' measurement times increases. We investigate the use of this structure on trial planning in the context of a primary care diabetes trial, where there is evidence of decaying correlation between pairs of patients' outcomes over time. In particular, for a range of different trial designs, we derive the variance of the treatment effect estimator under continuous-time correlation decay and compare this to the variance obtained under uniform correlation. For stepped wedge and cluster randomized crossover designs, incorrectly assuming uniform correlation will underestimate the required sample size under most trial configurations likely to occur in practice. Planning of CRTs requires consideration of the most appropriate within-cluster correlation structure to obtain a suitable sample size.

Correction to: Optima nutrition: an allocative efficiency tool to reduce childhood stunting by better targeting of nutrition-related interventions.

It has been highlighted that the original manuscript [1] contains a typesetting error in the name of Meera Shekar. This had been incorrectly captured as Meera Shekhar in the original article which has since been updated.

How should HIV resources be allocated? Lessons learnt from applying Optima HIV in 23 countries.

INTRODUCTION: With limited funds available, meeting global health targets requires countries to both mobilize and prioritize their health spending. Within this context, countries have recognized the importance of allocating funds for HIV as efficiently as possible to maximize impact. Over the past six years, the governments of 23 countries in Africa, Asia, Eastern Europe and Latin America have used the Optima HIV tool to estimate the optimal allocation of HIV resources. METHODS: Each study commenced with a request by the national government for technical assistance in conducting an HIV allocative efficiency study using Optima HIV. Each study team validated the required data, calibrated the Optima HIV epidemic model to produce HIV epidemic projections, agreed on cost functions for interventions, and used the model to calculate the optimal allocation of available funds to best address national strategic plan targets. From a review and analysis of these 23 country studies, we extract common themes around the optimal allocation of HIV funding in different epidemiological contexts. RESULTS AND DISCUSSION: The optimal distribution of HIV resources depends on the amount of funding available and the characteristics of each country's epidemic, response and targets. Universally, the modelling results indicated that scaling up treatment coverage is an efficient use of resources. There is scope for efficiency gains by targeting the HIV response towards the populations and geographical regions where HIV incidence is highest. Across a range of countries, the model results indicate that a more efficient allocation of HIV resources could reduce cumulative new HIV infections by an average of 18% over the years to 2020 and 25% over the years to 2030, along with an approximately 25% reduction in deaths for both timelines. However, in most countries this would still not be sufficient to meet the targets of the national strategic plan, with modelling results indicating that budget increases of up to 185% would be required. CONCLUSIONS: Greater epidemiological impact would be possible through better targeting of existing resources, but additional resources would still be required to meet targets. Allocative efficiency models have proven valuable in improving the HIV planning and budgeting process.

The global Optima HIV allocative efficiency model: targeting resources in efforts to end AIDS.

BACKGROUND: To move towards ending AIDS by 2030, HIV resources should be allocated cost-effectively. We used the Optima HIV model to estimate how global HIV resources could be retargeted for greatest epidemiological effect and how many additional new infections could be averted by 2030. METHODS: We collated standard data used in country modelling exercises (including demographic, epidemiological, behavioural, programmatic, and expenditure data) from Jan 1, 2000, to Dec 31, 2015 for 44 countries, capturing 80% of people living with HIV worldwide. These data were used to parameterise separate subnational and national models within the Optima HIV framework. To estimate optimal resource allocation at subnational, national, regional, and global levels, we used an adaptive stochastic descent optimisation algorithm in combination with the epidemic models and cost functions for each programme in each country. Optimal allocation analyses were done with international HIV funds remaining the same to each country and by redistributing these funds between countries. FINDINGS: Without additional funding, if countries were to optimally allocate their HIV resources from 2016 to 2030, we estimate that an additional 7·4 million (uncertainty range 3·9 million-14·0 million) new infections could be averted, representing a 26% (uncertainty range 13-50%) incidence reduction. Redistribution of international funds between countries could avert a further 1·9 million infections, which represents a 33% (uncertainty range 20-58%) incidence reduction overall. To reduce HIV incidence by 90% relative to 2010, we estimate that more than a three-fold increase of current annual funds will be necessary until 2030. The most common priorities for optimal resource reallocation are to scale up treatment and prevention programmes targeting key populations at greatest risk in each setting. Prioritisation of other HIV programmes depends on the epidemiology and cost-effectiveness of service delivery in each setting as well as resource availability. INTERPRETATION: Further reductions in global HIV incidence are possible through improved targeting of international and national HIV resources. FUNDING: World Bank and Australian NHMRC.

Optima Nutrition: an allocative efficiency tool to reduce childhood stunting by better targeting of nutrition-related interventions.

BACKGROUND: Child stunting due to chronic malnutrition is a major problem in low- and middle-income countries due, in part, to inadequate nutrition-related practices and insufficient access to services. Limited budgets for nutritional interventions mean that available resources must be targeted in the most cost-effective manner to have the greatest impact. Quantitative tools can help guide budget allocation decisions. METHODS: The Optima approach is an established framework to conduct resource allocation optimization analyses. We applied this approach to develop a new tool, 'Optima Nutrition', for conducting allocative efficiency analyses that address childhood stunting. At the core of the Optima approach is an epidemiological model for assessing the burden of disease; we use an adapted version of the Lives Saved Tool (LiST). Six nutritional interventions have been included in the first release of the tool: antenatal micronutrient supplementation, balanced energy-protein supplementation, exclusive breastfeeding promotion, promotion of improved infant and young child feeding (IYCF) practices, public provision of complementary foods, and vitamin A supplementation. To demonstrate the use of this tool, we applied it to evaluate the optimal allocation of resources in 7 districts in Bangladesh, using both publicly available data (such as through DHS) and data from a complementary costing study. RESULTS: Optima Nutrition can be used to estimate how to target resources to improve nutrition outcomes. Specifically, for the Bangladesh example, despite only limited nutrition-related funding available (an estimated $0.75 per person in need per year), even without any extra resources, better targeting of investments in nutrition programming could increase the cumulative number of children living without stunting by 1.3 million (an extra 5%) by 2030 compared to the current resource allocation. To minimize stunting, priority interventions should include promotion of improved IYCF practices as well as vitamin A supplementation. Once these programs are adequately funded, the public provision of complementary foods should be funded as the next priority. Programmatic efforts should give greatest emphasis to the regions of Dhaka and Chittagong, which have the greatest number of stunted children. CONCLUSIONS: A resource optimization tool can provide important guidance for targeting nutrition investments to achieve greater impact.