Undertaking Studies Within A Trial to evaluate recruitment and retention strategies for randomised controlled trials: lessons learnt from the PROMETHEUS research programme.

Background: Randomised controlled trials ('trials') are susceptible to poor participant recruitment and retention. Studies Within A Trial are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted. Objectives: PROMoting THE Use of Studies Within A Trial aimed to facilitate at least 25 Studies Within A Trial evaluating recruitment or retention strategies. We share our experience of delivering the PROMoting THE Use of Studies Within A Trial programme, and the lessons learnt for undertaking randomised Studies Within A Trial. Design: A network of 10 Clinical Trials Units and 1 primary care research centre committed to conducting randomised controlled Studies Within A Trial of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the Study Within A Trial Repository, and existing prioritisation exercises, which were reviewed by patient and public members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMoting THE Use of Studies Within A Trial team to undertake Studies Within A Trial. We also tested the feasibility of undertaking co-ordinated Studies Within A Trial, across multiple host trials simultaneously. Setting: Clinical trials unit-based trials recruiting or following up participants in any setting in the United Kingdom were eligible. Participants: Clinical trials unit-based teams undertaking trials in any clinical context in the United Kingdom. Interventions: Funding of up to £5000 and support from the PROMoting THE Use of Studies Within A Trial team to design, implement and report Studies Within A Trial. Main outcome measures: Number of host trials funded. Results: Forty-two Studies Within A Trial were funded (31 host trials), across 12 Clinical Trials Units. The mean cost of a Study Within A Trial was £3535. Twelve Studies Within A Trial tested the same strategy across multiple host trials using a co-ordinated Study Within A Trial design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMoting THE Use of Studies Within A Trial will add 18% more Studies Within A Trial to the Cochrane systematic review of recruitment strategies, and 79% more Studies Within A Trial to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or e-mail before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning Studies Within A Trial, including involving patient and public involvement partners; prioritising and selecting strategies to evaluate and elements to consider when designing a Study Within A Trial; obtaining governance approvals; implementing Studies Within A Trial, including individual and co-ordinated Studies Within A Trials; and reporting Study Within A Trials. Limitations: The COVID-19 pandemic negatively impacted five Studies Within A Trial, being either delayed (n = 2) or prematurely terminated (n = 3). Conclusions: PROMoting THE Use of Studies Within A Trial significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented Studies Within A Trial. Future work: Future research should identify and target gaps in the evidence base, including widening Study Within A Trial uptake, undertaking more complex Studies Within A Trial and translating Study Within A Trial evidence into practice. Study registration: All Studies Within A Trial in the PROMoting THE Use of Studies Within A Trial programme had to be registered with the Northern Ireland Network for Trials Methodology Research Study Within A Trial Repository. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/55/80) and is published in full in Health Technology Assessment; Vol. 28, No. 2. See the NIHR Funding and Awards website for further award information.

A Study Within A Trial is a research study nested inside a larger 'host trial', promoting the use of Studies Within A Trial aimed to do Study Within A Trial routine practice in clinical trial units by funding and supporting at least 25 Studies Within A Trial. The best way to test health and social care treatments is to do a randomised controlled trial ('trial'), where some patients get the treatment being tested and some do not. The results of different groups are compared to see if the treatment improves care. Recruiting patients and keeping them involved in trials is often very difficult. Research teams often do not know how best to recruit and keep patients engaged as the methods have not been tested to see if they work. The best way to test these methods is by doing a Study Within A Trial. We test a programme of Studies Within A Trial for recruiting and keeping patients engaged in trials. Trial teams were able to apply for funding of up to £5000 and receive support from Promoting the use of Study Within A Trial team to do Studies Within A Trial. We used our experience of doing Studies Within A Trial to outline lessons learnt for doing Studies Within A Trial. We funded 42 Studies Within A Trial and gave teams necessary advice to do them. We significantly increased the knowledge for both recruitment and retention strategies, and found 'pre-notifying' before sending questionnaires, sending pens and personalised text messages were all effective for increasing responses by participants. We tested Studies Within A Trial across several different trials at the same time to find out more quickly whether their methods worked. We highlight key lessons learnt to guide others doing Studies Within A Trial, including involving patient partners; picking the right strategy to test; getting ethical approvals; how to do and report Studies Within A Trial. Promoting the use of studies within a trial was successful and supported more Studies Within A Trial than planned. We hope our experience will support those doing Studies Within A Trial in the future.

Protocol Development for a Qualitative Methodological Study Within a Trial (Qual-SWAT): The KARMA-Dep-2 Trial.

Background: Despite methodological improvements in clinical trial design and conduct more generally, methodological limitations persist in trials concerning mental health care. A qualitative Study Within A Trial (Qual-SWAT), embedded in the KARMA-Dep-2 host trial, will be undertaken to explore and gain an understanding of two methodological questions in randomised trials specific to mental health care: (1) what are the key barriers and enablers of participation in randomised trials in mental health; and (2) how can randomised trials become part of routine mental health care. These issues will be examined from patient-participant and clinician- / researcher-participant perspectives, in alignment with PRioRiTy research themes. Methods: A descriptive qualitative study design will be used. Data will be collected via one-to-one semi-structured interviews, conducted via Microsoft Teams. The interview data will be analysed using Braun and Clarke's Thematic Analysis approach. One-to-one interviews will be conducted with three participant groups ( N = 30): 1) host trial patient-participants ( n = 10); 2) potentially eligible host trial patient-participants who refused enrolment in the host trial ( n = 10); and 3) clinician- / researcher-participants who are associated with work on the host trial ( n = 10). Ethics and dissemination: Ethical approval has been granted by St. Patrick's Mental Health Services Research Ethics Committee, Ireland (Ref: Protocol 09/20). When the study is completed, a report will be prepared and submitted to the Health Research Board (HRB). Findings will be shared with the host trial team and study participants, and submitted for publication. Host trial registration: ClinicalTrials.gov ( NCT04939649); EudraCT ( 2019-003109-92). Official title: Ketamine as an Adjunctive Therapy for Major Depression - A Randomised Controlled Trial: [KARMA-Dep (2)].

Monitoring metrics over time: Why clinical trialists need to systematically collect site performance metrics.

Background: Over the last decade, there has been an increasing interest in risk-based monitoring (RBM) in clinical trials, resulting in a number of guidelines from regulators and its inclusion in ICH GCP. However, there is a lack of detail on how to approach RBM from a practical perspective, and insufficient understanding of best practice. Purpose: We present a method for clinical trials units to track their metrics within clinical trials using descriptive statistics and visualisations. Research Design: We suggest descriptive statistics and visualisations within a SWAT methodology. Study Sample: We illustrate this method using the metrics from TEMPER, a monitoring study carried out in three trials at the MRC Clinical Trials Unit at UCL. Data Collection: The data collection for TEMPER is described in DOI: 10.1177/1740774518793379. Results: We show the results and discuss a protocol for a Study-Within-A-Trial (SWAT 167) for those wishing to use the method. Conclusions: The potential benefits metric tracking brings to clinical trials include enhanced assessment of sites for potential corrective action, improved evaluation and contextualisation of the influence of metrics and their thresholds, and the establishment of best practice in RBM. The standardisation of the collection of such monitoring data would benefit both individual trials and the clinical trials community.

A multicentre randomised controlled trial of a guided self-help cognitive behavioural therapy to MANage the impact of hot flushes and night sweats in patients with prostate CANcer undergoing androgen deprivation therapy (MANCAN2).

BACKGROUND: Androgen deprivation therapy (ADT) is prescribed to almost half of all men diagnosed with prostate cancer. Although ADT is effective treatment, with virtually all men with advanced disease showing initial clinical response, it is associated with troublesome side effects including hot flushes and night sweats (HFNS). HFNS can be both frequent and severe and can have a significant impact on quality of life (QoL). They can occasionally be so debilitating that patients stop ADT altogether, despite the increased risk of disease relapse or death. Previous research has found that guided self-help cognitive behavioural therapy (CBT) can be effective in reducing HFNS due to ADT when delivered by a clinical psychologist. MANCAN2 aims test whether we can train the existing NHS Prostate Cancer Nurse Specialist (CNS) team to deliver guided self-help CBT and whether it is effective in reducing the impact of HFNS in men undergoing ADT. METHODS: MANCAN2 is a phase III multicentre randomised controlled trial and process evaluation. Between 144 and 196 men with prostate cancer who are currently receiving ADT and are experiencing problematic HFNS will be individually randomised in a 1:1 ratio in groups of 6-8 participants to either treatment as usual (TAU) or participation in the guided self-help CBT intervention plus TAU. A process evaluation using the normalisation process theory (NPT) framework will be conducted, to understand the CNS team's experiences of delivering the intervention and to establish the key influencers to its implementation as a routine practice service. Fidelity of implementation of the intervention will be conducted by expert assessment. The cost-effectiveness of the intervention and participant adherence to the trial intervention will also be assessed. DISCUSSION: MANCAN2 will advance the program of work already conducted in development of management strategies for HFNS. This research will determine whether the severity of ADT-induced HFNS in men with prostate cancer can be reduced by a guided self-help CBT intervention, delivered by the existing NHS prostate cancer CNS team, within a multicentre study. The emphasis on this existing team, if successful, should facilitate translation through to implementation in routine practice. TRIAL REGISTRATION: ISRCTN reference 58720120 . Registered 13 December 2022.

Feasibility, effectiveness and costs of a decision support intervention for consultees and legal representatives of adults lacking capacity to consent (CONSULT): protocol for a randomised Study Within a Trial.

BACKGROUND: Randomised trials play a vital role in underpinning evidence-based care. However, trials involving adults with impaired capacity to consent raise a number of ethical and methodological challenges, leading to the frequent exclusion of this group from trials. This includes challenges around involving family members as alternative 'proxy' decision-makers. Family members are often given little information about their role as a consultee or legal representative. Some family members find making a decision about trial participation difficult and may experience an emotional and decisional burden as a result. Families have reported a need for greater support and guidance when making such decisions, leading to the development of a decision aid ('Making decisions about research for others') for family members acting as consultee/legal representative. The decision aid now requires evaluation to determine its effectiveness in supporting families to make more informed decisions. METHODS: This protocol describes a prospective, multi-centre, randomised-controlled Study Within a Trial (SWAT) to evaluate the effectiveness of the decision aid. The SWAT will initially be embedded in approximately five host trials. SWAT participants will be randomised in a 1:1 ratio to either the intervention (decision aid alongside standard information about the host trial provided to consultees/legal representatives) or control (standard information alone). The primary outcome is the quality of proxy consent decision, assessed by the Combined Scale for Proxy Informed Consent Decisions (CONCORD). The SWAT design is informed by previous qualitative research. Initial feasibility will be explored in one host trial, followed by the main SWAT. An embedded process evaluation and economic evaluation will enable the SWAT findings to be contextualised and identify factors likely to affect implementation. DISCUSSION: This SWAT will generate the first evidence for recruitment interventions for trials involving adults lacking capacity to consent and add to knowledge about the use of decision support interventions in trial participation decisions. The SWAT will be embedded in a range of trials, and the heterogenous nature of the host trials, settings and populations involved will enable the intervention to be evaluated in a wide range of contexts. However, a pragmatic and flexible approach to conducting the SWAT is needed. TRIAL REGISTRATION: The SWAT is registered as SWAT #159 with the Northern Ireland Hub for Trials Methodology Research SWAT repository (registered 09.08.2020). Each host trial will be registered on a clinical trials registry.

An enhanced participant information leaflet and multimedia intervention to improve the quality of informed consent to a randomised clinical trial enrolling people living with HIV and obesity: a protocol for a Study Within A Trial (SWAT).

BACKGROUND: It is the investigator's responsibility to communicate the relevant information about a clinical trial to participants before they provide informed consent to take part. Systematic reviews indicate that participants often have a poor understanding of the concepts which are key to ensuring valid informed consent, such as randomisation and risks/discomforts. Paper-based participant information leaflets and informed consent forms (PIL/ICFs) are becoming longer and are often too complex for many participants. Multimedia interventions and enhanced PIL/ICFs have been trialled in an attempt to improve participants' understanding of various aspects of research studies. However, there is insufficient empirical evidence to determine how effective such interventions are. This protocol describes a study to evaluate whether an enhanced PIL/ICF and website help research participants to understand important information about a human immunodeficiency virus (HIV) randomised clinical trial. METHODS: This Study Within A Trial (SWAT) is a prospective, multi-centre, randomised, controlled, parallel-group study embedded in a host clinical trial. The host trial (the SWIFT trial; EudraCT: 2019-002314-39) is a prospective, multi-centre, randomised, open-label, controlled trial investigating if semaglutide along with dietary advice assists individuals with HIV and obesity to lose weight, compared to dietary advice alone. For the SWAT, participants will be randomised in a 1:1 ratio to either the control (standard PIL/ICF) or the intervention (an enhanced PIL/ICF and a website which includes animations). The enhanced PIL/ICF and website were developed in line with the guidance from organisations which promote plain English and accessible public-facing materials in conjunction with HIV Ireland, a HIV advocacy organisation, and our previous work on consent documents. The primary outcome of the SWAT is the quality of informed consent, assessed by a validated comprehension test-the modified Deaconess Informed Consent Comprehension Test (DICCT). The DICCT will be administered within 48 h of consent to the host trial. The secondary is recall, measured by the modified DICCT questionnaire scores 2 weeks post-consent to the host trial. DISCUSSION: The results of this SWAT will add to the methodological evidence base on the use of multimedia to improve the quality of informed consent to randomised clinical trials. TRIAL REGISTRATION: ClinicalTrials.gov NCT04174755 . EudraCT 2019-002314-39. SWAT 160, Northern Ireland Hub for Trials Methodology Research SWAT repository (Clarke M, et al., Trials. 16:P209, 2015).

A telephone reminder to enhance adherence to interventions in cardiovascular randomized trials: A protocol for a study within a trial (SWAT).

The impact of reduced adherence in randomized clinical trials is well documented in the literature. Nonadherence can negatively affect the trial sample size and estimation of the treatment effect. This protocol aims to evaluate the effects of a telephone call reminder on the adherence rates of participants to interventions in a cardiovascular randomized trial. This is a study within a trial (SWAT). The host trial is evaluating the effectiveness of a multidisciplinary 16-wk cardiovascular disease prevention program on risk factor profile among patients with carotid artery stenosis. Simultaneously, this SWAT will evaluate the effectiveness of telephone call reminders on the participants' adherence to the host trial intervention. The primary outcome is adherence to the protocol of the host trial. Secondary outcomes are level of adherence, number of dropouts, and time to drop out from the host trial.

The effect of optimised patient information materials on recruitment in a lung cancer screening trial: an embedded randomised recruitment trial.

BACKGROUND: Written participant information materials are important for ensuring that potential trial participants receive necessary information so that they can provide informed consent. However, such materials are frequently long and complex, which may negatively impact patient understanding and willingness to participate. Improving readability, ease of comprehension and presentation may assist with improved participant recruitment. The Systematic Techniques for Assisting Recruitment to Trials (MRC START) study aimed to develop and evaluate interventions to improve trial recruitment. This study aimed to assess the effectiveness of an optimised participant information brochure and cover letter developed by MRC START regarding response and participant recruitment rates. METHODS: We conducted a study within a trial (SWAT) embedded in the EarlyCDT Lung Cancer Scotland (ECLS) trial that aimed to assess the effectiveness of a new test in reducing the incidence of patients with late-stage lung cancer at diagnosis compared with standard care. Potential participants approached for ECLS were randomised to receive the original participant information brochure and accompanying letter (control group) or optimised versions of these materials which had undergone user testing and a process of re-writing, re-organisation and professional graphic design (intervention group). The primary outcome was the number of patients recruited to ECLS. The secondary outcome was the proportion of patients expressing an interest in participating in ECLS. RESULTS: In total, 2262 patients were randomised, 1136 of whom were sent the intervention materials and 1126 of whom were sent the control materials. The proportion of patients enrolled and randomised into ECLS was 180 of 1136 (15.8%) in the intervention group and 176 of 1126 (15.6%) in the control group (OR = 1.016, 95% CI, 0.660 to 1.564). The proportion of patients who positively responded to the invitation was 224 of 1136 (19.7%) in the intervention group and 205 of 1126 (18.2%) in the control group (OR = 1.103, 95% CI, 0.778 to 1.565). CONCLUSIONS: Optimised patient information materials made little difference to the proportion of patients positively responding to a trial invitation or to the proportion subsequently randomised to the host trial. TRIAL REGISTRATION: ClinicalTrials.gov, NCT01925625 . Registered on 15 August 2015. Study Within A Trial, SWAT-23. Registered on 12 April 2016.

An intervention to support stroke survivors and their carers in the longer term (LoTS2Care): study protocol for a cluster randomised controlled feasibility trial.

BACKGROUND: Despite the evidence that many stroke survivors report longer term unmet needs, the provision of longer term care is limited. To address this, we are conducting a programme of research to develop an evidence-based and replicable longer term care strategy. The developed complex intervention (named New Start), which includes needs identification, exploration of social networks and components of problem solving and self-management, was designed to improve quality of life by addressing unmet needs and increasing participation. METHODS/DESIGN: A multicentre, cluster randomised controlled feasibility trial designed to inform the design of a possible future definitive cluster randomised controlled trial (cRCT) and explore the potential clinical and cost-effectiveness of New Start. Ten stroke services across the UK will be randomised on a 1:1 basis either to implement New Start or continue with usual care only. New Start will be delivered by trained facilitators and will be offered to all stroke survivors within the services allocated to the intervention arm. Stroke survivors will be eligible for the trial if they are 4-6 months post-stroke and residing in the community. Carers (if available) will also be invited to take part. Invitation to participate will be initiated by post and outcome measures will be collected via postal questionnaires at 3, 6 and 9 months after recruitment. Outcome data relating to perceived health and disability, wellbeing and quality of life as well as unmet needs will be collected. A 'study within a trial' (SWAT) is planned to determine the most acceptable format in which to provide the postal questionnaires. Details of health and social care service usage will also be collected to inform the economic evaluation. The feasibility of recruiting services and stroke survivors to the trial and of collecting postal outcomes will be assessed and the potential for effectiveness will be investigated. An embedded process evaluation (reported separately) will assess implementation fidelity and explore and clarify causal assumptions regarding implementation. DISCUSSION: This feasibility trial with embedded process evaluation will allow us to gather important and detailed data regarding methodological and implementation issues to inform the design of a possible future definitive cRCT of this complex intervention. TRIAL REGISTRATION: ISRCTN38920246 . Registered 22 June 2016.

SWAT 1: what effects do site visits by the principal investigator have on recruitment in a multicentre randomized trial?

The SWAT (Study Within A Trial) programme has been established to develop a series of studies that would embed research within research, so as to resolve uncertainties about the effects of different ways of designing, conducting, analyzing and interpreting evaluations of health and social care. It was described in an Education piece in the Journal of Evidence-Based Medicine in 2012. We have now prepared the first example of the design summary for a SWAT, using the template that will be used for other SWAT. This is presented in this article.