The overlap between randomised evaluations of recruitment and retention interventions: An updated review of recruitment (Online Resource for Recruitment in Clinical triAls) and retention (Online Resource for Retention in Clinical triAls) literature.

BACKGROUND: The Online Resource for Recruitment in Clinical triAls (ORRCA) and the Online Resource for Retention in Clinical triAls (ORRCA2) were established to organise and map the literature addressing participant recruitment and retention within clinical research. The two databases are updated on an ongoing basis using separate but parallel systematic reviews. However, recruitment and retention of research participants is widely acknowledged to be interconnected. While interventions aimed at addressing recruitment challenges can impact retention and vice versa, it is not clear how well they are simultaneously considered within methodological research. This study aims to report the recent update of ORRCA and ORRCA2 with a special emphasis on assessing crossover of the databases and how frequently randomised studies of methodological interventions measure the impact on both recruitment and retention outcomes. METHODS: Two parallel systematic reviews were conducted in line with previously reported methods updating ORRCA (recruitment) and ORRCA2 (retention) with publications from 2018 and 2019. Articles were categorised according to their evidence type (randomised evaluation, non-randomised evaluation, application and observation) and against the recruitment and retention domain frameworks. Articles categorised as randomised evaluations were compared to identify studies appearing in both databases. For randomised studies that were only in one database, domain categories were used to assess whether the methodological intervention was likely to impact on the alternate construct. For example, whether a recruitment intervention might also impact retention. RESULTS: In total, 806 of 17,767 articles screened for the recruitment database and 175 of 18,656 articles screened for the retention database were added as result of the update. Of these, 89 articles were classified as 'randomised evaluation', of which 6 were systematic reviews and 83 were randomised evaluations of methodological interventions. Ten of the randomised studies assessed recruitment and retention and were included in both databases. Of the randomised studies only in the recruitment database, 48/55 (87%) assessed the content or format of participant information which could have an impact on retention. Of the randomised studies only in the retention database, 6/18 (33%) assessed monetary incentives, 4/18 (22%) assessed data collection location and methods and 3/18 (17%) assessed non-monetary incentives, all of which could have an impact on recruitment. CONCLUSION: Only a small proportion of randomised studies of methodological interventions assessed the impact on both recruitment and retention despite having a potential impact on both outcomes. Where possible, an integrated approach analysing both constructs should be the new standard for these types of evaluations to ensure that improvements to recruitment are not at the expense of retention and vice versa.

The use of healthcare systems data for RCTs.

BACKGROUND: Healthcare systems data (HSD) has the potential to optimise the efficiency of randomised controlled trials (RCTs), by decreasing trial-specific data demands. Therefore, the use of HSD in trials is expected to increase. In 2019, it was estimated that 47% of NIHR-funded trials were planning to use HSD. We aim to understand the extent and nature of its current use and its evolution over time. METHODS: We identified a cohort of RCTs within the NIHR Journals Library that commenced after 2019 and were described as being in progress on 6 June 2022. Details on the source and use of HSD were extracted from eligible RCTs. The use of HSD was categorised according to whether it was used as the sole data source for outcomes and whether the outcomes were primary or secondary. HSD is often insufficient for patient-reported outcomes (PROs). We aimed to determine methods used by trialists for collecting PRO data alongside HSD. RESULTS: Of the 84 eligible studies, 52 (62%) planned to use HSD and 79 (94%) planned to collect PROs. The number of RCTs planning to use HSD for at least one outcome was 28 (54%) with 24 of these planning to use HSD as the sole data source for at least one outcome. The number of studies planning to use HSD for primary and secondary outcomes was 10 (20%) and 21 (40%) respectively. The sources of HSD were National Health Service (NHS) Digital (n = 37, 79%), patient registries (n = 7, 29%), primary care (n = 5, 21%), The Office for National Statistics (ONS) (n = 3, 13%) and other (n = 2, 8%). PROs were collected for 92% of the trials planning to use HSD. Methods for collection of PROs included in-person (n = 26, 54%), online (n = 22, 46%), postal (n = 18, 38%), phone (n = 14, 29%) and app (n = 2, 4%). CONCLUSIONS: HSD is being used in around two thirds of the studies but cannot yet be used to support PRO data collection within the cohort we examined. Comparison with an earlier cohort demonstrates an increase in the number of RCTs planning to use HSD.

Questioning approaches to consent in time critical obstetric trials: findings from a mixed-methods study.

OBJECTIVE: Trial legislation enables research to be conducted without prior consent (RWPC) in emergency situations, yet this approach has rarely been used in time-critical obstetric trials. This study explored views and experiences of antenatal recruitment and consent and RWPC in an emergency intrapartum randomised clinical trial. DESIGN: Embedded, mixed-methods study within a trial, involving questionnaires, recorded recruitment discussions, interviews and focus groups in the first 13 months of trial recruitment (December 2020-January 2022). SETTING: COPE is a double-blind randomised controlled trial, comparing the effectiveness of carboprost or oxytocin as first-line treatment of postpartum haemorrhage. PARTICIPANTS: Two hundred and eighty-six people (190 women/96 birth partners), linked to 198/380 (52%) COPE recruits participated in the embedded study. Of these, 272 completed a questionnaire (178 women/94 birth partners), 22 were interviewed (19 women/3 birth partners) and 16 consent discussions with 12 women were recorded. Twenty-seven staff took part in three focus groups and nine staff were interviewed. RESULTS: Participants recommended that information about the study should be more accessible antenatally for those who wish to be informed. Most women and staff did not think it would be appropriate to seek consent during pregnancy or early labour as it may cause 'unnecessary panic' and lead to research waste, as most women would not become eligible. There was support for the use of RWPC as COPE interventions are used in standard clinical practice and viewed as low risk. Women who were approached about the trial while having a postpartum haemorrhage also supported RWPC as they could not recall research discussions. CONCLUSIONS: Findings support the use of RWPC for time-critical interventions, and raise questions about the appropriateness of other commonly used consent pathways, including antenatal consent and verbal assent.

Good Statistical Practice-development of tailored Good Clinical Practice training for statisticians.

BACKGROUND: Statisticians are fundamental in ensuring clinical research, including clinical trials, are conducted with quality, transparency, reproducibility and integrity. Good Clinical Practice (GCP) is an international quality standard for the conduct of clinical trials research. Statisticians are required to undertake training on GCP but existing training is generic and, crucially, does not cover statistical activities. This results in statisticians undertaking training mostly unrelated to their role and variation in awareness and implementation of relevant regulatory requirements with regards to statistical conduct. The need for role-relevant training is recognised by the UK NHS Health Research Authority and the Medicines and Healthcare products Regulatory Agency (MHRA). METHODS: The Good Statistical Practice (GCP for Statisticians) project was instigated by the UK Clinical Research Collaboration (UKCRC) Registered Clinical Trials Unit (CTU) Statisticians Operational Group and funded by the National Institute for Health and Care Research (NIHR), to develop materials to enable role-specific GCP training tailored to statisticians. Review of current GCP training was undertaken by survey. Development of training materials were based on MHRA GCP. Critical review and piloting was conducted with UKCRC CTU and NIHR researchers with comment from MHRA. Final review was conducted through the UKCRC CTU Statistics group. RESULTS: The survey confirmed the need and desire for the development of dedicated GCP training for statisticians. An accessible, comprehensive, piloted training package was developed tailored to statisticians working in clinical research, particularly the clinical trials arena. The training materials cover legislation and guidance for best practice across all clinical trial processes with statistical involvement, including exercises and real-life scenarios to bridge the gap between theory and practice. Comprehensive feedback was incorporated. The training materials are freely available for national and international adoption. CONCLUSION: All research staff should have training in GCP yet the training undertaken by most academic statisticians does not cover activities related to their role. The Good Statistical Practice (GCP for Statisticians) project has developed and extensively piloted new, role-specific, comprehensive, accessible GCP training tailored to statisticians working in clinical research, particularly the clinical trials arena. This role-specific training will encourage best practice, leading to transparent and reproducible statistical activity, as required by regulatory authorities and funders.

Seizure control via pH manipulation: a phase II double-blind randomised controlled trial of inhaled carbogen as adjunctive treatment of paediatric convulsive status epilepticus (Carbogen for Status Epilepticus in Children Trial (CRESCENT)).

BACKGROUND: Paediatric convulsive status epilepticus is the most common neurological emergency presenting to emergency departments. Risks of resultant neurological morbidity and mortality increase with seizure duration. If the seizure fails to stop within defined time-windows, standard care follows an algorithm of stepwise escalation to more intensive treatments, ultimately resorting to induction of general anaesthesia and ventilation. Additionally, ventilatory support may also be required to treat respiratory depression, a common unwanted effect of treatment. There is strong pre-clinical evidence that pH (acid-base balance) is an important determinant of seizure commencement and cessation, with seizures tending to start under alkaline conditions and terminate under acidic conditions. These mechanisms may be particularly important in febrile status epilepticus: prolonged fever-related seizures which predominantly affect very young children. This trial will assess whether imposition of mild respiratory acidosis by manipulation of inhaled medical gas improves response rates to first-line medical treatment. METHODS: A double-blind, placebo-controlled trial of pH manipulation as an adjunct to standard medical treatment of convulsive status epilepticus in children. The control arm receives standard medical management whilst inhaling 100% oxygen; the active arm receives standard medical management whilst inhaling a commercially available mixture of 95% oxygen, 5% carbon dioxide known as 'carbogen'. Due to the urgent need to treat the seizure, deferred consent is used. The primary outcome is success of first-line treatment in seizure cessation. Planned subgroup analyses will be undertaken for febrile and non-febrile seizures. Secondary outcomes include rates of induction of general anaesthesia, admission to intensive care, adverse events, and 30-day mortality. DISCUSSION: If safe and effective 95% oxygen, 5% carbon dioxide may be an important adjunct in the management of convulsive status epilepticus with potential for pre-hospital use by paramedics, families, and school staff. TRIAL REGISTRATION: EudraCT: 2021-005367-49. CTA: 17136/0300/001. ISRCTN: 52731862. Registered on July 2022.

Using healthcare systems data for outcomes in clinical trials: issues to consider at the design stage.

BACKGROUND: Healthcare system data (HSD) are increasingly used in clinical trials, augmenting or replacing traditional methods of collecting outcome data. This study, PRIMORANT, set out to identify, in the UK context, issues to be considered before the decision to use HSD for outcome data in a clinical trial is finalised, a methodological question prioritised by the clinical trials community. METHODS: The PRIMORANT study had three phases. First, an initial workshop was held to scope the issues faced by trialists when considering whether to use HSDs for trial outcomes. Second, a consultation exercise was undertaken with clinical trials unit (CTU) staff, trialists, methodologists, clinicians, funding panels and data providers. Third, a final discussion workshop was held, at which the results of the consultation were fed back, case studies presented, and issues considered in small breakout groups. RESULTS: Key topics included in the consultation process were the validity of outcome data, timeliness of data capture, internal pilots, data-sharing, practical issues, and decision-making. A majority of consultation respondents (n = 78, 95%) considered the development of guidance for trialists to be feasible. Guidance was developed following the discussion workshop, for the five broad areas of terminology, feasibility, internal pilots, onward data sharing, and data archiving. CONCLUSIONS: We provide guidance to inform decisions about whether or not to use HSDs for outcomes, and if so, to assist trialists in working with registries and other HSD providers to improve the design and delivery of trials.

The effectiveness and acceptability of multimedia information when recruiting children and young people to trials: the TRECA meta-analysis of SWATs.

Background: The information provided to potential trial participants plays a crucial role in their decision-making. Printed participant information sheets for trials have received recurrent criticism as being too long and technical, unappealing and hard to navigate. An alternative is to provide information through multimedia (text, animations, video, audio, diagrams and photos). However, there is limited evidence on the effects of multimedia participant information on research recruitment rates, particularly in children and young people. Objectives: The study objectives were as follows: 1. to develop template multimedia information resources through participatory design, for use when recruiting children and young people to trials 2. to evaluate the multimedia information resources in a series of Studies Within A Trial, to test their effects on recruitment and retention rates, and participant decision-making, by comparing the provision of multimedia information resources instead of printed participant information sheets, and comparing the provision of multimedia information resources in addition to printed participant information sheets. Design: Two-phase study: 1. multimedia information resources development including qualitative study; user testing study; readability metrics; enhanced patient and public involvement 2. multimedia information resources' evaluation comprising Studies Within A Trial undertaken within host trials recruiting children and young people. Setting: United Kingdom trials involving patients aged under 18. Participants: Development phase: n = 120 (children and young people, parents, clinicians, trial personnel). Evaluation phase: n = 1906 (children and young people being asked to take part in trials). Interventions: Multimedia information resources (comprising text, audio, 'talking heads' video, trial-specific and trial-generic animations). Printed participant information sheets. Main outcome measures: Primary outcome: trial recruitment rate comparing multimedia information resource-only with printed participant information sheet-only provision. Secondary outcomes: trial recruitment rate comparing combined multimedia information resource and printed participant information sheet with printed participant information sheet-only provision; trial retention rate; quality of participant decision-making. Results for each trial were calculated and combined in a two-stage random-effects meta-analysis. Results: Phase 1 generated two multimedia information resource templates: (1) for children aged 6-11 years; (2) for children aged 12-18 years and parents. In the Phase 2 Studies Within A Trial the multimedia information resources improved trial recruitment, when compared to printed information alone [odds ratio (OR) = 1.54; 95% confidence interval (CI) 1.05 to 2.28; p = 0.03; I2 = 0%]. When printed participant information sheet-only provision was compared to combined multimedia information resource and printed participant information sheet provision, there was no effect on trial recruitment (OR = 0.89; 95% CI 0.53 to 1.50; I2 = 0%). There were no differences between multimedia information resource and printed participant information sheet on trial retention or participant decision-making quality. In a study within a hypothetical trial setting, multimedia information resource-only provision produced higher ratings of 'information was easy to understand' (Z = 3.03; p = 0.003) and 'I had confidence in decision-making' (Z = 2.00; p = 0.044) than printed participant information sheet-only provision. Limitations: It was not possible to include data from three Studies Within A Trial in the meta-analysis due to limited sample size, and questionnaire return rates were low, which reduced the strength of the findings. Conclusions: Use of multimedia information increased the rate of recruitment to trials involving children and young people compared to standard patient information sheets. Future work: There should be further evaluation of the effects of multimedia information on recruitment to trials involving children and young people. It would be valuable to assess any impacts of multimedia information resources on communication between trial recruiters, children and young people, and parents. Study registration: This trial is registered as TRECA ISRCTN 73136092 and Northern Ireland Hub for Trials Methodology Research SWAT Repository (SWAT 97). Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research programme (NIHR award ref: 14/21/21) and is published in full in Health and Social Care Delivery Research; Vol. 11, No. 24. See the NIHR Funding and Awards website for further award information.

Clinical trials are important to National Health Service care, but it can be difficult to recruit enough people. We do not know enough about how to improve recruitment, especially when trying to recruit children and young people. People are normally told about a trial through printed information, which is often long and complex. Multimedia information (text, audio, cartoons and video) might be a better way of telling people. It is important to test whether multimedia interventions can help. One way of doing this is to run a 'Study Within A Trial' where people receive information in different ways. We created two multimedia interventions, one for parents and young people being asked for consent, and a simpler one for younger children. Some content applied to all trials, and some about the specific trial people were being asked to consider. We designed these by working closely with children and young people, parents and healthcare staff. We tested the multimedia information in six trials (although only three gave us enough data). Children, young people and their parents saw either standard printed information or our multimedia information. We then collected data on their decision-making, trial recruitment and whether people stayed in the trial. Children and young people who saw multimedia information were more likely to be recruited than those who received standard printed information. Once recruited to a trial, people given multimedia or printed information were similarly likely to remain in the trial. People's views on multimedia and printed information were also similar, but this finding could have been affected by small numbers of people returning questionnaires. Our study provides evidence that multimedia information can be used in trials with children and young people and that it increases the number of people who agree to take part, but further work is needed.