Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis.

BACKGROUND: We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. METHODS AND FINDINGS: We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations. CONCLUSIONS: We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.

Reporting quality of clinical trial protocols: a repeated cross-sectional study about the Adherence to SPIrit Recommendations in Switzerland, CAnada and GErmany (ASPIRE-SCAGE).

OBJECTIVES: Comprehensive protocols are key for the planning and conduct of randomised clinical trials (RCTs). Evidence of low reporting quality of RCT protocols led to the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist in 2013. We aimed to examine the quality of reporting of RCT protocols from three countries before and after the publication of the SPIRIT checklist. DESIGN: Repeated cross sectional study. SETTING: Swiss, German and Canadian research ethics committees (RECs). PARTICIPANTS: RCT protocols approved by RECs in 2012 (n=257) and 2016 (n=292). PRIMARY AND SECONDARY OUTCOME MEASURES: The primary outcomes were the proportion of reported SPIRIT items per protocol and the proportion of trial protocols reporting individual SPIRIT items. We compared these outcomes in protocols approved in 2012 and 2016, and built regression models to explore factors associated with adherence to SPIRIT. For each protocol, we also extracted information on general trial characteristics and assessed whether individual SPIRIT items were reported RESULTS: The median proportion of reported SPIRIT items among RCT protocols showed a non-significant increase from 72% (IQR, 63%-79%) in 2012 to 77% (IQR, 68%-82%) in 2016. However, in a preplanned subgroup analysis, we detected a significant improvement in investigator-sponsored protocols: the median proportion increased from 64% (IQR, 55%-72%) in 2012 to 76% (IQR, 64%-83%) in 2016, while for industry-sponsored protocols median adherence was 77% (IQR 72%-80%) for both years. The following trial characteristics were independently associated with lower adherence to SPIRIT: single-centre trial, no support from a clinical trials unit or contract research organisation, and investigator-sponsorship. CONCLUSIONS: In 2012, industry-sponsored RCT protocols were reported more comprehensively than investigator-sponsored protocols. After publication of the SPIRIT checklist, investigator-sponsored protocols improved to the level of industry-sponsored protocols, which did not improve.

Reporting quality of trial protocols improved for non-regulated interventions but not regulated interventions: A repeated cross-sectional study.

OBJECTIVES: To investigate the adherence of randomised controlled trial (RCT) protocols evaluating non-regulated interventions (including dietary interventions, surgical procedures, behavioural and lifestyle interventions, and exercise programmes) in comparison with regulated interventions to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Statement. METHODS: We conducted a repeated cross-sectional investigation in a random sample of RCT protocols approved in 2012 (n = 257) or 2016 (n = 292) by research ethics committees in Switzerland, Germany, or Canada. We investigated the proportion of accurately reported SPIRIT checklist items in protocols of trials with non-regulated as compared to regulated interventions. RESULTS: Overall, 131 (24%) of trial protocols tested non-regulated interventions. In 2012, the median proportion of SPIRIT items reported in these protocols (59%, interquartile range [IQR], 53%-69%) was lower than in protocols with regulated interventions (median, 74%, IQR, 66%-80%). In 2016, the reporting quality of protocols with non-regulated interventions (median, 75%, IQR, 62%-83%) improved to the level of regulated intervention protocols, which had not changed on average. CONCLUSIONS: Reporting of RCT protocols evaluating non-regulated interventions improved between 2012 and 2016, although remained suboptimal. SPIRIT recommendations need to be further endorsed by researchers, ethics committees, funding agencies, and journals to optimize reporting of RCT protocols.

Rationale and design of repeated cross-sectional studies to evaluate the reporting quality of trial protocols: the Adherence to SPIrit REcommendations (ASPIRE) study and associated projects.

BACKGROUND: Clearly structured and comprehensive protocols are an essential component to ensure safety of participants, data validity, successful conduct, and credibility of results of randomized clinical trials (RCTs). Funding agencies, research ethics committees (RECs), regulatory agencies, medical journals, systematic reviewers, and other stakeholders rely on protocols to appraise the conduct and reporting of RCTs. In response to evidence of poor protocol quality, the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline was published in 2013 to improve the accuracy and completeness of clinical trial protocols. The impact of these recommendations on protocol completeness and associations between protocol completeness and successful RCT conduct and publication remain uncertain. OBJECTIVES AND METHODS: Aims of the Adherence to SPIrit REcommendations (ASPIRE) study are to investigate adherence to SPIRIT checklist items of RCT protocols approved by RECs in the UK, Switzerland, Germany, and Canada before (2012) and after (2016) the publication of the SPIRIT guidelines; determine protocol features associated with non-adherence to SPIRIT checklist items; and assess potential differences in adherence across countries. We assembled an international cohort of RCTs based on 450 protocols approved in 2012 and 402 protocols approved in 2016 by RECs in Switzerland, the UK, Germany, and Canada. We will extract data on RCT characteristics and adherence to SPIRIT for all included protocols. We will use multivariable regression models to investigate temporal changes in SPIRIT adherence, differences across countries, and associations between SPIRIT adherence of protocols with RCT registration, completion, and publication of results. We plan substudies to examine the registration, premature discontinuation, and non-publication of RCTs; the use of patient-reported outcomes in RCT protocols; SPIRIT adherence of RCT protocols with non-regulated interventions; the planning of RCT subgroup analyses; and the use of routinely collected data for RCTs. DISCUSSION: The ASPIRE study and associated substudies will provide important information on the impact of measures to improve the reporting of RCT protocols and on multiple aspects of RCT design, trial registration, premature discontinuation, and non-publication of RCTs observing potential changes over time.

A primary healthcare information intervention for communicating cardiovascular risk to patients with poorly controlled hypertension: The Education and Coronary Risk Evaluation (Educore) study-A pragmatic, cluster-randomized trial.

PURPOSE: Uncertainty exists regarding the best way to communicate cardiovascular risk (CVR) to patients, and it is unclear whether the comprehension and perception of CVR varies according to the format used. The aim of the present work was to determine whether a strategy designed for communicating CVR information to patients with poorly controlled high blood pressure (HBP), but with no background of cardiovascular disease, was more effective than usual care in the control of blood pressure (BP) over the course of a year. METHODS: A pragmatic, two-arm, cluster-randomized controlled trial was performed. Consecutive patients aged 40-65 years, all diagnosed with HBP in the last 12 months, and all of whom showed poor control of their condition (systolic BP ≥140 mmHg and/or diastolic BP ≥90 mmHg), were recruited at 22 primary healthcare centres. Eleven centres were randomly assigned to the usual care arm, and 11 to the informative intervention arm (Educore arm). At the start of the study, the Educore arm subjects were shown the "low risk SCORE table", along with impacting images and information pamphlets encouraging the maintenance of good cardiovascular health. The main outcome variable measured was the control of HBP; the secondary outcome variables were SCORE table score, total plasma cholesterol concentration, use of tobacco, adherence to prescribed treatment, and quality of life. RESULTS: The study participants were 411 patients (185 in the Educore arm and 226 in the usual care arm). Multilevel logistic regression showed that, at 12 months, the Educore intervention achieved better control of HBP (OR = 1.57; 1.02 to 2.41). No statistically significant differences were seen between the two arms at 12 months with respect to the secondary outcomes. CONCLUSIONS: Compared to usual care, the Educore intervention was associated with better control of HBP after adjusting for age, baseline SBP and plasma cholesterol, at 12 months.

Resource use, costs, and approval times for planning and preparing a randomized clinical trial before and after the implementation of the new Swiss human research legislation.

BACKGROUND: The preparation of a randomized controlled trial (RCT) requires substantial resources and the administrative processes can be burdensome. To facilitate the conduct of RCTs it is important to better understand cost drivers. In January 2014 the enactment of the new Swiss Legislation on Human Research (LHR) considerably changed the regulatory framework in Switzerland. We assess if the new LHR was associated with change in (i) resource use and costs to prepare an RCT, and (ii) approval times with research ethics committees (RECs) and the regulatory authority Swissmedic. METHODS: We surveyed investigators of RCTs which were approved by RECs in 2012 or in 2016 and asked for RCT preparation costs using a pre-specified item list. Additionally, we collected approval times from RECs and Swissmedic. RESULTS: The response rates of the investigator survey were 8.3% (19/228) for 2012 and 16.5% (47/285) in 2016. The median preparation cost of an RCT was USD 72,400 (interquartile range [IQR]: USD 59,500-87,700; n = 18) in 2012 and USD 72,600 (IQR: USD 42,800-169,600; n = 35) in 2016. For single centre RCTs a median REC approval time of 82 (IQR: 49-107; n = 38) days in 2012 and 92 (IQR: 65-131; n = 63) days in 2016 was observed. The median Swissmedic approval time for any clinical trial was 27 (IQR: 19-51; n = 213) days in 2012 and 49 (IQR: 36-67; n = 179) days in 2016. The total duration for achieving RCT approval from both authorities (REC and Swissmedic) in the parallel submission procedure applied in 2016 could not be assessed. CONCLUSION: Based on limited data the costs to plan and prepare RCTs in Switzerland were approximately USD 72,000 in 2012 and 2016. For effective and valid research on costs and approval times of RCTs a greater willingness to share cost information among investigators and more collaboration between stakeholders with data linkage is necessary.

Effectiveness of a strategy that uses educational games to implement clinical practice guidelines among Spanish residents of family and community medicine (e-EDUCAGUIA project): a clinical trial by clusters.

BACKGROUND: Clinical practice guidelines (CPGs) have been developed with the aim of helping health professionals, patients, and caregivers make decisions about their health care, using the best available evidence. In many cases, incorporation of these recommendations into clinical practice also implies a need for changes in routine clinical practice. Using educational games as a strategy for implementing recommendations among health professionals has been demonstrated to be effective in some studies; however, evidence is still scarce. The primary objective of this study is to assess the effectiveness of a teaching strategy for the implementation of CPGs using educational games (e-learning EDUCAGUIA) to improve knowledge and skills related to clinical decision-making by residents in family medicine. The primary objective will be evaluated at 1 and 6 months after the intervention. The secondary objectives are to identify barriers and facilitators for the use of guidelines by residents of family medicine and to describe the educational strategies used by Spanish teaching units of family and community medicine to encourage implementation of CPGs. METHODS/DESIGN: We propose a multicenter clinical trial with randomized allocation by clusters of family and community medicine teaching units in Spain. The sample size will be 394 residents (197 in each group), with the teaching units as the randomization unit and the residents comprising the analysis unit. For the intervention, both groups will receive an initial 1-h session on clinical practice guideline use and the usual dissemination strategy by e-mail. The intervention group (e-learning EDUCAGUIA) strategy will consist of educational games with hypothetical clinical scenarios in a virtual environment. The primary outcome will be the score obtained by the residents on evaluation questionnaires for each clinical practice guideline. Other included variables will be the sociodemographic and training variables of the residents and the teaching unit characteristics. The statistical analysis will consist of a descriptive analysis of variables and a baseline comparison of both groups. For the primary outcome analysis, an average score comparison of hypothetical scenario questionnaires between the EDUCAGUIA intervention group and the control group will be performed at 1 and 6 months post-intervention, using 95 % confidence intervals. A linear multilevel regression will be used to adjust the model. DISCUSSION: The identification of effective teaching strategies will facilitate the incorporation of available knowledge into clinical practice that could eventually improve patient outcomes. The inclusion of information technologies as teaching tools permits greater learning autonomy and allows deeper instructor participation in the monitoring and supervision of residents. The long-term impact of this strategy is unknown; however, because it is aimed at professionals undergoing training and it addresses prevalent health problems, a small effect can be of great relevance. TRIAL REGISTRATION: ClinicalTrials.gov: NCT02210442 .