Premature Discontinuation of Pediatric Randomized Controlled Trials: A Retrospective Cohort Study.

OBJECTIVES: To determine the proportion of pediatric randomized controlled trials (RCTs) that are prematurely discontinued, examine the reasons for discontinuation, and compare the risk for recruitment failure in pediatric and adult RCTs. STUDY DESIGN: A retrospective cohort study of RCTs approved by 1 of 6 Research Ethics Committees (RECs) in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics, trial discontinuation, and reasons for discontinuation from protocols, corresponding publications, REC files, and a survey of trialists. RESULTS: We included 894 RCTs, of which 86 enrolled children and 808 enrolled adults. Forty percent of the pediatric RCTs and 29% of the adult RCTs were discontinued. Slow recruitment accounted for 56% of pediatric RCT discontinuations and 43% of adult RCT discontinuations. Multivariable logistic regression analyses suggested that pediatric RCT was not an independent risk factor for recruitment failure after adjustment for other potential risk factors (aOR, 1.22; 95% CI, 0.57-2.63). Independent risk factors were acute care setting (aOR, 4.00; 95% CI, 1.72-9.31), nonindustry sponsorship (aOR, 4.45; 95% CI, 2.59-7.65), and smaller planned sample size (aOR, 1.05; 95% CI 1.01-1.09, in decrements of 100 participants). CONCLUSION: Forty percent of pediatric RCTs were discontinued prematurely, owing predominately to slow recruitment. Enrollment of children was not an independent risk factor for recruitment failure.

Agreements between Industry and Academia on Publication Rights: A Retrospective Study of Protocols and Publications of Randomized Clinical Trials.

BACKGROUND: Little is known about publication agreements between industry and academic investigators in trial protocols and the consistency of these agreements with corresponding statements in publications. We aimed to investigate (i) the existence and types of publication agreements in trial protocols, (ii) the completeness and consistency of the reporting of these agreements in subsequent publications, and (iii) the frequency of co-authorship by industry employees. METHODS AND FINDINGS: We used a retrospective cohort of randomized clinical trials (RCTs) based on archived protocols approved by six research ethics committees between 13 January 2000 and 25 November 2003. Only RCTs with industry involvement were eligible. We investigated the documentation of publication agreements in RCT protocols and statements in corresponding journal publications. Of 647 eligible RCT protocols, 456 (70.5%) mentioned an agreement regarding publication of results. Of these 456, 393 (86.2%) documented an industry partner's right to disapprove or at least review proposed manuscripts; 39 (8.6%) agreements were without constraints of publication. The remaining 24 (5.3%) protocols referred to separate agreement documents not accessible to us. Of those 432 protocols with an accessible publication agreement, 268 (62.0%) trials were published. Most agreements documented in the protocol were not reported in the subsequent publication (197/268 [73.5%]). Of 71 agreements reported in publications, 52 (73.2%) were concordant with those documented in the protocol. In 14 of 37 (37.8%) publications in which statements suggested unrestricted publication rights, at least one co-author was an industry employee. In 25 protocol-publication pairs, author statements in publications suggested no constraints, but 18 corresponding protocols documented restricting agreements. CONCLUSIONS: Publication agreements constraining academic authors' independence are common. Journal articles seldom report on publication agreements, and, if they do, statements can be discrepant with the trial protocol.

Premature Discontinuation of Randomized Trials in Critical and Emergency Care: A Retrospective Cohort Study.

OBJECTIVES: Randomized clinical trials that enroll patients in critical or emergency care (acute care) setting are challenging because of narrow time windows for recruitment and the inability of many patients to provide informed consent. To assess the extent that recruitment challenges lead to randomized clinical trial discontinuation, we compared the discontinuation of acute care and nonacute care randomized clinical trials. DESIGN: Retrospective cohort of 894 randomized clinical trials approved by six institutional review boards in Switzerland, Germany, and Canada between 2000 and 2003. SETTING: Randomized clinical trials involving patients in an acute or nonacute care setting. SUBJECTS AND INTERVENTIONS: We recorded trial characteristics, self-reported trial discontinuation, and self-reported reasons for discontinuation from protocols, corresponding publications, institutional review board files, and a survey of investigators. MEASUREMENTS AND MAIN RESULTS: Of 894 randomized clinical trials, 64 (7%) were acute care randomized clinical trials (29 critical care and 35 emergency care). Compared with the 830 nonacute care randomized clinical trials, acute care randomized clinical trials were more frequently discontinued (28 of 64, 44% vs 221 of 830, 27%; p = 0.004). Slow recruitment was the most frequent reason for discontinuation, both in acute care (13 of 64, 20%) and in nonacute care randomized clinical trials (7 of 64, 11%). Logistic regression analyses suggested the acute care setting as an independent risk factor for randomized clinical trial discontinuation specifically as a result of slow recruitment (odds ratio, 4.00; 95% CI, 1.72-9.31) after adjusting for other established risk factors, including nonindustry sponsorship and small sample size. CONCLUSIONS: Acute care randomized clinical trials are more vulnerable to premature discontinuation than nonacute care randomized clinical trials and have an approximately four-fold higher risk of discontinuation due to slow recruitment. These results highlight the need for strategies to reliably prevent and resolve slow patient recruitment in randomized clinical trials conducted in the critical and emergency care setting.

Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study.

OBJECTIVE: To investigate the prevalence of discontinuation and nonpublication of surgical versus medical randomized controlled trials (RCTs) and to explore risk factors for discontinuation and nonpublication of surgical RCTs. BACKGROUND: Trial discontinuation has significant scientific, ethical, and economic implications. To date, the prevalence of discontinuation of surgical RCTs is unknown. METHODS: All RCT protocols approved between 2000 and 2003 by 6 ethics committees in Canada, Germany, and Switzerland were screened. Baseline characteristics were collected and, if published, full reports retrieved. Risk factors for early discontinuation for slow recruitment and nonpublication were explored using multivariable logistic regression analyses. RESULTS: In total, 863 RCT protocols involving adult patients were identified, 127 in surgery (15%) and 736 in medicine (85%). Surgical trials were discontinued for any reason more often than medical trials [43% vs 27%, risk difference 16% (95% confidence interval [CI]: 5%-26%); P = 0.001] and more often discontinued for slow recruitment [18% vs 11%, risk difference 8% (95% CI: 0.1%-16%); P = 0.020]. The percentage of trials not published as full journal article was similar in surgical and medical trials (44% vs 40%, risk difference 4% (95% CI: -5% to 14%); P = 0.373). Discontinuation of surgical trials was a strong risk factor for nonpublication (odds ratio = 4.18, 95% CI: 1.45-12.06; P = 0.008). CONCLUSIONS: Discontinuation and nonpublication rates were substantial in surgical RCTs and trial discontinuation was strongly associated with nonpublication. These findings need to be taken into account when interpreting surgical literature. Surgical trialists should consider feasibility studies before embarking on full-scale trials.

Prevalence, characteristics, and publication of discontinued randomized trials.

IMPORTANCE: The discontinuation of randomized clinical trials (RCTs) raises ethical concerns and often wastes scarce research resources. The epidemiology of discontinued RCTs, however, remains unclear. OBJECTIVES: To determine the prevalence, characteristics, and publication history of discontinued RCTs and to investigate factors associated with RCT discontinuation due to poor recruitment and with nonpublication. DESIGN AND SETTING: Retrospective cohort of RCTs based on archived protocols approved by 6 research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics and planned recruitment from included protocols. Last follow-up of RCTs was April 27, 2013. MAIN OUTCOMES AND MEASURES: Completion status, reported reasons for discontinuation, and publication status of RCTs as determined by correspondence with the research ethics committees, literature searches, and investigator surveys. RESULTS: After a median follow-up of 11.6 years (range, 8.8-12.6 years), 253 of 1017 included RCTs were discontinued (24.9% [95% CI, 22.3%-27.6%]). Only 96 of 253 discontinuations (37.9% [95% CI, 32.0%-44.3%]) were reported to ethics committees. The most frequent reason for discontinuation was poor recruitment (101/1017; 9.9% [95% CI, 8.2%-12.0%]). In multivariable analysis, industry sponsorship vs investigator sponsorship (8.4% vs 26.5%; odds ratio [OR], 0.25 [95% CI, 0.15-0.43]; P < .001) and a larger planned sample size in increments of 100 (-0.7%; OR, 0.96 [95% CI, 0.92-1.00]; P = .04) were associated with lower rates of discontinuation due to poor recruitment. Discontinued trials were more likely to remain unpublished than completed trials (55.1% vs 33.6%; OR, 3.19 [95% CI, 2.29-4.43]; P < .001). CONCLUSIONS AND RELEVANCE: In this sample of trials based on RCT protocols from 6 research ethics committees, discontinuation was common, with poor recruitment being the most frequently reported reason. Greater efforts are needed to ensure the reporting of trial discontinuation to research ethics committees and the publication of results of discontinued trials.

Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study).

BACKGROUND: Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. METHODS/DESIGN: Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs.We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. DISCUSSION: Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

Generic patient-reported outcomes in child health research: a review of conceptual content using World Health Organization definitions.

AIM: Our aims were to (1) describe the conceptual basis of popular generic instruments according to World Health Organization (WHO) definitions of functioning, disability, and health (FDH), and quality of life (QOL) with health-related quality of life (HRQOL) as a subcomponent of QOL; (2) map the instruments to the International Classification of Functioning, Disability and Health (ICF); and (3) provide information on how the analyzed instruments were used in the literature. This should enable users to make valid choices about which instruments have the desired content for a specific context or purpose. METHOD: Child health-based literature over a 5-year period was reviewed to find research employing health status and QOL/HRQOL instruments. WHO definitions of FDH and QOL were applied to each item of the 15 most used instruments to differentiate measures of FDH and QOL/HRQOL. The ICF was used to describe the health and health-related content (if any) in those instruments. Additional aspects of instrument use were extracted from these articles. RESULTS: Many instruments that were used to measure QOL/HRQOL did not reflect WHO definitions of QOL. The ICF domains within instruments were highly variable with respect to whether body functions, activities and participation, or environment were emphasized. INTERPRETATION: There is inconsistency among researchers about how to measure HRQOL and QOL. Moreover, when an ICF content analysis is applied, there is variability among instruments in the health components included and emphasized. Reviewing content is important for matching instruments to their intended purpose.

Somatostatin analogues for the treatment of enterocutaneous fistulas: a systematic review and meta-analysis.

BACKGROUND: Enterocutaneous fistulas are abnormal connections between the skin and gastrointestinal tract that most commonly occur after surgery. Somatostatin analogues have been used in their treatment. The objective of the present study was to determine if somatostatin analogues shorten the time to closure of postoperative enterocutaneous fistulas compared to placebo. METHODS: We searched Medline, EMBase, the Cochrane Central Register of Controlled Trials, as well as reference lists of textbooks and relevant articles for randomized controlled trials (RCT) comparing somatostatin analogues to control in the treatment of postoperative enterocutaneous fistulas. We systematically assessed trials for eligibility and validity, and extracted data in duplicate. We pooled data across studies using a random effects model. RESULTS: Our initial search yielded 720 studies, of which eight RCT ultimately met eligibility criteria and were included in this review. Somatostatin analogues significantly decreased the time to closure of fistulas compared to placebo {weighted mean difference (WMD)--6.37 days [95% confidence interval (CI) -8.33, -4.42]}. The duration of hospital stay was also significantly decreased with somatostatin analogue treatment [WMD--4.53 days (95% CI -8.29, -0.77)]. No difference in mortality was identified with somatostatin treatment [RR 0.87 (95% CI 0.49-1.55)]. CONCLUSIONS: Somatostatin analogues appear to decrease the duration of enterocutaneous fistulas and duration of hospital stay, but no mortality benefit was identified. The quality of evidence for outcomes in this review ranged from low to moderate. Future large, blinded, RCT would be useful in improving the confidence in the treatment effects identified in this systematic review and meta-analysis.

Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications.

OBJECTIVE: To investigate the planning of subgroup analyses in protocols of randomised controlled trials and the agreement with corresponding full journal publications. DESIGN: Cohort of protocols of randomised controlled trial and subsequent full journal publications. SETTING: Six research ethics committees in Switzerland, Germany, and Canada. DATA SOURCES: 894 protocols of randomised controlled trial involving patients approved by participating research ethics committees between 2000 and 2003 and 515 subsequent full journal publications. RESULTS: Of 894 protocols of randomised controlled trials, 252 (28.2%) included one or more planned subgroup analyses. Of those, 17 (6.7%) provided a clear hypothesis for at least one subgroup analysis, 10 (4.0%) anticipated the direction of a subgroup effect, and 87 (34.5%) planned a statistical test for interaction. Industry sponsored trials more often planned subgroup analyses compared with investigator sponsored trials (195/551 (35.4%) v 57/343 (16.6%), P<0.001). Of 515 identified journal publications, 246 (47.8%) reported at least one subgroup analysis. In 81 (32.9%) of the 246 publications reporting subgroup analyses, authors stated that subgroup analyses were prespecified, but this was not supported by 28 (34.6%) corresponding protocols. In 86 publications, authors claimed a subgroup effect, but only 36 (41.9%) corresponding protocols reported a planned subgroup analysis. CONCLUSIONS: Subgroup analyses are insufficiently described in the protocols of randomised controlled trials submitted to research ethics committees, and investigators rarely specify the anticipated direction of subgroup effects. More than one third of statements in publications of randomised controlled trials about subgroup prespecification had no documentation in the corresponding protocols. Definitive judgments regarding credibility of claimed subgroup effects are not possible without access to protocols and analysis plans of randomised controlled trials.

Systematic review and network meta-analysis of interventions for fibromyalgia: a protocol.

BACKGROUND: Fibromyalgia is associated with substantial socioeconomic loss and, despite considerable research including numerous randomized controlled trials (RCTs) and systematic reviews, there exists uncertainty regarding what treatments are effective. No review has evaluated all interventional studies for fibromyalgia, which limits attempts to make inferences regarding the relative effectiveness of treatments. METHODS/DESIGN: We will conduct a network meta-analysis of all RCTs evaluating therapies for fibromyalgia to determine which therapies show evidence of effectiveness, and the relative effectiveness of these treatments. We will acquire eligible studies through a systematic search of CINAHL, EMBASE, MEDLINE, AMED, HealthSTAR, PsychINFO, PapersFirst, ProceedingsFirst, and the Cochrane Central Registry of Controlled Trials. Eligible studies will randomly allocate patients presenting with fibromyalgia or a related condition to an intervention or a control. Teams of reviewers will, independently and in duplicate, screen titles and abstracts and complete full text reviews to determine eligibility, and subsequently perform data abstraction and assess risk of bias of eligible trials. We will conduct meta-analyses to establish the effect of all reported therapies on patient-important outcomes when possible. To assess relative effects of treatments, we will construct a random effects model within the Bayesian framework using Markov chain Monte Carlo methods. DISCUSSION: Our review will be the first to evaluate all treatments for fibromyalgia, provide relative effectiveness of treatments, and prioritize patient-important outcomes with a focus on functional gains. Our review will facilitate evidence-based management of patients with fibromyalgia, identify key areas for future research, and provide a framework for conducting large systematic reviews involving indirect comparisons.