Nonregistration, discontinuation, and nonpublication of randomized trials: A repeated metaresearch analysis.

BACKGROUND: We previously found that 25% of 1,017 randomized clinical trials (RCTs) approved between 2000 and 2003 were discontinued prematurely, and 44% remained unpublished at a median of 12 years follow-up. We aimed to assess a decade later (1) whether rates of completion and publication have increased; (2) the extent to which nonpublished RCTs can be identified in trial registries; and (3) the association between reporting quality of protocols and premature discontinuation or nonpublication of RCTs. METHODS AND FINDINGS: We included 326 RCT protocols approved in 2012 by research ethics committees in Switzerland, the United Kingdom, Germany, and Canada in this metaresearch study. Pilot, feasibility, and phase 1 studies were excluded. We extracted trial characteristics from each study protocol and systematically searched for corresponding trial registration (if not reported in the protocol) and full text publications until February 2022. For trial registrations, we searched the (i) World Health Organization: International Clinical Trial Registry Platform (ICTRP); (ii) US National Library of Medicine (ClinicalTrials.gov); (iii) European Union Drug Regulating Authorities Clinical Trials Database (EUCTR); (iv) ISRCTN registry; and (v) Google. For full text publications, we searched PubMed, Google Scholar, and Scopus. We recorded whether RCTs were registered, discontinued (including reason for discontinuation), and published. The reporting quality of RCT protocols was assessed with the 33-item SPIRIT checklist. We used multivariable logistic regression to examine the association between the independent variables protocol reporting quality, planned sample size, type of control (placebo versus other), reporting of any recruitment projection, single-center versus multicenter trials, and industry versus investigator sponsoring, with the 2 dependent variables: (1) publication of RCT results; and (2) trial discontinuation due to poor recruitment. Of the 326 included trials, 19 (6%) were unregistered. Ninety-eight trials (30%) were discontinued prematurely, most often due to poor recruitment (37%; 36/98). One in 5 trials (21%; 70/326) remained unpublished at 10 years follow-up, and 21% of unpublished trials (15/70) were unregistered. Twenty-three of 147 investigator-sponsored trials (16%) reported their results in a trial registry in contrast to 150 of 179 industry-sponsored trials (84%). The median proportion of reported SPIRIT items in included RCT protocols was 69% (interquartile range 61% to 77%). We found no variables associated with trial discontinuation; however, lower reporting quality of trial protocols was associated with nonpublication (odds ratio, 0.71 for each 10% increment in the proportion of SPIRIT items met; 95% confidence interval, 0.55 to 0.92; p = 0.009). Study limitations include that the moderate sample size may have limited the ability of our regression models to identify significant associations. CONCLUSIONS: We have observed that rates of premature trial discontinuation have not changed in the past decade. Nonpublication of RCTs has declined but remains common; 21% of unpublished trials could not be identified in registries. Only 16% of investigator-sponsored trials reported results in a trial registry. Higher reporting quality of RCT protocols was associated with publication of results. Further efforts from all stakeholders are needed to improve efficiency and transparency of clinical research.

Investigator initiated trials versus industry sponsored trials - translation of randomized controlled trials into clinical practice (IMPACT).

BACKGROUND: Healthcare decisions are ideally based on clinical trial results, published in study registries, as journal articles or summarized in secondary research articles. In this research project, we investigated the impact of academically and commercially sponsored clinical trials on medical practice by measuring the proportion of trials published and cited by systematic reviews and clinical guidelines. METHODS: We examined 691 multicenter, randomized controlled trials that started in 2005 or later and were completed by the end of 2016. To determine whether sponsorship/funding and place of conduct influence a trial's impact, we created four sub-cohorts of investigator initiated trials (IITs) and industry sponsored trials (ISTs): 120 IITs and 171 ISTs with German contribution compared to 200 IITs and 200 ISTs without German contribution. We balanced the groups for study phase and place of conduct. German IITs were funded by the German Research Foundation (DFG), the Federal Ministry of Education and Research (BMBF), or by another non-commercial research organization. All other trials were drawn from the German Clinical Trials Register or ClinicalTrials.gov. We investigated, to what extent study characteristics were associated with publication and impact using multivariable logistic regressions. RESULTS: For 80% of the 691 trials, results were published as result articles in a medical journal and/or study registry, 52% were cited by a systematic review, and 26% reached impact in a clinical guideline. Drug trials and larger trials were associated with a higher probability to be published and to have an impact than non-drug trials and smaller trials. Results of IITs were more often published as a journal article while results of ISTs were more often published in study registries. International ISTs less often gained impact by inclusion in systematic reviews or guidelines than IITs. CONCLUSION: An encouraging high proportion of the clinical trials were published, and a considerable proportion gained impact on clinical practice. However, there is still room for improvement. For publishing study results, study registries have become an alternative or complement to journal articles, especially for ISTs. IITs funded by governmental bodies in Germany reached an impact that is comparable to international IITs and ISTs.

Degarelix for treating advanced hormone-sensitive prostate cancer.

BACKGROUND: Degarelix is a gonadotropin-releasing hormone antagonist that leads to medical castration used to treat men with advanced or metastatic prostate cancer, or both. It is unclear how its effects compare to standard androgen suppression therapy. OBJECTIVES: To assess the effects of degree compared with standard androgen suppression therapy for men with advanced hormone-sensitive prostate cancer. SEARCH METHODS: We searched multiple databases (CENTRAL, MEDLINE, Embase, Scopus, Web of Science, LILACS until September 2020), trial registries (until October 2020), and conference proceedings (until December 2020). We identified other potentially eligible trials by reference checking, citation searching, and contacting study authors. SELECTION CRITERIA: We included randomized controlled trials comparing degarelix with standard androgen suppression therapy for men with advanced prostate cancer. DATA COLLECTION AND ANALYSIS: Three review authors independently classified studies and abstracted data from the included studies. The primary outcomes were overall survival and serious adverse events. Secondary outcomes were quality of life, cancer-specific survival, clinical progression, other adverse events, and biochemical progression. We used a random-effects model for meta-analyses and assessed the certainty of evidence for the main outcomes according to GRADE. MAIN RESULTS: We included 11 studies with a follow-up of between three and 14 months. We also identified five ongoing trials. Primary outcomes Data to evaluate overall survival were not available.  Degarelix may result in little to no difference in serious adverse events compared to standard androgen suppression therapy (risk ratio (RR) 0.80, 95% confidence interval (CI) 0.62 to 1.05; low-certainty evidence; 2750 participants). Based on 114 serious adverse events in the standard androgen suppression group, this corresponds to 23 fewer serious adverse events per 1000 participants (43 fewer to 6 more). We downgraded the certainty of evidence for study limitations and imprecision. Secondary outcomes Degarelix likely results in little to no difference in quality of life assessed with a variety of validated questionnaires (standardized mean difference 0.06 higher, 95% CI 0.05 lower to 0.18 higher; moderate-certainty evidence; 2887 participants), with higher scores reflecting better quality of life. We downgraded the certainty of evidence for study limitations. Data to evaluate cancer-specific survival were not available. The effects of degarelix on cardiovascular events are very uncertain (RR 0.15, 95% CI 0.04 to 0.61; very low-certainty evidence; 80 participants). We downgraded the certainty of evidence for study limitations, imprecision, and indirectness as this trial was conducted in a unique group of high-risk participants with pre-existing cardiovascular morbidities. Degarelix likely results in an increase in injection site pain (RR 15.68, 95% CI 7.41 to 33.17; moderate-certainty evidence; 2670 participants). Based on 30 participants per 1000 with injection site pain with standard androgen suppression therapy, this corresponds to 440 more injection site pains per 1000 participants (192 more to 965 more). We downgraded the certainty of evidence for study limitations. We did not identify any relevant subgroup differences for different degarelix maintenance doses. AUTHORS' CONCLUSIONS: We did not find trial evidence for overall survival or cancer-specific survival comparing degarelix to standard androgen suppression, but serious adverse events and quality of life may be similar between groups. The effects of degarelix on cardiovascular events are very uncertain as the only eligible study had limitations, was small with few events, and was conducted in a high-risk population. Degarelix likely results in an increase in injection site pain compared to standard androgen suppression therapy. Maximum follow-up of included studies was 14 months, which is short. There is a need for methodologically better designed and executed studies with long-term follow-up evaluating men with metastatic prostate cancer.

Agreements between Industry and Academia on Publication Rights: A Retrospective Study of Protocols and Publications of Randomized Clinical Trials.

BACKGROUND: Little is known about publication agreements between industry and academic investigators in trial protocols and the consistency of these agreements with corresponding statements in publications. We aimed to investigate (i) the existence and types of publication agreements in trial protocols, (ii) the completeness and consistency of the reporting of these agreements in subsequent publications, and (iii) the frequency of co-authorship by industry employees. METHODS AND FINDINGS: We used a retrospective cohort of randomized clinical trials (RCTs) based on archived protocols approved by six research ethics committees between 13 January 2000 and 25 November 2003. Only RCTs with industry involvement were eligible. We investigated the documentation of publication agreements in RCT protocols and statements in corresponding journal publications. Of 647 eligible RCT protocols, 456 (70.5%) mentioned an agreement regarding publication of results. Of these 456, 393 (86.2%) documented an industry partner's right to disapprove or at least review proposed manuscripts; 39 (8.6%) agreements were without constraints of publication. The remaining 24 (5.3%) protocols referred to separate agreement documents not accessible to us. Of those 432 protocols with an accessible publication agreement, 268 (62.0%) trials were published. Most agreements documented in the protocol were not reported in the subsequent publication (197/268 [73.5%]). Of 71 agreements reported in publications, 52 (73.2%) were concordant with those documented in the protocol. In 14 of 37 (37.8%) publications in which statements suggested unrestricted publication rights, at least one co-author was an industry employee. In 25 protocol-publication pairs, author statements in publications suggested no constraints, but 18 corresponding protocols documented restricting agreements. CONCLUSIONS: Publication agreements constraining academic authors' independence are common. Journal articles seldom report on publication agreements, and, if they do, statements can be discrepant with the trial protocol.

Premature Discontinuation of Randomized Trials in Critical and Emergency Care: A Retrospective Cohort Study.

OBJECTIVES: Randomized clinical trials that enroll patients in critical or emergency care (acute care) setting are challenging because of narrow time windows for recruitment and the inability of many patients to provide informed consent. To assess the extent that recruitment challenges lead to randomized clinical trial discontinuation, we compared the discontinuation of acute care and nonacute care randomized clinical trials. DESIGN: Retrospective cohort of 894 randomized clinical trials approved by six institutional review boards in Switzerland, Germany, and Canada between 2000 and 2003. SETTING: Randomized clinical trials involving patients in an acute or nonacute care setting. SUBJECTS AND INTERVENTIONS: We recorded trial characteristics, self-reported trial discontinuation, and self-reported reasons for discontinuation from protocols, corresponding publications, institutional review board files, and a survey of investigators. MEASUREMENTS AND MAIN RESULTS: Of 894 randomized clinical trials, 64 (7%) were acute care randomized clinical trials (29 critical care and 35 emergency care). Compared with the 830 nonacute care randomized clinical trials, acute care randomized clinical trials were more frequently discontinued (28 of 64, 44% vs 221 of 830, 27%; p = 0.004). Slow recruitment was the most frequent reason for discontinuation, both in acute care (13 of 64, 20%) and in nonacute care randomized clinical trials (7 of 64, 11%). Logistic regression analyses suggested the acute care setting as an independent risk factor for randomized clinical trial discontinuation specifically as a result of slow recruitment (odds ratio, 4.00; 95% CI, 1.72-9.31) after adjusting for other established risk factors, including nonindustry sponsorship and small sample size. CONCLUSIONS: Acute care randomized clinical trials are more vulnerable to premature discontinuation than nonacute care randomized clinical trials and have an approximately four-fold higher risk of discontinuation due to slow recruitment. These results highlight the need for strategies to reliably prevent and resolve slow patient recruitment in randomized clinical trials conducted in the critical and emergency care setting.

Completion and Publication Rates of Randomized Controlled Trials in Surgery: An Empirical Study.

OBJECTIVE: To investigate the prevalence of discontinuation and nonpublication of surgical versus medical randomized controlled trials (RCTs) and to explore risk factors for discontinuation and nonpublication of surgical RCTs. BACKGROUND: Trial discontinuation has significant scientific, ethical, and economic implications. To date, the prevalence of discontinuation of surgical RCTs is unknown. METHODS: All RCT protocols approved between 2000 and 2003 by 6 ethics committees in Canada, Germany, and Switzerland were screened. Baseline characteristics were collected and, if published, full reports retrieved. Risk factors for early discontinuation for slow recruitment and nonpublication were explored using multivariable logistic regression analyses. RESULTS: In total, 863 RCT protocols involving adult patients were identified, 127 in surgery (15%) and 736 in medicine (85%). Surgical trials were discontinued for any reason more often than medical trials [43% vs 27%, risk difference 16% (95% confidence interval [CI]: 5%-26%); P = 0.001] and more often discontinued for slow recruitment [18% vs 11%, risk difference 8% (95% CI: 0.1%-16%); P = 0.020]. The percentage of trials not published as full journal article was similar in surgical and medical trials (44% vs 40%, risk difference 4% (95% CI: -5% to 14%); P = 0.373). Discontinuation of surgical trials was a strong risk factor for nonpublication (odds ratio = 4.18, 95% CI: 1.45-12.06; P = 0.008). CONCLUSIONS: Discontinuation and nonpublication rates were substantial in surgical RCTs and trial discontinuation was strongly associated with nonpublication. These findings need to be taken into account when interpreting surgical literature. Surgical trialists should consider feasibility studies before embarking on full-scale trials.

Prevalence, characteristics, and publication of discontinued randomized trials.

IMPORTANCE: The discontinuation of randomized clinical trials (RCTs) raises ethical concerns and often wastes scarce research resources. The epidemiology of discontinued RCTs, however, remains unclear. OBJECTIVES: To determine the prevalence, characteristics, and publication history of discontinued RCTs and to investigate factors associated with RCT discontinuation due to poor recruitment and with nonpublication. DESIGN AND SETTING: Retrospective cohort of RCTs based on archived protocols approved by 6 research ethics committees in Switzerland, Germany, and Canada between 2000 and 2003. We recorded trial characteristics and planned recruitment from included protocols. Last follow-up of RCTs was April 27, 2013. MAIN OUTCOMES AND MEASURES: Completion status, reported reasons for discontinuation, and publication status of RCTs as determined by correspondence with the research ethics committees, literature searches, and investigator surveys. RESULTS: After a median follow-up of 11.6 years (range, 8.8-12.6 years), 253 of 1017 included RCTs were discontinued (24.9% [95% CI, 22.3%-27.6%]). Only 96 of 253 discontinuations (37.9% [95% CI, 32.0%-44.3%]) were reported to ethics committees. The most frequent reason for discontinuation was poor recruitment (101/1017; 9.9% [95% CI, 8.2%-12.0%]). In multivariable analysis, industry sponsorship vs investigator sponsorship (8.4% vs 26.5%; odds ratio [OR], 0.25 [95% CI, 0.15-0.43]; P < .001) and a larger planned sample size in increments of 100 (-0.7%; OR, 0.96 [95% CI, 0.92-1.00]; P = .04) were associated with lower rates of discontinuation due to poor recruitment. Discontinued trials were more likely to remain unpublished than completed trials (55.1% vs 33.6%; OR, 3.19 [95% CI, 2.29-4.43]; P < .001). CONCLUSIONS AND RELEVANCE: In this sample of trials based on RCT protocols from 6 research ethics committees, discontinuation was common, with poor recruitment being the most frequently reported reason. Greater efforts are needed to ensure the reporting of trial discontinuation to research ethics committees and the publication of results of discontinued trials.

Toward a global harmonization of service infrastructure in academic clinical trial units: an international survey.

Background: Clinicians around the world perform clinical research in addition to their high workload. To meet the demands of high quality Investigator Initiated Trials (IITs), Clinical Trial Units (CTUs) (as part of Academic Research Institutions) are implemented worldwide. CTUs increasingly hold a key position in facilitating the international mutual acceptance of clinical research data by promoting clinical research practices and infrastructure according to international standards. Aim: In this project, we aimed to identify services that established and internationally operating CTUs - members of the International Clinical Trial Center Network (ICN) - consider most important to ensure the smooth processing of a clinical trial while meeting international standards. We thereby aim to drive international harmonization by providing emerging and growing CTUs with a resource for informed service range set-up. Methods: Following the AMEE Guide, we developed a questionnaire, addressing the perceived importance of different CTU services. Survey participants were senior representatives of CTUs and part of the ICN with long-term experience in their field and institution. Results: Services concerning quality and coordination of a research project were considered to be most essential, i.e., Quality management, Monitoring and Project management, followed by Regulatory & Legal affairs, Education & Training, and Data management. Operative services for conducting a research project, i.e., Study Nurse with patient contact and Study Nurse without patient contact, were considered to be least important. Conclusion: To balance the range of services offered while meeting high international standards of clinical research, emerging CTUs should focus on offering (quality) management services and expertise in regulatory and legal affairs. Additionally, education and training services are required to ensure clinicians are well trained on GCP and legislation. CTUs should evaluate whether the expertise and resources are available to offer operative services.

Learning from failure--rationale and design for a study about discontinuation of randomized trials (DISCO study).

BACKGROUND: Randomized controlled trials (RCTs) may be discontinued because of apparent harm, benefit, or futility. Other RCTs are discontinued early because of insufficient recruitment. Trial discontinuation has ethical implications, because participants consent on the premise of contributing to new medical knowledge, Research Ethics Committees (RECs) spend considerable effort reviewing study protocols, and limited resources for conducting research are wasted. Currently, little is known regarding the frequency and characteristics of discontinued RCTs. METHODS/DESIGN: Our aims are, first, to determine the prevalence of RCT discontinuation for specific reasons; second, to determine whether the risk of RCT discontinuation for specific reasons differs between investigator- and industry-initiated RCTs; third, to identify risk factors for RCT discontinuation due to insufficient recruitment; fourth, to determine at what stage RCTs are discontinued; and fifth, to examine the publication history of discontinued RCTs.We are currently assembling a multicenter cohort of RCTs based on protocols approved between 2000 and 2002/3 by 6 RECs in Switzerland, Germany, and Canada. We are extracting data on RCT characteristics and planned recruitment for all included protocols. Completion and publication status is determined using information from correspondence between investigators and RECs, publications identified through literature searches, or by contacting the investigators. We will use multivariable regression models to identify risk factors for trial discontinuation due to insufficient recruitment. We aim to include over 1000 RCTs of which an anticipated 150 will have been discontinued due to insufficient recruitment. DISCUSSION: Our study will provide insights into the prevalence and characteristics of RCTs that were discontinued. Effective recruitment strategies and the anticipation of problems are key issues in the planning and evaluation of trials by investigators, Clinical Trial Units, RECs and funding agencies. Identification and modification of barriers to successful study completion at an early stage could help to reduce the risk of trial discontinuation, save limited resources, and enable RCTs to better meet their ethical requirements.

A meta-research study of randomized controlled trials found infrequent and delayed availability of protocols.

OBJECTIVES: Availability of randomized controlled trial (RCT) protocols is essential for the interpretation of trial results and research transparency. STUDY DESIGN AND SETTING: In this study, we determined the availability of RCT protocols approved in Switzerland, Canada, Germany, and the United Kingdom in 2012. For these RCTs, we searched PubMed, Google Scholar, Scopus, and trial registries for publicly available protocols and corresponding full-text publications of results. We determined the proportion of RCTs with (1) publicly available protocols, (2) publications citing the protocol, and (3) registries providing a link to the protocol. A multivariable logistic regression model explored factors associated with protocol availability. RESULTS: Three hundred twenty-six RCTs were included, of which 118 (36.2%) made their protocol publicly available; 56 (47.6% 56 of 118) provided as a peer-reviewed publication and 48 (40.7%, 48 of 118) provided as supplementary material. A total of 90.9% (100 of 110) of the protocols were cited in the main publication, and 55.9% (66 of 118) were linked in the clinical trial registry. Larger sample size (>500; odds ratio [OR] = 5.90, 95% confidence interval [CI], 2.75-13.31) and investigator sponsorship (OR = 1.99, 95% CI, 1.11-3.59) were associated with increased protocol availability. Most protocols were made available shortly before the publication of the main results. CONCLUSION: RCT protocols should be made available at an early stage of the trial.

Reporting quality of clinical trial protocols: a repeated cross-sectional study about the Adherence to SPIrit Recommendations in Switzerland, CAnada and GErmany (ASPIRE-SCAGE).

OBJECTIVES: Comprehensive protocols are key for the planning and conduct of randomised clinical trials (RCTs). Evidence of low reporting quality of RCT protocols led to the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) checklist in 2013. We aimed to examine the quality of reporting of RCT protocols from three countries before and after the publication of the SPIRIT checklist. DESIGN: Repeated cross sectional study. SETTING: Swiss, German and Canadian research ethics committees (RECs). PARTICIPANTS: RCT protocols approved by RECs in 2012 (n=257) and 2016 (n=292). PRIMARY AND SECONDARY OUTCOME MEASURES: The primary outcomes were the proportion of reported SPIRIT items per protocol and the proportion of trial protocols reporting individual SPIRIT items. We compared these outcomes in protocols approved in 2012 and 2016, and built regression models to explore factors associated with adherence to SPIRIT. For each protocol, we also extracted information on general trial characteristics and assessed whether individual SPIRIT items were reported RESULTS: The median proportion of reported SPIRIT items among RCT protocols showed a non-significant increase from 72% (IQR, 63%-79%) in 2012 to 77% (IQR, 68%-82%) in 2016. However, in a preplanned subgroup analysis, we detected a significant improvement in investigator-sponsored protocols: the median proportion increased from 64% (IQR, 55%-72%) in 2012 to 76% (IQR, 64%-83%) in 2016, while for industry-sponsored protocols median adherence was 77% (IQR 72%-80%) for both years. The following trial characteristics were independently associated with lower adherence to SPIRIT: single-centre trial, no support from a clinical trials unit or contract research organisation, and investigator-sponsorship. CONCLUSIONS: In 2012, industry-sponsored RCT protocols were reported more comprehensively than investigator-sponsored protocols. After publication of the SPIRIT checklist, investigator-sponsored protocols improved to the level of industry-sponsored protocols, which did not improve.

Reliability of Trial Information Across Registries for Trials With Multiple Registrations: A Systematic Review.

Importance: Clinical trial registries are important for gaining an overview of ongoing research efforts and for deterring and identifying publication bias and selective outcome reporting. The reliability of the information in trial registries is uncertain. Objective: To assess the reliability of information across registries for trials with multiple registrations. Evidence Review: For this systematic review, 360 protocols of randomized clinical trials (RCTs) approved by research ethics committees in Switzerland, the UK, Canada, and Germany in 2012 were evaluated. Clinical trial registries were searched from March to September 2019 for corresponding registrations of these RCTs. For RCTS that were recorded in more than 1 clinical trial registry, key trial characteristics that should be identical among all trial registries (ie, sponsor, funding source, primary outcome, target sample size, trial status, date of first patient enrollment, results available, and main publication indexed) were extracted in duplicate. Agreement between the different trial registries for these key characteristics was analyzed descriptively. Data analyses were conducted from May 1 to November 30, 2020. Representatives from clinical trial registries were interviewed to discuss the study findings between February 1 and March 31, 2021. Findings: The analysis included 197 RCTs registered in more than 1 trial registry (151 in 2 registries and 46 in 3 registries), with 188 trials in ClinicalTrials.gov, 185 in the European Union Drug Regulating Authorities Clinical Trials Database (EudraCT), 20 in ISRCTN, and 47 in other registries. The agreement of key information across all registries was as follows: 178 of 197 RCTs (90%; 95% CI, 85%-94%) for sponsor, 18 of 20 (90%; 95% CI, 68%-99%) for funding source (funding was not reported on ClinicalTrials.gov), 154 of 197 (78%; 95% CI, 72%-84%) for primary outcome, 90 of 197 (46%; 95% CI, 39%-53%) for trial status, 122 of 194 (63%; 95% CI, 56%-70%) for target sample size, and 43 of 57 (75%; 95% CI, 62%-86%) for the date of first patient enrollment when the comparison time was increased to 30 days (date of first patient enrollment was not reported on EudraCT). For results availability in trial registries, agreement was 122 of 197 RCTs (62%; 95% CI, 55%-69%) for summary data reported in the registry and 91 of 197 (46%; 95% CI, 39%-53%) for whether a published article with the main results was indexed. Different legal requirements were stated as the main reason for inconsistencies by representatives of clinical trial registries. Conclusions and Relevance: In this systematic review, for a substantial proportion of registered RCTs, information about key trial characteristics was inconsistent across trial registries, raising concerns about the reliability of the information provided in these registries. Further harmonization across clinical trial registries may be necessary to increase their usefulness.

Reporting quality of trial protocols improved for non-regulated interventions but not regulated interventions: A repeated cross-sectional study.

OBJECTIVES: To investigate the adherence of randomised controlled trial (RCT) protocols evaluating non-regulated interventions (including dietary interventions, surgical procedures, behavioural and lifestyle interventions, and exercise programmes) in comparison with regulated interventions to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 Statement. METHODS: We conducted a repeated cross-sectional investigation in a random sample of RCT protocols approved in 2012 (n = 257) or 2016 (n = 292) by research ethics committees in Switzerland, Germany, or Canada. We investigated the proportion of accurately reported SPIRIT checklist items in protocols of trials with non-regulated as compared to regulated interventions. RESULTS: Overall, 131 (24%) of trial protocols tested non-regulated interventions. In 2012, the median proportion of SPIRIT items reported in these protocols (59%, interquartile range [IQR], 53%-69%) was lower than in protocols with regulated interventions (median, 74%, IQR, 66%-80%). In 2016, the reporting quality of protocols with non-regulated interventions (median, 75%, IQR, 62%-83%) improved to the level of regulated intervention protocols, which had not changed on average. CONCLUSIONS: Reporting of RCT protocols evaluating non-regulated interventions improved between 2012 and 2016, although remained suboptimal. SPIRIT recommendations need to be further endorsed by researchers, ethics committees, funding agencies, and journals to optimize reporting of RCT protocols.

A multi-state model analysis of the time from ethical approval to publication of clinical research studies.

BACKGROUND: Results of medical research should be made publicly available in a timely manner to enable patients and health professionals to make informed decisions about health issues. We aimed to apply a multi-state model to analyze the overall time needed to publish study results, and to examine predictors of the timing of transitions within the research process from study initiation through completion/discontinuation to eventual publication. METHODS: Using a newly developed multi-state model approach, we analysed the effect of different study-related factors on each of the transitions from study approval to eventual publication, using a data set of clinical studies approved by a German research ethics committee between 2000 and 2002. RESULTS: Of 917 approved studies, 806 were included in our analyses. About half of the clinical studies which began were subsequently published as full articles, and the median time from study approval to publication was 10 years. Differences across model states were apparent; several factors were predictive of the transition from study approval to completion, while funding source and collaboration were predictive of the transition from completion to publication. CONCLUSIONS: The proposed multi-state model approach permits a more comprehensive analysis of time to publication than a simple examination of the transition from approval to publication, and thus the findings represent an advance on previous studies of this aspect of the research process.

Rationale and design of repeated cross-sectional studies to evaluate the reporting quality of trial protocols: the Adherence to SPIrit REcommendations (ASPIRE) study and associated projects.

BACKGROUND: Clearly structured and comprehensive protocols are an essential component to ensure safety of participants, data validity, successful conduct, and credibility of results of randomized clinical trials (RCTs). Funding agencies, research ethics committees (RECs), regulatory agencies, medical journals, systematic reviewers, and other stakeholders rely on protocols to appraise the conduct and reporting of RCTs. In response to evidence of poor protocol quality, the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline was published in 2013 to improve the accuracy and completeness of clinical trial protocols. The impact of these recommendations on protocol completeness and associations between protocol completeness and successful RCT conduct and publication remain uncertain. OBJECTIVES AND METHODS: Aims of the Adherence to SPIrit REcommendations (ASPIRE) study are to investigate adherence to SPIRIT checklist items of RCT protocols approved by RECs in the UK, Switzerland, Germany, and Canada before (2012) and after (2016) the publication of the SPIRIT guidelines; determine protocol features associated with non-adherence to SPIRIT checklist items; and assess potential differences in adherence across countries. We assembled an international cohort of RCTs based on 450 protocols approved in 2012 and 402 protocols approved in 2016 by RECs in Switzerland, the UK, Germany, and Canada. We will extract data on RCT characteristics and adherence to SPIRIT for all included protocols. We will use multivariable regression models to investigate temporal changes in SPIRIT adherence, differences across countries, and associations between SPIRIT adherence of protocols with RCT registration, completion, and publication of results. We plan substudies to examine the registration, premature discontinuation, and non-publication of RCTs; the use of patient-reported outcomes in RCT protocols; SPIRIT adherence of RCT protocols with non-regulated interventions; the planning of RCT subgroup analyses; and the use of routinely collected data for RCTs. DISCUSSION: The ASPIRE study and associated substudies will provide important information on the impact of measures to improve the reporting of RCT protocols and on multiple aspects of RCT design, trial registration, premature discontinuation, and non-publication of RCTs observing potential changes over time.

Evidence of effectiveness of herbal medicinal products in the treatment of arthritis. Part 2: Rheumatoid arthritis.

Herbal medicinal products (HMPs) that interact with the mediators of inflammation are used in the treatment of rheumatoid arthritis (RA). The aim of this study was to update a previous systematic review published in 2000. We searched electronic databases (MEDLINE, EMBASE, CISCOM, AMED, CINAHL, Cochrane registers) to June 2007, unrestricted by date or language, and included randomized controlled trials that compared HMPs with inert (placebo) or active controls in patients with rheumatoid arthritis. Five reviewers contributed to data extraction. Disagreements were discussed and resolved by consensus with reference to Cochrane guidelines and advice from the Cochrane Collaboration. Twenty studies (10 identified for this review update, and 10 of the 11 studies of the original review) investigating 14 HMPs were included. Meta-analysis was restricted to data from previous seven studies with oils from borage, blackcurrant and evening primrose containing gamma linolenic acid (GLA). GLA doses equal or higher than 1400 mg/day showed benefit in the alleviation of rheumatic complaints whereas lower doses ( approximately 500 mg) were ineffective. Three studies compared products from Tripterygium wilfordii (thunder god vine) to placebos and returned favorable results but data could not be pooled because the interventions and measures differed. Serious adverse effects occurred in one study. In a follow-up study all side effects were mild to moderate and resolved after the intervention ceased, but time to resolution was variable. Two studies comparing Phytodolor NR to placebo were of limited use because some measures were poorly defined. The remaining studies, each considering differing HMPs, were assessed individually. For most HMPs used in the treatment of RA, the evidence of effectiveness was insufficient to either recommend or discourage their use. Interventions with HMPs containing GLA or Tripterygium wilfordii extract appear to produce therapeutic effects but further investigations are warranted to prove their effectiveness and safety.

Evidence of effectiveness of herbal medicinal products in the treatment of arthritis. Part I: Osteoarthritis.

Herbal medicinal products (HMPs) are used in a variety of oral and topical forms for the treatment of osteoarthritis. The aim of this study was to update a previous systematic review published in 2000. We searched electronic databases (MEDLINE, EMBASE, CISCOM, AMED, CINAHL, Cochrane registers) to June 2007, unrestricted by date or language, and included randomized controlled trials that compared HMPs with inert (placebo) or active controls in patients with osteoarthritis. Five reviewers contributed to data extraction. Disagreements were discussed and resolved by consensus with reference to Cochrane guidelines and advice from the Cochrane Collaboration.Thirty-five studies (30 studies identified for this review update, and 5 studies included in the original review) evaluating the effectiveness of 22 HMPs were included. However, due to differing HMPs, interventions, comparators, and outcome measures, meta-analysis was restricted to data from studies of three HMPs: topical capsaicin, avocado-soybean unsaponifiables, and the Chinese herbal mixture SKI306X showed benefit in the alleviation of osteoarthritic pain.Several studies investigating products from devil's claw, and a powder from rose hip and seed, reported favorable effects on osteoarthritic pain, whereas two studies of a willow bark extract returned disparate results. Three studies of Phytodolor N(R) were of limited use because doses and measures were inconsistent among trials. The remaining single studies for each HMP provided moderate evidence of effectiveness. No serious side effects were reported with any herbal intervention.Despite some evidence, the effectiveness of none of the HMPs is proven beyond doubt. The obvious potential benefits of HMPs in the treatment of osteoarthritis are reduced reliance on synthetic medications with the associated risks of harmful adverse events, but further clinical trials are necessary before HMPs can be adopted in osteoarthritis treatment guidelines.

Association between research sponsorship and study outcome in plastic surgery literature.

Financial and other competing interests have recently received increasing attention. In particular clinical research in plastic surgery attracts for-profit organizations, thus, explaining the increasing number of financial sponsorships. However, research articles often lack sufficient description of study design as well as disclosure of the source of funding. Furthermore, debate exists whether industry funding influences research findings and is leading to pro-industry results. A hand search was conducted identifying all randomized controlled (RCT) and controlled clinical trials (CCT) in 4 plastic surgery journals (Plastic and Reconstructive Surgery, British Journal of Plastic Surgery, Annals of Plastic Surgery, and Aesthetic Plastic Surgery) between 1990 and 2005. Subsequently, the influence of financial support on study outcome was analyzed. A total of 10,476 original articles were analyzed, resulting in the identification of 346 clinical trials which meet the Cochrane criteria for RCTs and CCTs. One hundred eighty-three trials and 163 studies were found to be RCTs and CCTs, respectively. Hereof, only 70 trials (20.2%) reported on grant support. Of these, 42 trials (60%) were supported by the industry. Depending on the topic addressed marked differences were detected regarding grant support. Studies with a focus on reconstructive plastic surgery were supported by the industry and by public institutions in almost equal shares (18 trials vs. 15 trials), whereas aesthetic surgical topics were predominantly funded by the industry (13 trials vs. 6 trials). Industry-funded trials reported more often statistically significant differences between treatment arms (28 trials vs. 16 trials). Authors' conclusions were found to be positively associated with financial competing interests. However, trial funding is rarely declared in the plastic surgery literature. Thus, the quality of reporting needs to be improved to be able to investigate these relationships in greater detail and draw more representative conclusions.

Evidence-based plastic surgery: controlled trials in three plastic surgical journals (1990 to 2005).

Although a myriad of original articles is published annually in plastic surgical journals assessment of the level of evidence-based medicine has rarely been conducted. A hand search was conducted identifying randomized controlled (RCTs) and controlled clinical trials in 3 plastic surgical journals from 1990 to 2005. The quality of reporting was assessed and additional parameters investigated including report of statistical significance, type of institution, and country affiliation of the first author. Nine thousand four hundred twenty-eight original articles were analyzed of which 172 and 139 articles met the inclusion criteria for RCTs and controlled clinical trials, respectively. Fifty-nine RCTs reported on successful double-blinding with only 20 RCTs reporting the allocation concealment appropriately. Description of participant drop-outs was detected in 64 RCTs and a statistically significant result was reported in 118 RCTs. The annual publication of controlled trials has increased over the last 16 years, with the majority of controlled trials being from North-America and Europe. Execution and publication of controlled trials has increased in the plastic surgical literature. However, the quality of reporting deserves improvement.

Cohort studies were found to be frequently biased by missing disease information due to death.

OBJECTIVES: In epidemiologic cohort studies with missing disease information due to death (MDID), conventional analyses right-censoring death cases at the last observation or at death may yield significant bias in relative risk and hazard ratio estimates. The aim of this study was to investigate susceptibility to this bias and assess its potential direction and magnitude. STUDY DESIGN AND SETTING: Literature review of selected epidemiologic, geriatric, and environmental journals in 2011-2012 and simulation study of various conventional approaches to handling missing disease data. A study was considered susceptible to MDID bias if disease information was collected at follow-up visits only, and a conventional analysis was performed on the data. RESULTS: Of 125 identified studies, 58 (46.4%, 95% confidence interval [CI]: 37.7-55.1%) were classified as susceptible to MDID bias, of which six (10.3%, 95% CI: 2.5-18.2%) attempted to address this in sensitivity analyses. The simulation revealed that depending on the analytic strategy for handling missing disease data, the potential exists for significant under- or over-estimation of risk factor effect estimates. CONCLUSION: Awareness of MDID bias is important as more adequate analysis methods exist permitting an unbiased analysis. Recommendations for better reporting and analysis of MDID are provided.