RESUMEN
There is an ongoing debate about the value of animal experiments to inform medical practice, yet there are limited data on how well therapies developed in animal studies translate to humans. We aimed to assess 2 measures of translation across various biomedical fields: (1) The proportion of therapies which transition from animal studies to human application, including involved timeframes; and (2) the consistency between animal and human study results. Thus, we conducted an umbrella review, including English systematic reviews that evaluated the translation of therapies from animals to humans. Medline, Embase, and Web of Science Core Collection were searched from inception until August 1, 2023. We assessed the proportion of therapeutic interventions advancing to any human study, a randomized controlled trial (RCT), and regulatory approval. We meta-analyzed the concordance between animal and human studies. The risk of bias was probed using a 10-item checklist for systematic reviews. We included 122 articles, describing 54 distinct human diseases and 367 therapeutic interventions. Neurological diseases were the focus of 32% of reviews. The overall proportion of therapies progressing from animal studies was 50% to human studies, 40% to RCTs, and 5% to regulatory approval. Notably, our meta-analysis showed an 86% concordance between positive results in animal and clinical studies. The median transition times from animal studies were 5, 7, and 10 years to reach any human study, an RCT, and regulatory approval, respectively. We conclude that, contrary to widespread assertions, the rate of successful animal-to-human translation may be higher than previously reported. Nonetheless, the low rate of final approval indicates potential deficiencies in the design of both animal studies and early clinical trials. To ameliorate the efficacy of translating therapies from bench to bedside, we advocate for enhanced study design robustness and the reinforcement of generalizability.
Asunto(s)
Investigación Biomédica Traslacional , Humanos , Animales , Investigación Biomédica Traslacional/métodos , Ensayos Clínicos Controlados Aleatorios como Asunto , Experimentación AnimalRESUMEN
The replicability of research results has been a cause of increasing concern to the scientific community. The long-held belief that experimental standardization begets replicability has also been recently challenged, with the observation that the reduction of variability within studies can lead to idiosyncratic, lab-specific results that cannot be replicated. An alternative approach is to, instead, deliberately introduce heterogeneity, known as "heterogenization" of experimental design. Here, we explore a novel perspective in the heterogenization program in a meta-analysis of variability in observed phenotypic outcomes in both control and experimental animal models of ischemic stroke. First, by quantifying interindividual variability across control groups, we illustrate that the amount of heterogeneity in disease state (infarct volume) differs according to methodological approach, for example, in disease induction methods and disease models. We argue that such methods may improve replicability by creating diverse and representative distribution of baseline disease state in the reference group, against which treatment efficacy is assessed. Second, we illustrate how meta-analysis can be used to simultaneously assess efficacy and stability (i.e., mean effect and among-individual variability). We identify treatments that have efficacy and are generalizable to the population level (i.e., low interindividual variability), as well as those where there is high interindividual variability in response; for these, latter treatments translation to a clinical setting may require nuance. We argue that by embracing rather than seeking to minimize variability in phenotypic outcomes, we can motivate the shift toward heterogenization and improve both the replicability and generalizability of preclinical research.
Asunto(s)
Experimentación Animal/normas , Proyectos de Investigación/normas , Animales , Conducta Animal/fisiología , Isquemia Encefálica/metabolismo , Humanos , Metaanálisis como Asunto , Modelos Animales , Fenotipo , Estándares de Referencia , Reproducibilidad de los Resultados , Proyectos de Investigación/tendencias , Accidente Cerebrovascular/fisiopatologíaRESUMEN
Any given research claim can be made with a degree of confidence that a phenomenon is present, with an estimate of the precision of the observed effects and a prediction of the extent to which the findings might hold true under different experimental or real-world conditions. In some situations, the certainty and precision obtained from a single study are sufficient reliably to inform future research decisions. However, in other situations greater certainty is required. This might be the case where a substantial research investment is planned, a pivotal claim is to be made or the launch of a clinical trial programme is being considered. Under these circumstances, some form of summary of findings across studies may be helpful.Summary estimates can describe findings from exploratory (observational) or hypothesis testing experiments, but importantly, the creation of such summaries is, in itself, observational rather than experimental research. The process is therefore particularly at risk from selective identification of literature to be included, and this can be addressed using systematic search strategies and pre-specified criteria for inclusion and exclusion against which possible contributing data will be assessed. This characterises a systematic review (in contrast to nonsystematic or narrative reviews). In meta-analysis, there is an attempt to provide a quantitative summary of such research findings.
Asunto(s)
Metadatos , HumanosRESUMEN
Olfactory ensheathing cell (OEC) transplantation is a candidate cellular treatment approach for human spinal cord injury (SCI) due to their unique regenerative potential and autologous origin. The objective of this study was, through a meta-epidemiologic approach, (i) to assess the efficacy of OEC transplantation on locomotor recovery after traumatic experimental SCI and (ii) to estimate the likelihood of reporting bias and/or missing data. A study protocol was finalized before data collection. Embedded into a systematic review and meta-analysis, we conducted a literature research of databases including PubMed, EMBASE, and ISI Web of Science from 1949/01 to 2014/10 with no language restrictions, screened by two independent investigators. Studies were included if they assessed neurobehavioral improvement after traumatic experimental SCI, administrated no combined interventions, and reported the number of animals in the treatment and control group. Individual effect sizes were pooled using a random effects model. Details regarding the study design were extracted and impact of these on locomotor outcome was assessed by meta-regression. Missing data (reporting bias) was determined by Egger regression and Funnel-plotting. The primary study outcome assessed was improvement in locomotor function at the final time point of measurement. We included 49 studies (62 experiments, 1,164 animals) in the final analysis. The overall improvement in locomotor function after OEC transplantation, measured using the Basso, Beattie, and Bresnahan (BBB) score, was 20.3% (95% CI 17.8-29.5). One missing study was imputed by trim and fill analysis, suggesting only slight publication bias and reducing the overall effect to a 19.2% improvement of locomotor activity. Dose-response ratio supports neurobiological plausibility. Studies were assessed using a 9-point item quality score, resulting in a median score of 5 (interquartile range [IQR] 3-5). In conclusion, OEC transplantation exerts considerable beneficial effects on neurobehavioral recovery after traumatic experimental SCI. Publication bias was minimal and affirms the translational potential of efficacy, but safety cannot be adequately assessed. The data justify OECs as a cellular substrate to develop and optimize minimally invasive and safe cellular transplantation paradigms for the lesioned spinal cord embedded into state-of-the-art Phase I/II clinical trial design studies for human SCI.
Asunto(s)
Trasplante de Células/métodos , Bulbo Olfatorio/citología , Traumatismos de la Médula Espinal/terapia , Animales , Trasplante de Células/efectos adversos , Modelos Animales de Enfermedad , Bulbo Olfatorio/trasplante , Sesgo de Publicación , Resultado del TratamientoRESUMEN
Cerebral small vessel disease (SVD) is a major contributor to stroke, cognitive impairment and dementia with limited therapeutic interventions. There is a critical need to provide mechanistic insight and improve translation between pre-clinical research and the clinic. A 2-day workshop was held which brought together experts from several disciplines in cerebrovascular disease, dementia and cardiovascular biology, to highlight current advances in these fields, explore synergies and scope for development. These proceedings provide a summary of key talks at the workshop with a particular focus on animal models of cerebral vascular disease and dementia, mechanisms and approaches to improve translation. The outcomes of discussion groups on related themes to identify the gaps in knowledge and requirements to advance knowledge are summarized.
Asunto(s)
Enfermedades de los Pequeños Vasos Cerebrales/etiología , Investigación Biomédica Traslacional , Animales , HumanosRESUMEN
[This corrects the article DOI: 10.1371/journal.pbio.1002273.].
RESUMEN
The reliability of experimental findings depends on the rigour of experimental design. Here we show limited reporting of measures to reduce the risk of bias in a random sample of life sciences publications, significantly lower reporting of randomisation in work published in journals of high impact, and very limited reporting of measures to reduce the risk of bias in publications from leading United Kingdom institutions. Ascertainment of differences between institutions might serve both as a measure of research quality and as a tool for institutional efforts to improve research quality.
Asunto(s)
Disciplinas de las Ciencias Biológicas/métodos , Investigación Biomédica/métodos , Guías como Asunto , Publicaciones Periódicas como Asunto , Animales , Disciplinas de las Ciencias Biológicas/tendencias , Investigación Biomédica/normas , Investigación Biomédica/tendencias , Exactitud de los Datos , Humanos , Factor de Impacto de la Revista , Publicaciones Periódicas como Asunto/tendencias , Sesgo de Publicación , Mejoramiento de la Calidad , Sesgo de Selección , Reino UnidoRESUMEN
RATIONALE: Cardiac stem cells (CSC) therapy has been clinically introduced for cardiac repair after myocardial infarction (MI). To date, there has been no systematic overview and meta-analysis of studies using CSC therapy for MI. OBJECTIVE: Here, we used meta-analysis to establish the overall effect of CSCs in preclinical studies and assessed translational differences between and within large and small animals in the CSC therapy field. In addition, we explored the effect of CSC type and other clinically relevant parameters on functional outcome to better predict and design future (pre)clinical studies using CSCs for MI. METHODS AND RESULTS: A systematic search was performed, yielding 80 studies. We determined the overall effect of CSC therapy on left ventricular ejection fraction and performed meta-regression to investigate clinically relevant parameters. We also assessed the quality of included studies and possible bias. The overall effect observed in CSC-treated animals was 10.7% (95% confidence interval 9.4-12.1; P<0.001) improvement in ejection fraction compared with placebo controls. Interestingly, CSC therapy had a greater effect in small animals compared with large animals (P<0.001). Meta-regression indicated that cell type was a significant predictor for ejection fraction improvement in small animals. Minor publication bias was observed in small animal studies. CONCLUSIONS: CSC treatment resulted in significant improvement of ejection fraction in preclinical animal models of MI compared with placebo. There was a reduction in the magnitude of effect in large compared with small animal models. Although different CSC types have overlapping culture characteristics, we observed a significant difference in their effect in post-MI animal studies.
Asunto(s)
Modelos Animales de Enfermedad , Infarto del Miocardio/terapia , Miocitos Cardíacos/trasplante , Trasplante de Células Madre/métodos , Animales , Infarto del Miocardio/patología , Miocitos Cardíacos/fisiología , Resultado del TratamientoAsunto(s)
Investigación Biomédica/normas , Edición/normas , Proyectos de Investigación , Informe de Investigación/normas , Animales , Ensayos Clínicos como Asunto/métodos , Ensayos Clínicos como Asunto/normas , Creatividad , Eficiencia , Humanos , Ratones , Ratas , Reproducibilidad de los ResultadosRESUMEN
The US National Institute of Neurological Disorders and Stroke convened major stakeholders in June 2012 to discuss how to improve the methodological reporting of animal studies in grant applications and publications. The main workshop recommendation is that at a minimum studies should report on sample-size estimation, whether and how animals were randomized, whether investigators were blind to the treatment, and the handling of data. We recognize that achieving a meaningful improvement in the quality of reporting will require a concerted effort by investigators, reviewers, funding agencies and journal editors. Requiring better reporting of animal studies will raise awareness of the importance of rigorous study design to accelerate scientific progress.
Asunto(s)
Edición/normas , Proyectos de Investigación/normas , Animales , Edición/tendencias , Distribución Aleatoria , Tamaño de la Muestra , Estadística como AsuntoRESUMEN
BACKGROUND: Developing new medicines is a complex process where understanding the reasons for both failure and success takes us forward. One gap in our understanding of most candidate stroke drugs before clinical trial is whether they have a protective effect on human tissues. NXY-059 is a spin-trap reagent hypothesized to have activity against the damaging oxidative biology which accompanies ischemic stroke. Re-examination of the preclinical in vivo dataset for this agent in the wake of the failed SAINT-II RCT highlighted the presence of a range of biases leading to overestimation of the magnitude of NXY-059's effects in laboratory animals. Therefore, NXY-059 seemed an ideal candidate to evaluate in human neural tissues to determine whether human tissue testing might improve screening efficiency. MATERIALS AND METHODS: The aim of this randomized and blinded study was to assess the effects of NXY-059 on human stem cell-derived neurons in the presence of ischemia-like injury induced by oxygen glucose deprivation or oxidative stress induced by hydrogen peroxide or sodium nitroprusside. RESULTS: In MTT assays of cell survival, lactate dehydrogenase assays of total cell death and terminal deoxynucleotidyl transferase dUTP nick end labeling staining of apoptotic-like cell death, NXY-059 at concentrations ranging from 1 µm to 1 mm was completely without activity. Conversely an antioxidant cocktail comprising 100 µm each of ascorbate, reduced glutathione, and dithiothreitol used as a positive control provided marked neuronal protection in these assays. CONCLUSION: These findings support our hypothesis that stroke drug screening in human neural tissues will be of value and provides an explanation for the failure of NXY-059 as a human stroke drug.
Asunto(s)
Bencenosulfonatos/farmacología , Hipoxia de la Célula/efectos de los fármacos , Glucosa/deficiencia , Neuronas/efectos de los fármacos , Fármacos Neuroprotectores/farmacología , Muerte Celular/efectos de los fármacos , Muerte Celular/fisiología , Hipoxia de la Célula/fisiología , Supervivencia Celular/efectos de los fármacos , Supervivencia Celular/fisiología , Células Cultivadas , Técnicas de Cocultivo , Relación Dosis-Respuesta a Droga , Evaluación Preclínica de Medicamentos , Células Madre Embrionarias/efectos de los fármacos , Células Madre Embrionarias/patología , Células Madre Embrionarias/fisiología , Fibroblastos/fisiología , Humanos , Peróxido de Hidrógeno/toxicidad , L-Lactato Deshidrogenasa/metabolismo , Neuronas/patología , Neuronas/fisiología , Nitroprusiato/toxicidad , Estrés Oxidativo/efectos de los fármacos , Estrés Oxidativo/fisiología , Método Simple Ciego , Insuficiencia del TratamientoRESUMEN
BACKGROUND: Findings from in vivo research may be less reliable where studies do not report measures to reduce risks of bias. The experimental stroke community has been at the forefront of implementing changes to improve reporting, but it is not known whether these efforts are associated with continuous improvements. Our aims here were firstly to validate an automated tool to assess risks of bias in published works, and secondly to assess the reporting of measures taken to reduce the risk of bias within recent literature for two experimental models of stroke. METHODS: We developed and used text analytic approaches to automatically ascertain reporting of measures to reduce risk of bias from full-text articles describing animal experiments inducing middle cerebral artery occlusion (MCAO) or modelling lacunar stroke. RESULTS: Compared with previous assessments, there were improvements in the reporting of measures taken to reduce risks of bias in the MCAO literature but not in the lacunar stroke literature. Accuracy of automated annotation of risk of bias in the MCAO literature was 86% (randomization), 94% (blinding) and 100% (sample size calculation); and in the lacunar stroke literature accuracy was 67% (randomization), 91% (blinding) and 96% (sample size calculation). DISCUSSION: There remains substantial opportunity for improvement in the reporting of animal research modelling stroke, particularly in the lacunar stroke literature. Further, automated tools perform sufficiently well to identify whether studies report blinded assessment of outcome, but improvements are required in the tools to ascertain whether randomization and a sample size calculation were reported.
Asunto(s)
Isquemia Encefálica/complicaciones , Infarto de la Arteria Cerebral Media/complicaciones , Accidente Cerebrovascular/complicaciones , Animales , Sesgo , Modelos Animales de Enfermedad , Humanos , RiesgoRESUMEN
Current antiseizure therapy is ineffective in approximately one third of people with epilepsy and is often associated with substantial side effects. In addition, most current therapeutic paradigms offer treatment, but not cure, and no therapies are able to modify the underlying disease, that is, can prevent or halt the process of epileptogenesis or alleviate the cognitive and psychiatric comorbidities. Preclinical research in the field of epilepsy has been extensive, but unfortunately, not all the animal models being used have been validated for their predictive value. The overall goal of TASK2 of the AES/ILAE Translational Task Force is to organize and coordinate systematic reviews on selected topics regarding animal research in epilepsy. Herein we describe our strategy. In the first part of the paper we provide an overview of the usefulness of systematic reviews and meta-analysis for preclinical research and explain the essentials for their conduct. Then we describe in detail the protocol for a first systematic review, which will focus on the identification and characterization of outcome measures reported in animal models of epilepsy. The specific goals of this study are to define systematically the phenotypic characteristics of the most commonly used animal models, and to effectively compare these with the manifestations of human epilepsy. This will provide epilepsy researchers with detailed information on the strengths and weaknesses of epilepsy models, facilitating their refinement and future research. Ultimately, this could lead to a refined use of relevant models for understanding the mechanism(s) of the epilepsies and developing novel therapies.
Asunto(s)
Comités Consultivos , Epilepsia/diagnóstico , Epilepsia/terapia , Evaluación de Resultado en la Atención de Salud , Investigación Biomédica Traslacional , Animales , Modelos Animales de Enfermedad , Humanos , Revisiones Sistemáticas como AsuntoRESUMEN
Spinal cord injury (SCI) is a devastating condition that causes substantial morbidity and mortality and for which no treatments are available. Stem cells offer some promise in the restoration of neurological function. We used systematic review, meta-analysis, and meta-regression to study the impact of stem cell biology and experimental design on motor and sensory outcomes following stem cell treatments in animal models of SCI. One hundred and fifty-six publications using 45 different stem cell preparations met our prespecified inclusion criteria. Only one publication used autologous stem cells. Overall, allogeneic stem cell treatment appears to improve both motor (effect size, 27.2%; 95% Confidence Interval [CI], 25.0%-29.4%; 312 comparisons in 5,628 animals) and sensory (effect size, 26.3%; 95% CI, 7.9%-44.7%; 23 comparisons in 473 animals) outcome. For sensory outcome, most heterogeneity between experiments was accounted for by facets of stem cell biology. Differentiation before implantation and intravenous route of delivery favoured better outcome. Stem cell implantation did not appear to improve sensory outcome in female animals and appeared to be enhanced by isoflurane anaesthesia. Biological plausibility was supported by the presence of a dose-response relationship. For motor outcome, facets of stem cell biology had little detectable effect. Instead most heterogeneity could be explained by the experimental modelling and the outcome measure used. The location of injury, method of injury induction, and presence of immunosuppression all had an impact. Reporting of measures to reduce bias was higher than has been seen in other neuroscience domains but were still suboptimal. Motor outcomes studies that did not report the blinded assessment of outcome gave inflated estimates of efficacy. Extensive recent preclinical literature suggests that stem-cell-based therapies may offer promise, however the impact of compromised internal validity and publication bias mean that efficacy is likely to be somewhat lower than reported here.
Asunto(s)
Traumatismos de la Médula Espinal/cirugía , Trasplante de Células Madre , Animales , Modelos Animales de Enfermedad , Resultado del TratamientoRESUMEN
Animal studies generate valuable hypotheses that lead to the conduct of preventive or therapeutic clinical trials. We assessed whether there is evidence for excess statistical significance in results of animal studies on neurological disorders, suggesting biases. We used data from meta-analyses of interventions deposited in Collaborative Approach to Meta-Analysis and Review of Animal Data in Experimental Studies (CAMARADES). The number of observed studies with statistically significant results (O) was compared with the expected number (E), based on the statistical power of each study under different assumptions for the plausible effect size. We assessed 4,445 datasets synthesized in 160 meta-analyses on Alzheimer disease (nâ=â2), experimental autoimmune encephalomyelitis (nâ=â34), focal ischemia (nâ=â16), intracerebral hemorrhage (nâ=â61), Parkinson disease (nâ=â45), and spinal cord injury (nâ=â2). 112 meta-analyses (70%) found nominally (p≤0.05) statistically significant summary fixed effects. Assuming the effect size in the most precise study to be a plausible effect, 919 out of 4,445 nominally significant results were expected versus 1,719 observed (p<10â»9). Excess significance was present across all neurological disorders, in all subgroups defined by methodological characteristics, and also according to alternative plausible effects. Asymmetry tests also showed evidence of small-study effects in 74 (46%) meta-analyses. Significantly effective interventions with more than 500 animals, and no hints of bias were seen in eight (5%) meta-analyses. Overall, there are too many animal studies with statistically significant results in the literature of neurological disorders. This observation suggests strong biases, with selective analysis and outcome reporting biases being plausible explanations, and provides novel evidence on how these biases might influence the whole research domain of neurological animal literature.
Asunto(s)
Sesgo , Enfermedades del Sistema Nervioso , Animales , Modelos Animales de Enfermedad , Proyectos de Investigación/normasRESUMEN
BACKGROUND: The issue of endocrine disrupting chemicals (EDCs) is receiving wide attention from both the scientific and regulatory communities. Recent analyses of the EDC literature have been criticized for failing to use transparent and objective approaches to draw conclusions about the strength of evidence linking EDC exposures to adverse health or environmental outcomes. Systematic review methodologies are ideal for addressing this issue as they provide transparent and consistent approaches to study selection and evaluation. Objective methods are needed for integrating the multiple streams of evidence (epidemiology, wildlife, laboratory animal, in vitro, and in silico data) that are relevant in assessing EDCs. METHODS: We have developed a framework for the systematic review and integrated assessment (SYRINA) of EDC studies. The framework was designed for use with the International Program on Chemical Safety (IPCS) and World Health Organization (WHO) definition of an EDC, which requires appraisal of evidence regarding 1) association between exposure and an adverse effect, 2) association between exposure and endocrine disrupting activity, and 3) a plausible link between the adverse effect and the endocrine disrupting activity. RESULTS: Building from existing methodologies for evaluating and synthesizing evidence, the SYRINA framework includes seven steps: 1) Formulate the problem; 2) Develop the review protocol; 3) Identify relevant evidence; 4) Evaluate evidence from individual studies; 5) Summarize and evaluate each stream of evidence; 6) Integrate evidence across all streams; 7) Draw conclusions, make recommendations, and evaluate uncertainties. The proposed method is tailored to the IPCS/WHO definition of an EDC but offers flexibility for use in the context of other definitions of EDCs. CONCLUSIONS: When using the SYRINA framework, the overall objective is to provide the evidence base needed to support decision making, including any action to avoid/minimise potential adverse effects of exposures. This framework allows for the evaluation and synthesis of evidence from multiple evidence streams. Finally, a decision regarding regulatory action is not only dependent on the strength of evidence, but also the consequences of action/inaction, e.g. limited or weak evidence may be sufficient to justify action if consequences are serious or irreversible.
Asunto(s)
Disruptores Endocrinos/toxicidad , Contaminantes Ambientales/toxicidad , Medición de Riesgo/métodos , Animales , Exposición a Riesgos Ambientales , Humanos , Modelos Teóricos , Pruebas de ToxicidadRESUMEN
BACKGROUND AND PURPOSE: Because the new era of preclinical stroke research demands improvements in validity and generalizability of findings, moving from single site to multicenter studies could be pivotal. However, the conduct of magnetic resonance imaging (MRI) in stroke remains ill-defined. We sought to assess the variability in the use of MRI for evaluating lesions post stroke and to examine the possibility as an alternative to gold standard histology for measuring the infarct size. METHODS: We identified animal studies of ischemic stroke reporting lesion sizes using MRI. We assessed the degree of heterogeneity and reporting of scanning protocols, postprocessing methods, study design characteristics, and study quality. Studies performing histological evaluation of infarct size were further selected to compare with corresponding MRI using meta-regression. RESULTS: Fifty-four articles undertaking a total of 78 different MRI scanning protocols met the inclusion criteria. T2-weighted imaging was most frequently used (83% of the studies), followed by diffusion-weighted imaging (43%). Reporting of the imaging parameters was adequate, but heterogeneity between studies was high. Twelve studies assessed the infarct size using both MRI and histology at corresponding time points, with T2-weighted imaging-based treatment effect having a significant positive correlation with histology (; P<0.001). CONCLUSIONS: Guidelines for standardized use and reporting of MRI in preclinical stroke are urgently needed. T2-weighted imaging could be used as an effective in vivo alternative to histology for estimating treatment effects based on the extent of infarction; however, additional studies are needed to explore the effect of individual parameters.
Asunto(s)
Técnicas Histológicas , Imagen por Resonancia Magnética , Accidente Cerebrovascular/patología , Animales , Isquemia Encefálica , Diagnóstico por Imagen/métodos , Modelos Animales de Enfermedad , Humanos , Ratones , Papio , Ratas , Análisis de Regresión , Reproducibilidad de los Resultados , Proyectos de InvestigaciónRESUMEN
Correctable weaknesses in the design, conduct, and analysis of biomedical and public health research studies can produce misleading results and waste valuable resources. Small effects can be difficult to distinguish from bias introduced by study design and analyses. An absence of detailed written protocols and poor documentation of research is common. Information obtained might not be useful or important, and statistical precision or power is often too low or used in a misleading way. Insufficient consideration might be given to both previous and continuing studies. Arbitrary choice of analyses and an overemphasis on random extremes might affect the reported findings. Several problems relate to the research workforce, including failure to involve experienced statisticians and methodologists, failure to train clinical researchers and laboratory scientists in research methods and design, and the involvement of stakeholders with conflicts of interest. Inadequate emphasis is placed on recording of research decisions and on reproducibility of research. Finally, reward systems incentivise quantity more than quality, and novelty more than reliability. We propose potential solutions for these problems, including improvements in protocols and documentation, consideration of evidence from studies in progress, standardisation of research efforts, optimisation and training of an experienced and non-conflicted scientific workforce, and reconsideration of scientific reward systems.
Asunto(s)
Proyectos de Investigación/normas , Reproducibilidad de los Resultados , Investigadores/educación , Recompensa , Estadística como AsuntoRESUMEN
BACKGROUND: Post-stroke fatigue (PSF) is a common and distressing problem after stroke. The best ways to prevent or treat PSF are uncertain. Several different interventions can be argued to have a rational basis. OBJECTIVES: To determine whether, among people with stroke, any intervention reduces the proportion of people with fatigue, fatigue severity, or both; and to determine the effect of intervention on health-related quality of life, disability, dependency and death, and whether such intervention is cost effective. SEARCH METHODS: We searched the Cochrane Stroke Group Trials Register (last searched May 2014), Cochrane Central Register of Controlled Trials (The Cochrane Library, 2014, Issue 4), MEDLINE (1950 to May 2014), EMBASE (1980 to May 2014), CINAHL (1982 to May 2014), AMED (1985 to May 2014), PsycINFO (1967 to May 2014), Digital Dissertations (1861 to May 2014), British Nursing Index (1985 to May 2014), PEDro (searched May 2014) and PsycBITE (searched May 2014). We also searched four ongoing trials registries, scanned reference lists, performed citation tracking of included trials and contacted experts. SELECTION CRITERIA: Two review authors independently scrutinised all titles and abstracts and excluded obviously irrelevant studies. We obtained the full texts for potentially relevant studies and three review authors independently applied the inclusion criteria. We included randomised controlled trials (RCTs) that compared an intervention with a control, or compared different interventions for PSF. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data and assessed risk of bias for each included trial. The primary outcomes were severity of fatigue, or proportion of people with fatigue after treatment. We performed separate analyses for trials investigating efficacy in treating PSF, trials investigating efficacy in preventing PSF and trials not primarily investigating efficacy in PSF but which reported fatigue as an outcome. We pooled results from trials that had a control arm. For trials that compared different potentially active interventions without a control arm, we performed analyses for individual trials without pooling.We calculated standardised mean difference (SMD) as the effect size for continuous outcomes and risk ratio (RR) for dichotomous outcomes. We pooled the results using a random-effects model and assessed heterogeneity using the I(2) statistic. We performed separate subgroup analyses for pharmacological and non-pharmacological interventions. We also performed sensitivity analyses to assess the influence of methodological quality. MAIN RESULTS: We retrieved 12,490 citations, obtained full texts for 58 studies and included 12 trials (three from the 2008 search and nine from the 2014 search) with 703 participants. Eight trials primarily investigated the efficacy in treating PSF, of which six trials with seven comparisons provided data suitable for meta-analysis (five pharmacological interventions: fluoxetine, enerion, (-)-OSU6162, citicoline and a combination of Chinese herbs; and two non-pharmacological interventions: a fatigue education programme and a mindfulness-based stress reduction programme). The fatigue severity was lower in the intervention groups than in the control groups (244 participants, pooled SMD -1.07, 95% confidence interval (CI) -1.93 to -0.21), with significant heterogeneity between trials (I(2) = 87%, degrees of freedom (df) = 6, P value < 0.00001). The beneficial effect was not seen in trials that had used adequate allocation concealment (two trials, 89 participants, SMD -0.38, 95% CI -0.80 to 0.04) or trials that had used adequate blinding of outcome assessors (four trials, 198 participants, SMD -1.10, 95% CI -2.31 to 0.11).No trial primarily investigated the efficacy in preventing PSF.Four trials (248 participants) did not primarily investigate the efficacy on fatigue but other symptoms after stroke. None of these interventions showed any benefit on reducing PSF, which included tirilazad mesylate, continuous positive airway pressure for sleep apnoea, antidepressants and a self management programme for recovery from chronic diseases. AUTHORS' CONCLUSIONS: There was insufficient evidence on the efficacy of any intervention to treat or prevent fatigue after stroke. Trials to date have been small and heterogeneous, and some have had a high risk of bias. Some of the interventions described were feasible in people with stroke, but their efficacy should be investigated in RCTs with a more robust study design and adequate sample sizes.