Introduction to the EQIPD quality system.

While high risk of failure is an inherent part of developing innovative therapies, it can be reduced by adherence to evidence-based rigorous research practices. Supported through the European Union's Innovative Medicines Initiative, the EQIPD consortium has developed a novel preclinical research quality system that can be applied in both public and private sectors and is free for anyone to use. The EQIPD Quality System was designed to be suited to boost innovation by ensuring the generation of robust and reliable preclinical data while being lean, effective and not becoming a burden that could negatively impact the freedom to explore scientific questions. EQIPD defines research quality as the extent to which research data are fit for their intended use. Fitness, in this context, is defined by the stakeholders, who are the scientists directly involved in the research, but also their funders, sponsors, publishers, research tool manufacturers, and collaboration partners such as peers in a multi-site research project. The essence of the EQIPD Quality System is the set of 18 core requirements that can be addressed flexibly, according to user-specific needs and following a user-defined trajectory. The EQIPD Quality System proposes guidance on expectations for quality-related measures, defines criteria for adequate processes (i.e. performance standards) and provides examples of how such measures can be developed and implemented. However, it does not prescribe any pre-determined solutions. EQIPD has also developed tools (for optional use) to support users in implementing the system and assessment services for those research units that successfully implement the quality system and seek formal accreditation. Building upon the feedback from users and continuous improvement, a sustainable EQIPD Quality System will ultimately serve the entire community of scientists conducting non-regulated preclinical research, by helping them generate reliable data that are fit for their intended use.

NXY-059, a Failed Stroke Neuroprotectant, Offers No Protection to Stem Cell-Derived Human Neurons.

BACKGROUND: Developing new medicines is a complex process where understanding the reasons for both failure and success takes us forward. One gap in our understanding of most candidate stroke drugs before clinical trial is whether they have a protective effect on human tissues. NXY-059 is a spin-trap reagent hypothesized to have activity against the damaging oxidative biology which accompanies ischemic stroke. Re-examination of the preclinical in vivo dataset for this agent in the wake of the failed SAINT-II RCT highlighted the presence of a range of biases leading to overestimation of the magnitude of NXY-059's effects in laboratory animals. Therefore, NXY-059 seemed an ideal candidate to evaluate in human neural tissues to determine whether human tissue testing might improve screening efficiency. MATERIALS AND METHODS: The aim of this randomized and blinded study was to assess the effects of NXY-059 on human stem cell-derived neurons in the presence of ischemia-like injury induced by oxygen glucose deprivation or oxidative stress induced by hydrogen peroxide or sodium nitroprusside. RESULTS: In MTT assays of cell survival, lactate dehydrogenase assays of total cell death and terminal deoxynucleotidyl transferase dUTP nick end labeling staining of apoptotic-like cell death, NXY-059 at concentrations ranging from 1 µm to 1 mm was completely without activity. Conversely an antioxidant cocktail comprising 100 µm each of ascorbate, reduced glutathione, and dithiothreitol used as a positive control provided marked neuronal protection in these assays. CONCLUSION: These findings support our hypothesis that stroke drug screening in human neural tissues will be of value and provides an explanation for the failure of NXY-059 as a human stroke drug.

Interventions for post-stroke fatigue.

BACKGROUND: Post-stroke fatigue (PSF) is a common and distressing problem after stroke. The best ways to prevent or treat PSF are uncertain. Several different interventions can be argued to have a rational basis. OBJECTIVES: To determine whether, among people with stroke, any intervention reduces the proportion of people with fatigue, fatigue severity, or both; and to determine the effect of intervention on health-related quality of life, disability, dependency and death, and whether such intervention is cost effective. SEARCH METHODS: We searched the Cochrane Stroke Group Trials Register (last searched May 2014), Cochrane Central Register of Controlled Trials (The Cochrane Library, 2014, Issue 4), MEDLINE (1950 to May 2014), EMBASE (1980 to May 2014), CINAHL (1982 to May 2014), AMED (1985 to May 2014), PsycINFO (1967 to May 2014), Digital Dissertations (1861 to May 2014), British Nursing Index (1985 to May 2014), PEDro (searched May 2014) and PsycBITE (searched May 2014). We also searched four ongoing trials registries, scanned reference lists, performed citation tracking of included trials and contacted experts. SELECTION CRITERIA: Two review authors independently scrutinised all titles and abstracts and excluded obviously irrelevant studies. We obtained the full texts for potentially relevant studies and three review authors independently applied the inclusion criteria. We included randomised controlled trials (RCTs) that compared an intervention with a control, or compared different interventions for PSF. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data and assessed risk of bias for each included trial. The primary outcomes were severity of fatigue, or proportion of people with fatigue after treatment. We performed separate analyses for trials investigating efficacy in treating PSF, trials investigating efficacy in preventing PSF and trials not primarily investigating efficacy in PSF but which reported fatigue as an outcome. We pooled results from trials that had a control arm. For trials that compared different potentially active interventions without a control arm, we performed analyses for individual trials without pooling.We calculated standardised mean difference (SMD) as the effect size for continuous outcomes and risk ratio (RR) for dichotomous outcomes. We pooled the results using a random-effects model and assessed heterogeneity using the I(2) statistic. We performed separate subgroup analyses for pharmacological and non-pharmacological interventions. We also performed sensitivity analyses to assess the influence of methodological quality. MAIN RESULTS: We retrieved 12,490 citations, obtained full texts for 58 studies and included 12 trials (three from the 2008 search and nine from the 2014 search) with 703 participants. Eight trials primarily investigated the efficacy in treating PSF, of which six trials with seven comparisons provided data suitable for meta-analysis (five pharmacological interventions: fluoxetine, enerion, (-)-OSU6162, citicoline and a combination of Chinese herbs; and two non-pharmacological interventions: a fatigue education programme and a mindfulness-based stress reduction programme). The fatigue severity was lower in the intervention groups than in the control groups (244 participants, pooled SMD -1.07, 95% confidence interval (CI) -1.93 to -0.21), with significant heterogeneity between trials (I(2) = 87%, degrees of freedom (df) = 6, P value < 0.00001). The beneficial effect was not seen in trials that had used adequate allocation concealment (two trials, 89 participants, SMD -0.38, 95% CI -0.80 to 0.04) or trials that had used adequate blinding of outcome assessors (four trials, 198 participants, SMD -1.10, 95% CI -2.31 to 0.11).No trial primarily investigated the efficacy in preventing PSF.Four trials (248 participants) did not primarily investigate the efficacy on fatigue but other symptoms after stroke. None of these interventions showed any benefit on reducing PSF, which included tirilazad mesylate, continuous positive airway pressure for sleep apnoea, antidepressants and a self management programme for recovery from chronic diseases. AUTHORS' CONCLUSIONS: There was insufficient evidence on the efficacy of any intervention to treat or prevent fatigue after stroke. Trials to date have been small and heterogeneous, and some have had a high risk of bias. Some of the interventions described were feasible in people with stroke, but their efficacy should be investigated in RCTs with a more robust study design and adequate sample sizes.

Effect of endothelin receptor antagonists on clinically relevant outcomes after experimental subarachnoid hemorrhage: a systematic review and meta-analysis.

In clinical trials, endothelin receptor antagonists (ETRAs) reduced vasospasm but did not improve functional outcome after subarachnoid hemorrhage (SAH). We assessed the effects of treatment with ETRAs on clinically relevant outcomes in animal studies modelling SAH by performing a systematic review of the literature for controlled animal studies of ETRAs for the treatment of SAH. Primary outcomes were neurobehavioral outcomes and case fatality. Secondary outcomes were cerebral vasospasm and cerebral blood flow. Summary estimates were calculated using normalized mean difference random effects meta-analysis. We included 27 studies (55 experiments, 639 animals). Neurobehavioral scores were reported in none of the experiments, and case fatality in 8 (15%). Treatment with ETRAs was associated with a pooled odds ratio for case fatality of 0.61 (95% confidence interval (CI), 0.27 to 1.39); a 54% increase (95% CI, 39 to 69) in cerebral arterial diameter; and a 93% increase (95% CI, 58 to 129) in cerebral blood flow. We conclude that there is no evidence from animal studies that treatment with an ETRA improves clinically relevant outcomes after SAH. The reduction in cerebral vasospasm observed in animal studies is consistent with that observed in clinical trials, an effect that is not associated with better functional outcome in patients.

Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically.

The use of systematic review and meta-analysis of preclinical studies has become more common, including those of studies describing the modeling of cerebrovascular diseases. Empirical evidence suggests that too many preclinical experiments lack methodological rigor, and this leads to inflated treatment effects. The aim of this review is to describe the concepts of systematic review and meta-analysis and consider how these tools may be used to provide empirical evidence to spur the field to improve the rigor of the conduct and reporting of preclinical research akin to their use in improving the conduct and reporting of randomized controlled trials in clinical research. As with other research domains, systematic reviews are subject to bias. Therefore, we have also suggested guidance for their conduct, reporting, and critical appraisal.

Improving the efficiency of the development of drugs for stroke.

The mortality and morbidity associated with stroke makes the development of new drugs a research priority. Recent unsuccessful clinical trials have reduced enthusiasm for the development of neuroprotective drugs. Here, we use empirical evidence derived from systematic reviews of stroke drug development to identify stages of drug development which might be improved. We then propose exemplar strategies which may be helpful, along with some basic economic modelling of what the impact of such strategies might be. This suggests that relatively straightforward measures might reduce the costs of drug development by $5·8 bn or 31%.

Preclinical drug evaluation for combination therapy in acute stroke using systematic review, meta-analysis, and subsequent experimental testing.

There is some evidence that in animal models of acute ischaemic stroke, combinations of neuroprotective agents might be more efficacious than the same agents administered alone. Hence, we developed pragmatic, empirical criteria based on therapeutic target, cost, availability, efficacy, administration, and safety to select drugs for testing in combination in animal models of acute stroke. Magnesium sulphate, melatonin, and minocycline were chosen from a library of neuroprotective agents, and were tested in a more 'realistic' model favoured by the STAIR (Stroke Therapy Academic Industry Roundtable). Outcome was assessed with infarct volume, neurologic score, and two newly developed scales measuring general health and physiologic homeostasis. Owing to the failure to achieve neuroprotection in aged, hypertensive animals with drug delivery at 3 hours, the bar was lowered in successive experiments to determine whether neuroprotection could be achieved under conditions more conducive to recovery. Testing in younger animals showed more favourable homeostasis and general health scores than did testing in older animals, but infarct volume and neurologic scores did not differ with age, and treatment efficacy was again not shown. Testing with shorter occlusions resulted in smaller infarct volumes; nevertheless, treatment efficacy was still not observed. It was concluded that this combination, in these stroke models, was not effective.

Stroke research at a road block: the streets from adversity should be paved with meta-analysis and good laboratory practice.

In this issue, Bath et al. use state of the art meta-analytical tools to address the pressing question of why NXY-059, a compound at the time considered to fulfil all the recommendations for the evaluation of preclinical data regarding neuroprotective drugs, has failed clinically. They demonstrate quantitatively that a negative publication bias existed, that the compound was indeed neuroprotective in experimental stroke, but that bias may have resulted in an overestimation of efficacy, and that efficacy in healthy, male, adolescent animals is a poor predictor of success in clinical trial. The study contains important messages for researchers, journal editors, the pharmaceutical industry and science policy makers. Bias is both prevalent and relevant in experiments modelling human stroke. Simple measures can reduce, perhaps substantially, the impact of such bias. The decision to proceed to clinical trial should be based on a thorough and systematic review of the animal data.

Systematic review and stratified meta-analysis of the efficacy of interleukin-1 receptor antagonist in animal models of stroke.

BACKGROUND: Interleukin (IL)-1 receptor antagonist (RA) is an anti-inflammatory protein used to treat arthritis that has also been identified as a candidate stroke drug. METHODS: We conducted a systematic review and meta-analysis of reports of the efficacy of IL-1 RA in animal models of focal cerebral ischemia. RESULTS: We identified 16 published sources and one unpublished source of data. IL-1 RA reduced infarct volume by 38.2% (95% confidence interval 31.2%-45.1%). Efficacy was higher with higher doses, earlier treatment, and central administration of drug. No studies used animals with hypertension or diabetes or tested efficacy beyond 3 hours. CONCLUSIONS: The animal data supporting IL-1 RA as a candidate drug for stroke are limited, and further experiments are required before proceeding to clinical trial.

Effect of hyperthermia and anoxia on glucocorticoid and mineralocorticoid receptor expression in neonatal rat hippocampus.

Brief periods of neonatal asphyxia are frequently observed. Within the CNS, the hippocampus is known to be particularly vulnerable to the damaging effects of hypoxia/ischaemia. The hippocampus contains the highest concentration of both mineralocorticoid (MR) and glucocorticoid (GR) receptors and the balance between MR/GR activation influences cell birth and death. MR occupation appears to promote prosurvival actions, while GR overactivation favours neurodegeneration. It has been widely recognized that core body temperature is a critical determinant of the severity of hypoxic-ischemic brain injury; indeed, hyperthermia exacerbates the degree of damage. Therefore, the aim of the present investigation was to study the effect of elevated body temperature in newborn rats under control conditions or during neonatal exposure to a critical anoxia, on changes of MR and GR mRNA expression in the rat hippocampus. 2-day-old rats were exposed to anoxia in 100% nitrogen atmosphere. Rectal temperature was kept at 33 degrees C (typical for the rat neonates), or elevated to a level typical for febrile (39 degrees C) adults. Control rats were exposed to atmospheric air under the respective thermal conditions. The changes in MR and GR mRNA expression in hippocampus were examined 24h after exposure. Our data show that hyperthermia with or without added anoxia, causes induction of MR mRNA expression in neonatal rat hippocampus without any effect on GR mRNA expression. We suggest this elevation of MR plays an important role in modulating the survival of neurons in the injured hippocampus.

1,026 experimental treatments in acute stroke.

OBJECTIVE: Preclinical evaluation of neuroprotectants fostered high expectations of clinical efficacy. When not matched, the question arises whether experiments are poor indicators of clinical outcome or whether the best drugs were not taken forward to clinical trial. Therefore, we endeavored to contrast experimental efficacy and scope of testing of drugs used clinically and those tested only experimentally. METHODS: We identified neuroprotectants and reports of experimental efficacy via a systematic search. Controlled in vivo and in vitro experiments using functional or histological end points were selected for analysis. Relationships between outcome, drug mechanism, scope of testing, and clinical trial status were assessed statistically. RESULTS: There was no evidence that drugs used clinically (114 drugs) were more effective experimentally than those tested only in animal models (912 drugs), for example, improvement in focal models averaged 31.3 +/- 16.7% versus 24.4 +/- 32.9%, p > 0.05, respectively. Scope of testing using Stroke Therapy Academic Industry Roundtable (STAIR) criteria was highly variable, and no relationship was found between mechanism and efficacy. INTERPRETATION: The results question whether the most efficacious drugs are being selected for stroke clinical trials. This may partially explain the slow progress in developing treatments. Greater rigor in the conduct, reporting, and analysis of animal data will improve the transition of scientific advances from bench to bedside.