A review of clinical trial designs used to detect a disease-modifying effect of drug therapy in Alzheimer's disease and Parkinson's disease.

BACKGROUND: Disease-modification clinical trials in neurodegenerative disorders have struggled to separate symptomatic effects of putative agents from disease-modification. In response, a variety of clinical trial designs have been developed. A systematic review was undertaken to examine which trial designs have been used in Alzheimer's disease (AD) and Parkinson's disease (PD) to detect disease-modifying, as opposed to symptomatic, drug effects. In addition we aimed to identify novel clinical trial designs used in the past or planned for use in the future. We aimed to critique whether the methods used would have identified true disease-modification. METHODS: MEDLINE, Embase and CENTRAL (1980-2015) were searched to identify papers meriting review in full. ClinicalTrials.gov was searched to identify unpublished or planned randomised controlled trials (RCTs). We included RCTs in PD or AD which aimed to demonstrate the disease-modifying properties of drug therapy and differentiate that benefit from any symptomatic effect. RESULTS: 128 RCTs were finally included: 84 in AD (59 published, 25 unpublished); 44 in PD (36 published, 8 unpublished). A variety of clinical trial designs were applied including long-term follow-up, wash-in and wash-out analyses, randomised delayed-start, the use of time-to-event outcome measures and surrogate disease progression biomarkers. Deficiencies in each of these design strategies, the quantity of missing data in included RCTs and the methods used to deal with missing data, meant that none of the included studies convincingly demonstrated disease-modification. No truly novel clinical trial designs were identified. CONCLUSION: We currently believe that the best clinical trial design available to demonstrate disease-modification is a long-term follow-up study, in which an examination is made for sustained divergence in outcome measures between treatment arms over the study period.

Using 'dead or dependent' as an outcome measure in clinical trials in Parkinson's disease.

BACKGROUND: Simple, robust, sensitive and clinically meaningful outcome measures are required for neuroprotective trials in Parkinson's disease (PD). We explored the feasibility of a composite binary outcome measure, 'dead or dependent', in such trials using data from a prospective follow-up study of an incident cohort of PD patients. METHODS: Two hundred incident patients had an annual follow-up, including assessment of the Hoehn-Yahr stage (H-Y) and Schwab and England Activities of Daily Living Scale (S&E). Annual scores were converted into binary variables (H-Y <3 vs H-Y ≥3, and S&E ≥80% vs S&E <80%). A new outcome of 'dead or dependent' was also created, with dependence in activities of daily living defined as S&E <80%. Using these data, sample sizes were calculated for a hypothetical three-year randomised trial in which the trial outcome was defined by a binary clinical variable, all-cause mortality, or PD-related mortality. RESULTS: At 3 years, 18.0% of patients were dead and 38.4% were dead or dependent. At 80% power, large sample sizes were required if PD-related mortality (n=1938 per study arm) or all-cause mortality (n=734) were used as the outcome, even for large treatment effects (30% reduction in relative risk). The new outcome of 'death or dependency' required the smallest sample sizes of all the outcome measures (n=277 for 30% reduction in relative risk, 627 for a 20% reduction). CONCLUSIONS: 'Death or dependency' is a feasible and potentially useful outcome measure in PD trials of neuroprotective agents, but further work is required to validate its use and define dependency.

A systematic review of biomarkers for disease progression in Parkinson's disease.

BACKGROUND: Using surrogate biomarkers for disease progression as endpoints in neuroprotective clinical trials may help differentiate symptomatic effects of potential neuroprotective agents from true disease-modifying effects. A systematic review was undertaken to determine what biomarkers for disease progression in Parkinson's disease (PD) exist. METHODS: MEDLINE and EMBASE (1950-2010) were searched using five search strategies. Abstracts were assessed to identify papers meriting review in full. Studies of participants with idiopathic PD diagnosed by formal criteria or clearly described clinical means were included. We made no restriction on age, disease duration, drug treatment, or study design. We included studies which attempted to draw associations between any tests used to investigate disease progression and any clinical measures of disease progression. The electronic search was validated by hand-searching the two journals from which most included articles came. RESULTS: 183 studies were included: 163 (89%) cross-sectional, 20 (11%) longitudinal. The electronic search strategy had a sensitivity of 71.4% (95% CI 51.1-86.0) and a specificity of 97.1% (95% CI 96.5-97.7). In longitudinal studies median follow-up was 2.0 years (IQR 1.1-3.5). Included studies were generally poor quality--cross-sectional with small numbers of participants, applying excessive inclusion/exclusion criteria, with flawed methodologies and simplistic statistical analyses. CONCLUSION: We found insufficient evidence to recommend the use of any biomarker for disease progression in PD clinical trials, which may simply reflect the poor quality of research in this area. We therefore present a provisional 'roadmap' for conducting future disease progression biomarker studies, and recommend new quality criteria by which future studies may be judged.

Comparison of patient rated treatment response with measured improvement in Parkinson's disease.

BACKGROUND: A marked response to dopamine replacement therapy is important in supporting a diagnosis of idiopathic Parkinson's disease (PD). The aim of the study was to compare PD patients' subjective rating of improvement with measured improvement on a number of scales. METHODS: People with clinically defined PD were identified from a prospective long term follow-up study of incident parkinsonian patients. Changes in the Unified Parkinson's Disease Rating Scale (UPDRS) (activities of daily living and motor subsections), timed tests and Parkinson's Disease Questionnaire, full version, between assessments immediately before starting adequate dopamine replacement and the two subsequent follow-up assessments (mean 6 and 12 months after baseline) were calculated. These were compared with the patients' own subjective ratings of improvement (nil, slight, moderate, good, excellent). RESULTS: 133 patients were included (mean age 71 years, 56% men). Thirty-eight patients were treated with a dopamine agonist and 95 with l-dopa (median l-dopa equivalent dose 300 mg). Most patients showed improvements in their measured scores but there was no statistically significant association between these scores and the patient subjective response, except for the motor UPDRS at the first follow-up. A third of those who showed no improvement in their motor UPDRS at the first follow-up rated their improvement as moderate or better, while 29% of those whose motor UPDRS improved by over 50% said they had no or slight improvement. CONCLUSION: PD patients' subjective ratings of their degree of improvement often do not accurately reflect the degree of objective change in parkinsonian impairment or disability. Clinicians should record a simple measure of motor impairment before and after treatment to assess treatment response more accurately.

A systematic review of biomarkers for disease progression in Alzheimer's disease.

BACKGROUND: Using surrogate biomarkers for disease progression as endpoints in neuroprotective clinical trials may help differentiate symptomatic effects of potential neuroprotective agents from true slowing of the neurodegenerative process. A systematic review was undertaken to determine what biomarkers for disease progression in Alzheimer's disease exist and how well they perform. METHODS: MEDLINE and Embase (1950-2011) were searched using five search strategies. Abstracts were assessed to identify papers meriting review in full. Studies of participants with probable Alzheimer's disease diagnosed by formal criteria were included. We made no restriction on age, disease duration, or drug treatment. We only included studies with a longitudinal design, in which the putative biomarker and clinical measure were both measured at least twice, as this is the only appropriate study design to use when developing a disease progression biomarker. We included studies which attempted to draw associations between the changes over time in the biomarker used to investigate disease progression and a clinical measure of disease progression. RESULTS: Fifty-nine studies were finally included. The commonest biomarker modality examined was brain MRI (17/59, 29% of included studies). Median follow-up in included studies was only 1.0 (IQR 0.8-1.7) year and most studies only measured the putative biomarker and clinical measure twice. Included studies were generally of poor quality with small numbers of participants (median 31 (IQR 17 to 64)), applied excessively restrictive study entry criteria, had flawed methodologies and conducted overly simplistic statistical analyses without adjusting for confounding factors. CONCLUSIONS: We found insufficient evidence to recommend the use of any biomarker as an outcome measure for disease progression in Alzheimer's disease trials. However, further investigation into the efficacy of using MRI measurements of ventricular volume and whole brain volume appeared to be merited. A provisional 'roadmap' to improve the quality of future disease progression biomarker studies is presented.