A checklist for clinical trials in rare disease: obstacles and anticipatory actions-lessons learned from the FOR-DMD trial.

BACKGROUND: Trials in rare diseases have many challenges, among which are the need to set up multiple sites in different countries to achieve recruitment targets and the divergent landscape of clinical trial regulations in those countries. Over the past years, there have been initiatives to facilitate the process of international study set-up, but the fruits of these deliberations require time to be operationally in place. FOR-DMD (Finding the Optimum Steroid Regimen for Duchenne Muscular Dystrophy) is an academic-led clinical trial which aims to find the optimum steroid regimen for Duchenne muscular dystrophy, funded by the National Institutes of Health (NIH) for 5 years (July 2010 to June 2015), anticipating that all sites (40 across the USA, Canada, the UK, Germany and Italy) would be open to recruitment from July 2011. However, study start-up was significantly delayed and recruitment did not start until January 2013. METHOD: The FOR-DMD study is used as an example to identify systematic problems in the set-up of international, multi-centre clinical trials. The full timeline of the FOR-DMD study, from funding approval to site activation, was collated and reviewed. Systematic issues were identified and grouped into (1) study set-up, e.g. drug procurement; (2) country set-up, e.g. competent authority applications; and (3) site set-up, e.g. contracts, to identify the main causes of delay and suggest areas where anticipatory action could overcome these obstacles in future studies. RESULTS: Time from the first contact to site activation across countries ranged from 6 to 24 months. Reasons of delay were universal (sponsor agreement, drug procurement, budgetary constraints), country specific (complexity and diversity of regulatory processes, indemnity requirements) and site specific (contracting and approvals). The main identified obstacles included (1) issues related to drug supply, (2) NIH requirements regarding contracting with non-US sites, (3) differing regulatory requirements in the five participating countries, (4) lack of national harmonisation with contracting and the requirement to negotiate terms and contract individually with each site and (5) diversity of languages needed for study materials. Additionally, as with many academic-led studies, the FOR-DMD study did not have access to the infrastructure and expertise that a contracted research organisation could provide, organisations often employed in pharmaceutical-sponsored studies. This delay impacted recruitment, challenged the clinical relevance of the study outcomes and potentially delayed the delivery of the best treatment to patients. CONCLUSION: Based on the FOR-DMD experience, and as an interim solution, we have devised a checklist of steps to not only anticipate and minimise delays in academic international trial initiation but also identify obstacles that will require a concerted effort on the part of many stakeholders to mitigate.

Improved Diagnosis and Care for Rare Diseases through Implementation of Precision Public Health Framework.

Public health relies on technologies to produce and analyse data, as well as effectively develop and implement policies and practices. An example is the public health practice of epidemiology, which relies on computational technology to monitor the health status of populations, identify disadvantaged or at risk population groups and thereby inform health policy and priority setting. Critical to achieving health improvements for the underserved population of people living with rare diseases is early diagnosis and best care. In the rare diseases field, the vast majority of diseases are caused by destructive but previously difficult to identify protein-coding gene mutations. The reduction in cost of genetic testing and advances in the clinical use of genome sequencing, data science and imaging are converging to provide more precise understandings of the 'person-time-place' triad. That is: who is affected (people); when the disease is occurring (time); and where the disease is occurring (place). Consequently we are witnessing a paradigm shift in public health policy and practice towards 'precision public health'.Patient and stakeholder engagement has informed the need for a national public health policy framework for rare diseases. The engagement approach in different countries has produced highly comparable outcomes and objectives. Knowledge and experience sharing across the international rare diseases networks and partnerships has informed the development of the Western Australian Rare Diseases Strategic Framework 2015-2018 (RD Framework) and Australian government health briefings on the need for a National plan.The RD Framework is guiding the translation of genomic and other technologies into the Western Australian health system, leading to greater precision in diagnostic pathways and care, and is an example of how a precision public health framework can improve health outcomes for the rare diseases population.Five vignettes are used to illustrate how policy decisions provide the scaffolding for translation of new genomics knowledge, and catalyze transformative change in delivery of clinical services. The vignettes presented here are from an Australian perspective and are not intended to be comprehensive, but rather to provide insights into how a new and emerging 'precision public health' paradigm can improve the experiences of patients living with rare diseases, their caregivers and families.The conclusion is that genomic public health is informed by the individual and family needs, and the population health imperatives of an early and accurate diagnosis; which is the portal to best practice care. Knowledge sharing is critical for public health policy development and improving the lives of people living with rare diseases.

Revised Hammersmith Scale for spinal muscular atrophy: A SMA specific clinical outcome assessment tool.

Recent translational research developments in Spinal Muscular Atrophy (SMA), outcome measure design and demands from regulatory authorities require that clinical outcome assessments are 'fit for purpose'. An international collaboration (SMA REACH UK, Italian SMA Network and PNCRN USA) undertook an iterative process to address discontinuity in the recorded performance of the Hammersmith Functional Motor Scale Expanded and developed a revised functional scale using Rasch analysis, traditional psychometric techniques and the application of clinical sensibility via expert panels. Specifically, we intended to develop a psychometrically and clinically robust functional clinician rated outcome measure to assess physical abilities in weak SMA type 2 through to strong ambulant SMA type 3 patients. The final scale, the Revised Hammersmith Scale (RHS) for SMA, consisting of 36 items and two timed tests, was piloted in 138 patients with type 2 and 3 SMA in an observational cross-sectional multi-centre study across the three national networks. Rasch analysis demonstrated very good fit of all 36 items to the construct of motor performance, good reliability with a high Person Separation Index PSI 0.98, logical and hierarchical scoring in 27/36 items and excellent targeting with minimal ceiling. The RHS differentiated between clinically different groups: SMA type, World Health Organisation (WHO) categories, ambulatory status, and SMA type combined with ambulatory status (all p < 0.001). Construct and concurrent validity was also confirmed with a strong significant positive correlation with the WHO motor milestones rs = 0.860, p < 0.001. We conclude that the RHS is a psychometrically sound and versatile clinical outcome assessment to test the broad range of physical abilities of patients with type 2 and 3 SMA. Further longitudinal testing of the scale with regards change in scores over 6 and 12 months are required prior to its adoption in clinical trials.

Detecting meaningful change using the North Star Ambulatory Assessment in Duchenne muscular dystrophy.

AIM: Clinician-reported outcome instruments such as the North Star Ambulatory Assessment (NSAA) need to be able to detect clinically important change to be suitable for clinical trials. However, in Duchenne muscular dystrophy (DMD), identifying changes in function is not straightforward. In this study, we use Rasch-transformed data to examine the responsiveness and minimal important difference (MID) of the NSAA in males with DMD receiving different corticosteroid regimes. METHOD: NSAA data were examined from 198 males (mean age at assessment was 8 y 6 mo [SD 2 y 6 mo] range 4 y-18 y; 805 assessments). Responsiveness was assessed using mean score changes (using Rasch-transformed data) between adjacent pairs of age groups, pairwise squared t-values from paired samples t-tests, and an effect size calculation. The MID was assessed using the effect size calculation and 0.5 standard deviation (SD) of mean score differences. RESULTS: Our findings revealed a difference in change scores over time between the two corticosteroid regimes. Mean NSAA person estimates were higher in the daily prednisolone group. The mean MID (0.5 SD) was 8.8 and 6.9 for the daily group and intermittent group respectively. INTERPRETATION: This study, based on Rasch-transformed NSAA data, provides an initial basis for the interpretation of clinical change in DMD over time and between corticosteroid regimes. Our proposed MIDs can be mapped back to differences in specific item content across the range of the NSAA.

Quantitative muscle MRI as an assessment tool for monitoring disease progression in LGMD2I: a multicentre longitudinal study.

BACKGROUND: Outcome measures for clinical trials in neuromuscular diseases are typically based on physical assessments which are dependent on patient effort, combine the effort of different muscle groups, and may not be sensitive to progression over short trial periods in slow-progressing diseases. We hypothesised that quantitative fat imaging by MRI (Dixon technique) could provide more discriminating quantitative, patient-independent measurements of the progress of muscle fat replacement within individual muscle groups. OBJECTIVE: To determine whether quantitative fat imaging could measure disease progression in a cohort of limb-girdle muscular dystrophy 2I (LGMD2I) patients over a 12 month period. METHODS: 32 adult patients (17 male;15 female) from 4 European tertiary referral centres with the homozygous c.826C>A mutation in the fukutin-related protein gene (FKRP) completed baseline and follow up measurements 12 months later. Quantitative fat imaging was performed and muscle fat fraction change was compared with (i) muscle strength and function assessed using standardized physical tests and (ii) standard T1-weighted MRI graded on a 6 point scale. RESULTS: There was a significant increase in muscle fat fraction in 9 of the 14 muscles analyzed using the quantitative MRI technique from baseline to 12 months follow up. Changes were not seen in the conventional longitudinal physical assessments or in qualitative scoring of the T1w images. CONCLUSIONS: Quantitative muscle MRI, using the Dixon technique, could be used as an important longitudinal outcome measure to assess muscle pathology and monitor therapeutic efficacy in patients with LGMD2I.

Motor and cognitive assessment of infants and young boys with Duchenne Muscular Dystrophy: results from the Muscular Dystrophy Association DMD Clinical Research Network.

Therapeutic trials in Duchenne Muscular Dystrophy (DMD) exclude young boys because traditional outcome measures rely on cooperation. The Bayley III Scales of Infant and Toddler Development (Bayley III) have been validated in developing children and those with developmental disorders but have not been studied in DMD. Expanded Hammersmith Functional Motor Scale (HFMSE) and North Star Ambulatory Assessment (NSAA) may also be useful in this young DMD population. Clinical evaluators from the MDA-DMD Clinical Research Network were trained in these assessment tools. Infants and boys with DMD (n = 24; 1.9 ± 0.7 years) were assessed. The mean Bayley III motor composite score was low (82.8 ± 8; p ≤ .0001) (normal = 100 ± 15). Mean gross motor and fine motor function scaled scores were low (both p ≤ .0001). The mean cognitive comprehensive (p=.0002), receptive language (p ≤ .0001), and expressive language (p = .0001) were also low compared to normal children. Age was negatively associated with Bayley III gross motor (r = -0.44; p = .02) but not with fine motor, cognitive, or language scores. HFMSE (n=23) showed a mean score of 31 ± 13. NSAA (n = 18 boys; 2.2 ± 0.4 years) showed a mean score of 12 ± 5. Outcome assessments of young boys with DMD are feasible and in this multicenter study were best demonstrated using the Bayley III.

Magnetic resonance imaging in Duchenne muscular dystrophy: longitudinal assessment of natural history over 18 months.

INTRODUCTION: In Duchenne muscular dystrophy (DMD), fat replacement of muscle may be a useful endpoint in trials of therapy, although progression in different muscle groups is uneven. In this study we assessed the progression of fat replacement with T(1) -weighted imaging over 2 9-month periods. METHODS: Eight ambulant, corticosteroid-treated boys with DMD were imaged at 3 Tesla at 3 time-points (baseline and 9 and 18 months) with T(1) -weighted imaging to measure fat replacement. RESULTS: The greatest increase in fat content was measured in the biceps femoris long head, vastus lateralis, and rectus femoris, whereas the biceps femoris short head and gluteus maximus progressed more slowly. None of the lower leg muscles studied changed significantly. CONCLUSIONS: MRI can measure specific changes in fat replacement of muscle over time, demonstrating the variability in rates of natural progression between muscle groups and identifying those muscles suitable for use as biomarkers in clinical trials.

Moving towards meaningful measurement: Rasch analysis of the North Star Ambulatory Assessment in Duchenne muscular dystrophy.

AIM: Reliable measurement of disease progression and the effect of therapeutic interventions in Duchenne muscular dystrophy (DMD) require clinically meaningful and scientifically sound rating scales. Therefore, we need robust evidence to support such tools. The North Star Ambulatory Assessment (NSAA) is a promising, clinician-rated scale with potential uses spanning clinical practice and clinical trials. In this study, we used Rasch analysis to test its suitability in these roles as a measurement instrument. METHOD: NSAA data from 191 ambulant boys (mean age at assessment 7 y 8 mo, SD 2 y 4 mo; range 3 y 6 mo-15 y 5 mo) with a confirmed diagnosis of DMD were examined for psychometric properties including clinical meaning, targeting, response categories, model fit, reliability, dependency, stability, and raw to interval-level measurement. All analyses were performed using the Rasch Unidimensional Measurement Model. RESULTS: Overall, Rasch analysis supported the NSAA as being a reliable (high Person Separation Index of 0.91) and valid (good targeting, little misfit, no reversed thresholds) measure of ambulatory function in DMD. One item displayed misfit (lifts head, fit residual 6.9) and there was evidence for some local dependency (stand on right/left leg, climb and descend box step right/left leg, and hop on right/left leg, residual correlations >0.40), which we provide potential solutions for in future use of the NSAA. Importantly, our findings supported good clinical validity in that the hierarchy of items within the scale produced by the analyses was supported by clinical opinion, thus increasing the clinical interpretability of scale scores. INTERPRETATION: In general, Rasch analysis supported the NSAA as a psychometrically robust scale for use in DMD clinical research and trials. This study also demonstrates how Rasch analysis is a useful instrument to detect and understand the key measurement issues of rating scales.

Survey of behaviour problems in children with neuromuscular diseases.

Previous research on clinic samples has suggested that children with neuromuscular diseases may be affected by mental health problems. The aim of this study was to establish the carer-reported prevalence of social, communication, and behavioural problems in middle childhood in a total population with neuromuscular diseases. From a target population of 111, 82 carers of children aged 5-13 years with a diagnosed neuromuscular disease living in the Northern Region of UK were interviewed about service utilisation and needs, and 66 completed the Strengths and Difficulties Questionnaire, Social Communication Questionnaire and Children's Communication Checklist. Two-fifths of children scored above the clinical cut-off on at least one questionnaire. These results were significantly higher than are reported for national and normally developing samples. Nine out of 82 had a diagnosis of autism spectrum disorder. Carers of children with problems reported significantly higher levels of unmet need. Behaviour, social and communication problems are common in children with neuromuscular diseases and Regional Neuromuscular Clinics should consider mental health screening and assessment.