Study to Assess Content Validity and Interrater and Intrarater Reliability of the Inclusion Body Myositis Functional Rating Scale.

Background and Objectives: Sporadic inclusion body myositis (IBM) is a rare, muscle-wasting disease that negatively affects health-related quality of life. Although a measure that has been developed to assess the impact of IBM, the IBM Functional Rating Scale (IBMFRS) has limited evidence of content validity or reliability, and what constitutes a meaningful change threshold; this study was conducted to address these gaps. Methods: Adult patients with a clinical diagnosis of IBM from the United Kingdom and disease area expert health care professionals from the United States and United Kingdom took part in this study. This study consisted of 5 stages including phone interviews (physicians), face-to-face interviews (patients), face-to-face ratings, phone ratings, and ratings of videos using the IBMFRS. Results: The IBMFRS adequately captures all core functional impacts of IBM, which was corroborated by both patient participants and physicians when debriefing the measure. Physicians and patient participants all thought any change on the measure would be meaningful change for a patient, either improvement or worsening. The quantitative analysis demonstrated good interrater reliability for face-to-face ratings (intraclass correlation coefficient [ICC] >0.7) and for video ratings (ICC >0.9). Intrarater reliability was excellent for face-to-face and video ratings (ICC >0.9). Equivalence between the modes of administration, face-to-face vs phone, was also excellent (ICC >0.9). Discussion: The IBMFRS is content valid in assessing the key functional impacts of IBM, and any change would be meaningful. It is reliable both within and across raters, and there is equivalence between different modes of administration (face-to-face vs phone).

Impacts and Burden of Niemann pick Type-C: a patient and caregiver perspective.

BACKGROUND: Niemann-Pick disease type C (NPC) is a debilitating condition that impacts patients' and caregivers' quality of life (QOL) and reduces the patient's life expectancy. Since there is little qualitative research from the perspective of patients and family caregivers, this study explored the impact of NPC on patients' and caregivers' daily lives to understand the burden of disease. RESULTS: A survey of caregivers for patients with NPC and adult patients with NPC (n = 49; patient age: 13 months-65 years) assessed NPC severity, importance of NPC symptoms, and how symptoms impacted patients' and caregivers' activities of daily living (ADLs) and health-related QOL (HRQOL). Follow-up interviews with a subset of survey participants (n = 28) explored the ranking of NPC symptom importance and impact on ADLs and HRQOL. Findings indicated that the most important manifestations of NPC were ambulation, swallowing, speech, fine motor skills, and cognition, which were those that had the most significant impact on ADLs and HRQOL. A wide range of ADLs were affected by NPC, mainly eating/drinking and the ability to perform daily tasks, including self-care, communicating, participating in school or work, and moving indoors as well as outside the home. Along with these impacts, there was an increased risk of experiencing dangerous or life-threatening situations leading to loss of patient independence and additional caregiver burden, often requiring changes in lifestyle such as giving up work. All aspects of patients' and caregivers' HRQOL were affected. Participants reported feelings of social isolation, loss of enjoyment in activities (patients), and feelings of sadness or worry (caregivers). CONCLUSIONS: Ambulation, swallowing, speech, fine motor skills, and cognition are important manifestations of NPC. ADLs and HRQOL were impaired in the majority of patients as well as their caregivers. The findings were independent of current age, age of onset of symptoms, and level of NPC disease-related disability; however, the impact increased at higher levels of disease disability. Knowing the impact of NPC on patients and caregivers is important for understanding the lived experience of NPC and for identifying potential areas of support.

International consensus on clinical severity scale use in evaluating Niemann-Pick disease Type C in paediatric and adult patients: results from a Delphi Study.

BACKGROUND: Several scales have been developed in the past two decades to evaluate Niemann-Pick disease Type C (NPC) severity in clinical practice and trials. However, a lack of clarity concerning which scale to use in each setting is preventing the use of standardised assessments across the world, resulting in incomparable data sets and clinical trial outcome measures. This study aimed to establish agreed approaches for the use of NPC severity scales in clinical practice and research. METHODS: A Delphi method of consensus development was used, comprising three survey rounds. In Round 1, participants were asked nine multiple-choice and open-ended questions to gather opinions on the six severity scales and domains. In Rounds 2 and 3, questions aimed to gain consensus on the opinions revealed in Round 1 using a typical Likert scale. RESULTS: Nineteen experts, active in NPC paediatric and adult research and treatment, participated in this study. Of these, 16/19 completed Rounds 1 and 2 and 19/19 completed Round 3. Consensus (defined as ≥ 70% agreement or neutrality, given the study aim to identify the severity scales that the clinical community would accept for international consistency) was achieved for 66.7% of the multiple-choice questions in Round 2 and 83% of the multiple-choice questions in Round 3. Consensus was almost reached (68%) on the use of the 5-domain NPCCSS scale as the first choice in clinical practice. Consensus was reached (74%) for the 17-domain NPCCSS scale as the first choice in clinical trial settings, but the domains measured in the 5-domain scale should be prioritised as the primary endpoints. Experts called for educational and training materials on how to apply the NPCCSS (17- and 5-domains) for clinicians working in NPC. CONCLUSIONS: In achieving a consensus on the use of the 17-domain NPCCSS scale as the first choice for assessing clinical severity of NPC in clinical trial settings but prioritising the domains in the 5-domain NPCCSS scale for routine clinical practice, this study can help to inform future discussion around the use of the existing NPC clinical severity scales. For routine clinical practice, the study helps provide clarity on which scale is favoured by a significant proportion of a representative body of experts, in this case, the 5-domain NPCCSS scale.

Validation of the 5-domain Niemann-Pick type C Clinical Severity Scale.

BACKGROUND: Niemann-Pick disease type C (NPC) is an ultra-rare, progressive, genetic disease leading to impaired lysosomal function and neurodegeneration causing serious morbidity and shortened life expectancy. The Niemann-Pick type C Clinical Severity Scale (NPCCSS) is a 17 domain, disease-specific, clinician-reported outcome measure of disease severity and progression. An abbreviated 5-domain NPCCSS scale has been developed (measuring Ambulation, Swallow, Cognition, Speech, and Fine Motor Skills) and the scale reliability has been established. Additional psychometric properties and meaningful change of the scale need, however, to be assessed. METHODS: Mixed method studies were conducted to ascertain which NPCCSS domains were most important, as well as to explore meaningful change: 1) surveys in caregivers/patients (n = 49) and 2) interviews with clinicians (n = 5) as well as caregivers/patients (n = 28). Clinical trial data (n = 43) assessed construct validity and meaningful change through an anchor-based approach. RESULTS: Domains identified as most important by clinicians, caregivers, and patients (independent of current age, age of onset, and disease severity) were Ambulation, Swallow, Cognition, Speech, and Fine Motor Skills, indicating content validity of the 5-domain NPCCSS. Criterion validity was shown with the 5-domain NPCCSS being highly correlated with the 17-item NPCCSS total score (excluding hearing domains), r2 = 0.97. Convergent validity was demonstrated against the 9 Hole Peg Test, r2 = 0.65 (n = 31 patients), and the Scale for Assessment and Rating of Ataxia (SARA), r2 = 0.86 (n = 49 patients). Any change was seen as meaningful by patients/caregivers across domains. Meaningful change using trial data and interviews with NPC experts (n = 5) and patients/caregivers (n = 28) suggested that a 1-category change on a domain is equivalent to 1-point change or greater in the 5-domain NPCCSS total score. CONCLUSIONS: Qualitative and quantitative data support content and construct validity of the 5-domain NPCCSS score as a valid endpoint in NPC trials. A 1-category change on any domain is equivalent to 1-point change or greater in the 5 domain NPCCSS total score, representing a clinically meaningful transition and reflecting loss of complex function and increased disability. Trial registration NCT02612129. Registered 23 November 2015, https://clinicaltrials.gov/ct2/show/NCT02612129.

Clinical disease progression and biomarkers in Niemann-Pick disease type C: a prospective cohort study.

BACKGROUND: Niemann-Pick disease type C (NPC) is a rare, progressive, neurodegenerative disease associated with neurovisceral manifestations resulting from lysosomal dysfunction and aberrant lipid accumulation. A multicentre, prospective observational study (Clinical Trials.gov ID: NCT02435030) of individuals with genetically confirmed NPC1 or NPC2 receiving routine clinical care was conducted, to prospectively characterize and measure NPC disease progression and to investigate potential NPC-related biomarkers versus healthy individuals. Progression was measured using the abbreviated 5-domain NPC Clinical Severity Scale (NPCCSS), 17-domain NPCCSS and NPC clinical database (NPC-cdb) score. Cholesterol esterification and heat shock protein 70 (HSP70) levels were assessed from peripheral blood mononuclear cells (PBMCs), cholestane-3ß,5α-,6ß-triol (cholestane-triol) from serum, and unesterified cholesterol from both PBMCs and skin biopsy samples. The inter- and intra-rater reliability of the 5-domain NPCCSS was assessed by 13 expert clinicians' rating of four participants via video recordings, repeated after ≥ 3 weeks. Intraclass correlation coefficients (ICCs) were calculated. RESULTS: Of the 36 individuals with NPC (2-18 years) enrolled, 31 (86.1%) completed the 6-14-month observation period; 30/36 (83.3%) were receiving miglustat as part of routine clinical care. A mean (± SD) increase in 5-domain NPCCSS scores of 1.4 (± 2.9) was observed, corresponding to an annualized progression rate of 1.5. On the 17-domain NPCCSS, a mean (± SD) progression of 2.7 (± 4.0) was reported. Compared with healthy individuals, the NPC population had significantly lower levels of cholesterol esterification (p < 0.0001), HSP70 (p < 0.0001) and skin unesterified cholesterol (p = 0.0006). Cholestane-triol levels were significantly higher in individuals with NPC versus healthy individuals (p = 0.008) and correlated with the 5-domain NPCCSS (Spearman's correlation coefficient = 0.265, p = 0.0411). The 5-domain NPCCSS showed high ICC agreement in inter-rater reliability (ICC = 0.995) and intra-rater reliability (ICC = 0.937). CONCLUSIONS: Progression rates observed were consistent with other reports on disease progression in NPC. The 5-domain NPCCSS reliability study supports its use as an abbreviated alternative to the 17-domain NPCCSS that focuses on the most relevant domains of the disease. The data support the use of cholestane-triol as a disease monitoring biomarker and the novel methods of measuring unesterified cholesterol could be applicable to support NPC diagnosis. Levels of HSP70 in individuals with NPC were significantly decreased compared with healthy individuals. TRIAL REGISTRATION: CT-ORZY-NPC-001: ClincalTrials.gov NCT02435030, Registered 6 May 2015, https://clinicaltrials.gov/ct2/show/NCT02435030 ; EudraCT 2014-005,194-37, Registered 28 April 2015, https://www.clinicaltrialsregister.eu/ctr-search/trial/2014-005194-37/DE . OR-REL-NPC-01: Unregistered.