Meaningful Change Thresholds and Fatigue Severity Points on Patient-Reported Outcomes by the Fatigue Symptoms and Impacts Questionnaire in Patients With Relapsing Multiple Sclerosis.

OBJECTIVES: The Fatigue Symptoms and Impacts Questionnaire-Relapsing Multiple Sclerosis (FSIQ-RMS) is a new content-valid, concise, and reliable 20-item patient-reported outcome measure to evaluate the symptoms and impacts of fatigue in patients with relapsing forms of multiple sclerosis. Analyses were performed to derive meaningful change thresholds (MCTs) on patient-reported outcomes as measured by FSIQ-RMS and generate receiver operating characteristic (ROC) curves to determine fatigue severity cut points at baseline and change in severity at post-baseline and supplement the anchor-based MCT results. METHODS: Analyses were based on data from the OPTIMUM trial (NCT02425644). An anchor-based approach using uncollapsed changes on the Patient Global Impression of Severity at week 108 were used to determine the MCT for only the FSIQ-RMS Symptoms domain; distribution-based MCT estimations were conducted using baseline FSIQ-RMS Impacts scores. ROC curves with calculation of area under the curve were used to identify the best cut point. RESULTS: Based on the evidence provided by the anchor-based analyses using the Patient Global Impression of Severity as an anchor for the FSIQ-RMS Symptoms domain, meaningful score changes for improvement and deterioration were -6.3 and 6.3, respectively. Meaningful score changes for the FSIQ-RMS Physical, Cognitive/Emotional, and Coping Impacts domains using distribution-based methods were 10.8, 8.4, and 9.8, respectively. These results are supported by the ROC analyses. CONCLUSIONS: Thresholds to support interpretation of the FSIQ-RMS, such as MCTs, can be used to determine and categorize patients who have experienced a meaningful change in their MS-related fatigue (eg, responder analyses) in future clinical research studies.

Meaningful Symptomatic Change in Patients With Myelofibrosis From the SIMPLIFY Studies.

OBJECTIVES: Patients with myelofibrosis develop symptoms due to bone marrow fibrosis, systemic inflammation, and/or organomegaly. Alleviating symptoms improves overall quality of life. Clinical trials have historically defined symptom response as a reduction of at least 50% in Total Symptom Score at week 24 compared with baseline. Whether 50% constitutes a meaningful benefit has not been established. This study determined the meaningful change threshold (MCT) for 2 momelotinib phase III trials, SIMPLIFY-1 and SIMPLIFY-2. METHODS: The absolute and percentage MCT was determined using anchor-based methods applied to the modified Myeloproliferative Neoplasm Symptom Assessment Form v2.0 and Patient Global Impression of Change. MCTs were applied retrospectively to determine responder rates. Generalized estimating equations estimated the treatment-related difference in likelihood of improvement. RESULTS: In SIMPLIFY-1, a Janus kinase inhibitor-naive population, the MCT was 8 points. In SIMPLIFY-2, a previously Janus kinase inhibitor-treated population, the MCT was 6 points. A 32% MCT was determined in both studies, showing that the historic 50% reduction threshold may be a conservative choice. In SIMPLIFY-1, a similar proportion of patients achieved responder status with 24 weeks of momelotinib or ruxolitinib therapy based on the absolute MCT (39% vs 41%, respectively). In SIMPLIFY-2, a significantly greater proportion of patients treated with momelotinib achieved responder states compared with best available therapy based on absolute and percent change MCTs. CONCLUSIONS: This study demonstrates that momelotinib provided clinically meaningful symptom benefit for patients with myelofibrosis and provides insight into the appropriateness of the symptom change threshold used in historical studies.

Establishing Meaningful Change Thresholds in Patient-Reported Outcomes Among Patients With Anaplastic Lymphoma Kinase-Positive Non-Small Cell Lung Cancer in ALTA-1L Trial.

OBJECTIVES: An earlier study from the ALTA-1L trial of patients with anaplastic lymphoma kinase-positive non-small cell lung cancer demonstrated that brigatinib produces superior health-related quality of life (QoL) outcomes over crizotinib. This study aimed to derive meaningful change thresholds (MCTs) for European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire (QLQ)-C30 and EORTC QLQ-LC13 to refine the earlier results. METHODS: Patients from the ALTA-1L trial were administered the EORTC QLQ-C30 and EORTC QLQ-LC13 questionnaires. Responses were analyzed using anchor-based analysis, graphical analysis, distribution-based analysis, longitudinal responder analysis, and time to deterioration. RESULTS: The patient-reported outcome population comprised 262 patients who completed the EORTC QLQ-C30 at baseline and at least 1 follow-up timepoint. Both anchors (QLQ-C30 items for overall health and QoL) had correlations >0.40 or < -0.40 with all functioning domains, fatigue, pain, appetite loss, and all dyspnea scores. Within-group analysis for most scales found the derived MCT was consistent with a cutoff of 10 points for classifying individual-patient change, except for 3-item dyspnea. The probability of improvement/remaining stable was significantly greater in the brigatinib group over crizotinib for the EORTC QLQ-C30 emotional functioning, appetite loss, and constipation domains. CONCLUSIONS: This study derived MCTs for EORTC QLQ-C30 and QLQ-LC13 domains that may be applied in future studies and again demonstrated the superiority of brigatinib over crizotinib in health-related QoL outcomes in patients with non-small cell lung cancer.

Estimating anchor-based minimal important change using longitudinal confirmatory factor analysis.

PURPOSE: The minimal important change (MIC) is defined as the smallest within-individual change in a patient-reported outcome measure (PROM) that patients on average perceive as important. We describe a method to estimate this value based on longitudinal confirmatory factor analysis (LCFA). The method is evaluated and compared with a recently published method based on longitudinal item response theory (LIRT) in simulated and real data. We also examined the effect of sample size on bias and precision of the estimate. METHODS: We simulated 108 samples with various characteristics in which the true MIC was simulated as the mean of individual MICs, and estimated MICs based on LCFA and LIRT. Additionally, both MICs were estimated in existing PROMIS Pain Behavior data from 909 patients. In another set of 3888 simulated samples with sample sizes of 125, 250, 500, and 1000, we estimated LCFA-based MICs. RESULTS: The MIC was equally well recovered with the LCFA-method as using the LIRT-method, but the LCFA analyses were more than 50 times faster. In the Pain Behavior data (with higher scores indicating more pain behavior), an LCFA-based MIC for improvement was estimated to be 2.85 points (on a simple sum scale ranging 14-42), whereas the LIRT-based MIC was estimated to be 2.60. The sample size simulations showed that smaller sample sizes decreased the precision of the LCFA-based MIC and increased the risk of model non-convergence. CONCLUSION: The MIC can accurately be estimated using LCFA, but sample sizes need to be preferably greater than 125.

Quantitative and Qualitative Exploration of Meaningful Change on the Vineland Adaptive Behavior Scales (Vineland™-II) in Children and Adolescents with Autism Without Intellectual Disability Following Participation in a Clinical Trial.

Purpose: The VinelandTM Adaptive Behavior Scale is often used in autism spectrum disorder (ASD) trials. The Adaptive Behavior Composite Score (VABS-ABC) is the standardized overall score (the average of the Socialization, Communication and Daily Living skills domains), and the standardized 2-Domain Composite Score (VABS-2DC) is a novel outcome measure (average of the Socialization and Communication domains). A within-person meaningful change threshold (MCT) has not been established for the VABS-2DC. This paper presents a quantitative and qualitative interpretation of what constitutes a meaningful change in these scores to individuals with ASD without Intellectual Disability (ID; IQ≥70) and their families, as reported by their study partners (SPs). Participants and Methods: Data were obtained from the aV1ation clinical trial in children and adolescents with ASD and associated exit interviews. The intent-to-treat (ITT) clinical trial population included 308 individuals with autism (85.4% male; average age: 12.4 years [standard deviation (SD)=2.97]); 124 in the child cohort (aged 5 to 12 years; average age: 9.4 years [SD=1.86]), and 184 in the adolescent cohort (aged 13 to 17 years; average age: 14.5 years [SD=1.39]). Study partners of 86 trial participants were included in the Exit Interview Population (EIP): participants represented were 83.7% male, average age: 12.3 years [SD=2.98]). Anchor and distribution-based methods were used to estimate within-person change to support a responder definition, to aid interpretation of the clinical trial data; qualitative data were used to contextualize the meaning of changes observed. Results: A within-person MCT range of 4 to 8 points was proposed for both VABS-ABC and VABS-2DC, which was associated with at least a 1-point improvement on 4 different anchors. Evidence for this within-person MCT was further supported by qualitative data, which suggested any change was considered meaningful to the individual with ASD, as reported by their SP, no matter what the magnitude. Conclusion: A change in standardized score of 4 to 8 points constitutes a within-person MCT on both VABS-ABC and novel VABS-2DC in those with ASD and no ID. A change of this, or more, was reported by the SPs in this trial to be meaningful and highly impactful upon the individuals with ASD and their family.

Psychometric Validation and Meaningful Change Thresholds of the New Nasal Polyposis Symptom Diary.

OBJECTIVES: The Nasal Polyposis Symptom Diary (NPSD) is a novel and short patient-reported outcome (PRO) tool specifically developed to assess important and relevant symptoms reported by patients with chronic rhinosinusitis with nasal polyposis (CRSwNP). We evaluated the psychometric properties of 4 predefined NPSD-derived scores intended to support symptom-improvement assessments of investigational therapies for inclusion in product labeling. METHODS: Five hundred eighteen patients with severe CRSwNP from a Phase III clinical trial (NCT03401229) completed the NPSD, comprising 11 items: 8 symptom-specific, 2 symptom-impact, and 1 optional medication-compliance. The psychometric characteristics of 3 single-item symptom scores (Nasal Blockage Score [NBS], Nasal Congestion Score [NCS], and Difficulty with Sense of Smell Score [DSS]) and a Total Symptom Score (TSS, summary of the 8 symptom-specific items) were evaluated for reliability, validity, and ability to detect change. Within-patient meaningful change thresholds (MCTs) were established using anchor- and distribution-based methods. Comparative PROs included the 22-item Sino-Nasal Outcome Test (SNOT-22) and Patient Global Impression of Severity (PGI-S). RESULTS: The TSS exhibited strong internal consistency (Cronbach α = .88) and test-retest reliability (intraclass correlation coefficient >.80). Correlation between the TSS and SNOT-22 total score indicated good convergent validity (r = .70). All 4 NPSD scores demonstrated known-groups validity (significant differences among subgroups of patients with predetermined disease severity levels based on PGI-S categories) and were sensitive to detect change in patients' clinical status (significant differences among subgroups of patients with reported changes between 2 time-points in PGI-S and Patient Global Impression of Change scores). MCTs for improvement were established at 1.0 point for NBS, NCS, and DSS, and 4.0 points for TSS. CONCLUSION: These findings support the reliability, validity, and suitability of the 4 NPSD-derived scores for evaluating treatment effect on CRSwNP symptoms and their use in clinical trials with predetermined MCTs for improvement.

How strong should my anchor be for estimating group and individual level meaningful change? A simulation study assessing anchor correlation strength and the impact of sample size, distribution of change scores and methodology on establishing a true meaningful change threshold.

PURPOSE: Treatment benefit as assessed using clinical outcome assessments (COAs), is a key endpoint in many clinical trials at both the individual and group level. Anchor-based methods can aid interpretation of COA change scores beyond statistical significance, and help derive a meaningful change threshold (MCT). However, evidence-based guidance on the selection of appropriately related anchors is lacking. METHODS: A simulation was conducted which varied sample size, change score variability and anchor correlation strength to assess the impact of these variables on recovering the simulated MCT for interpreting individual and group-level results. To assess MCTs derived at the individual-level (i.e. responder definitions; RDs), Receiver Operating Characteristic (ROC) curves and Predictive Modelling (PM) analyses were conducted. To assess MCTs for interpreting change at the group-level, the mean change method was conducted. RESULTS: Sample sizes, change score variability and magnitude of anchor correlation affected accuracy of the estimated MCT. For individual-level RDs, ROC curves were less accurate than PM methods at recovering the true MCT. For both methods, smaller samples led to higher variability in the returned MCT, but higher variability still using ROC. Anchors with weaker correlations with COA change scores had increased variability in the estimated MCT. An anchor correlation of around 0.50-0.60 identified a true MCT cut-point under certain conditions using ROC. However, anchor correlations as low as 0.30 were appropriate when using PM under certain conditions. For interpreting group-level results, the MCT derived using the mean change method was consistently underestimated regardless of the anchor correlation. CONCLUSION: Sample size and change score variability influence the necessary anchor correlation strength when recovering individual-level RDs. Often, this needs to be higher than the commonly accepted threshold of 0.30. Stronger correlations than 0.30 are required when using the mean change method. Results can assist researchers selecting and assessing the quality of anchors.

Assessing the meaningful change threshold of Quality of Life in Depression Scale using data from two phase 3 studies of esketamine nasal spray.

BACKGROUND: Major depressive disorder (MDD) directly impacts patients' lives including symptoms, functioning and health-related quality-of-life (HRQoL). Patient-reported outcomes can capture these impacts, however interpretation of clinical meaningfulness of these measurements are often not readily available. Meaningful change thresholds (MCTs) can be derived for clinical outcome assessments to quantify the change in symptoms that is meaningful to the patient following pharmacologic treatment or other interventions. The objective of this analysis was to determine the within-patient MCT of the self-reported Quality-of-Life in Depression Scale (QLDS) among patients with MDD and active suicidal ideation with intent (MDSI) using an anchor-based approach. METHODS: Data from 2 randomized phase-3 trials of esketamine nasal spray (ASPIRE I and ASPIRE II) were analyzed. The Montgomery-Åsberg Depression Rating Scale (MADRS) was the primary anchor with three different severity criteria. Other anchor variables utilized were Clinical Global Impression of Severity of Suicidality-revised version, Clinical Global Impression of Imminent Suicide Risk, and EuroQol Visual Analog Scale [EQ-VAS]. Spearman correlation coefficients between the change in QLDS and anchor variables were calculated. The mean change in QLDS score at Day 25 from baseline was calculated based on the categorical change in the anchor. Coefficient yield from linear regression of the mean changes in EQ-VAS and QLDS, and distribution-based approach with ½ SD of change in QLDS were considered. RESULTS: In ASPIRE I, mean (SD) improvement in QLDS score among patients with one category improvement in MADRS from baseline to Day 25 was - 8.22 (8.87), - 8.30 (9.01), and - 8.20 (8.92) using severity criteria #1, #2, and #3, respectively. Patients who achieved a 7-point improvement (MCT) in EQ-VAS yielded a mean - 9.69-point improvement in QLDS at Day 25. The ½ SD of change in QLDS was 5.63. Similar results were obtained for ASPIRE II. The MCTs identified using multiple anchors across both trials ranged from - 11.4 to - 6.7 and had an overall mean of - 7.90 (ASPIRE I) and - 7.92 (ASPIRE II). Thus, an 8-point change was recommended as the MCT for QLDS. CONCLUSION: The recommended MCT will help quantify within-person changes in HRQoL using patient-reported QLDS and determine meaningful treatment benefit in an MDD patient population with acute suicidal ideation or behavior. TRIAL REGISTRATION: Name of the registry: ClinicalTrials.gov. TRIAL REGISTRATION NUMBER: ASPIRE I (NCT03039192), ASPIRE II (NCT03097133). Date of registration: February 01, 2017; March 31, 2017. URL of trial registry record: https://clinicaltrials.gov/ct2/show/NCT03039192 ; https://clinicaltrials.gov/ct2/show/NCT03097133 .

Psychometric validation and interpretation of the Nocturia Impact Diary in a clinical trial setting.

PURPOSE: Psychometric evaluation of the Nocturia Impact (NI) Diary was conducted to support its use as a trial endpoint. METHODS: As part of a randomized, controlled Phase 2 clinical trial investigating a novel drug candidate for nocturnal polyuria, adult nocturia patients completed the NI Diary and a voiding diary for three nights preceding their clinic visit at Baseline and Weeks 1, 4, 8, and 12 (end of treatment). Exit interviews were conducted to obtain patient impressions of the NI Diary. RESULTS: A total of N = 302 participants were included. Confirmatory factor analysis (CFA) indicated that the 11-item measure is unidimensional with values of CFI, TLI, and RMSEA meeting relevant thresholds. Good internal consistency (Cronbach's α 0.941) and test-retest reliability (intra-class correlation coefficients 0.730-0.880). Convergent validity with two reference measures was demonstrated with strong correlations of 0.573-0.730 were shown. Significant differences (P = 0.0018, standardized effect size = 0.372) between groups defined by number of night-time voids supported known-groups validity. Exit interviews in 66 patients indicated all participants experienced improvement in at least 1 NI Diary item and that a 1-point improvement on the item response scale and 1-void reduction per night (associated with an average best cut point on ROC analysis of - 11.6) constituted meaningful improvement. Anchor and distribution-based analyses identified a meaningful change threshold of - 15 to - 18 points on the NI Diary. CONCLUSION: The NI Diary is a reliable and valid patient-reported psychometric instrument which is fit-for-purpose to evaluate the impact of nocturia on patient quality of life in the clinical trial setting. Trial registration number and registration date NCT03201419; June 28, 2017.

Meaningful Change in Depression Symptoms Assessed with the Patient Health Questionnaire (PHQ-9) and Montgomery-Åsberg Depression Rating Scale (MADRS) Among Patients with Treatment Resistant Depression in Two, Randomized, Double-blind, Active-controlled Trials of Esketamine Nasal Spray Combined With a New Oral Antidepressant.

BACKGROUND: Patients with major depressive disorder who do not respond to ≥2 different pharmacological treatments within the current depressive episode are considered to have treatment resistant depression (TRD). This analysis determined meaningful change thresholds (MCT) of the Patient Health Questionnaire (PHQ-9) and Montgomery-Åsberg Depression Rating Scale (MADRS) using anchor-based methods and compared proportions of meaningful changes in patients with TRD across treatment groups from two Phase 3 trials for esketamine nasal spray (SPRAVATOTM). METHODS: Data from two Phase 3 trials in patients with TRD, TRANSFORM-1 and -2, were used in this analysis. The MCTs for the PHQ-9 and MADRS were derived using a clinician global impression of severity anchor. Blinded probability density functions displayed score distributions between anchor categories. Proportions of meaningful response were compared between treatment groups using chi-square tests supported by unblinded cumulative distribution functions of change scores. RESULTS: Baseline scores were similar for the PHQ-9 and MADRS between the esketamine/antidepressant (AD) and AD/placebo groups. The most appropriate MCT on the PHQ-9 was -6 points. By Day 28, 86.5% of patients reached or exceeded the PHQ-9 MCT in the esketamine/AD group compared to 70% in the placebo/AD group. The most appropriate MCT for the MADRS was -10 points. By Day 28, 78.2% of patients reached or exceeded the MADRS MCT in the esketamine/AD group compared to 65.0% in the placebo/AD group. CONCLUSIONS: Individual-level meaningful change for the PHQ-9 and MADRS was effectively quantified using a clinical anchor to interpret efficacy from patients with TRD and their treating clinicians.