The challenges inherent with anchor-based approaches to the interpretation of important change in clinical outcome assessments.

PURPOSE: Anchor-based methods are group-level approaches used to derive clinical outcome assessment (COA) interpretation thresholds of meaningful within-patient change over time for understanding impacts of disease and treatment. The methods explore the associations between change in the targeted concept of the COA measure and the concept measured by the external anchor(s), typically a global rating, chosen as easier to interpret than the COA measure. While they are valued for providing plausible interpretation thresholds, group-level anchor-based methods pose a number of inherent theoretical and methodological conundrums for interpreting individual-level change. METHODS: This investigation provides a critical appraisal of anchor-based methods for COA interpretation thresholds and details key biases in anchor-based methods that directly influences the magnitude of the interpretation threshold. RESULTS: Five important research issues inherent with the use of anchor-based methods deserve attention: (1) global estimates of change are consistently biased toward the present state; (2) the use of static current state global measures, while not subject to artifacts of recall, may exacerbate the problem of estimating clinically meaningful change; (3) the specific anchor assessment response(s) that identify the meaningful change group usually involves an arbitrary judgment; (4) the calculated interpretation thresholds are sensitive to the proportion of patients who have improved; and (5) examination of anchor-based regression methods reveals that the correlation between the COA change scores and the anchor has a direct linear relationship to the magnitude of the interpretation threshold derived using an anchor-based approach; stronger correlations yielding larger interpretation thresholds. CONCLUSIONS: While anchor-based methods are recognized for their utility in deriving interpretation thresholds for COAs, attention to the biases associated with estimation of the threshold using these methods is needed to progress in the development of standard-setting methodologies for COAs.

Using qualitative methods to establish the clinically meaningful threshold for treatment success in alopecia areata.

PURPOSE: Traditionally, appropriate anchors are used to investigate the amount of change on a clinician-reported outcome assessment that is meaningful to individual patients. However, novel qualitative methods involving input from disease state experts together with patients may better inform the individual improvement threshold for demonstrating the clinical benefit of new treatments. This study aimed to establish a clinically meaningful threshold for treatment success for the clinician-reported Severity of Alopecia Tool (SALT) score for patients with alopecia areata (AA). METHODS: A purposive sample of 10 dermatologists expert in AA and 30 adult and adolescent patients with AA and a history of ≥ 50% scalp hair loss were recruited. Semi-structured interview questions explored the outcome that represented treatment success to clinicians and patients. Findings were analyzed using thematic methods to identify treatment success thresholds. RESULTS: Both informant groups confirmed scalp hair amount as the outcome of priority. Most expert clinicians considered a static threshold of 80% (n = 5) or 75% (n = 3) of the scalp hair as a treatment success. Most patient responses ranged from 70 to 90% (median: 80% of the scalp hair). Subsequently, queried patients confirmed that achieving SALT score ≤ 20 with treatment would be a success, as reflected in the Alopecia Areata Investigator Global Assessment (AA-IGA™). The novel qualitative processes used to inform this meaningful threshold reflects a clinician-then-patient process for: (a) confirmation of the patient outcome of priority; and (b) clinician input on a preliminary treatment success level for independent understanding among patients. CONCLUSION: This qualitative investigation of expert clinicians-then-patients with AA confirmed that achieving an amount of 80% or more scalp hair (SALT score ≤ 20) was an appropriate individual treatment success threshold indicating clinically meaningful improvement for patients with ≥ 50% scalp hair loss. A qualitative investigation of a quantifiable treatment success threshold is possible through a well-designed interview process with expert clinicians and the appropriate patient population.

Validation of patient-reported vaso-occlusive crisis day as an endpoint in sickle cell disease studies.

Individuals with sickle cell disease (SCD) experience vaso-occlusive crises (VOC). Historically, VOC episodes have been assessed through medical utilization, thereby excluding events managed at home. In order to validate a daily patient-reported outcome for patients with SCD to accurately report their VOC status and experience of a pain crisis, a SCD Diary was included in Evaluation of Longitudinal Pain Study in Sickle Cell Disease (ELIPSIS), a longitudinal, six-month, non-interventional study. The daily patient-completed diary included a description of SCD pain crisis, followed by questions on: pain crisis in the past 24 h (VOC Day question; respective response yes or no), worst pain, tiredness, and functioning. Thirty-five patients with SCD participated in ELIPSIS. Analyses were performed to validate the patient-reported VOC Day. Mean symptoms and functioning scores on the first or last VOC Day of a VOC Event were compared using t-tests with the mean of the three non-VOC Days before and after the event. Mean severity of symptoms and functioning scores on all VOC Days compared to all non-VOC Days were higher, with statistically significant mean differences between first/last VOC Days and respective three non-VOC Days (p's < .01). A subset of patients (n = 15) and caregivers (n = 9) were interviewed to evaluate their understanding of the SCD Diary questions. Nearly all confirmed that the pain crisis description accurately described the VOC experience, and participants expressed confidence differentiating SCD crisis pain from everyday pain. These results demonstrate patients can reliably report their experiences with VOC-related pain crises using the SCD Diary.

Recommendations for the Electronic Migration and Implementation of Clinician-Reported Outcome Assessments in Clinical Trials.

OBJECTIVES: Although best practices from electronic patient-reported outcome (PRO) measures are transferable, the migration of clinician-reported outcome (ClinRO) assessments to electronic modes requires recommendations that address their unique properties, such as the user (eg, clinician), and complexity associated with programming of clinical content. Faithful migration remains essential to ensuring that the content and psychometric properties of the original scale (ie, validated reference) are preserved, such that clinicians completing the ClinRO assessments interpret and respond to the items the same way regardless of data collection mode. The authors present a framework for how to "faithfully" migrate electronic ClinRO assessments for successful deployment in clinical trials. METHODS: Critical Path Institute's Electronic PRO Consortium and PRO Consortium convened a consensus panel of representatives from member firms to develop recommendations for electronic migration and implementation of ClinRO assessments in clinical trials based on industry standards, regulatory guidelines where available, and relevant literature. The recommendations were reviewed and approved by all member firms from both consortia. CONSENSUS RECOMMENDATIONS: Standard, minimal electronic modifications for ClinRO assessments are described. This article also outlines implementation steps, including planning, startup, electronic clinical outcome assessment system development, training, and deployment. The consensus panel proposes that functional clinical testing by a clinician or clinical outcome assessment expert, as well as copyright holder review of screenshots (if possible) are sufficient to support minimal modifications during migration. Additional evidence generation is proposed for modifications that deviate significantly from the validated reference.

Psychometric validation and meaningful within-patient change of the Migraine-Specific Quality of Life questionnaire version 2.1 electronic patient-reported outcome in patients with episodic and chronic migraine.

OBJECTIVE: To evaluate the measurement properties of all three domains of the Migraine-Specific Quality of Life questionnaire version 2.1 (MSQ v2.1) electronic patient-reported outcome (ePRO) to assess the functional impact of migraine in patients with episodic or chronic migraine (CM); and identify meaningful within-patient change thresholds for the Role Function-Restrictive (RFR), Role Function-Preventive (RFP), and Emotional Function (EF) domains. METHODS: Data were drawn from three double-blind, placebo-controlled, and randomized Phase 3 clinical studies (episodic migraine [EM]: EVOLVE-1 and EVOLVE-2; CM: REGAIN). The psychometric properties of the MSQ v2.1 ePRO domains were demonstrated by evaluating reliability (internal consistency and test-retest), construct validity (convergent and known groups), and responsiveness. Meaningful within-patient change thresholds for domains were estimated using anchor-based approaches, supplemented by empirical cumulative distribution function curves and probability density function plots to enable interpretation of meaningful change over 3 months. The Patient Global Impression of Severity (PGI-S) and Patient Global Impression of Improvement served as anchors. RESULTS: A total of 2,850 patients with either EM (EVOLVE-1: 851; EVOLVE-2: 909) or CM (REGAIN: 1,090) were included. The Cronbach's alpha estimates of internal consistency exceeded the recommended threshold of ≥0.70 for all domains from the three studies, indicating adequate internal consistency. Test-retest reliability intraclass correlation coefficients were ≥0.80 for all domains across all three studies, demonstrating almost perfect agreement. Convergent validity was supported by moderate-to-strong correlation (r ≥ 0.30) between all domains of MSQ v2.1 ePRO and studied anchors (Migraine Disability Assessment Score and PGI-S scores) across all three studies. Known group validity was established between all domains and subgroups of patients stratified by baseline PGI-S scores and baseline number of monthly migraine headache days for all three studies. The 3-month meaningful within-patient change thresholds were the same for EM and CM for RFP: 20.00 and EF: 26.67; and for RFR: 25.71. CONCLUSIONS: These findings demonstrate that all three domains of the MSQ v2.1 ePRO have sufficient reliability, validity, responsiveness, and appropriate interpretation standards. Our results suggest that MSQ v2.1 ePRO is a well-defined and reliable patient-reported outcome instrument that is suitable for use in clinical studies for evaluating the impact of migraine on patient functioning in episodic and CM.

The Role of Patients in Alopecia Areata Endpoint Development: Understanding Physical Signs and Symptoms.

Meaningful patient input to understand disease experience and patient expectations for improvement with treatment is essential for the selection and development of outcome measures for alopecia areata (AA) clinical trials. This study explored the physical signs and symptoms of AA through 30 semistructured interviews with adult (n = 25) and adolescent (n = 5) patients experienced with severe or very severe AA. Scalp hair loss was overwhelmingly the most important sign and symptom of AA. Nearly all patients (90%) considered scalp hair loss in their top three most bothersome physical signs and symptoms of AA, with 77% (n = 23) naming scalp hair loss as the most bothersome symptom. Other identified signs and symptoms in the top three most bothersome included eyebrow, eyelash, nose, body, and facial hair loss, as well as eye irritation and nail damage and/or appearance. Eyebrow (16%, n = 4), eyelash (4%, n = 1), nasal (4%, n = 1), and body (4%, n = 1) hair loss were identified by seven adult patients as the most bothersome signs and symptoms of AA. Conceptual saturation confirmed that a comprehensive understanding of this patient population's physical AA-related signs and symptoms was obtained. These findings indicate that the primary objective for new AA treatments for this patient population should be meaningful improvement in scalp hair growth to address the most troubling unmet need.

Psychometric Validation of the Role Function Restrictive Domain of the Migraine Specific Quality-of-Life Questionnaire Version 2.1 Electronic Patient-Reported Outcome in Patients With Episodic and Chronic Migraine.

OBJECTIVES: To assess the measurement properties of the Migraine-Specific Quality of Life Questionnaire version 2.1 (MSQv2.1) electronic patient-reported outcome (ePRO) Role Function-Restrictive (RFR) domain to evaluate the functional impact of migraine in patients with episodic (EM) or chronic migraine (CM) enrolled in clinical trials. METHODS: The 7-item MSQv2.1 ePRO RFR measures the functional impact of migraine on relationships with family and friends, leisure time, work or daily activities, productivity, concentration, tiredness, and energy. Measurement properties of the RFR were assessed using data from 2 EM (CGAG [n = 851] and CGAH [n = 909]) and 1 CM (CGAI [n = 1090]) Phase 3 galcanezumab clinical trials. Anchor- and distribution-based analyses were utilized to derive a responder threshold for clinical interpretation of change over time. The Migraine Disability Assessment (MIDAS), Patient Global Impression of Severity (PGI-S), Patient Global Impression of Improvement (PGI-I), and migraine headache days (MHD) served as anchors. Responsiveness and responder threshold analyses were completed from baseline to the average of months 4-6 for EM studies, and from baseline to month 3 for the CM study; timeframes selected were based on the primary endpoints in these studies. RESULTS: Cronbach's alpha values for internal consistency reliability were 0.93, 0.92, and 0.92, for CGAG, CGAH, and CGAI, respectively. Test-retest reliability intra-class correlation coefficients were 0.82 and 0.84 for CGAG and CGAH, and 0.85 for CGAI in stable patients. Convergent validity was supported by moderate to strong correlations (≥0.30) between the RFR and both MIDAS and PGI-S. Known-groups validity was established between subgroups stratified by baseline PGI-S and MHD (P < .05; δ = 0.35-1.96). For the EM studies, anchor variables suggested a change of ≥25 points (equivalent to 9 points/state changes on raw scale) in the RFR was an appropriate threshold to interpret a treatment benefit. For the CM study a change of ≥17.14 points (6 points/state changes on raw scale) was an appropriate threshold. In all 3 studies, significantly (P < .01) more galcanezumab patients achieved the responder definition thresholds, as compared to placebo (odds ratios of 1.98, 2.45, 2.27, 2.44, 1.64, and 1.66 for the 120 and 240 mg arms in the CGAG, CGAH, and CGAI trials, respectively). CONCLUSION: The MSQv2.1 ePRO RFR has sufficient reliability, validity, responsiveness, and appropriate interpretation standards for use in EM and CM clinical trials to assess the functional impact of migraine.

Psychometric properties of morning joint stiffness duration and severity measures in patients with moderately to severely active rheumatoid arthritis.

BACKGROUND: To assess the measurement properties of two single-item patient-reported outcome (PRO) measures that assessed the length of time (in minutes) and severity of morning joint stiffness (MJS) experienced each day. METHODS: Data from two Phase 3, randomized placebo-controlled (and active-controlled [RA-BEAM]), clinical studies assessing the safety and efficacy of baricitinib in adults with moderately to severely active rheumatoid arthritis (RA) were used to evaluate the psychometric properties of the Duration of MJS and Severity of MJS PROs. RESULTS: Test-retest reliability of Duration of MJS and Severity of MJS was supported through large intraclass correlation coefficients among stable patients (coefficient range for both studies: 0.88 to 0.93). In support of construct validity, moderate correlations were evidenced between Duration of MJS and other related patient- and clinician-reported assessments of RA symptoms and patient functioning, whereas moderate-to-strong correlations were evidenced between these same patient- and clinician-reported assessments and Severity of MJS. Statistically significant differences between the median and mean values of Duration of MJS and Severity of MJS for differing categories of RA disease severity supported known-groups validity. Finally, large and statistically significant differences in change scores from Day 1 to Week 12 for patients defined as responders versus non-responders using the American College of Rheumatology 20 criteria supported the responsiveness of both PROs. CONCLUSION: Duration of MJS and Severity of MJS PROs demonstrated reliability, validity, and responsiveness in adults with moderately to severely active RA, supporting the measurement of these key symptoms in clinical trials.

Psychometric properties of the single-item measure, severity of worst tiredness, in patients with moderately to severely active rheumatoid arthritis.

BACKGROUND: To assess the reliability, validity, and responsiveness to treatment change of the single-item measure, Severity of Worst Tiredness, in patients with rheumatoid arthritis (RA). METHODS: Data from two Phase 3, randomized, placebo-controlled (RA-BUILD; and active-controlled [RA-BEAM]), clinical studies of the efficacy of baricitinib in adults with moderately to severely active RA were used. The psychometric properties of the single-item measure, Severity of Worst Tiredness, were assessed, including test-retest reliability, convergent and discriminant validity, known-groups validity, and responsiveness, using other patient- and clinician-reported outcomes frequently assessed in RA patients. RESULTS: Test-retest reliability of the Severity of Worst Tiredness was supported through large intraclass correlation coefficients (0.89 ≤ ICC ≤ 0.91). Moderate-to-large correlations were observed between this patient-reported outcome (PRO) and other related patient- and clinician-reported assessments of RA symptoms and patient functioning, supporting construct validity of the measure (│r│ ≥ 0.41). The instrument also displayed known-groups validity through statistically significant differences between mean values of the Severity of Worst Tiredness defined using other indicators of RA severity. Finally, responsiveness was supported by large and statistically significant differences in change scores from Day 1 to Week 12 for patients comparing responders and nonresponders using the American College of Rheumatology 20 (ACR20) criteria. CONCLUSION: The Severity of Worst Tiredness PRO demonstrated adequate reliability, validity, and responsiveness in clinical trials of adults with moderately to severely active RA and is fit for purpose in this patient population.

Evaluation of Neuropsychiatric Function in Phenylketonuria: Psychometric Properties of the ADHD Rating Scale-IV and Adult ADHD Self-Report Scale Inattention Subscale in Phenylketonuria.

BACKGROUND: Previous qualitative research among adults and parents of children with phenylketonuria (PKU) has identified inattention as an important psychiatric aspect of this condition. The parent-reported ADHD Rating Scale-IV (ADHD RS-IV) and the Adult ADHD Self-Report Scale (ASRS) have been validated for measuring inattention symptoms in persons with attention-deficit/hyperactivity disorder (ADHD); however, their psychometric attributes for measuring PKU-related inattention have not been established. OBJECTIVE: The primary objective of this investigation was to demonstrate the reliability, validity, and responsiveness of the ADHD RS-IV and ASRS inattention symptoms subscales in a randomized controlled trial of patients with PKU aged 8 years or older. METHODS: A post hoc analysis investigated the psychometric properties (Rasch model fit, reliability, construct validity, and responsiveness) of the ADHD RS-IV and ASRS inattention subscales using data from a phase 3b, double-blind, placebo-controlled clinical trial in those with PKU aged 8 years or older. RESULTS: The Rasch results revealed good model fit, and reliability analyses revealed strong internal consistency reliability (α ≥ 0.87) and reproducibility (intraclass correlation coefficient ≥ 0.87) for both measures. Both inattention measures demonstrated the ability to discriminate between known groups (P < 0.001) created by the Clinical Global Impression-Severity scale. Correlations between the ADHD RS-IV and the ASRS with the Clinical Global Impression-Severity scale and the age-appropriate Behavior Rating Inventory of Executive Function Working Memory subscale were consistently moderate to strong (r ≥ 0.56). Similarly, results of the change score correlations were of moderate magnitude (r ≥ 0.43) for both measures when compared with changes over time in Behavior Rating Inventory of Executive Function Working Memory subscales. CONCLUSIONS: These findings of reliability, validity, and responsiveness of both the ADHD RS-IV and the ASRS inattention scales, in addition to content validation results, support their use for the assessment of inattention symptoms among persons with PKU aged 8 years or older in both clinical and research settings.

Responder definition of the Multiple Sclerosis Impact Scale physical impact subscale for patients with physical worsening.

BACKGROUND: The 29-item Multiple Sclerosis Impact Scale (MSIS-29) was developed to examine the impact of multiple sclerosis (MS) on physical and psychological functioning from a patient's perspective. OBJECTIVE: To determine the responder definition (RD) of the MSIS-29 physical impact subscale (PHYS) in a group of patients with relapsing-remitting MS (RRMS) participating in a clinical trial. METHODS: Data from the SELECT trial comparing daclizumab high-yield process with placebo in patients with RRMS were used. Physical function was evaluated in SELECT using three patient-reported outcomes measures and the Expanded Disability Status Scale (EDSS). Anchor- and distribution-based methods were used to identify an RD for the MSIS-29. RESULTS: Results across the anchor-based approach suggested MSIS-29 PHYS RD values of 6.91 (mean), 7.14 (median) and 7.50 (mode). Distribution-based RD estimates ranged from 6.24 to 10.40. An RD of 7.50 was selected as the most appropriate threshold for physical worsening based on corresponding changes in the EDSS (primary anchor of interest). CONCLUSION: These findings indicate that a ≥7.50 point worsening on the MSIS-29 PHYS is a reasonable and practical threshold for identifying patients with RRMS who have experienced a clinically significant change in the physical impact of MS.

Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data.

PURPOSE: Large samples are generally considered necessary for Rasch model to obtain robust item parameter estimates. Recently, small sample Rasch analysis was suggested as preliminary assessment of items' psychometric properties. This study is to evaluate the Rasch analysis results using small sample sizes. METHODS: Ten PROMIS pain behavior items were used. Random samples of 30, 50, 100, and 250, and a targeted sample of 30 were drawn 10 times each from a total of 800 subjects. Rasch analysis was conducted for each of these samples and the full sample. RESULTS: In the full sample, there were 104 cases of extreme scores, no null categories, two incorrectly ordered items, and four misfit items. For samples of 250, 100, 50, 30, and targeted 30, the average numbers of extreme scores were 42.2, 17.1, 9.6, 6.1, and 1.2; the average numbers of null categories were 1.0, 3.2, 8.7, 13.4, and 8.3; the average numbers of items with incorrectly ordered item parameters were 0.1, 0.8, 2.9, 4.7, and 3.7; and the average numbers of items with fit residuals exceeding ± 2.5 were 0.8, 0.3, 0.1, 0.2, and 0.3, respectively. CONCLUSIONS: Rasch analysis based on small samples (≤ 50) identified a greater number of items with incorrectly ordered parameters than larger samples (≥ 100). However, fewer items were identified as misfitting. Results from small samples led to opposite conclusions from those based on larger samples. Rasch analysis based on small samples should be used for exploratory purposes with extreme caution.

Are treatment benefits in neuropathic pain reflected in the Self Assessment of Treatment questionnaire?

BACKGROUND/OBJECTIVE: The Self Assessment of Treatment (SAT) questionnaire was developed to reflect key patient reported outcomes of Neuropathic Pain (NP) treatments. This study aimed to understand how patients perceived the relevance and ease of understanding of the questions in the SAT and to recommend modifications based on patient and clinician interviews. METHODS: Semi-structured interviews were conducted with clinicians and NP patients to provide information regarding treatment attributes and the impact of pain. Patients were debriefed on the SAT, a 5-item scale evaluating pain, activity level, quality of life (QoL) and satisfaction with treatment (recommend treatment and undergo treatment again). The SAT has a recall period reflecting back to the start of treatment. The qualitative analysis software ATLAS.ti 5.0 was used to analyze patient transcripts. Changes to the SAT were integrated into the questionnaire for a second round of debriefing interviews. RESULTS: Three NP clinicians and 44 patients (20 painful diabetic neuropathy, 16 HIV-associated neuropathy and 8 post herpetic neuralgia) with a mean age of 60.3 (12.3) years and an even gender distribution were interviewed. Patient treatment experience included anticonvulsants (73%), antidepressants (34%), opioids (25%), and topical medications (41%). Pain descriptors and treatment attributes were similar across the three NP groups. Pain relief was judged the most important treatment attribute, followed by ability to undertake activities. Sleep improvement was another important attribute. Activity limitations and QOL were perceived as too broad and non-specific, and were split into 3 concepts each (activity limitations was split into self care, daily and physical activities and QOL was split into sleep, emotions, and social function). A 7-day recall period was introduced. The item stem and response options were made consistent, and a baseline and follow-up questionnaires were developed (except for the satisfaction items) to enable monitoring onset of treatment benefit and change over time. CONCLUSIONS: The content validity of the revised SAT was improved by the qualitative research, and NP treatment benefits are reflected in a more consistent fashion by the changes. Baseline and follow-up versions make it possible to perform assessments of change over time.

The Fatigue Associated with Depression Questionnaire (FAsD): responsiveness and responder definition.

PURPOSE: The Fatigue Associated with Depression Questionnaire (FAsD) was developed to assess fatigue and its impact among patients with depression. The purpose of this study was to examine the questionnaire's responsiveness to change and identify a responder definition for interpretation of treatment-related changes. METHODS: Data were collected at baseline and at 6 weeks from patients with depression starting treatment with a new antidepressant. RESULTS: Of the 96 participants, 55.2% were women, with a mean age of 43.4 years. The total score and both subscales demonstrated statistically significant change with moderate to large effect sizes (absolute values ≥ 0.76). FAsD change scores were significantly correlated with change on the Brief Fatigue Inventory (r ≥ 0.73; p < 0.001). FAsD mean change scores discriminated among patient subgroups differing by degree of improvement in patient- and clinician-reported fatigue and depression. Responder definition for the two subscales and total score (0.67, 0.57, 0.62) was estimated primarily based on mean change among patients who reported a small but important improvement in fatigue. DISCUSSION: The FAsD was responsive to change, and the responder definition may be used when interpreting treatment-related change. Results add to previous findings suggesting the FAsD is a useful measure of fatigue among patients with depression.

ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research.

PURPOSE: An essential aspect of patient-centered outcomes research (PCOR) and comparative effectiveness research (CER) is the integration of patient perspectives and experiences with clinical data to evaluate interventions. Thus, PCOR and CER require capturing patient-reported outcome (PRO) data appropriately to inform research, healthcare delivery, and policy. This initiative's goal was to identify minimum standards for the design and selection of a PRO measure for use in PCOR and CER. METHODS: We performed a literature review to find existing guidelines for the selection of PRO measures. We also conducted an online survey of the International Society for Quality of Life Research (ISOQOL) membership to solicit input on PRO standards. A standard was designated as "recommended" when >50 % respondents endorsed it as "required as a minimum standard." RESULTS: The literature review identified 387 articles. Survey response rate was 120 of 506 ISOQOL members. The respondents had an average of 15 years experience in PRO research, and 89 % felt competent or very competent providing feedback. Final recommendations for PRO measure standards included: documentation of the conceptual and measurement model; evidence for reliability, validity (content validity, construct validity, responsiveness); interpretability of scores; quality translation, and acceptable patient and investigator burden. CONCLUSION: The development of these minimum measurement standards is intended to promote the appropriate use of PRO measures to inform PCOR and CER, which in turn can improve the effectiveness and efficiency of healthcare delivery. A next step is to expand these minimum standards to identify best practices for selecting decision-relevant PRO measures.

Association of Tafamidis With Health Status in Patients With ATTR Cardiac Amyloidosis: A Post Hoc Analysis of the ATTR-ACT Randomized Clinical Trial.

Importance: Tafamidis reduced all-cause mortality and cardiovascular-related hospitalizations and minimized patient-reported health status deterioration at 30 months in patients with transthyretin (ATTR) amyloidosis. However, the clinical significance of health status changes remains unclear, particularly in patients with New York Heart Association (NYHA) class III symptoms who experienced more cardiovascular-related hospitalizations than those with NYHA class I-II symptoms. Objective: To evaluate the health status of patients taking tafamidis with baseline NYHA class III symptoms. Design, Setting, and Participants: This randomized clinical trial post hoc analysis evaluated data for patients with transthyretin (ATTR) cardiac amyloidosis and NYHA class I-III symptoms at baseline who were enrolled in ATTR-ACT, a placebo-controlled study of tafamidis held at 48 sites in 13 countries. Interventions: Tafamidis meglumine, 80 mg or 20 mg (pooled cohort), vs placebo. Main Outcomes and Measures: Established thresholds for clinical benefit on the Kansas City Cardiomyopathy Questionnaire Overall Summary (KCCQ-OS) were used to define response groups (very large decline to very large improvement); the proportion of patients in each group was calculated within each baseline NYHA class. Results: Among 441 patients (264 tafamidis, 177 placebo), the mean (SD) age was 74.3 (7.0) years; 398 (90%) were male and 43 (10%) were female. Mean (SD) baseline KCCQ-OS scores were 67.3 (21.4) in the tafamidis group and 65.9 (21.7) in the placebo group (range: 0-100, with 100 indicating the best health). There was a significant shift toward better KCCQ-OS scores in patients receiving tafamidis (odds ratio for 10-point improvement 2.4; 95% CI, 1.6-3.4; P < .001). More patients taking tafamidis were alive and not worse at all time points (37% vs 15% at month 30). These findings were similar in patients with NYHA class III symptoms. In patients with NYHA class III symptoms alive at 30 months, improvements in health status were more common (35% vs 10%) and declines were less common (38% vs 57%) with tafamidis vs placebo. Conclusions and Relevance: In ATTR-ACT, although patients with baseline NYHA class III symptoms had worse overall outcomes, treatment with tafamidis yielded better health status compared with placebo. Trial Registration: ClinicalTrials.gov Identifier: NCT01994889.

Validation of the Alopecia Areata Patient Priority Outcomes (AAPPO) Questionnaire in Adults and Adolescents with Alopecia Areata.

INTRODUCTION: Individuals with alopecia areata (AA) may experience significant impacts on their health-related quality of life. The novel Alopecia Areata Patient Priority Outcomes (AAPPO) questionnaire has been developed to assess hair loss signs, emotional symptoms, and activity limitations associated with AA. The objective of this study was to evaluate psychometric properties and establish scoring of the AAPPO in adults and adolescents with AA. METHODS: Scoring and measurement properties of the AAPPO were examined using baseline and 2-week follow-up data from a prospective, noninterventional, web-based study of 121 patients with AA (85 adults aged ≥ 18 years, 36 adolescents aged 12-17 years) with Severity of Alopecia Tool (SALT) ≥ 25% scalp hair loss. RESULTS: Exploratory and confirmatory factor analysis supported four single Hair Loss (HL) items, an Emotional Symptoms domain (ES; 4 items), and an Activity Limitations domain (AL; 3 items). Among all patients, the multi-item ES and AL domains had strong internal consistency (α ≥ 0.87); all HL items and domain scores had strong test-retest reliability (weighted kappa or intraclass correlation coefficients ≥ 0.78). All HL item scores demonstrated strong construct validity (r ≥ 0.52) compared with the patient-reported Alopecia Areata Symptom and Impact Scale (AASIS) hair loss subscale score; ES and AL domain scores exhibited strong construct validity (r ≥ 0.66) compared with the SF-36 Mental Component Summary (MCS) score. Using SALT scores, HL mean item scores were better (lower) in the 25-49% SALT subgroup versus those with highest SALT scores (76-100%); however, ES mean domain scores were better in the SALT 76-100% subgroup in the same comparison (p < 0.0001). Using AASIS and MCS score-created subgroups, ES and AL mean domain scores demonstrated hypothesized differences across subgroups (all p values < 0.0001). CONCLUSION: The AAPPO questionnaire is a reliable, valid disease-specific measure of hair loss severity and impact in individuals with AA.

A Qualitative Study to Develop and Evaluate the Content Validity of the Vitiligo Patient Priority Outcome (ViPPO) Measures.

INTRODUCTION: Vitiligo can be associated with a psychological burden, stigmatization and impaired quality of life. Tools to assess the impact of vitiligo exist; however, none were developed in line with the FDA's patient-reported outcome (PRO) Guidance for Industry. This study aimed to explore the content validity of two newly developed PRO measures to assess the impact of facial and total body vitiligo on how patients feel and function. METHODS: Draft PRO measures were developed from existing literature and input from PRO experts, a patient advocate and a clinical expert. Qualitative interviews were conducted with US participants living with vitiligo and international dermatologists with vitiligo expertise. Concept elicitation methodology explored the relevance of concepts in the draft PRO, while cognitive debriefing assessed conceptual relevance and understanding/interpretation. Items were iteratively amended/added throughout the interview study. RESULTS: The 60 participants included adults (n = 48, 63% female, 18-62 years old) and adolescents (n = 12, 67% female, 12-17 years old) with Fitzpatrick Skin Types I-VI. Expert dermatologists from the US (n = 8), EU (n = 4), India (n = 1) and Egypt (n = 1) participated. Concept elicitation was utilized to confirm the signs/symptoms of vitiligo and the associated impact on emotional/psychological wellbeing, social functioning, daily life and work/school. Conceptual saturation was achieved. Most participants reported impacts on their emotional/psychological wellbeing (n = 57, 95%), e.g. feeling self-conscious (n = 35, 58%). Participants reported impacts on social functioning (n = 53, 88%), e.g. vitiligo being noticed by others (n = 42, 70%). There was general consensus between participants and expert dermatologists. Cognitive debriefing confirmed that the items were well understood. Most items were conceptually relevant; feeling self-conscious and feeling frustrated were highly endorsed. Items were removed based on low conceptual relevance (feeling abandoned, skin roughness) and expected redundancy (four items), resulting in two measures with three proposed domain scores: Emotional/Psychological Wellbeing; Social Functioning; and Physical Sensation. No comprehension concerns were observed in relation to the 7-day recall period or the item response scale/options. Eight dermatologists reviewed the PRO measures, confirming comprehensiveness and relevance. CONCLUSION: The draft Vitiligo Patient Priority Outcomes (ViPPO) measures evaluate the impact of facial (ViPPO-F) and total body (ViPPO-T) vitiligo on emotional/psychological and social functioning. The ViPPO measures are well understood, comprehensive and content valid for adults and adolescents with vitiligo.

Key measurement concepts and appropriate clinical outcome assessments in pediatric achondroplasia clinical trials.

BACKGROUND: This study aimed to identify fit-for-purpose clinical outcome assessments (COAs) to evaluate physical function, as well as social and emotional well-being in clinical trials enrolling a pediatric population with achondroplasia. Qualitative interviews lasting up to 90 min were conducted in the US with children/adolescents with achondroplasia and/or their caregivers. Interviews utilized concept elicitation methodology to explore experiences and priorities for treatment outcomes. Cognitive debriefing methodology explored relevance and understanding of selected COAs. RESULTS: Interviews (N = 36) were conducted with caregivers of children age 0-2 years (n = 8) and 3-7 years (n = 7) and child/caregiver dyads with children age 8-11 years (n = 15) and 12-17 years (n = 6). Children/caregivers identified pain, short stature, impacts on physical functioning, and impacts on well-being (e.g. negative attention/comments) as key bothersome aspects of achondroplasia. Caregivers considered an increase in height (n = 9/14, 64%) and an improvement in limb proportion (n = 11/14, 71%) as successful treatment outcomes. The Childhood Health Assessment Questionnaire (CHAQ) and Quality of Life in Short Stature Youth (QoLISSY-Brief) were cognitively debriefed. CHAQ items evaluating activities, reaching, and hygiene were most relevant. QoLISSY-Brief items evaluating reaching, height bother, being treated differently, and height preventing doing things others could were most relevant. The CHAQ and QoLISSY-Brief instructions, item wording, response scales/options and recall period were well understood by caregivers and adolescents age 12-17. Some children aged 8-11 had difficulty reading, understanding, or required caregiver input. Feedback informed minor amendments to the CHAQ and the addition of a 7-day recall period to the QoLISSY-Brief. These amendments were subsequently reviewed and confirmed in N = 12 interviews with caregivers of children age 0-11 (n = 9) and adolescents age 12-17 (n = 3). CONCLUSIONS: Achondroplasia impacts physical functioning and emotional/social well-being. An increase in height and improvement in limb proportion are considered to be important treatment outcomes, but children/adolescents and their caregivers expect that a successful treatment should also improve important functional outcomes such as reach. The CHAQ (adapted for achondroplasia) and QoLISSY-Brief are relevant and appropriate measures of physical function and emotional/social well-being for pediatric achondroplasia trials; patient-report is recommended for age 12-17 years and caregiver-report is recommended for age 0-11 years.

Meaningful Changes in What Matters to Individuals with Vitiligo: Content Validity and Meaningful Change Thresholds of the Vitiligo Area Scoring Index (VASI).

INTRODUCTION: This study explored patients' and dermatologists' priority outcomes for treatment to address, clinical outcome assessments (COA) for use in vitiligo clinical trials, and perceptions of within-patient meaningful change in facial and total body vitiligo. METHODS: Semistructured, individual, qualitative interviews were conducted with patients living with non-segmental vitiligo in the USA and with expert dermatologists in vitiligo. Concept elicitation discussions included open-ended questions to identify patient priority outcomes. Vitiligo COAs were reviewed by dermatologists. Tasks were completed by patients to explore their perceptions of meaningful changes in vitiligo outcomes; dermatologists' opinions were elicited. Data were analyzed using thematic methods; meaningful change tasks were descriptively summarized. RESULTS: Individuals with vitiligo (N = 60) included adults (n = 48, 63% female) and adolescents (n = 12, 67% female). All Fitzpatrick Skin Types were represented. Eight (13%) were first- or second-generation immigrants to the USA. Expert dermatologists (N = 14) participated from the USA (n = 8), EU (n = 4), India (n = 1), and Egypt (n = 1). All individuals with vitiligo reported experiencing skin depigmentation; an observable clinical sign of vitiligo. Most confirmed that lesion surface area (n = 59/60, 98%) and level of pigmentation (n = 53/60, 88%) were important to include in disease assessments. Following an explanation, participants (n = 49/60, 82%) felt that the Facial Vitiligo Area Scoring Index (F-VASI) measurement generally made sense and understood that doctors would use it to assess facial vitiligo. Most participants felt that a 75% (n = 47/59, 80%) or 9 0% improvement in their facial vitiligo would be indicative of treatment success (n = 55/59, 93%). In the context of evaluating a systemic oral treatment for vitiligo, dermatologists perceived a 75% improvement on the F-VASI as successful (n = 9/14, 64%). Regarding the Total VASI (T-VASI) score, n = 30 participants considered 33% improvement as treatment success; an additional n = 10 endorsed 50% improvement and a further n = 5 endorsed 75% improvement. Clinicians most frequently identified 50% (n = 6/14, 43%) or 75% (n = 4/14, 29%) improvement in T-VASI as successful. CONCLUSION: Repigmentation is a priority outcome for patients. The VASI was considered an appropriate tool to assess the extent of vitiligo. A minimum 75% improvement from baseline in the F-VASI and minimum 50% improvement from baseline in the T-VASI were identified as within-patient clinically meaningful thresholds.