Evaluation and Modification of a Shared Decision-Making Tool for Peanut Allergy Management.

PURPOSE OF REVIEW: Based on shared decision-making (SDM) principles, a decision aid was previously developed to help patients, their caregivers, and physicians decide which peanut allergy management approach best suits them. This study refined the decision aid's content to better reflect patients' and caregivers' lived experience. RECENT FINDINGS: Current standard of care for peanut allergy is avoidance, although peanut oral immunotherapy has been approved by the Food and Drug Administration for use in patients 4-17 years old. An advisory board of allergy therapy experts (n = 3) and patient advocates (n = 3) informed modifications to the decision aid. The revised tool underwent cognitive debriefing interviews (CDIs) among adolescents (12-17 years old) with peanut allergy and caregivers of patients 4-17 years old with peanut allergy to evaluate its relevance, understandability, and usefulness. The 20 CDI participants understood the information presented in the SDM tool and reported it was important and relevant. Some revisions were made based on participant feedback. Results support content validity of the Peanut Allergy Treatment SDM Tool.

Administering selected subscales of patient-reported outcome questionnaires to reduce patient burden and increase relevance: a position statement on a modular approach.

Patient-reported outcome (PRO) questionnaires considered in this paper contain multiple subscales, although not all subscales are equally relevant for administration in all target patient populations. A group of measurement experts, developers, license holders, and other scientific-, regulatory-, payer-, and patient-focused stakeholders participated in a panel to discuss the benefits and challenges of a modular approach, defined here as administering a subset of subscales out of a multi-scaled PRO measure. This paper supports the position that it is acceptable, and sometimes preferable, to take a modular approach when administering PRO questionnaires, provided that certain conditions have been met and a rigorous selection process performed. Based on the experiences and perspectives of all stakeholders, using a modular approach can reduce patient burden and increase the relevancy of the items administered, and thereby improve measurement precision and eliminate wasted data without sacrificing the scientific validity and utility of the instrument. The panelists agreed that implementing a modular approach is not expected to have a meaningful impact on item responses, subscale scores, variability, reliability, validity, and effect size estimates; however, collecting additional evidence for the impact of context may be desirable. It is also important to recognize that adequate rationale and evidence (e.g., of fit-for-purpose status and relevance to patients) and a robust consensus process that includes patient perspectives are required to inform selection of subscales, as in any other measurement circumstance, is expected. We believe that the considerations discussed within (content validity, administration context, and psychometric factors) are relevant across multiple therapeutic areas.

A Comparative Evaluation of the Measurement Properties of Three Histological Indices of Mucosal Healing in Ulcerative Colitis: Geboes Score, Robarts Histopathology Index and Nancy Index.

BACKGROUND AND AIMS: To inform their future use in regulated clinical trials to evaluate treatment efficacy hypotheses, the measurement properties of three histological indices, Geboes Score [GS], Robarts Histopathology Index [RHI] and Nancy Index [NI], were evaluated among patients with ulcerative colitis. METHODS: Analyses were conducted on data from a Phase 3 clinical trial of adalimumab [M14-033, n = 491] and focused on evaluating the measurement properties of the GS, RHI and NI. Specifically, internal consistency and inter-rater reliability, convergent, discriminant and known-group validity, and sensitivity to change were assessed at Baseline, and at Weeks 8 and 52. RESULTS: Internal consistency for the RHI showed lower alpha [α] values at Baseline [α = 0.62] relative to Weeks 8 [α = 0.82] and 52 [α = 0.81]. The inter-rater reliability values of RHI [0.91], NI [0.64] and GS [0.53] were excellent, good and fair, respectively. Regarding validity, Week 52 correlations were moderate to strong between full and partial Mayo scores and Mayo subscale scores and the RHI and GS, and were weak to moderate for the NI. Significant differences between mean scores of all three histological indices were observed across known-groups based on Mayo endoscopy subscores and full Mayo scores at Weeks 8 and 52 [p < 0.001]. CONCLUSIONS: The GS, RHI and NI are each capable of producing reliable and valid scores that are sensitive to changes in disease activity over time, in patients with moderately to severely active ulcerative colitis. While all three indices demonstrated relatively acceptable measurement properties, the GS and RHI performed better than the NI.

Psychometric evaluation of the NTDT-PRO questionnaire for assessing symptoms in patients with non-transfusion-dependent beta-thalassaemia.

OBJECTIVES: The non-transfusion-dependent beta-thalassaemia-patient-reported outcome (NTDT-PRO) questionnaire was developed for assessing anaemia-related tiredness/weakness (T/W) and shortness of breath (SoB) among patients with NTDT. Psychometric properties were evaluated using blinded data from the BEYOND trial (NCT03342404). DESIGN: Analysis of a phase 2, double-blind, randomised, placebo-controlled trial. SETTING: USA, Greece, Italy, Lebanon, Thailand and the UK. PARTICIPANTS: Adults (≥18 years) (N=145) with NTDT who had not received a red blood cell transfusion within 8 weeks prior to randomisation, with mean baseline haemoglobin level ≤100 g/L. MEASURES: NTDT-PRO daily scores from baseline until week 24, and scores at select time points for the 36-Item Short Form Health Survey version 2 (SF-36v2), Functional Assessment of Chronic Illness Therapy-Fatigue (FACIT-F) and Patient Global Impression of Severity (PGI-S). RESULTS: Cronbach's alpha at weeks 13-24 was 0.95 and 0.84 for the T/W and SoB domains, respectively, indicating acceptable internal consistency reliability. Among participants self-reporting no change in thalassaemia symptoms via the PGI-S between baseline and week 1, intraclass correlation coefficients were 0.94 and 0.92 for the T/W and SoB domains, respectively, indicating excellent test-retest reliability. In a known-groups validity analysis, least-squares mean T/W and SoB scores at weeks 13-24 were worse in participants with worse scores for the FACIT-F Fatigue Subscale (FS), SF-36v2 vitality or PGI-S. Indicating responsiveness, changes in T/W and SoB domain scores were moderately correlated with changes in haemoglobin levels, and strongly correlated with changes in SF-36v2 vitality, FACIT-F FS, select FACIT-F items and the PGI-S. Improvements in least-squares mean T/W and SoB scores were higher in participants with greater improvements in scores on other PROs measuring similar constructs. CONCLUSIONS: The NTDT-PRO demonstrated adequate psychometric properties to assess anaemia-related symptoms in adults with NTDT and can be used to evaluate treatment efficacy in clinical trials.

Psychometric evaluation of the Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF©) and determination of a threshold score for moderate symptoms.

BACKGROUND: The Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) (©Blueprint Medicines Corporation), a 12-item daily diary that assesses 11 signs and symptoms of indolent systemic mastocytosis (ISM) and smoldering systemic mastocytosis (SSM), was psychometrically evaluated among patients with ISM. Additionally, thresholds of the ISM-SAF total symptom score (TSS) to distinguish patients with moderate to severe symptoms from those with mild symptoms were evaluated. METHODS: The ISM-SAF was completed daily as an electronic diary in a prospective, observational study utilizing an online survey of patients with ISM in the United States. Descriptive statistics, psychometric analyses, and analyses to estimate ISM-SAF TSS clinical cutoff values were conducted. RESULTS: A total of 103 patients (81.6% female; mean age = 50.2 [± 12.6]) with a self-reported diagnosis of ISM or SSM (58 of whom also had a medically documented diagnosis) contributed to the analyses. Psychometric analysis supported the trustworthiness of the biweekly TSS, which was reliable (α > 0.8, ICC > 0.9), construct-valid, and able to distinguish among clinically distinct groups as specified by the Patient Global Impression of Severity, 12-item Short-Form Health Survey, and Mastocytosis Quality of Life Questionnaire (p < 0.01). A biweekly ISM-SAF TSS from 21 to 28 begins to distinguish the moderately to severely symptomatic ISM/SSM patients from mildly symptomatic patients. CONCLUSION: The biweekly TSS of ISM-SAF was reliable, construct-valid, and able to distinguish among clinically distinct groups. A cut-off value of 28 is a conservative threshold that can be used for screening purposes in future clinical studies to identify patients with at least a moderate severity of ISM symptoms.

Psychometric performance of the Primary Mitochondrial Myopathy Symptom Assessment (PMMSA) in a randomized, double-blind, placebo-controlled crossover study in subjects with mitochondrial disease.

BACKGROUND: The Primary Mitochondrial Myopathy Symptom Assessment (PMMSA) is a 10-item patient-reported outcome (PRO) measure designed to assess the severity of mitochondrial disease symptoms. Analyses of data from a clinical trial with PMM patients were conducted to evaluate the psychometric properties of the PMMSA and to provide score interpretation guidelines for the measure. METHODS: The PMMSA was completed as a daily diary for approximately 14 weeks by individuals in a Phase 2 randomized, placebo-controlled crossover trial evaluating the safety, tolerability, and efficacy of subcutaneous injections of elamipretide in patents with mitochondrial disease. In addition to the PMMSA, performance-based assessments, clinician ratings, and other PRO measures were also completed. Descriptive statistics, psychometric analyses, and score interpretation guidelines were evaluated for the PMMSA. RESULTS: Participants (N = 30) had a mean age of 45.3 years, with the majority of the sample being female (n = 25, 83.3%) and non-Hispanic white (n = 29, 96.6%). The 10 PMMSA items assessing a diverse symptomology were not found to form a single underlying construct. However, four items assessing tiredness and muscle weakness were grouped into a "general fatigue" domain score. The PMMSA Fatigue 4 summary score (4FS) demonstrated stable test-retest scores, internal consistency, correlations with the scores produced by reference measures, and the ability to differentiate between different global health levels. Changes on the PMMSA 4FS were also related to change scores produced by the reference measures. PMMSA severity scores were higher for the symptom rated as "most bothersome" by each subject relative to the remaining nine PMMSA items (most bothersome symptom mean = 2.88 vs. 2.18 for other items). Distribution- and anchor-based evaluations suggested that reduction in weekly scores between 0.79 and 2.14 (scale range: 4-16) may represent a meaningful change on the PMMSA 4FS and reduction in weekly scores between 0.03 and 0.61 may represent a responder for each of the remaining six non-fatigue items, scored independently. CONCLUSIONS: Upon evaluation of its psychometric properties, the PMMSA, specifically the 4FS domain, demonstrated strong reliability and construct-related validity. The PMMSA can be used to evaluate treatment benefit in clinical trials with individuals with PMM. Trial registration ClinicalTrials.gov identifier, NCT02805790; registered June 20, 2016; https://clinicaltrials.gov/ct2/show/NCT02805790 .

Development of symptom-focused outcome measures for advanced and indolent systemic mastocytosis: the AdvSM-SAF and ISM-SAF©.

BACKGROUND: Advanced systemic mastocytosis (AdvSM), indolent systemic mastocytosis (ISM), and smoldering systemic mastocytosis (SSM) are rare diseases characterized by neoplastic mast cell infiltration of more than one organ. A content-valid patient-reported outcome (PRO) questionnaire that assesses relevant signs and symptoms that are important and understandable to individuals with a condition is critical for assessing new treatment benefit as well as supporting product labeling claims. Notably, no such PRO questionnaire has been developed in accordance with regulatory and scientific guidelines for use in AdvSM, ISM, and SSM patient populations. To fill that gap, this study documents the development and content validity of instruments evaluating signs and symptoms of systemic mastocytosis. METHODS: A review of peer-reviewed literature, advice meetings with clinical therapeutic area experts, patient concept elicitation interviews, concept selection and questionnaire construction meetings, and patient cognitive debriefing interviews were conducted, and regulatory feedback was incorporated. RESULTS: For AdvSM, 26 sign- and symptom-level concepts were identified in literature, 39 by clinicians, and 33 by patients. For ISM/SSM, 38 sign- and symptom-level concepts were identified in the literature, 39 by clinicians, and 57 by patients. Two patient-reported instruments, the Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF) and Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF)(©Blueprint Medicines Corporation), were developed based on consolidated findings. Cognitive debriefing interviews with AdvSM and ISM patients showed the AdvSM-SAF and ISM-SAF were understood and interpreted as intended by the majority of patients. CONCLUSION: The AdvSM-SAF and ISM-SAF are content-valid tools measuring symptoms from AdvSM and ISM patients' perspective.

Psychometric evaluation of the Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) in a phase 2 clinical study.

BACKGROUND: Indolent systemic mastocytosis (ISM) is a rare, clonal mast cell neoplasm characterized by severe, unpredictable symptoms. The Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) items compose a Total Symptom Score (TSS), Gastrointestinal Symptom Score (GSS), and Skin Symptom Score (SSS) to assess symptom severity. This study evaluated the psychometric performance of ISM-SAF among ISM patients. METHODS: In PIONEER, a Phase 2 trial evaluating safety and efficacy of selective kinase inhibitor avapritinib in patients with ISM, the 12-item ISM-SAF was administered daily. Psychometric evaluation of score reliability, validity, and clinical interpretation was conducted using the trial data. RESULTS: Thirty-eight patients contributed to analyses (78.9% female; mean age = 49). Baseline internal consistency reliability (α) for bi-weekly TSS, GSS, and SSS was 0.86, 0.83, and 0.82, respectively. Test-retest reliability among patients exhibiting no change in Patient Global Impression of Symptom Severity (PGIS) between Baseline and Day 15 exceeded 0.74 universally. Construct validity and known-groups analysis showed moderate to strong ISM-SAF score correlation (r = 0.382-0.881) to supportive patient-reported questionnaires (e.g., PGIS and Mastocytosis Quality of Life Questionnaire) symptom and skin scores, and ability to distinguish among clinically unique groups. Correlations of ISM-SAF and other assessment change scores reflect evidence of score sensitivity. Clinically important difference and response estimates were 7-10 and 19, respectively. DISCUSSION: ISM-SAF produced reliable, construct-valid, sensitive scores when administered in PIONEER to patients in the target population. Results of this study support the use of the ISM-SAF as a reliable and valid measure to evaluate disease symptomology in ISM patients. Trial registration ClinicalTrials.gov, NCT03731260. Registered 10 October 2018, https://clinicaltrials.gov/ct2/show/study/NCT03731260 .

Clinically Relevant Activity of the Novel RASP Inhibitor Reproxalap in Allergic Conjunctivitis: The Phase 3 ALLEVIATE Trial.

PURPOSE: To assess the post-acute activity and clinical utility of reproxalap, a novel reactive aldehyde species (RASP) inhibitor, versus vehicle in patients with seasonal allergic conjunctivitis. DESIGN: Parallel-group, double-masked, randomized Phase 3 trial. METHODS: Two topical ocular reproxalap concentrations (0.25% and 0.5%) were evaluated versus vehicle in patients with allergic conjunctivitis randomized 1:1:1 and treated with test article 10 minutes prior to conjunctival seasonal allergen challenge. The primary endpoint was area under the post-acute ocular itching score (range = 0-4) curve from 10 to 60 minutes after challenge. The key secondary endpoint was the proportion of subjects with ≥2 points improvement from their peak ocular itching score at baseline. RESULTS: A total of 318 patients were randomized at 11 US sites. Both concentrations of reproxalap (0.25% and 0.5%) achieved the primary endpoint (P < .0001 and P = .003, respectively) and the key secondary endpoint (P = .0005 and P = .02, respectively). Time to complete resolution of ocular itching was statistically faster for both reproxalap concentrations than for vehicle (P < .0001 and P = .001, respectively). No safety or tolerability concerns were noted. The most common adverse event was mild and transient instillation site irritation. CONCLUSION: Reproxalap was effective at reducing ocular itching in patients with allergic conjunctivitis. Reproxalap activity was clinically relevant, as assessed by responder-based and distributional analyses. ALLEVIATE represents one of the first allergic conjunctivitis Phase 3 trials of a novel mechanism of action in decades, and is unique among conjunctival allergen challenge trials in assessing clinical relevance with standard and validated techniques.

Psychometric evaluation of the Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF).

BACKGROUND: The Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF) was developed to evaluate symptoms of advanced systemic mastocytosis (AdvSM). This study aimed to psychometrically evaluate AdvSM-SAF scores and provide score interpretation guidelines. METHODS: The 10-item AdvSM-SAF was administered daily (scored as a seven-day average) in EXPLORER, an open-label Phase 1 study in AdvSM. Score distribution, reliability, construct-related validity, sensitivity to change, and interpretation guidelines were evaluated for AdvSM-SAF items, gastrointestinal symptom score (GSS), skin symptom score (SSS), and total symptom score (TSS). RESULTS: Thirty-one patients contributed to the analyses. At Baseline, the GSS, SSS, and TSS had adequate internal consistency (α > 0.7) and test-retest reliability (intraclass correlation coefficients >0.7). AdvSM-SAF scores were moderately to strongly correlated with variables as expected, and distinguished among clinically distinct groups. Observed relationships between change scores in the AdvSM-SAF and other assessments reflect evidence that AdvSM-SAF scores change in concert with other assessments designed to measure similar constructs. The magnitude of AdvSM-SAF weekly TSS mean change scores based on different anchor groupings was as expected (improvement > stable > worsening). Candidate clinically meaningful between-group difference estimates (GSS = 2-4, SSS = 2-3, and TSS = 4-7 points) and within-person change estimates (GSS = 6-9, SSS = 1-4, TSS = 9-14) for AdvSM-SAF weekly scores were generated. CONCLUSION: The AdvSM-SAF produced reliable, construct-valid, and sensitive scores when administered in the target patient population. These results, along with its strong development history and evidence of content validity, indicate that the AdvSM-SAF is fit for the purpose of measuring treatment benefit in individuals with AdvSM.