Psychometric evaluation of the Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF©) and determination of a threshold score for moderate symptoms.

BACKGROUND: The Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) (©Blueprint Medicines Corporation), a 12-item daily diary that assesses 11 signs and symptoms of indolent systemic mastocytosis (ISM) and smoldering systemic mastocytosis (SSM), was psychometrically evaluated among patients with ISM. Additionally, thresholds of the ISM-SAF total symptom score (TSS) to distinguish patients with moderate to severe symptoms from those with mild symptoms were evaluated. METHODS: The ISM-SAF was completed daily as an electronic diary in a prospective, observational study utilizing an online survey of patients with ISM in the United States. Descriptive statistics, psychometric analyses, and analyses to estimate ISM-SAF TSS clinical cutoff values were conducted. RESULTS: A total of 103 patients (81.6% female; mean age = 50.2 [± 12.6]) with a self-reported diagnosis of ISM or SSM (58 of whom also had a medically documented diagnosis) contributed to the analyses. Psychometric analysis supported the trustworthiness of the biweekly TSS, which was reliable (α > 0.8, ICC > 0.9), construct-valid, and able to distinguish among clinically distinct groups as specified by the Patient Global Impression of Severity, 12-item Short-Form Health Survey, and Mastocytosis Quality of Life Questionnaire (p < 0.01). A biweekly ISM-SAF TSS from 21 to 28 begins to distinguish the moderately to severely symptomatic ISM/SSM patients from mildly symptomatic patients. CONCLUSION: The biweekly TSS of ISM-SAF was reliable, construct-valid, and able to distinguish among clinically distinct groups. A cut-off value of 28 is a conservative threshold that can be used for screening purposes in future clinical studies to identify patients with at least a moderate severity of ISM symptoms.

Psychometric performance of the Primary Mitochondrial Myopathy Symptom Assessment (PMMSA) in a randomized, double-blind, placebo-controlled crossover study in subjects with mitochondrial disease.

BACKGROUND: The Primary Mitochondrial Myopathy Symptom Assessment (PMMSA) is a 10-item patient-reported outcome (PRO) measure designed to assess the severity of mitochondrial disease symptoms. Analyses of data from a clinical trial with PMM patients were conducted to evaluate the psychometric properties of the PMMSA and to provide score interpretation guidelines for the measure. METHODS: The PMMSA was completed as a daily diary for approximately 14 weeks by individuals in a Phase 2 randomized, placebo-controlled crossover trial evaluating the safety, tolerability, and efficacy of subcutaneous injections of elamipretide in patents with mitochondrial disease. In addition to the PMMSA, performance-based assessments, clinician ratings, and other PRO measures were also completed. Descriptive statistics, psychometric analyses, and score interpretation guidelines were evaluated for the PMMSA. RESULTS: Participants (N = 30) had a mean age of 45.3 years, with the majority of the sample being female (n = 25, 83.3%) and non-Hispanic white (n = 29, 96.6%). The 10 PMMSA items assessing a diverse symptomology were not found to form a single underlying construct. However, four items assessing tiredness and muscle weakness were grouped into a "general fatigue" domain score. The PMMSA Fatigue 4 summary score (4FS) demonstrated stable test-retest scores, internal consistency, correlations with the scores produced by reference measures, and the ability to differentiate between different global health levels. Changes on the PMMSA 4FS were also related to change scores produced by the reference measures. PMMSA severity scores were higher for the symptom rated as "most bothersome" by each subject relative to the remaining nine PMMSA items (most bothersome symptom mean = 2.88 vs. 2.18 for other items). Distribution- and anchor-based evaluations suggested that reduction in weekly scores between 0.79 and 2.14 (scale range: 4-16) may represent a meaningful change on the PMMSA 4FS and reduction in weekly scores between 0.03 and 0.61 may represent a responder for each of the remaining six non-fatigue items, scored independently. CONCLUSIONS: Upon evaluation of its psychometric properties, the PMMSA, specifically the 4FS domain, demonstrated strong reliability and construct-related validity. The PMMSA can be used to evaluate treatment benefit in clinical trials with individuals with PMM. Trial registration ClinicalTrials.gov identifier, NCT02805790; registered June 20, 2016; https://clinicaltrials.gov/ct2/show/NCT02805790 .

Psychometric evaluation of the Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) in a phase 2 clinical study.

BACKGROUND: Indolent systemic mastocytosis (ISM) is a rare, clonal mast cell neoplasm characterized by severe, unpredictable symptoms. The Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) items compose a Total Symptom Score (TSS), Gastrointestinal Symptom Score (GSS), and Skin Symptom Score (SSS) to assess symptom severity. This study evaluated the psychometric performance of ISM-SAF among ISM patients. METHODS: In PIONEER, a Phase 2 trial evaluating safety and efficacy of selective kinase inhibitor avapritinib in patients with ISM, the 12-item ISM-SAF was administered daily. Psychometric evaluation of score reliability, validity, and clinical interpretation was conducted using the trial data. RESULTS: Thirty-eight patients contributed to analyses (78.9% female; mean age = 49). Baseline internal consistency reliability (α) for bi-weekly TSS, GSS, and SSS was 0.86, 0.83, and 0.82, respectively. Test-retest reliability among patients exhibiting no change in Patient Global Impression of Symptom Severity (PGIS) between Baseline and Day 15 exceeded 0.74 universally. Construct validity and known-groups analysis showed moderate to strong ISM-SAF score correlation (r = 0.382-0.881) to supportive patient-reported questionnaires (e.g., PGIS and Mastocytosis Quality of Life Questionnaire) symptom and skin scores, and ability to distinguish among clinically unique groups. Correlations of ISM-SAF and other assessment change scores reflect evidence of score sensitivity. Clinically important difference and response estimates were 7-10 and 19, respectively. DISCUSSION: ISM-SAF produced reliable, construct-valid, sensitive scores when administered in PIONEER to patients in the target population. Results of this study support the use of the ISM-SAF as a reliable and valid measure to evaluate disease symptomology in ISM patients. Trial registration ClinicalTrials.gov, NCT03731260. Registered 10 October 2018, https://clinicaltrials.gov/ct2/show/study/NCT03731260 .

Psychometric evaluation of the Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF).

BACKGROUND: The Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF) was developed to evaluate symptoms of advanced systemic mastocytosis (AdvSM). This study aimed to psychometrically evaluate AdvSM-SAF scores and provide score interpretation guidelines. METHODS: The 10-item AdvSM-SAF was administered daily (scored as a seven-day average) in EXPLORER, an open-label Phase 1 study in AdvSM. Score distribution, reliability, construct-related validity, sensitivity to change, and interpretation guidelines were evaluated for AdvSM-SAF items, gastrointestinal symptom score (GSS), skin symptom score (SSS), and total symptom score (TSS). RESULTS: Thirty-one patients contributed to the analyses. At Baseline, the GSS, SSS, and TSS had adequate internal consistency (α > 0.7) and test-retest reliability (intraclass correlation coefficients >0.7). AdvSM-SAF scores were moderately to strongly correlated with variables as expected, and distinguished among clinically distinct groups. Observed relationships between change scores in the AdvSM-SAF and other assessments reflect evidence that AdvSM-SAF scores change in concert with other assessments designed to measure similar constructs. The magnitude of AdvSM-SAF weekly TSS mean change scores based on different anchor groupings was as expected (improvement > stable > worsening). Candidate clinically meaningful between-group difference estimates (GSS = 2-4, SSS = 2-3, and TSS = 4-7 points) and within-person change estimates (GSS = 6-9, SSS = 1-4, TSS = 9-14) for AdvSM-SAF weekly scores were generated. CONCLUSION: The AdvSM-SAF produced reliable, construct-valid, and sensitive scores when administered in the target patient population. These results, along with its strong development history and evidence of content validity, indicate that the AdvSM-SAF is fit for the purpose of measuring treatment benefit in individuals with AdvSM.

Development of a Patient-Reported Outcome Questionnaire to Evaluate Primary Mitochondrial Myopathy Symptoms: The Primary Mitochondrial Myopathy Symptom Assessment.

OBJECTIVES: Primary mitochondrial myopathy (PMM) is a genetic condition characterized by life-limiting symptoms such as muscle weakness, fatigue, and pain. Because these symptoms are best reported by individuals with PMM, the objective of this qualitative research study was to develop a PMM-specific patient-reported outcome (PRO) questionnaire. METHOD: Individuals with PMM were interviewed, identifying the most salient symptoms of PMM and assessing the resulting questionnaire's relevance and comprehensibility. RESULTS: Developed based on patient interviews, the 10-item Primary Mitochondrial Myopathy Symptom Assessment assesses patients' symptom experiences at their worst in the last 24 hours. Individuals with PMM confirmed the concepts of the questionnaire as relevant and comprehensive to their symptom experiences and responded to the items consistently with developers' intentions. CONCLUSIONS: The Primary Mitochondrial Myopathy Symptom Assessment is a content-valid PRO questionnaire with qualitative and quantitative support as a valuable tool to evaluate and monitor the day-to-day experience of PMM symptoms from the patient perspective.

Development of a symptom assessment in patients with myelofibrosis: qualitative study findings.

BACKGROUND: The goal of the research reported here was to understand the patient experience of living with myelofibrosis (MF) and establish content validity of the Modified Myeloproliferative Neoplasm Symptom Assessment Diary (MPN-SD). METHODS: Qualitative interviews were performed in patients with MF, including both concept elicitation and cognitive debriefing. Patients with MF were asked to spontaneously report on their signs, symptoms, and impacts of MF, as well as their understanding of the MPN-SD content, and use of the tool on an electronic platform. A supplementary literature review and meetings with MF experts were also performed. RESULTS: Twenty-three patients with MF participated in qualitative interviews. Signs and symptoms most commonly reported by ruxolitinib-experienced patients (n = 16) were: fatigue and/or tiredness (n = 16, 100%), shortness of breath (n = 11, 69%), pain below the ribs on the left side and/or stomach pain and/or abdominal pain (n = 9, 56%), and enlarged spleen (n = 9, 56%) and for ruxolitinib-naïve patients (n = 7) were: fatigue and/or tiredness (n = 6, 86%), pain below the ribs on the left side (n = 6, 86%), enlarged spleen (n = 4, 57%), full quickly/filling up quickly (n = 4, 57%), night sweats and/or general sweats (n = 4, 57%), and itching (n = 4, 57%). Patients demonstrated that they were able to read, understand, and provide meaningful responses to the MPN-SD. The final version of the MPN-SD includes the 10 most commonly reported concepts from the MF patient interviews. CONCLUSIONS: The findings demonstrate the comprehensiveness of the MPN-SD in assessing MF symptoms in both ruxolitinib-experienced and ruxolitinib-naïve patients, while remaining easy for patients to understand and complete.

Informing a priori Sample Size Estimation in Qualitative Concept Elicitation Interview Studies for Clinical Outcome Assessment Instrument Development.

OBJECTIVE: Evidence-based recommendations for the a priori estimation of sample size are needed for qualitative concept elicitation (CE) interview studies in clinical outcome assessment (COA) instrument development. Saturation is described as the point at which no new data is expected to emerge from the conduct of additional qualitative interviews. STUDY DESIGN: A retrospective evaluation of 26 CE interview studies conducted with patients between 2006 and 2013 was completed to assess the point at which saturation of concept was achieved in each study. METHODS: For each of the 26 interview studies, saturation of symptom concepts was assessed by dividing the sample into quartiles and then comparing the number of responses elicited from the first 25% of participants to the next 25% of participants, from the first 50% of participants to the next 25% of participants, and then from the first 75% of participants to the last 25% of participants. The number of interviews required to achieve saturation was documented for each study and then summarized across studies. RESULTS: Findings indicate that 84% of symptom concepts emerged by the 10th interview, 92% emerged by the 15th interview, 97% emerged by the 20th interview, and 99% by the 25th interview. CONCLUSIONS: Results provide practical guidance for estimating the number of interviews that may be needed to achieve saturation in a qualitative CE interview study for COA instrument development; address an important gap in qualitative research for the development of COAs in the context of medical product development; and offer useful information for study design and implementation.

Development and psychometric evaluation of the self-assessment of psoriasis symptoms (SAPS) - clinical trial and the SAPS - real world patient-reported outcomes.

OBJECTIVE: The Self-Assessment of Psoriasis Symptoms - Clinical Trials (SAPS-CT) and SAPS - Real World (SAPS-RW) were simultaneously created to assess the experience of plaque psoriasis in two unique contexts. METHODS: Qualitative and quantitative research was conducted in four phases namely concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. RESULTS: Following concept elicitation, 18 concepts were selected to inform questionnaire construction of the SAPS-CT and SAPS-RW. To accommodate each context of use, the SAPS-CT asks respondents to rate the target symptom 'at its worst' in the 24 h prior to assessment, while the SAPS-RW asks respondents to rate the target symptom "on average" in the 7 days prior to assessment. Cognitive debriefing confirmed that patients could comprehend and provide meaningful responses to both versions and, after minor modifications, resulted in 11-item questionnaires administered in an observational study (N = 200). Results from the observational study informed further item reduction (SAPS-RW to six items and SAPS-CT to nine items) and demonstrated that scores from each were reliable (Cronbach's α > 0.90, test-retest intraclass correlation coefficient >0.70), construct valid and able to differentiate among clinically distinct groups. CONCLUSION: The SAPS-CT and SAPS-RW are content-valid PRO questionnaires capable of producing psychometrically sound scores when administered chronic to plaque psoriasis patients.

Development and Content Validity of the Statin Experience Assessment Questionnaire (SEAQ)©.

INTRODUCTION: The National Lipid Association Statin Intolerance (SI) Panel recognized the need for better understanding of the patient SI experience. OBJECTIVE: The objective of this research was to develop a patient-reported outcome (PRO) questionnaire to assess a patient's experience with SI. METHODS: Questionnaire development was informed via a series of research activities: literature review, concept elicitation, item generation, and content evaluation. Following the literature review and concept elicitation, a draft questionnaire was constructed and subsequently modified based on feedback from therapeutic area experts and patients via cognitive debriefing interviews. RESULTS: Muscle-related symptoms were the most commonly reported symptoms associated with SI in the literature review (35 of 41 articles reviewed [85%]) and in semi-structured interviews with experts (n = 5 [100%]) and patients (n = 17 of 20 [85.0%]). Physical and other impacts of SI symptoms on daily activities were also frequently reported. A 17-item draft questionnaire was created, and cognitive debriefing with experts (n = 5) and patients (n = 15) was conducted. Overall, the items, response options, and instructions were comprehensible and positively reviewed; minor changes resulted in the 15-item Statin Experience Assessment Questionnaire (SEAQ)©. Using a 30-day recall period, the SEAQ© assesses the severity and impact of six SI symptoms (muscle ache, muscle pain, muscle cramps, muscle weakness, tiredness, and joint pain) on an 11-point numeric scale. Statin discontinuation and likelihood of discontinuation due to symptoms are assessed and scored on a yes/no and five-point verbal response scale, respectively. CONCLUSION: The SEAQ

Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers.

A. A. Stone and S. Shiffman (1994) defined ecological momentary assessment (EMA) as monitoring or sampling strategies that assess phenomena at the moment they occur in natural settings, thus maximizing ecological validity while avoiding retrospective recall. To address the extent to which EMA affects the behaviors and cognitions under observation, the authors examined behavioral and motivational reactivity to EMA among male and female undergraduate problem drinkers (n = 33). Participants completed a 2-week monitoring protocol using palmtop computers as well as pre- and postmonitoring measures of their drinking behavior and motivation for change. The findings suggest that the magnitude of reactivity to EMA is small. Suggestions for future research are presented.