Providing meaningful interpretation of performance outcome measures by co-calibration with patient-reported outcomes through the Rasch model: illustration with multiple sclerosis measures.

Performance outcome (PerfO) measures are based on tasks performed by patients in a controlled environment, making their meaningful interpretation challenging to establish. Co-calibrating PerfO and patient-reported outcome (PRO) measures of the same target concept allow for interpretation of the PerfO with the item content of the PRO. The Rasch model applied to the discretized PerfO measure together with the PRO items allows expressing parameters related to the PerfO measure in the PRO metric for it to be linked to the PRO responses. We applied this approach to two PerfO measures used in multiple sclerosis (MS) for walking and manual ability: the Timed 25-Foot Walk (T25FW) and the 9-Hole Peg Test (9HPT). To determine meaningful interpretation of these two PerfO measures, they were co-calibrated with two PRO measures of closely related concepts, the MS walking scale - 12 items (MSWS-12) and the ABILHAND, using the data of 2,043 subjects from five global clinical trials in MS. The probabilistic relationships between the PerfO measures and the PRO metrics were used to express the response pattern to the PRO items as a function of the unit of the PerfOs. This example illustrates the promises of the co-calibration approach for the interpretation of PerfO measures but also highlights the challenges associated with it, mostly related to the quality of the PRO metric in terms of coverage of the targeted concept. Co-calibration with PRO measures could also be an adequate solution for interpretation of digital sensor measures whose meaningfulness is also often questioned.

Measuring the Patient Experience in Rare Disorders: Benefit of Pragmatic Mixed-Methods Research in NUT Carcinoma.

INTRODUCTION: Patient-centered outcome measurement (PCOM) is essential to capture the outcomes important to patients. However, it presents unique challenges in rare diseases, particularly those that are "young" (not diagnosed before the twenty-first century), with limited literature, lack of disease-specific patient-reported outcome (PRO) measures, and difficult sampling and data collection. One example of this is NUT (nuclear protein in testis) carcinoma (NUTca), a rare and rapidly progressing cancer, with tumors preliminary in the head, neck, and lungs. The published literature on NUTca is scarce. The limited number of case reports focus primarily on the clinical development and presentation of tumors. Currently, there are no publications describing the patient experience of NUTca and no specific PRO measures to assess the patient experience. We conducted mixed-methods research, including concept elicitation interviews, cognitive debriefing, and quantitative data analyses, to fill this evidence gap and describe challenges and solutions in the context of NUTca. METHODS: As published previously, our conceptualization of NUTca was based on elicitation interviews with 27 participants (n = 10 patients; n = 17 caregivers) using a semi-structured format; this framework formed the basis for a bolt-on strategy to develop a bespoke PRO measure based on the EORTC QLQ-C30, supplemented by targeted items from the EORTC Item Library and new items. In this publication, 20 participants were interviewed (n = 10 patients; n = 10 caregivers) to debrief items. Given the variety of tumor locations and related symptoms, and the small sample of patients providing responses to location-specific symptom items, we used response option endorsement frequencies to illuminate the variability of response for the concepts measured. RESULTS: This study highlights the challenges in implementing patient-centric research to inform and develop PRO measures in rare diseases. CONCLUSIONS: Our mixed-methods research used pragmatic solutions to collect patient experience data and provides an evidence base to inform PCOM in clinical programs in this rapidly progressing rare cancer with high unmet need.

Understanding the Patient Experience in NUT Carcinoma: Qualitative Interviews with Patients and Caregivers to Develop a Conceptual Framework.

INTRODUCTION: NUT (nuclear protein of the testis) carcinoma (NUTca) is a rare and aggressive cancer that is genetically hallmarked by a chromosomal abnormality in the NUT gene, and presents with tumors in the head, neck, and lungs. Currently there is no standard of care, but patients may undergo surgery, radiation, and/or chemotherapy. There is a lack of published research describing the patient experience of NUTca. The objective of this study was to develop a conceptual framework (CF) that describes patients' experience of NUTca to inform the selection of outcome measures and design of patient-centric endpoints for future clinical research. METHODS: Individual, semi-structured telephone interviews were conducted with patients and caregivers of patients who have/had NUTca (caregivers interviewed due to recruitment challenges resulting from the rarity of NUTca). Participants were asked about their disease symptoms, impacts, and treatment experience. Interviews were audio-recorded, transcribed, and analyzed using inductive coding. The CF was developed through inductive categorization of concepts, sub-domains, and domains. RESULTS: Twenty-seven interviews were completed (patients n = 10; caregivers n = 17). Participants reported systemic symptoms (e.g., fatigue) and symptoms related to the location of the tumor (e.g., nose blockage for head/neck tumor). Pain emerged as an important and bothersome symptom across tumor locations. Participants reported impacts on their daily activities (e.g., showering), emotions (e.g., preoccupation), sleep, social life (e.g., isolation), roles (e.g., caring for children), and finances. The final CF was organized into four symptom domains [systemic, location-specific (head/neck, lung), pain, and digestive] and six impact domains (daily activities, emotional, sleep, social, role, and financial). CONCLUSIONS: This study describes the patient experience of NUTca and proposes an evidence-based CF that informs both the clinical community's understanding of the disease and selection of a patient-reported outcome (PRO) measure to assess treatment benefit in future NUTca trials.

Measuring patient-reported physical functioning and fatigue in myelodysplastic syndromes using a modular approach based on EORTC QLQ-C30.

PURPOSE: Physical functioning and fatigue are key patient concerns in myelodysplastic syndromes (MDS), chronic myelomonocytic leukemia (CMML), and acute myeloid leukemia (AML). The objective of this research was to generate supportive quantitative evidence for modular physical functioning and fatigue measures based on the European Organisation for Research and Treatment of Cancer (EORTC) Quality of Life Questionnaire Core 30 items (QLQ-C30) and a customized selection of 10 supplemental items from the EORTC Item Library. METHODS: The 40 items were completed online cross-sectionally by 51 patients (higher risk [HR] MDS: 53%; CMML: 26%; AML: 10%). Psychometric analyses based on Rasch measurement theory (RMT) were conducted on the QLQ-C30 physical functioning and fatigue domains as well as measures combining QLQ-C30 and supplemental items. A measure of anemia-related symptoms composed of QLQ-C30 and supplemental items covering fatigue, dyspnea, and dizziness was also investigated. RESULTS: The QLQ-C30 physical functioning and fatigue domains showed good targeting to the sample and adequate reliability, with few conceptual gaps identified. Combining the QLQ-C30 and supplemental physical functioning and fatigue items improved the conceptual coverage and the reliability of the measures. The patient-reported anemia-related symptom measure showed good measurement performance, underpinned by a clinically meaningful characterization of severity of these symptoms over a spectrum, starting with fatigue, then dyspnea, and finally dizziness (most severe). CONCLUSION: The modular measurement approach of combining EORTC QLQ-C30 and Item Library offers a promising pragmatic solution to the measurement of physical functioning and fatigue, as well as anemia-related symptoms in clinical trials conducted in HR MDS, CMML, and AML.

Development and psychometric evaluation of the assessment of self-injection questionnaire: an adaptation of the self-injection assessment questionnaire.

BACKGROUND: Patient-reported outcome (PRO) instruments provide robust and effective means of evaluating patients' treatment experience; however, none adequately cover experience using self-injection devices with enhanced features, such as an electromechanical autoinjector (e-Device). The aim of this study was to develop a PRO instrument that accurately assesses patient experience of using an e-Device and to evaluate its psychometric properties. METHODS: A mixed-methods approach was taken; two parallel, targeted literature reviews were conducted to identify relevant concepts and existing self-injection PRO instruments that could be adapted. Patient feedback obtained from two focus groups was used to inform initial instrument development. The pilot instrument was then administered in a multicenter, open-label, phase 3 clinical study in which patients self-injected certolizumab pegol using an e-Device, to gather evidence of its psychometric qualities. Exit interviews were conducted with a sub-sample of patients enrolled in the study to confirm the appropriateness and clarity of the items included and cognitively debrief the instrument. Confirmatory factor analysis (CFA) was conducted on all items, and each domain's internal consistency was measured using Cronbach's ɑ. RESULTS: The literature searches identified several e-Device-specific concepts related to device features, device function, side effects/reactions/pain, confidence, and interference/convenience in daily life. Seven existing PRO instruments were identified. The Self-Injection Assessment Questionnaire (SIAQ), containing pre- and post-injection questionnaire modules, was selected as most suitable and adapted using feedback from 19 patients in the two focus groups to form the pilot Assessment of Self-Injection (ASI) questionnaire. CFA resulted in some changes to the grouping of items in the post-injection module domains following psychometric evaluation of the ASI. Internal consistency was satisfactory for all pre- and post-injection domains (ɑ > 0.8). Cognitive debriefing results from 12 patient exit interviews confirmed the ASI's appropriateness and clarity. CONCLUSIONS: The ASI was developed iteratively with patient input and was evaluated in its intended clinical context of use. Psychometric analyses indicated promising cross-sectional results; the ASI was well understood and considered relevant by patients self-injecting using the e-Device, suggesting that it could be used in real-world settings to aid with clinical decision making. TRIAL REGISTRATION: NCT03357471.

Review of Clinical Outcome Assessments in Pediatric Attention-Deficit/Hyperactivity Disorder.

PURPOSE: Various clinical outcome assessments (COAs) are used in clinical research to assess and monitor treatment efficacy in pediatric attention-deficit/hyperactivity disorder (ADHD) trials. It is unclear whether the concepts assessed are those that are important to patients and their caregivers. The concepts measured by commonly used COAs in this population have not been explicitly compared. METHODS: We conducted reviews of the qualitative literature to extract information on pediatric ADHD-related concepts reported by pediatric patients, parents, and teachers. Using these concepts, we developed a conceptual framework of pediatric ADHD using both the Diagnostic and Statistical Manual of Mental Disorders (DSM) criteria and the additional symptoms and behavioral impacts identified in the literature. We searched for COAs that have been used in pediatric ADHD research and mapped their items based on their conceptual underpinning. RESULTS: Of the 27 COAs found in the empirical literature, 4 COAs assessed only DSM symptoms. The most comprehensive coverage of our conceptual framework was seen in the Swanson, Nolan, and Pelham Rating Scale-DSM-IV (SNAP-IV). Eighteen COAs were used in at least 1 clinical trial: ADHD-Rating Scale-IV (ADHD-RS-IV) was used most often (n=77), followed by SNAP-IV (n=50), Swanson, Kotkin, Agler, M-Flynn, and Pelham Scale (SKAMP; n=31), Weiss Functional Impairment Rating Scale (WFIRS; n=24), and Vanderbilt ADHD Diagnostic Rating Scale (VADRS; n=15). CONCLUSION: We identified symptoms and behavioral impacts from qualitative studies in pediatric ADHD that are not included in DSM-based criteria. Most COAs used in pediatric ADHD clinical trials measure only those symptoms listed in the DSM. While these COAs can measure symptom severity, they may not assess the full range of symptoms and impacts important to patients and their caregivers. Future research is needed to measure all concepts important to patients and caregivers within ADHD clinical trials.