Psychometric Evaluation of the Diary for Irritable Bowel Syndrome Symptoms-Constipation in a Prospective Observational Study.

OBJECTIVES: To evaluate the psychometric properties of the Diary for Irritable Bowel Syndrome Symptoms-Constipation (DIBSS-C), which was developed to support primary and secondary endpoints in irritable bowel syndrome (IBS) with predominant constipation (IBS-C) clinical trials. METHODS: Observational data were collected from 108 adults with IBS-C using a smartphone-type device for 17 days. DIBSS-C data regarding bowel movements (BMs) were collected for each event (along with the Bristol Stool Form Scale); abdominal symptoms were rated each evening. Global status items and the Gastrointestinal Symptom Rating Scale-IBS were completed on day 10 and day 17 and the IBS-Symptom Severity Scale on day 17. Item-level performance, internal consistency reliability, test-retest reliability, and construct validity were evaluated. RESULTS: The Abdominal Symptoms Domain score demonstrated high internal consistency reliability (Cronbach's alpha week 1 = 0.98; week 2 = 0.96) and test-retest reliability (intraclass correlation coefficient [ICC] = 0.93). Test-retest reliability was stronger for abdominal symptoms (ICC = 0.91-0.94) than for the frequency-based BM-related outcomes (ICC = 0.54-0.66). Key construct validity hypotheses were supported by moderate to strong correlations with the corresponding Gastrointestinal Symptom Rating Scale-IBS, IBS-Symptom Severity Scale, and Bristol Stool Form Scale items. All known-groups comparisons were statistically significant for the abdominal symptom items and domain score; evidence for known-groups validity of BM-related outcomes was supportive when based on constipation severity. CONCLUSIONS: The results of this study provided key psychometric evidence for the DIBSS-C, ultimately contributing to its qualification by the US Food and Drug Administration for use in IBS-C clinical trials.

Best Practice Recommendations for Electronic Patient-Reported Outcome Dataset Structure and Standardization to Support Drug Development.

The electronic patient-reported outcome (ePRO) Dataset Structure and Standardization Project is a multistakeholder initiative formed by Critical Path Institute's PRO Consortium and Electronic Clinical Outcome Assessment (eCOA) Consortium to address issues related to ePRO dataset structure and standardization and to provide best practice recommendations for clinical trial sponsors and eCOA providers. Given the many benefits of utilizing electronic modes to capture PRO data, clinical trials are increasingly using these methods, yet there are challenges to using data generated by eCOA systems. Clinical Data Interchange Standards Consortium (CDISC) standards are used in clinical trials to ensure consistency in data collection, tabulation, and analysis and to facilitate regulatory submission. Currently, ePRO data are not required to follow a standard model, and the data models used often vary by eCOA provider and sponsor. This lack of consistency creates risks for programming and analysis and difficulties for analytics functions generating the required analysis and submission datasets. There is a disconnect between data standards used for study data submission and those used for data collection via case report forms and ePRO forms, which would be mitigated through the application of CDISC standards for ePRO data capture and transfer. The project was formed to collate and examine the issues arising from the lack of adoption of standardized approaches and this paper details recommendations to address those issues. Recommendations to address issues with ePRO dataset structure and standardization include adopting CDISC standards in the ePRO data platform, timely involvement of key stakeholders, ensuring ePRO controls are implemented, addressing issues of missing data early in development, ensuring quality control and validation of ePRO datasets, and use of read-only datasets.

Approaches to the Assessment of Clinical Benefit of Treatments for Conditions That Have Heterogeneous Symptoms and Impacts: Potential Applications in Rare Disease.

OBJECTIVES: Evaluating the clinical benefit of interventions for conditions with heterogeneous symptom and impact presentations is challenging. The same condition can present differently across and within individuals over time. This occurs frequently in rare diseases. The purpose of this review was to identify (1) assessment approaches used in clinical trials to address heterogeneous manifestations that could be relevant in rare disease research and (2) US Food and Drug Administration (FDA)-approved labeling claims that used these approaches. METHODS: A targeted literature review was conducted examining peer-reviewed publications and FDA-approved labeling claims from January 2002 to July 2020, focusing on claims incorporating clinical outcome assessments. Approaches were then assessed for their potential application in rare diseases. RESULTS: A total of 6 assessment approaches were identified: composite or other multicomponent endpoints, multidomain responder index, most bothersome symptom (MBS), goal attainment scaling, sliding dichotomy, and adequate relief. A total of 59 FDA-approved labeling claims associated with these approaches were identified: composite or other multicomponent endpoints (n=49), MBS (n=9), and adequate relief (n=1). A total of 10 FDA-approved labeling claims, all using multicomponent endpoints, were identified for rare diseases. CONCLUSIONS: Multicomponent, MBS, and adequate relief have been included in FDA-approved labeling claims. Multicomponent endpoints, including composite endpoints, were the most frequent way to address heterogeneous manifestations of both common and rare diseases. MBS may be acceptable to regulators, whereas multidomain responder index is unlikely to be. The goal attainment scaling and adequate relief approaches may have potential utility in rare disease trials, assuming the theoretical and statistical challenges inherent in each approach are managed.

Updated Recommendations on Evidence Needed to Support Measurement Comparability Among Modes of Data Collection for Patient-Reported Outcome Measures: A Good Practices Report of an ISPOR Task Force.

The ISPOR Task Force on measurement comparability between modes of data collection for patient-reported outcome measures (PROMs) has updated the good practice recommendations from the 2009 ISPOR electronic patient-reported outcome and 2014 patient-reported outcome mixed modes Good Research Practices Task Force reports in light of accumulated evidence of measurement comparability among different modes of PROM data collection. Furthermore, with the increasing use of electronic formats of clinical outcome assessments in clinical trials and the US Food and Drug Administration's encouragement of electronic data collection, this new task force report provides stakeholders with best practice recommendations reflecting the current body of evidence and enables them to respond to future developments in research and technology. This task force recommends an evidence-based approach to determine whether new research is needed to evaluate measurement comparability for a given questionnaire or technology. The suitability of existing evidence depends upon whether it satisfactorily demonstrates that the change in data collection mode has not affected the PROM's measurement properties. In cases where sufficient evidence of measurement comparability exists and best practices for faithful migration are followed, this task force concludes that further testing of measurement comparability among the data collection modes is unnecessary, including cases of "mixing modes" within clinical trials such as bring your own device designs.

Recommendations on the Selection, Development, and Modification of Performance Outcome Assessments: A Good Practices Report of an ISPOR Task Force.

In evaluating the clinical benefit of new therapeutic interventions, it is critical that the treatment outcomes assessed reflect aspects of health that are clinically important and meaningful to patients. Performance outcome (PerfO) assessments are measurements based on standardized tasks actively undertaken by a patient that reflect physical, cognitive, sensory, and other functional skills that bring meaning to people's lives. PerfO assessments can have substantial value as drug development tools when the concepts of interest being measured best suit task performance and in cases where patients may be limited in their capacity for self-report. In their development, selection, and modification, including the evaluation and documentation of validity, reliability, usability, and interpretability, the good practice recommendations established for other clinical outcome assessment types should continue to be followed, with concept elicitation as a critical foundation. In addition, the importance of standardization, and the need to ensure feasibility and safety, as well as their utility in patient groups, such as pediatric populations, or those with cognitive and psychiatric challenges, may enhance the need for structured pilot evaluations, additional cognitive interviewing, and evaluation of quantitative data, such as that which would support concept confirmation or provide ecological evidence and other forms of construct evidence within a unitary approach to validity. The opportunity for PerfO assessments to inform key areas of clinical benefit is substantial and establishing good practices in their selection or development, validation, and implementation, as well as how they reflect meaningful aspects of health is critical to ensuring high standards and in furthering patient-focused drug development.

Recommendations for the Electronic Migration and Implementation of Clinician-Reported Outcome Assessments in Clinical Trials.

OBJECTIVES: Although best practices from electronic patient-reported outcome (PRO) measures are transferable, the migration of clinician-reported outcome (ClinRO) assessments to electronic modes requires recommendations that address their unique properties, such as the user (eg, clinician), and complexity associated with programming of clinical content. Faithful migration remains essential to ensuring that the content and psychometric properties of the original scale (ie, validated reference) are preserved, such that clinicians completing the ClinRO assessments interpret and respond to the items the same way regardless of data collection mode. The authors present a framework for how to "faithfully" migrate electronic ClinRO assessments for successful deployment in clinical trials. METHODS: Critical Path Institute's Electronic PRO Consortium and PRO Consortium convened a consensus panel of representatives from member firms to develop recommendations for electronic migration and implementation of ClinRO assessments in clinical trials based on industry standards, regulatory guidelines where available, and relevant literature. The recommendations were reviewed and approved by all member firms from both consortia. CONSENSUS RECOMMENDATIONS: Standard, minimal electronic modifications for ClinRO assessments are described. This article also outlines implementation steps, including planning, startup, electronic clinical outcome assessment system development, training, and deployment. The consensus panel proposes that functional clinical testing by a clinician or clinical outcome assessment expert, as well as copyright holder review of screenshots (if possible) are sufficient to support minimal modifications during migration. Additional evidence generation is proposed for modifications that deviate significantly from the validated reference.

Comparing patient global impression of severity and patient global impression of change to evaluate test-retest reliability of depression, non-small cell lung cancer, and asthma measures.

PURPOSE: Score reproducibility is an important measurement property of fit-for-purpose patient-reported outcome (PRO) measures. It is commonly assessed via test-retest reliability, and best evaluated with a stable participant sample, which can be challenging to identify in diseases with highly variable symptoms. To provide empirical evidence comparing the retrospective (patient global impression of change [PGIC]) and current state (patient global impression of severity [PGIS]) approaches to identifying a stable subgroup for test-retest analyses, 3 PRO Consortium working groups collected data using both items as anchor measures. METHODS: The PGIS was completed on Day 1 and Day 8 + 3 for the depression and non-small cell lung cancer (NSCLC) studies, and daily for the asthma study and compared between Day 3 and 10. The PGIC was completed on the final day in each study. Scores were compared using an intraclass correlation coefficient (ICC) for participants who reported "no change" between timepoints for each anchor. RESULTS: ICCs using the PGIS "no change" group were higher for depression (0.84 vs. 0.74), nighttime asthma (0.95 vs. 0.53) and daytime asthma (0.86 vs. 0.68) compared to the PGIC "no change" group. ICCs were similar for NSCLC (PGIS: 0.87; PGIC: 0.85). CONCLUSION: When considering anchor measures to identify a stable subgroup for test-retest reliability analyses, current state anchors perform better than retrospective anchors. Researchers should carefully consider the type of anchor selected, the time period covered, and should ensure anchor content is consistent with the target measure concept, as well as inclusion of both current and retrospective anchor measures.

Why Reinvent the Wheel? Use or Modification of Existing Clinical Outcome Assessment Tools in Medical Product Development.

Assessment of clinical benefit in treatment trials can be made through report by a clinician, a patient, or a nonclinician observer (eg, caregiver) or through a performance-based assessment. The US Food and Drug Administration (FDA) published a final guidance for industry for one type of clinical outcome assessment (COA)-patient-reported outcome (PRO) measures-in 2009 that described how FDA reviews PRO measures for their adequacy to support medical product-labeling claims. Many of the principles described in the PRO Guidance could be applicable to the other types of COAs, including instruments completed by clinicians (ie, clinician-reported outcome assessments) and nonclinician observers (ie, observer-reported outcome assessments). FDA guidance describing the regulatory expectations for all COA types including performance outcome assessments, which are based on the patient's performance of a defined task or activity, is in progress to meet requirements described within the 21st Century Cures Act and PDUFA VI. This communication highlights potential ways in which existing instruments might be modified or used "as is" to conform to good measurement principles. An industry and a regulatory perspective are described.

The importance of drug safety and tolerability in the development of new immunosuppressive therapy for transplant recipients: The Transplant Therapeutics Consortium's position statement.

The Transplant Therapeutics Consortium (TTC) is a public-private partnership between the US Food and Drug Administration and the transplantation community including the transplantation societies and members of the biopharmaceutical industry. The TTC was formed to accelerate the process of developing new medical products for transplant patients. The initial goals of this collaboration are the following: (a) To define which aspects of the kidney transplant drug-development process have clear needs for improvement from an industry and regulatory perspective; (b) to define which of the unmet needs in the process could be positively impacted through the development of specific drug-development tools based on available data; and (c) to determine the most appropriate pathway to achieve regulatory acceptance of the proposed process-accelerating tools. The TTC has identified 2 major areas of emphasis: new biomarkers or endpoints for determining the efficacy of new therapies and new tools to assess the safety or tolerability of new therapies. This article presents the rationale and planned approach to develop new tools to assess safety and tolerability of therapies for transplant patients. We also discuss how similar efforts might support the continued development of patient-reported outcome measures in the future.

Development and Validation of the FSIQ-RMS: A New Patient-Reported Questionnaire to Assess Symptoms and Impacts of Fatigue in Relapsing Multiple Sclerosis.

OBJECTIVES: A new patient-reported outcome (PRO) instrument to measure fatigue symptoms and impacts in relapsing multiple sclerosis (RMS) was developed in a qualitative stage, followed by psychometric validation and migration from paper to an electronic format. METHODS: Adult patients with relapsing-remitting multiple sclerosis (RRMS) were interviewed to elicit fatigue-related symptoms and impacts. A draft questionnaire was debriefed in cognitive interviews with further RRMS patients, and revised. Content confirmation interviews were conducted with patients with progressive-relapsing multiple sclerosis (PRMS) and relapsing secondary-progressive multiple sclerosis (RSPMS). Psychometric analyses used data from adult patients with different RMS subtypes and matched non-RMS controls in a multicenter, observational study. After item reduction, the final instrument was migrated to a smartphone (eDiary) and usability was confirmed in interviews with additional adult RMS patients. RESULTS: The qualitative stage included 37 RRMS, 5 PRMS, and 5 RSPMS patients. Saturation of concepts was reached during concept elicitation. Cognitive interviews confirmed that participants understood the instructions, items, and response options of the instrument-named FSIQ-RMS-as intended. Psychometric validation included 164 RMS and 74 control patients. Internal consistency and test-retest reliability were demonstrated. The symptoms domain discriminated along the RMS symptom-severity continuum and between patients and controls. Patients were able to attribute fatigue-related symptoms to RMS. Usability and conceptual equivalence of the eDiary were confirmed (n = 10 participants). CONCLUSIONS: With 7 symptom items and 13 impact items (in 3 impacts subdomains: physical, cognitive and emotional, and coping) after item reduction, the FSIQ-RMS is a comprehensive, valid, and reliable measure of fatigue-related symptoms and impacts in RMS patients.

Assessing test-retest reliability of patient-reported outcome measures using intraclass correlation coefficients: recommendations for selecting and documenting the analytical formula.

PURPOSE: The US Food and Drug Administration (FDA) 2009 guidance for industry on patient-reported outcome (PRO) measures describes how the Agency evaluates the psychometric properties of measures intended to support medical product labeling claims. An important psychometric property is test-retest reliability. The guidance lists intraclass correlation coefficients (ICCs) and the assessment time period as key considerations for test-retest reliability evaluations. However, the guidance does not provide recommendations regarding ICC computation, nor is there consensus within the measurement literature regarding the most appropriate ICC formula for test-retest reliability assessment. This absence of consensus emerged as an issue within Critical Path Institute's PRO Consortium. The purpose of this project was to generate thoughtful and informed recommendations regarding the most appropriate ICC formula for assessing a PRO measure's test-retest reliability. METHODS: Literature was reviewed and a preferred ICC formula was proposed. Feedback on the chosen formula was solicited from psychometricians, biostatisticians, regulators, and other scientists who have collaborated on PRO Consortium initiatives. RESULTS AND CONCLUSIONS: Feedback was carefully considered and, after further deliberation, the proposed ICC formula was confirmed. In conclusion, to assess test-retest reliability for PRO measures, the two-way mixed-effect analysis of variance model with interaction for the absolute agreement between single scores is recommended.

Development of a Symptom-Focused Patient-Reported Outcome Measure for Functional Dyspepsia: The Functional Dyspepsia Symptom Diary (FDSD).

OBJECTIVES: The Functional Dyspepsia Symptom Diary (FDSD) was developed to address the lack of symptom-focused, patient-reported outcome (PRO) measures designed for use in functional dyspepsia (FD) patients and meeting Food and Drug Administration recommendations for PRO instrument development. METHODS: Concept elicitation interviews were conducted with FD participants to identify symptoms important and relevant to FD patients. A preliminary version of the FDSD was constructed, then completed by FD participants on an electronic device in cognitive interviews to evaluate the readability, comprehensibility, relevance, and comprehensiveness of the FDSD, and to preliminarily evaluate its measurement properties. RESULTS: During concept elicitation interviews, 45 participants spontaneously reported 19 symptom concepts. Of those, seven symptoms were selected for assessment by the eight-item FDSD. Cognitive interviews with 57 participants confirmed that participants were able to comprehend and provide meaningful responses to the FDSD, and that the handheld electronic FDSD format was suitable for use in the target population. Scores of the FDSD were well-distributed among response options, item discrimination indices suggested that the FDSD items differentiate among patients with varying degrees of FD severity, and inter-item correlations suggested that no items of the FDSD were capturing redundant information. Internal consistency estimates (0.87) and construct-related validity estimates using known-groups methods were within acceptable ranges. CONCLUSIONS: The FDSD is a content-valid PRO measure, with preliminary psychometric evidence providing support for the FDSD's items and total score. Further psychometric evaluations are recommended to more fully test the FDSD's score performance and other measurement properties in the target patient population.

Selection of and Evidentiary Considerations for Wearable Devices and Their Measurements for Use in Regulatory Decision Making: Recommendations from the ePRO Consortium.

BACKGROUND: Wearable devices offer huge potential to collect rich sources of data to provide insights into the effects of treatment interventions. Despite this, at the time of writing this report, limited regulatory guidance on the use of wearables in clinical trial programs has been published. OBJECTIVES: To present recommendations from the Critical Path Institute's Electronic Patient-Reported Outcome Consortium regarding the selection and evaluation of wearable devices and their measurements for use in regulatory trials and to support labeling claims. METHODS: The evaluation group was composed of Critical Path Institute's clinical outcome assessment (COA) scientists and COA specialists from pharmaceutical trial eCOA solution providers, including COA development and validation specialists. The resulting recommendations were drawn from a broad range of backgrounds, perspectives, and expertise that enriched the development of this report. Recommendations were developed through analysis of existing regulatory guidance relating to COA development and use in clinical trials, medical device certification/clearance regulations, literature-reported best practice, and practical experience of wearable technology application in clinical trials. RESULTS: We identify the essential properties of fit-for-purpose wearables and propose evidence needed to support their use. In addition, we overview the activities required to establish clinical endpoints derived from wearables data. CONCLUSIONS: Using this framework, we believe there is enough current understanding to promote the appropriate use of wearables in study protocols. We hope this will provide a basis for discussion among clinical trial stakeholders and catalyze the development of more robust regulatory guidance.

Reflection paper on copyright, patient-reported outcome instruments and their translations.

With the growth of patient-reported outcome (PRO) measurement, questions arise regarding how copyright protection applies to PRO instruments in general and to their translations in particular. The main objectives of this reflection paper are: 1) to help authors of PRO instruments understand basic rules of intellectual property and copyright that protect the integrity of their instruments and derivatives; and 2) to provide recommendations to authors and users of PRO instruments to prevent misuse or abuse.National laws on intellectual property (IP) and the international Berne Convention fully apply to PRO instruments since they are creations of the mind. Therefore, the copyright holder / owner / claimant of a PRO instrument, i.e., the person or legal entity who owns the copyright of the instrument, is granted exclusive rights that are divided into two main categories: moral and economic rights. Moral rights are: 1) the right of attribution (or right of paternity), i.e., the right to claim authorship of the work, 2) the right against false attribution, and 3) the right of integrity, i.e., the right to object to any mutilation, deformation or modification of the work. Economic rights represent the exclusive rights of the author to make or authorize reproduction, development of derivative works, distribution and communication to the public. In other words, the PRO instrument's copyright holder controls access (distribution, reproduction), and authorizes all derivative works, i.e., adaptations (e.g., electronic formats), modifications (e.g., shorter versions), and translations. Hence, the access to and use of an original PRO instrument and its derivatives in any kind of research should always be associated with the identification of its copyright holder. However, in some cases, this identification may be challenging, in particular when copyright ownership is not clearly defined. To prevent ownership conflicts as well as misuse or abuse of PRO instruments, the ISOQOL Translation and Cultural Adaptation Special Interest Group (TCA-SIG) provides recommendations to authors of PRO instruments and their users. In particular, the TCA-SIG recommends that the ownership of PRO instruments and their derivatives should be defined from the beginning (i.e., from the development of the instrument) and along the life cycle of the instrument between all parties involved. These recommendations apply not only to PRO instruments but also to all the other clinical outcome assessments (COAs), since they are also creations of the mind.

Content validity and electronic PRO (ePRO) usability of the Lung Cancer Symptom Scale-Mesothelioma (LCSS-Meso) in mesothelioma patients.

PURPOSE: Obtaining qualitative data directly from the patient perspective enhances the content validity of patient-reported outcome (PRO) instruments. The objective of this qualitative study was to evaluate the content validity of the Lung Cancer Symptom Scale for Mesothelioma (LCSS-Meso) and its usability on an electronic device. METHODS: A cross-sectional methodological study, using a qualitative approach, was conducted among patients recruited from four clinical sites. The primary target population included patients with pleural mesothelioma; data were also collected from patients with peritoneal mesothelioma on an exploratory basis. Semi-structured interviews were conducted consisting of concept elicitation, cognitive interviewing, and evaluation of electronic patient-reported outcome (ePRO) usability. RESULTS: Participants (n = 21) were interviewed in person (n = 9) or by telephone (n = 12); 71% were male with a mean age of 69 years (SD = 14). The most common signs and symptoms experienced by participants with pleural mesothelioma (n = 18) were shortness of breath, fluid build-up, pain, fatigue, coughing, and appetite loss. The most commonly described symptoms for those with peritoneal mesothelioma (n = 4) were bloating, changes in appetite, fatigue, fluid build-up, shortness of breath, and pain. Participants with pleural mesothelioma commonly described symptoms assessed by the LCSS-Meso in language consistent with the questionnaire and a majority understood and easily completed each of the items. The ePRO version was easy to use, and there was no evidence that the electronic formatting changed the way participants responded to the questions. CONCLUSIONS: Results support the content validity of the LCSS-Meso and the usability of the electronic format for use in assessing symptoms among patients with pleural mesothelioma.

PRO data collection in clinical trials using mixed modes: report of the ISPOR PRO mixed modes good research practices task force.

The objective of this report was to address the use and mixing of data collection modes within and between trials in which patient-reported outcome (PRO) end points are intended to be used to support medical product labeling. The report first addresses the factors that should be considered when selecting a mode or modes of PRO data collection in a clinical trial, which is often when mixing is first considered. Next, a summary of how to "faithfully" migrate instruments is presented followed by a section on qualitative and quantitative study designs used to evaluate measurement equivalence of the new and original modes of data collection. Finally, the report discusses a number of issues that must be taken into account when mixing modes is deemed necessary or unavoidable within or between trials, including considerations of the risk of mixing at different levels within a clinical trial program and mixing between different types of platforms. In the absence of documented evidence of measurement equivalence, it is strongly recommended that a quantitative equivalence study be conducted before mixing modes in a trial to ensure that sufficient equivalence can be demonstrated to have confidence in pooling PRO data collected by the different modes. However, we also strongly discourage the mixing of paper and electronic field-based instruments and suggest that mixing of electronic modes be considered for clinical trials and only after equivalence has been established. If proceeding with mixing modes, it is important to implement data collection carefully in the trial itself in a planned manner at the country level or higher and minimize ad hoc mixing by sites or individual subjects. Finally, when mixing occurs, it must be addressed in the statistical analysis plan for the trial and the ability to pool the data must be evaluated to then evaluate treatment effects with mixed modes data. A successful mixed modes trial requires a "faithful migration," measurement equivalence established between modes, and carefully planned implementation to minimize the risk of increased measurement error impacting the power of the trial to detect a treatment effect.

Assessing asthma symptoms in children: qualitative research supporting the development of the Pediatric Asthma Diary-Child (PAD-C) and Pediatric Asthma Diary-Observer (PAD-O).

BACKGROUND: Pediatric asthma has been identified by regulators, clinicians, clinical trial sponsors, and caregivers as an area in need of novel fit-for-purpose clinical outcome assessments (COAs) developed in accordance with the U.S. Food and Drug Administration's (FDA's) regulatory guidance for evaluating clinical benefit in treatment trials. To address this gap, the Patient-Reported Outcome (PRO) Consortium's Pediatric Asthma Working Group has continued development of 2 COAs to assess asthma signs and symptoms in pediatric asthma clinical trials to support efficacy endpoints: a PRO measure, the Pediatric Asthma Diary-Child (PAD-C) for children 8-11 years old (y.o.) and an observer-reported outcome measure, the Pediatric Asthma Diary-Observer (PAD-O) for caregivers of children 4-11 y.o. This qualitative research aimed to generate evidence regarding the content validity of the PAD-C and PAD-O. METHODS: Semi-structured combined concept elicitation and cognitive interviews were conducted with a diverse sample of U.S. participants (15 children 8-11 y.o. and 30 caregivers of children 4-11 y.o.). All children had clinician-diagnosed mild to severe asthma. Interviews explored the experience of pediatric asthma and assessed the understanding and relevance of both measures. Interviews were conducted across 3 iterative rounds to allow for modifications. RESULTS: Concept elicitation findings demonstrated that the core sign/symptom and impact concepts assessed in the PAD-C (cough, hard to breathe, out of breath, wheezing, chest tightness, and nighttime awakenings/symptoms) and PAD-O (cough, difficulty breathing, short of breath, wheezing, and nighttime awakenings/signs) correspond to those most frequently reported by participants; concept saturation was achieved. All PAD-C and PAD-O instructions and core items were well understood and considered relevant by most participants. Feedback from participants, the Pediatric Asthma Working Group, advisory panel, and FDA supported modifications to the measures, including addition of 1 new item to both measures and removal of 1 caregiver item. CONCLUSIONS: Findings provide strong support for the content validity of both measures. The cross-sectional measurement properties of both measures and their user experience and feasibility in electronic format will be assessed in a future quantitative pilot study with qualitative exit interviews, intended to support the reliability, construct validity, final content, and, ultimately, FDA qualification of the measures.

Pediatric asthma is one of the most common chronic diseases in children. However, there are problems of underdiagnosis, poor disease management, and undertreatment for many pediatric asthma patients, pressuring healthcare systems worldwide. Evaluating asthma symptoms is an important part of the development of treatments for pediatric asthma. However, there are few clinical outcome assessments (COAs) developed in line with regulatory guidance to directly assess symptom severity and evaluate the benefit of new treatments in children with asthma. In this study, we continued the development of the Pediatric Asthma Diary­Child (PAD-C) and the Pediatric Asthma Diary­Observer (PAD-O), according to regulatory guidance, to assess asthma signs and symptoms in children 4 through 11 years old and address this unmet need. The study aimed to explore the experience of pediatric asthma and assess how well-understood and relevant the measures are. Three rounds of qualitative interviews were conducted with 15 children 8 through 11 years old and 30 caregivers of children 4 through 11 years old with asthma. Results show that both measures are well-understood and assess the relevant and important aspects of pediatric asthma reported by children and caregivers. Findings provide evidence supporting the PAD-C and PAD-O as measures of symptom severity and their future use in pediatric asthma treatment trials. Further research is underway to evaluate their measurement properties and assess the user experience and feasibility of electronic completion, to ultimately support the PAD-C and PAD-O in an ongoing COA qualification process by the United States Food and Drug Administration.

Non-Small Cell Lung Cancer Symptom Assessment Questionnaire (NSCLC-SAQ): Measurement Properties and Estimated Clinically Meaningful Thresholds From a Phase 3 Study.

Introduction: The NSCLC Symptom Assessment Questionnaire (NSCLC-SAQ) was developed to assess NSCLC symptom severity in accordance with Food and Drug Administration evidentiary expectations leading to Food and Drug Administration qualification in 2018. This study evaluated the NSCLC-SAQ's measurement properties within a clinical trial. Methods: The KEYNOTE-598 phase 3 study of participants with stage IV metastatic NSCLC with programmed death-ligand 1 tumor proportion score greater than or equal to 50% was used to assess the NSCLC-SAQ's reliability, construct validity, responsiveness, and estimate clinically meaningful within-person change. Other patient-reported outcome measures included patient global impression items of severity and change in lung cancer symptoms, and the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire core 30 and lung cancer module, LC13. Results: Participants (N = 560) were mostly men (70%), had a mean age of 64 years, and had Eastern Cooperative Oncology Group performance status of 1 (64%) or 0 (36%). Internal consistency at baseline (Cronbach's α = 0.74) and test-retest reliability after 3 weeks (intraclass correlation coefficient = 0.79) were satisfactory. NSCLC-SAQ items, domains, and total score correlated moderately to highly with patient-reported outcome measures capturing similar content, and the total score differentiated among patient global impression of severity groups (p < 0.001). The total score detected improvement over time and the estimated clinically meaningful within-person change threshold for improvement ranged from three to five points on the 0 to 20 scale. Few participants exhibited symptom worsening (n = 38), limiting inferences in this group. Conclusions: The NSCLC-SAQ was found to be reliable, valid, responsive, and interpretable for assessing symptom improvement in NSCLC. Further evaluation is recommended in trial participants whose symptoms worsen over time.

Measurement Comparability of Electronic and Paper Administration of Visual Analogue Scales: A Review of Published Studies.

BACKGROUND: Visual analogue scales (VASs) are used in a variety of patient-, observer- and clinician-reported outcome measures. While typically included in measures originally developed for pen-and-paper completion, a greater number of clinical trials currently use electronic approaches to their collection. This leads researchers to question whether the measurement properties of the scale have been conserved during the migration to an electronic format, particularly because electronic formats often use a different scale length than the 100 mm paper standard. METHODS: We performed a review of published studies investigating the measurement comparability of paper and electronic formats of the VAS. RESULTS: Our literature search yielded 26 studies published between 1997 and 2018 that reported comparison of paper and electronic formats using the VAS. After excluding 2 publications, 23 of the remaining 24 studies included in this review reported electronic formats of the VAS (eVAS) and paper formats (pVAS) to be equivalent. A further study concluded that eVAS and pVAS were both acceptable but should not be interchanged. eVAS length varied from 21 to 200 mm, indicating that 100 mm length is not a requirement. CONCLUSIONS: The literature supports the hypothesis that eVAS and pVAS provide comparable results regardless of the VAS length. When implementing a VAS on a screen-based electronic mode, we recommend following industry best practices for faithful migration to minimise the likelihood of non-comparability with pVAS.

Comparability of a provisioned device versus bring your own device for completion of patient-reported outcome measures by participants with chronic obstructive pulmonary disease: qualitative interview findings.

BACKGROUND: There is interest in participants using their own smartphones or tablets ("bring your own device"; BYOD) to complete patient-reported outcome (PRO) measures in clinical studies. Our study aimed to qualitatively evaluate participants' experience using a provisioned device (PD) versus their own smartphone (BYOD) for this purpose. METHODS: Participants with chronic obstructive pulmonary disease (COPD) were recruited for this observational, cross-over study and completed PRO measures daily on one device type for 15 days, then switched to the other device type to complete the same measures for another 15 days. After each 15-day period, semi-structured interviews were conducted about their experience with the device. RESULTS: Of 64 participants enrolled, the final qualitative analysis populations comprised those who participated in an interview without protocol violations. Thus, the qualitative longitudinal population (LP) included n = 57 (89%), while the qualitative cross-sectional population (CSP) included n = 60 (94%). CSP participants found both device types easy to use. Twenty CSP participants (33%) reported missing data entry on at least one day when using PD, and 24 (40%) reported missing at least one day when using BYOD. In the LP, preference for one of the device types was somewhat evenly split; 45.6% (n = 26) preferred PD and 50.9% (n = 29) preferred BYOD. The most common reason for preferring PD was that it was "dedicated" to the study; the "convenience" of carrying a single device was the main reason for preferring BYOD. CONCLUSION: The findings from the interviews demonstrated few differences in participants' experience completing PRO measures on a PD versus BYOD. Our study supports the use of BYOD as a potential addition to PD for collecting PRO data and contributes evidence that BYOD may be employed to collect PRO data in demographically diverse patient populations.