Psychometric validation of a patient-reported measure of physical functioning in sporadic inclusion body myositis.

INTRODUCTION: To assess self-reported physical functioning in patients with sporadic inclusion body myositis (sIBM), the sIBM Physical Functioning Assessment (sIFA) was developed. This research establishes the validity, reliability, and responsiveness of the sIFA in patients with sIBM. METHODS: Data from 3 small, noninterventional, observational studies were analyzed. Several measures of physical function were included to assess validity. Reliability (Cronbach alpha, test-retest intraclass correlations), construct validity (correlations, analyses of variance), and responsiveness (effect size estimates) were evaluated. RESULTS: Cronbach alphas (range = 0.86-0.91) and test-retest reliability (0.91) were highly satisfactory. Correlations with other measures provided evidence of convergent validity. sIBM patients able to walk without assistive devices scored significantly better on the sIFA (means = 36.0-47.05) than those who required power mobility or wheelchairs (means = 54.9-71.5), demonstrating the discriminating ability of the sIFA. Effect size estimates of responsiveness suggested mild functional progression. CONCLUSIONS: Psychometric analyses of the sIFA demonstrate satisfactory reliability, validity, and responsiveness. Muscle Nerve 54: 658-665, 2016.

Psychometric evaluation of the Symptoms of Infection with Coronavirus-19 (SIC): results from a cross-sectional study and a phase 3 clinical trial.

BACKGROUND: The Symptoms of Infection with Coronavirus-19 (SIC) is a 30-item patient-reported outcome (PRO) measure scored by body system composites to assess signs/symptoms of coronavirus disease 2019 (COVID-19). In addition to cross-sectional and longitudinal psychometric evaluations, qualitative exit interviews were conducted to support the content validity of the SIC. METHODS: In a cross-sectional study, adults diagnosed with COVID-19 in the United States completed the web-based SIC and additional PRO measures. A subset was invited to participate in phone-based exit interviews. Longitudinal psychometric properties were assessed in ENSEMBLE2, a multinational, randomized, double-blind, placebo-controlled, phase 3 trial of the Ad26.COV2.S COVID-19 vaccine. Psychometric properties evaluated included structure, scoring, reliability, construct validity, discriminating ability, responsiveness, and meaningful change thresholds of SIC items and composite scores. RESULTS: In the cross-sectional study, 152 participants completed the SIC (mean age, 51.0 ± 18.6 years) and 20 completed follow-up interviews. Fatigue (77.6%), feeling unwell (65.8%), and cough (60.5%) were symptoms most frequently reported. SIC inter-item correlations were all positive and mostly moderate (r ≥ 0.3) and statistically significant. SIC items and Patient-Reported Outcomes Measurement Information System-29 (PROMIS-29) scores correlated as hypothesized (all r ≥ 0.32). Internal consistency reliabilities of all SIC composite scores were satisfactory (Cronbach's alpha, 0.69-0.91). SIC composite scores correlated moderately (r = 0.30-0.49) to strongly (r ≥ 0.50) with PROMIS-29 scores and Patient Global Impression of Severity (PGIS) ratings (all P < 0.01). A variety of signs/symptoms were cited in exit interviews, and participants considered the SIC straightforward, comprehensive, and easy to use. From ENSEMBLE2, 183 participants with laboratory-confirmed moderate to severe/critical COVID-19 were included (51.5 ± 14.8 years). Strong test-retest reliabilities were observed for most SIC composite scores (intraclass correlations ≥ 0.60). Statistically significant differences across PGIS severity levels were found for all but 1 composite score, supporting known-groups validity. All SIC composite scores demonstrated responsiveness based on changes in PGIS. CONCLUSIONS: The psychometric evaluations provided strong evidence for the reliability and validity of the SIC for measuring COVID-19 symptoms, supporting its use in vaccine and treatment trials. In exit interviews, participants described a broad range of signs/symptoms consistent with previous research, further supporting the content validity and format of the SIC.

Coronavirus disease 2019 (COVID-19) is a serious disease that continues to evolve globally. Researchers developed the Symptoms of Infection with Coronavirus-19 (SIC), a 30-item questionnaire designed for patients to report signs and symptoms of COVID-19. In this study, the researchers formally analyzed how well the SIC measures the patient experience with COVID-19, using survey and clinical trial data as well as telephone interviews. Adults with COVID-19 and at least 2 bothersome symptoms completed the web-based survey, and some of these individuals also participated in in-depth interviews. Participants in a clinical trial for a COVID-19 vaccine also completed the SIC measure. The SIC was compared with other commonly used questionnaires that evaluate patient experience. The most commonly reported symptoms of COVID-19 were fatigue, feeling unwell, cough, weakness, and headache. The items for individual symptoms (e.g., "cough") and combined scores for body systems (e.g., "respiratory system") performed well in statistical analyses. Participants found the SIC to be straightforward, comprehensive, and easy to use. The SIC may prove useful in the future for vaccine and treatment trials for COVID-19.

Psychometric evaluation of the Nocturia Sleep Quality Scale based on data from a prospective observational study.

STUDY OBJECTIVES: The Nocturia Sleep Quality Scale (NSQS), a novel patient-reported outcomes measure, was developed to assess the impact of sleep disturbance from nocturia. The objective of this study was to assess the psychometric properties of the NSQS, including its structure, reliability, and validity. METHODS: Data were collected in the context of a web-based, prospective, longitudinal, observational study. Participants with nocturia were randomized 1:1 to either a group that received sleep hygiene instructions, including instructions to limit liquids at nighttime and empty bladder prior to bedtime, or one that did not receive sleep instructions. All participants were asked to provide responses to the web-based questionnaires from day 1 to day 10. Psychometric analyses, aligned with current regulatory guidance, were conducted to evaluate the daily scores and 3-day average scores of NSQS items and potential composites. Item-level analyses were conducted first, followed by composite-level analyses. RESULTS: The NSQS items and supporting measures demonstrated very slight improvement in patient-perceived sleep disturbance from nocturia over the course of the study. NSQS test-retest reliabilities were generally satisfactory. Correlations between NSQS items and related patient-reported measures tended to support the construct validity of the NSQS, and the known-groups analyses supplied evidence of its discriminating ability. NSQS responsiveness statistics were small. CONCLUSIONS: The NSQS is a reliable and valid measure of the impact of nocturia on patients' sleep. The present analyses lay the psychometric groundwork for the use of the NSQS in future clinical trials to support product approval and labeling claims.

Psychometric validation of the depression and family functioning scale.

OBJECTIVE: A new patient-reported outcome (PRO) measure developed to assess the impact of major depressive disorder (MDD) on partner and family interactions and quality of relationships, the Depression and Family Functioning Scale (DFFS), was analyzed to establish its reliability, validity, and responsiveness. METHODS: Data from a multi-center, prospective, 2-year observational study were analyzed to assess the psychometric properties of the DFFS in patients with MDD (nBaseline = 478; nMonth2 = 433). Measures administered to assess validity included the Sheehan Disability Scale (SDS), Arizona Sexual Experiences Scale (ASEX) and Short Form Health Survey-12 (SF-12). Reliability (Cronbach's alphas and intra-class correlations), construct validity (factor analysis and correlations), discriminating ability (analyses of variance), and responsiveness (standardized effect size estimates) were evaluated. RESULTS: Principal components analyses indicated a single underlying dimension, confirmed by highly satisfactory Cronbach's alphas (αBaseline = 0.85, αMonth2 = 0.89). The DFFS demonstrated satisfactory test-re-test reliability in patients with the same SDS family life/home responsibilities ratings at baseline and month 2 (intraclass correlation = 0.75). Correlations with other measures showed convergent and divergent validity; e.g., the DFFS correlated better with SF-12 mental component scores (rBaseline = -0.35, rMonth2 = -0.49) than with SF-12 physical component scores (rBaseline = -0.05, rMonth2 = -0.31). Hypothesis tests were generally as predicted; many were statistically significant, substantiating DFFS discriminating ability. Standardized effect size estimates of responsiveness ranged from 0.44-0.84, demonstrating that the items were capable of detecting change. CONCLUSIONS: The psychometric analyses support the reliability, validity, and responsiveness of the DFFS and its usefulness for assessing the impact of depression on family functioning. The DFFS can potentially provide important information not captured in clinical practice and facilitate more comprehensive evaluation of MDD treatments.