Remote Self-Administration of Cognitive Screeners for Older Adults Prior to a Primary Care Visit: Pilot Cross-Sectional Study of the Reliability and Usability of the MyCog Mobile Screening App.

BACKGROUND: Routine cognitive screening is essential in the early detection of dementia, but time constraints in primary care settings often limit clinicians' ability to conduct screenings. MyCog Mobile is a newly developed cognitive screening system that patients can self-administer on their smartphones before a primary care visit, which can help save clinics' time, encourage broader screening practices, and increase early detection of cognitive decline. OBJECTIVE: The goal of this pilot study was to examine the feasibility, acceptability, and initial psychometric properties of MyCog Mobile. Research questions included (1) Can older adults complete MyCog Mobile remotely without staff support? (2) Are the internal consistency and test-retest reliability of the measures acceptable? and (3) How do participants rate the user experience of MyCog Mobile? METHODS: A sample of adults aged 65 years and older (N=51) self-administered the MyCog Mobile measures remotely on their smartphones twice within a 2- to 3-week interval. The pilot version of MyCog Mobile includes 4 activities: MyFaces measures facial memory, MySorting measures executive functioning, MySequences measures working memory, and MyPictures measures episodic memory. After their first administration, participants also completed a modified version of the Simplified System Usability Scale (S-SUS) and 2 custom survey items. RESULTS: All participants in the sample passed the practice items and completed each measure. Findings indicate that the Mobile Toolbox assessments measure the constructs well (internal consistency 0.73 to 0.91) and are stable over an approximately 2-week delay (test-retest reliability 0.61 to 0.71). Participants' rating of the user experience (mean S-SUS score 73.17, SD 19.27) indicated that older adults found the usability of MyCog Mobile to be above average. On free-response feedback items, most participants provided positive feedback or no feedback at all, but some indicated a need for clarity in certain task instructions, concerns about participants' abilities, desire to be able to contact a support person or use in-app technical support, and desire for additional practice items. CONCLUSIONS: Pilot evidence suggests that the MyCog Mobile cognitive screener can be reliably self-administered by older adults on their smartphones. Participants in our study generally provided positive feedback about the MyCog Mobile experience and rated the usability of the app highly. Based on participant feedback, we will conduct further usability research to improve support functionality, optimize task instructions and practice opportunities, and ensure that patients feel comfortable using MyCog Mobile. The next steps include a clinical validation study that compares MyCog Mobile to gold-standard assessments and tests the sensitivity and specificity of the measures for identifying dementia.

Development and Validation of a Vocabulary Measure in the Mobile Toolbox.

OBJECTIVE: We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies. METHOD: Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones. RESULTS: The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001). CONCLUSION: The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.

The Paradox in Positive and Negative Aspects of Emotional Functioning Among Older Adults with Early Stages of Cognitive Impairment.

Introduction: Emotional functioning in older adults is influenced by normal aging and cognitive impairment, likely heterogeneous across positive versus negative aspects of emotional functioning. Little is known about positive emotional experiences at the early stages of cognitive impairment. Methods: We assessed different aspects of emotional functioning among 448 participants aged 65+ (Normal Control (NC) = 276, Mild Cognitive Impairment (MCI) = 103, and mild dementia of the Alzheimer type (mild DAT) = 69) and tested moderators. Results: Compared to NC, older adults with MCI and mild DAT have maintained many positive aspects of emotional functioning, despite higher levels of negative affect, sadness, and loneliness. Among the oldest-old, the mild DAT group experienced higher fear and lower self-efficacy. Discussion: Older adults at early stages of cognitive impairment can experience positive aspects of emotional functioning, such as positive affect, purpose, and life satisfaction, all of which are important buildable psychological resources for coping.

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation.

BACKGROUND: Annual cognitive screening in adults aged >65 years can improve early detection of cognitive impairment, yet less than half of all cases are identified in primary care. Time constraints in primary care settings present a major barrier to routine screening. A remote cognitive screener completed on a patient's own smartphone before a visit has the potential to save primary care clinics time, encourage broader screening practices, and increase early detection of cognitive decline. OBJECTIVE: We described the iterative design and proposed the implementation of a remote cognitive screening app, MyCog Mobile, to be completed on a patient's smartphone before an annual wellness visit. The research questions were as follows: What would motivate primary care clinicians and clinic administrators to implement a remote cognitive screening process? How might we design a remote cognitive screener to fit well with existing primary care workflows? What would motivate an older adult patient to complete a cognitive screener on a smartphone before a primary care visit? How might we optimize the user experience of completing a remote cognitive screener on a smartphone for older adults? METHODS: To address research questions 1 and 2, we conducted individual interviews with clinicians (n=5) and clinic administrators (n=3). We also collaborated with clinic administrators to create user journey maps of their existing and proposed MyCog Mobile workflows. To address research questions 3 and 4, we conducted individual semistructured interviews with cognitively healthy older adults (n=5) and solicited feedback from a community stakeholder panel (n=11). We also tested and refined high-fidelity prototypes of the MyCog Mobile app with the older adult interview participants, who rated the usability on the Simplified System Usability Scale and After-Scenario Questionnaire. RESULTS: Clinicians and clinic administrators were motivated to adopt a remote cognitive screening process if it saved time in their workflows. Findings from interviews and user journey mapping informed the proposed implementation and core functionality of MyCog Mobile. Older adult participants were motivated to complete cognitive screeners to ensure that they were cognitively healthy and saw additional benefits to remote screening, such as saving time during their visit and privacy. Older adults also identified potential challenges to remote smartphone screening, which informed the user experience design of the MyCog Mobile app. The average rating across prototype versions was 91 (SD 5.18) on the Simplified System Usability Scale and 6.13 (SD 8.40) on the After-Scenario Questionnaire, indicating above-average usability. CONCLUSIONS: Through an iterative, human-centered design process, we developed a viable remote cognitive screening app and proposed an implementation strategy for primary care settings that was optimized for multiple stakeholders. The next steps include validating the cognitive screener in clinical and healthy populations and piloting the finalized app in a community primary care clinic.

Uses of the NIH Toolbox® in Clinical Samples: A Scoping Review.

Background and Objectives: The NIH Toolbox® for the Assessment of Neurologic and Behavioral Function is a compilation of computerized measures designed to assess sensory, motor, emotional, and cognitive functioning of individuals across the life span. The NIH Toolbox was initially developed for use with the general population and was not originally validated in clinical populations. The objective of this scoping review was to assess the extent to which the NIH Toolbox has been used with clinical populations. Methods: Guided by the Joanna Briggs Methods Manual for Scoping Reviews, records were identified through searches of PubMed MEDLINE, PsycINFO, ClinicalTrials.gov, EMBASE, and ProQuest Dissertations and Theses Global (2008-2020). Database searches yielded 5,693 unique titles of original research that used at least one NIH Toolbox assessment in a sample characterized by any clinical diagnosis. Two reviewers screened titles, abstracts, and full texts for inclusion in duplicate. Conflicts at each stage of the review process were resolved by a group discussion. Results: Ultimately, 281 publication records were included in this scoping review (nJournal Articles = 104, nConference Abstracts = 84, nClinical Trial Registrations = 86, and nTheses/Dissertations = 7). The NIH Toolbox Cognition Battery was by far the most used of the 4 batteries in the measurement system (nCognition = 225, nEmotion = 49, nMotor = 29, and nSensation = 16). The most represented clinical category was neurologic disorders (n = 111), followed by psychological disorders (n = 39) and cancer (n = 31). Most (96.8%) of the journal articles and conference abstracts reporting the use of NIH Toolbox measures with clinical samples were published in 2015 or later. As of May 2021, these records had been cited a total of nearly 1,000 times. Discussion: The NIH Toolbox measures have been widely used among individuals with various clinical conditions across the life span. Our results lay the groundwork to support the feasibility and utility of administering the NIH Toolbox measures in research conducted with clinical populations and further suggest that these measures may be of value for implementation in fast-paced clinical settings as part of routine practice.

Designing a Visit Schedule for Longitudinal Studies in Pediatric Research.

A challenge for longitudinal studies is combining individual assessments into visits that are scientifically logical, not burdensome for participants, well-choreographed, and operationally feasible. The visits then need to be sequenced and spaced to address the scientific goals and generate a data archive that is sufficiently robust and well-documented to support subsequent analyses. This paper summarizes comprehensive multi-disciplinary activities that were coordinated to design the content, format, and structure of the National Children's Study and concurrently serve as a model and resource for other studies.

Challenges in Participant Engagement and Retention Using Mobile Health Apps: Literature Review.

BACKGROUND: Mobile health (mHealth) apps are revolutionizing the way clinicians and researchers monitor and manage the health of their participants. However, many studies using mHealth apps are hampered by substantial participant dropout or attrition, which may impact the representativeness of the sample and the effectiveness of the study. Therefore, it is imperative for researchers to understand what makes participants stay with mHealth apps or studies using mHealth apps. OBJECTIVE: This study aimed to review the current peer-reviewed research literature to identify the notable factors and strategies used in adult participant engagement and retention. METHODS: We conducted a systematic search of PubMed, MEDLINE, and PsycINFO databases for mHealth studies that evaluated and assessed issues or strategies to improve the engagement and retention of adults from 2015 to 2020. We followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Notable themes were identified and narratively compared among different studies. A binomial regression model was generated to examine the factors affecting retention. RESULTS: Of the 389 identified studies, 62 (15.9%) were included in this review. Overall, most studies were partially successful in maintaining participant engagement. Factors related to particular elements of the app (eg, feedback, appropriate reminders, and in-app support from peers or coaches) and research strategies (eg, compensation and niche samples) that promote retention were identified. Factors that obstructed retention were also identified (eg, lack of support features, technical difficulties, and usefulness of the app). The regression model results showed that a participant is more likely to drop out than to be retained. CONCLUSIONS: Retaining participants is an omnipresent challenge in mHealth studies. The insights from this review can help inform future studies about the factors and strategies to improve participant retention.

Lessons from Detecting Cognitive Impairment Including Dementia (DetectCID) in Primary Care.

BACKGROUND: Cognitive impairment, including dementia, is frequently under-detected in primary care. The Consortium for Detecting Cognitive Impairment, including Dementia (DetectCID) convenes three multidisciplinary teams that are testing novel paradigms to improve the frequency and quality of patient evaluations for detecting cognitive impairment in primary care and appropriate follow-up. OBJECTIVE: Our objective was to characterize the three paradigms, including similarities and differences, and to identify common key lessons from implementation. METHODS: A qualitative evaluation study with dementia specialists who were implementing the detection paradigms. Data was analyzed using content analysis. RESULTS: We identified core components of each paradigm. Key lessons emphasized the importance of engaging primary care teams, enabling primary care providers to diagnose cognitive disorders and provide ongoing care support, integrating with the electronic health record, and ensuring that paradigms address the needs of diverse populations. CONCLUSION: Approaches are needed that address the arc of care from identifying a concern to post-diagnostic management, are efficient and adaptable to primary care workflows, and address a diverse aging population. Our work highlights approaches to partnering with primary care that could be useful across specialties and paves the way for developing future paradigms that improve differential diagnosis of symptomatic cognitive impairment, identifying not only its presence but also its specific syndrome or etiology.

Recommendations for Assessment of Social, Emotional, and Behavioral Health for the National Children's Study.

The Social Emotional Behavioral (SEB) Team of the National Children's Study (NCS) was tasked with making recommendations for assessment of important aspects of social-emotional health and function in children. This paper describes the constructs recommended for assessment along with the rationale for their assessment. These constructs, representing aspects of Social Relationships, Social Capital, Temperament, Negative Affect, Externalizing Behavior, Social Competence, Self-efficacy, Self-image, Psychological well-being, Ethnic/racial Socialization, Perceived Discrimination, Sexual Orientation, Religiosity, and Perceived Stress and Resilience were identified as being critical to the understanding of children's health and development from birth to age 21.

The NIH Toolbox: Overview of Development for Use with Hispanic Populations.

OBJECTIVE: Hispanics/Latinos are the largest and fastest-growing minority population in the United States. To facilitate appropriate outcome assessment of this expanding population, the NIH Toolbox for Assessment of Neurological and Behavioral Function® (NIH Toolbox®) was developed with particular attention paid to the cultural and linguistic needs of English- and Spanish-speaking Hispanics/Latinos. METHODS: A Cultural Working Group ensured that all included measures were appropriate for use with Hispanics/Latinos in both English and Spanish. In addition, a Spanish Language Working Group assessed all English-language NIH Toolbox measures for translatability. RESULTS: Measures were translated following the Functional Assessment of Chronic Illness Therapy (FACIT) translation methodology for instances where language interpretation could impact scores, or a modified version thereof for more simplified translations. The Spanish versions of the NIH Toolbox Cognition Battery language measures (i.e., Picture Vocabulary Test, Oral Reading Recognition Test) were developed independently of their English counterparts. CONCLUSIONS: The Spanish-language version of the NIH Toolbox provides a much-needed set of tools that can be selected as appropriate to complement existing protocols being conducted with the growing Hispanic/Latino population in the United States.

NIH Toolbox® Emotion Batteries for Children: Factor-Based Composites and Norms.

The recently released National Institutes of Health Toolbox (NIHTB) batteries for neurological and behavioral function were designed to serve as standardized, common measures in clinical and epidemiological research. The current study aimed to examine constructs assessed by the self-report and parental proxy-report scales in the NIHTB Emotion Battery (NIHTB-EB) for Children by using factor analyses on data from the U.S. national normative sample of 2,916 English-speaking children. This battery contains 31 scales designed to assess both positive and negative aspects of social and emotional functioning that are considered developmentally relevant at each of three age ranges (3-7, 8-12, and 13-17 years). Results revealed four similar self-report factors for ages 8 to 12 years and 13 to 17 years. Proxy reports for ages 3 to 7 years revealed three factors, and for ages 8 to 12 years two factors. Based on the standardization sample data, age- and gender-corrected norms are presented for all NIHTB-EB individual scales and factor-based composites.

PROMIS® Pediatric Depressive Symptoms as a Harmonized Score Metric.

OBJECTIVE: To conduct an evidence-based review of adolescent self-report depression measures and to demonstrate how various measures can be rescored onto a harmonized metric. METHOD: Six widely used person-reported outcome measures (PROMs) were reviewed. Psychometric properties were evaluated using previously published guidance for PROMs. Next, two secondary data sources (from an outpatient behavioral health clinic and from the general population) were evaluated to harmonize scores across three of the measures. Both item response theory and equipercentile linking methods were used and compared. RESULTS: All six PROMs demonstrated a high evidence base for widespread use depending on the purpose of the assessments. Adolescent involvement when developing the PROM for content validity and floor or ceiling effects were the least frequent available evidence. Three of the PROMs were linked to the PROMIS® Pediatric Depressive Symptoms v2.0 (PROMIS-PedDepSx) metric. The scales were highly correlated and essentially unidimensional when aggregated. All linking methods were broadly comparable. Group-level score conversions are recommended to minimize linking bias. CONCLUSIONS: There are a number of strong, widely used PROMs for the evidence-based assessment (EBD) of adolescent depression. However, score comparability is a concern whenever there is a proliferation of measures. Harmonized score metrics support data aggregation and re-analysis. Using four PROMs, one of which served as the scoring metric, we demonstrated the possibility of harmonized depression scores. Future directions for EBD should evaluate whether harmonized PROMs for other pediatric health domains would be useful.

National Institutes of Health Toolbox Emotion Battery for English- and Spanish-speaking adults: normative data and factor-based summary scores.

BACKGROUND: The National Institutes of Health Toolbox Emotion Battery (NIHTB-EB) is a "common currency", computerized assessment developed to measure the full spectrum of emotional health. Though comprehensive, the NIHTB-EB's 17 scales may be unwieldy for users aiming to capture more global indices of emotional functioning. METHODS: NIHTB-EB was administered to 1,036 English-speaking and 408 Spanish-speaking adults as a part of the NIH Toolbox norming project. We examined the factor structure of the NIHTB-EB in English- and Spanish-speaking adults and developed factor analysis-based summary scores. Census-weighted norms were presented for English speakers, and sample-weighted norms were presented for Spanish speakers. RESULTS: Exploratory factor analysis for both English- and Spanish-speaking cohorts resulted in the same 3-factor solution: 1) negative affect, 2) social satisfaction, and 3) psychological well-being. Confirmatory factor analysis supported similar factor structures for English- and Spanish-speaking cohorts. Model fit indices fell within the acceptable/good range, and our final solution was optimal compared to other solutions. CONCLUSION: Summary scores based upon the normative samples appear to be psychometrically supported and should be applied to clinical samples to further validate the factor structures and investigate rates of problematic emotions in medical and psychiatric populations.

Evolution of Patient-Reported Outcomes and Their Role in Multiple Sclerosis Clinical Trials.

Patient-reported outcomes (PROs) are playing an increasing role in multiple sclerosis (MS) research and practice, and are essential for understanding the effects that MS and MS treatments have on patients' lives. PROs are captured directly from patients and include symptoms, function, health status, and health-related quality of life. In this article, we review different categories (e.g., generic, targeted, preference-based) of PRO measures and considerations in selecting a measure. The PROs included in MS clinical research have evolved over time, as have the measures used to assess them. We describe findings from recent MS clinical trials that included PROs when evaluating Food and Drug Administration-approved disease-modifying therapies (e.g., daclizumab, teriflunomide). Variation in the measures used in these trials makes it difficult to draw any conclusions from the data. We therefore suggest a standardized approach to PRO assessment in MS research and describe 2 generic, National Institutes of Health-supported measurement systems [Neuro-QoL and the Patient-Reported Outcomes Measurement Information System (PROMIS)] that would facilitate such an approach. The use of PROs in MS care and research is expanding beyond clinical trials, as is demonstrated by examples from comparative effectiveness and other patient-centered research. The importance of PRO assessment is expected to continue to grow in the future.

Computerized Adaptive Testing in Pediatric Brain Tumor Clinics.

CONTEXT: Monitoring of health-related quality of life and symptoms of patients with brain tumors is needed yet not always feasible. This is partially due to lack of brief-yet-precise assessments with minimal administration burden that are easily incorporated into clinics. Dynamic computerized adaptive testing (CAT) or static fixed-length short forms, derived from psychometrically sound item banks, are designed to fill this void. OBJECTIVE: This study evaluated the comparability of scores obtained from CATs and short forms. METHODS: Patients (ages 7-22 years) were recruited from brain tumor clinics and completed Patient-Reported Outcome Measurement Information System CATs and short forms (Fatigue, Mobility, Upper Extremity, Depressive Symptoms, Anxiety, and Peer Relationships). Pearson correlations, paired t-tests, and Cohen's d were used to evaluate the relationship, significant differences, and the magnitude of the difference between these two scores, respectively. RESULTS: Data from 161 patients with brain tumors were analyzed. Patients completed each CAT within 2 minutes. Scores obtained from CATs and short forms were highly correlated (r = 0.95-0.98). Significantly different CAT vs. short-form scores were found on 4 (of 6) domains yet with negligible effect sizes (|d| < 0.09). These relationships varied across patients with different levels of reported symptoms, with the strongest association at the worst or best symptom scores. CONCLUSIONS: This study demonstrated the comparability of scores from CATs and short forms. Yet the agreement between these two varied across degrees of symptom severity which was a result of the ceiling effects of static short forms. We recommend CATs to enable individualized assessment for longitudinal monitoring.

A PROMIS Measure of Neuropathic Pain Quality.

OBJECTIVES: Neuropathic pain (NP) is a consequence of many chronic conditions. This study aimed to develop an unidimensional NP scale with scores that represent levels of NP and distinguish between individuals with NP and non-NP conditions. METHODS: A candidate item pool of 42 pain quality descriptors was administered to participants with osteoarthritis, rheumatoid arthritis, diabetic neuropathy, and cancer chemotherapy-induced peripheral neuropathy. A subset of pain quality descriptors (items) that best distinguished between participants with and those without NP conditions were identified. Dimensionality of pain descriptors was evaluated in a development sample and cross-validated in a holdout sample. Item responses were calibrated using an item response theory model, and scores were generated on a T-score metric. NP scale scores were evaluated in terms of the reliability, validity, and ability to distinguish between participants with and without conditions typically associated with NP. RESULTS: Of the 42 initial items, 5 were identified for the Patient-Reported Outcome Measurement Information System (PROMIS) Neuropathic Pain Quality Scale. T scores exhibited good discriminatory ability on the basis of receiver-operator characteristic analysis. Score thresholds that optimize sensitivity and specificity were identified. Construct, criterion, and discriminant validity, and reliability of scale scores were supported. CONCLUSIONS: The five-item Patient-Reported Outcome Measurement Information System (PROMIS PQ-Neuro) Neuropathic Pain Quality Scale is a short and practical measure that can be used to identify patients more likely to have NP and to distinguish levels of NP. The data collected will support future research that targets other unidimensional pain quality domains (e.g., nociceptive pain).

Neuro-QoL health-related quality of life measurement system: Validation in Parkinson's disease.

INTRODUCTION: Neuro-QoL is a multidimensional patient-reported outcome measurement system assessing aspects of physical, mental, and social health identified by neurology patients and caregivers as important. One of the first neurology-specific patient-reported outcome measure systems created using modern test development methods, Neuro-Qol enables brief, yet precise, assessment and the ability to conduct both PD-specific and cross-disease comparisons. We present results of Neuro-QoL clinical validation using a sample of PD patients. METHODS: A total of 120 PD patients recruited from academic medical centers were assessed at baseline, 1 week, and 6 months. Assessments included Neuro-QoL and general and PD-specific validity measures. RESULTS: Participants were 62% male and 95% white (average age = 66); H & Y stages were 1 (16%), 2 (61%), 3 (18%), and 4 (5%). Internal consistency and test-retest reliability of Neuro-QoL ranged from Cronbach's alphas = 0.81 to 0.94 with intraclass correlation coefficients = 0.66 to 0.80. Pearson's correlations between Neuro-QoL and legacy measures were generally moderate and in expected directions. UPDRS Part 2 was moderately correlated with Neuro-QoL Upper Extremity and Mobility, respectively (r's = -0.44; -0.59). Parkinson's Disease Questionnaire-39 and Neuro-QoL measures of similar constructs showed strong-to-moderate correlations (r's = 0.70-0.44). Neuro-QoL measures of fatigue, mobility, positive emotion, and emotional/behavioral control showed responsiveness to self-reported change. CONCLUSIONS: Neuro-QoL is valid for use in PD clinical research. Reliability for all but two measures is sufficient for group comparisons, with some evidence supporting responsiveness to change. Neuro-QoL possesses characteristics, such as brevity, flexibility in administration, and suitability, for cross-disease comparisons that may be advantageous to users in a variety of settings. © 2016 Movement Disorder Society.

Validating Neuro-QoL short forms and targeted scales with people who have multiple sclerosis.

BACKGROUND: Multiple sclerosis (MS) is a chronic, progressive, and disabling disease of the central nervous system with dramatic variations in the combination and severity of symptoms it can produce. The lack of reliable disease-specific health-related quality of life (HRQL) measures for use in clinical trials prompted the development of the Neurology Quality of Life (Neuro-QOL) instrument, which includes 13 scales that assess physical, emotional, cognitive, and social domains, for use in a variety of neurological illnesses. OBJECTIVE: The objective of this research paper is to conduct an initial assessment of the reliability and validation of the Neuro-QOL short forms (SFs) in MS. METHODS: We assessed reliability, concurrent validity, known groups validity, and responsiveness between cross-sectional and longitudinal data in 161 recruited MS patients. RESULTS: Internal consistency was high for all measures (α = 0.81-0.95) and ICCs were within the acceptable range (0.76-0.91); concurrent and known groups validity were highest with the Global HRQL question. Longitudinal assessment was limited by the lack of disease progression in the group. CONCLUSIONS: The Neuro-QOL SFs demonstrate good internal consistency, test-re-test reliability, and concurrent and known groups validity in this MS population, supporting the validity of Neuro-QOL in adults with MS.

Validation of the Neuro-QoL measurement system in children with epilepsy.

OBJECTIVE: Children with epilepsy often face complex psychosocial consequences that are not fully captured by existing patient-reported outcome (PRO) measures. The Neurology Quality of Life Measurement System "Neuro-QoL" was developed to provide a set of common PRO measures that address issues important to people with neurologic disorders. This paper reports Neuro-QoL (anxiety, depression, interaction with peers, fatigue, pain, cognitive function, stigma, and upper and lower extremity functions) validation in children with epilepsy. METHOD: Patients (aged 10-18years) diagnosed with epilepsy completed Neuro-QoL and legacy measures at time 1 (initial study visit) and 6-month follow-up. Internal consistency reliability was also evaluated. Concurrent validity was assessed by comparing Neuro-QoL measures with more established "legacy" measures of the same concepts. Clinical validity was evaluated by comparing mean Neuro-QoL scores of patients grouped by clinical anchors such as disease severity. Responsiveness of the Neuro-QoL from time 1 (initial study visit) to 6months was evaluated using self-reported change as the primary anchor. RESULTS: Sixty-one patients (mean age=13.4years; 62.3% male, 75.9% white) participated. Most patients (64.2%) had been seizure-free in the 3months prior to participation, and seizure frequency was otherwise described as follows: 17.8% daily, 13.3% weekly, 35.6% monthly, and 33.3% yearly. All patients were taking antiepileptic drugs. Patients reported better function/less symptoms compared to the reference groups. Internal consistency (alpha) coefficients ranged from 0.76 to 0.87. Patients with different seizure frequencies differed on anxiety (p<.01) and cognitive function (p<.05). Compared to patients on polytherapy, those on monotherapy had better upper extremity scores (p<.05). Compared to those with localized seizures, those experiencing generalized seizures reported worse stigma (p<.05). Depression, anxiety, lower extremity, fatigue, pain, interaction with peers, and stigma also significantly discriminated patients with different levels of quality of life (p≤.05). All Neuro-QoL measures were significantly correlated with other measures assessing similar domains. Stigma was related to self-reported change in several areas of functioning but in sometimes unexpected directions. SIGNIFICANCE: The Neurology Quality of Life Measurement System is a valid and reliable assessment tool for children with epilepsy and can be used in research and clinical settings.