RESUMO
OBJECTIVE: To identify the frequency and relative importance of symptoms experienced by adults with fibromyalgia (FM) and determine factors associated with a higher disease burden. METHODS: We conducted semistructured interviews with 15 participants with FM, collecting 1479 quotes regarding the symptomatic burden of FM. We then performed an international cross-sectional study involving 1085 participants with FM to determine the prevalence and relative importance (scale 0-4) of 149 symptoms representing 14 symptomatic themes. We performed subgroup analysis to determine how age, sex, disease duration, medication use, employment status, change in employment status, missing work due to FM, and ability level are related to symptomatic theme prevalence. RESULTS: The symptomatic themes with the highest prevalence in FM were pain (99.8%), muscle tenderness (99.8%), and fatigue (99.3%). The symptomatic themes that had the greatest effect on patients' lives were related to fatigue (2.88), pain (2.85), muscle tenderness (2.79), and impaired sleep and daytime sleepiness (2.70). Symptomatic theme prevalence was most strongly associated with the modified Rankin Scale level of disability, disability status, and change in employment status (on disability vs not on disability). CONCLUSION: Participants with FM identify a variety of symptoms that significantly affect their daily lives. Many of these symptoms, such as fatigue, sleep disturbance, and activity limitation, are life-altering and not related to traditional diagnostic criteria. Symptom prevalence in this population varies across subgroups based on demographic categories and disability status.
Assuntos
Fadiga , Fibromialgia , Humanos , Fibromialgia/epidemiologia , Fibromialgia/fisiopatologia , Feminino , Masculino , Pessoa de Meia-Idade , Adulto , Estudos Transversais , Fadiga/epidemiologia , Medidas de Resultados Relatados pelo Paciente , Dor/epidemiologia , Qualidade de Vida , Idoso , Efeitos Psicossociais da Doença , Índice de Gravidade de Doença , Prevalência , Emprego , Avaliação da DeficiênciaRESUMO
OBJECTIVE: We sought to develop and validate the Crohn's Disease-Health Index (CD-HI), a disease-specific, patient-reported outcome measure that serially measures Crohn's disease (CD) symptomatic burden in adults with CD. BACKGROUND: As therapeutic interventions are tested among patients with CD, responsive outcome measures are needed to track disease progression and therapeutic gain during clinical trials. PATIENTS AND METHODS: We conducted a national cross-sectional study of individuals with CD to identify the most prevalent and impactful symptoms of CD. The most relevant symptoms were included in the CD-HI. We used factor analysis, qualitative patient interviews, test-retest reliability evaluation, and known group validity testing to evaluate and optimize the CD-HI. RESULTS: The CD-HI contains 12 subscales that comprehensively measure CD burden using the patient's perspective. Fifteen adults with CD beta tested the CD-HI and found the instrument to be clear, easy to use, and relevant to them. Twenty-three adults with CD participated in an assessment of test-retest reliability, which indicated high reliability of individual questions, subscales, and the full instrument (intraclass correlation coefficient = 0.84 for the full instrument). The CD-HI and its subscales demonstrated a high internal consistency (Cronbach α = 0.98 for the full instrument). The CD-HI distinguished between groups of individuals with CD known to differ in disease severity. CONCLUSIONS: This research supports the use of the CD-HI as a valid, sensitive, reliable, and relevant patient-reported outcome to determine the multifactorial disease burden of those with CD, assess the relevance and merit of future CD therapies, and support drug labeling claims.
RESUMO
OBJECTIVE: The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties. METHOD: MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (N = 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (N = 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (N = 168), participants completed MTB measures twice remotely, two weeks apart. RESULTS: All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability. CONCLUSIONS: Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.
RESUMO
The progress of developmental research demands reliable measurement techniques, yet inconsistency persist across laboratories, subfields, and settings. To address this, the NIH Toolbox for Neurological and Behavioral Function (NIHTB)® has been extended to create a universal assessment for developmental and pediatric communities: The NIH Infant and Toddler ("Baby") Toolbox. Currently undergoing norming in a sample of 2550 children demographically representative of the 2020 U.S. census, the Baby Toolbox is slated for release in late 2024. This paper introduces the Baby Toolbox, details its objectives, development, and technological innovations, describes plans for reliability and norming, and invites researchers to consider the Baby Toolbox in the future studies. Ultimately, this initiative stands to enhance cross-study comparability and advance comprehensive developmental evaluation.
RESUMO
Cognitive research with developmental samples requires improved methods that support large-scale, diverse, and open science. This paper offers initial evidence to support the Mobile Toolbox (MTB), a self-administered remote smartphone-based cognitive battery, in youth populations, from a pilot sample of 99 children (Mage = 11.79 years; 36% female; 53% White, 33% Black or African American, 9% Asian, and 15% Hispanic). Completion rates (95%-99%), practice performance (96%-100%), internal consistency (0.60-0.98), and correlations with similar NIHTB measures (0.55-0.77) provide the first evidence to support the MTB in a youth sample, although there were some inconsistencies across measures. Preliminary findings provide promising evidence of the MTB in developmental populations, and further studies are encouraged.
Assuntos
Estudos de Viabilidade , Aplicativos Móveis , Humanos , Feminino , Masculino , Criança , Adolescente , Aplicativos Móveis/normas , Smartphone , Testes Neuropsicológicos/normas , Projetos PilotoRESUMO
Objective: Early measurement of atypical disruptive behavior within autistic children is critical for later referrals to behavioral screenings, diagnoses, and services. Disruptive behavior in autistic toddlers is often measured using a categorical approach and identifies the presence or absence of behavior. In contrast, dimensional approaches evaluate behavior on a spectrum of typical to atypical by measuring the clinical salience of disruptive behavior. We sought to assess the validity of the Infant/Toddler version of the multidimensional assessment profile of disruptive behavior (MAP-DB-IT), a dimensional approach measurement tool, in a sample of autistic toddlers. Methods: Autistic toddlers (n = 82, M age = 33.2 months, SD = 6.28 months) and their mothers received 8 weeks of caregiver-mediated social communication intervention. Mothers completed the MAP-DB-IT and the Infant Toddler Social Emotional Assessment (ITSEA) across three timepoints: before intervention, immediately after intervention, and at 3 months post-intervention follow-up. The MAP-DB-IT provided scores for three subdomains: temper loss, noncompliance, and aggression (generically or specifically with siblings). Ratings on the MAP-DB-IT were compared to the ITSEA using several analytic strategies such as evaluating (a) the internal consistency of the MAP-DB-IT domain scores; (b) the convergent validity between the two measures; and (c) its convergent change due to intervention and if this varied by child characteristics. Results: The MAP-DB-IT demonstrated excellent internal consistency across all four subdomains. We evaluated convergent validity and found positive correlations between the (a) ITSEA externalizing and MAP-DB-IT aggression domain, (b) ITSEA externalizing and MAP-DB-IT aggression with siblings domain, and (c) ITSEA dysregulation and MAP-DB-IT temper loss domain. Conclusion: The MAP-DB-IT is a valid measurement tool for disruptive behavior in autistic toddlers. Clinicians should consider the use of the MAP-DB-IT for young autistic clients presenting with disruptive behavior to (a) discriminate between early developmentally appropriate tantrums from clinically salient dysregulation, and (b) refer to additional behavioral evaluations and services.
RESUMO
Measurement invariance (MI) is a psychometric property of an instrument indicating the degree to which scores from an instrument are comparable across groups. In recent years, there has been a marked uptick in publications using MI in intellectual and developmental disability (IDD) samples. Our goal here is to provide an overview of why MI is important to IDD researchers and to describe some challenges to evaluating it, with an eye towards nudging our subfield into a more thoughtful and measured interpretation of studies using MI.
Assuntos
Deficiências do Desenvolvimento , Deficiência Intelectual , Psicometria , Humanos , Deficiência Intelectual/psicologia , Psicometria/normas , Psicometria/instrumentação , Pesquisa Biomédica/normasRESUMO
Background: Intellectual and developmental disabilities (IDDs) are associated with both cognitive challenges and difficulties in conceptual, social, and practical areas of living (DSM-5). Individuals with IDD often present with an intellectual disability in addition to a developmental disability such as autism or Down syndrome. Those with IDD may present with deficits in intellectual functioning as well as adaptive functioning that interfere with independence and living skills. The present study sought to examine associations of longitudinal developmental change in domains of cognition (NIH Toolbox Cognition Battery, NIHTB-CB) and adaptive behavior domains (Vineland Adaptive Behavior Scales-3; VABS-3) including Socialization, Communication, and Daily Living Skills (DLS) over a two-year period. Methods: Eligible participants for this multisite longitudinal study included those who were between 6 and 26 years at Visit 1, and who had a diagnosis of, or suspected intellectual disability (ID), including borderline ID. Three groups were recruited, including those with fragile X syndrome, Down syndrome, and other/idiopathic intellectual disability. In order to examine the association of developmental change between cognitive and adaptive behavior domains, bivariate latent change score (BLCS) models were fit to compare change in the three cognitive domains measured by the NIHTB-CB (Fluid, Crystallized, Composite) and the three adaptive behavior domains measured by the VABS-3 (Communication, DLS, and Socialization). Results: Over a two-year period, change in cognition (both Crystalized and Composite) was significantly and positively associated with change in daily living skills. Also, baseline cognition level predicted growth in adaptive behavior, however baseline adaptive behavior did not predict growth in cognition in any model. Conclusions: The present study demonstrated that developmental improvements in cognition and adaptive behavior are associated in children and young adults with IDD, indicating the potential for cross-domain effects of intervention. Notably, improvements in Daily Living Skills on the VABS-3 emerged as a primary area of adaptive behavior that positively related to improvements in cognition. This work provides evidence for the clinical, "real life" meaningfulness of the NIHTB-CB in IDD, and important empirical support for the NIHTB-CB as a fit-for-purpose performance-based outcome measure for this population.
RESUMO
BACKGROUND: Intellectual and developmental disabilities (IDDs) are associated with both cognitive challenges and difficulties in conceptual, social, and practical areas of living, commonly referred to as adaptive behavior (DSM-5). Although cross-sectional associations between intelligence or cognition and adaptive behavior have been reported in IDD populations, no study to date has examined whether developmental changes in cognition contribute to or track with changes in adaptive behavior. The present study sought to examine associations of longitudinal developmental change in domains of cognition (NIH Toolbox Cognition Battery, NIHTB-CB) and adaptive behavior domains (Vineland Adaptive Behavior Scales-3; VABS-3) including Socialization, Communication, and Daily Living Skills (DLS) over a two year period in a large sample of children, adolescents and young adults with IDD. METHODS: Three groups were recruited, including those with fragile X syndrome, Down syndrome, and other/idiopathic intellectual disability. Eligible participants (n = 263) included those who were between 6 and 26 years (mage = 15.52, sd = 5.17) at Visit 1, and who had a diagnosis of, or suspected intellectual disability (ID), including borderline ID, with a mental age of at least 3.0 years. Participants were given cognitive and adaptive behavior assessments at two time points over a two year period (m = 2.45 years, range = 1.27 to 5.56 years). In order to examine the association of developmental change between cognitive and adaptive behavior domains, bivariate latent change score (BLCS) models were fit to compare change in the three cognitive domains measured by the NIHTB-CB (Fluid Cognition, Crystallized Cognition, Total Cognition) and the three adaptive behavior domains measured by the VABS-3 (Communication, DLS, and Socialization). RESULTS: Over a two year period, change in cognition (both Crystallized and Total Composites) was significantly and positively associated with change in daily living skills. Also, baseline cognition level predicted growth in adaptive behavior, however baseline adaptive behavior did not predict growth in cognition in any model. CONCLUSIONS: The present study demonstrated that developmental changes in cognition and adaptive behavior are associated in children and young adults with IDD, indicating the potential for cross-domain effects of intervention. Notably, improvements in DLS emerged as a primary area of adaptive behavior that positively related to improvements in cognition. This work provides evidence for the clinical, "real life" meaningfulness of changes in cognition detected by the NIHTB-CB in IDD, and provides empirical support for the NIHTB-CB as a fit-for-purpose performance-based outcome measure for this population.
Assuntos
Adaptação Psicológica , Cognição , Deficiências do Desenvolvimento , Deficiência Intelectual , Humanos , Masculino , Criança , Adolescente , Feminino , Adaptação Psicológica/fisiologia , Adulto Jovem , Adulto , Cognição/fisiologia , Estudos Longitudinais , Atividades Cotidianas , Socialização , Síndrome de Down/fisiopatologia , Síndrome do Cromossomo X Frágil/fisiopatologiaRESUMO
INTRODUCTION: Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. METHOD: In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. RESULTS: Internal consistency was good across samples (ρxx = .80 to .85, p < .001). Test-retest reliability was marginal (ICC = .49, p < .001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ = .44 to .76, p < .001), while correlations with discriminant measures were small (ρ = .23 to .27, p < .05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to -.21, p < .001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p < .001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p < .001), but there were not significantly more perfect scores. CONCLUSION: The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples.
Assuntos
Memória Episódica , Humanos , Masculino , Feminino , Reprodutibilidade dos Testes , Adulto , Pessoa de Meia-Idade , Adulto Jovem , Idoso , Testes Neuropsicológicos/normas , Smartphone , Adolescente , Aplicativos Móveis/normas , Psicometria/normas , Psicometria/instrumentação , Estimulação Luminosa/métodosRESUMO
OBJECTIVE: We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies. METHOD: Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones. RESULTS: The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001). CONCLUSION: The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.
RESUMO
Timely detection of cognitive impairment (CI) is critical for the wellbeing of elderly individuals. The MyCog assessment employs two validated iPad-based measures from the NIH Toolbox® for Assessment of Neurological and Behavioral Function (NIH Toolbox). These measures assess pivotal cognitive domains: Picture Sequence Memory (PSM) for episodic memory and Dimensional Change Card Sort Test (DCCS) for cognitive flexibility. The study involved 86 patients and explored diverse machine learning models to enhance CI prediction. This encompassed traditional classifiers and neural-network-based methods. After 100 bootstrap replications, the Random Forest model stood out, delivering compelling results: precision at 0.803, recall at 0.758, accuracy at 0.902, F1 at 0.742, and specificity at 0.951. Notably, the model incorporated a composite score derived from a 2-parameter higher order item response theory (HOIRT) model that integrated DCCS and PSM assessments. The study's pivotal finding underscores the inadequacy of relying solely on a fixed composite score cutoff point. Instead, it advocates for machine learning models that incorporate HOIRT-derived scores and encompass relevant features such as age. Such an approach promises more effective predictive models for CI, thus advancing early detection and intervention among the elderly.