Relationship of Hoarding and Depression Symptoms in Older Adults.

Hoarding disorder (HD) is a debilitating neuropsychiatric condition that affects 2%-6% of the population and increases in incidence with age. Major depressive disorder (MDD) co-occurs with HD in approximately 50% of cases and leads to increased functional impairment and disability. However, only one study to date has examined the rate and trajectory of hoarding symptoms in older individuals with a lifetime history of MDD, including those with current active depression (late-life depression; LLD). We therefore sought to characterize this potentially distinct phenotype. We determined the incidence of HD in two separate cohorts of participants with LLD (n = 73) or lifetime history of MDD (n = 580) and examined the reliability and stability of hoarding symptoms using the Saving Inventory-Revised (SI-R) and Hoarding Rating Scale-Self Report (HRS), as well as the co-variance of hoarding and depression scores over time. HD was present in 12% to 33% of participants with MDD, with higher rates found in those with active depressive symptoms. Hoarding severity was stable across timepoints in both samples (all correlations >0.75), and fewer than 30% of participants in each sample experienced significant changes in severity between any two timepoints. Change in depression symptoms over time did not co-vary with change in hoarding symptoms. These findings indicate that hoarding is a more common comorbidity in LLD than previously suggested, and should be considered in screening and management of LLD. Future studies should further characterize the interaction of these conditions and their impact on outcomes, particularly functional impairment in this vulnerable population.

Mobile toolbox (MTB) remote measures of executive function and processing speed: development and validation.

OBJECTIVE: The ability to remotely monitor cognitive skills is increasing with the ubiquity of smartphones. The Mobile Toolbox (MTB) is a new measurement system that includes measures assessing Executive Functioning (EF) and Processing Speed (PS): Arrow Matching, Shape-Color Sorting, and Number-Symbol Match. The purpose of this study was to assess their psychometric properties. METHOD: MTB measures were developed for smartphone administration based on constructs measured in the NIH Toolbox® (NIHTB). Psychometric properties of the resulting measures were evaluated in three studies with participants ages 18 to 90. In Study 1 (N = 92), participants completed MTB measures in the lab and were administered both equivalent NIH TB measures and other external measures of similar cognitive constructs. In Study 2 (N = 1,021), participants completed the equivalent NIHTB measures in the lab and then took the MTB measures on their own, remotely. In Study 3 (N = 168), participants completed MTB measures twice remotely, two weeks apart. RESULTS: All three measures exhibited very high internal consistency and strong test-retest reliability, as well as moderately high correlations with comparable NIHTB tests and moderate correlations with external measures of similar constructs. Phone operating system (iOS vs. Android) had a significant impact on performance for Arrow Matching and Shape-Color Sorting, but no impact on either validity or reliability. CONCLUSIONS: Results support the reliability and convergent validity of MTB EF and PS measures for use across the adult lifespan in remote, self-administered designs.

Storyteller in ADNI4: Application of an early Alzheimer's disease screening tool using brief, remote, and speech-based testing.

INTRODUCTION: Speech-based testing shows promise for sensitive and scalable objective screening for Alzheimer's disease (AD), but research to date offers limited evidence of generalizability. METHODS: Data were taken from the AMYPRED (Amyloid Prediction in Early Stage Alzheimer's Disease from Acoustic and Linguistic Patterns of Speech) studies (N = 101, N = 46 mild cognitive impairment [MCI]) and Alzheimer's Disease Neuroimaging Initiative 4 (ADNI4) remote digital (N = 426, N = 58 self-reported MCI, mild AD or dementia) and in-clinic (N = 57, N = 13 MCI) cohorts, in which participants provided audio-recorded responses to automated remote story recall tasks in the Storyteller test battery. Text similarity, lexical, temporal, and acoustic speech feature sets were extracted. Models predicting early AD were developed in AMYPRED and tested out of sample in the demographically more diverse cohorts in ADNI4 (> 33% from historically underrepresented populations). RESULTS: Speech models generalized well to unseen data in ADNI4 remote and in-clinic cohorts. The best-performing models evaluated text-based metrics (text similarity, lexical features: area under the curve 0.71-0.84 across cohorts). DISCUSSION: Speech-based predictions of early AD from Storyteller generalize across diverse samples. HIGHLIGHTS: The Storyteller speech-based test is an objective digital prescreener for Alzheimer's Disease Neuroimaging Initiative 4 (ADNI4). Speech-based models predictive of Alzheimer's disease (AD) were developed in the AMYPRED (Amyloid Prediction in Early Stage Alzheimer's Disease from Acoustic and Linguistic Patterns of Speech) sample (N = 101). Models were tested out of sample in ADNI4 in-clinic (N = 57) and remote (N = 426) cohorts. Models showed good generalization out of sample. Models evaluating text matching and lexical features were most predictive of early AD.

Brain Health Registry Study Partner Portal: Novel infrastructure for digital, dyadic data collection.

BACKGROUND: In Alzheimer's disease (AD) research, subjective reports of cognitive and functional decline from participant-study partner dyads is an efficient method of assessing cognitive impairment and clinical progression. METHODS: Demographics and subjective cognitive/functional decline (Everyday Cognition Scale [ECog]) scores from dyads enrolled in the Brain Health Registry (BHR) Study Partner Portal were analyzed. Associations between dyad characteristics and both ECog scores and study engagement were investigated. RESULTS: A total of 10,494 BHR participants (mean age = 66.9 ± 12.16 standard deviations, 67.4% female) have enrolled study partners (mean age = 64.3 ± 14.3 standard deviations, 49.3% female), including 8987 dyads with a participant 55 years of age or older. Older and more educated study partners were more likely to complete tasks and return for follow-up. Twenty-five percent to 27% of older adult participants had self and study partner-report ECog scores indicating a possible cognitive impairment. DISCUSSION: The BHR Study Partner Portal is a unique digital tool for capturing dyadic data, with high impact applications in the clinical neuroscience and AD fields. Highlights The Brain Health Registry (BHR) Study Partner Portal is a novel, digital platform of >10,000 dyads. Collection of dyadic online subjective cognitive and functional data is feasible. The portal has good usability as evidenced by positive study partner feedback. The portal is a potential scalable strategy for cognitive impairment screening in older adults.

The ADNI4 Digital Study: A novel approach to recruitment, screening, and assessment of participants for AD clinical research.

INTRODUCTION: We evaluated preliminary feasibility of a digital, culturally-informed approach to recruit and screen participants for the Alzheimer's Disease Neuroimaging Initiative (ADNI4). METHODS: Participants were recruited using digital advertising and completed digital surveys (e.g., demographics, medical exclusion criteria, 12-item Everyday Cognition Scale [ECog-12]), Novoic Storyteller speech-based cognitive test). Completion rates and assessment performance were compared between underrepresented populations (URPs: individuals from ethnoculturally minoritized or low education backgrounds) and non-URPs. RESULTS: Of 3099 participants who provided contact information, 654 enrolled in the cohort, and 595 completed at least one assessment. Two hundred forty-seven participants were from URPs. Of those enrolled, 465 met ADNI4 inclusion criteria and 237 evidenced possible cognitive impairment from ECog-12 or Storyteller performance. URPs had lower ECog and Storyteller completion rates. Scores varied by ethnocultural group and educational level. DISCUSSION: Preliminary results demonstrate digital recruitment and screening assessment of an older diverse cohort, including those with possible cognitive impairment, are feasible. Improving engagement and achieving educational diversity are key challenges. HIGHLIGHTS: A total of 654 participants enrolled in a digital cohort to facilitate ADNI4 recruitment. Culturally-informed digital ads aided enrollment of underrepresented populations. From those enrolled, 42% were from underrepresented ethnocultural and educational groups. Digital screening tools indicate > 50% of participants likely cognitively impaired. Completion rates and assessment performance vary by ethnocultural group and education.

How intention to join an Alzheimer's participant recruitment registry differs by race, ethnicity, sex, and family history: Results from a national survey of US adults.

INTRODUCTION: Alzheimer's-focused participant recruitment registries are tools for accelerating enrollment into studies, however, registry members are primarily White women. METHODS: We conducted a national online survey of 1501 adults ages 50-80, oversampling for Black and Hispanic/Latino respondents, assessing intention to join a generic "brain health" registry and to join a registry that required specific tasks. RESULTS: Intention to join a registry was low (M 3.48, SD 1.77), and lower than intention to join a registry requiring specific tasks. Intention was greatest for registries requiring completing surveys (M 4.70, SD 1.77). Differences in intention were primarily between White women and Black women; differences between other groups were limited to specific tasks required. DISCUSSION: The results indicate uncertainty about what a registry is, its purpose, and/or the concept of "brain health." Using the Reasoned Action Approach (RAA) to develop evidence-based outreach messages describing a registry and required tasks may increase diversity.

Brain health registry updates: An online longitudinal neuroscience platform.

INTRODUCTION: Remote, internet-based methods for recruitment, screening, and longitudinally assessing older adults have the potential to facilitate Alzheimer's disease (AD) clinical trials and observational studies. METHODS: The Brain Health Registry (BHR) is an online registry that includes longitudinal assessments including self- and study partner-report questionnaires and neuropsychological tests. New initiatives aim to increase inclusion and engagement of commonly underincluded communities using digital, community-engaged research strategies. New features include multilingual support and biofluid collection capabilities. RESULTS: BHR includes > 100,000 participants. BHR has made over 259,000 referrals resulting in 25,997 participants enrolled in 30 aging and AD studies. In addition, 28,278 participants are coenrolled in BHR and other studies with data linkage among studies. Data have been shared with 28 investigators. Recent efforts have facilitated the enrollment and engagement of underincluded ethnocultural communities. DISCUSSION: The major advantages of the BHR approach are scalability and accessibility. Challenges include compliance, retention, cohort diversity, and generalizability. HIGHLIGHTS: Brain Health Registry (BHR) is an online, longitudinal platform of > 100,000 members. BHR made > 259,000 referrals, which enrolled 25,997 participants in 32 studies. New efforts increased enrollment and engagement of underincluded communities in BHR. The major advantages of the BHR approach are scalability and accessibility. BHR provides a unique adjunct for clinical neuroscience research.

Digital culturally tailored marketing for enrolling Latino participants in a web-based registry: Baseline metrics from the Brain Health Registry.

INTRODUCTION: This culturally tailored enrollment effort aims to determine the feasibility of enrolling 5000 older Latino adults from California into the Brain Health Registries (BHR) over 2.25 years. METHODS: This paper describes (1) the development and deployment of culturally tailored BHR websites and digital ads, in collaboration with a Latino community science partnership board and a marketing company; (2) an interim feasibility analysis of the enrollment efforts and numbers, and participant characteristics (primary aim); as well as (3) an exploration of module completion and a preliminary efficacy evaluation of the culturally tailored digital efforts compared to BHR's standard non-culturally tailored efforts (secondary aim). RESULTS: In 12.5 months, 3603 older Latino adults were enrolled (71% of the total California Latino BHR initiative enrollment goal). Completion of all BHR modules was low (6%). DISCUSSION: Targeted ad placement, culturally tailored enrollment messaging, and culturally tailored BHR websites increased enrollment of Latino participants in BHR, but did not translate to increased module completion. HIGHLIGHTS: Culturally tailored social marketing and website improvements were implemented. The efforts enrolled 5662 Latino individuals in 12.5 months. The number of Latino Brain Health Registry (BHR) participants increased by 122.7%. We failed to adequately enroll female Latinos and Latinos with lower education. Future work will evaluate effects of a newly released Spanish-language BHR website.

Hoarding symptoms are associated with higher rates of disability than other medical and psychiatric disorders across multiple domains of functioning.

BACKGROUND: Hoarding symptoms are associated with functional impairment, though investigation of disability among individuals with hoarding disorder has largely focused on clutter-related impairment to home management activities and difficulties using space because of clutter. This analysis assesses disability among individuals with hoarding symptoms in multiple domains of everyday functioning, including cognition, mobility, self-care, interpersonal and community-level interactions, and home management. The magnitude of the association between hoarding and disability was compared to that of medical and psychiatric disorders with documented high disability burden, including major depressive disorder (MDD), diabetes, and chronic pain. METHODS: Data were cross-sectionally collected from 16,312 adult participants enrolled in an internet-based research registry, the Brain Health Registry. Pearson's chi-square tests and multivariable logistic regression models were used to quantify the relationship between hoarding and functional ability relative to MDD, diabetes, and chronic pain. RESULTS: More than one in ten participants endorsed clinical (5.7%) or subclinical (5.7%) hoarding symptoms (CHS and SCHS, respectively). After adjusting for participant demographic characteristics and psychiatric and medical comorbidity, CHS and SCHS were associated with increased odds of impairment in all domains of functioning. Moderate to extreme impairment was endorsed more frequently by those with CHS or SCHS compared to those with self-reported MDD, diabetes, and/or chronic pain in nearly all domains (e.g., difficulty with day-to-day work or school: CHS: 18.7% vs. MDD: 11.8%, p < 0.0001) except mobility and self-care. While those with current depressive symptoms endorsed higher rates of impairment than those with hoarding symptoms, disability was most prevalent among those endorsing both hoarding and comorbid depressive symptoms. CONCLUSIONS: Hoarding symptoms are associated with profound disability in all domains of functioning. The burden of hoarding is comparable to that of other medical and psychiatric illnesses with known high rates of functional impairment. Future studies should examine the directionality and underlying causality of the observed associations, and possibly identify target interventions to minimize impairment associated with hoarding symptomatology.

Web-Based Mindfulness-Based Interventions for Well-being: Randomized Comparative Effectiveness Trial.

BACKGROUND: Mindfulness can improve overall well-being by training individuals to focus on the present moment without judging their thoughts. However, it is unknown how much mindfulness practice and training are necessary to improve well-being. OBJECTIVE: The primary aim of this study was to determine whether a standard 8-session web-based mindfulness-based cognitive therapy (MBCT) program, compared with a brief 3-session mindfulness intervention, improved overall participant well-being. In addition, we sought to explore whether the treatment effects differed based on the baseline characteristics of the participants (ie, moderators). METHODS: Participants were recruited from 17 patient-powered research networks, web-based communities of stakeholders interested in a common research area. Participants were randomized to either a standard 8-session MBCT or a brief 3-session mindfulness training intervention accessed on the web. The participants were followed for 12 weeks. The primary outcome of the study was well-being, as measured by the World Health Organization-Five Well-Being Index. We hypothesized that MBCT would be superior to a brief mindfulness training. RESULTS: We randomized 4411 participants, 3873 (87.80%) of whom were White and 3547 (80.41%) of female sex assigned at birth. The mean baseline World Health Organization-Five Well-Being Index score was 50.3 (SD 20.7). The average self-reported well-being in each group increased over the intervention period (baseline to 8 weeks; model-based slope for the MBCT group: 0.78, 95% CI 0.63-0.93, and brief mindfulness group: 0.76, 95% CI 0.60-0.91) as well as the full study period (ie, intervention plus follow-up; baseline to 20 weeks; model-based slope for MBCT group: 0.41, 95% CI 0.34-0.48; and brief mindfulness group: 0.33, 95% CI 0.26-0.40). Changes in self-reported well-being were not significantly different between MBCT and brief mindfulness during the intervention period (model-based difference in slopes: -0.02, 95% CI -0.24 to 0.19; P=.80) or during the intervention period plus 12-week follow-up (-0.08, 95% CI -0.18 to 0.02; P=.10). During the intervention period, younger participants (P=.05) and participants who completed a higher percentage of intervention sessions (P=.005) experienced greater improvements in well-being across both interventions, with effects that were stronger for participants in the MBCT condition. Attrition was high (ie, 2142/4411, 48.56%), which is an important limitation of this study. CONCLUSIONS: Standard MBCT improved well-being but was not superior to a brief mindfulness intervention. This finding suggests that shorter mindfulness programs could yield important benefits across the general population of individuals with various medical conditions. Younger people and participants who completed more intervention sessions reported greater improvements in well-being, an effect that was more pronounced for participants in the MBCT condition. This finding suggests that standard MBCT may be a better choice for younger people as well as treatment-adherent individuals. TRIAL REGISTRATION: ClinicalTrials.gov NCT03844321; https://clinicaltrials.gov/ct2/show/NCT03844321.

Screening and enrollment of underrepresented ethnocultural and educational populations in the Alzheimer's Disease Neuroimaging Initiative (ADNI).

INTRODUCTION: An analysis of the ethnocultural and socioeconomic composition of Alzheimer's Disease Neuroimaging Initiative (ADNI) participants is needed to assess the generalizability of ADNI data to diverse populations. METHODS: ADNI data collected between October 2004 and November 2020 were used to determine ethnocultural and educational composition of the sample and differences in the following metrics: screening, screen fails, enrollment, biomarkers. RESULTS: Of 3739 screened individuals, 11% identified as being from ethnoculturally underrepresented populations (e.g., Black, Latinx) and 16% had <12 years of education. Of 2286 enrolled participants, 11% identified as ethnoculturally underrepresented individuals and 15% had <12 years of education. This participation is considerably lower than US Census data for adults 60+ (ethnoculturally underrepresented populations: 25%; <12 years of education: 4%). Individuals with <12 years of education failed screening at a higher rate. DISCUSSION: Our findings suggest that ADNI results may not be entirely generalizable to ethnoculturally diverse and low education populations.

Remote blood collection from older adults in the Brain Health Registry for plasma biomarker and genetic analysis.

INTRODUCTION: Use of online registries to efficiently identify older adults with cognitive decline and Alzheimer's disease (AD) is an approach with growing evidence for feasibility and validity. Linked biomarker and registry data can facilitate AD clinical research. METHODS: We collected blood for plasma biomarker and genetic analysis from older adult Brain Health Registry (BHR) participants, evaluated feasibility, and estimated associations between demographic variables and study participation. RESULTS: Of 7150 participants invited to the study, 864 (12%) enrolled and 629 (73%) completed remote blood draws. Participants reported high study acceptability. Those from underrepresented ethnocultural and educational groups were less likely to participate. DISCUSSION: This study demonstrates the challenges of remote blood collection from a large representative sample of older adults. Remote blood collection from > 600 participants within a short timeframe demonstrates the feasibility of our approach, which can be expanded for efficient collection of plasma AD biomarker and genetic data.

Putting participants and study partners FIRST when clinical trials end early.

Between 2018 and 2019, multiple clinical trials ended earlier than planned, resulting in calls to improve communication with and support for participants and their study partners ("dyads"). The multidisciplinary Participant Follow-Up Improvement in Research Studies and Trials (Participant FIRST) Work Group met throughout 2021. Its goals were to identify best practices for communicating with and supporting dyads affected by early trial stoppage. The Participant FIRST Work Group identified 17 key recommendations spanning the pre-trial, mid-trial, and post-trial periods. These focus on prospectively allocating sufficient resources for orderly closeout; developing dyad-centered communication plans; helping dyads build and maintain support networks; and, if a trial stops, informing dyads rapidly. Participants and study partners invest time, effort, and hope in their research participation. The research community should take intentional steps toward better communicating with and supporting participants when clinical trials end early. The Participant FIRST recommendations are a practical guide for embarking on that journey.

The search for a convenient procedure to detect one of the earliest signs of Alzheimer's disease: A systematic review of the prediction of brain amyloid status.

INTRODUCTION: Convenient, cost-effective tests for amyloid beta (Aß) are needed to identify those at higher risk for developing Alzheimer's disease (AD). This systematic review evaluates recent models that predict dichotomous Aß. (PROSPERO: CRD42020144734). METHODS: We searched Embase and identified 73 studies from 29,581 for review. We assessed study quality using established tools, extracted information, and reported results narratively. RESULTS: We identified few high-quality studies due to concerns about Aß determination and analytical issues. The most promising convenient, inexpensive classifiers consist of age, apolipoprotein E genotype, cognitive measures, and/or plasma Aß. Plasma Aß may be sufficient if pre-analytical variables are standardized and scalable assays developed. Some models lowered costs associated with clinical trial recruitment or clinical screening. DISCUSSION: Conclusions about models are difficult due to study heterogeneity and quality. Promising prediction models used demographic, cognitive/neuropsychological, imaging, and plasma Aß measures. Further studies using standardized Aß determination, and improved model validation are required.

Item response theory analysis of the Clinical Dementia Rating.

INTRODUCTION: The Clinical Dementia Rating (CDR) is widely used in Alzheimer's disease research studies and has well established reliability and validity. To facilitate the development of an online, electronic CDR (eCDR) for more efficient clinical applications, this study aims to produce a shortened version of the CDR, and to develop the statistical model for automatic scoring. METHODS: Item response theory (IRT) was used for item evaluation and model development. An automatic scoring algorithm was validated using existing CDR global and domain box scores as the reference standard. RESULTS: Most CDR items discriminate well at mild and very mild levels of cognitive impairment. The bi-factor IRT model fits best and the shortened CDR still demonstrates very high classification accuracy (81%∼92%). DISCUSSION: The shortened version of the CDR and the automatic scoring algorithm has established a good foundation for developing an eCDR and will ultimately improve the efficiency of cognitive assessment.

Validation of online functional measures in cognitively impaired older adults.

INTRODUCTION: Assessment of functional status is associated with risk of cognitive decline and diagnosis of dementia, and can be assessed by participants and study partners (SPs). METHODS: In 770 older adults enrolled in the Imaging Dementia-Evidence for Amyloid Scanning (IDEAS) study and the online Brain Health Registry (BHR), we estimated associations between online assessments and clinical variables related to Alzheimer's disease (AD) risk. RESULTS: Worse online learning scores and SP-reported functional decline were associated with higher probability of AD dementia diagnosis and poor in-clinic cognitive assessment, and with higher odds of amyloid beta (Aß) positivity when combined with participants' report of less decline. SP report of functional decline conferred predictive value independent of online cognitive assessments. Participants underreported decline compared to SPs. DISCUSSION: The results support the validity of online assessments and their greater utilization in healthcare and research settings. Online SP-reported functional decline is an indicator of dementia and AD risk.

Participant completion of longitudinal assessments in an online cognitive aging registry: The role of medical conditions.

INTRODUCTION: This study aimed to understand whether older adults' longitudinal completion of assessments in an online Alzheimer's disease and related dementias (ADRD)-related registry is influenced by self-reported medical conditions. METHODS: Brain Health Registry (BHR) is an online cognitive aging and ADRD-related research registry that includes longitudinal health and cognitive assessments. Using logistic regressions, we examined associations between longitudinal registry completion outcomes and self-reported (1) number of medical conditions and (2) eight defined medical condition groups (cardiovascular, metabolic, immune system, ADRD, current psychiatric, substance use/abuse, acquired, other specified conditions) in adults aged 55+ (N = 23,888). Longitudinal registry completion outcomes were assessed by the completion of the BHR initial questionnaire (first questionnaire participants see at each visit) at least twice and completion of a cognitive assessment (Cogstate Brief Battery) at least twice. Models included ethnocultural identity, education, age, and subjective memory concern as covariates. RESULTS: We found that the likelihood of longitudinally completing the initial questionnaire was negatively associated with reporting a diagnosis of ADRD and current psychiatric conditions but was positively associated with reporting substance use/abuse and acquired medical conditions. The likelihood of longitudinally completing the cognitive assessment task was negatively associated with number of reported medical conditions, as well as with reporting cardiovascular conditions, ADRD, and current psychiatric conditions. Previously identified associations between ethnocultural identity and longitudinal assessment completion in BHR remained after accounting for the presence of medical conditions. DISCUSSION: This post hoc analysis provides novel, initial evidence that older adults' completion of longitudinal assessments in an online registry is associated with the number and types of participant-reported medical conditions. Our findings can inform future efforts to make online studies with longitudinal health and cognitive assessments more usable for older adults with medical conditions. The results need to be interpreted with caution due to selection biases, and the under-inclusion of minoritized communities.

Development and validation of an episodic memory measure in the Mobile Toolbox (MTB): Arranging Pictures.

INTRODUCTION: Arranging Pictures is a new episodic memory test based on the NIH Toolbox (NIHTB) Picture Sequence Memory measure and optimized for self-administration on a personal smartphone within the Mobile Toolbox (MTB). We describe evidence from three distinct validation studies. METHOD: In Study 1, 92 participants self-administered Arranging Pictures on study-provided smartphones in the lab and were administered external measures of similar and dissimilar constructs by trained examiners to assess validity under controlled circumstances. In Study 2, 1,021 participants completed the external measures in the lab and self-administered Arranging Pictures remotely on their personal smartphones to assess validity in real-world contexts. In Study 3, 141 participants self-administered Arranging Pictures remotely twice with a two-week delay on personal iOS smartphones to assess test-retest reliability and practice effects. RESULTS: Internal consistency was good across samples (ρxx = .80 to .85, p < .001). Test-retest reliability was marginal (ICC = .49, p < .001) and there were significant practice effects after a two-week delay (ΔM = 3.21 (95% CI [2.56, 3.88]). As expected, correlations with convergent measures were significant and moderate to large in magnitude (ρ = .44 to .76, p < .001), while correlations with discriminant measures were small (ρ = .23 to .27, p < .05) or nonsignificant. Scores demonstrated significant negative correlations with age (ρ = -.32 to -.21, p < .001). Mean performance was slightly higher in the iOS compared to the Android group (MiOS = 18.80, NiOS = 635; MAndroid = 17.11, NAndroid = 386; t(757.73) = 4.17, p < .001), but device type did not significantly influence the psychometric properties of the measure. Indicators of potential cheating were mixed; average scores were significantly higher in the remote samples (F(2, 850) = 11.415, p < .001), but there were not significantly more perfect scores. CONCLUSION: The MTB Arranging Pictures measure demonstrated evidence of reliability and validity when self-administered on personal device. Future research should examine the potential for cheating in remote settings and the properties of the measure in clinical samples.

Validity and reliability of the Mobile Toolbox Faces and Names memory test.

Validation of the Mobile Toolbox Faces and Names associative memory test is presented. Ninety-two participants self-administered Faces and Names in-person; 956 self-administered Faces and Names remotely but took convergent measures in person; and 123 self-administered Faces and Names remotely twice, 14 days apart. Internal consistency (.76-.79) and test-retest reliability (ICC = .73) were acceptable. Convergent validity with WMS-IV Verbal Paired Associates was satisfactory (immediate .54; delayed .58). The findings suggest the remotely administered Faces and Names is a reliable instrument.

Development and Validation of a Vocabulary Measure in the Mobile Toolbox.

OBJECTIVE: We describe the development of a new computer adaptive vocabulary test, Mobile Toolbox (MTB) Word Meaning, and validity evidence from 3 studies. METHOD: Word Meaning was designed to be a multiple-choice synonym test optimized for self-administration on a personal smartphone. The items were first calibrated online in a sample of 7,525 participants to create the computer-adaptive test algorithm for the Word Meaning measure within the MTB app. In Study 1, 92 participants self-administered Word Meaning on study-provided smartphones in the lab and were administered external measures by trained examiners. In Study 2, 1,021 participants completed the external measures in the lab and Word Meaning was self-administered remotely on their personal smartphones. In Study 3, 141 participants self-administered Word Meaning remotely twice with a 2-week delay on personal iPhones. RESULTS: The final bank included 1363 items. Internal consistency was adequate to good across samples (ρxx = 0.78 to 0.81, p < .001). Test-retest reliability was good (ICC = 0.65, p < .001), and the mean theta score was not significantly different upon the second administration. Correlations were moderate to large with measures of similar constructs (ρ = 0.67-0.75, p < .001) and non-significant with measures of dissimilar constructs. Scores demonstrated small to moderate correlations with age (ρ = 0.35 to 0.45, p < .001) and education (ρ = 0.26, p < .001). CONCLUSION: The MTB Word Meaning measure demonstrated evidence of reliability and validity in three samples. Further validation studies in clinical samples are necessary.