The use of subjective cognitive complaints for detecting mild cognitive impairment in older adults across cultural and linguistic groups: A comparison of the Cognitive Function Instrument to the Montreal Cognitive Assessment.

INTRODUCTION: This pilot study aims to explore the psychometric properties of the Cognitive Function Instrument (CFI) as a measure of subjective cognitive complaints (SCC) and its performance in distinguishing mild cognitive impairment (MCI) from normal control (NC) compared to an objective cognitive screen (Montreal Cognitive Assessment [MoCA]). METHODS: One hundred ninety-four community-dwelling non-demented older adults with racial/ethnic diversity were included. Unidimensionality and internal consistency of the CFI were examined using factor analysis, Cronbach's alpha, and McDonald's omega. Logistic regression models and receiver operating characteristic (ROC) analysis were used to examine the performance of CFI. RESULTS: The CFI demonstrated adequate internal consistency; however, the fit for a unidimensional model was suboptimal. The CFI distinguished MCI from NC alone or in combination with MoCA. ROC analysis showed comparable performance of the CFI and the MoCA. DISCUSSION: Our findings support the use of CFI as a brief and easy-to-use screen to detect MCI in culturally/linguistically diverse older adults. HIGHLIGHT: What is the key scientific question or problem of central interest of the paper? Subjective cognitive complaints (SCCs) are considered the earliest sign of dementia in older adults. However, it is unclear if SCC are equivalent in different cultures. The Cognitive Function Instrument (CFI) is a 14-item measure of SCC. This study provides pilot data suggesting that CFI is sensitive for detecting mild cognitive impairment in a cohort of older adults with racial/ethnic diversity. Comparing performance, CFI demonstrates comparable sensitivity to the Montreal Cognitive Assessment, an objective cognitive screening test. Overall, SCC may provide a non-invasive, easy-to-use method to flag possible cognitive impairment in both research and clinical settings.

Challenges in Measuring Applied Cognition: Measurement Properties and Equivalence of the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT) Applied Cognition Item Bank.

OBJECTIVE: To present challenges in assessment of applied cognition and the results of differential item functioning (DIF) analyses used to inform the development of a computerized adaptive test (CAT). DESIGN: Measurement evaluation cohort study. DIF analyses of 107 items were conducted across educational, age, and sex groups. DIF hypotheses informed the evaluation of the results. SETTING: Hospital-based rehabilitation from a single hospital system. PARTICIPANTS: A total of 2216 hospitalized patients (N=2216). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Applied cognition item pool from multiple sources. RESULTS: Many items were hypothesized to show DIF, particularly for age. Information was moderately high in the lower (cognitive disability) tail of the distribution, but some items were not informative. Reliability estimates were high (>0.89) across all studied groups, regardless of estimation method. There were 35 items with DIF of high magnitude and 19 with accompanying supportive hypotheses. CONCLUSIONS: A key clinical tool in inpatient rehabilitation medicine is assessment of applied functional cognitive ability to inform patient-centered rehabilitation strategies to improve function. This was the first study to evaluate measurement equivalence of the applied cognition item pool across large samples of hospitalized patients. Although about one-third of the item pool evidenced DIF or low discrimination, results supported placement of most items into the bank and its use across groups differing in education, age, and sex. Six items were classified with salient DIF, defined as consistent DIF of high magnitude and or impact, with confirmatory directional DIF hypotheses, generated by content experts. These were recommended for adjustment or removal from the bank; 4 were deleted from the bank and 2 had lowered CAT exposure (administration frequency) rates. Many items hypothesized to show DIF contained content measuring constructs other than applied cognition such as physical frailty, perceptual difficulties, or skills reflective of greater educational attainment. Challenges in measurement of this construct are discussed.

Examination of the Measurement Equivalence of the Functional Assessment in Acute Care MCAT (FAMCAT) Mobility Item Bank Using Differential Item Functioning Analyses.

OBJECTIVE: To assess differential item functioning (DIF) in an item pool measuring the mobility of hospitalized patients across educational, age, and sex groups. DESIGN: Measurement evaluation cohort study. Content experts generated DIF hypotheses to guide the interpretation. The graded response item response theory (IRT) model was used. Primary DIF tests were Wald statistics; sensitivity analyses were conducted using the IRT ordinal logistic regression procedure. Magnitude and impact were evaluated by examining group differences in expected item and scale score functions. SETTING: Hospital-based rehabilitation. PARTICIPANTS: Hospitalized patients (N=2216). INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: A total of 111 self-reported mobility items. RESULTS: Two linking items among those used to set the metric across forms evidenced DIF for sex and age: "difficulty climbing stairs step-over-step without a handrail (alternating feet)" and "difficulty climbing 3-5 steps without a handrail." Conditional on the mobility state, the items were more difficult for women and older people (aged ≥65y). An additional 18 items were identified with DIF. Items with both high DIF magnitude and hypotheses related to age were difficulty "crossing road at a 4-lane traffic light with curbs," "jumping/landing on one leg," "strenuous activities," and "descending 3-5 steps with no handrail." Although DIF of higher magnitude was observed for several items, the scale-level effect was relatively small and the exposure rate for the most problematic items was low (0.35, 0.27, and 0.20). CONCLUSIONS: This was the first study to evaluate measurement equivalence of the hospital-based rehabilitation mobility item bank. Although 20 items evidenced high magnitude DIF, 5 of which were related to stairs, the scale-level effect was minimal; however, it is recommended that such items be avoided in the development of short-form measures. No items with salient DIF were removed from calibrations, supporting the use of the item bank across groups differing in education, age, and sex. The bank may thus be useful to assist clinical assessment and decision-making regarding risk for specific mobility restrictions at discharge as well as identifying mobility-related functions targeted for postdischarge interventions. Additionally, with the goal of avoiding long and burdensome assessments for patients and clinical staff, these results could be informative for those using the item bank to construct short forms.

Improving the Delivery of Function-Directed Care During Acute Hospitalizations: Methods to Develop and Validate the Functional Assessment in Acute Care Multidimensional Computerized Adaptive Test (FAMCAT).

OBJECTIVE: To (1) develop a patient-reported, multidomain functional assessment tool focused on medically ill patients in acute care settings; (2) characterize the measure's psychometric performance; and (3) establish clinically actionable score strata that link to easily implemented mobility preservation plans. DESIGN: This article describes the approach that our team pursued to develop and characterize this tool, the Functional Assessment in Acute Care Multidimensional Computer Adaptive Test (FAMCAT). Development involved a multistep process that included (1) expanding and refining existing item banks to optimize their salience for hospitalized patients; (2) administering candidate items to a calibration cohort; (3) estimating multidimensional item response theory models; (4) calibrating the item banks; (5) evaluating potential multidimensional computerized adaptive testing (MCAT) enhancements; (6) parameterizing the MCAT; (7) administering it to patients in a validation cohort; and (8) estimating its predictive and psychometric characteristics. SETTING: A large (2000-bed) Midwestern Medical Center. PARTICIPANTS: The overall sample included 4495 adults (2341 in a calibration cohort, 2154 in a validation cohort) who were admitted either to medical services with at least 1 chronic condition or to surgical/medical services if they required readmission after a hospitalization for surgery (N=4495). INTERVENTION: Not applicable. MAIN OUTCOME MEASURES: Not applicable. RESULTS: The FAMCAT is an instrument designed to permit the efficient, precise, low-burden, multidomain functional assessment of hospitalized patients. We tried to optimize the FAMCAT's efficiency and precision, as well as its ability to perform multiple assessments during a hospital stay, by applying cutting edge methods such as the adaptive measure of change (AMC), differential item functioning computerized adaptive testing, and integration of collateral test-taking information, particularly item response times. Evaluation of these candidate methods suggested that all may enhance MCAT performance, but none were integrated into initial MCAT parameterization. CONCLUSIONS: The FAMCAT has the potential to address a longstanding need for structured, frequent, and accurate functional assessment among patients hospitalized with medical diagnoses and complications of surgery.

Evaluation of measurement equivalence of the Family Satisfaction with the End-of-Life Care (FAMCARE): Tests of differential item functioning between Hispanic and non-Hispanic White caregivers.

OBJECTIVE: Although the psychometric properties of the Family Satisfaction with End-of-Life Care measure have been examined in diverse settings internationally; little evidence exists regarding measurement equivalence in Hispanic caregivers. The aim was to examine the psychometric properties of a short-form of the FAMCARE in Hispanics using latent variable models and place information on differential item functioning (DIF) in an existing family satisfaction item bank. METHOD: The graded form of the item response theory model was used for the analyses of DIF; sensitivity analyses were performed using a latent variable logistic regression approach. Exploratory and confirmatory factor analyses to examine dimensionality were performed within each subgroup studied. The sample included 1,834 respondents: 317 Hispanic and 1,517 non-Hispanic White caregivers of patients with Alzheimer's disease and cancer, respectively. RESULTS: There was strong support for essential unidimensionality for both Hispanic and non-Hispanic White subgroups. Modest DIF of low magnitude and impact was observed; flagged items related to information sharing. Only 1 item was flagged with significant DIF by both a primary and sensitivity method after correction for multiple comparisons: "The way the family is included in treatment and care decisions." This item was more discriminating for the non-Hispanic, White responders than for the Hispanic subsample, and was also a more severe indicator at some levels of the trait; the Hispanic respondents located at higher satisfaction levels were more likely than White non-Hispanic respondents to report satisfaction. SIGNIFICANCE OF RESULTS: The magnitude of DIF was below the salience threshold for all items. Evidence supported the measurement equivalence and use for cross-cultural comparisons of the short-form FAMCARE among Hispanic caregivers, including those interviewed in Spanish.

Assessment of financial decision making: an informant scale.

Older adults with cognitive impairment are a population at great risk for financial exploitation. At-risk older adults often have difficulty reporting on their own financial abilities. Collecting information from trusted others is vital for professionals investigating the financial exploitation older adults. There are few reliable, valid, and standardized informant-report measures of financial capacity, and none that assess decisional abilities for an ongoing, real-world financial transaction. The present study sought to examine the psychometric properties of a new informant-report scale of financial decisional abilities in older adults. One hundred fifty participants were recruited to complete the Family and Friends and Interview regarding a known older adult's financial decisional abilities. A factor analysis identified two subscales. The full scale had adequate sensitivity and specificity to detect an informant's current concerns regarding financial exploitation. The Family and Friends Scale is a useful tool for collecting informant-report regarding an older adult's ability to make financial transactions.

Conceptual and Empirical Approaches to Financial Decision-making by Older Adults: Results from a Financial Decision-making Rating Scale.

OBJECTIVES: The objectives of this study were threefold: (1) to empirically test the conceptual model proposed by the Lichtenberg Financial Decision-making Rating Scale (LFDRS); (2) to examine the psychometric properties of the LFDRS contextual factors in financial decision-making by investigating both the reliability and convergent validity of the subscales and total scale, and (3) extending previous work on the scale through the collection of normative data on financial decision-making. METHODS: A convenience sample of 200 independent function and community dwelling older adults underwent cognitive and financial management testing and were interviewed using the LFDRS. Confirmatory factor analysis, internal consistency measures, and hierarchical regression were used in a sample of 200 community-dwelling older adults, all of whom were making or had recently made a significant financial decision. RESULTS: Results confirmed the scale's reliability and supported the conceptual model. Convergent validity analyses indicate that as hypothesized, cognition is a significant predictor of risk scores. Financial management scores, however, were not predictive of decision-making risk scores. CONCLUSIONS: The psychometric properties of the LFDRS support the scale's use as it was proposed. CLINICAL IMPLICATIONS: The LFDRS instructions and scale are provided for clinicians to use in financial capacity assessments.

Reliability and Validity of the Lichtenberg Financial Decision Screening Scale.

The scarcity of empirically validated assessment instruments continues to impede the work of professionals in a number of fields, including medicine, finance, and estate planning; adult protective services; and criminal justice-and, more importantly, it impedes their ability to effectively assist and, in some case, protect their clients. Other professionals (e.g. legal, financial, medical, mental health services) are in a position to prevent financial exploitation and would benefit from access to new instruments. The Lichtenberg Financial Decision Screening Scale (LFDSS) was introduced in 2016, along with evidence for its convergent validity (Lichtenberg et al., 2016). Using a sample of 213 participants, this study investigated the internal consistency of the LFDSS and its criterion validity based on ratings by professionals using the scale. Results demonstrate that the LFDSS has excellent internal consistency and clinical utility properties. This paper provides support for use of the LFDSS as a reliable and valid instrument. The LFDSS and instructions for its use are included in the article, along with information about online tools and support.

Item response theory analysis of the Lichtenberg Financial Decision Screening Scale.

The focus of these analyses was to examine the psychometric properties of the Lichtenberg Financial Decision Screening Scale (LFDSS). The purpose of the screen was to evaluate the decisional abilities and vulnerability to exploitation of older adults. Adults aged 60 and over were interviewed by social, legal, financial, or health services professionals who underwent in-person training on the administration and scoring of the scale. Professionals provided a rating of the decision-making abilities of the older adult. The analytic sample included 213 individuals with an average age of 76.9 (SD = 10.1). The majority (57%) were female. Data were analyzed using item response theory (IRT) methodology. The results supported the unidimensionality of the item set. Several IRT models were tested. Ten ordinal and binary items evidenced a slightly higher reliability estimate (0.85) than other versions and better coverage in terms of the range of reliable measurement across the continuum of financial incapacity.

Methodological issues in measuring subjective well-being and quality-of-life: Applications to assessment of affect in older, chronically and cognitively impaired, ethnically diverse groups using the Feeling Tone Questionnaire.

Quality of life assessment includes measurement of positive affect. Methods artifacts associated with positively and negatively worded items can manifest as negative items loading on a second factor, despite the conceptual view that the items are measuring one underlying latent construct. Negatively worded items may elicit biased responses. Additionally, item-level response bias across ethnically diverse groups may compromise group comparisons. The aim was to illustrate methodological approaches to examining method factors and measurement equivalence in an affect measure with 9 positively and 7 negatively worded items: The Feeling Tone Questionnaire (FTQ). The sample included 4,960 non-Hispanic White, 1,144 non-Hispanic Black, and 517 Hispanic community and institutional residents receiving long-term supportive services. The mean age was 82 (s.d.=11.0); 73% were female. Two thirds were cognitively impaired. Methods effects were assessed using confirmatory factor analyses (CFA), and reliability with McDonald's omega and item response theory (IRT) generated estimates. Measurement equivalence was examined using IRT-based Wald tests. Methods effects associated with negatively worded items were observed; these provided little IRT information, and as a composite evidenced lower reliability. Both 13 and 9 item positive affect scales performed well in terms of model fit, reliability, IRT information, and evidenced little differential item functioning of high magnitude or impact. Both CFA and IRT approaches provided complementary methodological information about scale performance. The 9-item affect scale based on the FTQ can be recommended as a brief quality-of-life measure among frail and cognitively impaired individuals in palliative and long-term care settings.

A comparison of item response theory-based methods for examining differential item functioning in object naming test by language of assessment among older Latinos.

Object naming tests are commonly included in neuropsychological test batteries. Differential item functioning (DIF) in these tests due to cultural and language differences may compromise the validity of cognitive measures in diverse populations. We evaluated 26 object naming items for DIF due to Spanish and English language translations among Latinos (n=1,159), mean age of 70.5 years old (Standard Deviation (SD)±7.2), using the following four item response theory-based approaches: Mplus/Multiple Indicator, Multiple Causes (Mplus/MIMIC; Muthén & Muthén, 1998-2011), Item Response Theory Likelihood Ratio Differential Item Functioning (IRTLRDIF/MULTILOG; Thissen, 1991, 2001), difwithpar/Parscale (Crane, Gibbons, Jolley, & van Belle, 2006; Muraki & Bock, 2003), and Differential Functioning of Items and Tests/MULTILOG (DFIT/MULTILOG; Flowers, Oshima, & Raju, 1999; Thissen, 1991). Overall, there was moderate to near perfect agreement across methods. Fourteen items were found to exhibit DIF and 5 items observed consistently across all methods, which were more likely to be answered correctly by individuals tested in Spanish after controlling for overall ability.

A program to reduce the disparity in the rate of biennial lipid profiles between African-American and white Medicare beneficiaries with diabetes mellitus in New York City.

The burden of diabetes is more severe for minority populations than for the white population in the United States. Analysis of Medicare fee-for-service claims data revealed a significant disparity regarding screening for lipids between white and African-American Medicare beneficiaries with diabetes as measured by the biennial lipid profile indicator in New York State and the disparity was even greater in New York City. Thus IPRO, the Medicare New York State Quality Improvement Organization, launched a multifaceted quality improvement project to reduce the disparity, targeting African-American Medicare beneficiaries with diabetes in New York City and the providers who serve them. There was an absolute increase of 16.7% in the proportion of African-American beneficiaries with diabetes receiving a biennial lipid profile in the intervention areas and the disparity reduced by 9.8% between African-American and all eligible white beneficiaries in the intervention areas. Although it was not feasible to determine the direct impact of selected interventions on reducing the disparity, the interventions collectively appeared to be effective.

The relationship between organizational systems and clinical quality in diabetes care.

OBJECTIVE: To assess the clinical quality of diabetes care and the systems of care in place in Medicare managed care organizations (MCOs) to determine which systems are associated with the quality of care. STUDY DESIGN: Cross-sectional, observational study that included a retrospective review of 2001 diabetes Health Plan Employer and Data Information Set (HEDIS) measures and a mailed survey to MCOs. METHODS: One hundred and thirty-four plans received systems surveys. Data on clinical quality were obtained from HEDIS reports of diabetes measures. RESULTS: Ninety plans returned the survey. Composite diabetes quality scores (CDSs) were based on averaging scores for the 6 HEDIS diabetes measures. For the upper quartile of responding plans, the average score was 77.6. The average score for the bottom quartile was 53.9 (P < .001). The mean number of systems or interventions for the upper-quartile group and the bottom-quartile group was 17.5 and 12.5 (P < .01), respectively. There were significant differences in the 2 groups in the following areas: computer-generated reminders, physician champions, practitioner quality-improvement work groups, clinical guidelines, academic detailing, self-management education, availability of laboratory results, and registry use. After adjusting for structural and geographic variables, practitioner input and use of clinical-guidelines software remained as independent predictors of CDS. Structural variables that were independent predictors were nonprofit status and increasing number of Medicare beneficiaries in the MCO. CONCLUSIONS: MCO structure and greater use of systems/interventions are associated with higher-quality diabetes care. These relationships require further exploration.