Comparison of in-person vs. remote administration of cognitive screening tools for people with ALS.

OBJECTIVE: This study investigated whether cognitive screening tools used for people with amyotrophic lateral sclerosis (pwALS) are affected by the screen being administered face-to-face or remotely online. It also investigated whether demographic variables predicted total cognitive screen scores. METHODS: The cognitive component of the Edinburgh Cognitive and Behavioural ALS Screen (ECASc), the cognitive component of the ALS Cognitive Behavioural Screen (ALS-CBSc), and the Mini Addenbrooke's Cognitive Examination (Mini-ACE) were administered to 41 pwALS and 41 controls face-to-face. Versions of the cognitive screens designed to be administered remotely were administered to 57 pwALS and 44 controls via videoconferencing methods. Backwards stepwise linear regressions were conducted to assess whether total scores on the ECASc, ALS-CBSc, and Mini-ACE scores were predicted by administration mode (face-to-face or remote) or demographic variables. RESULTS: Mode of administration significantly affected scores on the ECASc and ALS-CBSc; remote administration was associated with better total scores. Administration mode did not significantly affect Mini-ACE scores. All cognitive screens were significantly affected by IQ scores; higher IQ scores predicted better screening tool scores. Only ECASc scores were significantly affected by age, with older age predicting poorer scores. Being female was associated with better Mini-ACE scores; sex did not predict ECASc and ALS-CBSc scores. CONCLUSIONS: Our results suggest that videoconferencing versions of the ECASc and ALS-CBSc may function differently to the original, face-to-face versions. There are advantages to using remote versions of cognitive screening tools but clinicians and researchers who use them should consider that they may not yield equivalent scores.

Beyond sound irritation: cross-cultural evidence on the robustness of the five aspects of misophonic experience measured by the S-Five in a Polish sample.

Misophonia is commonly associated with negative emotional or physiological responses to specific sounds. However, the consensus definition emphasizes that misophonia entails much more than that. Even in cases of subclinical misophonia, where individuals do not meet the disorder criteria, the experience can still be burdensome, despite not currently causing significant distress or impairment. The S-Five is a psychometric tool for comprehensive assessment of five aspects of misophonic experience: internalizing, externalizing, impact, threat, and outburst, and includes S-Five-T section to evaluate feelings evoked by triggering sounds and their intensity. We examined whether the five-factor structure developed in the UK could be replicated in a Polish sample, including individuals with and without self-identified misophonia. The Polish version of the S-Five was translated and tested on 288 Polish-speaking individuals. Comprehensive psychometric evaluation, including factor structure, measurement invariance, test-retest reliability, internal consistency, and concurrent validity evaluations, was conducted on the translated scale. Exploratory factor analysis suggested similar structure to the original English study, while bootstrap exploratory graph analysis showed the factor structure to be reproducible in other samples. The scale was found to be bias free with respect to gender, internally consistent and stable in time, and evidence of validity was provided using MisoQuest and Misophonia Questionnaire. These results offer support for the cross-cultural stability of the five factors and provide preliminary evidence for the suitability of the Polish version for clinical and research purposes. The study also investigated five facets of misophonia, triggering sounds, emotional responses, and their associations with symptoms of psychopathology across various cultures. It underscores the central role of anger, distress, and panic, while also highlighting the mixed role of irritation and disgust in misophonia across different cultural contexts. Mouth sounds evoked the most pronounced reactions compared to other repetitive sounds, although there were discernible cultural differences in the nature and intensity of reactions to various trigger sounds. These findings hold significant implications for future research and underscore the importance of considering cultural nuances in both research and the clinical management of misophonia.

Identifying vulnerable mother-infant dyads: a psychometric evaluation of two observational coding systems using varying interaction periods.

Introduction: Clinical services require feasible assessments of parent-infant interaction in order to identify dyads requiring parenting intervention. We assessed the reliability and predictive validity of two observational tools and tested whether briefer forms could be identified which retain acceptable psychometric properties over short observation periods. Methods: A stratified high-risk community sample of 250 mother-infant dyads from The Wirral Child Health and Development Study completed 7-min play-based interaction at 6-8 months. Film-footage was independently coded by two trained raters using PIIOS and NICHD-SECCYD systems. Incremental predictive validity was assessed from 3, 5 and 7 min observation to attachment outcomes (Strange Situation; 14 months) and infant mental health (BITSEA; 14 and 30 months). Results: Excellent inter-rater reliability was evident at code and subscale level for each tool and observation period. Stability of within-rater agreement was optimal after 5 min observation. ROC analysis confirmed predictive (discriminant) validity (AUCs >0.70) to top decile age 2 mental health outcomes for PIIOS total score and a brief 3-item composite from NICHD-SECCYD (sensitivity, intrusiveness, positive regard; NICHD-3), but not to attachment outcomes. Logistic regression showed dyads rated at-risk for externalizing problems using NICHD-3 were also at significantly higher risk for insecurity at 14 months (OR = 2.7, p = 0.004). Conclusion: PIIOS total and NICHD-3 ratings from 5 min observation are both reliable and valid tools for use in clinical practice. Findings suggest NICHD-3 may have greater utility due to its comparative brevity to train and code, with suitability for use over a broader developmental time frame (3-24 months).

Protocol for a systematic review evaluating psychometric properties and gender-related measurement (non)invariance of self-report assessment tools for autism in adults.

BACKGROUND: Given the recent evidence on gender differences in the presentation of autism, there is an increasing concern that current tools for autism do not adequately capture traits more often found in women. If tools for autism measure autistic traits differently based on gender alone, their validity may be compromised as they may not be measuring the same construct across genders. Measurement invariance investigations of autism measures can help assess the validity of autism constructs for different genders. The aim of this systematic review is to identify and critically appraise the psychometric properties of all self-report tools for autism in adults that meet two criteria: (a) they have been published since or included in the NICE (2014) recommendations, and (b) they have undergone gender-related measurement invariance investigations as part of their validation process. METHODS: A search of electronic databases will be conducted from 2014 until the present using MEDLINE, Embase, and PsycINFO using predefined search terms to identify eligible studies. The search for grey literature will include sources such as OpenGrey, APA PsycEXTRA, and Scopus. Two reviewers will independently screen titles, abstracts, and full texts for eligibility. The references of included studies will be searched for additional records. The methodological quality of the studies will be evaluated using the COSMIN Risk of Bias checklist, while psychometric quality of findings will be assessed based on criteria for good measurement properties and ConPsy checklist. The quality of the total body of evidence will be appraised using the approach outlined in the modified GRADE guidelines. DISCUSSION: This systematic review will be among the first to assess the psychometric properties and gender-related measurement invariance of self-reported measures for autism in adults that were published since (or included in) NICE (2014) guidelines. The review will provide recommendations for the most suitable tool to assess for autism without gender bias. If no such measure is found, it will identify existing tools with promising psychometric properties that require further testing, or suggest developing a new measure. SYSTEMATIC REVIEW REGISTRATION: The protocol has been registered at the International Prospective Register of Systematic Reviews (PROSPERO). The registration number is CRD42023429350.

The Knowledge of Autism Questionnaire-UK: Development and Initial Psychometric Evaluation.

Tools to measure autism knowledge are needed to assess levels of understanding within particular groups of people and to evaluate whether awareness-raising campaigns or interventions lead to improvements in understanding. Several such measures are in circulation, but, to our knowledge, there are no psychometrically-validated questionnaires that assess contemporary autism knowledge suitable to the UK context. We aimed to produce a brief measure to assess between-respondent variability and within-respondent change over time. A pool of questionnaire items was developed and refined through a multi-stage iterative process involving autism experts and a lay sample. Attention was paid to face validity, clarity, consensus on correct responses, and appropriate difficulty levels. Initial validation data was obtained from a lay sample of 201 people. Difficulty and discrimination ability were assessed using item response theory and low-performing items were removed. Dimensionality was evaluated with exploratory factor analysis, which revealed a one-factor structure of the questionnaire. Further items were removed where they did not load strongly on their main factor. This process resulted in a final 14-item questionnaire called the Knowledge of Autism Questionnaire-UK. Internal consistency was satisfactory, and the final questionnaire was able to distinguish between parents of autistic people and those without an affiliation to autism. The KAQ-UK is a new, freely-available measure of autism knowledge that could be used to assess between-respondent variability and within-respondent change over time. Further evaluation and validation of its measurement properties are required.

Psychometric Evaluation and Misophonic Experience in a Portuguese-Speaking Sample.

Misophonia, a disorder characterised by an extreme sensitivity to certain sounds, is increasingly being studied in cross-cultural settings. The S-Five scale is a multidimensional psychometric tool initially developed to measure the severity of misophonia in English-speaking populations. The scale has been validated in several languages, and the present study aimed to validate the European Portuguese S-Five scale in a Portuguese-speaking sample. The scale was translated into Portuguese using a forward-backwards translation method. The psychometric properties of the S-Five scale were evaluated in a sample of 491 Portuguese-speaking adults. Confirmatory factor analysis supported a five-factor structure consistent with previous versions of the S-Five scale. The five factors were as follows: (1) internalising appraisals, (2) externalising appraisals, (3) perceived threat and avoidance behaviour, (4) outbursts, and (5) impact on functioning. The satisfactory psychometric properties of the S-Five scale further indicated its cross-cultural stability. As a psychometrically robust tool, the S-Five can measure misophonia in Portuguese-speaking populations, allowing future studies to explore and compare misophonia in this population.

What is the extent of reliability and validity evidence for screening tools for cognitive and behavioral change in people with ALS? A systematic review.

OBJECTIVE: This systematic review provides an updated summary of the existing literature on the validity of screening tools for cognitive and behavioral impairment in people with Amyotrophic Lateral Sclerosis (pwALS), and also focuses on their reliability. METHOD: The following cognitive and behavioral screening tools were assessed in this review: the Edinburgh Cognitive and Behavioral ALS Screen (ECAS); the ALS Cognitive Behavioral Screen (ALS-CBS), the Mini Addenbrooke's Cognitive Examination (Mini-ACE), the Beaumont Behavioral Interview (BBI); the MND Behavior Scale (MiND-B); and the ALS-FTD Questionnaire (ALS-FTD-Q). A search, using Medline, PsychINFO and Embase (21/09/2023), generated 37 results after exclusion criteria were applied. Evidence of internal consistency, item-total correlations, inter-rater reliability, clinical validity, convergent validity, and structural validity were extracted and assessed and risk of bias was evaluated. RESULTS: The cognitive component of the ECAS was the tool with most evidence of reliability and validity for the assessment of cognitive impairment in ALS. It is well-suited to accommodate physical symptoms of ALS. For behavioral assessment, the BBI or ALS-FTD-Q had the most evidence of reliability and validity. The BBI is more thorough, but the ALS-FTD-Q is briefer. CONCLUSIONS: There is good but limited evidence for the reliability and validity of cognitive and behavioral screens. Further evidence of clinical and convergent validity would increase confidence in their clinical and research use.

Measurement invariance of Attention Deficit/Hyperactivity Disorder symptom criteria as rated by parents and teachers in children and adolescents: A systematic review.

This systematic review aimed to establish the extent to which each Attention Deficit/Hyperactivity Disorder (ADHD) symptom criterion is being assessed without being influenced (biased) by factors such as informant, sex/gender, and age. Measurement invariance (MI) testing using confirmatory factor analysis (CFA) is the prime statistical method to ascertain how these factors may affect the measurement and colour the perception or interpretation of symptom criteria. Such effects (non-invariance) can be operationalised in the form of altered association of a symptom criterion with the measured trait (expressed via variations in CFA loadings which represent the weight of each symptom criterion) due to the factor(s) and/or artificially alter the probability of endorsement of a particular symptom criterion (expressed via variations in the CFA threshold(s) representing how mild or severe a given symptom is). Based on a pre-registered protocol (CRD42022276105), we searched PubMed, Global Health, Embase and PsycInfo up to 21-02-23 for studies that included MI assessments on specific ADHD symptom criteria in individuals aged 0-18 years old, using parental and/or teacher report. Self-reports were excluded, given the poor reliability of self-report in ADHD. All included studies met specific COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) criteria. Results were synthesised in tabular form, grouping results by factors (e.g. informant) from 44 studies retained. Most comparisons indicated both metric (same loadings) and scalar invariance (same thresholds) with regard to informant, gender, age, temporal (repeated assessments) and co-morbidity. Therefore, the available evidence supports the current diagnostic criteria. However, findings could have been improved by systematic reporting of the direction of bias and its effect size. There appears to be a bias towards reporting MI instead of non-invariance. More studies in the literature are needed where the amalgamation of information provided by different informs and the association of specific symptoms with comorbidity are analysed.

Translation and validation of the Body Esteem Scale in Adults and Adolescents among Indonesian adolescents.

There is a need for a psychometrically robust body image measure to advance body image scholarship among Indonesian adolescents. This study aimed to validate a Bahasa Indonesia version of the Body Esteem Scale for Adults and Adolescents (BESAA). The measure was forward and back translated from English into Bahasa Indonesia (i.e., primary Indonesian language) and was assessed for comprehension and cultural appropriateness using cognitive interviews and expert reviews. The factor structure, reliability, and validity of the measure was tested with adolescents aged 11-17 years from two districts in Indonesia (N = 650; 51.5 % girls). Exploratory factor analysis identified a suitable 17-item three-factor solution for the BESAA, with Appearance Positive, Appearance Negative, and Weight subscales. This model was confirmed via confirmatory factor analysis and found to be largely invariant across gender and age. Test re-test reliability and internal consistency of the subscales were acceptable. The Bahasa Indonesia version of the BESAA is a psychometrically robust measure suitable for use among Indonesian adolescents. Reasons as to why the factor structure of the BESAA differentiates across cultural contexts are discussed.

Confirmatory factor analysis of the Hyperacusis Impact Questionnaire, Sound Sensitivity Symptoms Questionnaire, and Screening for Anxiety and Depression in Tinnitus, including preliminary analyses of the parent versions for use with children.

BACKGROUND: We previously reported the results of exploratory factor analysis (EFA) of the Hyperacusis Impact Questionnaire (HIQ), the Sound Sensitivity Symptoms Questionnaire (SSSD) and the Screening for Anxiety and Depression in Tinnitus (SAD-T). Confirmatory Factor Analysis (CFA) is necessary to confirm the latent constructs determined using EFA. CFA should use different samples but with similar characteristics to those used for EFA. PURPOSE: The aim was to use CFA to confirm latent constructs derived using EFA of the HIQ, SSSQ and SAD-T. We further evaluated the psychometric properties of parent versions of these questionnaires (indicated by -P), which are intended for use with children. RESEARCH DESIGN: This was a retrospective cross-sectional study. STUDY SAMPLE: Data for 323 consecutive adults and 49 children who attended a Tinnitus and Hyperacusis Therapy Clinic in the UK within a six-month period were included. DATA COLLECTION AND ANALYSIS: Data were collected retrospectively from the records of patients held at the audiology department. CFA with the weighted least-squares mean and variance-adjusted estimator was applied to assess the previously proposed factor structures of the HIQ, SSSQ and SAD-T. The internal consistency of the scales was assessed via Cronbach's alpha (α). The items of the HIQ, SSSQ and SAD-T were tested for measurement invariance regarding age and gender using the multiple indicator multiple cause (MIMIC) model. RESULTS: All questionnaires showed good to excellent internal consistency, with α = 0.93 for the HIQ, 0.87 for the SSSQ, and 0.91 for the SAD-T. The parent versions showed acceptable to good internal consistency, with α = 0.88 for the HIQ-P, 0.71 for the SSSQ-P, and 0.86 for the SAD-T-P. CFA showed that the HIQ, SSSQ, and SAD-T were all one-factor questionnaires and the factors generally were similar to those obtained for the EFA. The MIMIC model showed that all three questionnaires can be considered as measurement invariant, with scores similar across genders and ages. CONCLUSIONS: The HIQ, SSSQ and SAD-T are internally consistent one-factor questionnaires that can be used in clinical and research settings to assess the impact of hyperacusis, the severity of sound sensitivity symptoms, and to screen for anxiety and depression symptoms. Future studies should further explore the psychometric properties of the parent versions of the HIQ and SSSQ and SAD-T.

Adaptation and validation of the Body Image Life Disengagement Questionnaire (BILD-Q) for use in english among adolescents in urban India.

Body image concerns are a global issue among adolescents, including in India. These concerns can prevent adolescents from engaging in everyday life activities, impeding social and academic development. However, at present, there are no psychometrically valid measures to assess such impact in the Indian context. This study culturally adapted and validated the Body Image Life Disengagement Questionnaire (BILD-Q) for use in English among adolescents in urban India. A total of 1427 adolescents completed an adapted version of the BILD-Q along with additional measures pertaining to body image. Exploratory factor analysis identified one dimension of body image life disengagement, which provided the best fit. The 9-item one-factor model was further supported by confirmatory factor analysis. The scale demonstrated good internal consistency and test re-test reliability. Further analysis demonstrated that the scale can be used to compare scores between boys and girls without measurement bias. This study presents a culturally adapted version of the BILD-Q, which can be used as a valid and reliable measure to assess the impact of body image concerns on life disengagement among English-speaking adolescents in urban India.