Using Constrained Factor Mixture Analysis to Validate Mixed-Worded Psychological Scales: The Case of the Rosenberg Self-Esteem Scale in the Dominican Republic.

A common method to collect information in the behavioral and health sciences is the self-report. However, the validity of self-reports is frequently threatened by response biases, particularly those associated with inconsistent responses to positively and negatively worded items of the same dimension, known as wording effects. Modeling strategies based on confirmatory factor analysis have traditionally been used to account for this response bias, but they have recently become under scrutiny due to their incorrect assumption of population homogeneity, inability to recover uncontaminated person scores or preserve structural validities, and their inherent ambiguity. Recently, two constrained factor mixture analysis (FMA) models have been proposed by Arias et al. (2020) and Steinmann et al. (2021) that can be used to identify and screen inconsistent response profiles. While these methods have shown promise, tests of their performance have been limited and they have not been directly compared. Thus the objective of the current study was to assess and compare their performance with data from the Dominican Republic of the Rosenberg Self-Esteem Scale (N = 632). Additionally, as this scale had not yet been studied for this population, another objective was to show how using constrained FMAs could help in the validation of mixed-worded scales. The results indicated that removing the inconsistent respondents identified by both FMAs (≈8%) reduced the amount of wording effects in the database. However, whereas the Steinmann et al. method only cleaned the data partially, the Arias et al. (2020) method was able to remove the great majority of the wording effects variance. Based on the screened data with the Arias et al. method, we evaluated the psychometric properties of the RSES for the Dominican population, and the results indicated that the scores had good validity and reliability properties. Given these findings, we recommend that researchers incorporate constrained FMAs into their toolbox and consider using them to screen out inconsistent respondents to mixed-worded scales.

Invariance of parent ratings of attention deficit hyperactivity disorder symptoms for children with and without intellectual disability.

BACKGROUND: Although attention deficit hyperactivity disorder (ADHD) is considered a valid diagnosis for children with intellectual disability, no studies have evaluated the invariance of ADHD symptom ratings across children with and without intellectual disability. METHOD: Parents completed ratings on the ADHD symptoms for 189 children with intellectual disability and for 474 children without intellectual disability. Differential item functioning analysis was used to determine the equivalence of the ADHD symptoms across the two groups. RESULTS: The symptoms loses things, talks too much, and blurts out answers showed significant bias against children with intellectual disability. The prevalence of ADHD in children with intellectual disability was 18% (according to the symptom criterion), and 7.4% when the academic and/or social impairment criterion was also considered. CONCLUSIONS: Most of the ADHD symptoms can be valid for the assessment of ADHD in children with mild and moderate intellectual disability. ADHD symptoms may be used in further studies to establish base rates of the disorder in the intellectual disability population.

Does Quality of Life Differ for Children With Autism Spectrum Disorder and Intellectual Disability Compared to Peers Without Autism?

The main goal was to test if children with intellectual disability (ID) and autism spectrum disorder (ASD) show lower quality of life (QOL) in comparison to those with only ID. The KidsLife Scale was applied to 1060 children with ID, 25% of whom also had ASD, aged 4-21 years old. Those with ASD showed lower scores in several QOL domains but, when the effect of other variables was controlled, lower scores were only kept for interpersonal relationships, social inclusion, and physical wellbeing. Slightly higher scores were found for material wellbeing. ASD, Level of ID and support needs were the covariables with the greatest influence in most domains, while gender was only significant for social inclusion (girls scored lower than boys).

Bifactor Models of Attention-Deficit/Hyperactivity Disorder (ADHD): An Evaluation of Three Necessary but Underused Psychometric Indexes.

BACKGROUND: In the past decade, the bifactor model of attention-deficit/hyperactivity disorder (ADHD) has been extensively researched. This model consists of an ADHD general dimension and two specific factors: inattention and hyperactivity/impulsivity. All studies conclude that the bifactor is superior to the traditional two-correlated factors model, according to the fit obtained by factor analysis. However, the proper interpretation of a bifactor not only depends on the fit but also on the quality of the measurement model. OBJECTIVE: To evaluate the model-based reliability, distribution of common variance and construct replicability of general and specific ADHD factors. METHOD: We estimated expected common variance, omega hierarchical/subscale and H-index from standardized factor loadings of 31 ADHD bifactor models previously published. RESULTS AND CONCLUSION: The ADHD general factor explained most of the common variance. Given the low reliable variance ratios, the specific factors were difficult to interpret. However, in clinical samples, inattention acquired sufficient specificity and stability for interpretation beyond the general factor. Implications for research and clinical practice are discussed.

Hierarchy and Psychometric Properties of ADHD Symptoms in Spanish Children: An Application of the Graded Response Model.

The Diagnostic and Statistical Manual of Mental Disorders (DSM) diagnostic criteria assume that the 18 symptoms carry the same weight in an Attention Deficit with Hyperactivity Disorder (ADHD) diagnosis and bear the same discriminatory capacity. However, it is reasonable to think that symptoms may differ in terms of severity and even in the reliability with they represent the disorder. To test this hypothesis, the aim of this study was to calibrate in a sample of Spanish children (age 4-7; n = 784) a scale for assessing the symptoms of ADHD proposed by Diagnostic and Statistical Manual of Mental Disorders, IV-TR within the framework of Item Response Theory. Samejima's Graded Response Model was used as a method for estimating the item difficulty and discrimination parameters. The results showed that ADHD subscales (Attention Deficit and Hyperactivity / Impulsivity) had good psychometric properties and had also a good fit to the model. However, relevant differences between symptoms were observed at the level of severity, informativeness and reliability for the assessment of ADHD. This finding suggests that it would be useful to identify the symptoms that are more important than the others with regard to diagnosing ADHD.