Operationalization and measurement of compulsivity across video gaming and gambling behavioral domains.

BACKGROUND: Compulsivity is the hallmark of addiction progression and, as a construct, has played an important role in unveiling the etiological pathways from learning mechanisms underlying addictive behavior to harms resulting from it. However, a sound use of the compulsivity construct in the field of behavioral addictions has been hindered to date by the lack of consensus regarding its definition and measurement. Here we capitalize on a previous systematic review and expert appraisal to develop a compulsivity scale for candidate behavioral addictions (the Granada Assessment for Cross-domain Compulsivity, GRACC). METHODS: The initial scale (GRACC90) consisted of 90 items comprising previously proposed operationalizations of compulsivity, and was validated in two panel samples of individuals regularly engaging in gambling and video gaming, using exploratory structural equation modeling (ESEM) and convergence analyses. RESULTS: The GRACC90 scale is unidimensional and structurally invariant across samples, and predicted severity of symptoms, lower quality of life, and negative affect, to similar degrees in the two samples. Additionally, poorer quality of life and negative affect were comparably predicted by compulsivity and by severity of symptoms. A shorter version of the scale (GRACC18) is proposed, based on selecting the 18 items with highest factor loadings. CONCLUSIONS: Results support the proposal that core symptoms of behavioral addictions strongly overlap with compulsivity, and peripheral symptoms are not essential for their conceptualization. Further research should clarify the etiology of compulsive behavior, and whether pathways to compulsivity in behavioral addictions could be common or different across domains.

Adapting cognitive diagnosis computerized adaptive testing item selection rules to traditional item response theory.

Currently, there are two predominant approaches in adaptive testing. One, referred to as cognitive diagnosis computerized adaptive testing (CD-CAT), is based on cognitive diagnosis models, and the other, the traditional CAT, is based on item response theory. The present study evaluates the performance of two item selection rules (ISRs) originally developed in the CD-CAT framework, the double Kullback-Leibler information (DKL) and the generalized deterministic inputs, noisy "and" gate model discrimination index (GDI), in the context of traditional CAT. The accuracy and test security associated with these two ISRs are compared to those of the point Fisher information and weighted KL using a simulation study. The impact of the trait level estimation method is also investigated. The results show that the new ISRs, particularly DKL, could be used to improve the accuracy of CAT. Better accuracy for DKL is achieved at the expense of higher item overlap rate. Differences among the item selection rules become smaller as the test gets longer. The two CD-CAT ISRs select different types of items: items with the highest possible a parameter with DKL, and items with the lowest possible c parameter with GDI. Regarding the trait level estimator, expected a posteriori method is generally better in the first stages of the CAT, and converges with the maximum likelihood method when a medium to large number of items are involved. The use of DKL can be recommended in low-stakes settings where test security is less of a concern.

Assessing job performance using brief self-report scales: the case of the individual work performance questionnaire / La evaluación del desempeño en el trabajo con escalas de autoinforme breves: el cuestionario de desempeño laboral individual

Job performance is considered the "ultimate dependent variable" in human resource management, turning its assessment into a capital issue. The present study analyzes the functioning of a brief 18-item self-report scale, the Individual Work Performance Questionnaire (IWPQ), which measures the main dimensions of job performance (task performance, contextual performance, and counterproductive behaviors) in a wide variety of jobs. Participants were 368 employees who voluntarily answered a questionnaire including the IWPQ, other performance scales, and the NEO-FFI. Descriptive statistics, exploratory structural equation modeling, and correlations were performed. Results show that the IWPQ has a tridimensional structure with adequate reliability, exhibits significant associations with other measures of performance, and its association with personality traits is similar in terms of direction and strength of the correlations between other job performance measures and personality. We conclude that the IWPQ is an adequate measure of job performance but with emphasis on behaviors aimed toward organizations

El desempeño laboral es considerado la "variable dependiente definitiva" en recursos humanos, convirtiendo su evaluación en algo crucial. El presente estudio analiza el funcionamiento de una escala autoinformada breve de 18 ítems, el Individual Work Performance Questionnaire (IWPQ), que mide las principales dimensiones del desempeño laboral (desempeño de tarea, desempeño contextual y comportamientos contraproductivos en el trabajo) en una amplia variedad de trabajos. Los participantes fueron 368 empleados que voluntariamente completaron un cuestionario que incluía el IWPQ, otras escalas de desempeño y el NEO-FFI. Se llevaron a cabo estadísticos descriptivos, modelos exploratorios de ecuaciones estructurales y correlaciones. Los resultados muestran que el IWPQ tiene una estructura tridimensional con una fiabilidad adecuada, mostrando asociaciones significativas con el resto de medidas de desempeño. En cuanto a los factores de personalidad, el IWPQ muestra correlaciones similares a las de los otros instrumentos de desempeño analizados. Se concluye que el IWPQ es un instrumento adecuado para medir de manera breve y autoinformada el desempeño laboral, pero con énfasis en los comportamientos dirigidos hacia la organización

Orthorexia nervosa and healthy orthorexia as new eating styles.

It was recently proposed that healthy orthorexia (HeOr) and orthorexia nervosa (OrNe) should be differentiated. The aim of the present study was to analyze whether the two dimensions of orthorexia can be considered new eating styles or basically equivalent to restrained eating behavior. Two samples of university students (sample 1, n = 460; sample 2, n = 509) completed the Teruel Orthorexia Scale (TOS), the Dutch Eating Behavior Questionnaire (DEBQ), and the Positive and Negative Affect Schedule (PANAS). Factor analysis with the TOS and DEBQ items together revealed an adequate fit for the preexisting five-factor solution (TOS: OrNe and HeOr; DEBQ: Restrained Eating, Emotional Eating, and External Eating). This result points out that these factors are conceptually distinguishable. Moreover, we tested whether the different eating styles presented different patterns of correlations with gender, body mass index (BMI), and age, and whether OrNe and HeOr predicted Positive and Negative Affect after controlling for Restrained, Emotional, and External Eating. Whereas Restrained and Emotional Eating were higher for women and increased with BMI in both samples, HeOr and OrNe presented much lower associations with these variables. OrNe was positively related to Negative Affect and negatively to Positive Affect, whereas HeOr was positively related to Positive Affect. Again, this result supports the assumption that OrNe is a new variant of disordered eating, whereas HeOr could possibly be seen as a protective behavior.

Reconsidering the roots, structure, and implications of gambling motives: An integrative approach.

RATIONALE AND METHOD: Accurately identifying motives to gamble is crucial in the functional analysis of gambling behavior. In this study, a data-driven approach was followed to clarify the factor structure underlying a pool of motives for gambling, selected from the Gambling Motives Questionnaire-Financial (GMQ-F), and the Reasons for Gambling Questionnaire (RGQ), in a sample of regular problem and non-problem gamblers. Additionally, the role of gambling motives in the relationship between root behavioral activation/inhibition systems (BIS/BAS) and gambling severity, frequency, and preferences was explored using structural equation modelling (SEM). RESULTS AND CONCLUSIONS: The present study identified Social, Financial, and Fun/thrill-related gambling motives factors, but also a fourth factor in which some positive and negative reinforcement-based motives were grouped into a single and broader Affect regulation factor. This Affect regulation factor shared variance both with BIS and BAS-related measures, and was the only direct predictor of disordered gambling symptoms. The Fun/thrill factor was directly related to frequency of participation in high-arousal, skill-based games, and all factors were related to participation in lower-arousal, chance games (with Social motives negatively predicting both participation in the latter and total severity). In the SEM model, measures of BIS/BAS sensitivity were connected to gambling behavior only through gambling motives. Based on measures of items' specificity, a shortened Spanish scale (the brief Gambling Motives Inventory, bGMI) is proposed to assess gambling motives in accordance with the observed 4-factor structure.

The Tridimensional Structure of Sociosexuality: Spanish Validation of the Revised Sociosexual Orientation Inventory.

Casual sex has become a common experience for many university students. Therefore, it is necessary to have instruments and studies that analyze youth's orientation toward sociosexuality. The SOI-R assesses sociosexual behavior, attitudes toward sociosexuality, and the desire for relationships without commitment with just nine items. The goal of this study was to validate the Spanish version of the SOI-R, to improve the scale, and to contribute evidence of the utility of the Sociosexual Desire subscale. Participants were 839 heterosexual university students of both sexes, aged between 18 and 26, who completed a battery of online questionnaires. The internal structure of the SOI-R revealed the three proposed theoretical dimensions, with medium to low relationships between factors. The instrument has measurement invariance with regards to sex and age. The Spanish version of the SOI-R had adequate levels of reliability. The modification of the first item of the scale is suggested, as well as the relevance of assessing sociosexual desire as an independent construct. The relation between sociosexuality and other sociodemographic and psychosocial variables was also analyzed. The discussion highlights the need for research to determine youth's sociosexual orientation and patterns of casual sex.

Extracting the Evaluations of Stereotypes: Bi-factor Model of the Stereotype Content Structure.

Stereotype dimensions-competence, morality and sociability-are fundamental to studying the perception of other groups. These dimensions have shown moderate/high positive correlations with each other that do not reflect the theoretical expectations. The explanation for this (e.g., halo effect) undervalues the utility of the shared variance identified. In contrast, in this work we propose that this common variance could represent the global evaluation of the perceived group. Bi-factor models are proposed to improve the internal structure and to take advantage of the information representing the shared variance among dimensions. Bi-factor models were compared with first order models and other alternative models in three large samples (300-309 participants). The relationships among the global and specific bi-factor dimensions with a global evaluation dimension (measured through a semantic differential) were estimated. The results support the use of bi-factor models rather than first order models (and other alternative models). Bi-factor models also show a greater utility to directly and more easily explore the stereotype content including its evaluative content.

Calibrating a new item pool to adaptively assess the Big Five.

BACKGROUND: Even though the Five Factor Model (FFM) has been the dominant paradigm in personality research for the past two decades, very few studies have measured the FFM adaptively. Thus, the purpose of this research was the building of a new item pool to develop a computerized adaptive test (CAT) for personality assessment. METHOD: A pool of 480 items that measured the FFM facets was developed and applied to 826 participants. Facets were calibrated separately and item selection was performed being mindful of the preservation of unidimensionality of each facet. Then, a post-hoc simulation study was carried out to test the performance of separate CATs to measure the facets. RESULTS: The final item pool was composed of 360 items with good psychometric properties. Findings reveal that a CAT administration of four items per facet (total length of 120 items) provides accurate facets scores, while maintaining the factor structure of the FFM. CONCLUSIONS: An item pool with good psychometric properties was obtained and a CAT simulation study demonstrated that the FFM facets could be measured with precision using a third of the items in the pool.

Iteration of Partially Specified Target Matrices: Application to the Bi-Factor Case.

The current study proposes a new bi-factor rotation method, Schmid-Leiman with iterative target rotation (SLi), based on the iteration of partially specified target matrices and an initial target constructed from a Schmid-Leiman (SL) orthogonalization. SLi was expected to ameliorate some of the limitations of the previously presented SL bi-factor rotations, SL and SL with target rotation (SLt), when the factor structure either includes cross-loadings, near-zero loadings, or both. A Monte Carlo simulation was carried out to test the performance of SLi, SL, SLt, and the two analytic bi-factor rotations, bi-quartimin and bi-geomin. The results revealed that SLi accurately recovered the bi-factor structures across the majority of the conditions, and generally outperformed the other rotation methods. SLi provided the biggest improvements over SL and SLt when the bi-factor structures contained cross-loadings and pure indicators of the general factor. Additionally, SLi was superior to bi-quartimin and bi-geomin, which performed inconsistently across the types of factor structures evaluated. No method produced a good recovery of the bi-factor structures when small samples (N = 200) were combined with low factor loadings (0.30-0.50) in the specific factors. Thus, it is recommended that larger samples of at least 500 observations be obtained.

The impact of ambiguous response categories on the factor structure of the GHQ-12.

Previous research has suggested multiple factor structures for the 12-item General Health Questionnaire (GHQ-12), with contradictory evidence arising across different studies on the validity of these models. In the present research, it was hypothesized that these inconsistent findings were due to the interaction of 3 main methodological factors: ambiguous response categories in the negative items, multiple scoring schemes, and inappropriate estimation methods. Using confirmatory factor analysis with appropriate estimation methods and scores obtained from a large (n = 27,674) representative Spanish sample, we tested this hypothesis by evaluating the fit and predictive validities of 4 GHQ-12 factor models-unidimensional, Hankins' (2008a) response bias model, Andrich and Van Schoubroeck's (1989) 2-factor model, and Graetz's (1991) 3-factor model-across 3 scoring methods: standard, corrected, and Likert. In addition, the impact of method effects on the reliability of the global GHQ-12 scores was also evaluated. The combined results of this study support the view that the GHQ-12 is a unidimensional measure that contains spurious multidimensionality under certain scoring schemes (corrected and Likert) as a result of ambiguous response categories in the negative items. Therefore, it is suggested that the items be scored using the standard method and that only a global score be derived from the instrument.

Bifactor analysis and construct validity of the HADS: a cross-sectional and longitudinal study in fibromyalgia patients.

The dimensionality of the Hospital Anxiety and Depression Scale (HADS) is a current source of controversy among experts. The present study integrates a solid theoretical framework (Clark & Watson's, 1991, tripartite theory) and a fine-grained methodological approach (structural equation modeling; SEM) to examine the dimensionality and construct validity of the HADS in fibromyalgia (FM) patients. Using the HADS data of 269 Spanish patients with FM, we estimated the cross-sectional and, for the first time, longitudinal fit (autoregressive model) of 2 competing models (oblique 2-factor vs. bifactor) via confirmatory factor analysis. The pattern of relationships between the HADS latent dimensions and positive and negative affect (PA and NA) was analyzed using SEM. HADS reliability was assessed by computing the omega and omega hierarchical coefficients. The bifactor model, which accounted for the covariance among HADS items with regard to 1 general factor (psychological distress) and 2 specific factors (depression and anxiety), described the HADS structure better than the original oblique 2-factor model during both study periods. All latent dimensions of the bifactor model were temporally stable. The SEM analysis revealed a significant link between psychological distress and NA as well as between depression and low PA. Only the general factor of psychological distress showed adequate reliability. In conclusion, the HADS shows a clear bifactor structure among FM patients. Our results indicate that it is not recommendable to compute anxiety and depression scores separately because anxiety variance is tapped primarily by the broader construct of psychological distress, and both specific dimensions show low reliability.

EROL scale: a new behavioural olfactory measure and its relationship with anxiety and depression symptoms.

INTRODUCTION: The main objective of this study was to develop and validate a new olfactory measure that assesses the influence of olfaction on several emotional, behavioural, and cognitive issues: The Relational Scale of Olfaction (EROL). A secondary objective was to explore the relationship between the olfactory function and the anxiety and depression symptoms by means of EROL and the Hospital Anxiety and Depression Scale (HADS). A positive relationship between anxiety symptoms and the olfactory function was hypothesized. Regarding depressive symptoms, a significant relationship with the olfactory scores was not expected. METHOD: Psychometric properties of EROL scale and correlations between HADS and EROL were tested in a sample from the general population. RESULTS: EROL showed an adequate level of test-retest reliability (ICC=.748) and good internal consistency (Cronbach's alpha=.761). Convergent validity with other olfactory measures was satisfactory. A one-factor solution was found for the scale. HADS showed a significant relationship with EROL (r=.280, p<.01), but the analysis through dimensions revealed that only the anxiety subscale correlated significantly and moderately with the olfactory measure (r=.325, p<.001), whereas the correlation with the depression subscale was non-significant (r=.146, p>.05). CONCLUSIONS: Given that EROL displayed good psychometrical properties, it appears as a suitable tool to assess the olfactory function in general population. The relationship between this olfactory scale and anxiety symptoms found in this study is an interesting issue that requires further research.

La escala EROL: Una nueva medida olfatoria conductual y su relación con los síntomas ansiosos y depresivos / EROL scale: A new behavioural olfactory measure and its relationship with anxiety and depression symptoms

Introducción: El objetivo principal de este estudio fue desarrollar y validar una nueva escala olfatoria que evalúa la influencia del olfato en diferentes cuestiones emocionales, conductuales y cognitivas: La escala relacional sobre el olfato(EROL). El objetivo secundario consistió en explorar la relación entre la función olfatoria y los síntomas de ansiedad y depresión mediante la escala EROL y la Escala Hospitalaria de Ansiedad y Depresión (HADS). Se hipotetizó una relación positiva entre los síntomas de ansiedad y la función olfatoria. En cambio, no se esperó ningún tipo de relación significativa entre los síntomas depresivos y la medida olfatoria. Metodología: Se evaluaron las propiedades psicométricas de la escala olfatoria y se calcularon las correlaciones entre EROL y HADS en una muestra de la población general. Resultados: EROL mostró un nivel adecuado de fiabilidad test-retest con un coeficiente de correlación intraclase de 0.748. El alfa de Cronbach de 0.761 indicó una buena consistencia interna. La validez convergente con otras escalas olfatorias fue satisfactoria. El análisis factorial presentó una solución unidimensional. Se halló una relación significativa entre las escalas EROL y HADS (r=0.280, p<0.01), pero el análisis por subescalas reveló que sólo la dimensión de ansiedad correlacionaba significativamente y de forma moderada con la medida olfatoria (r=0.325, p<0.001), mientras que la correlación con la de depresión no fue significativa (r=0.146, p>0.05). Conclusiones: Las adecuadas propiedades psicométricas de la escala EROL indican que es un instrumento útil para valorar la función olfatoria en la población general. La relación que se ha hallado entre esta escala y los síntomas de ansiedad es un tema que requiere más investigación (AU)

Introduction: The main objective of this study was to develop and validate a new olfactory measure that assesses the influence of olfaction on several emotional, behavioural, and cognitive issues: The Relational Scale of Olfaction(EROL). A secondary objective was to explore the relationship between the olfactory function and the anxiety and depression symptoms by means of EROL and the Hospital Anxiety and Depression Scale (HADS). A positive relationship between anxiety symptoms and the olfactory function was hypothesized. Regarding depressive symptoms, a significant relationship with the olfactory scores was not expected. Method: Psychometric properties of EROL scale and correlations between HADS and EROL were tested in a sample from the general population. Results: EROL showed an adequate level of test-retest reliability (ICC=0.748) and good internal consistency (Cronbach’s alpha=0.761). Convergent validity with other olfactory measures was satisfactory. A one-factor solution was found for the scale. HADS showed a significant relationship with EROL (r=0.280, p<0.01), but the analysis through dimensions revealed that only the anxiety subscale correlated significantly and moderately with the olfactory measure (r=0.325, p<0.001), whereas the correlation with the depression subscale was non-significant (r=0.146, p>0.05). Conclusions: Given that EROL displayed good psychometrical properties, it appears as a suitable tool to assess the olfactory function in general population. The relationship between this olfactory scale and anxiety symptoms found in this study is an interesting issue that requires further research (AU)

[Item parameter drift in computerized adaptive testing: Study with eCAT]. / Deterioro de parámetros de los ítems en tests adaptativos informatizados: estudio con eCAT.

This study describes the parameter drift analysis conducted on eCAT (a Computerized Adaptive Test to assess the written English level of Spanish speakers). The original calibration of the item bank (N = 3224) was compared to a new calibration obtained from the data provided by most eCAT operative administrations (N = 7254). A Differential Item Functioning (DIF) study was conducted between the original and the new calibrations. The impact that the new parameters have on the trait level estimates was obtained by simulation. Results show that parameter drift is found especially for a and c parameters, an important number of bank items show DIF, and the parameter change has a moderate impact on high-level-English ? estimates. It is then recommended to replace the original estimates by the new set.

Tests informatizados y otros nuevos tipos de tests / No disponible

Recientemente se ha producido un considerable desarrollo de los tests adaptativos informatizados, en los que el test se adapta progresivamente al rendimiento del evaluando, y de otros tipos de tests: a) los test basados en modelos (se dispone de un modelo o teoría de cómo se responde a cada ítem, lo que permite predecir su dificultad), b) los tests ipsativos (el evaluado ha de elegir entre opciones que tienen parecida deseabilidad social, por lo que pueden resultar eficaces para controlar algunos sesgos de respuestas), c) los tests conductuales (miden rasgos que ordinariamente se han venido midiendo con autoinformes, mediante tareas que requieren respuestas no verbales) y d) los tests situacionales (en los que se presenta al evaluado una situación de conflicto laboral, por ejemplo, con varias posibles soluciones, y ha de elegir la que le parece la mejor descripción de lo que el haría en esa situación). El artículo comenta las características, ventajas e inconvenientes de todos ellos y muestra algunos ejemplos de tests concretos (AU)

The paper provides a short description of some test types that are earning considerable interest in both research and applied areas. The main feature of a computerized adaptive test is that in despite of the examinees receiving different sets of items, their test scores are in the same metric and can be directly compared. Four other test types are considered: a) model-based tests (a model or theory is available to explain the item response process and this makes the prediction of item difficulties possible), b) ipsative tests (the examinee has to select one among two or more options with similar social desirability; so, these tests can help to control faking or other examinee’s response biases), c) behavioral tests (personality traits are measured from non-verbal responses rather than from self-reports), and d) situational tests (the examinee faces a conflictive situation and has to select the option that best describes what he or she will do). The paper evaluates these types of tests, comments on their pros and cons and provides some specific examples (AU)