Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives.

This review summarizes the current state of the art of statistical and (survey) methodological research on measurement (non)invariance, which is considered a core challenge for the comparative social sciences. After outlining the historical roots, conceptual details, and standard procedures for measurement invariance testing, the paper focuses in particular on the statistical developments that have been achieved in the last 10 years. These include Bayesian approximate measurement invariance, the alignment method, measurement invariance testing within the multilevel modeling framework, mixture multigroup factor analysis, the measurement invariance explorer, and the response shift-true change decomposition approach. Furthermore, the contribution of survey methodological research to the construction of invariant measurement instruments is explicitly addressed and highlighted, including the issues of design decisions, pretesting, scale adoption, and translation. The paper ends with an outlook on future research perspectives.

Cross-Cultural Measurement of Positive and Negative Emotions in Adolescence: Evidence from Three Countries.

Cross-cultural assessment of affective well-being among adolescents has received scarce attention in positive psychological research. The present study investigated cross-cultural measurement invariance of the Scale of Positive and Negative Experience (SPANE) among adolescents from three countries (India, Poland, and Serbia). The sample included a total of 1080 adolescents (53.6% female; M age = 16.75, range = 15-19 years). Surveys were administered online in each country. Measurement invariance testing provided evidence for partial scalar invariance of the SPANE across cultures, with item "afraid" showing nonivariance across the three countries. Latent factor correlations between positive and negative emotions were stronger in Serbia compared to Poland and India. Positive emotions and life satisfaction had strong positive associations in all three countries (ranging from 0.68 to 0.75). The inverse correlations between negative emotions and life satisfaction were - 0.27, - 0.54, - 0.69 in India, Poland, and Serbia, respectively. Polish adolescents demonstrated the lowest levels of affective well-being, whereas Indian and Serbian adolescents did not differ substantially in levels of positive and negative emotions. The present study demonstrated that the SPANE is a reliable and useful tool for the assessment of positive and negative emotions among adolescents from different cultural settings. Supplementary Information: The online version contains supplementary material available at 10.1007/s10902-022-00521-6.

The Coronavirus Anxiety Scale: Cross-national measurement invariance and convergent validity evidence.

Coronavirus Anxiety Scale (CAS) is a widely used measure that captures somatic symptoms of coronavirus-related anxiety. In a large-scale collaboration spanning 60 countries (Ntotal = 21,513), we examined the CAS's measurement invariance and assessed the convergent validity of CAS scores in relation to the fear of COVID-19 (FCV-19S) and the satisfaction with life (SWLS-3) scales. We utilized both conventional exact invariance tests and alignment procedures, with results revealing that the single-factor model fit the data well in almost all countries. Partial scalar invariance was supported in a subset of 56 countries. To ensure the robustness of results, given the unbalanced samples, we employed resampling techniques both with and without replacement and found the results were more stable in larger samples. The alignment procedure demonstrated a high degree of measurement invariance with 9% of the parameters exhibiting noninvariance. We also conducted simulations of alignment using the parameters estimated in the current model. Findings demonstrated reliability of the means but indicated challenges in estimating the latent variances. Strong positive correlations between CAS and FCV-19S estimated with all three different approaches were found in most countries. Correlations of CAS and SWLS-3 were weak and negative but significantly differed from zero in several countries. Overall, the study provided support for the measurement invariance of the CAS and offered evidence of its convergent validity while also highlighting issues with variance estimation. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The Satisfaction with Life Scale in Adolescent Samples: Measurement Invariance across 24 Countries and Regions, Age, and Gender.

Measurement of adolescent life satisfaction across cultures has not received much attention in previous empirical research. The present study evaluated measurement invariance of the Satisfaction with Life Scale (SWLS) among adolescents in 24 countries and regions (N = 22,710; age range = 13-19 years; 53% female). A single-factor model with residual covariance between a pair of items tapping past life satisfaction fitted well in 19 countries and regions and showed a partial metric invariance. In a subset of nine countries and regions, partial scalar invariance was supported. Partial metric invariance across all 24 countries and regions was achieved when custom model modifications in five countries and regions were included. Three SWLS items showed evidence of noninvariance across cultures. The measurement model was found to operate similarly across gender and age. Our findings suggest that caution is needed when using the SWLS for measuring life satisfaction among adolescents from different cultures. Supplementary Information: The online version contains supplementary material available at 10.1007/s11482-021-10024-w.

Political participation and basic values in Europe: Replication and extension of Vecchione et al. (2015).

Vecchione et al. (Br J Psychol, 106, 2015, 84) demonstrated the effects of four higher-order values on political participation across 20 European countries. In their Study 1, they found that political participation was related to three higher-order basic values and that these associations were stronger in more democratic countries. The present study attempted a replication using a more rigorous modelling approach. Multilevel structural equation models with latent variables for both participation and basic values replicated the main effects of Self-Transcendence and Conservation values but demonstrated negative effects of Openness values (vs. positive in the original study) and positive effects of Self-Enhancement values (vs. ambiguous or insignificant in the original study), while cross-level interactions indicated weaker effects of values in more democratic countries (vs. the opposite in the original study). These discrepancies appeared mostly due to the original study's implicit assumption that basic values' measurement errors were zero. The new results indicated a counter-intuitive similarity of effects of supposedly opposite values. Self-Transcendence-Self-Enhancement is suggested to be a politically motivating value dimension, whereas Openness to Change-Conservation is a dimension that discourages political participation regardless of the preferred extreme.

Measurement Invariance of the Burnout Assessment Tool (BAT) Across Seven Cross-National Representative Samples.

The aim of this study was to investigate the measurement invariance of the Burnout Assessment Tool (BAT) across seven cross-national representative samples. In this study, burnout was modeled as a second-order factor in line with the conceptual definition as a syndrome. The combined sample consisted of 10,138 participants from countries in Europe and Japan. The data were treated as ordered categorical in nature and a series of models were tested to find evidence for invariance. Specifically, theta parameterization was used in conjunction with the weighted least squares (mean- and variance adjusted) estimation method. The results showed supportive evidence that BAT-assessed burnout was invariant across the samples, so that cross-country comparison would be justifiable. Comparison of effect sizes of the latent means between countries showed that Japan had a significantly higher score on overall burnout and all the first-order factors compared to the European countries. The European countries all scored similarly on overall burnout with no significant difference but for some minor differences in first-order factors between some of the European countries. All in all, the analyses of the data provided evidence that the BAT is invariant across the countries for meaningful comparisons of burnout scores.

Measurement invariance of the moral vitalism scale across 28 cultural groups.

Moral vitalism refers to a tendency to view good and evil as actual forces that can influence people and events. The Moral Vitalism Scale had been designed to assess moral vitalism in a brief survey form. Previous studies established the reliability and validity of the scale in US-American and Australian samples. In this study, the cross-cultural comparability of the scale was tested across 28 different cultural groups worldwide through measurement invariance tests. A series of exact invariance tests marginally supported partial metric invariance, however, an approximate invariance approach provided evidence of partial scalar invariance for a 5-item measure. The established level of measurement invariance allows for comparisons of latent means across cultures. We conclude that the brief measure of moral vitalism is invariant across 28 cultures and can be used to estimate levels of moral vitalism with the same precision across very different cultural settings.

The Link Between Personal Values and Frequency of Drinking Depends on Cultural Values: A Cross-Level Interaction Approach.

The increasing availability of large cross-national datasets enables researchers to integrate micro and macro levels of relations between human values and behavior. Particularly interesting are interactions between personal and cultural levels which can demonstrate to what extent a specific behavior is affected by individual values and cultural context. In this study, we aimed to shed light on this issue by analyzing data on basic values and drinking behavior from 21 national representative samples of the European Social Survey (2014). The results of multilevel regressions showed that country-level effects of Openness to Change (vs. Conservation) or Self-Transcendence (vs. Self-Enhancement) were not significantly related to frequency of drinking. As expected, individual-level Openness to Change (vs. Conservation) was consistently positively related to drinking frequency, whereas Self-Transcendence (vs. Self-Enhancement) was not. Contrary to our hypothesis, there was a positive association between personal Self-Transcendence (vs. Self-Enhancement) values and frequency of drinking in countries putting higher importance on extrinsic motivations (i.e., Conservation or Self-Enhancement values), while this link was less positive or even negative in countries valuing intrinsic motivations (i.e., Openness to Change or Self-Transcendence values). Moreover, a marginally significant interaction between individual- and country-level Openness to Change (vs. Conservation) values supported the same counter-intuitive result. These findings challenge the widespread idea that more conservative societies attenuate the link between personal values and behavior. In contrast, self-affirmation and cultural rewards theories, as well as culture-specific value instantiations, may explain these results. This study shows that the value-behavior link differs across cultures, yet in a more complex way than was assumed so far. This opens up new possibilities for research on values and behavior in a cross-cultural context.