Careless responding detection revisited: Accuracy of direct and indirect measures.

To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.

An examination of model fit and measurement invariance of general mental ability and personality measures used in the multilingual context of the Swiss Armed Forces: A Bayesian structural equation modeling approach.

Measurement invariance of psychological test batteries is an essential quality criterion when the test batteries are administered in different cultural and language contexts. The purpose of this study was to examine to what extent measurement model fit and measurement invariance across the two largest language groups in Switzerland (i.e., German and French speakers) can be assumed for selected general mental ability and personality tests used in the Swiss Armed Forces' cadre selection process. For the model fit and invariance testing, we used Bayesian structural equation modeling (BSEM). Because the sizes of the language group samples were unbalanced, we reran the invariance testing with the subsampling procedure as a robustness check. The results showed that at least partial approximate scalar invariance can be assumed for the constructs. However, comparisons in the full sample and subsamples also showed that certain test items function differently across the language groups. The results are discussed regarding the three following issues: First, we critically discuss the applied criterion and alternative effect size measures for assessing the practical importance of non-invariances. Second, we highlight potential remedies and further testing options, that can be applied, once certain items have been detected to function differently. Third, we discuss alternative modeling and invariance testing approaches to BSEM and outline future research avenues.

Reliability of Scales With Second-Order Structure: Evaluation of Coefficient Alpha's Population Slippage Using Latent Variable Modeling.

A readily applicable procedure is discussed that allows evaluation of the discrepancy between the popular coefficient alpha and the reliability coefficient of a scale with second-order factorial structure that is frequently of relevance in empirical educational and psychological research. The approach is developed within the framework of the widely used latent variable modeling methodology and permits point and interval estimation of the slippage of alpha from scale reliability in a population under investigation. The method is useful when examining the consistency of complex structure measuring instruments assessing higher order latent constructs and, under its assumptions, represents a generally recommendable alternative to coefficient alpha. The outlined procedure is illustrated using data from an authoritarianism study.

Social control and smoking: examining the moderating effects of different dimensions of relationship quality.

A common form of social regulation of an individual's health behavior is social control. The contextual model of social control assumes that higher relationship quality goes along with more beneficial effects of social control on health behavior. This study examined potential differential moderating effects of different dimensions of relationship quality on the associations between positive and negative social control and smoking behavior and hiding smoking. The sample consisted of 144 smokers (n = 72 women; mean age = 31.78, SD = 10.04) with a nonsmoking partner. Positive and negative social control, dimensions of relationship quality consensus, cohesion and satisfaction, numbers of cigarettes smoked (NCS), hiding smoking (HS), and control variables were assessed at baseline. Four weeks later NCS and HS were assessed again. Only for smokers with high consensus, but not cohesion and satisfaction, a negative association between positive control and NCS emerged. Moreover, smokers with high consensus tended to report more HS when being positively and negatively socially controlled. This also emerged for cohesion and positive control. Satisfaction with the relationship did not display any interaction effects. This study's results emphasize the importance of differentiating not only between positive and negative social control but also between different dimensions of relationship quality in order to gain a comprehensive understanding of the dynamics in romantic dyads with regard to social regulation of behavioral change.