Experience and Reporting of Postnatal Depression Across Cultures: A Comparison Using Anchoring Vignettes of Mothers in the United Kingdom and India.

Postnatal mental health is often assessed using self-assessment questionnaires in epidemiologic research. Differences in response style, influenced by language, culture, and experience, may mean that the same response may not have the same meaning in different settings. These differences need to be identified and accounted for in cross-cultural comparisons. Here we describe the development and application of anchoring vignettes to investigate the cross-cultural functioning of the Edinburgh Postnatal Depression Scale (EPDS) in urban community samples in India (n = 549) and the United Kingdom (n = 828), alongside a UK calibration sample (n = 226). Participants completed the EPDS and anchoring vignettes when their children were 12-24 months old. In an unadjusted item-response theory model, UK mothers reported higher depressive symptoms than Indian mothers (d = 0.48, 95% confidence interval: 0.358, 0.599). Following adjustment for differences in response style, these positions were reversed (d = -0.25, 95% confidence interval: -0.391, -0.103). Response styles vary between India and the United Kingdom, indicating a need to take these differences into account when making cross-cultural comparisons. Anchoring vignettes offer a valid and feasible method for global data harmonization.

Killing Two Birds with One Stone: Accounting for Unfolding Item Response Process and Response Styles Using Unfolding Item Response Tree Models.

Two research streams on responses to Likert-type items have been developing in parallel: (a) unfolding models and (b) individual response styles (RSs). To accurately understand Likert-type item responding, it is vital to parse unfolding responses from RSs. Therefore, we propose the Unfolding Item Response Tree (UIRTree) model. First, we conducted a Monte Carlo simulation study to examine the performance of the UIRTree model compared to three other models - Samejima's Graded Response Model, Generalized Graded Unfolding Model, and Dominance Item Response Tree model, for Likert-type responses. Results showed that when data followed an unfolding response process and contained RSs, AIC was able to select the UIRTree model, while BIC was biased toward the DIRTree model in many conditions. In addition, model parameters in the UIRTree model could be accurately recovered under realistic conditions, and mis-specifying item response process or wrongly ignoring RSs was detrimental to the estimation of key parameters. Then, we used datasets from empirical studies to show that the UIRTree model could fit personality datasets well and produced more reasonable parameter estimates compared to competing models. A strong presence of RS(s) was also revealed by the UIRTree model. Finally, we provided examples with R code for UIRTree model estimation to facilitate the modeling of responses to Likert-type items in future studies.

Patterns of life stress and the development of ruminative brooding in adolescence: A person-centered approach.

Research links life stressors, including acute, chronic, and early life stress, to the development of ruminative brooding. However, singular forms of life stress rarely occur in isolation, as adolescents typically encounter stressors that vary on important dimensions (e.g., types, timings, quantities) across development. The current study employs latent profile analysis (LPA) to identify natural clusters of life stress that, over time, may be differently associated with ruminative brooding. Evaluations of episodic, chronic, and early life stress were conducted with community-recruited mid-adolescents (N = 241, Mage = 15.90 years, 53% female) and their parents using the UCLA Life Stress Interview and lifetime adversity portions of the Youth Life Stress Interview. Analyses identified four distinct patterns: low stress, high peer stress, moderate home / family stress, and multifaceted / high school stress. Adolescents in the high peer stress and moderate home / family stress profiles were at highest risk for developing a brooding style over time. Despite high overall levels of stress, teens in the multifaceted / high school stress profile were at not at elevated risk for developing a brooding style. Findings demonstrate the utility of person-centered approaches to identify patterns of stress exposure that heighten risk for brooding over time.

Modeling Changes in Response Style with Longitudinal IRTree Models.

Traditional psychometric modeling focuses on observed categorical item responses, which can over-simplify the respondent cognitive response process. A further weakness is that analysis of ordinal responses has been primarily limited to a single substantive trait at one time point. We propose a significant expansion of this modeling framework to account for complex response processes across multiple waves of data collection using the beneficial item response tree framework. This study proposes a novel model, the longitudinal IRTree, for response processes in longitudinal studies, and investigates whether the response style changes are proportional to changes in the substantive trait of interest. A simulation study demonstrates adequate item parameter recovery in a Bayesian framework, especially with larger sample sizes of 2000. The longitudinal change parameters were recovered similarly well, with improved recovery using informative priors over default priors in Mplus. The empirical application demonstrates that relatively stable observed scores are due to a decrease in response styles offsetting an increase in the latent trait of interest.

Do Response Styles Affect Estimates of Growth on Social-Emotional Constructs? Evidence from Four Years of Longitudinal Survey Scores.

Survey respondents employ different response styles when they use the categories of the Likert scale differently despite having the same true score on the construct of interest. For example, respondents may be more likely to use the extremes of the response scale independent of their true score. Research already shows that differing response styles can create a construct-irrelevant source of bias that distorts fundamental inferences made based on survey data. While some initial studies examine the effect of response styles on survey scores in longitudinal analyses, the issue of how response styles affect estimates of growth is underexamined. In this study, we conducted empirical and simulation analyses in which we scored surveys using item response theory (IRT) models that do and do not account for response styles, and then used those different scores in growth models and compared results. Generally, we found that response styles can affect estimates of growth parameters including the slope, but that the effects vary by psychological construct, response style, and IRT model used.

Maternal depressive symptoms, rumination, and child emotion regulation.

Children of depressed mothers are at risk for maladaptive emotion regulation. This study examined a model of maternal rumination that links maternal depressive symptoms to child emotion regulation. A sample of 126 mother-child dyads (65 girls) participated in the current study, at three assessment points when children were age three, four, and five. At all assessment points, mothers reported their depressive symptoms and ruminative response style. Child emotion regulation was assessed observationally from two laboratory tasks, which were designed to elicit anger and sadness. Elevated maternal depressive symptoms were associated with higher concurrent rumination. Maternal rumination at child age four predicted that more child focus on distress during sadness-eliciting tasks and less child active distraction during anger-eliciting tasks 1 year later. Additionally, maternal rumination at child age three and four predicted less child passive behaviors in anger-eliciting tasks prospectively. Findings suggest that maternal rumination is predictive of using maladaptive regulatory strategies among children of depressed mothers. This study has significant implications for intervention programs targeting depressed mothers and their children.

Students' achievement motivation in Finnish and Chinese higher education and its relation to perceived teaching-learning environments.

This cross-cultural study of Finnish and Chinese students set out to compare the levels of achievement motivation (AM) in order to investigate whether the differences in them might be explained by the different cultural response styles and whether these response styles could be controlled for with a method which includes response style variables as covariates in ANCOVA. This study also scrutinizes relationships between perceived teaching-learning environments (TLE) and AM within each cultural group. The survey sample consisted of 3,035 Finnish and 2,309 mainland Chinese university students. Finnish students were found to rate the level of AM markedly higher than do Chinese students. It was determined that the method applied for response style controlling is not suitable for cross-cultural studies, even though it is recommended for this use. A modification of the method, which is based on robust statistical tools, was found not to change this conclusion, but it can nevertheless be used to obtain useful information about the effects of response style differences. The results also show that similar relationships between AM and TLE could be identified in the data of both groups. However, for the Finnish group AM is related to perceived suitable workload, whereas for the Chinese group it is related to teacher encouragement.

MIMIC approach to assessing differential item functioning with control of extreme response style.

Likert or rating scales may elicit an extreme response style (ERS), which means that responses to scales do not reflect the ability that is meant to be measured. Research has shown that the presence of ERS could lead to biased scores and thus influence the accuracy of differential item functioning (DIF) detection. In this study, a new method under the multiple-indicators multiple-causes (MIMIC) framework is proposed as a means to eliminate the impact of ERS in DIF detection. The findings from a series of simulations showed that a difference in ERS between groups caused inflated false-positive rates and deflated true-positive rates in DIF detection when ERS was not taken into account. The modified MIMIC model, as compared to conventional MIMIC, logistic discriminant function analysis, ordinal logistic regression, and their extensions, could control false-positive rates across situations and yielded trustworthy true-positive rates. An empirical example from a study of Chinese marital resilience was analyzed to demonstrate the proposed model.

Response styles confound the age gradient of four health and well-being outcomes.

OBJECTIVES: Accurate representation of the association of health and well-being outcomes over age can inform us about how well the population is doing, where segments of the population may be in need, and allow hypothesis generation about correlates and causes of observed gradients. In this paper, we examine the possibility that response styles can impact associations between respondent age and four common, self-report variables: overall health; life satisfaction; pain intensity; and, fatigue level. Response styles (RSs) are defined as tendencies for people to use certain locations on response scales (e.g., extremes, middle) regardless of scale content. Although RSs have been shown in some circumstances to bias self-reports, often little attention is paid to this source of bias. METHODS: A sample of 2000 Internet panelists completed an online questionnaire that included a set of heterogeneous items to compute measures of the following RSs: acquiescence, disacquiescence, midpoint responding, and extreme responding. RESULTS: A total of 1839 participants formed the analytic sample and they had an average age of 54.4 (range: 21-89). RSs were associated with age and with the outcome variables. Moreover, the age pattern of the health and well-being variables was considerably altered when RSs were controlled. An alternative, item-response theory-based method of deriving measures of RSs confirmed many of the associations from the primary method of computing RS variables. Across the different self-report outcomes, disacquiescence had the greatest effect on the age patterns, and pain and fatigue were the outcomes most impacted by controlling for RSs. DISCUSSION: In accord with prior research, we recommend greater consideration be given to RSs in aging research.

Extreme Response Style and the Measurement of Intra-Individual Variability in Affect.

Extreme response style (ERS) has the potential to bias the measurement of intra-individual variability in psychological constructs. This paper explores such bias through a multilevel extension of a latent trait model for modeling response styles applied to repeated measures rating scale data. Modeling responses to multi-item scales of positive and negative affect collected from smokers at clinic visits following a smoking cessation attempt revealed considerable ERS bias in the intra-individual sum score variances. In addition, simulation studies suggest the magnitude and direction of bias due to ERS is heavily dependent on the mean affect level, supporting a model-based approach to the study and control of ERS effects. Application of the proposed model-based adjustment is found to improve intra-individual variability as a predictor of smoking cessation.

The Graded Response Differential Discrimination Model Accounting for Extreme Response Style.

Extreme response style or, more generally, individual differences in response spacing have been shown to be an influential bias when analyzing questionnaire data. Recently a promising model adjusting for this bias - the differential discrimination model - has been proposed. An advantage to other related approaches is that the model can be fitted using standard structural equation modeling software. However, the model is designed for analyzing continuous item responses, whereas graded response formats are certainly more prominent in behavioral sciences. To resolve this limitation, the present article extends the differential discrimination model to analyzing graded responses. Empirical examples as well as a small simulation study are presented.

Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

BACKGROUND: Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can seriously bias the estimation of constructs assessed by the scale. A well-documented disadvantage of self-report measures is their sensitivity to response style (RS) effects such as the respondent's tendency to select the extremes of a rating scale. Although the biasing effect of extreme responding on constructs measured by self-reported tools has been widely acknowledged and studied across disciplines, little attention has been given to the development and systematic application of methodologies to assess and control for this effect in PRO measures. METHODS: We review the methodological approaches that have been proposed to study extreme RS effects (ERS). We applied a multidimensional item response theory model to simultaneously estimate and correct for the impact of ERS on trait estimation in a PRO instrument. Model estimates were used to study the biasing effects of ERS on sum scores for individuals with the same amount of the targeted trait but different levels of ERS. We evaluated the effect of joint estimation of multiple scales and ERS on trait estimates and demonstrated the biasing effects of ERS on these trait estimates when used as explanatory variables. RESULTS: A four-dimensional model accounting for ERS bias provided a better fit to the response data. Increasing levels of ERS showed bias in total scores as a function of trait estimates. The effect of ERS was greater when the pattern of extreme responding was the same across multiple scales modeled jointly. The estimated item category intercepts provided evidence of content independent category selection. Uncorrected trait estimates used as explanatory variables in prediction models showed downward bias. CONCLUSIONS: A comprehensive evaluation of the psychometric quality and soundness of PRO assessment measures should incorporate the study of ERS as a potential nuisance dimension affecting the accuracy and validity of scores and the impact of PRO data in clinical research and decision making.

Consistent Differential Discrimination Model Estimation.

A novel factor-analytic model-the differential discrimination model-for assessing individual differences in scale use has been recently introduced, together with a three-stage estimation approach for model fitting. Unfortunately, the second-stage estimator and, as a consequence, the third-stage estimator of this procedure are not consistent. In this article we show that (a) the differential discrimination model can be expressed in a structural equation model framework, and (b) consistent and simultaneous estimation of all model parameters can be achieved using standard SEM software.

Individual and culture-level components of survey response styles: A multi-level analysis using cultural models of selfhood.

Variations in acquiescence and extremity pose substantial threats to the validity of cross-cultural research that relies on survey methods. Individual and cultural correlates of response styles when using 2 contrasting types of response mode were investigated, drawing on data from 55 cultural groups across 33 nations. Using 7 dimensions of self-other relatedness that have often been confounded within the broader distinction between independence and interdependence, our analysis yields more specific understandings of both individual- and culture-level variations in response style. When using a Likert-scale response format, acquiescence is strongest among individuals seeing themselves as similar to others, and where cultural models of selfhood favour harmony, similarity with others and receptiveness to influence. However, when using Schwartz's (2007) portrait-comparison response procedure, acquiescence is strongest among individuals seeing themselves as self-reliant but also connected to others, and where cultural models of selfhood favour self-reliance and self-consistency. Extreme responding varies less between the two types of response modes, and is most prevalent among individuals seeing themselves as self-reliant, and in cultures favouring self-reliance. As both types of response mode elicit distinctive styles of response, it remains important to estimate and control for style effects to ensure valid comparisons.

A Novel Indicator to Correct for Individual Reported Heterogeneity. An Application to Self-Evaluation of Later-Life Depression.

Program evaluations often investigate complex or multi-dimensional constructs, such as individual opinions or attitudes, by means of ratings. A different interpretation of the same question may affect cross-country comparability, leading to the Differential Item Functioning problem. Anchoring vignettes were introduced in the literature as a way to adjust self-evaluations from this interpersonal incomparability. In this paper, we first introduce a new nonparametric solution to analyse anchoring vignette data, recoding a variable based on a rating scale to a new corrected-variable that guarantees comparability in any cross-country analysis. Then, we exploit the flexibility of a mixture model introduced to account for uncertainty in the response process (the CUP model) to test if the proposed solution is effectively able to remove this reported heterogeneity. This solution is easy to construct and has important advantages compared with the original nonparametric solution adopted with anchoring vignette data. The novel indicator is applied to investigate self-reported depression in an old population. Data that will be analysed come from the second wave of the Survey of Health, Ageing and Retirement in Europe, collected in 2006/2007. Results highlight the need of correcting for reported heterogeneity comparing individual self-evaluations. Once interpersonal incomparability resulting from the different uses of response scales is removed from the self-assessments, some estimates are reversed in magnitude and signs with respect to the analysis of the collected data.

Longitudinal associations between response-style strategies and abnormal eating behaviors/attitudes in adolescents: a cross-lagged panel model.

BACKGROUND: Previous studies have suggested that response-style strategies (rumination, problem-solving, and distraction) can be risk or protective factors for the development of abnormal eating behaviors/attitudes (AEB) during adolescence. However, due to limited empirical data regarding the prospective effects of these strategies on AEB, further research is needed to clarify their role in developing AEB in adolescence. METHODS: This study investigated the one-year lagged effects of response-style strategies on AEB in 24,883 fourth- to eighth-grade students in Japan between 2015 and 2019 using a cross-lagged panel model. Depressive symptoms and body mass index (BMI), which are reported to relate to AEB, were also included in the analytic model. The students self-reported their levels of response-style strategies, AEB, and depressive symptoms. We also evaluated BMI based on teachers' reports. RESULTS: We found that greater rumination significantly predicted more severe AEB in the following year among students from all grades, with small to moderate effect sizes. In addition, distraction significantly predicted more severe binge eating/purging behaviors, but with very weak small effect sizes. Problem-solving did not predict any level of AEB. Furthermore, we observed significant reciprocal relationships between response-style strategies, AEB, and depressive symptoms. Positive reciprocal associations between BMI and AEB were also found except for some intervals. CONCLUSIONS: We concluded that a decrease in rumination is critical to alleviating mental health problems, such as AEB and depressive symptoms, during adolescence. This suggests that interventions to reduce the level of rumination should be conducted in the early stages of adolescence. TRIAL REGISTRATION NUMBER: Not Applicable.

This study examines the effects of three response styles when faced with distress­rumination, problem-solving, and distraction­on unhealthy eating behaviors. In this study, we looked at how these coping strategies are linked to unhealthy eating behaviors in 24,883 students in grades four to eight in Japan between 2015 and 2019. We checked again at year-long intervals to see if the coping strategies had any effect on the students' unhealthy eating behaviors. In addition, we considered depressive symptoms and body mass index in our analysis because these variables might also be related to unhealthy eating behaviors. We found that more rumination (i.e., a repetitive negative thinking pattern) predicted the severity of unhealthy eating behaviors and depressive symptoms in the following year across all the grades. In addition, greater depressive symptoms also contributed to an increase in unhealthy eating behaviors in the following year. Therefore, we suggest that rumination is a key factor that influences mental health during adolescence.

A Systematic Review of Response Styles Among Latinx Populations.

Culture influences responses to psychological measurements in ways unrelated to target constructs, thus biasing test scores and potentially contributing to under- and over-diagnosis of mental health problems in populations for which measures have not yet been normed. We conducted a systematic review of publications addressing response style among Latinx population groups in North and South America. In a final corpus of 24 studies, Latinx/Latin American populations were generally found to exhibit higher levels of extreme response style (n = 17), acquiescent response style (n = 10), and socially desirable responding (n = 5). The few publications (n = 3) that investigated midpoint responding reported no differences. Seven publications (29%) attempted to adjust scores to mitigate response style bias, using both scale design and statistical techniques. Findings suggest that researchers and clinicians should directly assess culturally patterned response style as a construct, rather than inferring style indirectly using other measures. For clinicians, knowledge of response style represents another facet of case conceptualization.

Application of a Longitudinal IRTree Model: Response Style Changes Over Time.

Traditional psychometric models focus on studying observed categorical item responses, but these models often oversimplify the respondent cognitive response process, assuming responses are driven by a single substantive trait. A further weakness is that analysis of ordinal responses has been primarily limited to a single substantive trait at one time point. This study applies a significant expansion of this modeling framework to account for complex response processes across multiple waves of data collection using the item response tree (IRTree) framework. This study applies a novel model, the longitudinal IRTree, for response processes in longitudinal studies, and investigates whether the response style changes are proportional to changes in the substantive trait of interest. To do so, we present an empirical example using a six-item sexual knowledge scale from the National Longitudinal Study of Adolescent to Adult Health across two waves of data collection. Results show an increase in sexual knowledge from the first wave to the second wave and a decrease in midpoint and extreme response styles. Model validation revealed failure to account for response style can bias estimation of substantive trait growth. The longitudinal IRTree model captures midpoint and extreme response style, as well as the trait of interest, at both waves.

Identifying positive impression management using the MMPI-2 and the MMPI-2-RF: A meta-analysis.

Objective:Individuals may be motivated to conceal or minimize psychological symptoms and engage in positive impression management (PIM) in order to achieve desired outcomes across high stakes contexts (e.g. fitness for duty evaluations, pre-sentencing assessments, medical procedure evaluations, civil commitment). Despite the importance of this topic, the most recent meta-analysis of the MMPI-2, a widely used instrument for detecting PIM, was conducted more than two decades ago. Method:Using a Robust Variance Estimation method, this meta-analysis synthesized the results of 27 studies that examined the MMPI-2 (k = 22) and MMPI-2-RF (k = 5) validity scales' ability to discriminate individuals who engage in PIM from genuine responders, with a particular focus on the L, K, and S scales. Results:The MMPI-2 L scale produced the largest effect size (g = 1.30), whereas the MMPI-2-RF L-r scale effect size was moderate (g = 1.16). Moderate effect sizes were also found for the K (g = 1.01) and K-r (g = 1.21) scales, and for the MMPI-2 S scale (g = 1.23). Conclusions: Effect sizes did not significantly vary between the two versions of the MMPI. Findings suggest that both versions of the MMPI have demonstrated utility in identifying PIM, but clinicians should interpret T scores conservatively to account for the modest elevations associated with defensiveness. Findings are discussed in the context of the recently released MMPI-3.

A Monte Carlo study of IRTree models' ability to recover item parameters.

Item response tree (IRTree) models are theorized to extract response styles from self-report data by utilizing multidimensional item response theory (IRT) models based on theoretical decision processes. Despite the growing popularity of the IRTree framework, there has been little research that has systematically examined the ability of its most popular models to recover item parameters across sample size and test length. This Monte Carlo simulation study explored the ability of IRTree models to recover item parameters based on data created from the midpoint primary process model. Results indicate the IRTree model can adequately recover item parameters early in the decision process model, specifically the midpoint node. However, as the model progresses through the decision hierarchy, item parameters have increased associated error variance. The authors ultimately recommend caution when employing the IRTree framework.