Does the Rorschach Performance Assessment System (R-PAS) Differ from the Comprehensive System (CS) on Variables Relevant to Interpretation?

We examined the impact of the changes in administration and coding introduced by the Rorschach Performance Assessment System (R-PAS) relative to the Comprehensive System (CS) on the Rorschach response process, as manifested in variables relevant to interpretation. We also examined the efficiency of each system to obtain protocols in an optimal range of responses (R) for interpretation. As hypothesized, when comparing 50 CS and 50 R-PAS nonpatient protocols, R-PAS produced many more protocols in the optimal R range (18-27) than the CS (78% vs. 24%) and it eliminated the need for re-administration, which was required for five CS protocols. As expected, R was less variable with R-PAS, as were two variables derived from it, R8910% and Complexity. In addition, as expected because of different Form Quality tables, R-PAS showed notably fewer and less variable perceptual distortions than the CS, and an increase in more conventional perceptions. The other 58 variables showed no reliable differences in means or standard deviations, though modest power precluded definitive inferences about equivalence. Overall, our results support previous findings about the benefit of R-PAS to obtain protocols in an optimal range for interpretation, while keeping the core manifestations of the response process unchanged.

The Effect of CS Administration or an R-Optimized Alternative on Potential Projective Material in Rorschach Responses From Six Studies and a Meta-Analysis of Their Findings.

The Rorschach Performance Assessment System (R-PAS; Meyer, Viglione, Mihura, Erard, & Erdberg, 2011) introduced R-optimized administration to reduce variability in the number of Responses (R). We provide new data from six studies of participants randomly assigned to receive a version of this method or Comprehensive System (CS; Exner, 2003) administration. We examine how administration methods affect 3 types of codes most likely to contain potential projective material and the frequency of these codes for the 1st, 2nd, 3rd, 4th, or last response to a card (R in Card). In a meta-analytic summary, we found 37% of responses have 1 type of code, 19% have 2 types, and 3% have all 3 types, with stable proportions across responses within cards. Importantly, administration method had no impact on potential projective variable means. Differential skew across samples made variability harder to interpret. Initial results suggesting differences in 3 of the 18 specific Type by R in Card pairs did not follow a coherent pattern and disappeared when using raw counts from all participants. Overall, data do not support concerns that R-optimized administration might alter potential projective processes, or make potentially "signature" last responses to the card any different in R-PAS than the CS.

Why We Need a Formal Systematic Approach to Validating Psychological Tests: The Case of the Rorschach Comprehensive System.

This article documents and discusses the importance of using a formal systematic approach to validating psychological tests. To illustrate, results are presented from a systematic review of the validity findings cited in the Rorschach Comprehensive System (CS; Exner, 2003) test manual, originally conducted during the manuscript review process for Mihura, Meyer, Dumitrascu, and Bombel's (2013) CS meta-analyses. Our review documents (a) the degree to which the CS test manual reports validity findings for each test variable, (b) whether these findings are publicly accessible or unpublished studies coordinated by the test developer, and (c) the presence and nature of data discrepancies between the CS test manual and the cited source. Implications are discussed for the CS in particular, the Rorschach more generally, and psychological tests more broadly. Notably, a history of intensive scrutiny of the Rorschach has resulted in more stringent standards applied to it, even though its scales have more published and supportive construct validity meta-analyses than any other psychological test. Calls are made for (a) a mechanism to correct data errors in the scientific literature, (b) guidelines for test developers' key unpublished studies, and (c) systematic reviews and meta-analyses to become standard practice for all psychological tests.

Contemporary Data on the Location of Response Objects in Rorschach's Inkblots.

Using a diverse sample of 4,786 protocols obtained with the Rorschach Performance Assessment System (Meyer, Viglione, Mihura, Erard, & Erdberg, 2011), we provide a contemporary overview of how people organize Rorschach's inkblots into identifiable regions while formulating responses. After examining how frequently each location was used across all cards in this sample, we examined the consistency of their use by computing parallel information in 17 samples (N = 4,701) obtained using the Comprehensive System (CS; Exner, 2003), including clinical, nonclinical, and adult, child, and adolescent data. Even though the CS data could only record a single location for each response, the average correlation of location use across samples was .96. The results also document continuous dimensionality in use rather than any discontinuities that would demarcate a boundary between common and uncommon locations. Implications of this notable reproducibility and dimensionality are discussed for future conceptualization of location typicality, including location coding considerations and possibilities for improved measures of perceptual fit.

The Effect of CS Administration or an R-Optimized Alternative on R-PAS Variables: A Meta-Analysis of Findings From Six Studies.

Controlling the number of Rorschach responses (R) as a method to reduce variability in the length of records has stimulated controversy among researchers for many years. Recently, the Rorschach Performance Assessment System (R-PAS; Meyer, Viglione, Mihura, Erard, & Erdberg, 2011 ) introduced an R-Optimized method to reduce variability in R. Using 4 published and 2 previously unpublished studies (N = 713), we examine the extent to which 51 Comprehensive System-based scores on the R-PAS profile pages are affected as a result of receiving Comprehensive System (CS; Exner, 2003 ) administration versus a version of R-Optimized administration. As hypothesized, R-the intended target of R-Optimized administration-showed reliable weighted average differences across each method of administration. As expected, its mean modestly increased and its standard deviation notably decreased. Also as hypothesized, the next largest effects were decreases in the variability (SD) of 2 variables directly related to R, R8910% and Complexity. No other reliable differences were observed. Therefore, because R-Optimized administration does not notably modify the existing CS-based normative values for other profiled R-PAS variables, the data do not support concerns that R-Optimized administration notably modifies the Rorschach task or that existing CS research data would not generalize to R-PAS. However, because R-Optimized administration reduces variability in R, it allows a single set of norms to apply readily to more people.

Criterion Validity of the Rorschach Developmental Index With Children.

The Rorschach Developmental Index (DI) is a composite measure of psychological development. The aim of this study was to examine the criterion validity of the DI by investigating its relationship with age, nonverbal intelligence, and the impact of institutionalization in a sample of Brazilian children. The sample included 231 children, ages 7 to 11, who were either living with their families or in an institutionalized setting. The results indicated that the DI is strongly associated with nonverbal intelligence. Multiple regression analysis revealed that 71% of the variability in the DI was associated with nonverbal intelligence, whereas age explained only 2%. Moreover, the DI scores and nonverbal intelligence scores were significantly lower for children living in institutionalized settings. The DI appears to be effective in assessing various levels of psychological development, especially when expressed in cognitive ability. The DI was developed in the United States, and this study suggests that the DI can be adapted to diverse cultures, regions, or languages.

Coding With R-PAS: Does Prior Training With the Exner Comprehensive System Impact Interrater Reliability Compared to Those Examiners With Only R-PAS-Based Training?

The Rorschach Inkblot Method (RIM) is a performance-based personality assessment instrument used in both clinical and research settings worldwide. This investigation examines response-level, interrater reliability of U.S. graduate students enrolled in the same doctoral program and divided into two unique participant groups: 20 of those with previous Comprehensive System (CS) training background who are now trained in Rorschach Performance Assessment System (R-PAS; initial coders N = 11, blind coders N = 9), and 19 of those trained solely with R-PAS (initial coders N = 10, blind coders N = 9). Trainees' coding was analyzed based on a sample of 50 protocols (half per group) representing a total of 1,189 responses. Blind coding was used among trainees and coding between the two investigated training groups was analyzed for each variable at the response level and expressed as percent agreement, Gwet's AC, and kappa values. Rates of agreement between the trainees were similar across both groups, and most of the concordance rates can be characterized as excellent. Overall, these results suggest that trainees may learn how to code R-PAS variables with similar reliability levels whether or not they had prior CS knowledge.

Visuospatial processing bias in ADHD: A potential artifact in the Wechsler Adult Intelligence Scale and the Rorschach Inkblots Test.

Global processing bias is the automatic tendency to process the global picture before processing the local details. Recent studies suggest that individuals with attention-deficit/hyperactivity disorder (ADHD) show a lack of global processing bias. In the current study, we examined whether lack of global processing bias affects performance on 2 psychological tests, Wechsler Adult Intelligence Scale IV (WAIS-IV) and the Rorschach inkblots test, which require the use of visuospatial processing while measuring different psychological constructs. Adult participants (30 ADHD and 30 typically developing controls) completed the subtests of the WAIS-IV, which rely on visuospatial components, and the Rorschach inkblots test. We found no indication of differences in general fluid intelligence between the groups. On the WAIS-IV test, ADHD participants consistently exhibited superior performance on tasks that relied on local processing and inferior performance on tasks that relied on global processing when compared with healthy controls. On the Rorschach inkblots test, ADHD participants exhibited more responses that referred to local aspects (part/s) of the stimulus and fewer responses that referred to global aspects (whole) of the stimulus. These findings imply that when patients with ADHD are given psychological tests that require visuospatial processing, a potential confound of visuospatial processing style needs to be considered. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Reassessment (after 15 Years) of Non-Patient Adults by the Rorschach Method.

The investigation of personality using the Rorschach Method has been historically established, however, its proper use requires continuous study, especially in regard to reliability, validity and normative references. This study's objective was to verify stability indicators of Rorschach (French Approach) through a reassessment (after 15 years) of non-patient adults previously addressed in the normative study by Pasian (1998). A total of 88 adults, aged between 34 and 69 years old, of both sexes, with different socio-economic and educational levels, were reassessed in 2013 in the state of São Paulo, Brazil. The responses were independently rated by different judges, with adequate precision. The average results obtained collected in 1998 and 2013 were analyzed to determine if these two sets of data were significantly different from each other (Student's t test, p ≤ .05) and the following variables were compared: Productivity indices, Apprehension Modes/Location, Formal Quality, Determinants, Contents and Banality. The overall stability level in these variables is considerable (mean r = .28, ± SD = 0.21). We discuss the theoretical approach of the Rorschach method regarding structural aspects of personality and developmental issues in personality assessment.

Development and preliminary validation of a brief behavioral measure of psychotic propensity.

Extensive research demonstrates that the dimensional assessment of psychotic manifestations is a primary strength of the Rorschach inkblot task, which provides an in vivo sample of problem-solving behavior and normative standards concerning the logic and coherence of thought processes and the typicality of perceptual representations. This article presents foundational research for the Thought and Perception Assessment System (TPAS), a Rorschach-based system designed to assess solely for disordered thinking and perceptual aberrations using either the standard 10-card set of inkblots or alternative 3-, 4-, and 5-card short forms. Using data from three patient samples (ns = 61, 93, and 133) and one nonpatient sample (n = 118), we document the equivalence of mean scores across the full and short-form card sets. We also document satisfactory interrater reliability and validity for the full and short forms, as well as strong part-whole reliability coefficients between the short forms and the full form. Consistent with psychometric theory and the principle of aggregation, each type of coefficient decreased as a function of decreasing the number of cards. We discuss implications and future applications in research and clinical assessment.

The Centrality of the Response Process in Construct Validity: An Illustration via the Rorschach Space Response.

Recently, psychologists have emphasized the response process-that is, the psychological operations and behaviors that lead to test scores-when designing psychological tests, interpreting their results, and refining their validity. To illustrate the centrality of the response process in construct validity and test interpretation, we provide a historical, conceptual, and empirical review of the main uses of the background white space of the Rorschach cards, called space reversal (SR) and space integration (SI) in the Rorschach Performance Assessment System. We show how SR and SI's unique response processes result in different interpretations, and that reviewing their literatures with these distinct interpretations in mind produces the expected patterns of convergent and discriminant validity. That is, SR was uniquely related to measures of oppositionality; SI was uniquely related to measures of cognitive complexity; and both SR and SI were related to measures of creativity. Our review further suggests that the Comprehensive System use of a single space code for all uses of white space likely led to its lack of meta-analytic support as a measure of oppositionality (Mihura, Meyer, Dumitrascu, & Bombel, 2013 ). We close by discussing the use of the response process to improve test interpretation, develop better measures, and advance the design of research.

Reassessment (after 15 Years) of non-patient adults by the Rorschach Method

The investigation of personality using the Rorschach Method has been historically established, however, its proper use requires continuous study, especially in regard to reliability, validity and normative references. This study's objective was to verify stability indicators of Rorschach (French Approach) through a reassessment (after 15 years) of non-patient adults previously addressed in the normative study by Pasian (1998). A total of 88 adults, aged between 34 and 69 years old, of both sexes, with different socio-economic and educational levels, were reassessed in 2013 in the state of São Paulo, Brazil. The responses were independently rated by different judges, with adequate precision. The average results obtained collected in 1998 and 2013 were analyzed to determine if these two sets of data were significantly different from each other (Student's t test, p ≤ .05) and the following variables were compared: Productivity indices, Apprehension Modes/Location, Formal Quality, Determinants, Contents and Banality. The overall stability level in these variables is considerable (mean r = .28, ± SD = 0.21). We discuss the theoretical approach of the Rorschach method regarding structural aspects of personality and developmental issues in personality assessment

No disponible

An Interrater Reliability Study of Rorschach Performance Assessment System (R-PAS) Raw and Complexity-Adjusted Scores.

Recently, the Rorschach Performance Assessment System (R-PAS; Meyer, Viglione, Mihura, Erard, & Erdberg, 2011 ) was introduced to overcome some possible limitations of the Comprehensive System (CS; Exner, 2003 ) while continuing its efforts to link Rorschach inferences to their evidence base. An important, technical modification to the scoring system is that R-PAS interpretations are based on both standard scores and complexity-adjusted scores. Two previous U.S. studies reported good to excellent interrater reliability (IRR) for the great majority of R-PAS variables; however, IRR of complexity-adjusted scores has never been investigated. Furthermore, no studies have yet investigated R-PAS IRR in Europe. To extend this literature, we examined R-PAS IRR of Page 1 and Page 2 raw and complexity-adjusted scores with 112 Italian Rorschach protocols. We collected a large sample of both clinical and nonclinical Rorschach protocols, each of which was coded separately by 2 independent raters. Results demonstrated a mean intraclass correlation of .78 (SD = .14) for raw scores and.74 (SD = .14) for complexity-adjusted scores. Overall, for both raw and complexity-adjusted values, most of the variables were characterized by good to excellent IRR.

Aggressive Drive Derivatives in the Rorschachs of Maltreated Children and Adolescents: Latent Structure and Clinical Correlates.

Psychological assessment can play an important role in informing the intervention process with child and adolescent victims of maltreatment. This study investigated the validity of the Rorschach in assessing aggressive drive derivatives using a profile-based approach, with a sample of 108 children and adolescents in foster care. Aggression indicators were derived from the work of Gacono and Meloy ( 1994 ). Latent class analysis yielded a 4-class model including gender and age as covariates. The first 2 classes were characterized by low prevalence rates across all indicators of aggression, and were distinguished primarily on the basis of participant's age. The 3rd class was characterized by the presence of Aggressive Vulnerability (AgV) responses, whereas the 4th showed higher occurrence of all markers except AgV. Modest associations were found between characteristics of abuse, select classes, and behavior problems. The 4th class showed the strongest link with behavior problems, albeit only in the presence of ego impairment. These findings support a contextualized, developmentally informed use of aggression markers on the Rorschach in the context of child maltreatment.

The Rorschach Comprehensive System (CS) Psychometric Validity of Individual Variables.

Since the publication of the Rorschach Inkblot Method (Rorschach, 1921/1942 ), theorists, researchers, and practitioners have been debating the nature of the task, its conceptual foundation, and most important its psychometric properties. The validity of the Rorschach Comprehensive System (CS; Exner, 1974 , 2003; Exner & Weiner, 1995 ) has been supported by several meta-analyses that used different types of nontest external criterion for validating individual variables. In a recent meta-analysis, Mihura, Meyer, Dumitrascu, and Bombel ( 2013 ) found coefficients ranging from modest to excellent for most of the selected CS variables, with 13 of them reported as showing "little to no support." This article focuses on these variables. Although endorsing Mihura et al.'s mainly validating findings, we also suggest that the evidence presented for the little or no validity of these 13 variables is not quite compelling enough to warrant changing their definition or coding, or removing them from the system. We point to some issues concerning the description and interpretation of these variables and the appropriateness of the external criteria used for exploring their validity, and suggest considering these issues in further CS research. Implications of Mihura et al.'s meta-analysis for clinical and forensic practice are discussed.

The Impact of R-Optimized Administration Modeling Procedures on Brazilian Normative Reference Values for Rorschach Scores.

To generate normative reference data for the Rorschach Performance Assessment System (R-PAS), modeling procedures were developed to convert the distribution of responses (R) in protocols obtained using Comprehensive System (CS; Exner 2003 ) administration guidelines to match the distribution of R in protocols obtained using R-Optimized Administration (Meyer, Viglione, Mihura, Erard, & Erdberg, 2011 ). This study replicates the R-PAS study, examining the impact of modeling R-Optimized Administration on Brazilian normative reference values by comparing a sample of 746 CS administered protocols to its counterpart sample of 343 records modeled to match R-Optimized Administration. The results were strongly consistent with the R-PAS findings, showing the modeled records had a slightly higher mean R and, secondarily, slightly higher means for Complexity and V-Comp, as well as smaller standard deviations for R, Complexity, and R8910%. We also observed 5 other small differences not observed in the R-PAS study. However, when comparing effect sizes for the differences in means and standard deviations observed in this study to the differences found in the R-PAS study, the results were virtually identical. These findings suggest that using R-Optimized Administration in Brazil might produce normative results that are similar to traditional CS norms for Brazil and similar to the international norms used in R-PAS.

Potential Projective Material on the Rorschach: Comparing Comprehensive System Protocols to Their Modeled R-Optimized Administration Counterparts.

Exner ( 1989 ) and Weiner ( 2003 ) identified 3 types of Rorschach codes that are most likely to contain personally relevant projective material: Distortions, Movement, and Embellishments. We examine how often these types of codes occur in normative data and whether their frequency changes for the 1st, 2nd, 3rd, 4th, or last response to a card. We also examine the impact on these variables of the Rorschach Performance Assessment System's (R-PAS) statistical modeling procedures that convert the distribution of responses (R) from Comprehensive System (CS) administered protocols to match the distribution of R found in protocols obtained using R-optimized administration guidelines. In 2 normative reference databases, the results indicated that about 40% of responses (M = 39.25) have 1 type of code, 15% have 2 types, and 1.5% have all 3 types, with frequencies not changing by response number. In addition, there were no mean differences in the original CS and R-optimized modeled records (M Cohen's d = -0.04 in both databases). When considered alongside findings showing minimal differences between the protocols of people randomly assigned to CS or R-optimized administration, the data suggest R-optimized administration should not alter the extent to which potential projective material is present in a Rorschach protocol.

The Effects of Using the International Versus Comprehensive System Rorschach Norms For Children, Adolescents, and Adults.

Currently, there is some debate about whether to use Comprehensive System norms (CS; Exner, 2003 ) or the Composite International Reference Values (CIRV; Meyer, Erdberg, & Shaffer, 2007 ) when interpreting Rorschach Inkblot Method (RIM; Rorschach, 1921 ) protocols administered with the CS method. The goal of this study is to assist clinicians in making this decision by providing information about the effects of choosing one option or the other. Accordingly, this research evaluates the effects of using the CS versus CIRV norms with children, adolescents, and adults. First, we identified 43 variables for which the CS and the CIRV for children and adolescents differ from each other by at least a Cohen's d value of .50. Next, we evaluated whether these divergent variables are the same as those previously identified as divergent for the adult population. Results showed that for both children and adolescents, as well as for adults, relying on CS norms versus CIRV would result in interpretations that are more pathological in terms of (a) perception and thinking, (b) psychological resources and cognitive and emotional abilities, and (c) representations of human relationships. A discussion on the clinical effects of using one versus the other set of norms follows.

Incarcerated Violent Offenders' Ability to Avoid Revealing Their Potential for Violence on the Rorschach and the MMPI-2.

Recently, Hartmann and Hartmann (2014) found that psychiatric outpatients, both with and without access to Internet-based information about the Rorschach Inkblot Method (RIM; Weiner, 2003 ) and the MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989 ), were unable to imitate healthy test performance on these tests. We replicated the study by administering the RIM and the MMPI-2 to 63 incarcerated violent offenders using similar testing conditions. As in the previous study, comparisons were made not only among the 3 subgroups of incarcerated offenders, but also between these offender groups and the group of nonpatients examined in the previous study. On the RIM, Internet-coached and uncoached "faking good" offenders produced records with significantly higher F% and X-% and significantly lower M, m, SumC, X+%, P, AG, and COP than nonoffenders under standard instructions (effect sizes between d = 0.24 and d = 2.39). For AgC, AgPot, AgPast, and TCI% there were no significant differences between the faking offenders and the nonoffenders under standard instructions. On the MMPI-2 clinical scales, there were no significant differences between the faking good groups and the nonoffenders under standard instructions, except on Hs, Pd, and Sc. Both faking groups were identifiable by their high L scale scores. Although both faking groups managed to avoid giving responses with aggressive and generally psychopathological content on the RIM, they were unable to produce test profiles demonstrating healthy test performance on any of the tests; nevertheless, Internet-based test information might weaken test validity.

An Investigation of Interrater Reliability for the Rorschach Performance Assessment System (R-PAS) in a Nonpatient U.S. Sample.

The Rorschach Performance Assessment System (R-PAS) aims to provide an evidence-based approach to administration, coding, and interpretation of the Rorschach Inkblot Method (RIM). R-PAS analyzes individualized communications given by respondents to each card to code a wide pool of possible variables. Due to the large number of possible codes that can be assigned to these responses, it is important to consider the concordance rates among different assessors. This study investigated interrater reliability for R-PAS protocols. Data were analyzed from a nonpatient convenience sample of 50 participants who were recruited through networking, local marketing, and advertising efforts from January 2013 through October 2014. Blind recoding was used and discrepancies between the initial and blind coders' ratings were analyzed for each variable with SPSS yielding percent agreement and intraclass correlation values. Data for Location, Space, Contents, Synthesis, Vague, Pairs, Form Quality, Populars, Determinants, and Cognitive and Thematic codes are presented. Rates of agreement for 1,168 responses were higher for more simplistic coding (e.g., Location), whereas agreement was lower for more complex codes (e.g., Cognitive and Thematic codes). Overall, concordance rates achieved good to excellent agreement. Results suggest R-PAS is an effective method with high interrater reliability supporting its empirical basis.