Using the Personality Assessment Inventory to Assess the Alternative Model for Personality Disorders: Criterion Validity in a Clinical Sample.

The Personality Assessment Inventory (PAI) is a broadband measure of psychopathology that is widely used in applied settings. Researchers developed regression-based estimates that use the PAI to measure constructs of the Alternative Model for Personality Disorders (AMPD) - a hybrid dimensional and categorical approach to conceptualizing personality disorders. Although prior work has linked these estimates to formal measures of the AMPD, there is little work investigating the clinical correlates of this scoring approach of the PAI. The current study examines associations between these PAI-based AMPD estimates and life data in a large, archival dataset of psychiatric outpatients and inpatients. We found general support for the criterion validity of AMPD estimate scores, such that a theoretically consistent pattern of associations emerged with indicators such as prior academic achievement, antisocial behavior, psychiatric history, and substance abuse. These results provide preliminary support to this scoring approach for use in clinical samples.

Deriving the Transdiagnostic Scales From the Personality Assessment Inventory and SPECTRA: Indices of Psychopathology: A Demonstration.

Transdiagnostic models of psychopathology address many of the shortcomings common to categorical diagnostic systems. These empirically derived models conceptualize psychopathology as a few broad interrelated and hierarchically arranged dimensions, with an overarching general psychopathology dimension, the p-factor, at the apex. While transdiagnostic models are gaining prominence in mental health research, the lack of available tools has limited their clinical translation. The present study explored the potential of creating transdiagnostic scales from the joint factor structure of the Personality Assessment Inventory, Alternative Model of Personality Disorder trait scales (AMPD), and the clinical scales of the SPECTRA: Indices of Psychopathology (SPECTRA). Exploratory factor analysis in a clinical sample (n = 212) identified five factors corresponding to the Negative Affect/Internalizing, Detachment, Antagonism/Externalizing, Disinhibition/Externalizing, and Thought Disorder transdiagnostic dimensions. Goldberg's "Bass-Ackward" method supported a hierarchical structure. Five composite transdiagnostic scales were created by summing each factor's highest loading PAI and SPECTRA scales. A global psychopathology scale was created by summing the five composite scales. All the composite scales demonstrated adequate internal consistency. Correlations between the composite scales and the NEO Five-Factor Inventory-3 provide initial validity evidence for four composite and global scales. The composite thought disorder scale had no conceptually corresponding NEO domain. Clinical implications and study limitations are discussed.

Convergence in patient and therapist alliance ratings early in treatment with Personality Assessment Inventory clinical scales and subscales.

We examined discrepancies in 81 patient-therapist dyads' alliance ratings early in treatment (3rd or 4th session) in relation to Personality Assessment Inventory clinical scales, subscales and global psychopathology. Results indicated that PAI global psychopathology (mean clinical elevation) and the scales of Aggression [AGG], Somatization [SOM], and Anxiety-Related Disorders [ARD] were significantly, negatively associated with an absolute difference of patient and therapist alliance ratings at Session 3. Higher initial scores on these clinical scales at treatment onset are associated with less difference (i.e., more convergence) in patient/ therapist ratings of alliance at Session 3. Correlations between PAI clinical subscales and absolute differences of patient and therapist alliance ratings at Session 3 also demonstrated statistically significant inverse relationships for several PAI subscales of Aggression- Attitude [AGG-A], Aggression-Physical [AGG-P], Somatic- Health Concerns [SOM-H], Anxiety-Related Disorders-Traumatic Stress [ARD-T], Anxiety-Related Disorders- Obsessive Compulsive [ARD-O], Borderline Features-Affective Instability [BOR-A], Borderline- Self-Harm [BOR-S], Anxiety-Physiological [ANX-P], Depression-Physiological [DEP-P] and Antisocial-Stimulus Seeking [ANT-S]. Again, higher scores on these subscales at treatment onset are associated with less difference (i.e., more convergence) in patient/therapist ratings. We also examined group differences between patients rating alliance higher (Group 1) and therapists rating alliance higher (Group 2) and found that Group 1 had significantly lower scores on Mania-Activity Level [MAN-A]. Clinical implications of results are discussed.

Personality assessment inventory items in relation to patient- and therapist-rated alliance.

Based on the results of prior research, we examined relationships between Personality Assessment Inventory (PAI) items on clinical scales of antisocial features (ANT) and anxiety-related disorders (ARD) with patient- and therapist-rated alliance early in treatment (third or fourth session). We also explored the relationship between the PAI treatment rejection scale (RXR) and early session therapist-rated alliance, despite null findings in previous work. We used PAI protocols from a clinical outpatient sample (N = 80). Data were analysed using backwards linear regressions. Results indicated that a group of ANT items from different ANT subscales predicted patient-rated therapeutic alliance, F(8,59) = 5.182, p = .000, R2 of .413, f2 = 0.70. Additionally, a group of ARD items from different ARD subscales significantly predicted therapist-rated alliance, F(6,62) = 3.007, p = .012, R2 of .225, f2 = 0.29. No significant relationships were found for RXR items and therapist-rated alliance, consistent with prior findings. Clinical implications are discussed.

External correlates of the SPECTRA: Indices of psychopathology (SPECTRA) in a clinical sample.

The SPECTRA: Indices of Psychopathology is a broadband assessment inventory compatible with contemporary hierarchical models of psychopathology (internalizing, externalizing, reality impairing dimensions and global psychopathology factor). This study explored the SPECTRA's construct validity using a wide range of life event (extra-test) variables in a clinical sample. The life event variables included the following: education level, school failure, childhood adversity, suicide attempts, psychiatric hospitalizations, depression, psychotic symptoms, self-injury, substance abuse, arrests, physical violence, marital status, employment status and current medications. Results showed that all SPECTRA clinical scales had significant life event correlations. For the higher-order Spectra scales, the global index of psychopathology had the greatest number and range of life event correlations. Correlations for the externalizing and reality impairing Spectra scales provided solid validity evidence, while correlations for the internalizing Spectra scale were more diffuse. These findings provide the first non-test-based evidence of construct validity for the SPECTRA.

When's a story a story? Determining interpretability of Social Cognition and Object Relations Scale-Global ratings on Thematic Apperception Test narratives.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) measures the quality of object relations in narrative material. The reliability and validity of this measure have been well established. However, a psychometric oddity of this scale is that default ratings are given to select dimensions when the relevant construct is not present. This can result in narrative 'blandness' and may impact clinical findings. The aim of these two studies is to understand these phenomena both psychometrically and clinically. In the first study, we identified 276 outpatients who had SCORS-G ratings for TAT Cards 1, 2, 3BM, and 14, set criteria for narrative 'blandness' across all eight dimensions, and examined group differences. In Study 2, we used a subset (N = 99) of Study 1 and examined how percentage of formal default ratings for Emotional Investment in Values and Moral Standards (EIM), Experience and Management of Aggressive Impulses (AGG), Self-Esteem(SE), and Identify and Coherence of Self (ICS) impacted robustness of correlations across tests of intelligence, psychopathology, and normal personality functioning. Taken together, we identified clinical characteristics of patients who are more likely to produce 'bland' narratives and increased percentages of formal default ratings. Also, an excess of default ratings per protocol impacts robustness of correlations and weakens significant correlations. As cut-off scores increase (>25% and >28.12%), the likelihood of being able to interpret EIM, AGG, SE, and ICS decreases. Psychometric and clinical implications are discussed.

Extending the Use of the SCORS-G Composite Ratings in Assessing Level of Personality Organization.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, 1995b ) reliably measures the quality of object relations in narrative material. It assesses 8 dimensions (on a continuum from maladaptive to adaptive) that mediate interpersonal functioning. The 8 dimensions can be averaged to create a global or composite score to represent a person's overall object relational functioning. This study aimed to create levels of personality organization using the SCORS-G global score ratings of Thematic Apperception Test (TAT) narratives and to explore the construct validity of these levels using a multimethod approach (i.e., psychopathology, normal personality, and life-event data). Meaningful relationships were found between the SCORS-G level of personality organization and aspects of psychopathology (Personality Assessment Inventory; Morey, 1991 ), regulation and control (NEO Five-Factor Inventory; Costa & McCrae, 1989, 1992b ), and number of psychiatric hospitalizations, suicide attempts, and educational level. Overall, this study demonstrates the potential value of creating levels of personality organization (LPO) using the SCORS-G composite or global ratings as a supplement to the psychological assessment process and further highlights the utility of this measure in the field of personality assessment. Clinical and research-related implications as well as limitations are discussed.

Exploring the Factor Structure of the Social Cognition and Object Relations-Global Rating Method: Support for Two- and Three-Factor Models.

The Social Cognition and Object Relations Scales-Global Rating Method (SCORS-G) contains 8 scales for coding narrative content. This study explores the factor structure of this measure using college (n = 171), outpatient (n = 239), and inpatient (n = 78) samples. Participants told stories to the Thematic Apperception Test (TAT; Murray, 1943) cards. Stories were transcribed and coded by blind raters using the SCORS-G. Cases were randomly assigned to an exploratory or validation group. Exploratory factor analysis with the exploratory group suggested 2- and 3-factor models. The Emotional Investment in Relationships (EIR) scale did not obtain a primary loading on any factor and was not included in subsequentmodels. After modifications, confirmatory factor analysis indicated good-to-adequate fit for 2- and 3-factor models. Both models showed good fit in the validation group and met criteria for invariance across models. Findings indicated that some SCORS-G scales tap cognitive-structural elements, whereas others assess affective-relational components of narratives. We found mild support separating the affective-relational scales in terms of internal representations for the self and others and relationships. The results reported here indicate that clinicians and researchers can calculate a separate cognitive-structural composite score and an affective-relational composite score when using the SCORS-G to rate TAT stories.

Dimensional measure of self and interpersonal functioning: Comparisons with treatment alliance and readiness for inpatient psychotherapy.

The social cognition and object relations scale-global rating method is a clinical rating system assessing 8 domains of self and interpersonal functioning. It can be applied to score numerous forms of narrative data. In this study, we investigate the SCORS-G relationship to measures of alliance and readiness for psychotherapy with an adolescent inpatient sample. Seventy-two psychiatrically hospitalized adolescents were consented and subsequently rated by their individual and group therapist using the SCORS-G. The unit psychiatrist also completed an assessment of patients' readiness for inpatient psychotherapy. The patients completed a self-report of their alliance with the inpatient treatment team as a whole. SCORS-G ratings were positively correlated with assessments of readiness for inpatient psychotherapy and patient-reported alliance. This study further demonstrates the clinical utility of the SCORS-G with adolescents.

Model-Based Approaches for Teaching and Practicing Personality Assessment.

Psychological assessment is a complex professional skill. Competence in assessment requires an extensive knowledge of personality, neuropsychology, social behavior, and psychopathology, a background in psychometrics, familiarity with a range of multimethod tools, cognitive flexibility, skepticism, and interpersonal sensitivity. This complexity makes assessment a challenge to teach and learn, particularly as the investment of resources and time in assessment has waned in psychological training programs over the last few decades. In this article, we describe 3 conceptual models that can assist teaching and learning psychological assessments. The transtheoretical model of personality provides a personality systems-based framework for understanding how multimethod assessment data relate to major personality systems and can be combined to describe and explain complex human behavior. The quantitative psychopathology-personality trait model is an empirical model based on the hierarchical organization of individual differences. Application of this model can help students understand diagnostic comorbidity and symptom heterogeneity, focus on more meaningful high-order domains, and identify the most effective assessment tools for addressing a given question. The interpersonal situation model is rooted in interpersonal theory and can help students connect test data to here-and-now interactions with patients. We conclude by demonstrating the utility of these models using a case example.

Estimating the Effects of Thematic Apperception Test Card Content on SCORS-G Ratings: Replication With a Nonclinical Sample.

The content of Thematic Apperception Test (TAT) cards can, in some cases, influence how respondents form narratives. This study examines how imagery from select TAT cards affects the narratives of respondents from a nonclinical setting. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, Lohr, Silk, Kerber, & Goodrich, 1989) was used to rate narratives. Forty-nine college students provided narratives to 6 TAT cards. Narratives were rated by two expert raters using the SCORS-G. Consistent with prior research, Card 2 exhibited the most pull for adaptive ratings on SCORS-G scales, and 3 BM exhibited the most pull for maladaptive ratings. Findings for other cards were mixed. Although raters were highly reliable, internal consistency estimates were lower than desirable for 6 of the 8 SCORS-G scales. Variance component estimates indicated that card by person interactions accounted for the largest amount of variance in person-level scores. Results and limitations are discussed in light of prior research. We also make suggestions for further lines of research in this area.

External validity of the Symptom Assessment-45 Questionnaire (SA-45) in a clinical sample.

This study seeks to evaluate the construct validity of the Symptom Assessment-45 by investigating the instrument's correlation with selected scales from the Personality Assessment Inventory and life-event data in a sample of 93 psychiatric patients. The life-event data used in the study included: education and employment, as well as history of suicide attempts, psychiatric hospitalizations, medical problems, hallucinations, and paranoid ideation. Bivariate correlations were computed to explore the associations among the SA-45 scales and the validity criteria. The results indicated that the SA-45 scales demonstrated adequate convergent and divergent validity with target scales from the PAI. They were also found to be meaningfully associated with a variety of life event variables. These findings add to the emerging body of evidence corroborating the convergent and discriminant validity of the SA-45.

Extending the validity of the Personality Assessment Inventory's (PAI) Level of Care Index (LOCI) in multiple psychiatric settings.

The purpose of this study was to extend the validity and clinical application of the Level of Care Index (LOCI) from the Personality Assessment Inventory (PAI) in 2 independent psychiatric samples. In Study 1 (N = 201), the LOCI effectively differentiated level of care (inpatients from outpatients), and was also meaningfully associated with risk factors for psychiatric admission (e.g., suicidal ideation, self-harming behavior, previous psychiatric admission, etc.), even after controlling for other demographic variables (range of Cohen's ds = 0.57-1.00). Likewise, the LOCI also incremented other risk indicators (suicide and violence history) and relevant PAI indexes (i.e., Mean Clinical Elevation, and Suicide and Violence Potential) in predicting level of care, and explained an additional 6% to 12% of variance in the target variable. Diagnostic efficiency analyses indicated LOCI scores in the range of 15 to 18 optimize positive and negative predictive power, and classification rate. In Study 2 (N = 96), the LOCI was found to be significantly higher in those with a recent psychiatric admission within the past 6 months (d = 0.64), as compared to those without an admission. Similarly, those who were admitted for suicide risk had significantly higher mean LOCI scores as compared to those who did not (d = 0.70). The clinical implications of these findings and potential application of the LOCI are discussed.

Development and Initial Validation of a Brief Symptom Measure.

UNLABELLED: Self-report measures of psychiatric symptomatology are important components of treatment monitoring and service evaluation programs. However, the currently available measures have numerous limitations including being symptom or disorder specific, suited to a limited range of clinical settings, and having excessive burden. Consequently, there is a need for a brief and psychometrically robust measure of global symptomatology that is applicable across diverse clinical settings, therapeutic modalities and patient populations. This paper presents the development and initial validation of such a scale, the Brief Symptom Measure-25 (BSM-25). We report findings from multiple samples examining the reliability, validity, sensitivity to change and factor structure of the new instrument. The results suggest that the BSM-25 has good reliability, is suitable to multiple levels of care, sensitive to treatment induced change and has promising validity. Exploratory bifactor modelling revealed that all items loaded strongly on a general factor (bifactor) while also forming two minor group factors. Potential limitations of this study along with future research and clinical applications of the BSM-25 are discussed. KEY PRACTITIONER MESSAGE: The BSM-25 is a broad measure of symptom severity that is easy to administer and score, appropriate for divers patient populations, and suitable for monitoring progress in routine clinical practice.

Validation of a measure of alliance for an adolescent inpatient setting.

UNLABELLED: The link between alliance and treatment outcome is robust. Nevertheless, few, if any, self-report measures exist to assess the alliance between hospitalized adolescents and their treatment team as a whole. The present study looks to extend the use of a brief self-report measure of inpatient treatment alliance designed for adult inpatients to be used with adolescents. The scale is designed incorporating items that tap the three factors of alliance (bond, goals and collaboration) to assess the alliance that the patient has with his or her treatment team. Our results show that the Inpatient-Treatment Alliance Scale is unifactoral, shows good psychometrics and is linked in theoretically meaningful ways to global clinician ratings of engagement in individual psychotherapy. KEY PRACTITIONER MESSAGE: Inpatient treatment of adolescents requires the assessment of alliance to be between the patient and his or her treatment team rather than an individual clinician. Assessment of the alliance can benefit clinicians treating hospitalized adolescents especially because these patients are difficult to engage with in treatment. This study shows that the Inpatient-Treatment Alliance Scale is a promising measure for assessing treatment alliance on an adolescent inpatient setting.

Reliability and validity of the Symptoms of Depression Questionnaire (SDQ).

Current measures for major depressive disorder focus primarily on the assessment of depressive symptoms, while often omitting other common features. However, the presence of comorbid features in the anxiety spectrum influences outcome and may effect treatment. More comprehensive measures of depression are needed that include the assessment of symptoms in the anxiety-depression spectrum. This study examines the reliability and validity of the Symptoms of Depression Questionnaire (SDQ), which assesses irritability, anger attacks, and anxiety symptoms together with the commonly considered symptoms of depression. Analysis of the factor structure of the SDQ identified 5 subscales, including one in the anxiety-depression spectrum, with adequate internal consistency and concurrent validity. The SDQ may be a valuable new tool to better characterize depression and identify and administer more targeted interventions.

SCORS-G stimulus characteristics of select thematic apperception test cards.

There has been surprisingly little research into the stimulus properties of the Thematic Apperception Test Cards (TAT; Murray, 1943). This study used the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, 1995 ) to explore the stimulus properties of select TAT cards in a clinical sample. The SCORS-G is a theoretically based and empirically validated measure of object relations that has widely been used in TAT research. A sample of 80 patients referred for psychological assessment at a large Northeastern hospital were administered the TAT (Cards 1, 2, 3BM, 4, 13MF, 12M, and 14) as part of their assessment battery. Trained raters scored the narratives using the SCORS-G. The SCORS-G ratings were analyzed to determine the nature and degree of object representation "pull" both across and within the TAT cards. The results showed that Cards 3BM and 13MF exhibited the greatest card pull for negative pathological object representations, and Card 2 displayed the highest card pull for adaptive and mature object representations. Both clinical and research related implications are discussed.

Structure of the DSM-IV personality disorders as revealed in clinician ratings.

The revisions proposed for the DSM-5 would greatly alter how personality pathology is conceptualized, assessed, and diagnosed. One aspect of the proposed changes, elimination of four current personality disorders, has raised considerable controversy. The present study attempts to inform this debate by exploring clinicians' views of the structure of Personality Disorders using the current diagnostic system, the DSM-IV. An exploratory factor analysis was conducted on the DSM-IV Personality Disorder criteria using clinician ratings for 280 patients. The factor analysis revealed eight clear and meaningful factors. The eight factors contained all six personality disorders proposed for retention in DSM-5 but also contained clear representations of two disorders (Paranoid and Schizoid) identified for removal from the system. These conditions appear to have clinical utility and their removal may have unintended negative consequences in clinical practice. Dependent and Avoidant criteria also merged to form a new construct with interesting clinical implications. These findings provide new insights into the complex typologies clinicians employ when applying the DSM-IV system to personality disordered patients. Lastly we argue that successful refinement of clinically significant constructs, like diagnostic systems, requires a balanced appraisal of evidence for clinical utility as well as external and internal validity.

A brief inpatient measure of global psychiatric symptom severity: initial validation of the Brief Symptom Measure-25 for an adolescent inpatient sample.

Adolescent psychiatry is experiencing a growing need for brief yet psychometrically robust outcome measures for inpatient settings. Outcome measures currently available present limitations to clinicians and patients alike in terms of their excessive length, time of completion, difficulty to score, and focus on specific clusters of symptoms. The present study sought to validate the Brief Symptom Measure-25 (BSM-25) as a brief and easily administered measure of global psychiatric symptom severity in adolescent inpatient samples. This study evaluated the results from 154 adolescent inpatients who completed several self-report measures at admission. The findings demonstrate that the instrument has good construct validity when compared with validated measures of psychological health and well-being, behavioral problems, and interpersonal distress. We also showed the sensitivity to change of the BSM-25 from admission to discharge, and we showed that this healthy change was paralleled in several measures (self-reports and clinician ratings), using data from 75 adolescent psychiatric inpatients who were assessed at admission and also at discharge. Although this is only the first step in the validation of this measure for an adolescent inpatient setting, the BSM-25 shows promise as a brief outcome measure of global psychiatric symptom severity while maintaining validity and instrument sensitivity.