Using the Personality Assessment Inventory to Assess the Alternative Model for Personality Disorders: Criterion Validity in a Clinical Sample.

The Personality Assessment Inventory (PAI) is a broadband measure of psychopathology that is widely used in applied settings. Researchers developed regression-based estimates that use the PAI to measure constructs of the Alternative Model for Personality Disorders (AMPD) - a hybrid dimensional and categorical approach to conceptualizing personality disorders. Although prior work has linked these estimates to formal measures of the AMPD, there is little work investigating the clinical correlates of this scoring approach of the PAI. The current study examines associations between these PAI-based AMPD estimates and life data in a large, archival dataset of psychiatric outpatients and inpatients. We found general support for the criterion validity of AMPD estimate scores, such that a theoretically consistent pattern of associations emerged with indicators such as prior academic achievement, antisocial behavior, psychiatric history, and substance abuse. These results provide preliminary support to this scoring approach for use in clinical samples.

Deriving the Transdiagnostic Scales From the Personality Assessment Inventory and SPECTRA: Indices of Psychopathology: A Demonstration.

Transdiagnostic models of psychopathology address many of the shortcomings common to categorical diagnostic systems. These empirically derived models conceptualize psychopathology as a few broad interrelated and hierarchically arranged dimensions, with an overarching general psychopathology dimension, the p-factor, at the apex. While transdiagnostic models are gaining prominence in mental health research, the lack of available tools has limited their clinical translation. The present study explored the potential of creating transdiagnostic scales from the joint factor structure of the Personality Assessment Inventory, Alternative Model of Personality Disorder trait scales (AMPD), and the clinical scales of the SPECTRA: Indices of Psychopathology (SPECTRA). Exploratory factor analysis in a clinical sample (n = 212) identified five factors corresponding to the Negative Affect/Internalizing, Detachment, Antagonism/Externalizing, Disinhibition/Externalizing, and Thought Disorder transdiagnostic dimensions. Goldberg's "Bass-Ackward" method supported a hierarchical structure. Five composite transdiagnostic scales were created by summing each factor's highest loading PAI and SPECTRA scales. A global psychopathology scale was created by summing the five composite scales. All the composite scales demonstrated adequate internal consistency. Correlations between the composite scales and the NEO Five-Factor Inventory-3 provide initial validity evidence for four composite and global scales. The composite thought disorder scale had no conceptually corresponding NEO domain. Clinical implications and study limitations are discussed.

The Impact of Different Thematic Apperception Test Administration Methods on Narrative Length and Story Richness as Measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G).

The Thematic Apperception Test (TAT) is the second most commonly used performance-based task in clinical practice. However, traditional TAT administration is time-consuming and raises accessibility issues. This study examines the effect of administration modifications (i.e., examiner handwriting versus typing, examiner recording versus participant recording, and re-prompting versus no re-prompting) on narrative length and richness as measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G). A four-card TAT protocol was administered to 150 college students under one of five conditions. The resulting narratives were scored by two trained raters using the SCORS-G. MANOVA procedures showed (a) no significant differences between examiner handwriting versus typing; (b) the shortest, blandest narratives were produced when the examiner recorded the narratives without re-prompting; and (c) the longest, richest narratives were produced when the participant typed the narratives with re-prompts on the computer screen. Clinical and research implications and future directions will be discussed.

Psychology Internship Training Amidst COVID-19: Balancing Training Opportunities, Patient Care, and Risk of Exposure.

The emergence of the 2019 novel coronavirus (COVID-19) has dramatically altered how psychologists deliver its training. At least for the time being, virtual care has become the primary method for delivering mental health services. This has allowed patients and clinicians to continue to access and provide services in a way that would have been impossible years ago. Not only has this shift impacted patients, but it has also impacted supervision and training. The impact has been especially profound on inpatient units where the psychiatric and medical acuity is high of patients and the therapeutic milieu is an important aspect of treatment. The purpose of this paper is to review the impact of COVID-19 on pre-doctoral psychology interns during their rotation on an inpatient psychiatry unit at the start of the pandemic (January to June of 2020) and use these experiences to onboard the next class of interns in the new academic year (July 2020 to June 2021) using a hybrid model of in-person and virtual training experiences. At the end of 2020/2021 rotation, we voluntarily asked interns to complete a questionnaire that was developed based on the qualitative experiences of the previous class to assess the effectiveness of this hybrid model. We also surveyed multi-disciplinary staff members who were essential personnel and required to work in person during this time about their experiences of safety and support. With this information, we explore and offer guidance to other inpatient training sites who are likely to encounter similar challenges during this time. In particular, we discuss the integration of virtual technology into this training experience, as well as the restructuring of clinical and supervisory experiences. We highlighted several short-term strategies that we have flexibly adapted to our inpatient unit. The lessons learned herein seek to guide supervisors and trainees alike in adapting their psychology training programs to meet the evolving demands of COVID-19.

Longitudinal stability of Social Cognition and Object Relations Scale-Global Rating Method dimensional ratings, score ranges and narrative 'blandness' in a clinical sample.

While understanding how internalized representations of others (i.e., object relations) change over the course of treatment is essential for treatment planning and evaluation of progress, few studies have examined the nature of these changes through repeated psychological assessments. In this study, we applied the SCORS-G to Thematic Apperception Test narratives for 61 adult patients with complex psychiatric problems undergoing residential treatment over an 18-month period. Over the course of treatment, patient representations of self and others became more complex, indicating improvements in mentalization. Further, an analysis of default ratings (i.e., an aspect of story 'blandness') suggested that certain shifts in SCORS-G dimensional scores over time were accounted for by greater degree of scorable content across time points, rather than changes specific to the dimensions themselves. Findings from novel exploratory analyses aimed at evaluating the test-retest reliability of both default rating proportion and several emerging alternative scoring approaches (including changes in minimum, maximum and range of scores on individual dimensions) are reported. While the magnitude of change across mean dimensional scores was found to be lower compared to those previously found in outpatient populations, our results suggest that the SCORS-G remains capable of detecting changes in mentalization capacities in individuals contending with longstanding, severe psychiatric impairment and personality-based psychopathology. Implications for treatment, assessment and future research are discussed.

External correlates of the SPECTRA: Indices of psychopathology (SPECTRA) in a clinical sample.

The SPECTRA: Indices of Psychopathology is a broadband assessment inventory compatible with contemporary hierarchical models of psychopathology (internalizing, externalizing, reality impairing dimensions and global psychopathology factor). This study explored the SPECTRA's construct validity using a wide range of life event (extra-test) variables in a clinical sample. The life event variables included the following: education level, school failure, childhood adversity, suicide attempts, psychiatric hospitalizations, depression, psychotic symptoms, self-injury, substance abuse, arrests, physical violence, marital status, employment status and current medications. Results showed that all SPECTRA clinical scales had significant life event correlations. For the higher-order Spectra scales, the global index of psychopathology had the greatest number and range of life event correlations. Correlations for the externalizing and reality impairing Spectra scales provided solid validity evidence, while correlations for the internalizing Spectra scale were more diffuse. These findings provide the first non-test-based evidence of construct validity for the SPECTRA.

How narrative source impacts convergence of ratings from the Social Cognition and Object Relations Scale-Global Rating Method with psychotherapy process measures.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Westen, 1995; see also Stein & Mulford, 2018) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) in relation to patient- and therapist-rated psychotherapy process measures. Using a university-based outpatient sample (n = 81), we found limited convergence for SCORS-G ratings across narrative type. First, paired t tests showed that the means for six of the eight SCORS-G dimensions differed significantly between the EM and PT narratives with the majority having a large magnitude of effect. Moreover, despite 29 significant correlations between a SCORS-G dimension and either an alliance or session quality variable, only two of the eight SCORS-G dimensions significantly correlated with the same process variable across narrative type (e.g., patient-rated session depth with SCORS-G Self Esteem [SE] and Identity and Coherence of Self [ICS]). Importantly, the high degree of theoretical coherence in the associations that emerged between the SCORS-G dimensions and the process variables suggest that the lack of convergence was not due to limited validity of the SCORS-G. Instead, the results underscore the importance of multi-method assessment techniques by highlighting that the manner in which a narrative is elicited will impact the object relational content patients provide. Future research and clinical implications related to the SCORS-G, alliance and psychotherapy process are discussed.

Are all narratives the same: Convergent and discriminant validity of the Social Cognition and Object Relations Scale-Global Rating Method across two narrative types.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) using a university-based outpatient sample (n = 101). First, we examined intercorrelations between SCORS-G ratings of EM and PT. Intercorrelations between SCORS-G EM and PT revealed that three of the dimensions significantly correlated with themselves across narrative type (Emotional Investment in Relationships [EIR], Experience and Management of Aggressive Impulses [AGG], and Self-Esteem [SE]), but that only AGG had its strongest correlation with itself (i.e., EM AGG to PT AGG). In addition, EM AGG was significantly related to all but one of the PT SCORS-G dimensions. Likewise, EM SE correlated with all but two of the PT SCORS-G dimensions. Second, we examined how narrative source related to clinical findings. With the use of a multimethod approach, we assessed how SCORS-G ratings from both narrative types correlated with selected variables from the Personality Assessment Inventory (PAI) and Rorschach Inkblot Test. Findings indicated that there were only three instances in which both narrative types had significant relationships to the same variable/scale, and all three instances were with the Rorschach. Together, these findings suggest that even when using the same scale (SCORS-G), different narrative sources differentially activate aspects of object relations. In addition, the results highlight that difficulties with self-esteem and poor management of aggression in childhood interactions relates to patients' object relational functioning later in life. Clinical implications and future research are discussed.

Card pull effects of the Thematic Apperception Test using the Social Cognition and Object Relations-Global Rating Method on complex psychiatric sample.

In recent years, there has been growing interest in examining the stimulus pull effects on respondent narratives to the Thematic Apperception Test (Murray, 1943) using standardized coding methods such as the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995). The present study expands on prior work by examining sources of variance in SCORS-G dimensions and card pull effect patterns in an adult clinical sample characterized by high psychiatric comorbidity and clinical severity. A sample of 158 adult psychiatric patients in long-term residential treatment provided narratives to 10 TAT cards (five of which have not previously been studied for pull effects). Cards 2 and 7BM pulled for significantly more adaptive narratives (positive pull), whereas Card 13MF pulled for more pathological stories (negative pull). Like prior studies, variance in cognitive dimensions of the SCORS-G was most explained by person effects, whereas the largest source of variance for all other dimensions was best explained by a combination of the card and the person effects on the narrative. Finally, exploratory analyses of card pull effects within different gender groups were conducted. The implications of these findings for performance-based future studies and possible clinical applications of card pull findings are discussed.

When's a story a story? Determining interpretability of Social Cognition and Object Relations Scale-Global ratings on Thematic Apperception Test narratives.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) measures the quality of object relations in narrative material. The reliability and validity of this measure have been well established. However, a psychometric oddity of this scale is that default ratings are given to select dimensions when the relevant construct is not present. This can result in narrative 'blandness' and may impact clinical findings. The aim of these two studies is to understand these phenomena both psychometrically and clinically. In the first study, we identified 276 outpatients who had SCORS-G ratings for TAT Cards 1, 2, 3BM, and 14, set criteria for narrative 'blandness' across all eight dimensions, and examined group differences. In Study 2, we used a subset (N = 99) of Study 1 and examined how percentage of formal default ratings for Emotional Investment in Values and Moral Standards (EIM), Experience and Management of Aggressive Impulses (AGG), Self-Esteem(SE), and Identify and Coherence of Self (ICS) impacted robustness of correlations across tests of intelligence, psychopathology, and normal personality functioning. Taken together, we identified clinical characteristics of patients who are more likely to produce 'bland' narratives and increased percentages of formal default ratings. Also, an excess of default ratings per protocol impacts robustness of correlations and weakens significant correlations. As cut-off scores increase (>25% and >28.12%), the likelihood of being able to interpret EIM, AGG, SE, and ICS decreases. Psychometric and clinical implications are discussed.

Introduction to the Special Section on the Social Cognition and Object Relations Scale-Global Rating Method: From Research to Practice.

There continues to be a need in the field of psychology for measures that quantify qualitative data in dynamically rich and clinically meaningful ways. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Westen, 1995) is a clinician-rated measure with a strong theoretical foundation that assesses sophisticated underlying constructs, specifically 8 dimensions of object relations (Stein & Slavin-Mulford, 2018 ). The SCORS-G has steadily increased in popularity and this special section of the Journal of Personality Assessment reflects this growing interest. In this introduction, we provide readers with a brief overview of the 5 articles in this special section and note ways in which they reflect and build on the existing SCORS-G empirical literature. Contextualizing these articles within the broader literature allows us to highlight how the measure is employed in clinical and research settings. Each of these 5 articles also highlights areas and opportunities for future research that would address gaps in the SCORS-G literature and strengthen the utility of the measure. We close by noting how each of studies can be seen as a model for future lines of research.

Extending the Use of the SCORS-G Composite Ratings in Assessing Level of Personality Organization.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, 1995b ) reliably measures the quality of object relations in narrative material. It assesses 8 dimensions (on a continuum from maladaptive to adaptive) that mediate interpersonal functioning. The 8 dimensions can be averaged to create a global or composite score to represent a person's overall object relational functioning. This study aimed to create levels of personality organization using the SCORS-G global score ratings of Thematic Apperception Test (TAT) narratives and to explore the construct validity of these levels using a multimethod approach (i.e., psychopathology, normal personality, and life-event data). Meaningful relationships were found between the SCORS-G level of personality organization and aspects of psychopathology (Personality Assessment Inventory; Morey, 1991 ), regulation and control (NEO Five-Factor Inventory; Costa & McCrae, 1989, 1992b ), and number of psychiatric hospitalizations, suicide attempts, and educational level. Overall, this study demonstrates the potential value of creating levels of personality organization (LPO) using the SCORS-G composite or global ratings as a supplement to the psychological assessment process and further highlights the utility of this measure in the field of personality assessment. Clinical and research-related implications as well as limitations are discussed.

Estimating the Effects of Thematic Apperception Test Card Content on SCORS-G Ratings: Replication With a Nonclinical Sample.

The content of Thematic Apperception Test (TAT) cards can, in some cases, influence how respondents form narratives. This study examines how imagery from select TAT cards affects the narratives of respondents from a nonclinical setting. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, Lohr, Silk, Kerber, & Goodrich, 1989) was used to rate narratives. Forty-nine college students provided narratives to 6 TAT cards. Narratives were rated by two expert raters using the SCORS-G. Consistent with prior research, Card 2 exhibited the most pull for adaptive ratings on SCORS-G scales, and 3 BM exhibited the most pull for maladaptive ratings. Findings for other cards were mixed. Although raters were highly reliable, internal consistency estimates were lower than desirable for 6 of the 8 SCORS-G scales. Variance component estimates indicated that card by person interactions accounted for the largest amount of variance in person-level scores. Results and limitations are discussed in light of prior research. We also make suggestions for further lines of research in this area.

Extending the validity of the Personality Assessment Inventory's (PAI) Level of Care Index (LOCI) in multiple psychiatric settings.

The purpose of this study was to extend the validity and clinical application of the Level of Care Index (LOCI) from the Personality Assessment Inventory (PAI) in 2 independent psychiatric samples. In Study 1 (N = 201), the LOCI effectively differentiated level of care (inpatients from outpatients), and was also meaningfully associated with risk factors for psychiatric admission (e.g., suicidal ideation, self-harming behavior, previous psychiatric admission, etc.), even after controlling for other demographic variables (range of Cohen's ds = 0.57-1.00). Likewise, the LOCI also incremented other risk indicators (suicide and violence history) and relevant PAI indexes (i.e., Mean Clinical Elevation, and Suicide and Violence Potential) in predicting level of care, and explained an additional 6% to 12% of variance in the target variable. Diagnostic efficiency analyses indicated LOCI scores in the range of 15 to 18 optimize positive and negative predictive power, and classification rate. In Study 2 (N = 96), the LOCI was found to be significantly higher in those with a recent psychiatric admission within the past 6 months (d = 0.64), as compared to those without an admission. Similarly, those who were admitted for suicide risk had significantly higher mean LOCI scores as compared to those who did not (d = 0.70). The clinical implications of these findings and potential application of the LOCI are discussed.

Clinical validity of a dimensional assessment of self- and interpersonal functioning in adolescent inpatients.

The Social Cognition and Object Relations Scale-Global Version (SCORS-G) is a clinical rating system assessing 8 domains of self- and interpersonal relational experience that can be applied to narrative response data (e.g., Thematic Apperception Test [TAT; Murray, 1943], early memories narratives) or oral data (e.g., psychotherapy narratives, relationship anecdotal paradigms). In this study, 72 psychiatrically hospitalized adolescents consented and were rated by their individual and group therapist using the SCORS-G. Clinicians also rated therapy engagement, personality functioning, quality of peer relationships, school functioning, global assessment of functioning (GAF), history of eating-disordered behavior, and history of nonsuicidal self-injury. SCORS-G composite ratings achieved an acceptable level of interrater reliability and were associated with theoretically predicted variables (e.g., engagement in therapy, history of nonsuicidal self-injury). SCORS-G ratings also incrementally improved the prediction of therapy engagement and global functioning beyond what was accounted for by GAF scores. This study further demonstrates the clinical utility of the SCORS-G with adolescents.

SCORS-G stimulus characteristics of select thematic apperception test cards.

There has been surprisingly little research into the stimulus properties of the Thematic Apperception Test Cards (TAT; Murray, 1943). This study used the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, 1995 ) to explore the stimulus properties of select TAT cards in a clinical sample. The SCORS-G is a theoretically based and empirically validated measure of object relations that has widely been used in TAT research. A sample of 80 patients referred for psychological assessment at a large Northeastern hospital were administered the TAT (Cards 1, 2, 3BM, 4, 13MF, 12M, and 14) as part of their assessment battery. Trained raters scored the narratives using the SCORS-G. The SCORS-G ratings were analyzed to determine the nature and degree of object representation "pull" both across and within the TAT cards. The results showed that Cards 3BM and 13MF exhibited the greatest card pull for negative pathological object representations, and Card 2 displayed the highest card pull for adaptive and mature object representations. Both clinical and research related implications are discussed.

Exploring the construct validity of the social cognition and object relations scale in a clinical sample.

The Social Cognition and Object Relations Scale-Global rating method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) measures the quality of object relations in narrative material. This study employed a multimethod approach to explore the structure and construct validity of the SCORS-G. The Thematic Apperception Test (TAT; Murray, 1943) was administered to 59 patients referred for psychological assessment at a large Northeastern U.S. hospital. The resulting 301 TAT narratives were rated using the SCORS-G method. The 8 SCORS variables were found to have high interrater reliability and good internal consistency. Principal components analysis revealed a 3-component solution with components tapping emotions/affect regulation in relationships, self-image, and aspects of cognition. Next, the construct validity of the SCORS-G components was explored using measures of intellectual and executive functioning, psychopathology, and normal personality. The 3 SCORS-G components showed unique and theoretically meaningful relationships across these broad and diverse psychological measures. This study demonstrates the value of using a standardized scoring method, like the SCORS-G, to reveal the rich and complex nature of narrative material.

Exploring the Alternative Model for Personality Disorders Using SCORS-G Ratings on Thematic Apperception Test Narratives.

The Alternative Model for Personality Disorders (AMPD) in Section III of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013) conceptualizes personality pathology as a combination of impairment (Criterion A) and traits (Criterion B). One measure used to develop Criterion A was the Social Cognition and Object Relations Scale - Global Rating Method (SCORS-G), which is a multidimensional, object-relational clinician-rated measure of personality functioning. Although there are conceptual links between the AMPD and SCORS-G dimensions, there exists no research examining the relationship. To address this, we examined associations between the SCORS-G dimensions and measures of the AMPD constructs in a large, archival dataset of outpatients and inpatients. More pathological scores on SCORS-G dimensions reflecting self- and interpersonal functioning were associated with greater pathological traits and impairment. Overall, results support further investigation into SCORS-G as a useful measure in AMPD research and assessment.

An Ecological Momentary Intervention Study of Emotional Responses to Smartphone-Prompted CBT Skills Practice and the Relationship to Clinical Outcomes.

The practice of therapeutic skills outside of sessions in which they are learned is one presumed key component of cognitive behavioral therapy (CBT). Yet, our understanding of how skills practice relates to clinical outcomes remains limited. Here, we explored patients' emotional responses to CBT skills practice in a pilot study pairing smartphone-app-delivered skills reminders and guided practice (ecological momentary intervention [EMI]) using ecological momentary assessment (EMA). Participants (n = 25) were adults recently hospitalized for a suicide attempt or severe suicidal thinking. They received brief inpatient CBT (1 to 3 sessions covering core CBT skills from the Unified Protocol), followed by 1 month of EMI and EMA after discharge. On average, participants reported modest reductions in negative affect after skills use (i.e., immediate responses; median time elapsed = 4.30 minutes). Additionally, participants tended to report less negative affect when the timepoint preceding the current assessment included EMI skills practice, rather than EMA alone (i.e., delayed responses; median time elapsed between prompts = 2.17 hours). Immediate effects were unrelated to longer-term clinical outcomes, whereas greater delayed effects were associated with lower symptom severity at follow-up. Future studies should further examine how CBT skills use in daily life may alleviate symptoms.

Relationship between the Social Cognition and Object Relations Scale (SCORS) and attachment style in a clinical sample.

This present study examined the relationship between the Social Cognition and Object Relations Scale (SCORS) and two measures of adult attachment: the Relationship Questionnaire (RQ) and the Experiences in Close Relationships Questionnaire-Revised (ECR-R). Forty-five patients (76% female) at a university-based outpatient treatment clinic participated in this study. We hypothesized that higher levels of attachment security would be associated with higher, more adaptive ratings on the SCORS variables. Results indicated that the SCORS Self-Esteem (SE) variable was significantly positively related to the RQ's Secure Attachment ratings and negatively related with the ECR-R's Anxious Attachment scale. Additionally, negative trends were noted between SE and the RQ's Fearful and Preoccupied Attachment scores. The SCORS Emotional Investments in Relationships and Affective Quality of Representations variables were associated with higher Secure scores and lower, more maladaptive Preoccupied scores on the RQ. It was also associated with greater attachment anxiety as measured by the ECR-R. Using both clinician (SCORS) and participant-rated measures (ECR-R and RQ), this study provides further understanding on how object representations and attachment style relate within a clinical sample. Results are discussed in light of prior research examining relationships between object relations and adult attachments, and clinical implications are also reviewed. Copyright © 2010 John Wiley & Sons, Ltd. Key Practitioner Message: • Individuals with higher levels of attachment anxiety may enter therapy with more self-image problems. • Individuals with higher levels of attachment anxiety may enter therapy with more maladaptive expectations about relationships. • Patients who endorse high levels of attachment anxiety (e.g., fearful and preoccupied) may be more likely to present with Axis II complaints. • Examining a patient's attachment style and object relations using different measures of assessment (e.g., explicit and implicit) can help gain a deeper and more comprehensive understanding of a patient.