Deriving the Transdiagnostic Scales From the Personality Assessment Inventory and SPECTRA: Indices of Psychopathology: A Demonstration.

Transdiagnostic models of psychopathology address many of the shortcomings common to categorical diagnostic systems. These empirically derived models conceptualize psychopathology as a few broad interrelated and hierarchically arranged dimensions, with an overarching general psychopathology dimension, the p-factor, at the apex. While transdiagnostic models are gaining prominence in mental health research, the lack of available tools has limited their clinical translation. The present study explored the potential of creating transdiagnostic scales from the joint factor structure of the Personality Assessment Inventory, Alternative Model of Personality Disorder trait scales (AMPD), and the clinical scales of the SPECTRA: Indices of Psychopathology (SPECTRA). Exploratory factor analysis in a clinical sample (n = 212) identified five factors corresponding to the Negative Affect/Internalizing, Detachment, Antagonism/Externalizing, Disinhibition/Externalizing, and Thought Disorder transdiagnostic dimensions. Goldberg's "Bass-Ackward" method supported a hierarchical structure. Five composite transdiagnostic scales were created by summing each factor's highest loading PAI and SPECTRA scales. A global psychopathology scale was created by summing the five composite scales. All the composite scales demonstrated adequate internal consistency. Correlations between the composite scales and the NEO Five-Factor Inventory-3 provide initial validity evidence for four composite and global scales. The composite thought disorder scale had no conceptually corresponding NEO domain. Clinical implications and study limitations are discussed.

Using the Personality Assessment Inventory to Assess the Alternative Model for Personality Disorders: Criterion Validity in a Clinical Sample.

The Personality Assessment Inventory (PAI) is a broadband measure of psychopathology that is widely used in applied settings. Researchers developed regression-based estimates that use the PAI to measure constructs of the Alternative Model for Personality Disorders (AMPD) - a hybrid dimensional and categorical approach to conceptualizing personality disorders. Although prior work has linked these estimates to formal measures of the AMPD, there is little work investigating the clinical correlates of this scoring approach of the PAI. The current study examines associations between these PAI-based AMPD estimates and life data in a large, archival dataset of psychiatric outpatients and inpatients. We found general support for the criterion validity of AMPD estimate scores, such that a theoretically consistent pattern of associations emerged with indicators such as prior academic achievement, antisocial behavior, psychiatric history, and substance abuse. These results provide preliminary support to this scoring approach for use in clinical samples.

The Impact of Different Thematic Apperception Test Administration Methods on Narrative Length and Story Richness as Measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G).

The Thematic Apperception Test (TAT) is the second most commonly used performance-based task in clinical practice. However, traditional TAT administration is time-consuming and raises accessibility issues. This study examines the effect of administration modifications (i.e., examiner handwriting versus typing, examiner recording versus participant recording, and re-prompting versus no re-prompting) on narrative length and richness as measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G). A four-card TAT protocol was administered to 150 college students under one of five conditions. The resulting narratives were scored by two trained raters using the SCORS-G. MANOVA procedures showed (a) no significant differences between examiner handwriting versus typing; (b) the shortest, blandest narratives were produced when the examiner recorded the narratives without re-prompting; and (c) the longest, richest narratives were produced when the participant typed the narratives with re-prompts on the computer screen. Clinical and research implications and future directions will be discussed.

Psychology Internship Training Amidst COVID-19: Balancing Training Opportunities, Patient Care, and Risk of Exposure.

The emergence of the 2019 novel coronavirus (COVID-19) has dramatically altered how psychologists deliver its training. At least for the time being, virtual care has become the primary method for delivering mental health services. This has allowed patients and clinicians to continue to access and provide services in a way that would have been impossible years ago. Not only has this shift impacted patients, but it has also impacted supervision and training. The impact has been especially profound on inpatient units where the psychiatric and medical acuity is high of patients and the therapeutic milieu is an important aspect of treatment. The purpose of this paper is to review the impact of COVID-19 on pre-doctoral psychology interns during their rotation on an inpatient psychiatry unit at the start of the pandemic (January to June of 2020) and use these experiences to onboard the next class of interns in the new academic year (July 2020 to June 2021) using a hybrid model of in-person and virtual training experiences. At the end of 2020/2021 rotation, we voluntarily asked interns to complete a questionnaire that was developed based on the qualitative experiences of the previous class to assess the effectiveness of this hybrid model. We also surveyed multi-disciplinary staff members who were essential personnel and required to work in person during this time about their experiences of safety and support. With this information, we explore and offer guidance to other inpatient training sites who are likely to encounter similar challenges during this time. In particular, we discuss the integration of virtual technology into this training experience, as well as the restructuring of clinical and supervisory experiences. We highlighted several short-term strategies that we have flexibly adapted to our inpatient unit. The lessons learned herein seek to guide supervisors and trainees alike in adapting their psychology training programs to meet the evolving demands of COVID-19.

An Ecological Momentary Intervention Study of Emotional Responses to Smartphone-Prompted CBT Skills Practice and the Relationship to Clinical Outcomes.

The practice of therapeutic skills outside of sessions in which they are learned is one presumed key component of cognitive behavioral therapy (CBT). Yet, our understanding of how skills practice relates to clinical outcomes remains limited. Here, we explored patients' emotional responses to CBT skills practice in a pilot study pairing smartphone-app-delivered skills reminders and guided practice (ecological momentary intervention [EMI]) using ecological momentary assessment (EMA). Participants (n = 25) were adults recently hospitalized for a suicide attempt or severe suicidal thinking. They received brief inpatient CBT (1 to 3 sessions covering core CBT skills from the Unified Protocol), followed by 1 month of EMI and EMA after discharge. On average, participants reported modest reductions in negative affect after skills use (i.e., immediate responses; median time elapsed = 4.30 minutes). Additionally, participants tended to report less negative affect when the timepoint preceding the current assessment included EMI skills practice, rather than EMA alone (i.e., delayed responses; median time elapsed between prompts = 2.17 hours). Immediate effects were unrelated to longer-term clinical outcomes, whereas greater delayed effects were associated with lower symptom severity at follow-up. Future studies should further examine how CBT skills use in daily life may alleviate symptoms.

Longitudinal stability of Social Cognition and Object Relations Scale-Global Rating Method dimensional ratings, score ranges and narrative 'blandness' in a clinical sample.

While understanding how internalized representations of others (i.e., object relations) change over the course of treatment is essential for treatment planning and evaluation of progress, few studies have examined the nature of these changes through repeated psychological assessments. In this study, we applied the SCORS-G to Thematic Apperception Test narratives for 61 adult patients with complex psychiatric problems undergoing residential treatment over an 18-month period. Over the course of treatment, patient representations of self and others became more complex, indicating improvements in mentalization. Further, an analysis of default ratings (i.e., an aspect of story 'blandness') suggested that certain shifts in SCORS-G dimensional scores over time were accounted for by greater degree of scorable content across time points, rather than changes specific to the dimensions themselves. Findings from novel exploratory analyses aimed at evaluating the test-retest reliability of both default rating proportion and several emerging alternative scoring approaches (including changes in minimum, maximum and range of scores on individual dimensions) are reported. While the magnitude of change across mean dimensional scores was found to be lower compared to those previously found in outpatient populations, our results suggest that the SCORS-G remains capable of detecting changes in mentalization capacities in individuals contending with longstanding, severe psychiatric impairment and personality-based psychopathology. Implications for treatment, assessment and future research are discussed.

Exploring the Alternative Model for Personality Disorders Using SCORS-G Ratings on Thematic Apperception Test Narratives.

The Alternative Model for Personality Disorders (AMPD) in Section III of the fifth edition of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5; American Psychiatric Association, 2013) conceptualizes personality pathology as a combination of impairment (Criterion A) and traits (Criterion B). One measure used to develop Criterion A was the Social Cognition and Object Relations Scale - Global Rating Method (SCORS-G), which is a multidimensional, object-relational clinician-rated measure of personality functioning. Although there are conceptual links between the AMPD and SCORS-G dimensions, there exists no research examining the relationship. To address this, we examined associations between the SCORS-G dimensions and measures of the AMPD constructs in a large, archival dataset of outpatients and inpatients. More pathological scores on SCORS-G dimensions reflecting self- and interpersonal functioning were associated with greater pathological traits and impairment. Overall, results support further investigation into SCORS-G as a useful measure in AMPD research and assessment.

How narrative source impacts convergence of ratings from the Social Cognition and Object Relations Scale-Global Rating Method with psychotherapy process measures.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Westen, 1995; see also Stein & Mulford, 2018) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) in relation to patient- and therapist-rated psychotherapy process measures. Using a university-based outpatient sample (n = 81), we found limited convergence for SCORS-G ratings across narrative type. First, paired t tests showed that the means for six of the eight SCORS-G dimensions differed significantly between the EM and PT narratives with the majority having a large magnitude of effect. Moreover, despite 29 significant correlations between a SCORS-G dimension and either an alliance or session quality variable, only two of the eight SCORS-G dimensions significantly correlated with the same process variable across narrative type (e.g., patient-rated session depth with SCORS-G Self Esteem [SE] and Identity and Coherence of Self [ICS]). Importantly, the high degree of theoretical coherence in the associations that emerged between the SCORS-G dimensions and the process variables suggest that the lack of convergence was not due to limited validity of the SCORS-G. Instead, the results underscore the importance of multi-method assessment techniques by highlighting that the manner in which a narrative is elicited will impact the object relational content patients provide. Future research and clinical implications related to the SCORS-G, alliance and psychotherapy process are discussed.

External correlates of the SPECTRA: Indices of psychopathology (SPECTRA) in a clinical sample.

The SPECTRA: Indices of Psychopathology is a broadband assessment inventory compatible with contemporary hierarchical models of psychopathology (internalizing, externalizing, reality impairing dimensions and global psychopathology factor). This study explored the SPECTRA's construct validity using a wide range of life event (extra-test) variables in a clinical sample. The life event variables included the following: education level, school failure, childhood adversity, suicide attempts, psychiatric hospitalizations, depression, psychotic symptoms, self-injury, substance abuse, arrests, physical violence, marital status, employment status and current medications. Results showed that all SPECTRA clinical scales had significant life event correlations. For the higher-order Spectra scales, the global index of psychopathology had the greatest number and range of life event correlations. Correlations for the externalizing and reality impairing Spectra scales provided solid validity evidence, while correlations for the internalizing Spectra scale were more diffuse. These findings provide the first non-test-based evidence of construct validity for the SPECTRA.

Card pull effects of the Thematic Apperception Test using the Social Cognition and Object Relations-Global Rating Method on complex psychiatric sample.

In recent years, there has been growing interest in examining the stimulus pull effects on respondent narratives to the Thematic Apperception Test (Murray, 1943) using standardized coding methods such as the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995). The present study expands on prior work by examining sources of variance in SCORS-G dimensions and card pull effect patterns in an adult clinical sample characterized by high psychiatric comorbidity and clinical severity. A sample of 158 adult psychiatric patients in long-term residential treatment provided narratives to 10 TAT cards (five of which have not previously been studied for pull effects). Cards 2 and 7BM pulled for significantly more adaptive narratives (positive pull), whereas Card 13MF pulled for more pathological stories (negative pull). Like prior studies, variance in cognitive dimensions of the SCORS-G was most explained by person effects, whereas the largest source of variance for all other dimensions was best explained by a combination of the card and the person effects on the narrative. Finally, exploratory analyses of card pull effects within different gender groups were conducted. The implications of these findings for performance-based future studies and possible clinical applications of card pull findings are discussed.

Do Patterns and Types of Negative Affect During Hospitalization Predict Short-Term Post-Discharge Suicidal Thoughts and Behaviors?

We still have little understanding of short-term predictors of suicidal thoughts and behaviors (STBs). Prior research links increased negative affect to STBs, but the vast majority of earlier work is limited by measuring negative affect at one time point and aiming to predict STBs months or years in the future. Recently, intensive longitudinal studies have shown that negative affect is associated with suicidal thoughts over relatively short, clinically useful time periods; however, the specific patterns and types of negative affect that predict STBs remain unclear. Using ecological momentary assessment (EMA) data from psychiatric inpatients hospitalized for suicide risk (N = 83), this study sought to test whether the patterns (means and variability) of two types of negative affect (anxiety/agitation and shame/self-hatred, which were derived from a larger EMA battery) during hospitalization predict STBs in the four weeks after discharge: an extremely high-risk time for suicidal behavior. The mean - but not the variability - of both anxiety/agitation and shame/self-hatred during hospitalization predicted the number of days with suicidal thoughts after discharge. The mean and the variability of shame/self-hatred - but not anxiety/agitation - predicted post-discharge suicide attempt. We discuss implications for assessment and treatment of suicidal individuals and propose key directions for future research.

Are all narratives the same: Convergent and discriminant validity of the Social Cognition and Object Relations Scale-Global Rating Method across two narrative types.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) using a university-based outpatient sample (n = 101). First, we examined intercorrelations between SCORS-G ratings of EM and PT. Intercorrelations between SCORS-G EM and PT revealed that three of the dimensions significantly correlated with themselves across narrative type (Emotional Investment in Relationships [EIR], Experience and Management of Aggressive Impulses [AGG], and Self-Esteem [SE]), but that only AGG had its strongest correlation with itself (i.e., EM AGG to PT AGG). In addition, EM AGG was significantly related to all but one of the PT SCORS-G dimensions. Likewise, EM SE correlated with all but two of the PT SCORS-G dimensions. Second, we examined how narrative source related to clinical findings. With the use of a multimethod approach, we assessed how SCORS-G ratings from both narrative types correlated with selected variables from the Personality Assessment Inventory (PAI) and Rorschach Inkblot Test. Findings indicated that there were only three instances in which both narrative types had significant relationships to the same variable/scale, and all three instances were with the Rorschach. Together, these findings suggest that even when using the same scale (SCORS-G), different narrative sources differentially activate aspects of object relations. In addition, the results highlight that difficulties with self-esteem and poor management of aggression in childhood interactions relates to patients' object relational functioning later in life. Clinical implications and future research are discussed.

When's a story a story? Determining interpretability of Social Cognition and Object Relations Scale-Global ratings on Thematic Apperception Test narratives.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) measures the quality of object relations in narrative material. The reliability and validity of this measure have been well established. However, a psychometric oddity of this scale is that default ratings are given to select dimensions when the relevant construct is not present. This can result in narrative 'blandness' and may impact clinical findings. The aim of these two studies is to understand these phenomena both psychometrically and clinically. In the first study, we identified 276 outpatients who had SCORS-G ratings for TAT Cards 1, 2, 3BM, and 14, set criteria for narrative 'blandness' across all eight dimensions, and examined group differences. In Study 2, we used a subset (N = 99) of Study 1 and examined how percentage of formal default ratings for Emotional Investment in Values and Moral Standards (EIM), Experience and Management of Aggressive Impulses (AGG), Self-Esteem(SE), and Identify and Coherence of Self (ICS) impacted robustness of correlations across tests of intelligence, psychopathology, and normal personality functioning. Taken together, we identified clinical characteristics of patients who are more likely to produce 'bland' narratives and increased percentages of formal default ratings. Also, an excess of default ratings per protocol impacts robustness of correlations and weakens significant correlations. As cut-off scores increase (>25% and >28.12%), the likelihood of being able to interpret EIM, AGG, SE, and ICS decreases. Psychometric and clinical implications are discussed.

The relationship between trainee therapist traits with the use of self-disclosure and immediacy in psychotherapy.

The goal of the present study was to explore how self-disclosure (SD) and immediacy relate to trainee therapists' personal characteristics. A prospective multitrait multimethod assessment approach was utilized to assess a wide range of trainee characteristics at the beginning of graduate school. Results showed a significant, positive relationship between trainee interpersonal problems and SD for trainees (n = 33) in their third psychotherapy session with their first patient. Moreover, greater use of SD correlated with less session depth, as rated by the trainee. Greater use of immediacy was positively related to trainee undergraduate grade point average and trainee-reported post-session arousal. Notably, all statistically significant findings had a moderate magnitude of effect. Finally, qualitative analyses of the SDs and immediacy statements were included to aid the discussion of potential reasons for the results. Overall, our findings provide preliminary conclusions about which trainees utilize SD and immediacy, what types of SDs and immediacy interventions they tend to use, and how trainees and patients perceived the session in which SD and immediacy were implemented. Implications for supervision and training are discussed. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Introduction to the Special Section on the Social Cognition and Object Relations Scale-Global Rating Method: From Research to Practice.

There continues to be a need in the field of psychology for measures that quantify qualitative data in dynamically rich and clinically meaningful ways. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Westen, 1995) is a clinician-rated measure with a strong theoretical foundation that assesses sophisticated underlying constructs, specifically 8 dimensions of object relations (Stein & Slavin-Mulford, 2018 ). The SCORS-G has steadily increased in popularity and this special section of the Journal of Personality Assessment reflects this growing interest. In this introduction, we provide readers with a brief overview of the 5 articles in this special section and note ways in which they reflect and build on the existing SCORS-G empirical literature. Contextualizing these articles within the broader literature allows us to highlight how the measure is employed in clinical and research settings. Each of these 5 articles also highlights areas and opportunities for future research that would address gaps in the SCORS-G literature and strengthen the utility of the measure. We close by noting how each of studies can be seen as a model for future lines of research.

Extending the Use of the SCORS-G Composite Ratings in Assessing Level of Personality Organization.

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, 1995b ) reliably measures the quality of object relations in narrative material. It assesses 8 dimensions (on a continuum from maladaptive to adaptive) that mediate interpersonal functioning. The 8 dimensions can be averaged to create a global or composite score to represent a person's overall object relational functioning. This study aimed to create levels of personality organization using the SCORS-G global score ratings of Thematic Apperception Test (TAT) narratives and to explore the construct validity of these levels using a multimethod approach (i.e., psychopathology, normal personality, and life-event data). Meaningful relationships were found between the SCORS-G level of personality organization and aspects of psychopathology (Personality Assessment Inventory; Morey, 1991 ), regulation and control (NEO Five-Factor Inventory; Costa & McCrae, 1989, 1992b ), and number of psychiatric hospitalizations, suicide attempts, and educational level. Overall, this study demonstrates the potential value of creating levels of personality organization (LPO) using the SCORS-G composite or global ratings as a supplement to the psychological assessment process and further highlights the utility of this measure in the field of personality assessment. Clinical and research-related implications as well as limitations are discussed.

External validity of the Psychiatric Diagnostic Screening Questionnaire (PDSQ) in a clinical sample.

This study contributes to the convergent and discriminant validity of the Psychiatric Diagnostic Screening Questionnaire (PDSQ) by investigating its correlations with the relevant clinical scales of the Personality Assessment Inventory (PAI) and life space variables, such as relationship status, education level, job loss, and history of suicide attempts. Bivariate correlations were calculated for a sample of 254 psychiatric outpatients. The results indicated that the PDSQ scales demonstrated good to excellent convergent and discriminant validity with target scales from the PAI. They were also found to be meaningfully associated with a variety of life space variables. For example, five of the subscales and the Total Score correlated positively with a recent job loss, and eight of the subscales were negatively associated with education and/or employment status. Some incongruence with hypothesized relationships was discovered for life correlates classified as markers of psychiatric severity. Overall, these findings add to the emerging body of evidence corroborating the convergent and discriminant validity of the PDSQ.

Estimating the Effects of Thematic Apperception Test Card Content on SCORS-G Ratings: Replication With a Nonclinical Sample.

The content of Thematic Apperception Test (TAT) cards can, in some cases, influence how respondents form narratives. This study examines how imagery from select TAT cards affects the narratives of respondents from a nonclinical setting. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011 ; Westen, Lohr, Silk, Kerber, & Goodrich, 1989) was used to rate narratives. Forty-nine college students provided narratives to 6 TAT cards. Narratives were rated by two expert raters using the SCORS-G. Consistent with prior research, Card 2 exhibited the most pull for adaptive ratings on SCORS-G scales, and 3 BM exhibited the most pull for maladaptive ratings. Findings for other cards were mixed. Although raters were highly reliable, internal consistency estimates were lower than desirable for 6 of the 8 SCORS-G scales. Variance component estimates indicated that card by person interactions accounted for the largest amount of variance in person-level scores. Results and limitations are discussed in light of prior research. We also make suggestions for further lines of research in this area.

Neuropsychological functioning and profile validity on the Personality Assessment Inventory (PAI): An investigation in multiple psychiatric settings.

Psychologists in medical settings are frequently tasked with providing comprehensive evaluations of patients with complex medical and psychiatric conditions. In order to achieve these aims, standardized measures of neurocognitive and psychological functioning are often employed to empirically assess a patient's level of functioning across an array of relevant clinical domains. However, less is known about the degree to which cognitive impairment affects a patient's ability to complete these more comprehensive assessments, raising questions about test validity. The current study sought to contribute to this growing body of literature by examining whether neurocognitive functioning is associated with profile validity on the Personality Assessment Inventory (PAI) in both outpatient (N = 321) and inpatient (N = 131) psychiatric settings. In Study 1, results indicate that while multiple cognitive domains are associated with overall profile validity in psychiatric outpatients, attentional impairment specifically was found to be a significant predictor of profile invalidity after accounting for the effects of overall intellectual functioning (accounting for 13% of the variance overall). The magnitude of attentional impairment specifically, and number of impaired cognitive domains more generally, were also found to be meaningfully associated with overall profile validity. Likewise, in Study 2, PAI profile validity was found to be meaningfully associated with gross cognitive impairment on the WMS-IV Brief Cognitive Status Examination (BCSE) in an inpatient psychiatric setting, with almost half of the patients in the most impaired group yielding invalid PAI profiles. The clinical implications of these findings are discussed.

Extending the validity of the Personality Assessment Inventory's (PAI) Level of Care Index (LOCI) in multiple psychiatric settings.

The purpose of this study was to extend the validity and clinical application of the Level of Care Index (LOCI) from the Personality Assessment Inventory (PAI) in 2 independent psychiatric samples. In Study 1 (N = 201), the LOCI effectively differentiated level of care (inpatients from outpatients), and was also meaningfully associated with risk factors for psychiatric admission (e.g., suicidal ideation, self-harming behavior, previous psychiatric admission, etc.), even after controlling for other demographic variables (range of Cohen's ds = 0.57-1.00). Likewise, the LOCI also incremented other risk indicators (suicide and violence history) and relevant PAI indexes (i.e., Mean Clinical Elevation, and Suicide and Violence Potential) in predicting level of care, and explained an additional 6% to 12% of variance in the target variable. Diagnostic efficiency analyses indicated LOCI scores in the range of 15 to 18 optimize positive and negative predictive power, and classification rate. In Study 2 (N = 96), the LOCI was found to be significantly higher in those with a recent psychiatric admission within the past 6 months (d = 0.64), as compared to those without an admission. Similarly, those who were admitted for suicide risk had significantly higher mean LOCI scores as compared to those who did not (d = 0.70). The clinical implications of these findings and potential application of the LOCI are discussed.