Object Relations Scale-Global Rating Method Research Articles

The Impact of Different Thematic Apperception Test Administration Methods on Narrative Length and Story Richness as Measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G)

The Thematic Apperception Test (TAT) is the second most commonly used performance-based task in clinical practice. However, traditional TAT administration is time-consuming and raises accessibility issues. This study examines the effect of administration modifications (i.e., examiner handwriting versus typing, examiner recording versus participant recording, and re-prompting versus no re-prompting) on narrative length and richness as measured by the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G). A four-card TAT protocol was administered to 150 college students under one of five conditions. The resulting narratives were scored by two trained raters using the SCORS-G. MANOVA procedures showed (a) no significant differences between examiner handwriting versus typing; (b) the shortest, blandest narratives were produced when the examiner recorded the narratives without re-prompting; and (c) the longest, richest narratives were produced when the participant typed the narratives with re-prompts on the computer screen. Clinical and research implications and future directions will be discussed.

Longitudinal stability of Social Cognition and Object Relations Scale-Global Rating Method dimensional ratings, score ranges and narrative 'blandness' in a clinical sample.

While understanding how internalized representations of others (i.e., object relations) change over the course of treatment is essential for treatment planning and evaluation of progress, few studies have examined the nature of these changes through repeated psychological assessments. In this study, we applied the SCORS-G to Thematic Apperception Test narratives for 61 adult patients with complex psychiatric problems undergoing residential treatment over an 18-month period. Over the course of treatment, patient representations of self and others became more complex, indicating improvements in mentalization. Further, an analysis of default ratings (i.e., an aspect of story 'blandness') suggested that certain shifts in SCORS-G dimensional scores over time were accounted for by greater degree of scorable content across time points, rather than changes specific to the dimensions themselves. Findings from novel exploratory analyses aimed at evaluating the test-retest reliability of both default rating proportion and several emerging alternative scoring approaches (including changes in minimum, maximum and range of scores on individual dimensions) are reported. While the magnitude of change across mean dimensional scores was found to be lower compared to those previously found in outpatient populations, our results suggest that the SCORS-G remains capable of detecting changes in mentalization capacities in individuals contending with longstanding, severe psychiatric impairment and personality-based psychopathology. Implications for treatment, assessment and future research are discussed.

How narrative source impacts convergence of ratings from the Social Cognition and Object Relations Scale-Global Rating Method with psychotherapy process measures.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Westen, 1995; see also Stein & Mulford, 2018) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) in relation to patient- and therapist-rated psychotherapy process measures. Using a university-based outpatient sample (n = 81), we found limited convergence for SCORS-G ratings across narrative type. First, paired t tests showed that the means for six of the eight SCORS-G dimensions differed significantly between the EM and PT narratives with the majority having a large magnitude of effect. Moreover, despite 29 significant correlations between a SCORS-G dimension and either an alliance or session quality variable, only two of the eight SCORS-G dimensions significantly correlated with the same process variable across narrative type (e.g., patient-rated session depth with SCORS-G Self Esteem [SE] and Identity and Coherence of Self [ICS]). Importantly, the high degree of theoretical coherence in the associations that emerged between the SCORS-G dimensions and the process variables suggest that the lack of convergence was not due to limited validity of the SCORS-G. Instead, the results underscore the importance of multi-method assessment techniques by highlighting that the manner in which a narrative is elicited will impact the object relational content patients provide. Future research and clinical implications related to the SCORS-G, alliance and psychotherapy process are discussed.

Card pull effects of the Thematic Apperception Test using the Social Cognition and Object Relations-Global Rating Method on complex psychiatric sample.

In recent years, there has been growing interest in examining the stimulus pull effects on respondent narratives to the Thematic Apperception Test (Murray, 1943) using standardized coding methods such as the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995). The present study expands on prior work by examining sources of variance in SCORS-G dimensions and card pull effect patterns in an adult clinical sample characterized by high psychiatric comorbidity and clinical severity. A sample of 158 adult psychiatric patients in long-term residential treatment provided narratives to 10 TAT cards (five of which have not previously been studied for pull effects). Cards 2 and 7BM pulled for significantly more adaptive narratives (positive pull), whereas Card 13MF pulled for more pathological stories (negative pull). Like prior studies, variance in cognitive dimensions of the SCORS-G was most explained by person effects, whereas the largest source of variance for all other dimensions was best explained by a combination of the card and the person effects on the narrative. Finally, exploratory analyses of card pull effects within different gender groups were conducted. The implications of these findings for performance-based future studies and possible clinical applications of card pull findings are discussed.

Are all narratives the same: Convergent and discriminant validity of the Social Cognition and Object Relations Scale-Global Rating Method across two narrative types.

This study examines the construct validity of the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) by exploring the degree of convergence across different narrative sources (i.e., early memories [EM] and psychotherapy narratives [PT]) using a university-based outpatient sample (n=101). First, we examined intercorrelations between SCORS-G ratings of EM and PT. Intercorrelations between SCORS-G EM and PT revealed that three of the dimensions significantly correlated with themselves across narrative type (Emotional Investment in Relationships [EIR], Experience and Management of Aggressive Impulses [AGG], and Self-Esteem [SE]), but that only AGG had its strongest correlation with itself (i.e., EM AGG to PT AGG). In addition, EM AGG was significantly related to all but one of the PT SCORS-G dimensions. Likewise, EM SE correlated with all but two of the PT SCORS-G dimensions. Second, we examined how narrative source related to clinical findings. With the use of a multimethod approach, we assessed how SCORS-G ratings from both narrative types correlated with selected variables from the Personality Assessment Inventory (PAI) and Rorschach Inkblot Test. Findings indicated that there were only three instances in which both narrative types had significant relationships to the same variable/scale, and all three instances were with the Rorschach. Together, these findings suggest that even when using the same scale (SCORS-G), different narrative sources differentially activate aspects of object relations. In addition, the results highlight that difficulties with self-esteem and poor management of aggression in childhood interactions relates to patients' object relational functioning later in life. Clinical implications and future research are discussed.

When's a story a story? Determining interpretability of Social Cognition and Object Relations Scale‐Global ratings on Thematic Apperception Test narratives

The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) measures the quality of object relations in narrative material. The reliability and validity of this measure have been well established. However, a psychometric oddity of this scale is that default ratings are given to select dimensions when the relevant construct is not present. This can result in narrative 'blandness' and may impact clinical findings. The aim of these two studies is to understand these phenomena both psychometrically and clinically. In the first study, we identified 276 outpatients who had SCORS-G ratings for TAT Cards 1, 2, 3BM, and 14, set criteria for narrative 'blandness' across all eight dimensions, and examined group differences. In Study 2, we used a subset (N = 99) of Study 1 and examined how percentage of formal default ratings for Emotional Investment in Values and Moral Standards (EIM), Experience and Management of Aggressive Impulses (AGG), Self-Esteem(SE), and Identify and Coherence of Self (ICS) impacted robustness of correlations across tests of intelligence, psychopathology, and normal personality functioning. Taken together, we identified clinical characteristics of patients who are more likely to produce 'bland' narratives and increased percentages of formal default ratings. Also, an excess of default ratings per protocol impacts robustness of correlations and weakens significant correlations. As cut-off scores increase (>25% and >28.12%), the likelihood of being able to interpret EIM, AGG, SE, and ICS decreases. Psychometric and clinical implications are discussed.

주제통각검사를 활용한 사회인지와 대상관계 척도 타당화 연구

The Social Cognition and Object Relations Scale-Global rating method (SCORS-G) is a coding system that assesses the cognitive and emotional aspects of interpersonal functioning in narrative materials. This study aimed to validate the Korean version of the SCORS-G using card from the Thematic Apperception Test (1, 2, 3BM, 4, 13MF, 12M, 14). The Personality Assessment Inventory, NEO-Five Factor Inventory, Inventory of Interpersonal Problems, Interpersonal Cognitive Distortions Scale, Difficulties in Emotional Regulation Scale, and Thematic Apperception Test (TAT) were administered to 215 undergraduate students. The reliability and validity of the SCORS-G were tested by rating TAT protocols according to the scoring criteria. The level of interrater reliability for 8 dimensions of the SCORS-G was mostly acceptable. Based on existing literature, we established a two-factor model consisting of the cognitive and emotional factors and verified a model fit using confirmatory factor analysis. As a result, the model fit was good, which suggests that the factor structure of the SCORS-G is valid. Furthermore, the cognitive and emotional factors of the SCORS-G had a significant correlation with various psychopathologies, personality traits (Big-5), interpersonal problems, cognitive distortion, and emotional dysregulation. We provide an interpretation guideline for the clinical utility of SCORS-G based on the present and previous studies, and discuss the clinical implications and limitations of this study.

Stimulus Characteristics in Picture Story Exercise Cards and Their Effects on the Social Cognition and Object Relations Scale–Global Rating Method

This study examined the effects of stimulus characteristics from the Picture Story Exercise (PSE; Smith, 1992) on the quality of social cognition and object relational functions as expressed in narrative responses. A nonclinical sample of 140 adults told stories to five PSE cards. Three trained raters scored the narratives using the Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Stein & Slavin-Mulford, 2018). Data were then analyzed to determine the extent to which different PSE cards elicited more pathological or more adaptive ratings on the 8 SCORS–G dimensions. Results showed that different cards produced reliable and significant differences in ratings on different SCORS–G dimensions. These results extend findings of previous research (Siefert et al., 2016; Stein et al., 2014) that used the SCORS–G with Thematic Apperception Test (Murray, 1943) cards to a unique and previously unexplored stimulus set. The implications of these findings on the use and interpretation of the PSE and SCORS–G are discussed.

SCORS-G and Card Pull Effect of TAT Stories: A Study With a Nonclinical Sample of Children.

Previous research has shown that stimulus pull is one of the contributory factors influencing Thematic Apperception Test (TAT) responses. In recent years, there has been a resurgence of studies examining this. In particular, the Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) has been employed to examine stimulus pull in adult clinical and nonclinical samples. The present study is the first attempt to examine this issue in a nonclinical sample of children. Ninety-eight children from Italian elementary (1st to 5th grade) and middle (6th to 8th grade) schools provided narratives to six TAT cards (1, 2, 3BM, 4, 8BM, and 16). Some important findings with regard to variance within scales replicate prior findings from other studies. Furthermore, some findings regarding the specific nature of pull for particular TAT cards (1, 2, 3BM, and 4) replicate prior work. Given that Cards 8BM and 16's SCORS-G stimulus properties have not been previously studied, the pull of these cards is explored. Last, SCORS-G differences/similarities across these two age groups are highlighted. Suggestions for further research in this field are also provided, particularly concerning the use of SCORS-G and TAT for clinical assessment.

Dimensional measure of self and interpersonal functioning: Comparisons with treatment alliance and readiness for inpatient psychotherapy.

The social cognition and object relations scale-global rating method is a clinical rating system assessing 8 domains of self and interpersonal functioning. It can be applied to score numerous forms of narrative data. In this study, we investigate the SCORS-G relationship to measures of alliance and readiness for psychotherapy with an adolescent inpatient sample. Seventy-two psychiatrically hospitalized adolescents were consented and subsequently rated by their individual and group therapist using the SCORS-G. The unit psychiatrist also completed an assessment of patients' readiness for inpatient psychotherapy. The patients completed a self-report of their alliance with the inpatient treatment team as a whole. SCORS-G ratings were positively correlated with assessments of readiness for inpatient psychotherapy and patient-reported alliance. This study further demonstrates the clinical utility of the SCORS-G with adolescents.

Introduction to the Special Section on the Social Cognition and Object Relations Scale–Global Rating Method: From Research to Practice

ABSTRACTThere continues to be a need in the field of psychology for measures that quantify qualitative data in dynamically rich and clinically meaningful ways. The Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Westen, 1995) is a clinician-rated measure with a strong theoretical foundation that assesses sophisticated underlying constructs, specifically 8 dimensions of object relations (Stein & Slavin-Mulford, 2018). The SCORS–G has steadily increased in popularity and this special section of the Journal of Personality Assessment reflects this growing interest. In this introduction, we provide readers with a brief overview of the 5 articles in this special section and note ways in which they reflect and build on the existing SCORS–G empirical literature. Contextualizing these articles within the broader literature allows us to highlight how the measure is employed in clinical and research settings. Each of these 5 articles also highlights areas and opportunities for future research that would address gaps in the SCORS–G literature and strengthen the utility of the measure. We close by noting how each of studies can be seen as a model for future lines of research.

Flexibility and Rigidity in Object Relational Functioning: Assessing Change in Suicidal Ideation and Global Psychiatric Functioning Using the SCORS–G

ABSTRACTThe Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Westen, 1995) has been widely used as an assessment measure of object relational functioning across a number of stimuli. This study used the SCORS–G to investigate associations between global impairments and rigidity in quality of object relations with changes in suicidal ideation and psychiatric functioning over time. Participant narratives describing actual interpersonal experiences were collected using the Relationship Anecdote Paradigm (Luborsky, 1998) from a sample of individuals diagnosed with complex psychopathology completing residential psychiatric treatment. We found that a greater range in affective quality and emotional investment in relationship scores at admission into treatment were significantly related to a reduction in suicidal ideation as well as improvements in global psychiatric functioning at 5-year follow-up. Thus, participants who acknowledged having both healthy as well as troubled relationships in their daily lives were less suicidal and less likely to experience disruptive psychiatric symptoms over time than those who described more restricted or uniform relational experiences on entering treatment. Implications for calculating range scores and using various narrative techniques when applying the SCORS–G method are discussed.

The Use of the Social Cognition and Object Relations Scale in a Primary Care Setting

ABSTRACTResearch has indicated that as many as 10% to 15% of primary care patients have symptoms that are not well explained medically. These patients could be labeled as “somatizers.” This study assessed the extent to which underlying psychological characteristics contribute to a person's level of somatization and service utilization. The Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) was used to rate early memory narratives of 100 patients in a suburban primary care setting. Using principal axis factoring, the SCORS–G was divided into 2 components and these components (cognitive and affective) were used in subsequent analyses. The affective component was significantly negatively correlated with 2 measures of somatization and positively related to physician ratings of global health. The affective component also showed a trend toward significance on overnight hospital stays and patient-rated health. The cognitive component showed a trend toward significance with both measures of somatization, but it was not correlated with other measures of health. This study demonstrates the value of assessing underlying processes (via SCORS–G ratings of early memory narratives) that contribute to increased rates of somatization and health care utilization. Clinical implications for the relationship between affect and physical health are explored.

Facets of Object Representation: Process and Outcome Over the Course of Psychodynamic Psychotherapy

ABSTRACTThis study explores the effectiveness of psychodynamic psychotherapy in improving facets of object relations (OR) functioning over the course of treatment. The sample consisted of 75 outpatients engaged in short-term dynamic psychotherapy at a university-based psychological services clinic. Facets of OR functioning were assessed at pre- and posttreatment by independent raters using the Social Cognition and Object Relations Scale–Global rating method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) from in-session patient relational narratives. The Comparative Psychotherapy Process Scale (CPPS; Hilsenroth, Blagys, Ackerman, Bonge, & Blais, 2005) was used to assess therapist activity and psychotherapy techniques early in treatment. Independent clinical ratings of OR functioning and psychotherapy technique were conducted and all were found to be in the good to excellent range of reliability. Specific facets of OR functioning improved with medium to large effect changes posttreatment. These adaptive changes were significantly related to the incidence of psychodynamic-interpersonal (PI) techniques. Also, this study identified the role specific psychodynamic techniques had in facilitating change in a number of underlying dimensions of OR. Patient self-reported reliable change in symptomatology and reliable change in facets of OR were significantly related as well. This study highlights the utility of incorporating psychological assessment into psychotherapy practice to assess change at the explicit (symptoms) and implicit (OR) level. Limitations of this study, future research directions, and implications for clinical practice are discussed.

Extending the Use of the SCORS–G Composite Ratings in Assessing Level of Personality Organization

ABSTRACTThe Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995b) reliably measures the quality of object relations in narrative material. It assesses 8 dimensions (on a continuum from maladaptive to adaptive) that mediate interpersonal functioning. The 8 dimensions can be averaged to create a global or composite score to represent a person's overall object relational functioning. This study aimed to create levels of personality organization using the SCORS–G global score ratings of Thematic Apperception Test (TAT) narratives and to explore the construct validity of these levels using a multimethod approach (i.e., psychopathology, normal personality, and life-event data). Meaningful relationships were found between the SCORS–G level of personality organization and aspects of psychopathology (Personality Assessment Inventory; Morey, 1991), regulation and control (NEO Five-Factor Inventory; Costa & McCrae, 1989, 1992b), and number of psychiatric hospitalizations, suicide attempts, and educational level. Overall, this study demonstrates the potential value of creating levels of personality organization (LPO) using the SCORS–G composite or global ratings as a supplement to the psychological assessment process and further highlights the utility of this measure in the field of personality assessment. Clinical and research-related implications as well as limitations are discussed.

Estimating the Effects of Thematic Apperception Test Card Content on SCORS–G Ratings: Replication With a Nonclinical Sample

ABSTRACTThe content of Thematic Apperception Test (TAT) cards can, in some cases, influence how respondents form narratives. This study examines how imagery from select TAT cards affects the narratives of respondents from a nonclinical setting. The Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, Lohr, Silk, Kerber, & Goodrich, 1989) was used to rate narratives. Forty-nine college students provided narratives to 6 TAT cards. Narratives were rated by two expert raters using the SCORS–G. Consistent with prior research, Card 2 exhibited the most pull for adaptive ratings on SCORS–G scales, and 3 BM exhibited the most pull for maladaptive ratings. Findings for other cards were mixed. Although raters were highly reliable, internal consistency estimates were lower than desirable for 6 of the 8 SCORS–G scales. Variance component estimates indicated that card by person interactions accounted for the largest amount of variance in person-level scores. Results and limitations are discussed in light of prior research. We also make suggestions for further lines of research in this area.

SCORS–G Stimulus Characteristics of Select Thematic Apperception Test Cards

There has been surprisingly little research into the stimulus properties of the Thematic Apperception Test Cards (TAT; Murray, 1943). This study used the Social Cognition and Object Relations Scale–Global Rating Method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) to explore the stimulus properties of select TAT cards in a clinical sample. The SCORS–G is a theoretically based and empirically validated measure of object relations that has widely been used in TAT research. A sample of 80 patients referred for psychological assessment at a large Northeastern hospital were administered the TAT (Cards 1, 2, 3BM, 4, 13MF, 12M, and 14) as part of their assessment battery. Trained raters scored the narratives using the SCORS–G. The SCORS–G ratings were analyzed to determine the nature and degree of object representation “pull” both across and within the TAT cards. The results showed that Cards 3BM and 13MF exhibited the greatest card pull for negative pathological object representations, and Card 2 displayed the highest card pull for adaptive and mature object representations. Both clinical and research related implications are discussed.

Dimensional Assessment of Self- and Interpersonal Functioning in Adolescents: Implications forDSM-5's General Definition of Personality Disorder

Central to the proposed DSM-5 general definition of personality disorder (PD) are features of self- and interpersonal functioning. The Social Cognition and Object Relations Scale-Global Rating Method (SCORS-G) is a coding system that assesses eight dimensions of self- and relational experience that can be applied to narrative data or used by clinically experienced observers to quantify observations of patients in ongoing psychotherapy. This study aims to evaluate the relationship of SCORS-G dimensions to personality pathology in adolescents and their incremental validity for predicting multiple domains of adaptive functioning. A total of 294 randomly sampled doctoral-level clinical psychologists and psychiatrists described an adolescent patient in their care based on all available data. Individual SCORS-G variables demonstrated medium-to-large effect size differences for PD versus non-PD identified adolescents (d = .49-1.05). A summary SCORS-Composite rating was significantly related to composite measurements of global adaptive functioning (r = .66), school functioning (r = .47), externalizing behavior (r = -.49), and prior psychiatric history (r = -.31). The SCORS-Composite significantly predicted variance in domains of adaptive functioning above and beyond age and DSM-IV PD diagnosis (ΔR(2)s = .07-.32). As applied to adolescents, the SCORS-G offers a framework for a clinically meaningful and empirically sound dimensional assessment of self- and other representations and interpersonal functioning capacities. Our findings support the inclusion of self- and interpersonal capacities in the DSM-5 general definition of personality disorder as an improvement to existing PD diagnosis for capturing varied domains of adaptive functioning and psychopathology.

Exploring the Construct Validity of the Social Cognition and Object Relations Scale in a Clinical Sample

The Social Cognition and Object Relations Scale–Global rating method (SCORS–G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) measures the quality of object relations in narrative material. This study employed a multimethod approach to explore the structure and construct validity of the SCORS–G. The Thematic Apperception Test (TAT; Murray, 1943) was administered to 59 patients referred for psychological assessment at a large Northeastern U.S. hospital. The resulting 301 TAT narratives were rated using the SCORS–G method. The 8 SCORS variables were found to have high interrater reliability and good internal consistency. Principal components analysis revealed a 3-component solution with components tapping emotions/affect regulation in relationships, self-image, and aspects of cognition. Next, the construct validity of the SCORS–G components was explored using measures of intellectual and executive functioning, psychopathology, and normal personality. The 3 SCORS–G components showed unique and theoretically meaningful relationships across these broad and diverse psychological measures. This study demonstrates the value of using a standardized scoring method, like the SCORS–G, to reveal the rich and complex nature of narrative material.