The validity of the interviewer severity ratings in groups of ASI interviewers with varying training.

AIMS: This study evaluated the hypothesis that the subjective interviewer severity rating (ISR) summary indices of the intake Addiction Severity Index (ASI) of less trained interviewers are less valid than those of more highly trained interviewers. DESIGN: Baseline ASIs from three completed studies whose interviewers varied in degree of initial ASI training and subsequent quality assurance monitoring were examined. Associations between baseline ISRs and three other sets of ASI summary indices not based on interviewer ratings-composite scores, clinical indices and evaluation indices-were compared for three groups of interviewers with varying amounts of training. The assumption underlying these analyses was that more reliable ISRs, found in more trained interviewers, would be more highly associated with the other more objective indices. SETTING: Methadone maintenance patients in the Philadelphia and New York City areas. PARTICIPANTS: Thirty-five interviewers with the most intense training who administered 295 interviews; 10 interviewers with an intermediate level of training who administered 763 interviews; and eight identified (and other unidentified) least trained interviewers who administered a total of 276 interviews. Measurements and methods. Four sets of summary indices from the above ASIs. Both bivariate and multivariate analyses were performed. FINDINGS: The study found that the validity of the validity of ISRs was greater in more trained interviewers. CONCLUSIONS: Greater training and subsequent monitoring of ASI interviewers generally appears to be associated with increased ISR validity.

A comparison of the predictive validity of four sets of baseline ASI summary indices.

This study compared the long-term predictive validity of original and new baseline Addiction Severity Index summary scores in methadone patients. The indices included the original Interviewer Severity Ratings (ISRs) and the new Clinical Indices (CIs), which use both lifetime and recent problem information, and the original Composite Scores (CSs) and Evaluation Indices (EIs), based on recent problems only. Outcomes were medical hospitalization, employment, alcohol intoxication, drug hospitalization, and psychiatric hospitalization in Months 7-24 poststudy entry and criminal charges in Months 0-24. Hierarchical logistic regression analyses were used in which 1 index was entered first and the other in the 2nd step. The reverse order of entry was used in a 2nd analysis. A final analysis set compared the best predictor from each of the 2 prior analysis sets. The CIs were superior to the other indices in predicting 3 of 6 outcomes (psychiatric hospitalization, drug hospitalization, and criminal charges); the EI was the best predictor of alcohol intoxication, and the CS the best predictor of unemployment.

Generalizability of the clinical dimensions of the Addiction Severity Index to nonopioid-dependent patients.

Clinical dimensions (CDs) for the Addiction Severity Index recently have been established for application among opioid-dependent patients in methadone treatment (P. A. McDermott et al., 1996). This article examines the generalizability of the CDs to other substance-dependent patients. A sample of 2,027 adult nonopioid-dependent patients was identified; it comprised 581 primarily cocaine-dependent, 544 primarily alcohol-dependent, and 803 polydrug-dependent patients and 99 patients who were dependent on other varied drugs. Generality of dimensions was assessed through confirmatory components analysis, structural congruence, internal consistency, and variance partitioning in higher order factoring. The CDs were found generalizable overall and to specific nonopioid-dependent subgroups, and across patient gender and age, and to African American and White patients. Preliminary concurrent and predictive validity data supported the CD structure.

Generality of Psychopathy Checklist-Revised factors over prisoners and substance-dependent patients.

The Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991) is an often-used device for assessment of adult antisociality. This research examined generalizability by replicating the 2-factor model for a sample of 326 male prisoners and assessing its congruence and relative reliability and specificity among 620 substance-dependent patients. Generality was assessed also across addiction subtypes (opioid, cocaine, and alcohol), age, gender, and ethnicity. The 2-factor model was found inappropriate for the substance-dependent samples, whereas a unidimensional model represented by the PCL-R total score was found generalizable across prison and substance-dependent samples.

A typology of antisociality in methadone patients.

Multistage cluster analyses with replications were used to sort score profiles of 252 methadone maintained men on 4 continuous measures of antisociality--childhood conduct disorder and adult antisocial personality disorder symptoms, the revised Psychopathy Checklist, and the Socialization scale of the California Psychological Inventory. The analysis yielded 6 replicable and temporally stable cluster groups varying in degree and pattern of antisociality. The groups were statistically compared on sets of external criterion variables--Addiction Severity Index measures of past and recent substance abuse and functioning and lifetime criminal history. Axis I and II symptomatology, anxiety and depression, object relations and reality testing, hostility, guilt, and machiavellianism. The expression of antisociality in the 6 groups and differences found among them on the external variables supported the validity of a more complex conceptualization of antisociality than is provided by antisocial personality disorder.

A psychometric evaluation of the Defense Style Questionnaire in methadone patients.

The self-report Defense Style Questionnaire (DSQ) was designed to assess defenses along a developmental continuum. Factor analysis of the original DSQ suggested that the scale assessed four factors or types of defenses, whereas a more recent factor analysis indicated the DSQ measured three-factors: Immature, Neurotic, and Mature. No data, however, regarding the reliability or unique construct validity of DSQ dimensions was published. This article reports on factor analyses of two DSQ versions in a sample of 215 methadone maintenance patients. Results indicate that both DSQ versions are unidimensional, assessing only Immature defenses. The lack of published psychometric data raises concerns regarding the true reliability of DSQ dimensions reported in previous investigations. Prior statements based on DSQ findings may have been incorrect if the DSQ factors were unreliable. Findings from this investigation stress the importance of requiring and evaluating the psychometric integrity of an instrument before employing it in research.

The Pictorial Scale of Perceived Competence and Social Acceptance: does it work with low-income urban children?

The present study represents a twofold investigation wherein (a) the construct validity of the Pictorial Scale of Perceived Competence and Social Acceptance for Young Children (PSPCSA) and (b) the developmental appropriateness of the PSPCSA were empirically examined for urban Head Start children. Data were collected from a sample of 476 African-American children (48-64 months) representing children enrolled in a large metropolitan Head Start program. In the first study, neither replication of the test author's statistical procedures nor a series of exploratory factor analyses produced psychologically meaningful constructs. A second study tested the assumption that the PSPCSA administration format is developmentally appropriate for preschool children. Results from this study did not support the assumption that the PSPCSA is developmentally appropriate for preschool children. Implications for establishing valid assessment methods for urban Head Start children were discussed.

A nationwide study of developmental and gender prevalence for psychopathology in childhood and adolescence.

Psychopathology was assessed through standardized observations by teachers of 1,400 youths 5 through 17 years old comprising the national norm sample of the Adjustment Scales for Children and Adolescents. The sample was stratified according to the US. population by age, sex, ethnicity, parent education, family structure, national region, community size, and handicapping condition. The maladjusted portion of the sample for each of six specific syndromes was examined for departures from expected developmental and gender prevalence. Males outnumbered females for most types of maladjustment, including attention-deficit hyperactive, both provocative and impulsive forms of solitary aggressive, oppositional defiant, and avoidant disorders. Also revealed were general patterns of reduced behavior excess and increased avoidant behavior with advancing age.

Generality of test-session observations to kindergarteners' classroom behavior.

Test observations are integral components in the comprehensive assessment of children's academic talents and personal adjustment. They are used to validate standardized test scores obtained during test sessions and to draw inferences about children's general pattern of learning and social adjustment. Unfortunately, little empirical justification exists for extending inferences beyond the confines of test sessions. This issue was examined with 155 kindergarten children using the Stanford Binet Observation Schedule (SBOS), a popular instrument for the summative integration of test-session observations. Children's ratings on the SBOS were used to estimate teacher-observed behavior on the Guide to the Child's Learning Style (GCLS). SBOS and GCLS scores were subjected to independent principal components analyses with varimax rotation and, thereafter, to a joint canonical variance analysis. Weighted factor composites from two SBOS dimensions constituted the predictor data set and three GCLS dimensions the criterion data set. Although multivariate statistical significance was achieved (lambda = .834, F(6,200) = 3.18, p less than .005), cannonical redundancy showed merely 9.4% of classroom behavior predictable from test-session. Results are examined in light of research on the situational specificity of behavior.

Child behavior disorders by age and sex based on item factoring of the revised Bristol Guides.

Standardized teacher observations of 2,527 schoolchildren, selected at random for the revised Bristol Social Adjustment Guides were partitioned into four subsamples consisting of 797 5- to 10-year-old boys, 758 5- to 10-year-old-girls; 508 11- to 15-year-old boys, and 464 11- to 15-year-old girls, respectively. The children were observed by over 900 teachers and rated on 104 indicators of maladaptive behavior. Item scores for each age/sex sample were subjected to first- and second-order factor analysis, with varimax rotation yielding identical second-order models of behavior disorder across age and sex samples and somewhat different first-order models for each sample. Comparison of derived dimensions with dimensions emergent in other behavior problem research indicated considerable consistency. Moreover, the similarity of the factorially derived dimensions confirmed the cross-age and -sex generality of the syndromes known as unforthcomingness, hostility, and depression, and provided reasonable support for the utility of the syndrome of inconsequence, although it was apparent that inconsequence stands as more a composite of underlying factor dimensions reflecting hyperactive and attention-seeking behaviors. While the withdrawal syndrome found factorial support, its integrity was clearly specific to child age and sex.

Validation of a systems-actuarial computer process for multidimensional classification of child psychopathology.

Tested diagnostic classifications of child psychopathology produced by a computerized technique known as multidimensional actuarial classification (MAC) against the criterion of expert psychological opinion. The MAC program applies series of statistical decision rules to assess the importance of and relationships among several dimensions of classification, i.e., intellectual functioning, academic achievement, adaptive behavior, and social and behavioral adjustment, to perform differential diagnosis of children's mental retardation, specific learning disabilities, behavioral and emotional disturbance, possible communication or perceptual-motor impairment, and academic under- and overachievement in reading and mathematics. Classifications rendered by MAC are compared to those offered by two expert child psychologists for cases of 73 children referred for psychological services. Experts' agreement with MAC was significant for all classification areas, as was MAC's agreement with the experts held as a conjoint reference standard. Whereas the experts' agreement with MAC averaged 86.0% above chance, their agreement with one another averaged 76.5% above chance. Implications of the findings are explored and potential advantages of the systems-actuarial approach are discussed.

Patterns of disturbance in behaviorally maladjusted children and adolescents.

Factorially-based dimensions of disturbance in children vary markedly across adjusted and maladjusted subpopulations; hence, maladjusted children's behavior patterns must be assessed against dimensions of disturbance found among other maladjusted children. Within this context, 510 5- to 15-year-old children (viz., 307 boys and 203 girls) were identified as the significantly maladjusted segment of the random normative population for the revised Bristol Social Adjustment Guides (BSAG). Teacher's behavioral ratings of these children on the BSAG's core syndromes and associated item groupings were subjected to principal-components factor analysis with varimax rotation. Two dimensions emerged: The first, a unique bipolar continuum of generally overreactive vs. unforthcoming behavior; the second, a dimension of constricted socioemotional reactions. Tests for significance of exclusive syndromic variation further revealed that several of the BSAG's syndrome carry enough stable and distinct variance to warrant their consideration as specific qualities of disturbance among maladjusted children and adolescents.

Prevalence and constituency of behavioral disturbance taxonomies in the regular school population.

The Bristol Social Adjustment Guides (BSAG) are widely employed in research and in the identification of maladjustment in school children. The BSAG provides scores on several indices including five homogeneous behavioral syndromes and one associated grouping. Field experience suggests that maladjusted children frequently manifest problems in more than one syndrome. In order to discover what patterns of syndromic profiles may commonly exist among children, the data for the most recent revision of the BSAG are reanalyzed. The syndrome scores for all 2,527 5- to 15-year-old regular school children in the standardization sample were grouped into similar profile patterns by hierarchical cluster analysis. Sixteen homogeneous syndromic profile types emerged. The resultant profiles types were described on the basis of their component behaviors and examined for membership trends by sex and age groups. Multiple syndromic profiles represented 60% of all maladjusted children.