The Work and Social Adjustment Scale for Youth: Psychometric properties of the teacher version and evidence of contextual variability in psychosocial impairments.

Effective mental health services require accurate assessment of psychosocial impairments linked to mental health concerns. Youth who experience these impairments do so within and across various contexts (e.g., school, home). Youth may display symptoms of mental health concerns without co-occurring impairments, and vice versa. Yet, nearly all impairment measures presume that those assessed display mental health concerns. Consequently, we recently developed youth and parent versions of a five-item measure of youth psychosocial impairments (i.e., Work and Social Adjustment Scale for Youth [WSASY]), structured to assess any youth, regardless of mental health status. Across two studies, we developed and tested a WSASY teacher version, in a large sample of 382 student teacher reports (Study 1), and a subsample of 66 youth who, along with their parents and teachers, completed the WSASY and a series of school- and home-based behavioral tasks (Study 2). In Study 1, WSASY teacher reports demonstrated excellent internal consistency and unique relations with teacher reports on well-established measures of psychosocial strengths and difficulties. In Study 2, teacher, youth, and parent WSASY reports demonstrated low correspondence with each other and context-specific relations with criterion variables. This low correspondence allowed us to capitalize on an integrative approach designed to optimize informant-specific variance. Integrative scores demonstrated robust, large-magnitude relations with criterion variables across multiple information sources. These findings provide important psychometric support for use of WSASY teacher reports, and pave the way toward integrating WSASY reports from multiple informants who observe youth psychosocial impairments within different contexts and from different perspectives. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research.

Psychosocial functioning plays a key role in students' wellbeing and performance inside and outside of school. As such, techniques designed to measure and improve psychosocial functioning factor prominently in school-based service delivery and research. Given that the different contexts (e.g., school, home, community) in which students exist vary in the degree to which they influence psychosocial functioning, educators and researchers often rely on multiple informants to characterize intervention targets, monitor intervention progress, and inform the selection of evidence-based services. These informants include teachers, students, and parents. Across research teams, domains, and measurement methodologies, researchers commonly observe discrepancies among informants' reports. We review theory and research-occurring largely outside of school-based service delivery and research-that demonstrates how patterns of informant discrepancies represent meaningful differences that can inform our understanding of psychosocial functioning. In turn, we advance a research agenda to improve use and interpretation of informant discrepancies in school-based services and research.

A comparison of problem identification interviews conducted face-to-face and via videoconferencing using the consultation analysis record.

School psychologists who experience challenges delivering face-to-face consultation may utilize videoconferencing to facilitate their consultation activities. Videoconferencing has been found to be an effective method of service delivery in related fields and emerging research suggests that it may be effective for providing teacher training and support in school settings. In this exploratory investigation, we used the Consultation Analysis Record (Bergan & Tombari, 1975) and its four indices to assess the effectiveness of conducting problem identification interviews via videoconferencing versus face-to-face. Overall, findings indicated significant differences across these two conditions, with videoconference interviews coded as having higher indices of content relevance, process effectiveness, and message control, but lower content focus, compared to face-to-face interviews. As these indices have been positively associated with favorable consultation outcomes, the results provide initial support for the effectiveness of consultation delivered via videoconferencing.

The Effects of Peer-Mediated Check-In/Check-Out on the Social Skills of Socially Neglected Students.

Check-In/Check-Out (CICO) is a moderately effective Tier 2 intervention often used to address attention-maintained problem behaviors in schools. Recent studies on CICO have demonstrated the effectiveness of the intervention when combined with social skills training and when utilizing students' peers as interventionists. Using a concurrent multiple baseline across participants design, the present study evaluated the effectiveness of peer-mediated CICO to target social skills in elementary school students identified as socially neglected using a sociometric classification system. Results, implications for practice, limitations, and future directions are discussed.

Peer-mediated check-in/check-out for students at-risk for internalizing disorders.

The present study investigated the effectiveness of peer-mediated check-in/check-out (CICO) on the internalizing behaviors of elementary school students. A nonconcurrent multiple-baseline design across participants was utilized to evaluate the intervention's effectiveness for 3 students in 1st and 2nd grade. Two 5th grade students were trained to implement CICO under the supervision of an adult intervention specialist. The peer-mediated CICO procedure was effective for 2 of the 3 participants as evidenced by moderate to large effect sizes; however, all 3 participants were identified as "at-risk" on a universal screener for internalizing problems. The results suggest peer-mediated CICO may be a resource-efficient Tier II strategy to meet the needs of students engaging in internalizing behavior within a multitiered framework of service delivery.

Standard of practice and Flynn Effect testimony in death penalty cases.

The Flynn Effect is a well-established psychometric fact documenting substantial increases in measured intelligence test performance over time. Flynn's (1984) review of the literature established that Americans gain approximately 0.3 points per year or 3 points per decade in measured intelligence. The accurate assessment and interpretation of intellectual functioning becomes critical in death penalty cases that seek to determine whether an individual meets the criteria for intellectual disability and thereby is ineligible for execution under Atkins v. Virginia (2002) . We reviewed the literature on the Flynn Effect and demonstrated how failure to adjust intelligence test scores based on this phenomenon invalidates test scores and may be in violation of the Standards for Educational and Psychological Testing as well as the "Ethical Principles for Psychologists and Code of Conduct." Application of the Flynn Effect and score adjustments for obsolete norms clearly is supported by science and should be implemented by practicing psychologists.

Base rates of social skills acquisition/performance deficits, strengths, and problem behaviors: an analysis of the Social Skills Improvement System--Rating Scales.

Base rate information is important in clinical assessment because one cannot know how unusual or typical a phenomenon is without first knowing its base rate in the population. This study empirically determined the base rates of social skills acquisition and performance deficits, social skills strengths, and problem behaviors using a nationally representative sample of children and adolescent ages 3-18 years. Using the national standardization sample of the Social Skills Improvement System--Rating Scales (N = 4,550) across 3 informants (teacher, parent, and student) and across 3 broad age groupings (3-5 years, 5-12 years, and 13-18 years), these base rates were computed. Results showed that the base rates for social skills acquisition deficits and problem behaviors are extremely low in the general population. Base rates for social skills performance deficits and social skills strengths were considerably higher, with students in the 5- to 12-year-old age group reporting fewer performance deficits and more social skills strengths than older children (13-18 years). Teachers and parents reported more performance deficits and fewer social skills strengths across all age groups than students in the 5- to 12-year-old age group. These results are discussed in terms of the utility of base rate information in clinical decision making.

Cross-informant agreement for ratings for social skill and problem behavior ratings: an investigation of the Social Skills Improvement System-Rating Scales.

One of the most consistent findings in rating scale research with children and adolescents is the modest agreement among different informants' ratings. The present study systematically explored patterns of agreement among teachers, parents/caregivers, and students in domains of social skills and problem behaviors using the Social Skills Improvement System-Rating Scales (SSIS-RS; F. M. Gresham & S. N. Elliott, 2008). Two subsamples from the normative sample of the SSIS-RS were used. The first sample of participants consisted of 168 students who had all 3 informants (parent, teacher, and self) complete the SSIS-RS scales, which was necessary to assess agreement across different raters. The second sample consisted of 164 students who had raters in a similar or same role (father-mother, teacher-teacher). The results replicated an extensive literature showing that cross-informant agreements for social skills and problem behaviors are weak to moderate. The current study invoked multitrait-multimethod logic to interpret the correlations among raters derived from different informants and showed that the convergent validity coefficients were consistently stronger than the discriminant validity correlations. Implications for assessment practices and future research are discussed.

Interpretation of intelligence test scores in Atkins cases: conceptual and psychometric issues.

So-called Atkins cases refer to individuals who have been sentenced to death for capital crimes who claim that the death penalty constitutes "cruel and unusual punishment" under the Eighth Amendment. Psychological testimony is influential because this testimony strikes at the very core issue in these cases; namely, whether or not the individual is mentally retarded. Despite the importance of psychological testimony, courts have not been made to understand the subtleties and complexities of the issues in diagnosing mental retardation. Five such issues are discussed in this article: (a) the nature of intellectual functioning, (b) the Flynn Effect, (c) measurement error, (d) practice effects, and (e) the nature of school "diagnoses." Examples of each of these issues are illustrated with an actual Atkins case (Walker v. True, 2006).

Treatment integrity of school-based interventions with children in the journal of applied behavior analysis 1991-2005.

We reviewed all school-based experimental studies with individuals 0 to 18 years published in the Journal of Applied Behavior Analysis (JABA) between 1991 and 2005. A total of 142 articles (152 studies) that met review criteria were included. Nearly all (95%) of these experiments provided an operational definition of the independent variable, but only 30% of the studies provided treatment integrity data. Nearly half of studies (45%) were judged to be at high risk for treatment inaccuracies. Treatment integrity data were more likely to be included in studies that used teachers, multiple treatment agents, or both. Although there was a substantial increase in reporting operational definitions of independent variables, results suggest that there was only a modest improvement in reported integrity over the past 30 years of JABA studies. Recommendations for research and practice are discussed.

Relevance of functional behavioral assessment research for school-based interventions and positive behavioral support.

The Individuals With Disabilities Education Act (IDEA) Amendments of 1997 mandate the use of functional behavioral assessment (FBA) and positive behavioral supports and interventions for students with disabilities. Although much progress has been made in our understanding of functional analysis over the past 15 years, the extent to which these findings can be generalized across clients, methods, settings, and response classes is unknown. This article reviewed 150 school-based intervention studies conducted with children published in the Journal of Applied Behavior Analysis from 1991 to 1999. Fifty-two percent of these intervention studies did not report using FBA information linked to the intervention. Interventions based on descriptive, experimental, or combined FBA procedures were no more effective than interventions in which no FBA information was provided. With respect to positive behavioral support, over half of the studies targeted appropriate behaviors with two-thirds of them using a combination of antecedent- and consequence-based interventions. Recommendations are made for conducting fundamental research on reliability and validity issues in FBA and determining when, how, and under what conditions FBA procedures are most appropriate.