Brief Report: Psychometric Properties of the Ability in Behavior Assessment and Interventions for Teachers-Revised (ABAIT-R).

Given the importance of competencies in functional behavior assessment (FBA) and behavioral interventions among teachers for managing problem behaviors among children with autism spectrum disorder (ASD) and other developmental disabilities, a previously reported ability in behavior assessment and interventions for teachers (ABAIT) needed improvements in the multiple-choices by adding a 'don't know' option. This study reports on the psychometric properties of this revised scale (ABAIT-R) among 102 special educators assessed using Rasch models. It was found that the model had good fit and a wide spread of difficulties (3.63 to - 2.60). ABAIT-R had good targeting (over 85%) and high reliability (0.79). The assumptions of the model were met recommending sufficiency for the use of summated score from ABAIT-R among teachers.

Is Utena's Brief Objective Measures (UBOM) useful in real-world behavioral assessment of functioning? Validity and utility testing in patients with schizophrenia.

AIM: Utena's Brief Objective Measures (UBOM) was developed to assess psychophysiological functions proximal to real-world functioning in individuals with psychiatric disorders, including schizophrenia (SCZ), to facilitate shared decision-making. However, the validity of UBOM has not been fully examined. METHODS: We conducted a cross-sectional observational study to evaluate the validity of each of the three tests in UBOM: UBOM-Pulse, UBOM-Ruler, and UBOM-Random. We investigated associations: (i) between UBOM and existing cognitive- and autonomic-function tests; and (ii) between UBOM and daily social functioning. The participants included SCZ individuals and healthy controls. We evaluated the cognitive and autonomic function using UBOM, the heart rate variability test, the simple reaction time test, and the Brief Assessment of Cognition in Schizophrenia, Japanese version. We also assessed the daily social functioning using the WHO Disability Assessment Schedule 2.0 and the modified Global Assessment of Functioning, Japanese version. RESULTS: Thirty-one SCZ individuals and 35 healthy control individuals participated in this study. In the SCZ group, UBOM-Ruler was significantly associated with the Cognition and Getting Along domains of WHO Disability Assessment Schedule 2.0. UBOM-Random was significantly associated with the Brief Assessment of Cognition in Schizophrenia's Working Memory, Verbal Fluency and Attention domains, and the modified Global Assessment of Functioning in the SCZ group. CONCLUSION: The validity of the current version of UBOM is imperfect and further improvements will be necessary to attain the originally intended goal of developing a brief assessment tool for real-world functioning in SCZ.

Is the endorsement of the Attention Deficit Hyperactivity Disorder symptom criteria ratings influenced by informant assessment, gender, age, and co-occurring disorders? A measurement invariance study.

OBJECTIVES: This study aims to ascertain whether the differences of prevalence and severity of attention deficit hyperactivity disorder (ADHD) are true or whether children are perceived and rated differently by parent and teacher informant assessments (INFAs) according to gender, age, and co-occurring disorders, even at equal levels of latent ADHD traits. METHODS: Use of latent trait models (for binary responses) to evaluate measurement invariance in children with ADHD and their siblings from the International Multicenter ADHD Gene data. RESULTS: Substantial measurement noninvariance between parent and teacher INFAs was detected for seven out of nine inattention (IA) and six out of nine hyperactivity/impulsivity (HI) items; the correlations between parent and teacher INFAs for six IA and four HI items were not significantly different from zero, which suggests that parent and teacher INFAs are essentially rating different kinds of behaviours expressed in different settings, instead of measurement bias. However, age and gender did not affect substantially the endorsement probability of either IA or HI symptom criteria, regardless of INFA. For co-occurring disorders, teacher INFA ratings were largely unaffected by co-morbidity; conversely, parental endorsement of HI symptoms is substantially influenced by co-occurring oppositional defiant disorder. CONCLUSIONS: Our findings suggest general robustness of Diagnostic and Statistical Manual of Mental Disorders ADHD diagnostic items in relation to age and gender. Further research on classroom presentations is needed.

Reliability, validity, and accuracy of the intervention selection profile-Function: A brief functional assessment tool.

The purpose of this study was to evaluate the reliability, validity, and accuracy of scores from the Intervention Selection Profile-Function (ISP-Function): a brief functional assessment tool founded upon Direct Behavior Rating (DBR) methodology. Participants included 34 teacher-student dyads. Using the ISP-Function, teachers rated the extent to which students exhibited disruptive behavior, as well as the frequency with which disruptions were met with four consequences. Ratings were completed across three 10-min sessions, during which a research assistant also collected systematic direct observation (SDO) data regarding the same behavior and consequences. Results indicated adequate temporal reliability (≥.70) was attained for the adult attention and peer attention targets across the three ratings; in contrast, up to 8-18 data points would be needed to achieve adequate reliability across the remaining targets. Findings further suggested that while ISP-Function ratings of disruptive behavior, adult attention, and peer attention were moderately to highly correlated with SDO data, correlations were in the low range for the access to items/activities and escape/avoidance targets. Finally, analysis of difference scores showed that on average, mean ISP-Function scores fell within only 0.33 to 1.81 points of mean SDO scores (on the 0-10 DBR scale). Agreement coefficients indicative of exact score agreement were less consistent, suggesting accuracy ranged from poor to substantial. Results are promising, but future research is necessary to support applied ISP-Function use. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Informant Discrepancies in the Assessment of Adaptive Behavior of Children with Autism Spectrum Disorder.

This study examined informant discrepancies for parent and teacher adaptive behavior ratings of 103 children, ages 6-12 years, with ASD (without intellectual disability). Scores on the Adaptive Behavior Assessment System, third edition (Harrison and Oakland, Western Psychological Services, Los Angeles, 2015) General Adaptive Composite (GAC) and practical, social, and conceptual domains were examined for mean differences, level of agreement, and moderators of difference scores between informant groups. Teacher scores were significantly higher (indicating better functioning) than parents for the GAC and practical domain. Parent and teacher scores were moderately correlated and Bland-Altman plots and regression analyses revealed no systematic differences in parent-teacher agreement across the range of scores. None of the tested variables moderated the parent-teacher difference scores. Implications for clinical practice are discussed.

Inter-Rater Agreement for the Milestones and Barriers Assessments of the Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP).

We determined inter-rater agreement for the VB-MAPP, an instrument sometimes used in planning educational goals and evaluating intervention effects for young people with autism. A pair of raters independently rated each of 32 children diagnosed with autism. Intraclass correlation coefficients for the total Milestones and Barrier scores were 0.876 and 0.629, respectively, indicating good and moderate reliability. There was variability in reliability in the different domains of the Milestones Assessment, with most indicating moderate reliability, and most of the individual Barriers Assessment domains indicating poor reliability. These are the first data relevant to the reliability of the VB-MAPP, they suggest that further evaluation of its reliability is merited and that a high reliability for individual domains should not be assumed.

Evidence-based severity assessment: Impact of repeated versus single open-field testing on welfare in C57BL/6J mice.

According to current guidelines on animal experiments, a prospective assessment of the severity of each procedure is mandatory. However, so far, the classification of procedures into different severity categories mainly relies on theoretic considerations, since it is not entirely clear which of the various procedures compromise the welfare of animals, or, to what extent. Against this background, a systematic empirical investigation of the impact of each procedure, including behavioral testing, seems essential. Therefore, the present study was designed to elucidate the effects of repeated versus single testing on mouse welfare, using one of the most commonly used paradigms for behavioral phenotyping in behavioral neuroscience, the open-field test. In an independent groups design, laboratory mice (Mus musculus f. domestica) experienced either repeated, single, or no open-field testing - procedures that are assigned to different severity categories. Interestingly, testing experiences did not affect fecal corticosterone metabolites, body weights, elevated plus-maze or home cage behavior differentially. Thus, with respect to the assessed endocrinological, physical, and behavioral outcome measures, no signs of compromised welfare could be detected in mice that were tested in the open-field repeatedly, once, or, not at all. These findings challenge current classification guidelines and may, furthermore, stimulate systematic research on the severity of single procedures involving living animals.

Reliability and Validity of the Child and Adolescent Behavior Assessment (CABA): A Brief Structured Scale.

Use of valid, affordable, accessible, and brief measures facilitates the assessment of mental health outcomes. The Child and Adolescent Behavior Assessment Scale, a brief, structured scale, assesses problem behavior through patient and/or informant report. The purpose of this paper is to illustrate the scale's psychometric properties. In the cross-sectional study presented, a large national sample of youth (aged 5-18) admitted for psychiatric treatment (N = 32,689) was examined. The two major domains of problem behavior assessed were Internalizing and Externalizing. Reliability was good to excellent with alpha levels ranging from 0.874 to 0.917. Additional items measured Risk Behavior (α = 0.648). Subscale total scores correlated well with the Brief Psychiatric Rating Scale for Children, 9-item version (BPRS-C-9). Exploratory and confirmatory factor analyses supported the three-factor, multidimensional model of problem behavior as satisfactory for child and adolescent use, although further research is required to refine some items for clarity and improved model fit.

New scoring system improves inter-rater reliability of the Neonatal Oral-Motor Assessment Scale.

AIM: The Neonatal Oral-Motor Assessment Scale (NOMAS) is a standardised tool to assess sucking patterns in infants to 48 weeks of postmenstrual age (PMA). In the Netherlands, the interpretation of specific NOMAS items has evolved, leading to a new scoring system. Recent research using the NOMAS describes a way of clustering the most frequent items, and the aim of this study was to determine whether those changes improved the inter-rater reliability. METHODS: The inter-rater reliability was tested by two NOMAS-certified therapists who scored 120 video recordings of 40 preterm infants, admitted to the University Hospital of Düsseldorf, Germany, at 34, 37 and 44 weeks PMA, for normal, disorganised and dysfunctional diagnosis. The NOMAS comprised 28 items and five clusters of items. RESULTS: The therapists agreed on the level of diagnoses for 116 of 120 recordings (Cohen's Κ 0.90), on an item level for 107 of 120 recordings (Cohen's Κ 0.78) and on a cluster level for 108 of 120 recordings (Cohen's K 0.90). CONCLUSION: The new scoring system improved the inter-rater reliability of the NOMAS on all levels, highlighting the importance of NOMAS user having a clear understanding on how to interpret and score each item.

Development, validation, and performance of a scale to measure community mobilization.

RATIONALE: Community mobilization approaches (CMAs) are increasingly becoming key components of health programming. However, CMAs have been ill defined and poorly evaluated, largely due to the lack of measurement tools to assess mobilization processes and impact. OBJECTIVE: We developed the Community Mobilization Measure (CMM), composed of a set of scales to measure mobilization domains hypothesized to operate at the community-level. The six domains include: shared concerns, critical consciousness, leadership, collective action, social cohesion, and organizations and networks. We also included the domain of social control to explore synergies with the related construct of collective efficacy. METHOD: A survey instrument was developed and pilot tested, then revised and administered to 1181 young people, aged 18-35, in a community-based survey in rural South Africa. Item response modeling and exploratory factor analyses were conducted to assess model fit, dimensionality, reliability, and validity. RESULTS: Results indicate the seven-dimensional model, with linked domains but no higher order construct, fit the data best. Internal consistency reliability of the factors was strong, with ρ values ranging from 0.81 to 0.93. Six of seven scales were sufficiently correlated to represent linked concepts that comprise community mobilization; social control was less related to the other components. At the village level, CMM sub-scales were correlated with other metrics of village social capital and integrity, providing initial evidence of higher-level validity, however additional evaluation of the measure at the community-level is needed. CONCLUSION: This is the first effort to develop and validate a comprehensive measure for community mobilization. The CMM was designed as an evaluation tool for health programming and should facilitate a more nuanced understanding of mechanisms of change associated with CM, ultimately making mobilizing approaches more effective.

Protocol for the development and validation of a questionnaire to assess concerning behaviours and mental health in individuals with autism spectrum disorders: the Assessment of Concerning Behaviour (ACB) scale.

INTRODUCTION: Co-occurring psychiatric conditions and concerning behaviours are prevalent in individuals with autism spectrum disorders (ASD), and are likely to be detrimental to functioning and long-term outcomes. The cognitive rigidity and deficits in emotional literacy and verbal behaviour that commonly occur in ASD can adversely affect clinicians' confidence to identify concerning behaviours and mental health problems. There is a need to develop a measure that is tailored towards individuals with ASD, and differentiates between symptoms of psychopathology and core ASD symptoms. Furthermore, it should be modified to capture internalising symptoms that individuals with ASD may find difficult or be unable to verbalise. This protocol describes the intended development and validation of the Assessment of Concerning Behaviour (ACB) scale. The ACB will aim to be a multidimensional measure of concerning behaviours in ASD incorporating self-report, parent/carer, teacher/employer and clinician report versions that can be used across the lifespan and spectrum of intellectual ability. METHODS AND ANALYSIS: This study will be guided by the methods described in the US Food and Drug Administration Guidance for Industry Patient-reported Outcome Measures. A literature review, cognitive interviews and focus groups with individuals who have experience of working or living with ASDs will be used for item generation. A sample of children and adults with ASD will complete the ACB, in addition to other gold standard measures of concerning behaviour in order to establish the initial psychometric properties of the scale. ETHICS AND DISSEMINATION: This study has received ethical approval from the NHS Research Ethics Committee: London-Camden and King's Cross (ref: 15/LO/0085). Study findings will be disseminated to healthcare professionals and scientists in the field through publication in peer-reviewed journals and conference presentations.

Development and applications of the SWAN rating scale for assessment of attention deficit hyperactivity disorder: a literature review

This study reviewed the use of the Strengths and Weaknesses of Attention-Deficit/Hyperactivity-symptoms and Normal-behaviors (SWAN) rating scale in diagnostic and evolutive approaches to attention deficit hyperactivity disorder (ADHD) and in correlational studies of the disorder. A review of articles published in indexed journals from electronic databases was conducted and 61 articles on the SWAN scale were analyzed. From these, 27 were selected to a) examine use of SWAN in research on attention disorders and b) verify evidence of its usefulness in the areas of genetics, neuropsychology, diagnostics, psychiatric comorbidities, neuroimaging, pharmacotherapy, and to examine its statistical reliability and validity in studies of diverse populations. This review of articles indicated a growing use of the SWAN scale for diagnostic purposes, for therapy, and in research on areas other than ADHD, especially when compared with other reliable scales. Use of the scale in ADHD diagnosis requires further statistical testing to define its psychometric properties.

Development and applications of the SWAN rating scale for assessment of attention deficit hyperactivity disorder: a literature review.

This study reviewed the use of the Strengths and Weaknesses of Attention-Deficit/Hyperactivity-symptoms and Normal-behaviors (SWAN) rating scale in diagnostic and evolutive approaches to attention deficit hyperactivity disorder (ADHD) and in correlational studies of the disorder. A review of articles published in indexed journals from electronic databases was conducted and 61 articles on the SWAN scale were analyzed. From these, 27 were selected to a) examine use of SWAN in research on attention disorders and b) verify evidence of its usefulness in the areas of genetics, neuropsychology, diagnostics, psychiatric comorbidities, neuroimaging, pharmacotherapy, and to examine its statistical reliability and validity in studies of diverse populations. This review of articles indicated a growing use of the SWAN scale for diagnostic purposes, for therapy, and in research on areas other than ADHD, especially when compared with other reliable scales. Use of the scale in ADHD diagnosis requires further statistical testing to define its psychometric properties.

Multi-item direct behavior ratings: Dependability of two levels of assessment specificity.

Direct Behavior Rating-Multi-Item Scales (DBR-MIS) have been developed as formative measures of behavioral assessment for use in school-based problem-solving models. Initial research has examined the dependability of composite scores generated by summing all items comprising the scales. However, it has been argued that DBR-MIS may offer assessment of 2 levels of behavioral specificity (i.e., item-level, global composite-level). Further, it has been argued that scales can be individualized for each student to improve efficiency without sacrificing technical characteristics. The current study examines the dependability of 5 items comprising a DBR-MIS designed to measure classroom disruptive behavior. A series of generalizability theory and decision studies were conducted to examine the dependability of each item (calls out, noisy, clowns around, talks to classmates and out of seat), as well as a 3-item composite that was individualized for each student. Seven graduate students rated the behavior of 9 middle-school students on each item over 3 occasions. Ratings were based on 10-min video clips of students during mathematics instruction. Separate generalizability and decision studies were conducted for each item and for a 3-item composite that was individualized for each student based on the highest rated items on the first rating occasion. Findings indicate favorable dependability estimates for 3 of the 5 items and exceptional dependability estimates for the individualized composite.