Psychometric properties of the mock interview rating scale for autistic transition-age youth.

Background: Employment is a major contributor to quality of life. However, autistic people are often unemployed and underemployed. One potential barrier to employment is the job interview. However, the availability of psychometrically-evaluated assessments of job interviewing skills is limited for autism services providers and researchers. Objective: We analyzed the psychometric properties of the Mock Interview Rating Scale that was adapted for research with autistic transition-age youth (A-MIRS; a comprehensive assessment of video-recorded job interview role-play scenarios using anchor-based ratings for 14 scripted job scenarios). Methods: Eighty-five transition-age youth with autism completed one of two randomized controlled trials to test the effectiveness of two interventions focused on job interview skills. All participants completed a single job interview role-play at pre-test that was scored by raters using the A-MIRS. We analyzed the structure of the A-MIRS using classical test theory, which involved conducting both exploratory and confirmatory factor analyzes, Rasch model analysis and calibration techniques. We then assessed internal consistency, inter-rater reliability, and test-retest reliability. Pearson correlations were used to assess the A-MIRS' construct, convergent, divergent, criterion, and predictive validities by comparing it to demographic, clinical, cognitive, work history measures, and employment outcomes. Results: Results revealed an 11-item unidimensional construct with strong internal consistency, inter-rater reliability, and test-retest reliability. Construct [pragmatic social skills (r = 0.61, p < 0.001), self-reported interview skills (r = 0.34, p = 0.001)], divergent [e.g., age (r = -0.13, p = 0.26), race (r = 0.02, p = 0.87)], and predictive validities [competitive employment (r = 0.31, p = 0.03)] received initial support via study correlations, while convergent [e.g., intrinsic motivation (r = 0.32, p = 0.007), job interview anxiety (r = -0.19, p = 0.08)] and criterion [e.g., prior employment (r = 0.22, p = 0.046), current employment (r = 0.21, p = 0.054)] validities were limited. Conclusion: The psychometric properties of the 11-item A-MIRS ranged from strong-to-acceptable, indicating it may have utility as a reliable and valid method for assessing the job interview skills of autistic transition-age youth.

Enhancing pre-employment transition services: A type 1 hybrid randomized controlled trial protocol for evaluating WorkChat: A Virtual Workday among autistic transition-age youth.

Autistic transition-age youth experience high rates of unemployment and underemployment, in part due to the social challenges they may face when having conversations in the workplace. In an effort to help enhance conversational abilities in the workplace, our collaborative team partnered to develop WorkChat: A Virtual Workday. Specifically, our team of scientists, community partners, and diversity and inclusion experts participated in a community-engaged process to develop WorkChat using iterative feedback from autistic transition-age youth and their teachers. With initial development complete, this study reports on the protocol that our collaborative team developed, reviewed, and approved to conduct a randomized controlled trial (RCT) to evaluate the real-world effectiveness and initial implementation process outcomes of WorkChat when integrated into post-secondary pre-employment transition services (Pre-ETS). Our aims are to: 1) evaluate whether services-as-usual in combination with WorkChat, compared to services-as-usual with an attention control, enhances social cognition and work-based social ability (between pre- and post-test); reduces anxiety about work-based social encounters (between pre- and post-test), and increases sustained employment by 9-month follow-up; 2) evaluate whether social cognitive ability and work-based social ability mediate the effect of WorkChat on sustained employment; and 3) conduct a multilevel, mixed-method process evaluation of WorkChat implementation.

Development and Psychometric Properties of Self-Reported Job Interview Skills and Job Interview Anxiety for Autistic Transition-Age Youth.

BACKGROUND: The study of job interview training is an emerging area among transition-age autistic youth who face significant challenges when navigating job interviews. The autism field has limited measures that have undergone rigorous psychometric evaluation. OBJECTIVE: We sought to evaluate the psychometric properties of adapted self-report measures assessing job interview skills and job interview anxiety. METHODS: As part of two parent randomized controlled trials, eighty-five transition-age autistic youth completed measures related to the strength of their job interview skills and their level of job interview anxiety. We conducted classical test theory analyses, exploratory and confirmatory factor analyses, and Rasch model analytic and calibration analyses. Pearson correlations were used to establish concurrent, divergent, and criterion validity by correlating these scales with measures of social differences, depressive symptoms, behaviors, neuropsychological functioning, and work history. RESULTS: Our analyses yielded two brief and reliable scales: Measure of Job Interview Skills (MOJO-iSkills) and Measure of Job Interview Anxiety (MOJO-iAnxiety), which demonstrated initial concurrent, divergent, and criterion validities when correlated with measures of depressive symptoms, social differences, internalizing and externalizing behavior, and work history. CONCLUSIONS: This study presents initial evidence that MOJO-iSkills and MOJO-iAnxiety have acceptable psychometric properties supporting they can be used to reliably and validly assess job interview skills and interview anxiety.