Developing an entrustable professional activity for providing health education and consultation in occupational therapy and examining its validity.

BACKGROUND: Entrustable Professional Activities (EPA)-based assessment is easily and intuitively used in evaluating the learning outcomes of competency-based medical education (CBME). This study aimed to develop an EPA for occupational therapy focused on providing health education and consultation (TP-EPA3) and examine its validity. METHODS: Nineteen occupational therapists who had completed online training on the EQual rubric evaluation participated in this study. An expert committee identified six core EPAs for pediatric occupational therapy. TP-EPA3 was developed following the EPA template and refined through consensus meetings. The EQual rubric, a 14-item, five-point criterion-based anchor system, encompassing discrete units of work (DU), entrustable, essential, and important tasks of the profession (EEIT), and curricular role (CR), was used to evaluate the quality of TP-EPA3. Overall scores below 4.07, or scores for DU, EEIT, and CR domains below 4.17. 4.00, and 4.00, respectively, indicate the need for modifications. RESULTS: The TP-EPA3 demonstrated good validity, surpassing the required cut-off score with an average overall EQual score of 4.21 (SD = 0.41). Specific domain scores for DU, EEIT, and CR were 3.90 (SD = 0.69), 4.46 (SD = 0.44), and 4.42 (SD = 0.45), respectively. Subsequent revisions clarified observation contexts, enhancing specificity and focus. Further validation of the revised TP-EPA3 and a thorough examination of its reliability and validity are needed. CONCLUSION: The successful validation of TP-EPA3 suggests its potential as a valid assessment tool in occupational therapy education, offering a structured approach for developing competency in providing health education and consultation. This process model for EPA development and validation can guide occupational therapists in creating tailored EPAs for diverse specialties and settings.

Development and Psychometric Examination of a New Social Competence Outcome Measure for Children with Autism Spectrum Disorder: The Observational Social Competence Assessment.

Current assessments of social competence for children with autism spectrum disorder (ASD) are mostly designed for screening or diagnosis, not for measuring outcomes. This study aimed to develop a professional-administrated outcome measure, the Observational Social Competence Assessment (OSCA), and examine its psychometric properties. The OSCA was constructed based on a multidimensional view of social competence (i.e., social skill elements, social reciprocity, and social adjustment). For psychometric evaluation, 89 children with ASD between 3 and 12 years (mean = 70.69 months, SD = 15.31) were assessed with the OSCA and with assessments of ASD symptoms, verbal comprehension ability, and adaptive function. The results show that the OSCA has good internal consistency (Cronbach's α = 0.820-0.954), test-retest reliability (intraclass correlation coefficients [ICC] = 0.917-0.960), and inter-rater reliability (ICC = 0.905-0.974). The OSCA also has good convergent (r = 0.508-0.703, p < 0.01) and divergent validity (r = 0.105, p = 0.496), as well as good responsiveness to changes in the social adjustment dimension (Cohen's d = 1.26 and standardized response mean [SRM] = 1.92). Conclusively, these results show that the OSCA is sufficiently reliable, valid and responsive to be applied as an outcome measure of social competence in children with ASD.

Responsiveness of the psychoeducational profile-third edition for children with autism spectrum disorders.

The aim of this study was to examine the responsiveness of the Psychoeducational Profile-third edition (PEP-3) in children with Autism Spectrum Disorders (ASD). We investigated the responsiveness in terms of three types of scores (i.e., raw scores, developmental ages, and percentile ranks) of the subtests and composites of the PEP-3 and three methods of analysis were used: effect size, standardized response mean, and paired t test. The findings generally support the use of the PEP-3 as an outcome measure. We suggest using the raw scores and developmental ages of the PEP-3 when evaluating program effectiveness and developmental changes for children with ASD.