RESUMO
BACKGROUND: There is a scarcity of evaluated tools to assess whether non-specialist providers achieve minimum levels of competency to effectively and safely deliver psychological interventions in low- and middle-income countries. The objective of this study was to evaluate the reliability and utility of the newly developed Working with children - Assessment of Competencies Tool (WeACT) to assess service providers' competencies in Gaza, Palestine. METHODS: The study evaluated; (1) psychometric properties of the WeACT based on observed role-plays by trainers/supervisors (N = 8); (2) sensitivity to change among service provider competencies (N = 25) using pre-and-post training WeACT scores on standardized role-plays; (3) in-service competencies among experienced service providers (N = 64) using standardized role-plays. RESULTS: We demonstrated moderate interrater reliability [intraclass correlation coefficient, single measures, ICC = 0.68 (95% CI 0.48-0.86)] after practice, with high internal consistency (α = 0.94). WeACT assessments provided clinically relevant information on achieved levels of competencies (55% of the competencies were scored as adequate pre-training; 71% post-training; 62% in-service). Pre-post training assessment saw significant improvement in competencies (W = -3.64; p < 0.001). CONCLUSION: This study demonstrated positive results on the reliability and utility of the WeACT, with sufficient inter-rater agreement, excellent internal consistency, sensitivity to assess change, and providing insight needs for remedial training. The WeACT holds promise as a tool for monitoring quality of care when implementing evidence-based care at scale.
RESUMO
OBJECTIVES: Compassion-focused therapy (CFT) has shown promise as a treatment for a number of clinical presentations; however, existing studies have not adequately addressed issues of treatment fidelity. The aims of the present study were to identify initial candidate items that may be included in a CFT therapist competence rating scale and to develop the behavioural indicators to anchor these items. DESIGN: The Delphi method was used to develop and operationalize the competencies required for inclusion in a CFT therapist competence rating scale over five rounds. METHODS: Face-to-face meetings with two CFT experts were conducted in rounds one, two, and five, and these were used to define and operationalize the competencies. Nine other CFT experts were invited to complete online surveys in rounds two and four. An 80% consensus level was applied to the online surveys. RESULTS: The resulting Compassion Focused Therapy Therapist Competence Rating Scale (CFT-TCRS) consisted of 23 competencies which were separated into 14 'CFT unique competencies' and nine 'Microskills'. There was high agreement about the included 'CFT unique competencies' and 'Microskills'; however, there were some differences in opinion about the specific content of some items. CONCLUSIONS: This is the first study that has attempted to reach consensus regarding the competencies and behavioural anchors for a CFT therapist competence rating scale. The next stage of development for the CFT-TCRS is to establish whether the scale can be reliably and validly used to evaluate CFT practice. PRACTITIONER POINTS: The Compassion Focused Therapy Therapist Competence Rating Scale (CFT-TCRS) is the first scale to operationalize the unique and generic competencies required to deliver compassion-focused therapy (CFT). The CFT-TCRS can be used as a learning guide for delivering CFT training and with further development could be used to assess therapist competence for CFT training courses, clinical practice, and treatment fidelity in research trials.