Feasibility and acceptability of a volunteer peer fidelity assessment model in early psychosis intervention programmes in Ontario: Results from a pilot study.

AIM: Fidelity monitoring can support high-quality service delivery but is resource-intensive to implement. A fidelity assessment model utilizing volunteer assessors was trialled as a low-cost strategy for conducting fidelity assessments. This article reports on the acceptability and feasibility of this model. METHODS: Twenty volunteer assessors were trained to conduct fidelity assessments in nine Early Psychosis Intervention programmes across Ontario, Canada. Assessments were conducted using the First-Episode Psychosis Services Fidelity Scale based on a 2-day site visit, during which assessors interviewed staff, clients and families; reviewed charts; observed a team meeting and reviewed programme materials. The model was evaluated based on assessor focus groups, programme interviews, consensus meeting data and time-tracking logs. General inductive analysis was used to code and synthesize qualitative data. Quantitative data were aggregated and summarized. RESULTS: Participant feedback was positive and indicated that use of peer assessors and the in-person site visit added value to the process. The model was perceived to provide valuable information to support internal quality improvement efforts. Assessors reported direct benefits from participating, including networking and learning opportunities. Key challenges were the high time demand on assessors and turnover in the assessor team. CONCLUSIONS: The volunteer peer fidelity model was perceived to be a valuable improvement process by participants, but the high cost and reliance on ongoing volunteerism makes its sustainability uncertain. Next steps may include exploring remote assessment strategies or direct payments, although these strategies risk reducing the acceptability, and therefore uptake, of the assessment.

Using Fidelity Measurement to Assess Quality of Early Psychosis Intervention Services in Ontario.

OBJECTIVES: The First Episode Psychosis Services Fidelity Scale (FEPS-FS) is a validated measure of program delivery in relation to international standards. This study assessed fidelity in Ontario programs and the utility of the FEPS-FS for program improvement. METHODS: Assessments were conducted in a volunteer sample of nine early psychosis intervention (EPI) programs. Thirty components of care were each rated on a 5-point scale; a rating of 4 indicates satisfactory performance. Trained assessor teams conducted site visits, and ratings were made by consensus. RESULTS: Program mean fidelity ratings ranged from 3.1 to 4.4 and exceeded 4 in five programs. Across the programs, item mean fidelity ratings ranged from 2.1 to 5 and exceeded 4 for 14 of 30 items. CONCLUSIONS: The FEPS-FS captured variation in program implementation and provided a baseline for measuring change. Additions to the scale are planned to address components of the Ontario EPI standards not covered by the FEPS-FS.