Building Provincial Mental Health Capacity in Primary Care: An Evaluation of a Project ECHO Mental Health Program.

OBJECTIVE: Project Extension for Community Healthcare Outcomes (Project ECHO©) addresses urban-rural disparities in access to specialist care by building primary care provider (PCP) capacity through tele-education. Evidence supporting the use of this model for mental health care is limited. Therefore, this study evaluated a mental health and addictions-focused ECHO program. Primary outcome measures were PCP knowledge and perceived self-efficacy. Secondary objectives included: satisfaction, engagement, and sense of professional isolation. PCP knowledge and self-efficacy were hypothesized to improve with participation. METHODS: Using Moore's evaluation framework, we evaluated the ECHO program on participant engagement, satisfaction, learning, and competence. A pre-post design and weekly questionnaires measured primary and secondary outcomes, respectively. RESULTS: Knowledge test performance and self-efficacy ratings improved post-ECHO (knowledge change was significant, p < 0.001, d = 1.13; self-efficacy approached significance; p = 0.056, d = 0.57). Attrition rate was low (7.7%) and satisfaction ratings were high across all domains, with spokes reporting reduced feelings of isolation. DISCUSSION: This is the first study to report objective mental health outcomes related to Project ECHO. The results indicate high-participant retention is achievable, and provide preliminary evidence for increased knowledge and self-efficacy. These findings suggest this intervention may improve mental health management in primary care.

Adapting the Consolidated Framework for Implementation Research to Create Organizational Readiness and Implementation Tools for Project ECHO.

The Project Extension for Community Healthcare Outcomes (ECHO) model expands primary care provider (PCP) capacity to manage complex diseases by sharing knowledge, disseminating best practices, and building a community of practice. The model has expanded rapidly, with over 140 ECHO projects currently established globally. We have used validated implementation frameworks, such as Damschroder's (2009) Consolidated Framework for Implementation Research (CFIR) and Proctor's (2011) taxonomy of implementation outcomes, combined with implementation experience to (1) create a set of questions to assess organizational readiness and suitability of the ECHO model and (2) provide those who have determined ECHO is the correct model with a checklist to support successful implementation. A set of considerations was created, which adapted and consolidated CFIR constructs to create ECHO-specific organizational readiness questions, as well as a process guide for implementation. Each consideration was mapped onto Proctor's (2011) implementation outcomes, and questions relating to the constructs were developed and reviewed for clarity. The Preimplementation list included 20 questions; most questions fall within Proctor's (2001) implementation outcome domains of "Appropriateness" and "Acceptability." The Process Checklist is a 26-item checklist to help launch an ECHO project; items map onto the constructs of Planning, Engaging, Executing, Reflecting, and Evaluating. Given that fidelity to the ECHO model is associated with robust outcomes, effective implementation is critical. These tools will enable programs to work through key considerations to implement a successful Project ECHO. Next steps will include validation with a diverse sample of ECHO projects.