ABSTRACT
Persistent gaps exist in healthcare workers' capacity to address HIV and tuberculosis in Asia and Africa due to constraints in resources and knowledge. Project ECHO (Extension for Community Healthcare Outcomes) leverages video-enabled technology to build workforce capacity and promote collaboration through mentorship and case-based learning. To understand current perceptions of ECHO participants and develop a comprehensive evaluation framework for ECHO implementation, we utilized modified appreciative inquiry guided focus group discussions (FGD) in India and Tanzania and called it SCORE (Strengths, Challenges, Opportunities, Results, and Evaluation). Content and thematic analysis of transcripts from FGDs and key-informant interviews triangulated perceptions of diverse stakeholders about ECHO implementation and identified key elements for development of the framework. The perceived strengths (S) were capacity building and establishing communities of practice. The perceived challenges (C) included securing resources, engaging leadership, and building systems for monitoring impact. Improved internet connectivity, addressing logistical challenges, encouraging session interactivity, and having strategic scale-up plans were perceived opportunities (O). Additionally, gathering measurable results (R) led to development of a comprehensive evaluation (E) framework. Contextualizing and facilitating SCORE with qualitative analysis of findings 6-12 months post-ECHO implementation may serve as a best practice to assess mid-course corrections to improve ECHO implementation quality.
Subject(s)
Leadership , Mentors , Community Health Services , Focus Groups , Humans , Program EvaluationABSTRACT
Introduction: The United States Centers for Disease Control and Prevention (CDC), through U.S. President's Emergency Plan for AIDS Relief (PEPFAR), supports a third of all people receiving HIV care globally. CDC works with local partners to improve methods to find, treat, and prevent HIV and tuberculosis. However, a shortage of trained medical professionals has impeded efforts to control the HIV epidemic in Sub-Saharan Africa and Asia. The Project Extension for Community Healthcare Outcomes (ECHOTM) model expands capacity to manage complex diseases, share knowledge, disseminate best practices, and build communities of practice. This manuscript describes a practical protocol for an evaluation framework and toolkit to assess ECHO implementation. Methods and Analysis: This mixed methods, developmental evaluation design uses an appreciative inquiry approach, and includes a survey, focus group discussion, semi-structured key informant interviews, and readiness assessments. In addition, ECHO session content will be objectively reviewed for accuracy, content validity, delivery, appropriateness, and consistency with current guidelines. Finally, we offer a mechanism to triangulate data sources to assess acceptability and feasibility of the evaluation framework and compendium of monitoring and evaluation tools. Expected impact of the study on public health: This protocol offers a unique approach to engage diverse group of stakeholders using an appreciative inquiry process to co-create a comprehensive evaluation framework and a compendium of assessment tools. This evaluation framework utilizes mixed methods (quantitative and qualitative data collection tools), was pilot tested in Tanzania, and has the potential for contextualized use in other countries who plan to evaluate their Project ECHO implementation.
Subject(s)
Community Health Services , Public Health , Focus Groups , Humans , Surveys and Questionnaires , TanzaniaABSTRACT
BACKGROUND: Despite impressive decreases in under-five mortality, progress in reducing maternal and neonatal mortality in Tanzania has been slow. We present an evaluation of a cadre of maternal, newborn, and child health community health worker (MNCH CHW) focused on preventive and promotive services during the antenatal and postpartum periods in Morogoro Region, Tanzania. Study findings review the effect of several critical design elements on knowledge, time allocation, service delivery, satisfaction, and motivation. METHODS: A quantitative survey on service delivery and knowledge was administered to 228 (of 238 trained) MNCH CHWs. Results are compared against surveys administered to (1) providers in nine health centers (n = 88) and (2) CHWs (n = 53) identified in the same districts prior to the program's start. Service delivery outputs were measured by register data and through a time motion study conducted among a sub-sample of 33 randomly selected MNCH CHWs. RESULTS: Ninety-seven percent of MNCH CHWs (n = 228) were interviewed: 55% male, 58% married, and 52% with secondary school education or higher. MNCH CHWs when compared to earlier CHWs were more likely to be unmarried, younger, and more educated. Mean MNCH CHW knowledge scores were <50% for 8 of 10 MNCH domains assessed and comparable to those observed for health center providers but lower than those for earlier CHWs. MNCH CHWs reported covering a mean of 186 households and were observed to provide MNCH services for 5 h weekly. Attendance of monthly facility-based supervision meetings was nearly universal and focused largely on registers, yet data quality assessments highlighted inconsistencies. Despite program plans to provide financial incentives and bicycles for transport, only 56% of CHWs had received financial incentives and none received bicycles. CONCLUSIONS: Initial rollout of MNCH CHWs yields important insights into addressing program challenges. The social profile of CHWs was not significantly associated with knowledge or service delivery, suggesting a broader range of community members could be recruited as CHWs. MNCH CHW time spent on service delivery was limited but comparable to the financial incentives received. Service delivery registers need to be simplified to reduce inconsistencies and yet expanded to include indicators on the timing of antenatal and postpartum visits.