Profile, knowledge, and work patterns of a cadre of maternal, newborn, and child health CHWs focusing on preventive and promotive services in Morogoro Region, Tanzania.

BACKGROUND: Despite impressive decreases in under-five mortality, progress in reducing maternal and neonatal mortality in Tanzania has been slow. We present an evaluation of a cadre of maternal, newborn, and child health community health worker (MNCH CHW) focused on preventive and promotive services during the antenatal and postpartum periods in Morogoro Region, Tanzania. Study findings review the effect of several critical design elements on knowledge, time allocation, service delivery, satisfaction, and motivation. METHODS: A quantitative survey on service delivery and knowledge was administered to 228 (of 238 trained) MNCH CHWs. Results are compared against surveys administered to (1) providers in nine health centers (n = 88) and (2) CHWs (n = 53) identified in the same districts prior to the program's start. Service delivery outputs were measured by register data and through a time motion study conducted among a sub-sample of 33 randomly selected MNCH CHWs. RESULTS: Ninety-seven percent of MNCH CHWs (n = 228) were interviewed: 55% male, 58% married, and 52% with secondary school education or higher. MNCH CHWs when compared to earlier CHWs were more likely to be unmarried, younger, and more educated. Mean MNCH CHW knowledge scores were <50% for 8 of 10 MNCH domains assessed and comparable to those observed for health center providers but lower than those for earlier CHWs. MNCH CHWs reported covering a mean of 186 households and were observed to provide MNCH services for 5 h weekly. Attendance of monthly facility-based supervision meetings was nearly universal and focused largely on registers, yet data quality assessments highlighted inconsistencies. Despite program plans to provide financial incentives and bicycles for transport, only 56% of CHWs had received financial incentives and none received bicycles. CONCLUSIONS: Initial rollout of MNCH CHWs yields important insights into addressing program challenges. The social profile of CHWs was not significantly associated with knowledge or service delivery, suggesting a broader range of community members could be recruited as CHWs. MNCH CHW time spent on service delivery was limited but comparable to the financial incentives received. Service delivery registers need to be simplified to reduce inconsistencies and yet expanded to include indicators on the timing of antenatal and postpartum visits.

Comparing program supervision with an external RADAR evaluation of quality of care in integrated community case management for childhood illnesses in Mali.

BACKGROUND: Many countries have adopted integrated community case management (iCCM) to reduce mortality among children under five years from common childhood illnesses. The 2016-2020 Malian Red Cross iCCM program trained 441 Community Health Workers (CHWs) to treat malaria, pneumonia, diarrhea, and malnutrition for children under five years of age in six districts. Implementation strength and quality of care (QoC) were assessed through the program's supervision function, using the Malian Ministry of Health's system. OBJECTIVE: This paper compares methods and results of program supervision data and an independent evaluation to assess the effectiveness of program implementation and supervision and inform program improvement. It also presents the benefits and limitations of each method. METHOD: An independent QoC evaluation was conducted using tools developed by the Real Accountability: Data Analysis for Results (RADAR) project, hereafter referred to as the RADAR evaluation. RADAR evaluation data collected in July and August 2018 were compared with program supervision data collected mostly between May and December 2018. RESULTS: The RADAR evaluation provided detailed findings on correct assessment, classification, and treatment per illness, medication type, and dosage. Program supervision combined the findings for all illnesses, medication type, and dosage due to limitations in the data collection process. Six indicators were comparable between both methods. Findings were similar for temperature and mid-upper arm circumference measurements but diverged between program supervision and the RADAR evaluation, respectively, on correct classification for all illnesses (87.1% vs. 65.3%), correct treatment for all illnesses (69.5% vs. 39.8%), correct respiratory rate counting (88.5% vs. 54.7%), and administering the first dose by CHW (75.4% vs. 65.0%). Findings from the RADAR evaluation guided improvements in program supervision. CONCLUSIONS: A robust program supervision system can serve as a credible method to assess QoC. However, a rigorous independent QoC evaluation provides a valuable benchmark to gauge the effectiveness of the supervisory process.