Under-five mortality before and after implementation of the Liberia National Community Health Assistant (NCHA) program: A study protocol.

Between 2018 and 2022 the Liberian Government implemented the National Community Health Assistant (NCHA) program to improve provision of maternal and child health care to underserved rural areas of the country. Whereas the contributions of this and similar community health worker (CHW) based healthcare programs have been associated with improved process measures, the impact of a governmental CHW program at scale on child mortality has not been fully established. We will conduct a cluster sampled, community-based survey with landmark event calendars to retrospectively assess child births and deaths among all children born to women in the Grand Bassa District of Liberia. We will use a mixed effects Cox proportional hazards model, taking advantage of the staggered program implementation in Grand Bassa districts over a period of 4 years to compare rates of under-5 child mortality between the pre- and post-NCHA program implementation periods. This study will be the first to estimate the impact of the Liberian NCHA program on under-5 mortality.

Measuring health system responsiveness in a national community health worker primary care programme in rural Liberia.

As many low- and middle-income countries scale up community health worker (CHW) programmes to achieve universal health coverage, ensuring quality as well as access is critical. Health system responsiveness (HSR) is a core domain of quality patient-centred care but has not been widely measured in CHW-delivered care. We report results from a household survey measuring HSR and health systems' quality of CHW-delivered care in two Liberian counties where the national CHW programme of Community Health Assistants (CHAs) for communities ≥5 km from a health centre has been implemented. We conducted a cross-sectional population-based household survey in 2019 in Rivercess (RC) and Grand Gedeh (GG) counties, using a two-stage cross-sectional cluster sampling approach. We included validated HSR questions on six responsiveness domains and patient-reported health system outcomes, such as satisfaction and trust in the CHA's skills and abilities. The HSR questions were administered to women aged 18-49 years who reported seeking care from a CHA in the 3 months prior to the survey. A composite responsiveness score was calculated and divided into tertiles. Multivariable analysis using Poisson regression with log link and adjusting for respondent characteristics was used to determine the association between responsiveness and patient-reported health system outcomes. The proportion of individuals rating responsiveness as very good or excellent was similar across all domains within a district, with ratings being lower in RC (23-29%) than in GG (52-59%). High ratings in both counties were seen for high trust in the CHA's skills and abilities (GG 84%, RC 75%) and high confidence in the CHA (GG 58%, RC 60%). Compared with women in the lowest responsiveness tertile (score ≤3), women in the highest tertile (score $ \ge $4.25) were significantly more likely to report high quality of CHA-delivered care (prevalence ratio, PR = 14.1), very good/excellent at meeting health needs (PR = 8.0), high confidence in the CHA to provide future care (PR = 2.4), and a high level of trust in CHA's skills and abilities (PR = 1.4). Controlling for respondent characteristics, the composite responsiveness score was significantly associated with all patient-reported health system outcomes (P < 0.001). We found that HSR was associated with important patient-reported health system quality outcomes, including satisfaction, trust, and confidence in the CHA. Measuring patients' experience and outcomes of care is important to complement more common measures of technical quality for CHW-delivered care to ensure that this domain of quality is central to the community health programme design and delivery.

Impact of the Liberian National Community Health Assistant Program on childhood illness care in Grand Bassa County, Liberia.

Liberia launched its National Community Health Assistant Program in 2016, which seeks to ensure that all people living 5 kilometers or farther from a health facility have access to trained, supplied, supervised, and paid community health workers (CHWs). This study aims to evaluate the impact of the national program following implementation in Grand Bassa County in 2018 using data from population-based surveys that included information on 1291 illness episodes. We measured before-to-after changes in care for childhood illness by qualified providers in a portion of the county that implemented in a first phase compared to those which had not yet implemented. We also assessed changes in whether children received oral rehydration therapy for diarrhea and malaria rapid diagnostic tests if they had a fever by a qualified provider (facility based or CHW). For these analyses, we used a difference-in-differences approach and adjusted for potential confounding using inverse probability of treatment weighting. We also assessed changes in the source from which care was received and examined changes by key dimensions of equity (distance from health facilities, maternal education, and household wealth). We found that care of childhood illness by a qualified provider increased by 60.3 percentage points (95%CI 44.7-76.0) more in intervention than comparison areas. Difference-in-differences for oral rehydration therapy and malaria rapid diagnostic tests were 37.6 (95%CI 19.5-55.8) and 38.5 (95%CI 19.9-57.0) percentage points, respectively. In intervention areas, care by a CHW increased from 0 to 81.6% and care from unqualified providers dropped. Increases in care by a qualified provider did not vary significantly by household wealth, remoteness, or maternal education. This evaluation found evidence that the Liberian National Community Health Assistant Program has increased access to effective care in rural Grand Bassa County. Improvements were approximately equal across three measured dimensions of marginalization.

Measuring Knowledge of Community Health Workers at the Last Mile in Liberia: Feasibility and Results of Clinical Vignette Assessments.

INTRODUCTION: Community health workers (CHWs) can provide lifesaving treatment for children in remote areas, but high-quality care is essential for effective delivery. Measuring the quality of community-based care in remote areas is logistically challenging. Clinical vignettes have been validated in facility settings as a proxy for competency. We assessed feasibility and effectiveness of clinical vignettes to measure CHW knowledge of integrated community case management (iCCM) in Liberia's national CHW program. METHODS: We developed 3 vignettes to measure knowledge of iCCM illnesses (malaria, diarrhea, and pneumonia) in 4 main areas: assessment, diagnosis, treatment, and caregiver instructions. Trained nurse supervisors administered the vignettes to CHWs in 3 counties in rural Liberia as part of routine program supervision between January and May 2019, collected data on CHW knowledge using a standardized checklist tool, and provided feedback and coaching to CHWs in real time after vignette administration. Proportions of vignettes correctly managed, including illness classification, treatment, and referral where necessary, were calculated. We assessed feasibility, defined as the ability of clinical supervisors to administer the vignettes integrated into their routine activities once per year for each CHW, and effectiveness, defined as the ability of the vignettes to measure the primary outcomes of CHW knowledge of diagnosis and treatment including referrals. RESULTS: We were able to integrate this assessment into routine supervision, facilitate real-time coaching, and collect data on iCCM knowledge among 155 CHWs through delivery of 465 vignettes. Diagnosis including severity was correct in 65%-82% of vignettes. CHWs correctly identified danger signs in 44%-50% of vignettes, correctly proposed referral to the facility in 63% of vignettes including danger signs, and chose correct lifesaving treatment in 23%-65% of vignettes. Both diagnosis and lifesaving treatment rates were highest for malaria and lowest for severe pneumonia. CONCLUSION: Administration of vignettes to assess knowledge of correct iCCM case management was feasible and effective in producing results in this setting. Proportions of correct diagnosis and lifesaving treatment varied, with high proportions for uncomplicated disease, but lower for more severe cases, with accurate recognition of danger signs posing a challenge. Future work includes validation of vignettes for use with CHWs through direct observation, strengthening supportive supervision, and program interventions to address identified knowledge gaps.