Measuring health system responsiveness in a national community health worker primary care programme in rural Liberia.

As many low- and middle-income countries scale up community health worker (CHW) programmes to achieve universal health coverage, ensuring quality as well as access is critical. Health system responsiveness (HSR) is a core domain of quality patient-centred care but has not been widely measured in CHW-delivered care. We report results from a household survey measuring HSR and health systems' quality of CHW-delivered care in two Liberian counties where the national CHW programme of Community Health Assistants (CHAs) for communities ≥5 km from a health centre has been implemented. We conducted a cross-sectional population-based household survey in 2019 in Rivercess (RC) and Grand Gedeh (GG) counties, using a two-stage cross-sectional cluster sampling approach. We included validated HSR questions on six responsiveness domains and patient-reported health system outcomes, such as satisfaction and trust in the CHA's skills and abilities. The HSR questions were administered to women aged 18-49 years who reported seeking care from a CHA in the 3 months prior to the survey. A composite responsiveness score was calculated and divided into tertiles. Multivariable analysis using Poisson regression with log link and adjusting for respondent characteristics was used to determine the association between responsiveness and patient-reported health system outcomes. The proportion of individuals rating responsiveness as very good or excellent was similar across all domains within a district, with ratings being lower in RC (23-29%) than in GG (52-59%). High ratings in both counties were seen for high trust in the CHA's skills and abilities (GG 84%, RC 75%) and high confidence in the CHA (GG 58%, RC 60%). Compared with women in the lowest responsiveness tertile (score ≤3), women in the highest tertile (score $ \ge $4.25) were significantly more likely to report high quality of CHA-delivered care (prevalence ratio, PR = 14.1), very good/excellent at meeting health needs (PR = 8.0), high confidence in the CHA to provide future care (PR = 2.4), and a high level of trust in CHA's skills and abilities (PR = 1.4). Controlling for respondent characteristics, the composite responsiveness score was significantly associated with all patient-reported health system outcomes (P < 0.001). We found that HSR was associated with important patient-reported health system quality outcomes, including satisfaction, trust, and confidence in the CHA. Measuring patients' experience and outcomes of care is important to complement more common measures of technical quality for CHW-delivered care to ensure that this domain of quality is central to the community health programme design and delivery.

Measuring Knowledge of Community Health Workers at the Last Mile in Liberia: Feasibility and Results of Clinical Vignette Assessments.

INTRODUCTION: Community health workers (CHWs) can provide lifesaving treatment for children in remote areas, but high-quality care is essential for effective delivery. Measuring the quality of community-based care in remote areas is logistically challenging. Clinical vignettes have been validated in facility settings as a proxy for competency. We assessed feasibility and effectiveness of clinical vignettes to measure CHW knowledge of integrated community case management (iCCM) in Liberia's national CHW program. METHODS: We developed 3 vignettes to measure knowledge of iCCM illnesses (malaria, diarrhea, and pneumonia) in 4 main areas: assessment, diagnosis, treatment, and caregiver instructions. Trained nurse supervisors administered the vignettes to CHWs in 3 counties in rural Liberia as part of routine program supervision between January and May 2019, collected data on CHW knowledge using a standardized checklist tool, and provided feedback and coaching to CHWs in real time after vignette administration. Proportions of vignettes correctly managed, including illness classification, treatment, and referral where necessary, were calculated. We assessed feasibility, defined as the ability of clinical supervisors to administer the vignettes integrated into their routine activities once per year for each CHW, and effectiveness, defined as the ability of the vignettes to measure the primary outcomes of CHW knowledge of diagnosis and treatment including referrals. RESULTS: We were able to integrate this assessment into routine supervision, facilitate real-time coaching, and collect data on iCCM knowledge among 155 CHWs through delivery of 465 vignettes. Diagnosis including severity was correct in 65%-82% of vignettes. CHWs correctly identified danger signs in 44%-50% of vignettes, correctly proposed referral to the facility in 63% of vignettes including danger signs, and chose correct lifesaving treatment in 23%-65% of vignettes. Both diagnosis and lifesaving treatment rates were highest for malaria and lowest for severe pneumonia. CONCLUSION: Administration of vignettes to assess knowledge of correct iCCM case management was feasible and effective in producing results in this setting. Proportions of correct diagnosis and lifesaving treatment varied, with high proportions for uncomplicated disease, but lower for more severe cases, with accurate recognition of danger signs posing a challenge. Future work includes validation of vignettes for use with CHWs through direct observation, strengthening supportive supervision, and program interventions to address identified knowledge gaps.