A conceptual framework for measuring community health workforce performance within primary health care systems.

BACKGROUND: With the 40th anniversary of the Declaration of Alma-Ata, a global effort is underway to re-focus on strengthening primary health care systems, with emphasis on leveraging community health workers (CHWs) towards the goal of achieving universal health coverage for all. Institutionalizing effective, sustainable community health systems is currently limited by a lack of standard metrics for measuring CHW performance and the systems they work within. Developed through iterative consultations, supported by the Bill & Melinda Gates Foundation and in partnership with USAID and UNICEF, this paper details a framework, list of indicators, and measurement considerations for monitoring CHW performance in low- and middle-income countries. METHODS: A review of peer-reviewed articles, reports, and global data collection tools was conducted to identify key measurement domains in monitoring CHW performance. Three consultations were successively convened with global stakeholders, community health implementers, advocates, measurement experts, and Ministry of Health representatives using a modified Delphi approach to build consensus on priority indicators. During this process, a structured, web-based survey was administered to identify the importance and value of specific measurement domains, sub-domains, and indicators determined through the literature reviews and initial stakeholder consultations. Indicators with more than 75% support from participants were further refined with expert qualitative input. RESULTS: Twenty-one sub-domains for measurement were identified including measurement of incentives for CHWs, supervision and performance appraisal, data use, data reporting, service delivery, quality of services, CHW absenteeism and attrition, community use of services, experience of services, referral/counter-referral, credibility/trust, and programmatic costs. Forty-six indicators were agreed upon to measure the sub-domains. In the absence of complete population enumeration and digitized health information systems, the quality of metrics to monitor CHW programs is limited. CONCLUSIONS: Better data collection approaches at the community level are needed to strengthen management of CHW programs and community health systems. The proposed list of metrics balances exhaustive and pragmatic measurement of CHW performance within primary healthcare systems. Adoption of the proposed framework and associated indicators by CHW program implementors may improve programmatic effectiveness, strengthen their accountability to national community health systems, drive programmatic quality improvement, and plausibly improve the impact of these programs.

Rapid Design and Delivery of an Experience-Based Co-designed Mobile App to Support the Mental Health Needs of Health Care Workers Affected by the COVID-19 Pandemic: Impact Evaluation Protocol.

BACKGROUND: The COVID-19 pandemic has highlighted the importance of health care workers' mental health and well-being for the successful function of the health care system. Few targeted digital tools exist to support the mental health of hospital-based health care workers, and none of them appear to have been led and co-designed by health care workers. OBJECTIVE: RMHive is being led and developed by health care workers using experience-based co-design (EBCD) processes as a mobile app to support the mental health challenges posed by the COVID-19 pandemic to health care workers. We present a protocol for the impact evaluation for the rapid design and delivery of the RMHive mobile app. METHODS: The impact evaluation will adopt a mixed methods design. Qualitative data from photo interviews undertaken with up to 30 health care workers and semistructured interviews conducted with up to 30 governance stakeholders will be integrated with qualitative and quantitative user analytics data and user-generated demographic and mental health data entered into the app. Analyses will address three evaluation questions related to engagement with the mobile app, implementation and integration of the app, and the impact of the app on individual mental health outcomes. The design and development will be described using the Mobile Health Evidence Reporting and Assessment guidelines. Implementation of the app will be evaluated using normalization process theory to analyze qualitative data from interviews combined with text and video analysis from the semistructured interviews. Mental health impacts will be assessed using the total score of the 4-item Patient Health Questionnaire (PHQ4) and subscale scores for the 2-item Patient Health Questionnaire for depression and the 2-item Generalized Anxiety Scale for anxiety. The PHQ4 will be completed at baseline and at 14 and 28 days. RESULTS: The anticipated average use period of the app is 30 days. The rapid design will occur over four months using EBCD to collect qualitative data and develop app content. The impact evaluation will monitor outcome data for up to 12 weeks following hospital-wide release of the minimal viable product release. The study received funding and ethics approvals in June 2020. Outcome data is expected to be available in March 2021, and the impact evaluation is expected to be published mid-2021. CONCLUSIONS: The impact evaluation will examine the rapid design, development, and implementation of the RMHive app and its impact on mental health outcomes for health care workers. Findings from the impact evaluation will provide guidance for the integration of EBCD in rapid design and implementation processes. The evaluation will also inform future development and rollout of the app to support the mental health needs of hospital-based health care workers more widely. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/26168.