Implementation Outcomes Assessment of a Digital Clinical Support Tool for Intrapartum Care in Rural Kenya: Observational Analysis.

BACKGROUND: iDeliver, a digital clinical support system for maternal and neonatal care, was developed to support quality of care improvements in Kenya. OBJECTIVE: Taking an implementation research approach, we evaluated the adoption and fidelity of iDeliver over time and assessed the feasibility of its use to provide routine Ministry of Health (MOH) reports. METHODS: We analyzed routinely collected data from iDeliver, which was implemented at the Transmara West Sub-County Hospital from December 2018 to September 2020. To evaluate its adoption, we assessed the proportion of actual facility deliveries that was recorded in iDeliver over time. We evaluated the fidelity of iDeliver use by studying the completeness of data entry by care providers during each stage of the labor and delivery workflow and whether the use reflected iDeliver's envisioned function. We also examined the data completeness of the maternal and neonatal indicators prioritized by the Kenya MOH. RESULTS: A total of 1164 deliveries were registered in iDeliver, capturing 45.31% (1164/2569) of the facility's deliveries over 22 months. This uptake of registration improved significantly over time by 6.7% (SE 2.1) on average in each quarter-year (P=.005), from 9.6% (15/157) in the fourth quarter of 2018 to 64% (235/367) in the third quarter of 2020. Across iDeliver's workflow, the overall completion rate of all variables improved significantly by 2.9% (SE 0.4) on average in each quarter-year (P<.001), from 22.25% (257/1155) in the fourth quarter of 2018 to 49.21% (8905/18,095) in the third quarter of 2020. Data completion was highest for the discharge-labor summary stage (16,796/23,280, 72.15%) and lowest for the labor signs stage (848/5820, 14.57%). The completion rate of the key MOH indicators also improved significantly by 4.6% (SE 0.5) on average in each quarter-year (P<.001), from 27.1% (69/255) in the fourth quarter of 2018 to 83.75% (3346/3995) in the third quarter of 2020. CONCLUSIONS: iDeliver's adoption and data completeness improved significantly over time. The assessment of iDeliver' use fidelity suggested that some features were more easily used because providers had time to enter data; however, there was low use during active childbirth, which is when providers are necessarily engaged with the woman and newborn. These insights on the adoption and fidelity of iDeliver use prompted the team to adapt the application to reflect the users' culture of use and further improve the implementation of iDeliver.

Understanding incentive preferences of community health workers using discrete choice experiments: a multicountry protocol for Kenya, Uganda, Bangladesh and Haiti.

INTRODUCTION: There is a renewed global interest in improving community health worker (CHW) programmes. For CHW programmes to be effective, key intervention design factors which contribute to the performance of CHWs need to be identified. The recent WHO guidelines recommends the combination of financial and non-financial incentives to improve CHW performance. However, evidence gaps remain as to what package of incentives will improve their performance in different country contexts. This study aims to evaluate CHW incentive preferences to improve performance and retention which will strengthen CHW programmes and help governments leverage limited resources appropriately. METHODS AND ANALYSIS: A discrete choice experiment (DCE) will be conducted with CHWs in Bangladesh, Haiti, Kenya and Uganda with different levels of maturity of CHWs programmes. This will be carried out in two phases. Phase 1 will involve preliminary qualitative research including focus group discussions (FGDs) and key informant interviews to develop the DCE design which will include attributes relevant to the CHW country settings. Phase 2 will involve a DCE survey with CHWs, presenting them with a series of job choices with varying attribute levels. An orthogonal design will be used to generate the choice sets for the surveys. The surveys will be administered in locally-appropriate languages to at least 150 CHWs from each of the cadres in each country. Conditional and mixed multinomial logit (MMNL) models will be used for the estimation of stated preferences. ETHICS AND DISSEMINATION: This study has been reviewed and approved by the Population Council's Institutional Review Board in New York, and appropriate ethics review boards in Kenya, Uganda, Bangladesh and Haiti. The results of the study will be disseminated through in-country dissemination workshops, meetings with country-level stakeholders and policy working groups, print media, online blogs and peer-reviewed journals.

The impact of India's accredited social health activist (ASHA) program on the utilization of maternity services: a nationally representative longitudinal modelling study.

BACKGROUND: In 2006, the Government of India launched the accredited social health activist (ASHA) program, with the goal to connect marginalized communities to the health care system. We assessed the effect of the ASHA program on the utilization of maternity services. METHODS: We used data from Indian Human Development Surveys done in 2004-2005 and in 2011-2012 to assess demographic and socioeconomic factors associated with the receipt of ASHA services, and used difference-in-difference analysis with cluster-level fixed effects to assess the effect of the program on the utilization of at least one antenatal care (ANC) visit, four or more ANC visits, skilled birth attendance (SBA), and giving birth at a health facility. RESULTS: Substantial variations in the receipt of ASHA services were reported with 66% of women in northeastern states, 30% in high-focus states, and 16% of women in other states. In areas where active ASHA activity was reported, the poorest women, and women belonging to scheduled castes and other backward castes, had the highest odds of receiving ASHA services. Exposure to ASHA services was associated with a 17% (95% CI 11.8-22.1) increase in ANC-1, 5% increase in four or more ANC visits (95% CI - 1.6-11.1), 26% increase in SBA (95% CI 20-31.1), and 28% increase (95% CI 22.4-32.8) in facility births. CONCLUSIONS: Our results suggest that the ASHA program is successfully connecting marginalized communities to maternity health services. Given the potential of the ASHA in impacting service utilization, we emphasize the need to strengthen strategies to recruit, train, incentivize, and retain ASHAs.

Are stage-based health information messages effective and good value for money in improving maternal newborn and child health outcomes in India? Protocol for an individually randomized controlled trial.

BACKGROUND: Evidence is limited on the effectiveness of mobile health programs which provide stage-based health information messages to pregnant and postpartum women. Kilkari is an outbound service that delivers weekly, stage-based audio messages about pregnancy, childbirth, and childcare directly to families in 13 states across India on their mobile phones. In this protocol we outline methods for measuring the effectiveness and cost-effectiveness of Kilkari. METHODS: The study is an individually randomized controlled trial (iRCT) with a parallel, partially concurrent, and unblinded design. Five thousand pregnant women will be enrolled from four districts of Madhya Pradesh and randomized to an intervention or control arm. The women in the intervention arm will receive Kilkari messages while the control group will not receive any Kilkari messages as part of the study. Women in both arms will be followed from enrollment in the second and early third trimesters of pregnancy until one year after delivery. Differences in primary outcomes across study arms including early and exclusive breastfeeding and the adoption of modern contraception at 1 year postpartum will be assessed using intention to treat methodology. Surveys will be administered at baseline and endline containing modules on phone ownership, geographical and demographic characteristics, knowledge, practices, respectful maternity care, and coverage for antenatal care, delivery, and postnatal care. In-depth interviews and focus group discussions will be carried out to understand user perceptions of Kilkari, and more broadly, experiences providing phone numbers and personal health information to health care providers. Costs and consequences will be estimated from a societal perspective for the 2018-2019 analytic time horizon. DISCUSSION: Kilkari is the largest maternal messaging program, in terms of absolute numbers, currently being implemented globally. Evaluations of similar initiatives elsewhere have been small in scale and focused on summative outcomes, presenting limited evidence on individual exposure to content. Drawing upon system-generated data, we explore linkages between successful receipt of calls, user engagement with calls, and reported outcomes. This is the first study of its kind in India and is anticipated to provide the most robust and comprehensive evidence to date on maternal messaging programs globally. TRIAL REGISTRATION: Clinicaltrials.gov, 90075552, NCT03576157 . Registered on 22 June 2018.

Setting the global research agenda for community health systems: literature and consultative review.

BACKGROUND: Globally, there is renewed interest in and momentum for strengthening community health systems, as also emphasized by the recent Astana Declaration. Recent reviews have identified factors critical to successful community health worker (CHW) programs but pointed to significant evidence gaps. This review aims to propose a global research agenda to strengthen CHW programs. METHODS AND RESULTS: We conducted a search for extant systematic reviews on any intermediate factors affecting the effectiveness of CHW programs in February 2018. A total of 30 articles published after year 2000 were included. Data on research gaps were abstracted and summarized under headings based on predominant themes identified in the literature. Following this data gathering phase, two technical advisory groups comprised of experts in the field of community health-including policymakers, implementors, researchers, advocates and donors-were convened to discuss, validate, and prioritize the research gaps identified. Research gap areas that were identified in the literature and validated through expert consultation include selection and training of CHWs, community embeddedness, institutionalization of CHW programs (referrals, supervision, and supply chain), CHW needs including incentives and remuneration, governance and sustainability of CHW programs, performance and quality of care, and cost-effectiveness of CHW programs. Priority research questions included queries on effective policy, financing, governance, supervision and monitoring systems for CHWs and community health systems, implementation questions around the role of digital technologies, CHW preferences, and drivers of CHW motivation and retention over time. CONCLUSIONS: As international interest and investment in CHW programs and community health systems continue to grow, it becomes critical not only to analyze the evidence that exists, but also to clearly define research questions and collect additional evidence to ensure that CHW programs are effective, efficient, equity promoting, and evidence based. Generally, the literature places a strong emphasis on the need for higher quality, more robust research.

Mobile Phone Interventions for Adolescent Sexual and Reproductive Health: A Systematic Review.

CONTEXT: Interventions for adolescent sexual and reproductive health (ASRH) are increasingly using mobile phones but may not effectively report evidence. OBJECTIVE: To assess strategies, findings, and quality of evidence on using mobile phones to improve ASRH by using the mHealth Evidence Reporting and Assessment (mERA) checklist recently published by the World Health Organization mHealth Technical Evidence Review Group. DATA SOURCES: Systematic searches of 8 databases for peer-reviewed studies published January 2000 through August 2014. STUDY SELECTION: Eligible studies targeted adolescents ages 10 to 24 and provided results from mobile phone interventions designed to improve ASRH. DATA EXTRACTION: Studies were evaluated according to the mERA checklist, covering essential mHealth criteria and methodological reporting criteria. RESULTS: Thirty-five articles met inclusion criteria. Studies reported on 28 programs operating at multiple levels of the health care system in 7 countries. Most programs (82%) used text messages. An average of 41% of essential mHealth criteria were met (range 14%-79%). An average of 82% of methodological reporting criteria were met (range 52%-100%). Evidence suggests that inclusion of text messaging in health promotion campaigns, sexually transmitted infection screening and follow-up, and medication adherence may lead to improved ASRH. LIMITATIONS: Only 3 articles reported evidence from lower- or middle-income countries, so it is difficult to draw conclusions for these settings. CONCLUSIONS: Evidence on mobile phone interventions for ASRH published in peer-reviewed journals reflects a high degree of quality in methods and reporting. In contrast, current reporting on essential mHealth criteria is insufficient for understanding, replicating, and scaling up mHealth interventions.

Family Planning Counseling in Your Pocket: A Mobile Job Aid for Community Health Workers in Tanzania.

To address low contraceptive use in Tanzania, a pilot intervention using a mobile job aid was developed to guide community health workers (CHWs) to deliver integrated counseling on family planning, HIV, and other sexually transmitted infections (STIs). In this article, we describe the process of developing the family planning algorithms and implementation of the mobile job aid, discuss how the job aid supported collection of real-time data for decision making, and present the cost of the overall system based on an evaluation of the pilot. The family planning algorithm was developed, beginning in June 2011, in partnership with the Tanzania Ministry of Health and Social Welfare based on a combination of evidence-based tools such as the Balanced Counseling Strategy Plus Toolkit. The pilot intervention and study was implemented with 25 CHWs in 3 wards in Ilala district in Dar es Salaam between January 2013 and July 2013. A total of 710 family planning users (455 continuing users and 255 new users) were registered and counseled using the mobile job aid over the 6-month intervention period. All users were screened for current pregnancy, questioned on partner support for contraceptive use, counseled on a range of contraceptives, and screened for HIV/STI risk. Most new and continuing family planning users chose pills and male condoms (59% and 73%, respectively). Pills and condoms were provided by the CHW at the community level. Referrals were made to the health facility for pregnancy confirmation, injectable contraceptives, long-acting reversible contraceptives and HIV/STI testing. Follow-up visits with clients were planned to confirm completion of the health facility referral. The financial cost of implementing this intervention with 25 CHWs and 3 supervisors are estimated to be US$26,000 for the first year. For subsequent years, the financial costs are estimated to be 73% lower at $7,100. Challenges such as limited client follow-up by CHWs and use of data by supervisors identified during the pilot are currently being addressed during the scale-up phase by developing accountability and incentive mechanisms for CHWs and dashboards for data access and use.

An evaluation of a family planning mobile job aid for community health workers in Tanzania.

OBJECTIVES: The global rapid growth in mobile technology provides unique opportunities to support community health workers (CHWs) in providing family planning (FP) services. FHI 360, Pathfinder International and D-tree International developed an evidence-based mobile job aid to support CHW counseling, screening, service provision and referrals, with mobile forms for client and service data, and text-message reporting and reminders. The purpose of this study is to evaluate the acceptability and potential benefits to service quality from the perspective of CHWs and their clients. STUDY DESIGN: The mobile job aid was piloted in Dar es Salaam, Tanzania. Data collection tools included a demographic survey of all 25 CHWs trained to use the mobile job aid, in-depth interviews with 20 of the CHWs after 3 months and a survey of 176 clients who received FP services from a CHW using the mobile job aid after 6 months. RESULTS: Both CHWs and their clients reported that the mobile job aid was a highly acceptable FP support tool. CHWs perceived benefits to service quality, including timelier and more convenient care; better quality of information; increased method choice; and improved privacy, confidentiality and trust with clients. Most clients discussed multiple FP methods with CHWs; only 1 in 10 clients reported discussion of all 9 methods. CONCLUSIONS: This research suggests that mobile phones can be effective tools to support CHWs with FP counseling, screening and referrals, data collection and reporting, and communication. Challenges remain to support informed contraceptive choice. Future research should focus on implementation, including scale-up and sustainability. IMPLICATIONS: Mobile job aids can uniquely enhance FP service provision at the community level through adherence to standard protocols, real-time feedback and technical assistance, and provision of confidential care. This study can inform future efforts to support and expand the role of CHWs in increasing FP access and informed contraceptive choice.

Sustainable Cost Models for mHealth at Scale: Modeling Program Data from m4RH Tanzania.

BACKGROUND: There is increasing evidence that mobile phone health interventions ("mHealth") can improve health behaviors and outcomes and are critically important in low-resource, low-access settings. However, the majority of mHealth programs in developing countries fail to reach scale. One reason may be the challenge of developing financially sustainable programs. The goal of this paper is to explore strategies for mHealth program sustainability and develop cost-recovery models for program implementers using 2014 operational program data from Mobile for Reproductive Health (m4RH), a national text-message (SMS) based health communication service in Tanzania. METHODS: We delineated 2014 m4RH program costs and considered three strategies for cost-recovery for the m4RH program: user pay-for-service, SMS cost reduction, and strategic partnerships. These inputs were used to develop four different cost-recovery scenarios. The four scenarios leveraged strategic partnerships to reduce per-SMS program costs and create per-SMS program revenue and varied the structure for user financial contribution. Finally, we conducted break-even and uncertainty analyses to evaluate the costs and revenues of these models at the 2014 user volume (125,320) and at any possible break-even volume. RESULTS: In three of four scenarios, costs exceeded revenue by $94,596, $34,443, and $84,571 at the 2014 user volume. However, these costs represented large reductions (54%, 83%, and 58%, respectively) from the 2014 program cost of $203,475. Scenario four, in which the lowest per-SMS rate ($0.01 per SMS) was negotiated and users paid for all m4RH SMS sent or received, achieved a $5,660 profit at the 2014 user volume. A Monte Carlo uncertainty analysis demonstrated that break-even points were driven by user volume rather than variations in program costs. CONCLUSIONS: These results reveal that breaking even was only probable when all SMS costs were transferred to users and the lowest per-SMS cost was negotiated with telecom partners. While this strategy was sustainable for the implementer, a central concern is that health information may not reach those who are too poor to pay, limiting the program's reach and impact. Incorporating strategies presented here may make mHealth programs more appealing to funders and investors but need further consideration to balance sustainability, scale, and impact.

What do they do? Interactions between village doctors and medical representatives in Chakaria, Bangladesh.

BACKGROUND: Informally trained village doctors supply the majority of healthcare services to the rural poor in many developing countries. This study describes the demographic and socio-economic differences between medical representatives (MRs) and village doctors in rural Bangladesh, and explores the nature of their interactions. METHODS: This study was conducted in Chakaria, a rural sub-district of Bangladesh. Focus group discussions and in-depth interviews were conducted, along with a quantitative survey to understand practice perceptions. Data analysis was performed using grounded theory and bivariate statistical tests. RESULTS: We surveyed 43 MRs and 83 village doctors through 22 focus group discussions and 33 in-depth interviews. MRs have a higher average per capita monthly expenditure compared to village doctors. MRs are better educated with 98% having bachelor's degrees whereas 84% of village doctors have twelfth grade education or less (p<0.001). MRs are the principal information source about new medications for the village doctors. Furthermore, incentives offered by MRs and credit availability influence the prescription practices of village doctors. CONCLUSIONS: MRs being the key player in providing information about drugs to village doctors might influence their prescription practices. Improvements in the quality of healthcare delivered to the rural poor in informal provider-based health markets require stricter regulations and educational initiatives for providers and MRs.