Key learnings from an outcome and embedded process evaluation of a direct to beneficiary mobile health intervention among marginalised women in rural Bihar, India.

INTRODUCTION: Mobile Vaani was implemented as a pilot programme across six blocks of Nalanda district in Bihar state, India to increase knowledge of rural women who were members of self-help groups on proper nutrition for pregnant or lactating mothers and infants, family planning and diarrhoea management. Conveners of self-help group meetings, community mobilisers, introduced women to the intervention by giving them access to interactive voice response informational and motivational content. A mixed methods outcome and embedded process evaluation was commissioned to assess the reach and impact of Mobile Vaani. METHODS: The outcome evaluation, conducted from January 2017 to November 2018, used a quasi-experimental pre-post design with a sample of 4800 married women aged 15-49 from self-help group households, who had a live birth in the past 24 months. Surveys with community mobilisers followed by meeting observations (n=116), in-depth interviews (n=180) with self-help group members and secondary analyses of system generated data were conducted to assess exposure and perceptions of the intervention. RESULTS: From the outcome evaluation, 23% of women interviewed had heard about Mobile Vaani. Women in the intervention arm had significantly higher knowledge than women in the comparison arm for two of seven focus outcomes: knowledge of how to make child's food nutrient and energy dense (treatment-on-treated: 18.8% (95% CI 0.4% to 37.2%, p<0.045)) and awareness of at least two modern spacing family planning methods (treatment-on-treated: 17.6% (95% CI 4.7% to 30.5%, p<0.008)). Women with any awareness of Mobile Vaani were happy with the programme and appreciated the ability to call in and listen to the content. CONCLUSION: Low population awareness and programme exposure are underpinned by broader population level barriers to mobile phone access and use among women and missed opportunities by the programme to improve targeting and programme promotion. Further research is needed to assess programmatic linkages with changes in health practices.

Measuring gender attitudes: Developing and testing Implicit Association Tests for adolescents in India.

We develop and test gender attitude measures conducted with a school-based sample of adolescents aged 14-17 years in India. We test a measure with survey items and vignettes to capture gender-based value and stereotypes, an Implicit Association Test (IAT) capturing gender-based value, and an IAT capturing gender stereotype. All demonstrate good internal reliability, and both IATs are significantly associated with our survey measure suggesting criterion validity, though not confirming it due to the lack of a gold standard measure on gender attitudes. Finally, construct validity is indicated from the measures' positive significant associations with higher girls' mobility and education. The gender-related IAT tools developed are consistent and valid, and modestly correlated with gender-related behavior outcomes such as mobility and school enrolment.

Assessing the reliability of phone surveys to measure reproductive, maternal and child health knowledge among pregnant women in rural India: a feasibility study.

OBJECTIVES: Efforts to understand the factors influencing the uptake of reproductive, maternal, newborn, child health and nutrition (RMNCH&N) services in high disease burden low-resource settings have often focused on face-to-face surveys or direct observations of service delivery. Increasing access to mobile phones has led to growing interest in phone surveys as a rapid, low-cost alternatives to face-to-face surveys. We assess determinants of RMNCH&N knowledge among pregnant women with access to phones and examine the reliability of alternative modalities of survey delivery. PARTICIPANTS: Women 5-7 months pregnant with access to a phone. SETTING: Four districts of Madhya Pradesh, India. DESIGN: Cross-sectional surveys administered face-to-face and within 2 weeks, the same surveys were repeated among two random subsamples of the original sample: face-to-face (n=205) and caller-attended telephone interviews (n=375). Bivariate analyses, multivariable linear regression, and prevalence and bias-adjusted kappa scores are presented. RESULTS: Knowledge scores were low across domains: 52% for maternal nutrition and pregnancy danger signs, 58% for family planning, 47% for essential newborn care, 56% infant and young child feeding, and 58% for infant and young child care. Higher knowledge (≥1 composite score) was associated with older age; higher levels of education and literacy; living in a nuclear family; primary health decision-making; greater attendance in antenatal care and satisfaction with accredited social health activist services. Survey questions had low inter-rater and intermodal reliability (kappa<0.70) with a few exceptions. Questions with the lowest reliability included true/false questions and those with unprompted, multiple response options. Reliability may have been hampered by the sensitivity of the content, lack of privacy, enumerators' and respondents' profile differences, rapport, social desirability bias, and/or enumerator's ability to adequately convey concepts or probe. CONCLUSIONS: Phone surveys are a reliable modality for generating population-level estimates data about pregnant women's knowledge, however, should not be used for individual-level tracking. TRIAL REGISTRATION NUMBER: NCT03576157.

Does having a mobile phone matter? Linking phone access among women to health in India: An exploratory analysis of the National Family Health Survey.

BACKGROUND: The disruptive potential of mobile phones in catalyzing development is increasingly being recognized. However, numerous gaps remain in access to phones and their influence on health care utilization. In this cross-sectional study from India, we assess the gaps in women's access to phones, their influencing factors, and their influence on health care utilization. METHODS: Data drawn from the 2015 National Family Health Survey (NFHS) in India included a national sample of 45,231 women with data on phone access. Survey design weighted estimates of household phone ownership and women's access among different population sub-groups are presented. Multilevel logistic models explored the association of phone access with a wide range of maternal and child health indicators. Blinder-Oaxaca (BO) decomposition is used to decompose the gaps between women with and without phone access in health care utilization into components explained by background characteristics influencing phone access (endowments) and unexplained components (coefficients), potentially attributable to phone access itself. FINDINGS: Phone ownership at the household level was 92·8% (95% CI: 92·6-93·0%), with rural ownership at 91·1% (90·8-91·4%) and urban at 97.1% (96·7-97·3%). Women's access to phones was 47·8% (46·7-48·8%); 41·6% in rural areas (40·5-42·6%) and 62·7% (60·4-64·8%) in urban. Phone access in urban areas was positively associated with skilled birth attendance, postnatal care and use of modern contraceptives and negatively associated with early antenatal care. Phone access was not associated with improvements in utilization indicators in rural settings. Phone access (coefficient components) explained large gaps in the use of modern contraceptives, moderate gaps in postnatal care and early antenatal care, and smaller differences in the use of skilled birth attendance and immunization. For full antenatal car, phone access was associated with reducing gaps in utilization. INTERPRETATION: Women of reproductive age have significantly lower phone access use than the households they belong to and marginalized women have the least phone access. Existing phone access for rural women did not improve their health care utilization but was associated with greater utilization for urban women. Without addressing these biases, digital health programs may be at risk of worsening existing health inequities.

Are stage-based health information messages effective and good value for money in improving maternal newborn and child health outcomes in India? Protocol for an individually randomized controlled trial.

BACKGROUND: Evidence is limited on the effectiveness of mobile health programs which provide stage-based health information messages to pregnant and postpartum women. Kilkari is an outbound service that delivers weekly, stage-based audio messages about pregnancy, childbirth, and childcare directly to families in 13 states across India on their mobile phones. In this protocol we outline methods for measuring the effectiveness and cost-effectiveness of Kilkari. METHODS: The study is an individually randomized controlled trial (iRCT) with a parallel, partially concurrent, and unblinded design. Five thousand pregnant women will be enrolled from four districts of Madhya Pradesh and randomized to an intervention or control arm. The women in the intervention arm will receive Kilkari messages while the control group will not receive any Kilkari messages as part of the study. Women in both arms will be followed from enrollment in the second and early third trimesters of pregnancy until one year after delivery. Differences in primary outcomes across study arms including early and exclusive breastfeeding and the adoption of modern contraception at 1 year postpartum will be assessed using intention to treat methodology. Surveys will be administered at baseline and endline containing modules on phone ownership, geographical and demographic characteristics, knowledge, practices, respectful maternity care, and coverage for antenatal care, delivery, and postnatal care. In-depth interviews and focus group discussions will be carried out to understand user perceptions of Kilkari, and more broadly, experiences providing phone numbers and personal health information to health care providers. Costs and consequences will be estimated from a societal perspective for the 2018-2019 analytic time horizon. DISCUSSION: Kilkari is the largest maternal messaging program, in terms of absolute numbers, currently being implemented globally. Evaluations of similar initiatives elsewhere have been small in scale and focused on summative outcomes, presenting limited evidence on individual exposure to content. Drawing upon system-generated data, we explore linkages between successful receipt of calls, user engagement with calls, and reported outcomes. This is the first study of its kind in India and is anticipated to provide the most robust and comprehensive evidence to date on maternal messaging programs globally. TRIAL REGISTRATION: Clinicaltrials.gov, 90075552, NCT03576157 . Registered on 22 June 2018.

Development of a Phone Survey Tool to Measure Respectful Maternity Care During Pregnancy and Childbirth in India: Study Protocol.

BACKGROUND: Respectful maternity care (RMC) is a key barometer of the underlying quality of care women receive during pregnancy and childbirth. Efforts to measure RMC have largely been qualitative, although validated quantitative tools are emerging. Available tools have been limited to the measurement of RMC during childbirth and confined to observational and face-to-face survey modes. Phone surveys are less invasive, low cost, and rapid alternatives to traditional face-to-face methods, yet little is known about their validity and reliability. OBJECTIVE: The primary objective of this study was to develop validated face-to-face and phone survey tools for measuring RMC during pregnancy and childbirth for use in India and other low resource settings. The secondary objective was to optimize strategies for improving the delivery of phone surveys for use in measuring RMC. METHODS: To develop face-to-face and phone surveys for measuring RMC, we describe procedures for assessing content, criterion, and construct validity as well as reliability analyses. To optimize the delivery of phone surveys, we outline plans for substudies, which aim to assess the effect of survey modality, and content on survey response, completion, and attrition rates. RESULTS: Data collection will be carried out in 4 districts of Madhya Pradesh, India, from July 2018 to March 2019. CONCLUSIONS: To our knowledge, this is the first RMC phone survey tool developed for India, which may provide an opportunity for the rapid, routine collection of data essential for improving the quality of care during pregnancy and childbirth. Elsewhere, phone survey tools are emerging; however, efforts to develop these surveys are often not inclusive of rigorous pretesting activities essential for ensuring quality data, including cognitive, reliability, and validity testing. In the absence of these activities, emerging data could overestimate or underestimate the burden of disease and health care practices under assessment. In the context of RMC, poor quality data could have adverse consequences including the naming and shaming of providers. By outlining a blueprint of the minimum activities required to generate reliable and valid survey tools, we hope to improve efforts to develop and deploy face-to-face and phone surveys in the health sector. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/12173.

Effects of an mHealth intervention for community health workers on maternal and child nutrition and health service delivery in India: protocol for a quasi-experimental mixed-methods evaluation.

INTRODUCTION: Millions of children in India still suffer from poor health and under-nutrition, despite substantial improvement over decades of public health programmes. The Anganwadi centres under the Integrated Child Development Scheme (ICDS) provide a range of health and nutrition services to pregnant women, children <6 years and their mothers. However, major gaps exist in ICDS service delivery. The government is currently strengthening ICDS through an mHealth intervention called Common Application Software (ICDS-CAS) installed on smart phones, with accompanying multilevel data dashboards. This system is intended to be a job aid for frontline workers, supervisors and managers, aims to ensure better service delivery and supervision, and enable real-time monitoring and data-based decision-making. However, there is little to no evidence on the effectiveness of such large-scale mHealth interventions integrated with public health programmes in resource-constrained settings on the service delivery and subsequent health and nutrition outcomes. METHODS AND ANALYSIS: This study uses a village-matched controlled design with repeated cross-sectional surveys to evaluate whether ICDS-CAS can enable more timely and appropriate services to pregnant women, children <12 months and their mothers, compared with the standard ICDS programme. The study will recruit approximately 1500 Anganwadi workers and 6000+ mother-child dyads from 400+ matched-pair villages in Bihar and Madhya Pradesh. The primary outcomes are the proportion of beneficiaries receiving (a) adequate number of home visits and (b) appropriate level of counselling by the Anganwadi workers. Secondary outcomes are related to improvements in other ICDS services, and knowledge and practices of the Anganwadi workers and beneficiaries. ETHICS AND DISSEMINATION: Ethical oversight is provided by the Committee for the Protection of Human Subjects at the University of California at Berkeley, and the Suraksha Independent Ethics Committee in India. The results will be published in peer-reviewed journals and analysis data will be made public. TRIAL REGISTRATION NUMBER: ISRCTN83902145.

Associations between intimate partner violence and reproductive and maternal health outcomes in Bihar, India: a cross-sectional study.

BACKGROUND: Bihar, India has higher rates of intimate partner violence (IPV) and maternal and infant mortality relative to India as a whole. This study assesses whether IPV is associated with poor reproductive and maternal health outcomes, as well as whether poverty exacerbates any observed associations, among women who gave birth in the preceding 23 months in Bihar, India. METHODS: A cross-sectional analysis of data from a representative household sample of mothers of children 0-23 months old in Bihar, India (N = 13,803) was conducted. Associations between lifetime IPV (physical and/or sexual violence) and poor reproductive health outcomes ever (miscarriage, stillbirth, and abortion) as well as maternal complications for the index pregnancy (early and/or prolonged labor complications, other complications during pregnancy or delivery) were assessed using multivariable logistic regression, adjusting for demographics and fertility history of the mother. Models were then stratified by wealth index to determine whether observed associations were stronger for poorer versus wealthier women. RESULTS: IPV was reported by 45% of women in the sample. A history of miscarriage, stillbirth, and abortion was reported by 8.7, 4.6, and 1.3% of the sample, respectively. More than one in 10 women (10.7%) reported labor complications during the last pregnancy, and 16.3% reported other complications during pregnancy or delivery. Adjusted regressions revealed significant associations between IPV and miscarriage (AOR = 1.35, 95% CI = 1.11-1.65) and stillbirth (AOR = 1.36, 95% CI = 1.02-1.82) ever, as well as with labor complications (AOR = 1.27, 95% CI = 1.04-1.54) and other pregnancy/delivery complications (AOR = 1.68, 95% CI = 1.42-1.99). Women in the poorest quartile (Quartile 1) saw no associations between IPV and miscarriage (Quartile 1 AOR = 0.98, 95% CI = 0.67-1.45) or stillbirth (Quartile 1 AOR = 1.17, 95% CI = 0.69-1.98), whereas women in the higher wealth quartile (Quartile 3) did see associations between IPV and miscarriage (Quartile 3 AOR = 1.55, 95% CI = 1.07, 2.25) and stillbirth (Quartile 3 AOR = 1.79, 95% CI = 1.04, 3.08). DISCUSSION: IPV is highly prevalent in Bihar and is associated with increased risk for miscarriage, stillbirth, and maternal health complications. Associations between IPV and miscarriage and stillbirth do not hold true for the poorest women, possibly because other risks attached to poverty and deprivation may be greater contributors.

Associations of intimate partner violence with postnatal health practices in Bihar, India.

BACKGROUND: Reducing neonatal mortality is a global priority, and improvements in postnatal health (PNH) practices in India are needed to do so. Intimate partner violence (IPV) may be associated with PNH practices, but little research has assessed this relationship. METHODS: A cross-sectional analysis of data from a representative household sample of mothers of neonates 0-11 months old in Bihar, India was conducted. The relationship between lifetime IPV experience (physical violence only, sexual violence only, or both physical and sexual violence) and PNH practices [clean cord care, kangaroo mother care, early initiation of breastfeeding (EIBF), delayed bathing, receipt of a postnatal care visit, exclusive breastfeeding, and current post-partum contraceptive use] was assessed using multivariate logistic regression. RESULTS: Over 45% of the 10,469 mothers experienced IPV in their lifetime. The three types of IPV experiences differentially related to PNH practices. Adjusted analyses revealed that compared to those who had never experienced IPV, women who experienced physical violence only (29.0%) had higher odds of skin-to-skin care (AOR = 1.67, 95% CI = 1.42, 1.96) and delayed bathing (AOR = 1.19, 95% CI = 1.03, 1.37), but lower odds of EIBF (AOR = 0.81, 95% CI = 0.70, 0.93) and exclusive breastfeeding (AOR = 0.83, 95% CI = 0.71, 0.96). Mothers who had experienced sexual violence only (2.3%) had lower odds of practicing EIBF (AOR = 0.52, 95% CI = 0.36, 0.76). Those who had both experiences of physical and sexual violence (14.0%) had increased odds of postpartum modern contraceptive use (AOR = 1.35, 95% CI = 1.07, 1.71) and lower odds of delayed bathing (AOR = 0.76, 95% CI = 0.63, 0.91). CONCLUSIONS: The results of this study found differing patterns of vulnerability to poor PNH practices depending on the type of IPV experienced. Efforts to increase access to health services for women experiencing IPV and to integrate IPV intervention into such service may increase PNH practices, and as a result, reduce neonatal mortality.