User Perceptions and Experiences of an Interactive Voice Response Mobile Phone Survey Pilot in Uganda: Qualitative Study.

BACKGROUND: With the growing burden of noncommunicable diseases in low- and middle- income countries, the World Health Organization recommended a stepwise approach of surveillance for noncommunicable diseases. This is expensive to conduct on a frequent basis and using interactive voice response mobile phone surveys has been put forth as an alternative. However, there is limited evidence on how to design and deliver interactive voice response calls that are robust and acceptable to respondents. OBJECTIVE: This study aimed to explore user perceptions and experiences of receiving and responding to an interactive voice response call in Uganda in order to adapt and refine the instrument prior to national deployment. METHODS: A qualitative study design was used and comprised a locally translated audiorecorded interactive voice response survey delivered in 4 languages to 59 purposively selected participants' mobile phones in 5 survey rounds guided by data saturation. The interactive voice response survey had modules on sociodemographic characteristics, physical activity, fruit and vegetable consumption, diabetes, and hypertension. After the interactive voice response survey, study staff called participants back and used a semistructured interview to collect information on the participant's perceptions of interactive voice response call audibility, instruction clarity, interview pace, language courtesy and appropriateness, the validity of questions, and the lottery incentive. Descriptive statistics were used for the interactive voice response survey, while a framework analysis was used to analyze qualitative data. RESULTS: Key findings that favored interactive voice response survey participation or completion included preference for brief surveys of 10 minutes or shorter, preference for evening calls between 6 PM and 10 PM, preference for courteous language, and favorable perceptions of the lottery-type incentive. While key findings curtailing participation were suspicion about the caller's identity, unclear voice, confusing skip patterns, difficulty with the phone interface such as for selecting inappropriate digits for both ordinary and smartphones, and poor network connectivity for remote and rural participants. CONCLUSIONS: Interactive voice response surveys should be as brief as possible and considerate of local preferences to increase completion rates. Caller credibility needs to be enhanced through either masking the caller or prior community mobilization. There is need to evaluate the preferred timing of interactive voice response calls, as the finding of evening call preference is inconclusive and might be contextual.

Adaptation of a mobile phone health survey for risk factors for noncommunicable diseases in Colombia: a qualitative study.

BACKGROUND: Data collection on noncommunicable disease (NCD) behavioral risk factors has traditionally been carried out through face-to-face surveys. However, its high costs and logistical difficulties can lead to lack of timely statistics for planning, particularly in low and middle-income countries. Mobile phone surveys (MPS) have the potential to fill these gaps. OBJECTIVE: This study explores perceptions, feasibility and strategies to increase the acceptability and response rate of health surveys administered through MPS using interactive voice response in Colombia. METHOD: A sequential multimodal exploratory design was used. We conducted key informant interviews (KII) with stakeholders from government and academia; focus group discussions (FGDs) and user-group tests (UGTs) with young adults and elderly people living in rural and urban settings (men and women). The KII and FGDs explored perceptions of using mobile phones for NCD surveys. In the UGTs, participants were administered an IVR survey, and they provided feedback on its usability and potential improvement. RESULTS: Between February and November 2017, we conducted 7 KII, 6 FGDs (n = 54) and 4 UGTs (n = 34). Most participants consider MPS is a novel way to explore risk factors in NCDs. They also recognize challenges for their implementation including security issues, technological literacy and telecommunications coverage, especially in rural areas. It was recommended to promote the survey using mass media before its deployment and stressing its objectives, responsible institution and data privacy safeguards. The preferences in the survey administration relate to factors such as skills in the use of mobile phones, age, availability of time and educational level. The participants recommend questionnaires shorter than 10 minutes. CONCLUSIONS: The possibility of obtaining data through MPS at a population level represents an opportunity to improve the availability of risk-factor data. Steps towards increasing the acceptability and overcoming technological and methodological challenges need to be taken.

Integrating capacity development during digital health research: a case study from global health.

Background: The Bloomberg Data for Health Initiative Research and Development Arm at Johns Hopkins University Bloomberg School of Public Health, has thus far collected NCD risk factor data from more than 13,000 citizens of three LMICs (Bangladesh, Tanzania and Uganda), and has actively worked to improve capacity with partners worldwide. Objective: This paper focuses on how a research project, can also act as a capacity building activity through its research into collecting non-communicable disease risk factor data using different mobile phone modalities. Methods: This paper evaluates the activities undertaken by the project using the ESSENCE Planning Monitoring and Evaluation Framework for Research Capacity Strengthening. Results: The project was able to successfully integrate meaningful capacity development activities across all partners. Training, networking, sharing resources, joint data collection, and analysis across individual, organizational and project levels were some of the strategies used. The ESSENCE framework allowed a good assessment strategy for this type of work. Conclusions: This paper highlights the value of making capacity development a high priority for digital health research activities, while also considering the need to monitor and evaluate those activities in order for them to be meaningful and sustainable. It also considers how to utilize the ESSENCE Framework to evaluate capacity development activities through research, and how best to adapt the Framework to different programs.

Does mobile phone survey method matter? Reliability of computer-assisted telephone interviews and interactive voice response non-communicable diseases risk factor surveys in low and middle income countries.

INTRODUCTION: Increased mobile phone subscribership in low- and middle-income countries (LMICs) provides novel opportunities to track population health. The objective of this study was to examine reliability of data in comparing participant responses collected using two mobile phone survey (MPS) delivery modalities, computer assisted telephone interviews (CATI) and interactive voice response (IVR) in Bangladesh (BGD) and Tanzania (TZA). METHODS: Using a cross-over design, we used random digit dialing (RDD) to call randomly generated mobile phone numbers and recruit survey participants to receive either a CATI or IVR survey on non-communicable disease (NCD) risk factors, followed 7 days later by the survey mode not received during first contact; either IVR or CATI. Respondents who received the first survey were designated as first contact (FC) and those who consented to being called a second time and subsequently answered the call were designated as follow-up (FU). We used the same questionnaire for both contacts, with response options modified to suit the delivery mode. Reliability of responses was analyzed using the Cohen's kappa statistic for percent agreement between two modes. RESULTS: Self-reported data on demographic characteristics and NCD behavioral risk factors were collected from 482 (CATI-FC) and 653 (IVR-FC) age-eligible and consenting respondents in BGD, and from 387 (CATI-FC) and 674 (IVR-FC) respondents in TZA respectively. Survey follow-up rates were 30.7% (n = 482) for IVR-FU and 53.8% (n = 653) for CATI-FU in BGD; and 42.4% (n = 387) for IVR-FU and 49.9% (n = 674) for CATI-FU in TZA respectively. Overall, there was high consistency between delivery modalities for alcohol consumption in the past 30 days in both countries (kappa = 0.64 for CATI→IVR (BGD), kappa = 0.54 for IVR→CATI (BGD); kappa = 0.66 for CATI→IVR (TZA), kappa = 0.76 for IVR→CATI (TZA)), and current smoking (kappa = 0.68 for CATI→IVR (BGD), kappa = 0.69 for IVR→CATI (BGD); kappa = 0.39 for CATI→IVR (TZA), kappa = 0.50 for IVR→CATI (TZA)). There was moderate to substantial consistency in both countries for history of checking for hypertension and diabetes with kappa statistics ranging from 0.43 to 0.67. There was generally lower consistency in both countries for physical activity (vigorous and moderate) with kappa statistics ranging from 0.10 to 0.41, weekly fruit and vegetable with kappa ranging from 0.08 to 0.45, consumption of foods high in salt and efforts to limit salt with kappa generally below 0.3. CONCLUSIONS: The study found that when respondents are re-interviewed, the reliability of answers to most demographic and NCD variables is similar whether starting with CATI or IVR. The study underscores the need for caution when selecting questions for mobile phone surveys. Careful design can help ensure clarity of questions to minimize cognitive burden for respondents, many of whom may not have prior experience in taking automated surveys. Further research should explore possible differences and determinants of survey reliability between delivery modes and ideally compare both IVR and CATI surveys to in-person face-to-face interviews. In addition, research is needed to better understand factors that influence survey cooperation, completion, refusal and attrition rates across populations and contexts.