RESUMO
Adolescents 360 (A360) is a four-year initiative (2016-2020) to increase 15-19-year-old girls' use of modern contraception in Nigeria, Ethiopia and Tanzania. The innovative A360 approach is led by human-centred design (HCD), combined with social marketing, developmental neuroscience, public health, sociocultural anthropology and youth engagement 'lenses', and aims to create context-specific, youth-driven solutions that respond to the needs of adolescent girls. The A360 external evaluation includes a process evaluation, quasi-experimental outcome evaluation, and a cost-effectiveness study. We reflect on evaluation opportunities and challenges associated with measuring the application and impact of this novel HCD-led design approach. For the process evaluation, participant observations were key to capturing the depth of the fast-paced, highly-iterative HCD process, and to understand decision-making within the design process. The evaluation team had to be flexible and align closely with the work plan of the implementers. The HCD process meant that key information such as intervention components, settings, and eligible populations were unclear and changed over outcome evaluation and cost-effectiveness protocol development. This resulted in a more time-consuming and resource-intensive study design process. As much time and resources went into the creation of a new design approach, separating one-off "creation" costs versus those costs associated with actually implementing the programme was challenging. Opportunities included the potential to inform programmatic decision-making in real-time to ensure that interventions adequately met the contextualized needs in targeted areas. Robust evaluation of interventions designed using HCD, a promising and increasingly popular approach, is warranted yet challenging. Future HCD-based initiatives should consider a phased evaluation, focusing initially on programme theory refinement and process evaluation, and then, when the intervention program details are clearer, following with outcome evaluation and cost-effectiveness analysis. A phased approach would delay the availability of evaluation findings but would allow for a more appropriate and tailored evaluation design.
RESUMO
Background: Adolescents 360 (A360) implements the Smart Start (SS) programme through Ethiopia's Health Extension Programme (HEP). SS is premised on financial planning as an entry point to discuss family planning (FP) with newly married couples and central to its delivery are the health extension workers (HEW). This article evaluates the A360 experience and learning from the process evaluation implemented by Itad to understand contextual barriers and enablers from the perspective of the HEW. Methods: A purposive sampling strategy was employed whereby 27 key stakeholders were identified from Oromia, Addis Ababa and Amhara, based on exposure to the SS programme. Findings from the action research were shared with A360 through a one day sounding workshop. Results: Findings revealed that many local government and communal respondents do not view adolescent pregnancy as a problem, unless out of wedlock, and adolescent pregnancy is closely linked to early marriage. As a result, some providers, including HEWs, acknowledged that married adolescent girls were previously 'neglected' by them, while husbands indicated that they had not previously been included in FP counselling. Findings also revealed some challenges with SS implementation as HEWs were 'deprioritizing' the intervention and many HEWs had been in situ for several years and were overworked and frustrated. Against this backdrop, A360 was viewed as adding to the HEW workload. While the programme design was focused on adolescent users, there was increasing recognition that HEWs also needed to be at the centre of solution design. Conclusions: Despite challenges associated with the HEP, Ethiopia FP2020 plans to support the 'next generation' of HEWs, including a focus on adolescents and youth. To gain deeper insight and put the HEW at the centre of design, A360 will continue to work with the process evaluation to understand contextual barriers and enablers from the perspective of the HEW.
RESUMO
INTRODUCTION: Nigeria, Ethiopia and Tanzania have some of the highest teenage pregnancy rates and lowest rates of modern contraceptive use among adolescents. The transdisciplinary Adolescents 360 (A360) initiative being rolled out across these three countries uses human-centred design to create context-specific multicomponent interventions with the aim of increasing voluntary modern contraceptive use among girls aged 15-19 years. METHODS: The primary objective of the outcome evaluation is to assess the impact of A360 on the modern contraceptive prevalence rate (mCPR) among sexually active girls aged 15-19 years. A360 targets different subpopulations of adolescent girls in the three countries. In Northern Nigeria and Ethiopia, the study population is married girls aged 15-19 years. In Southern Nigeria, the study population is unmarried girls aged 15-19 years. In Tanzania, both married and unmarried girls aged 15-19 years will be included in the study. In all settings, we will use a prepopulation and postpopulation-based cross-sectional survey design. In Nigeria, the study design will also include a comparison group. A one-stage sampling design will be used in Nigeria and Ethiopia. A two-stage sampling design will be used in Tanzania. Questionnaires will be administered face-to-face by female interviewers aged between 18 and 26 years. Study outcomes will be assessed before the start of A360 implementation in late 2017 and approximately 24 months after implementation in late 2019. ETHICS AND DISSEMINATION: Findings of this study will be widely disseminated through workshops, conference presentations, reports, briefings, factsheets and academic publications.