Engaging Stakeholders, from Inception and Throughout the Study, is Good Research Practice to Promote use of Findings.

The need for research-informed programming and policy making is well established. However, there is limited evidence that, when researchers actively promote utilization of research findings, stakeholders use such findings for decision making in low- and middle-income countries (LMIC). A common barrier for research uptake in LMIC is that researchers focus on passive dissemination of final findings as the primary vehicle to affect research uptake. A more active approach to facilitating research utilization (RU) is necessary. Project SOAR, a six-year USAID-funded operations research project, recognized this gap and developed an approach to include the end data users in the research process from inception to final results dissemination. In this commentary, we make recommendations for active facilitation of research uptake using emerging lessons from SOAR's RU process that focuses on ongoing engagement of stakeholders throughout the life of the study.

Challenges to and opportunities for the adoption and routine use of early warning indicators to monitor pediatric HIV drug resistance in Kenya.

BACKGROUND: Pediatric non-adherence to antiretroviral therapy (ART), loss to follow-up, and HIV drug resistance (HIVDR) are challenges to achieving UNAIDS' targets of 90% of those diagnosed HIV-positive receiving treatment, and 90% of those receiving treatment achieving viral suppression. In Kenya, the pediatric population represents 8% of total HIV infections and pediatric virological failure is estimated at 33%. The monitoring of early warning indicators (EWIs) for HIVDR can help to identify and correct gaps in ART program functioning to improve HIV care and treatment outcomes. However, EWIs have not been integrated into health systems. We assessed challenges to the use of EWIs and solutions to challenges identified by frontline health administrators. METHODS: We conducted key informant interviews with health administrators who were fully knowledgeable of the ART program at 23 pediatric ART sites in 18 counties across Kenya from May to June 2015. Thematic content analysis identified themes for three EWIs: on-time pill pick-up, retention in care, and virological suppression. RESULTS: Nine themes-six at the facility level and three at the patient level-emerged as major challenges to EWI monitoring. At the facility level, themes centered on system issues (e.g., slow return of viral load results), staff shortages and inadequate adherence counseling skills, lack of effective patient tracking and linkage systems, and lack of support for health personnel. At the patient level, themes focused on stigma, non-disclosure of HIV status to children who are age eligible, and little engagement of guardians in the children's care. Practical solutions identified included the use of lay health workers (e.g., peer educators, community health workers) to implement a variety of care and treatment tasks, whole facility approaches to adherence counseling, adolescent peer support groups, and working with children directly as soon as they are age eligible. DISCUSSION: The monitoring of EWIs has not been routine in health facilities in Kenya due to several challenges. However, facilities have implemented novel strategies to address some of these barriers. Future work is needed to assess whether scale-up of some of these approaches can aid in the effective use of EWIs and improving HIV care outcomes among the pediatric population.

Factors associated with acceptability of HIV self-testing among health care workers in Kenya.

Health care workers (HCWs) in sub-Saharan Africa are at a high risk of HIV infection from both sexual and occupational exposures. However, many do not seek HIV testing. This paper examines the acceptability of an unsupervised facility-based HIV self-testing (HIVST) intervention among HCWs and their partners and factors associated with uptake of HIVST among HCWs. HCWs in seven large Kenyan hospitals were invited to participate in pre-HIVST information sessions during which they were offered HIVST kits to take home for self-testing. A post-intervention survey was conducted among 765 HCWs. Forty-one percent attended the information session; of those, 89% took the HIVST kits and of those, 85% self-tested. Thirty-four percent of surveyed HCWs used the HIVST to test themselves. Of those who took the HIVST kit and had partners, 73% gave the kit to their partner and 86% of them indicated their partner self-tested. Factors positively associated with use of the HIVST on self were being female, being single, and being a HCW from Homa Bay Hospital (located in a high HIV prevalence area). HIVST is acceptable to HCWs and their partners. However, strategies are needed to increase HCWs attendance at pre-implementation information sessions.

Examining dimensions of vulnerability among children in Uganda.

Insufficient data on the nature and extent of children's vulnerability in Uganda has challenged government and donors in priority setting, resource allocation and developing effective approaches to improve well-being. We conducted a population-based survey among a nationally representative sample of 2551 households, covering a total of 7946 children. We engaged national stakeholders in a priority-setting exercise to develop a scoring system to assess dimensions of children's vulnerability. The exercise identified individual and household characteristics to assess vulnerability--many of which had not been measured previously--to which numerical weights representing vulnerability level were assigned. Highly weighted characteristics included maternal death, disability, child labour and pregnancy before age 17. Psychosocial elements included living apart from siblings, having nobody to talk to and never visiting a living parent. According to this approach, an estimated 51.1% of children in Uganda (weighted for national population distribution) are considered critically or moderately vulnerable. It is to these children, equivalent to a national total of 8.7 million, that support services should be prioritised. However, survey data suggest that the most critically vulnerable children are under-represented in several types of support services. This pioneering, participatory methodology provides a rudimentary, but valuable, first step towards quantifying the vulnerability of children in Uganda and assessing their resource needs. It has been used by the Government of Uganda to determine subcategories of vulnerability for resource allocation. A major advantage is that it uses local contextual knowledge of child vulnerability rather than generic criteria applied in international surveys. Further analytical work is required to validate the methodology, link it to child well-being outcomes and devise a practical tool for service providers to refine programme targeting. The approach may be useful to national, regional or local service providers seeking an overview of their client base to monitor and improve programme-targeting efforts.

Meaningful involvement of people living with HIV/AIDS in Uganda through linkages between network groups and health facilities: an evaluation study.

While community-based groups are able to provide vital support to people living with HIV/AIDS (PLHIV), their organizational and technical capacities are limited, and they frequently operate in isolation from PLHIV groups. We evaluated a three-year project implemented by the International HIV/AIDS Alliance in Uganda to increase the involvement of PLHIV in the HIV/AIDS response and to improve access to and utilization of prevention, treatment, care, and support services for households affected by HIV/AIDS. Information sources included project monitoring data, interviews with 113 key informants, and 17 focus group discussions in 11 districts. The evaluation found that PLHIV groups reached large numbers of people with education and awareness activities and made a growing number of referrals to health facilities and community-based services. The project trained individuals living openly with HIV as service providers in the community and at designated health facilities. Their presence helped to reduce the stigma that previously deterred PLHIV from seeking care and encouraged individuals to disclose their HIV status to spouses and family members. The project has put into practice the widely endorsed principles of greater and meaningful involvement of PLHIV in a systematic manner and on a large scale. A wide audience--ranging from grassroots PLHIV networks and AIDS service organizations to national-level non-governmental organizations, government agencies, and international organizations--can benefit from the lessons learned.

Documenting HIV research-utilization activities, outputs and outcomes: examples and lessons learned from Project SOAR.

The importance of using research findings to inform policy and program decisions is well recognized, but the literature on measuring research utilization activities is scarce. As funding to support some areas of research wanes or remains stagnant, the need to document the value of investing in research by its' effect on improved programs and policies becomes increasingly necessary. We present the experience of Project SOAR, a six-year USAID-funded project focusing on HIV/AIDS-related implementation research, to demonstrate measurement of research utilization. We follow the project's research-utilization logic model, including inputs, activities, outputs, and outcomes. We present tools the project developed and examples from project studies and discuss what works, remaining challenges and how to overcome them, and lessons learned. We then make recommendations for incorporating research-utilization activities and measurement in implementation-research studies.

Reducing HIV-related risk and mental health problems through a client-centred psychosocial intervention for vulnerable adolescents in Addis Ababa, Ethiopia.

INTRODUCTION: Ethiopia is experiencing an increasingly urban HIV epidemic, alongside a rise in urban adolescent migration. Adolescent migrants are often confronted by unique social challenges, including living in a difficult environment, abuse and mental health problems. These issues can increase adolescents' vulnerability to HIV and compromise their capacity to protect themselves and others from HIV. We piloted and assessed the effects of a targeted psychosocial intervention to reduce mental health problems and improve HIV-related outcomes among migrant adolescents in Addis Ababa. METHODS: A pre- and post-comparison design was used in a cohort of 576 female and 154 male migrant adolescents aged 15 to 18 years in Addis Ababa receiving services from two service delivery organizations, Biruh Tesfa and Retrak. We implemented a three-month client-centred, counsellor-delivered psychosocial intervention, based on findings from formative research among the same target population, to address participants' increased vulnerability to HIV. The intervention package comprised individual, group and creative arts therapy counselling sessions. Key outcome indicators included anxiety, depression, aggressive behaviour, attention problems, social problems, knowledge of HIV, safer sex practices and use of sexual health services. Longitudinal data analysis (McNemar test and random effects regression) was used to assess changes over time in key indicators by gender. RESULTS: For females, aggressive behaviour decreased by 60% (adjusted odds ratio (AOR): 0.4 (0.25 to 0.65)) and any mental health problem decreased by 50% (AOR: 0.5 (0.36 to 0.81)) from baseline to end line. In addition, knowledge of HIV increased by 60% (AOR: 1.6 (1.08 to 2.47)), knowledge of a place to test for HIV increased by 70% (AOR: 1.7 (1.12 to 2.51)) and HIV testing increased by 80% (AOR: 1.8 (1.13 to 2.97)). For males, HIV knowledge increased by 110% (AOR: 2.1 (1.1 to 3.94)), knowledge of a place to test for HIV increased by 290% (AOR: 3.9 (1.02 to 14.9)), HIV testing increased by 630% (AOR: 7.3 (2.6 to 20.7)) and use of sexual health services increased by 220% (AOR: 3.2 (1.62 to 6.27)). We did not find any significant reduction in mental health problems among male adolescents. CONCLUSIONS: Our findings suggest that a psychosocial intervention was associated with increased knowledge and uptake of HIV and sexual health services among both male and female migrant adolescents and with reduced mental health problems among female adolescents. Mental health problems varied significantly for male and female adolescents, suggesting that future interventions should be tailored to address their different needs and would benefit from intensive follow-up efforts.

Opportunities and challenges in conducting secondary analysis of HIV programmes using data from routine health information systems and personal health information.

INTRODUCTION: HIV programme data from routine health information systems (RHIS) and personal health information (PHI) provide ample opportunities for secondary data analysis. However, these data pose unique opportunities and challenges for use in health system monitoring, along with process and impact evaluations. METHODS: Analyses focused on retrospective case reviews of four of the HIV-related studies published in this JIAS supplement. We identify specific opportunities and challenges with respect to the secondary analysis of RHIS and PHI data. RESULTS: Challenges working with both HIV-related RHIS and PHI included missing, inconsistent and implausible data; rapidly changing indicators; systematic differences in the utilization of services; and patient linkages over time and different data sources. Specific challenges among RHIS data included numerous registries and indicators, inconsistent data entry, gaps in data transmission, duplicate registry of information, numerator-denominator incompatibility and infrequent use of data for decision-making. Challenges specific to PHI included the time burden for busy providers, the culture of lax charting, overflowing archives for paper charts and infrequent chart review. CONCLUSIONS: Many of the challenges that undermine effective use of RHIS and PHI data for analyses are related to the processes and context of collecting the data, excessive data requirements, lack of knowledge of the purpose of data and the limited use of data among those generating the data. Recommendations include simplifying data sources, analysis and reporting; conducting systematic data quality audits; enhancing the use of data for decision-making; promoting routine chart review linked with simple patient tracking systems; and encouraging open access to RHIS and PHI data for increased use.

Reliability and Validity of an Interviewer-Administered Adaptation of the Youth Self-Report for Mental Health Screening of Vulnerable Young People in Ethiopia.

OBJECTIVE: Evaluate the reliability and validity of the Youth Self-Report (YSR) as a screening tool for mental health problems among young people vulnerable to HIV in Ethiopia. DESIGN: A cross-sectional assessment of young people currently receiving social services. METHODS: Young people age 15-18 participated in a study where a translated and adapted version of the YSR was administered by trained nurses, followed by an assessment by Ethiopian psychiatrists. Internal reliability of YSR syndrome scales were assessed using Chronbach's alpha. Test-retest reliability was assessed through repeating the YSR one month later. To assess validity, analysis of the sensitivity and specificity of the YSR compared to the psychiatrist assessment was conducted. RESULTS: Across the eight syndrome scales, the YSR best measured the diagnosis of anxiety/depression and social problems among young women, and attention problems among young men. Among individual YSR syndrome scales, internal reliability ranged from unacceptable (Chronback's alpha = 0.11, rule-breaking behavior among young women) to good (α≥0.71, anxiety/depression among young women). Anxiety/depression scores of ≥8.5 among young women also had good sensitivity (0.833) and specificity (0.754) to predict a true diagnosis. The YSR syndrome scales for social problems among young women and attention problems among young men also had fair consistency and validity measurements. Most YSR scores had significant positive correlations between baseline and post-one month administration. Measures of reliability and validity for most other YSR syndrome scales were fair to poor. CONCLUSIONS: The adapted, personally administered, Amharic version of the YSR has sufficient reliability and validity in identifying young vulnerable women with anxiety/depression and/or social problems, and young men with attention problems; which were the most common mental health disorders observed by psychiatrists among the migrant populations in this study. Further assessment of the applicability of the YSR among vulnerable young people for less common disorders in Ethiopia is needed.

Results from a rapid national assessment of services for the prevention of mother-to-child transmission of HIV in Côte d'Ivoire.

INTRODUCTION: Loss-to-follow-up (LTFU) in the prevention of mother-to-child HIV transmission (PMTCT) programmes can occur at multiple stages of antenatal and follow-up care. This paper presents findings from a national assessment aimed at identifying major bottlenecks in Côte d'Ivoire's PMTCT cascade, and to distinguish characteristics of high- and low-performing health facilities. METHODS: This cross-sectional study, based on a nationally representative sample of 30 health facilities in Côte d'Ivoire used multiple data sources (registries, patient charts, patient booklets, interviews) to determine the magnitude of LTFU in PMTCT services. A composite measure of retention - based on child prophylaxis, maternal treatment and infant testing - was used to identify high- and low-performing sites and determine significant differences using Student's t-tests. RESULTS: Among 1,741 pregnant women newly recorded as HIV-positive between June 2011 and May 2012, 43% had a CD4 count taken, 77% received appropriate prophylaxis and 70% received prophylaxis intended for their infant. During that time, 1,054 first infant HIV tests were recorded. A conservative rate of adherence to antiretroviral therapy was estimated at 50% (n=219 patient charts). Significant differences between high- and low-performing sites included: duration of time elapsed between HIV testing and CD4 results (29.5 versus 56.3 days, p=0.001); and density (number per 100 first antenatal care visits) of full-time physicians (6.7 versus 1.7, p=0.04), laboratory technicians (2.3 versus 0.7, p=0.046), staff trained in PMTCT (10.7 versus 4.7, p=0.01), and staff performing patient follow-up activities (7.9 versus 2.5, p=0.02). Key informants highlighted staff presence and training, the availability of medical supplies and equipment (i.e., on-site CD4 machine), and the adequacy of infrastructure (i.e., space and ventilation) as perceived key factors positively and negatively impacting retention in care. CONCLUSIONS: Patient LTFU occurred throughout the PMTCT cascade from maternal to infant testing, with retention scores ranging from 0.10 to 0.83. Sites that scored higher had more dedicated and trained frontline health workers, and emphasised patient follow-up through outreach and the reduction of delays in care. Strategies to improve patient retention and decrease transmission should emphasise patient tracking systems that utilise critical human resources to both improve data quality and increase direct patient follow-up.

Annual cost of antiretroviral therapy among three service delivery models in Uganda.

INTRODUCTION: In response to the increasing burden of HIV, the Ugandan government has employed different service delivery models since 2004 that aim to reduce costs and remove barriers to accessing HIV care. These models include community-based approaches to delivering antiretroviral therapy (ART) and delegating tasks to lower-level health workers. This study aimed to provide data on annual ART cost per client among three different service delivery models in Uganda. METHODS: Costing data for the entire year 2012 were retrospectively collected as part of a larger task-shifting study conducted in three organizations in Uganda: Kitovu Mobile (KM), the AIDS Support Organisation (TASO) and Uganda Cares (UC). A standard cost data capture tool was developed and used to retrospectively collect cost information regarding antiretroviral (ARV) drugs and non-ARV drugs, ART-related lab tests, personnel and administrative costs. A random sample of four TASO centres (out of 11), four UC clinics (out of 29) and all KM outreach units were selected for the study. RESULTS: Cost varied across sites within each organization as well as across the three organizations. In addition, the number of annual ART visits was more frequent in rural areas and through KM (the community distribution model), which played a major part in the overall annual ART cost. The annual cost per client (in USD) was $404 for KM, $332 for TASO and $257 for UC. These estimates were lower than previous analyses in Uganda or the region compared to data from 2001 to 2009, but comparable with recent estimates using data from 2010 to 2013. ARVs accounted for the majority of the total cost, followed by personnel and operational costs. CONCLUSIONS: The study provides updated data on annual cost per ART visit for three service delivery models in Uganda. These data will be vital for in-country budgetary efforts to ensure that universal access to ART, as called for in the 2015 World Health Organization (WHO) guidelines, is achievable. The lower annual ART cost found in this study indicates that we may be able to treat all people with HIV as laid out in the 2015 WHO guidelines. The variation of costs across sites and the three models indicates the potential for efficiency gains.

Factors associated with long-term antiretroviral therapy attrition among adolescents in rural Uganda: a retrospective study.

INTRODUCTION: As access to antiretroviral therapy (ART) increases, the success of treatment programmes depends on ensuring high patient retention in HIV care. We examined retention and attrition among adolescents in ART programmes across clinics operated by The AIDS Support Organization (TASO) in Uganda, which has operated both facility- and community-based distribution models of ART delivery since 2004. METHODS: Using a retrospective cohort analysis of patient-level clinical data, we examined attrition and retention in HIV care and factors associated with attrition among HIV-positive adolescents aged 10-19 years who initiated ART at 10 TASO clinics between January 2006 and December 2011. Retention in care was defined as the proportion of adolescents who had had at least one facility visit within the six months prior to 1 June 2013, and attrition was defined as the proportion of adolescents who died, were lost to follow-up, or stopped treatment. Descriptive statistics and Cox proportional hazards regression models were used to determine the levels of retention in HIV care and the factors associated with attrition following ART initiation. RESULTS: A total of 1228 adolescents began ART between 2006 and 2011, of whom 57% were female. The median duration in HIV care was four years (IQR=3-6 years). A total of 792 (65%) adolescents were retained in care over the five-year period; 36 (3%) had died or transferred out and 400 (32%) were classified as loss to follow-up. Factors associated with attrition included being older (adjusted hazard ratio (AHR)=1.38, 95% confidence interval (CI) 1.02-1.86), having a higher CD4 count (250+ cells/mm(3)) at treatment initiation (AHR=0.49, 95% CI 0.34-0.69) and HIV care site with a higher risk of attrition among adolescents in Gulu (AHR=2.26; 95% CI 1.27-4.02) and Masindi (AHR=3.30, 95% CI 1.87-5.84) and a lower risk of attrition in Jinja (AHR=0.24, 95% CI 0.08-0.70). Having an advanced WHO clinical stage at initiation was not associated with attrition. CONCLUSIONS: We found an overall retention rate of 65%, which is comparable to rates achieved by TASO's adult patients and adolescents in other studies in Africa. Variations in the risk of attrition by TASO treatment site and by clinical and demographic characteristics suggest the need for early diagnosis of HIV infection, use of innovative approaches to reach and retain adolescents living with HIV in treatment and identifying specific groups, such as older adolescents, that are at high risk of dropping out of treatment for targeted care and support.

Experiences in implementation and publication of operations research interventions: gaps and a way forward.

INTRODUCTION: According to UNAIDS, the world currently has an adequate collection of proven HIV prevention, treatment and diagnostic tools, which, if scaled up, can lay the foundation for ending the AIDS epidemic. HIV operations research (OR) tests and promotes the use of interventions that can increase the demand for and supply of these tools. However, current publications of OR mainly focus on outcomes, leaving gaps in reporting of intervention characteristics, which are essential to address for the utilization of OR findings. This has prompted WHO and other international public health agencies to issue reporting requirements for OR studies. The objective of this commentary is to review experiences in HIV OR intervention design, implementation, process data collection and publication in order to identify gaps, contribute to the body of knowledge and propose a way forward to improve the focus on "implementation" in implementation research. DISCUSSION: Interventions in OR, like ordinary service delivery programmes, are subject to the programme cycle, which continually uses insights from implementation and the local context to modify service delivery modalities. Given that some of these modifications in the intervention may influence study outcomes, the documentation of process data becomes vital in OR. However, a key challenge is that study resources tend to be skewed towards documentation and the reporting of study outcomes to the detriment of process data, even though process data is vital for understanding factors influencing the outcomes. CONCLUSIONS: Interventions in OR should be viewed using the lens of programme evaluation, which includes formative assessment (to determine concept and design), followed by process evaluation (to monitor inputs and outputs) and effectiveness evaluation (to assess outcomes and effectiveness). Study resources should be equitably used between process evaluation and outcome measurement to facilitate inclusion of data about fidelity and dose in publications in order to enable explanation of the relationship between dosing and study outcomes for purposes of scaling up and further refinement through research.

Assessment of linkages from HIV testing to enrolment and retention in HIV care in Central Mozambique.

INTRODUCTION: Effectiveness of the rapid expansion of antiretroviral therapy (ART) throughout sub-Saharan Africa is highly dependent on adequate enrolment and retention in HIV care. However, the measurement of both has been challenging in these settings. This study aimed to assess enrolment and retention in HIV care (pre-ART and ART) among HIV-positive adults in Central Mozambique, including identification of barriers and facilitators. METHODS: We assessed linkages to and retention in HIV care using a mixed quantitative and qualitative approach in six districts of Manica and Sofala provinces. We analyzed routine district and health facility monthly reports and HIV care registries from April 2012 to March 2013 and used single imputation and trimmed means to adjust for missing values. In eight health facilities in the same districts and period, we assessed retention in HIV care among 795 randomly selected adult patient charts (15 years and older). We also conducted 25 focus group discussions and 53 in-depth interviews with HIV-positive adults, healthcare providers and community members to identify facilitators and barriers to enrolment and retention in HIV care. RESULTS: Overall, 46% of the monthly HIV testing reports expected at the district level were missing, compared to 6.4% of the pre-ART registry reports. After adjustment for missing values, we estimated that the aggregate numbers of adults registered in pre-ART was 75% of the number of persons tested HIV-positive in the six districts. In the eight health facilities, 40% of the patient charts for adults enrolled in pre-ART and 44% in ART were missing. Of those on ART for whom charts were found, retention in treatment within 90 and 60 days prior to the study team visit was 34 and 25%, respectively. Combining these multiple data sources, the overall estimated retention was 18% in our sample. Individual-level factors were perceived to be key influences to enrolment in HIV care, while health facility and structural-level factors were perceived to be key influences of retention. CONCLUSIONS: Efforts to increase linkages to and retention in HIV care should address individual, health facility, and structural-level factors in Central Mozambique. However, their outcomes cannot be reliably assessed without improving the quality of routine health information systems.

Using biomarkers to assess the validity of sexual behavior reporting across interview modes among young women in Kampala, Uganda.

Understanding the transmission dynamics of HIV and other sexually transmitted infections is critically dependent on accurate behavioral data. This study investigates the effect of the mode of questionnaire delivery on the quality of sexual behavior reporting in a 2010 survey conducted in Kampala, Uganda, among 18-24-year-old women. We compare the reported prevalence of five sexual outcomes across three interview modes: traditional face-to-face interviewing (FTFI) in which question rewording was permitted, FTFI administered via computer-assisted personal interviewing (CAPI) in which questions were read as written, and audio computer-assisted self-interviewing (ACASI) in which participants listened to prerecorded questions and entered responses using a computer touchscreen. We then assess the validity of the data by evaluating the reporting of sexual experience against three biological markers. Results suggest that ACASI elicits higher reporting of some key indicators than FTFI does, but self-reports from all interview modes were subject to validity concerns when compared with biomarker data. The study highlights the important role that biomarkers can play in sexual behavior research.