Synthetic Controls for Implementation Science: Opportunities for HIV Program Evaluation Using Routinely Collected Data.

PURPOSE OF REVIEW: HIV service delivery programs are some of the largest funded public health programs in the world. Timely, efficient evaluation of these programs can be enhanced with methodologies designed to estimate the effects of policy. We propose using the synthetic control method (SCM) as an implementation science tool to evaluate these HIV programs. RECENT FINDINGS: SCM, introduced in econometrics, shows increasing utility across fields. Key benefits of this methodology over traditional design-based approaches for evaluation stem from directly approximating pre-intervention trends by weighting of candidate non-intervention units. We demonstrate SCM to evaluate the effectiveness of a public health intervention targeting HIV health facilities with high numbers of recent infections on trends in pre-exposure prophylaxis (PrEP) enrollment. This test case demonstrates SCM's feasibility for effectiveness evaluations of site-level HIV interventions. HIV programs collecting longitudinal, routine service delivery data for many facilities, with only some receiving a time-specified intervention, are well-suited for evaluation using SCM.

Survival and HIV-Free Survival Among Children Aged ≤3 Years - Eight Sub-Saharan African Countries, 2015-2017.

Although mother-to-child transmission (MTCT) of human immunodeficiency virus (HIV) is preventable through antiretroviral treatment (ART) during pregnancy and postpartum, the Joint United Nations Programme on HIV/AIDS (UNAIDS) estimates that 160,000 new HIV infections occurred among children in 2018 (1). Child survival and HIV-free survival rates* are standard measures of progress toward eliminating MTCT† (2). Nationally representative Population-based HIV Impact Assessment (PHIA)§ survey data, pooled from eight sub-Saharan African countries¶ were used to calculate survival probability among children aged ≤3 years by maternal HIV status during pregnancy and HIV-free survival probability among children aged ≤3 years born to women with HIV infection, stratified by maternal ART** status during pregnancy. Survival probability was significantly lower among children born to women with HIV infection (94.7%) than among those born to women without HIV infection (97.6%). HIV-free survival probability of children born to women with HIV infection differed significantly by the timing of initiation of maternal ART: 93.0% among children whose mothers received ART before pregnancy, 87.8% among those whose mothers initiated ART during pregnancy, and 53.4% among children whose mothers did not receive ART during pregnancy. Focusing on prevention of HIV acquisition and, among women of reproductive age with HIV infection, on early diagnosis of HIV infection and ART initiation when applicable, especially before pregnancy, can improve child survival and HIV-free survival.

Status of HIV Epidemic Control Among Adolescent Girls and Young Women Aged 15-24 Years - Seven African Countries, 2015-2017.

In 2016, an estimated 1.5 million females aged 15-24 years were living with human immunodeficiency virus (HIV) infection in Eastern and Southern Africa, where the prevalence of HIV infection among adolescent girls and young women (3.4%) is more than double that for males in the same age range (1.6%) (1). Progress was assessed toward the Joint United Nations Programme on HIV/AIDS (UNAIDS) 2020 targets for adolescent girls and young women in sub-Saharan Africa (90% of those with HIV infection aware of their status, 90% of HIV-infected persons aware of their status on antiretroviral treatment [ART], and 90% of those on treatment virally suppressed [HIV viral load <1,000 HIV RNA copies/mL]) (2) using data from recent Population-based HIV Impact Assessment (PHIA) surveys in seven countries. The national prevalence of HIV infection in adolescent girls and young women aged 15-24 years, the percentage who were aware of their status, and among those persons who were aware, the percentage who had achieved viral suppression were calculated. The target for viral suppression among all persons with HIV infection is 73% (the product of 90% x 90% x 90%). Among all seven countries, the prevalence of HIV infection among adolescent girls and young women was 3.6%; among those in this group, 46.3% reported being aware of their HIV-positive status, and 45.0% were virally suppressed. Sustained efforts by national HIV and public health programs to diagnose HIV infection in adolescent girls and young women as early as possible to ensure rapid initiation of ART should help achieve epidemic control among adolescent girls and young women.

Attrition From Human Immunodeficiency Virus Treatment Programs in Africa: A Longitudinal Ecological Analysis Using Data From 307 144 Patients Initiating Antiretroviral Therapy Between 2005 and 2010.

BACKGROUND: As access to antiretroviral therapy (ART) in Africa has increased dramatically, concerns have been raised regarding patient attrition, an important measure of program quality. METHODS: We examined aggregate data from 307144 patients initiating ART in 5638 successive cohorts at 638 facilities in 9 African countries from 2005 to 2010, a period characterized by massive treatment expansion. Poisson regression assessed trends in 6- and 12-month cohort attrition (ie, the proportion of patients in each cohort no longer receiving ART at their initiating facility) over calendar time and as ART services matured, and identified factors associated with attrition. RESULTS: Across all 9 countries, 6- and 12-month cohort attrition was 21% and 29%, respectively, with no decrease over calendar time (6-month P = .8735; 12-month P = .5717) or as ART services matured (6-month P = .3005; 12-month P = .2277). Additionally, attrition remained stable or decreased across both measures in nearly all countries. Initiating ART in facilities with more documented transfers and fewer women on ART, and in cohorts with poor CD4 count documentation and lower median CD4 count at ART initiation was associated with increased 6-month attrition. Increased 12-month attrition was observed in semiurban facilities and those with more documented transfers, and in cohorts with poor CD4 count documentation, whereas higher patient load was associated with decreased attrition. CONCLUSIONS: Stable or decreasing trends in attrition for ART patients were observed in most countries, suggesting programs can be expanded without compromising quality. However, further reductions in attrition are needed to maximize individual and population benefits of ART.

A Qualitative Evaluation of the Acceptability of an Interactive Voice Response System to Enhance Adherence to Isoniazid Preventive Therapy Among People Living with HIV in Ethiopia.

Interactive voice response (IVR) is increasingly used to monitor and promote medication adherence. In 2014, we evaluated patient acceptability toward IVR as part of the ENRICH Study, aimed to enhance adherence to isoniazid preventive therapy for tuberculosis prevention among HIV-positive adults in Ethiopia. Qualitative interviews were completed with 30 participants exposed to 2867 IVR calls, of which 24 % were completely answered. Individualized IVR options, treatment education, and time and cost savings facilitated IVR utilization, whereas poor IVR instruction, network and power malfunctions, one-way communication with providers, and delayed clinic follow-up inhibited utilization. IVR acceptability was complicated by HIV confidentiality, mobile phone access and literacy, and patient-provider trust. Incomplete calls likely reminded patients to take medication but were less likely to capture adherence or side effect data. Simple, automated systems that deliver health messages and triage clinic visits appear to be acceptable in this resource-limited setting.

Prevalence, patterns, and correlates of HIV disclosure among TB-HIV patients initiating antiretroviral therapy in Lesotho.

Disclosure of HIV-positive status has important implications for patient outcomes and preventing HIV transmission, but has been understudied in TB-HIV patients. We assessed disclosure patterns and correlates of non-disclosure among adult TB-HIV patients initiating ART enrolled in the START Study, a mixed-methods cluster-randomized trial conducted in Lesotho, which evaluated a combination intervention package (CIP) versus standard of care. Interviewer-administered questionnaire data were analyzed to describe patterns of disclosure. Patient-related factors were assessed for association with non-disclosure to anyone other than a health-care provider and primary partners using generalized linear mixed models. Among 371 participants, 95% had disclosed their HIV diagnosis to someone other than a health-care provider, most commonly a spouse/primary partner (76%). Age, TB knowledge, not planning to disclose TB status, greater perceived TB stigma, and CIP were associated with non-disclosure in unadjusted models (p < .1). In adjusted models, all point estimates were similar and greater TB knowledge (adjusted odds ratio [aOR] 0.59, 95% confidence interval [CI] 0.39-0.90) and CIP (aOR 0.20, 95% CI 0.05-0.79) remained statistically significant. Among 220 participants with a primary partner, 76% had disclosed to that partner. Significant correlates of partner non-disclosure (p < .1) in unadjusted analyses included being female, married/cohabitating, electricity at home, not knowing if partner was HIV-positive, and TB knowledge. Adjusted point estimates were largely similar, and being married/cohabitating (aOR 0.03, 95% CI 0.01-0.12), having electricity at home (aOR 0.38, 95% CI 0.17-0.85) and greater TB knowledge (aOR 0.76, 95% CI 0.59-0.98) remained significant. In conclusion, although nearly all participants reported disclosing their HIV status to someone other than a health-care provider at ART initiation, nearly a quarter of participants with a primary partner had not disclosed to their partner. Additional efforts to support HIV disclosure (e.g., counseling) may be needed for TB-HIV patients, particularly for women and those unaware of their partners' status.

Brief Report: Self-Reported HIV-Positive Status but Subsequent HIV-Negative Test Results in Population-Based HIV Impact Assessment Survey Participants-11 Sub-Saharan African Countries, 2015-2018.

BACKGROUND: HIV testing is a critical step to accessing antiretroviral therapy (ART) because early diagnosis can facilitate earlier initiation of ART. This study presents aggregated data of individuals who self-reported being HIV-positive but subsequently tested HIV-negative during nationally representative Population-Based HIV Impact Assessment surveys conducted in 11 countries from 2015 to 2018. METHOD: Survey participants aged 15 years or older were interviewed by trained personnel using a standard questionnaire to determine HIV testing history and self-reported HIV status. Home-based HIV testing and counseling using rapid diagnostic tests with return of results were performed by survey staff according to the respective national HIV testing services algorithms on venous blood samples. Laboratory-based confirmatory HIV testing for all participants identified as HIV-positives and self-reported positives, irrespective of HIV testing results, was conducted and included Geenius HIV-1/2 and DNA polymerase chain reaction if Geenius was negative or indeterminate. RESULTS: Of the 16,630 participants who self-reported as HIV-positive, 16,432 (98.6%) were confirmed as HIV-positive and 198 (1.4%) were HIV-negative by subsequent laboratory-based testing. Participants who self-reported as HIV-positive but tested HIV-negative were significantly younger than 30 years, less likely to have received ART, and less likely to have received a CD4 test compared with participants who self-reported as HIV-positive with laboratory-confirmed infection. CONCLUSIONS: A small proportion of self-reported HIV-positive individuals could not be confirmed as positive, which could be due to initial misdiagnosis, deliberate wrong self-report, or misunderstanding of the questionnaire. As universal ART access is expanding, it is increasingly important to ensure quality of HIV testing and confirmation of HIV diagnosis before ART initiation.

Point of Care CD4 Testing in National Household Surveys - Results and Quality Indicators from Eleven Population-Based HIV Impact Assessment (PHIA) Surveys.

Population-based HIV Impact Assessments (PHIAs) are national household (HH) surveys that provide HIV diagnosis and CD4 testing with an immediate return of results. Accurate CD4 results improve HIV-positive participants' clinical care and inform the effectiveness of HIV programs. Here, we present CD4 results from the PHIA surveys that were conducted in 11 countries in sub-Saharan Africa between 2015 and 2018. All of the HIV-positive participants and 2 to 5% of the HIV-negative participants were offered Pima CD4 (Abbott, IL, USA) point-of-care (POC) tests. The quality of the CD4 test was ensured by conducting instrument verification, comprehensive training, quality control, a review of testing errors and an analysis of unweighted CD4 data by HIV status, age, gender, and antiretroviral (ARV) treatment status. Overall, CD4 testing was completed for 23,085 (99.5%) of the 23,209 HIV-positive and 7,329 (2.7%) of the 270,741 negative participants in 11 surveys. The instrument error rate was 11.3% (range, 4.4% to 15.7%). The median CD4 values among HIV-positive and HIV-negative participants (aged 15+) were 468 cells/mm3 (interquartile range [IQR], 307 to 654) and 811 cells/mm3 (IQR, 647 to 1,013), respectively. Among the HIV-positive participants (aged 15+), those with detectable ARVs had higher CD4 values (508 cells/mm3) than those with undetectable ARVs (385.5 cells/mm3). Among the HIV-positive participants (aged 15+), 11.4% (2,528/22,253) had a CD4 value of less than 200 cells/mm3, and approximately half of them (1,225/2,528 = 48.5%) had detectable ARVs, whereas 51.5% (1,303/2,528) had no detectable ARVs (P < 0.0001). We successfully implemented high quality POC CD4 testing using Pima instruments. Our data come from nationally representative surveys in 11 countries and provide unique insights regarding the CD4 distribution among HIV-positive individuals as well as the baseline CD4 values among HIV-negative individuals. IMPORTANCE The manuscript describes CD4 levels among HIV-positive individuals and baseline CD4 levels among HIV-negative individuals from 11 sub-Saharan countries, thereby highlighting the importance of CD4 markers in the context of the HIV epidemic. Despite increased ARV access in each country, advanced HIV disease (CD4 < 200 cells/mm3) persists among approximately 11% of HIV-positive individuals. Therefore, it is important that our findings are shared with the scientific community to assist with similar implementations of point-of-care testing and to conduct a review of HIV programmatic gaps.

Correcting for selection bias in HIV prevalence estimates: an application of sample selection models using data from population-based HIV surveys in seven sub-Saharan African countries.

INTRODUCTION: Population-based biomarker surveys are the gold standard for estimating HIV prevalence but are susceptible to substantial non-participation (up to 30%). Analytical missing data methods, including inverse-probability weighting (IPW) and multiple imputation (MI), are biased when data are missing-not-at-random, for example when people living with HIV more frequently decline participation. Heckman-type selection models can, under certain assumptions, recover unbiased prevalence estimates in such scenarios. METHODS: We pooled data from 142,706 participants aged 15-49 years from nationally representative cross-sectional Population-based HIV Impact Assessments in seven countries in sub-Saharan Africa, conducted between 2015 and 2018 in Tanzania, Uganda, Malawi, Zambia, Zimbabwe, Lesotho and Eswatini. We compared sex-stratified HIV prevalence estimates from unadjusted, IPW, MI and selection models, controlling for household and individual-level predictors of non-participation, and assessed the sensitivity of selection models to the copula function specifying the correlation between study participation and HIV status. RESULTS: In total, 84.1% of participants provided a blood sample to determine HIV serostatus (range: 76% in Malawi to 95% in Uganda). HIV prevalence estimates from selection models diverged from IPW and MI models by up to 5% in Lesotho, without substantial precision loss. In Tanzania, the IPW model yielded lower HIV prevalence estimates among males than the best-fitting copula selection model (3.8% vs. 7.9%). CONCLUSIONS: We demonstrate how HIV prevalence estimates from selection models can differ from those obtained under missing-at-random assumptions. Further benefits include exploration of plausible relationships between participation and outcome. While selection models require additional assumptions and careful specification, they are an important tool for triangulating prevalence estimates in surveys with substantial missing data due to non-participation.

Prevalence of and factors associated with late diagnosis of HIV in Malawi, Zambia, and Zimbabwe: Results from population-based nationally representative surveys.

INTRODUCTION: Late diagnosis of HIV (LD) increases the risk of morbidity, mortality, and HIV transmission. We used nationally representative data from population-based HIV impact assessment (PHIA) surveys in Malawi, Zambia, and Zimbabwe (2015-2016) to characterize adults at risk of LD and to examine associations between LD and presumed HIV transmission to cohabiting sexual partners. METHODS: We estimated the prevalence of LD, defined as CD4 count <350 cells/µL, among adults newly diagnosed with HIV during the surveys and odds ratios for associated factors. We linked newly diagnosed adults (index cases) to their household sexual partners and calculated adjusted odds ratios for associations between LD of the index case, viral load of the index case, and duration of HIV exposure in the relationship, and the HIV status of the household sexual partner. RESULTS: Of 1,804 adults who were newly diagnosed with HIV in the surveys, 49% (882) were diagnosed late. LD was associated with male sex, older age, and almost five times the odds of having an HIV-positive household sexual partner (adjusted odds ratio [aOR], 4.65 [95% confidence interval: 2.56-8.45]). Longer duration of HIV exposure in a relationship and higher viral load of the index case were both independently associated with higher odds of having HIV-positive household sexual partners. Individuals with HIV exposure of more than 5 years had more than three times (aOR 3.42 [95% CI: 1.63-7.18]) higher odds of being HIV positive than those with less than 2 years HIV exposure. The odds of being HIV positive were increased in individuals who were in a relationship with an index case with a viral load of 400-3499 copies/mL (aOR 4.06 [95% CI 0.45-36.46]), 3,500-9,999 copies/mL (aOR 11.32 [95% CI: 4.08-31.39]), 10,000-49,999 copies/mL (aOR 17.07 [95% CI: 9.18-31.72]), and ≥50,000 copies/mL (aOR 28.41 [95% CI: 12.18-66.28]) compared to individuals who were in a relationship with an index case with a viral load of <400 copies/mL. CONCLUSIONS: LD remains a challenge in Southern Africa and is strongly associated with presumed HIV transmission to household sexual partners. Our study underscores the need for earlier HIV diagnosis, particularly among men and older adults, and the importance of index testing.