Protocol-driven primary care and community linkage to reduce all-cause mortality in rural Zambia: a stepped-wedge cluster randomized trial.

Introduction: While tremendous progress has been made in recent years to improve the health of people living in low- and middle-income countries (LMIC), significant challenges remain. Chief among these are poor health systems, which are often ill-equipped to respond to current challenges. It remains unclear whether intensive intervention at the health system level will result in improved outcomes, as there have been few rigorously designed comparative studies. We present results of a complex health system intervention that was implemented in Zambia using a cluster randomized design. Methods: BHOMA was a complex health system intervention comprising intensive clinical training and quality improvement measures, support for commodities procurement, improved community outreach, and district level management support. The intervention was introduced as a stepped wedge cluster-randomized trial in 42 predominately rural health centers and their surrounding communities in Lusaka Province, Zambia. Baseline survey was conducted between January-May 2011, mid-line survey was conducted February-November, 2013 and Endline survey, February-November 2015.The primary outcome was all-cause mortality among those between 28 days and 60 years of age and assessed through community-based mortality surveys. Secondary outcomes included post-neonatal under-five mortality and service coverage scores. Service coverage scores were calculated across five domains (child preventative services; child treatment services; family planning; maternal health services, and adult health services). We fit Cox proportional hazards model with shared frailty at the cluster level for the primary analysis. Mortality rates were age-standardized using the WHO World Standard Population. Results: Mortality declined substantially from 3.9 per 1,000 person-years in the pre-intervention period, to 1.5 per 1,000 person-years in the post intervention period. When we compared intervention and control periods, there were 174 deaths in 49,230 person years (age-standardized rate = 4.4 per 1,000 person-years) in the control phase and 277 deaths in 74,519 person years (age-standardized rate = 4.6 per 1,000 person-years) in the intervention phase. Overall, there was no evidence for an effect of the intervention in minimally-adjusted [hazard ratio (HR) = 1.18; 95% confidence interval (CI): 0.88, 1.56; value of p = 0.265], or adjusted (HR = 1.12; 95% CI: 0.84, 1.49; value of p = 0.443) analyses.Coverage scores that showed some evidence of changing with time since the cluster joined the intervention were: an increasing proportion of children sleeping under insecticide treated bed-net (value of p < 0.001); an increasing proportion of febrile children who received appropriate anti-malarial drugs (value of p = 0.039); and an increasing proportion of ever hypertensive adults with currently controlled hypertension (value of p = 0.047). No adjustments were made for multiple-testing and the overall coverage score showed no statistical evidence for a change over time (value of p = 0.308). Conclusion: We noted an overall reduction in post-neonatal under 60 mortality in the study communities during the period of our study, but this could not be attributed to the BHOMA intervention. Some improvements in service coverage scores were observed. Clinical Trial Registration: clinicaltrials.gov, Identifier NCT01942278.

What are the prospects for the hormonal IUD in the public sector? A mixed-method study of the user population in Zambia.

BACKGROUND: The levonorgestrel-releasing intrauterine device (IUD)-also known as the hormonal IUD-is a highly effective contraceptive method that has not been widely available in the public sector in Zambia. Early introduction efforts can provide critical insights into the characteristics of users, reasons for method choice, and experiences getting their method. METHODS: We conducted a survey with 710 public sector clients who received a hormonal IUD, copper IUD, implant or injectable in two provinces of Zambia, and additional in-depth interviews with 29 women. We performed descriptive analyses of survey data and fitted multivariable logistic regression models to assess factors associated with hormonal IUD use. Qualitative interviews were analyzed thematically. RESULTS: Factors associated with hormonal IUD use included full-time or self-employment (relative to both implant and copper IUD use), as well as being older, wealthier, and partner not being aware of method use (relative to implant use only). Common reasons for choosing long-acting methods were duration, perception that the method was "right for my body," and convenience. In addition, a portion of hormonal IUD acceptors mentioned effectiveness, potential for discreet use, few or manageable side effects, and treatment for heavy or painful periods. Between 83 and 95% of women said that they were counseled about menstrual changes and/or non-bleeding side effects; however, more hormonal IUD acceptors recalled being counseled on the possibility of experiencing reduced bleeding (88%) than amenorrhea (43%). Qualitative interviews indicate that women seek methods with minimal or tolerable side effects. While most women reported their partner was aware of method use, men may be more consistently involved in the decision to use contraception rather than in the choice of a particular method. Qualitative results show an appreciation of the lifestyle benefits of reduced bleeding (especially lighter bleeding), although amenorrhea can be cause for concern. CONCLUSIONS: Initial efforts to introduce the hormonal IUD can provide valuable learnings that can inform broader method introduction to expand choice and better suit women's needs in Zambia and elsewhere. Scale-up plans should include emphasis on high quality counseling and demand generation. The government of Zambia is committed to increasing access to high-quality contraception and making more choices available to users. To date, the hormonal IUD, a highly effective, long-lasting contraceptive has not been widely available in the country. A study in pilot introduction settings provided insights into why women chose the methods, their characteristics, and their experiences getting their methods. The 710 women in the study received family planning services in public sector settings in two provinces in Zambia. Women in the study who received a hormonal IUD, copper IUD, implant, or injectable completed a quantitative survey; in-depth interviews were also conducted with 29 women. Results showed common reasons for choosing the long-acting methods (hormonal IUD, copper IUD or implants) were their duration, perception that the method was "right for my body," and convenience. In addition, some hormonal IUD acceptors indicated that they were attracted to the method's effectiveness, potential for discreet use, few or manageable side effects, and treatment for heavy or painful periods. Qualitative interviews with women also showed that women want contraceptive methods that lead to minimal or tolerable side effects. Male partners were typically aware of contraceptive use; however, men were less involved with decisions about the particular method women selected. Use of the hormonal IUD can lead to reduced menstrual bleeding, and in the interviews, women indicated that they liked reduced bleeding (especially lighter bleeding), although amenorrhea (paused bleeding) can be cause for concern. The results can help inform broader method introduction.

Does community-based distribution of HIV self-tests increase uptake of HIV testing? Results of pair-matched cluster randomised trial in Zambia.

OBJECTIVES: Ending HIV by 2030 is a global priority. Achieving this requires alternative HIV testing strategies, such as HIV self-testing (HIVST) to reach all individuals with HIV testing services (HTS). We present the results of a trial evaluating the impact of community-based distribution of HIVST in community and facility settings on the uptake of HTS in rural and urban Zambia. DESIGN: Pair-matched cluster randomised trial. METHODS: In catchment areas of government health facilities, OraQuick HIVST kits were distributed by community-based distributors (CBDs) over 12 months in 2016-2017. Within matched pairs, clusters were randomised to receive the HIVST intervention or standard of care (SOC). Individuals aged ≥16 years were eligible for HIVST. Within communities, CBDs offered HIVST in high traffic areas, door to door and at healthcare facilities. The primary outcome was self-reported recent testing within the previous 12 months measured using a population-based survey. RESULTS: In six intervention clusters (population 148 541), 60 CBDs distributed 65 585 HIVST kits. A recent test was reported by 66% (1622/2465) in the intervention arm compared with 60% (1456/2429) in SOC arm (adjusted risk ratio 1.08, 95% CI 0.94 to 1.24; p=0.15). Uptake of the HIVST intervention was low: 24% of respondents in the intervention arm (585/2493) used an HIVST kit in the previous 12 months. No social harms were identified during implementation. CONCLUSION: Despite distributing a large number of HIVST kits, we found no evidence that this community-based HIVST distribution intervention increased HTS uptake. Other models of HIVST distribution, including secondary distribution and community-designed distribution models, provide alternative strategies to reach target populations. TRIAL REGISTRATION NUMBER: ClinicalTrials.gov Registry (NCT02793804).

The evaluation of the Woman's Condom marketing approach: What value did peer-led interpersonal communication add to the promotion of a new female condom in urban Lusaka?

During a mass media campaign accompanying the launch of the Maximum Diva Woman's Condom (WC) in Lusaka, Zambia, a cluster-randomized evaluation was implemented to measure the added impact of a peer-led interpersonal communication (IPC) intervention on the awareness and uptake of the new female condom (FC). The WC and mass media campaign were introduced simultaneously in 40 urban wards in April 2016; half of the wards were randomly assigned to the treatment (IPC intervention) with cross-sectional surveys conducted before (n = 2,364) and one year after (n = 2,430) the start of the intervention. A pre-specified intention-to-treat (ITT) analysis measured the impact of randomization to IPC at the community level. In adjusted ITT models, there were no statistically significant differences between intervention and control groups. Due to significant implementation challenges, we also conducted exploratory secondary analyses to estimate effects among those who attended an IPC event (n = 66) using instrumental variable and inverse probability weighting analyses. In addition to increases in FC identification (IPC attendees had higher reported use of any condom, improved perceptions of FC's, and were more likely to have discussed contraceptive use with their partner as compared to non-attendees). The introduction of a new FC product combined with an IPC intervention significantly increased general knowledge and awareness in the community as compared to media alone, but did not lead to detectable community level impacts on other primary outcomes of interest. Observational evidence from our study suggests that IPC attendance is associated with increased use and negotiation. Future studies should explore the intensity and duration of IPC programming necessary to achieve detectable community level impacts on behavior. Trial Registration: AEARCTR-0000899.

Application of an HIV Prevention Cascade to Identify Gaps in Increasing Coverage of Voluntary Medical Male Circumcision Services in 42 Rural Zambian Communities.

Increased coverage of voluntary medical male circumcision (VMMC) is needed in countries with high HIV prevalence. We applied an HIV-prevention cascade to identify gaps in male circumcision coverage in Zambia. We used survey data collected in 2013 and 2014/15 to describe circumcision coverage at each time-point, and prevalence of variables related to demand for and supply of VMMC. We explored whether circumcision coverage in 2014/15 was associated with demand and supply among uncircumcised men in 2013. Results show that circumcision coverage was 11.5% in 2013 and 18.0% in 2014/15. Levels of having heard of circumcision and agreeing with prevention benefits was similar at both time-points (79.8% vs 83.2%, and 49.7% vs 50.7%, respectively). In 2013, 39.3% of men perceived services to be available compared to 54.7% in 2014/15. Levels of having heard of circumcision in 2013 was correlated with and higher perceived service availability associated with coverage in 2014/15. VMMC coverage was low in these study sites. Knowledge of prevention tools and of service availability are necessary to increase coverage but alone are insufficient.

Associations between health systems capacity and mother-to-child HIV prevention program outcomes in Zambia.

INTRODUCTION: Zambia has made substantial investments in health systems capacity, yet it remains unclear whether improved service quality improves outcomes. We investigated the association between health system capacity and use of prevention of mother-to-child HIV transmission (PMTCT) services in Zambia. MATERIALS AND METHODS: We analyzed data from two studies conducted in rural and semi-urban Lusaka Province in 2014-2015. Health system capacity, our primary exposure, was measured with a validated balanced scorecard approach. Based on WHO building blocks for health systems strengthening, we derived overall and domain-specific facility scores (range: 0-100), with higher scores indicating greater capacity. Our outcome, community-level maternal antiretroviral drug use at 12 months postpartum, was measured via self-report in a large cohort study evaluating PMTCT program impact. Associations between health systems capacity and our outcome were analyzed via linear regression. RESULTS: Among 29 facilities, median overall facility score was 72 (IQR:67-74). Median domain scores were: patient satisfaction 75 (IQR 71-78); human resources 85 (IQR:63-87); finance 50 (IQR:50-67); governance 82 (IQR:74-91); service capacity 77 (IQR:68-79); service provision 60 (IQR:52-76). Our programmatic outcome was measured from 804 HIV-infected mothers. Median community-level antiretroviral use at 12 months was 81% (IQR:69-89%). Patient satisfaction was the only domain score significantly associated with 12-month maternal antiretroviral use (ß:0.22; p = 0.02). When we excluded the human resources and finance domains, we found a positive association between composite 4-domain facility score and 12-month maternal antiretroviral use in peri-urban but not rural facilities. CONCLUSIONS: In these Zambian health facilities, patient satisfaction was positively associated with maternal antiretroviral 12 months postpartum. The association between overall health system capacity and maternal antiretroviral drug use was stronger in peri-urban versus rural facilities. Additional work is needed to guide strategic investments for improved outcomes in HIV and broader maternal-child health region-wide.

Application of systems thinking: 12-month postintervention evaluation of a complex health system intervention in Zambia: the case of the BHOMA.

RATIONALE, AIMS AND OBJECTIVES: Strong health systems are said to be paramount to achieving effective and equitable health care. The World Health Organization has been advocating for using system-wide approaches such as 'systems thinking' to guide intervention design and evaluation. In this paper we report the system-wide effects of a complex health system intervention in Zambia known as Better Health Outcome through Mentorship and Assessment (BHOMA) that aimed to improve service quality. METHODS: We conducted a qualitative study in three target districts. We used a systems thinking conceptual framework to guide the analysis focusing on intended and unintended consequences of the intervention. NVivo version 10 was used for data analysis. RESULTS: The addressed community responded positively to the BHOMA intervention. The indications were that in the short term there was increased demand for services but the health worker capacity was not severely affected. This means that the prediction that service demand would increase with implementation of BHOMA was correct and the workload also increased, but the help of clinic lay supporters meant that some of the work of clinicians was transferred to these lay workers. However, from a systems perspective, unintended consequences also occurred during the implementation of the BHOMA. CONCLUSIONS: We applied an innovative approach to evaluate a complex intervention in low-income settings, exploring empirically how systems thinking can be applied in the context of health system strengthening. Although the intervention had some positive outcomes by employing system-wide approaches, we also noted unintended consequences.

Safety and Efficacy of the PrePex Male Circumcision Device: Results From Pilot Implementation Studies in Mozambique, South Africa, and Zambia.

BACKGROUND: Fourteen countries in East and Southern Africa have engaged in national programs to accelerate the provision of voluntary medical male circumcision (VMMC) since 2007. Devices have the potential to accelerate VMMC programs by making the procedure easier, quicker, more efficient, and widely accessible. METHODS: Pilot Implementation studies were conducted in Mozambique, South Africa, and Zambia. The primary objective of the studies was to assess the safety of PrePex device procedures when conducted by nurses and clinical officers in adults and adolescent males (13-17 years, South Africa only) with the following end points: number and grade of adverse events (AEs); pain-related AEs measured using visual analog score; device displacements/self-removals; time to complete wound healing; and procedure times for device placement and removal. RESULTS: A total of 1401 participants (1318 adult and 83 adolescent males) were circumcised using the PrePex device across the 3 studies. Rates of moderate/severe AEs were low (1.0%; 2.0%; and 2.8%) in the studies in Mozambique, Zambia, and South Africa, respectively. Eight early self-removals of 1401 (0.6%) were observed, all required corrective surgery. High rates of moderate/severe pain-related AEs were recorded especially at device removal in South Africa (34.9%) and Mozambique (59.5%). Ninety percent of participants were healed at day 56 postplacement. DISCUSSION: The study results from the 3 countries suggest that the implementation of the PrePex device using nonphysician health care workers is both safe and feasible, but better pain control at device removal needs to be put in place to increase the comfort of VMMC clients using the PrePex device.

Application of system thinking concepts in health system strengthening in low-income settings: a proposed conceptual framework for the evaluation of a complex health system intervention: the case of the BHOMA intervention in Zambia.

BACKGROUND: The current drive to strengthen health systems provides an opportunity to develop new strategies that will enable countries to achieve targets for millennium development goals. In this paper, we present a proposed framework for evaluating a new health system strengthening intervention in Zambia known as Better Health Outcomes through Mentoring and Assessment. APPROACH: We briefly describe the intervention design and focus on the proposed evaluation approach through the lens of systems thinking. DISCUSSION: In this paper, we present a proposed framework to evaluate a complex health system intervention applying systems thinking concepts. We hope that lessons learnt from this process will help to adapt the intervention and limit unintended negative consequences while promoting positive effects. Emphasis will be paid to interaction and interdependence between health system building blocks, context and the community.

Implementation and Operational Research: Distance From Household to Clinic and Its Association With the Uptake of Prevention of Mother-to-Child HIV Transmission Regimens in Rural Zambia.

BACKGROUND: In rural settings, HIV-infected pregnant women often live significant distances from facilities that provide prevention of mother-to-child transmission (PMTCT) services. METHODS: We offered universal maternal combination antiretroviral regimens in 4 pilot sites in rural Zambia. To evaluate the impact of services, we conducted a household survey in communities surrounding each facility. We collected information about HIV status and antenatal service utilization from women who delivered in the past 2 years. Using household Global Positioning System coordinates collected in the survey, we measured Euclidean (i.e., straight line) distance between individual households and clinics. Multivariable logistic regression and predicted probabilities were used to determine associations between distance and uptake of PMTCT regimens. RESULTS: From March to December 2011, 390 HIV-infected mothers were surveyed across four communities. Of these, 254 (65%) had household geographical coordinates documented. One hundred sixty-eight women reported use of a PMTCT regimen during pregnancy including 102 who initiated a combination antiretroviral regimen. The probability of PMTCT regimen initiation was the highest within 1.9 km of the facility and gradually declined. Overall, 103 of 145 (71%) who lived within 1.9 km of the facility initiated PMTCT versus 65 of 109 (60%) who lived farther away. For every kilometer increase, the association with PMTCT regimen uptake (adjusted odds ratio: 0.90, 95% confidence interval: 0.82 to 0.99) and combination antiretroviral regimen uptake (adjusted odds ratio: 0.88, 95% confidence interval: 0.80 to 0.97) decreased. CONCLUSIONS: In this rural African setting, uptake of PMTCT regimens was influenced by distance to health facility. Program models that further decentralize care into remote communities are urgently needed.

Universal combination antiretroviral regimens to prevent mother-to-child transmission of HIV in rural Zambia: a two-round cross-sectional study.

OBJECTIVE: To evaluate if a pilot programme to prevent mother-to-child transmission (PMTCT) of the human immunodeficiency virus (HIV) was associated with changes in early childhood survival at the population level in rural Zambia. METHODS: Combination antiretroviral regimens were offered to pregnant and breastfeeding, HIV-infected women, irrespective of immunological status, at four rural health facilities. Twenty-four-month HIV-free survival among children born to HIV-infected mothers was determined before and after PMTCT programme implementation using community surveys. Households were randomly selected and women who had given birth in the previous 24 months were asked to participate. Mothers were tested for HIV antibodies and children born to HIV-infected mothers were tested for viral deoxyribonucleic acid. Multivariable models were used to determine factors associated with child HIV infection or death. FINDINGS: In the first survey (2008-2009), 335 of 1778 women (18.8%) tested positive for HIV. In the second (2011), 390 of 2386 (16.3%) tested positive. The 24-month HIV-free survival in HIV-exposed children was 0.66 (95% confidence interval, CI: 0.63-0.76) in the first survey and 0.89 (95% CI: 0.83-0.94) in the second. Combination antiretroviral regimen use was associated with a lower risk of HIV infection or death in children (adjusted hazard ratio: 0.33, 95% CI: 0.15-0.73). Maternal knowledge of HIV status, use of HIV tests and use of combination regimens during pregnancy increased between the surveys. CONCLUSION: The PMTCT programme was associated with an increased HIV-free survival in children born to HIV-infected mothers. Maternal utilization of HIV testing and treatment in the community also increased.

A mobile phone-based, community health worker program for referral, follow-up, and service outreach in rural Zambia: outcomes and overview.

BACKGROUND: Mobile health (m-health) utilizes widespread access to mobile phone technologies to expand health services. Community health workers (CHWs) provide first-level contact with health facilities; combining CHW efforts with m-health may be an avenue for improving primary care services. As part of a primary care improvement project, a pilot CHW program was developed using a mobile phone-based application for outreach, referral, and follow-up between the clinic and community in rural Zambia. MATERIALS AND METHODS: The program was implemented at six primary care sites. Computers were installed at clinics for data entry, and data were transmitted to central servers. In the field, using a mobile phone to send data and receive follow-up requests, CHWs conducted household health surveillance visits, referred individuals to clinic, and followed up clinic patients. RESULTS: From January to April 2011, 24 CHWs surveyed 6,197 households with 33,304 inhabitants. Of 15,539 clinic visits, 1,173 (8%) had a follow-up visit indicated and transmitted via a mobile phone to designated CHWs. CHWs performed one or more follow-ups on 74% (n=871) of active requests and obtained outcomes on 63% (n=741). From all community visits combined, CHWs referred 840 individuals to a clinic. CONCLUSIONS: CHWs completed all planned aspects of surveillance and outreach, demonstrating feasibility. Components of this pilot project may aid clinical care in rural settings and have potential for epidemiologic and health system applications. Thus, m-health has the potential to improve service outreach, guide activities, and facilitate data collection in Zambia.

Application of balanced scorecard in the evaluation of a complex health system intervention: 12 months post intervention findings from the BHOMA intervention: a cluster randomised trial in Zambia.

INTRODUCTION: In many low income countries, the delivery of quality health services is hampered by health system-wide barriers which are often interlinked, however empirical evidence on how to assess the level and scope of these barriers is scarce. A balanced scorecard is a tool that allows for wider analysis of domains that are deemed important in achieving the overall vision of the health system. We present the quantitative results of the 12 months follow-up study applying the balanced scorecard approach in the BHOMA intervention with the aim of demonstrating the utility of the balanced scorecard in evaluating multiple building blocks in a trial setting. METHODS: The BHOMA is a cluster randomised trial that aims to strengthen the health system in three rural districts in Zambia. The intervention aims to improve clinical care quality by implementing practical tools that establish clear clinical care standards through intensive clinic implementations. This paper reports the findings of the follow-up health facility survey that was conducted after 12 months of intervention implementation. Comparisons were made between those facilities in the intervention and control sites. STATA version 12 was used for analysis. RESULTS: The study found significant mean differences between intervention(I) and control (C) sites in the following domains: Training domain (Mean I:C; 87.5.vs 61.1, mean difference 23.3, p = 0.031), adult clinical observation domain (mean I:C; 73.3 vs.58.0, mean difference 10.9, p = 0.02 ) and health information domain (mean I:C; 63.6 vs.56.1, mean difference 6.8, p = 0.01. There was no gender differences in adult service satisfaction. Governance and motivation scores did not differ between control and intervention sites. CONCLUSION: This study demonstrates the utility of the balanced scorecard in assessing multiple elements of the health system. Using system wide approaches and triangulating data collection methods seems to be key to successful evaluation of such complex health intervention. TRIAL NUMBER: ClinicalTrials.gov NCT01942278.

Protocol-driven primary care and community linkages to improve population health in rural Zambia: the Better Health Outcomes through Mentoring and Assessment (BHOMA) project.

INTRODUCTION: Zambia's under-resourced public health system will not be able to deliver on its health-related Millennium Development Goals without a substantial acceleration in mortality reduction. Reducing mortality will depend not only upon increasing access to health care but also upon improving the quality of care that is delivered. Our project proposes to improve the quality of clinical care and to improve utilization of that care, through a targeted quality improvement (QI) intervention delivered at the facility and community level. DESCRIPTION OF IMPLEMENTATION: The project is being carried out 42 primary health care facilities that serve a largely rural population of more than 450,000 in Zambia's Lusaka Province. We have deployed six QI teams to implement consensus clinical protocols, forms, and systems at each site. The QI teams define new clinical quality expectations and provide tools needed to deliver on those expectations. They also monitor the care that is provided and mentor facility staff to improve care quality. We also engage community health workers to actively refer and follow up patients. EVALUATION DESIGN: Project implementation occurs over a period of four years in a stepped expansion to six randomly selected new facilities every three months. Three annual household surveys will determine population estimates of age-standardized mortality and under-5 mortality in each community before, during, and after implementation. Surveys will also provide measures of childhood vaccine coverage, pregnancy care utilization, and general adult health. Health facility surveys will assess coverage of primary health interventions and measures of health system effectiveness. DISCUSSION: The patient-provider interaction is an important interface where the community and the health system meet. Our project aims to reduce population mortality by substantially improving this interaction. Our success will hinge upon the ability of mentoring and continuous QI to improve clinical service delivery. It will also be critical that once the quality of services improves, increasing proportions of the population will recognize their value and begin to utilize them.

Approaches to ensuring and improving quality in the context of health system strengthening: a cross-site analysis of the five African Health Initiative Partnership programs.

BACKGROUND: Integrated into the work in health systems strengthening (HSS) is a growing focus on the importance of ensuring quality of the services delivered and systems which support them. Understanding how to define and measure quality in the different key World Health Organization building blocks is critical to providing the information needed to address gaps and identify models for replication. DESCRIPTION OF APPROACHES: We describe the approaches to defining and improving quality across the five country programs funded through the Doris Duke Charitable Foundation African Health Initiative. While each program has independently developed and implemented country-specific approaches to strengthening health systems, they all included quality of services and systems as a core principle. We describe the differences and similarities across the programs in defining and improving quality as an embedded process essential for HSS to achieve the goal of improved population health. The programs measured quality across most or all of the six WHO building blocks, with specific areas of overlap in improving quality falling into four main categories: 1) defining and measuring quality; 2) ensuring data quality, and building capacity for data use for decision making and response to quality measurements; 3) strengthened supportive supervision and/or mentoring; and 4) operational research to understand the factors associated with observed variation in quality. CONCLUSIONS: Learning the value and challenges of these approaches to measuring and improving quality across the key components of HSS as the projects continue their work will help inform similar efforts both now and in the future to ensure quality across the critical components of a health system and the impact on population health.

Improving health information systems for decision making across five sub-Saharan African countries: Implementation strategies from the African Health Initiative.

BACKGROUND: Weak health information systems (HIS) are a critical challenge to reaching the health-related Millennium Development Goals because health systems performance cannot be adequately assessed or monitored where HIS data are incomplete, inaccurate, or untimely. The Population Health Implementation and Training (PHIT) Partnerships were established in five sub-Saharan African countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia) to catalyze advances in strengthening district health systems. Interventions were tailored to the setting in which activities were planned. COMPARISONS ACROSS STRATEGIES: All five PHIT Partnerships share a common feature in their goal of enhancing HIS and linking data with improved decision-making, specific strategies varied. Mozambique, Ghana, and Tanzania all focus on improving the quality and use of the existing Ministry of Health HIS, while the Zambia and Rwanda partnerships have introduced new information and communication technology systems or tools. All partnerships have adopted a flexible, iterative approach in designing and refining the development of new tools and approaches for HIS enhancement (such as routine data quality audits and automated troubleshooting), as well as improving decision making through timely feedback on health system performance (such as through summary data dashboards or routine data review meetings). The most striking differences between partnership approaches can be found in the level of emphasis of data collection (patient versus health facility), and consequently the level of decision making enhancement (community, facility, district, or provincial leadership). DISCUSSION: Design differences across PHIT Partnerships reflect differing theories of change, particularly regarding what information is needed, who will use the information to affect change, and how this change is expected to manifest. The iterative process of data use to monitor and assess the health system has been heavily communication dependent, with challenges due to poor feedback loops. Implementation to date has highlighted the importance of engaging frontline staff and managers in improving data collection and its use for informing system improvement. Through rigorous process and impact evaluation, the experience of the PHIT teams hope to contribute to the evidence base in the areas of HIS strengthening, linking HIS with decision making, and its impact on measures of health system outputs and impact.

Measuring health system strengthening: application of the balanced scorecard approach to rank the baseline performance of three rural districts in Zambia.

INTRODUCTION: There is growing interest in health system performance and recently WHO launched a report on health systems strengthening emphasising the need for close monitoring using system-wide approaches. One recent method is the balanced scorecard system. There is limited application of this method in middle- and low-income countries. This paper applies the concept of balanced scorecard to describe the baseline status of three intervention districts in Zambia. METHODOLOGY: The Better Health Outcome through Mentoring and Assessment (BHOMA) project is a randomised step-wedged community intervention that aims to strengthen the health system in three districts in the Republic of Zambia. To assess the baseline status of the participating districts we used a modified balanced scorecard approach following the domains highlighted in the MOH 2011 Strategic Plan. RESULTS: Differences in performance were noted by district and residence. Finance and service delivery domains performed poorly in all study districts. The proportion of the health workers receiving training in the past 12 months was lowest in Kafue (58%) and highest in Luangwa district (77%). Under service capacity, basic equipment and laboratory capacity scores showed major variation, with Kafue and Luangwa having lower scores when compared to Chongwe. The finance domain showed that Kafue and Chongwe had lower scores (44% and 47% respectively). Regression model showed that children's clinical observation scores were negatively correlated with drug availability (coeff -0.40, p = 0.02). Adult clinical observation scores were positively association with adult service satisfaction score (coeff 0.82, p = 0.04) and service readiness (coeff 0.54, p = 0.03). CONCLUSION: The study applied the balanced scorecard to describe the baseline status of 42 health facilities in three districts of Zambia. Differences in performance were noted by district and residence in most domains with finance and service delivery performing poorly in all study districts. This tool could be valuable in monitoring and evaluation of health systems.

Field effectiveness of combination antiretroviral prophylaxis for the prevention of mother-to-child HIV transmission in rural Zambia.

OBJECTIVE: To evaluate the effectiveness of maternal combination antiretroviral prophylaxis for prevention of mother-to-child transmission of HIV (PMTCT) in a program setting. DESIGN: Prospective cohort study. SETTING: Nine primary care clinics in rural Zambia. PARTICIPANTS: Two hundred and eighty-four HIV-infected pregnant women at at least 28 weeks gestation initiating PMTCT services between April 2009 and January 2011 and their newborn infants. INTERVENTION: In four 'intervention' sites, PMTCT comprised universal combination antiretroviral prophylaxis (i.e. irrespective of CD4 cell count) from pregnancy until the cessation of breastfeeding. In five 'control' sites, women received antenatal zidovudine and peripartum nevirapine, the standard of care at the time. Prophylaxis during breastfeeding was not available in control sites. MAIN OUTCOME MEASURE: Cumulative infant HIV infection and death at 12 months postpartum. RESULTS: At 12 month postpartum, one of 104 (1.0%) infants born to mothers at the intervention sites were HIV-infected, compared with 14 of 116 (12.1%) receiving care in the control sites [relative risk (RR): 12.6, 95% CI: 2.2-73.1; P = 0.005]. When we considered the composite outcome of HIV infection or death, similar trends were observed in the overall study population (RR: 3.4, 95% CI: 1.6-7.6; P = 0.002) and in a sub-analysis of women with CD4 cell count more than 350 cells/µl (RR: 3.2; 95% CI: 1.1-9.6; P = 0.04). CONCLUSION: When compared with PMTCT services based on antenatal zidovudine and peripartum nevirapine, the provision of maternal combination prophylaxis imparted measurable health benefits to HIV-exposed infants. Implementation research is needed to further tailor and optimize these strategies for similar field settings.

Nonvirologic algorithms for predicting HIV infection among HIV-exposed infants younger than 12 weeks of age.

BACKGROUND: Early initiation of antiretroviral therapy has been shown to reduce mortality among perinatally HIV-infected infants, but availability of virologic testing remains limited in many settings. METHODS: We collected cross-sectional data from mother-infant pairs in three primary care clinics in Lusaka, Zambia, to develop predictive models for HIV infection among infants younger than 12 weeks of age. We evaluated algorithm performance for all possible combinations of selected characteristics using an iterative approach. In primary analysis, we identified the model with the highest combined sensitivity and specificity. RESULTS: Between July 2009 and May 2011, 822 eligible HIV-infected mothers and their HIV-exposed infants were enrolled; of these, 44 (5.4%) infants had HIV diagnosed. We evaluated 382,155,260 different characteristic combinations for predicting infant HIV infection. The algorithm with the highest combined sensitivity and specificity required 5 of the following 7 characteristic thresholds: infant CD8 percentage >22; infant CD4 percentage ≤44; infant weight-for-age Z score ≤0; infant CD4 ≤1600 cells/µL; infant CD8 >2200 cells/µL; maternal CD4 ≤600 cells/µL; and mother not currently using antiretroviral therapy for HIV treatment. This combination had a sensitivity of 90.3%, specificity of 78.4%, positive predictive value of 22.4%, negative predictive value of 99.2% and area under the curve of 0.844. CONCLUSION: Predicting HIV infection in HIV-exposed infants in this age group is difficult using clinical and immunologic characteristics. Expansion of polymerase chain reaction capacity in resource-limited settings remains urgently needed.