Race to the Top: evaluation of a novel performance-based financing initiative to promote healthcare delivery in rural Rwanda.

BACKGROUND: Performance-based financing (PBF) has demonstrated a range of successes and failures in improving health outcomes across low- and middle-income countries. Evidence indicates that the success of PBF depends, in large part, on the model selected, in relation to a variety of contextual factors. OBJECTIVE: Partners In Health∣Inshuti Mu Buzima aimed to evaluate health outcomes associated with a novel capacity-building model of PBF at health centers throughout Kirehe district, Rwanda. DESIGN: Thirteen health centers in Kirehe district, which provide healthcare to a population of over 300,000 people, agreed to participate in a PBF initiative scheme that integrated data feedback, quality improvement coaching, peer-to-peer learning, and district-level priority setting. Health centers' progress toward collectively agreed upon site-specific health targets was assessed every 6 months for 18 months. Incentives were awarded only when health centers met goals on all three priorities health centers had collectively agreed upon: 90% coverage of community-based health insurance, 70% contraceptive prevalence rate, and zero acute severe malnutrition cases. Improvement across all four time points and facilities was measured using mixed-effects linear regression. FINDINGS: At 6-month follow-up, 4 of 13 health centers had met 1 target. At 12-month follow-up, 7 centers had met 1 target, and by 18-month follow-up, 6 centers had met 2 targets and 2 centers had met all 3. Average health center performance had improved significantly across the district for all three targets: mean insurance coverage increased from 68% at baseline to 93% (p<0.001); mean number of acute malnutrition cases in the previous 6 months declined from 24 to 5 per facility (p<0.001); and contraceptive prevalence increased from 42 to 59% (p<0.001). A number of innovative improvement initiatives were identified. CONCLUSION: The combining of PBF, district engagement/support, and peer-to-peer learning resulted in significant improvements despite resource constraints and is now being considered as a model for scale-up in other districts of Rwanda.

Medical Education and Global Health Equity.

Recent efforts to expand medical training in resource-constrained settings are laudable, but change that transforms health systems will require new educational approaches. Today's physician-leaders need to leverage clinical and global health knowledge with a nuanced understanding of the social forces that impact health, the ability to marshal political will, and the capacity to manage dynamic programs and institutions. In establishing the University of Global Health Equity, we have identified three reform principles. First, equipping medical schools with the tools and technology to deliver is imperative. Second, the mismatch between the skills taught in most medical schools and those needed to improve fragile health systems must be addressed. Finally, medical schools that strive to eliminate health inequities should "walk the walk," adopting progressive practices to institutionalize equity.

Pursuing equity in cancer care: implementation, challenges and preliminary findings of a public cancer referral center in rural Rwanda.

BACKGROUND: Cancer services are inaccessible in many low-income countries, and few published examples describe oncology programs within the public sector. In 2011, the Rwanda Ministry of Health (RMOH) established Butaro Cancer Center of Excellence (BCCOE) to expand cancer services nationally. In hopes of informing cancer care delivery in similar settings, we describe program-level experience implementing BCCOE, patient characteristics, and challenges encountered. METHODS: Butaro Cancer Center of Excellence was founded on diverse partnerships that emphasize capacity building. Services available include pathology-based diagnosis, basic imaging, chemotherapy, surgery, referral for radiotherapy, palliative care and socioeconomic access supports. Retrospective review of electronic medical records (EMR) of patients enrolled between July 1, 2012 and June 30, 2014 was conducted, supplemented by manual review of paper charts and programmatic records. RESULTS: In the program's first 2 years, 2326 patients presented for cancer-related care. Of these, 70.5% were female, 4.3% children, and 74.3% on public health insurance. In the first year, 66.3% (n = 1144) were diagnosed with cancer. Leading adult diagnoses were breast, cervical, and skin cancer. Among children, nephroblastoma, acute lymphoblastic leukemia, and Hodgkin lymphoma were predominant. As of June 30, 2013, 95 cancer patients had died. Challenges encountered include documentation gaps and staff shortages. CONCLUSION: Butaro Cancer Center of Excellence demonstrates that complex cancer care can be delivered in the most resource-constrained settings, accessible to vulnerable patients. Key attributes that have made BCCOE possible are: meaningful North-south partnerships, innovative task- and infrastructure-shifting, RMOH leadership, and an equity-driven agenda. Going forward, we will apply our experiences and lessons learned to further strengthen BCCOE, and employ the developed EMR system as a valuable platform to assess long-term clinical outcomes and improve care.

Capacity building for oncology programmes in sub-Saharan Africa: the Rwanda experience.

Despite an estimated 456,000 deaths caused by cancer in sub-Saharan Africa in 2012 and a cancer burden that is predicted to double by 2030, the region accounts for only 0·3% of worldwide medical expenditure for cancer. Challenges to cancer care in sub-Saharan Africa include a shortage of clinicians and training programmes, weak healthcare infrastructure, and inadequate supplies. Since 2011, Rwanda has developed a national cancer programme by designing comprehensive, integrated frameworks of care, building local human resource capacity through partnerships, and delivering equitable, rights-based care. In the 2 years since the inauguration of Rwanda's first cancer centre, more than 2500 patients have been enrolled, including patients from every district in Rwanda. Based on Rwanda's national cancer programme development, we suggest principles that could guide other nations in the development of similar cancer programmes.

Improving district facility readiness: a 12-month evaluation of a data-driven health systems strengthening intervention in rural Rwanda.

BACKGROUND: While health systems strengthening (HSS) interventions are recommended by global health policy experts to improve population health in resource-limited settings, few examples exist of evaluations of HSS interventions conducted at the district level. In 2009, a partnership between Partners In Health (PIH), a non-governmental organization, and the Rwandan Ministry of Health (RMOH) was provided funds to implement and evaluate a district-level HSS intervention in two rural districts of Rwanda. DESIGN: The partnership provided limited funds to 14 health centers for targeted systems support in 2010; six others received support prior to the intervention (reference). RMOH health systems norms were mapped across the WHO HSS framework, scored from 0 to 10 and incorporated into a rapid survey assessing 11 domains of facility readiness. Stakeholder meetings allowed partnership leaders to review results, set priorities, and allocate resources. Investments included salary support, infrastructure improvements, medical equipment, and social support for patients. We compared facility domain scores from the start of the intervention to 12 months and tested for correlation between change in score and change in funding allocation to assess equity in our approach. RESULTS: We found significant improvements among intervention facilities from baseline to 12 months across several domains [infrastructure (+4, p=0.0001), clinical services (+1.2, p=0.03), infection and sanitation control (+0.6, p=0.03), medical equipment (+1.0, p=0.02), information use (+2, p=0.002)]. Composite score across domains improved from 6.2 at baseline to 7.4 at 12 months (p=0.002). Across facilities, 50% had composite scores greater than the average score among reference facilities (7.4) at 12 months compared to none at baseline. CONCLUSIONS: Rapid facility surveys, stakeholder engagement, and information feedback can be used for gap analysis and resource allocation. This approach can achieve effective use of limited resources, improve facility readiness, and ensure consistency of facility capacity to provide quality care at the district level.

Data for Program Management: An Accuracy Assessment of Data Collected in Household Registers by Community Health Workers in Southern Kayonza, Rwanda.

Community health workers (CHWs) collect data for routine services, surveys and research in their communities. However, quality of these data is largely unknown. Utilizing poor quality data can result in inefficient resource use, misinformation about system gaps, and poor program management and effectiveness. This study aims to measure CHW data accuracy, defined as agreement between household registers compared to household member interview and client records in one district in Eastern province, Rwanda. We used cluster-lot quality assurance sampling to randomly sample six CHWs per cell and six households per CHW. We classified cells as having 'poor' or 'good' accuracy for household registers for five indicators, calculating point estimates of percent of households with accurate data by health center. We evaluated 204 CHW registers and 1,224 households for accuracy across 34 cells in southern Kayonza. Point estimates across health centers ranged from 79 to 100% for individual indicators and 61 to 72% for the composite indicator. Recording error appeared random for all but the widely under-reported number of women on modern family planning method. Overall, accuracy was largely 'good' across cells, with varying results by indicator. Program managers should identify optimum thresholds for 'good' data quality and interventions to reach them according to data use. Decreasing variability and improving quality will facilitate potential of these routinely-collected data to be more meaningful for community health program management. We encourage further studies assessing CHW data quality and the impact training, supervision and other strategies have on improving it.

Rwanda's evolving community health worker system: a qualitative assessment of client and provider perspectives.

BACKGROUND: Community health workers (CHWs) can play important roles in primary health care delivery, particularly in settings of health workforce shortages. However, little is known about CHWs' perceptions of barriers and motivations, as well as those of the beneficiaries of CHWs. In Rwanda, which faces a significant gap in human resources for health, the Ministry of Health expanded its community health programme beginning in 2007, eventually placing 4 trained CHWs in every village in the country by 2009. The aim of this study was to assess the capacity of CHWs and the factors affecting the efficiency and effectiveness of the CHW programme, as perceived by the CHWs and their beneficiaries. METHODS: As part of a larger report assessing CHWs in Rwanda, a cross-sectional descriptive study was conducted using focus group discussions (FGDs) to collect qualitative information regarding educational background, knowledge and practices of CHWs, and the benefits of community-based care as perceived by CHWs and household beneficiaries. A random sample of 108 CHWs and 36 beneficiaries was selected in 3 districts according to their food security level (low, middle and high). Qualitative and demographic data were analyzed. RESULTS: CHWs were found to be closely involved in the community, and widely respected by the beneficiaries. Rwanda's community performance-based financing (cPBF) was an important incentive, but CHWs were also strongly motivated by community respect. The key challenges identified were an overwhelming workload, irregular trainings, and lack of sufficient supervision. CONCLUSIONS: This study highlights the challenges and areas in need of improvement as perceived by CHWs and beneficiaries, in regards to a nationwide scale-up of CHW interventions in a resource-challenged country. Identifying and understanding these barriers, and addressing them accordingly, particularly within the context of performance-based financing, will serve to strengthen the current CHW system and provide key guidance for the continuing evolution of the CHW system in Rwanda.

Enhancing formal educational and in-service training programs in rural Rwanda: a partnership among the public sector, a nongovernmental organization, and academia.

Global disparities in the distribution, specialization, diversity, and competency of the health workforce are striking. Countries with fewer health professionals have poorer health outcomes compared with countries that have more. Despite major gains in health indicators, Rwanda still suffers from a severe shortage of health professionals.This article describes a partnership launched in 2005 by Rwanda's Ministry of Health with the U.S. nongovernmental organization Partners In Health and with Harvard Medical School and Brigham and Women's Hospital. The partnership has expanded to include the Faculty of Medicine and the School of Public Health at the National University of Rwanda and other Harvard-affiliated academic medical centers. The partnership prioritizes local ownership and-with the ultimate goals of strengthening health service delivery and achieving health equity for poor and underserved populations-it has helped establish new or strengthen existing formal educational programs (conferring advanced degrees) and in-service training programs (fostering continuing professional development) targeting the local health workforce. Harvard Medical School and Brigham and Women's Hospital have also benefited from the partnership, expanding the opportunities for training and research in global health available to their faculty and trainees.The partnership has enabled Rwandan health professionals at partnership-supported district hospitals to acquire new competencies and deliver better health services to rural and underserved populations by leveraging resources, expertise, and growing interest in global health within the participating U.S. academic institutions. Best practices implemented during the partnership's first nine years can inform similar formal educational and in-service training programs in other low-income countries.

Integrated care as a means to improve primary care delivery for adults and adolescents in the developing world: a critical analysis of Integrated Management of Adolescent and Adult Illness (IMAI).

BACKGROUND: More than three decades after the 1978 Declaration of Alma-Ata enshrined the goal of 'health for all', high-quality primary care services remain undelivered to the great majority of the world's poor. This failure to effectively reach the most vulnerable populations has been, in part, a failure to develop and implement appropriate and effective primary care delivery models. This paper examines a root cause of these failures, namely that the inability to achieve clear and practical consensus around the scope and aims of primary care may be contributing to ongoing operational inertia. The present work also examines integrated models of care as a strategy to move beyond conceptual dissonance in primary care and toward implementation. Finally, this paper examines the strengths and weaknesses of a particular model, the World Health Organization's Integrated Management of Adolescent and Adult Illness (IMAI), and its potential as a guidepost toward improving the quality of primary care delivery in poor settings. DISCUSSION: Integration and integrated care may be an important approach in establishing a new paradigm of primary care delivery, though overall, current evidence is mixed. However, a number of successful specific examples illustrate the potential for clinical and service integration to positively impact patient care in primary care settings. One example deserving of further examination is the IMAI, developed by the World Health Organization as an operational model that integrates discrete vertical interventions into a comprehensive delivery system encompassing triage and screening, basic acute and chronic disease care, basic prevention and treatment services, and follow-up and referral guidelines. IMAI is an integrated model delivered at a single point-of-care using a standard approach to each patient based on the universal patient history and physical examination. The evidence base on IMAI is currently weak, but whether or not IMAI itself ultimately proves useful in advancing primary care delivery, it is these principles that should serve as the basis for developing a standard of integrated primary care delivery for adults and adolescents that can serve as the foundation for ongoing quality improvement. SUMMARY: As integrated primary care is the standard of care in the developed world, so too must we move toward implementing integrated models of primary care delivery in poorer settings. Models such as IMAI are an important first step in this evolution. A robust and sustained commitment to innovation, research and quality improvement will be required if integrated primary care delivery is to become a reality in developing world.

Baseline assessment of adult and adolescent primary care delivery in Rwanda: an opportunity for quality improvement.

BACKGROUND: As resource-limited health systems evolve to address complex diseases, attention must be returned to basic primary care delivery. Limited data exists detailing the quality of general adult and adolescent primary care delivered at front-line facilities in these regions. Here we describe the baseline quality of care for adults and adolescents in rural Rwanda. METHODS: Patients aged 13 and older presenting to eight rural health center outpatient departments in one district in southeastern Rwanda between February and March 2011 were included. Routine nurse-delivered care was observed by clinical mentors trained in the WHO Integrated Management of Adolescent & Adult Illness (IMAI) protocol using standardized checklists, and compared to decisions made by the clinical mentor as the gold standard. RESULTS: Four hundred and seventy consultations were observed. Of these, only 1.5% were screened and triaged for emergency conditions. Fewer than 10% of patients were routinely screened for chronic conditions including HIV, tuberculosis, anemia or malnutrition. Nurses correctly diagnosed 50.1% of patient complaints (95% CI: 45.7%-54.5%) and determined the correct treatment 44.9% of the time (95% CI: 40.6%-49.3%). Correct diagnosis and treatment varied significantly across health centers (p = 0.03 and p = 0.04, respectively). CONCLUSION: Fundamental gaps exist in adult and adolescent primary care delivery in Rwanda, including triage, screening, diagnosis, and treatment, with significant variability across conditions and facilities. Research and innovation toward improving and standardizing primary care delivery in sub-Saharan Africa is required. IMAI, supported by routine mentorship, is one potentially important approach to establishing the standards necessary for high-quality care.

Shared learning in an interconnected world: innovations to advance global health equity.

The notion of "reverse innovation"--that some insights from low-income countries might offer transferable lessons for wealthier contexts--is increasingly common in the global health and business strategy literature. Yet the perspectives of researchers and policymakers in settings where these innovations are developed have been largely absent from the discussion to date. In this Commentary, we present examples of programmatic, technological, and research-based innovations from Rwanda, and offer reflections on how the global health community might leverage innovative partnerships for shared learning and improved health outcomes in all countries.

Comprehensive and integrated district health systems strengthening: the Rwanda Population Health Implementation and Training (PHIT) Partnership.

BACKGROUND: Nationally, health in Rwanda has been improving since 2000, with considerable improvement since 2005. Despite improvements, rural areas continue to lag behind urban sectors with regard to key health outcomes. Partners In Health (PIH) has been supporting the Rwanda Ministry of Health (MOH) in two rural districts in Rwanda since 2005. Since 2009, the MOH and PIH have spearheaded a health systems strengthening (HSS) intervention in these districts as part of the Rwanda Population Health Implementation and Training (PHIT) Partnership. The partnership is guided by the belief that HSS interventions should be comprehensive, integrated, responsive to local conditions, and address health care access, cost, and quality. The PHIT Partnership represents a collaboration between the MOH and PIH, with support from the National University of Rwanda School of Public Health, the National Institute of Statistics, Harvard Medical School, and Brigham and Women's Hospital. DESCRIPTION OF INTERVENTION: The PHIT Partnership's health systems support aligns with the World Health Organization's six health systems building blocks. HSS activities focus across all levels of the health system - community, health center, hospital, and district leadership - to improve health care access, quality, delivery, and health outcomes. Interventions are concentrated on three main areas: targeted support for health facilities, quality improvement initiatives, and a strengthened network of community health workers. EVALUATION DESIGN: The impact of activities will be assessed using population-level outcomes data collected through oversampling of the demographic and health survey (DHS) in the intervention districts. The overall impact evaluation is complemented by an analysis of trends in facility health care utilization. A comprehensive costing project captures the total expenditures and financial inputs of the health care system to determine the cost of systems improvement. Targeted evaluations and operational research pieces focus on specific programmatic components, supported by partnership-supported work to build in-country research capacity. DISCUSSION: Building on early successes, the work of the Rwanda PHIT Partnership approach to HSS has already seen noticeable increases in facility capacity and quality of care. The rigorous planned evaluation of the Partnership's HSS activities will contribute to global knowledge about intervention methodology, cost, and population health impact.

Prevention of mother-to-child transmission of HIV: cost-effectiveness of antiretroviral regimens and feeding options in Rwanda.

BACKGROUND: Rwanda's National PMTCT program aims to achieve elimination of new HIV infections in children by 2015. In November 2010, Rwanda adopted the WHO 2010 ARV guidelines for PMTCT recommending Option B (HAART) for all HIV-positive pregnant women extended throughout breastfeeding and discontinued (short course-HAART) only for those not eligible for life treatment. The current study aims to assess the cost-effectiveness of this policy choice. METHODS: Based on a cohort of HIV-infected pregnant women in Rwanda, we modelled the cost-effectiveness of six regimens: dual ARV prophylaxis with either 12 months breastfeeding or replacement feeding; short course HAART (Sc-HAART) prophylaxis with either 6 months breastfeeding, 12 months breastfeeding, or 18 months breastfeeding; and Sc-HAART prophylaxis with replacement feeding. Direct costs were modelled based on all inputs in each scenario and related unit costs. Effectiveness was evaluated by measuring HIV-free survival at 18 months. Savings correspond to the lifetime costs of HIV treatment and care avoided as a result of all vertical HIV infections averted. RESULTS: All PMTCT scenarios considered are cost saving compared to "no intervention." Sc-HAART with 12 months breastfeeding or 6 months breastfeeding dominate all other scenarios. Sc-HAART with 12 months breastfeeding allows for more children to be alive and HIV-uninfected by 18 months than Sc-HAART with 6 months breastfeeding for an incremental cost per child alive and uninfected of 11,882 USD. This conclusion is sensitive to changes in the relative risk of mortality by 18 months for exposed HIV-uninfected children on replacement feeding from birth and those who were breastfed for only 6 months compared to those breastfeeding for 12 months or more. CONCLUSION: Our findings support the earlier decision by Rwanda to adopt WHO Option B and could inform alternatives for breastfeeding duration. Local contexts and existing care delivery models should be part of national policy decisions.

Local use of geographic information systems to improve data utilisation and health services: mapping caesarean section coverage in rural Rwanda.

OBJECTIVES: To show the utility of combining routinely collected data with geographic location using a Geographic Information System (GIS) in order to facilitate a data-driven approach to identifying potential gaps in access to emergency obstetric care within a rural Rwandan health district. METHODS: Total expected births in 2009 at sub-district levels were estimated using community health worker collected population data. Clinical data were extracted from birth registries at eight health centres (HCs) and the district hospital (DH). C-section rates as a proportion of total expected births were mapped by cell. Peri-partum foetal mortality rates per facility-based births, as well as the rate of uterine rupture as an indication for C-section, were compared between areas of low and high C-section rates. RESULTS: The lowest C-section rates were found in the more remote part of the hospital catchment area. The sector with significantly lower C-section rates had significantly higher facility-based peri-partum foetal mortality and incidence of uterine rupture than the sector with the highest C-section rates (P < 0.034). CONCLUSIONS: This simple approach for geographic monitoring and evaluation leveraging existing health service and GIS data facilitated evidence-based decision making and represents a feasible approach to further strengthen local data-driven decisions for resource allocation and quality improvement.