Operationalising health systems thinking: a pathway to high effective coverage.

BACKGROUND: The global health community has recognised the importance of defining and measuring the effective coverage of health interventions and their implementation strength to monitor progress towards global mortality and morbidity targets. Existing health system models and frameworks guide thinking around these measurement areas; however, they fall short of adequately capturing the dynamic and multi-level relationships between different components of the health system. These relationships must be articulated for measurement and managed to effectively deliver health interventions of sufficient quality to achieve health impacts. Save the Children's Saving Newborn Lives programme and EnCompass LLC, its evaluation partner, developed and applied the Pathway to High Effective Coverage as a health systems thinking framework (hereafter referred to as the Pathway) in its strategic planning, monitoring and evaluation. METHODS: We used an iterative approach to develop, test and refine thinking around the Pathway. The initial framework was developed based on existing literature, then shared and vetted during consultations with global health thought leaders in maternal and newborn health. RESULTS: The Pathway is a robust health systems thinking framework that unpacks system, policy and point of intervention delivery factors, thus encouraging specific actions to address gaps in implementation and facilitate the achievement of high effective coverage. The Pathway includes six main components - (1) national readiness; (2) system structures; (3) management capacity; (4) implementation strength; (5) effective coverage; and (6) impact. Each component is comprised of specific elements reflecting the range of facility-, community- and home-based interventions. We describe applications of the Pathway and results for in-country strategic planning, monitoring of progress and implementation strength, and evaluation. CONCLUSIONS: The Pathway provides a cohesive health systems thinking framework that facilitates assessment and coordinated action to achieve high coverage and impact. Experiences of its application show its utility in guiding strategic planning and in more comprehensive and effective monitoring and evaluation as well as its potential adaptability for use in other health areas and sectors.

Stillbirths: progress and unfinished business.

This first paper of the Lancet Series on ending preventable stillbirths reviews progress in essential areas, identified in the 2011 call to action for stillbirth prevention, to inform the integrated post-2015 agenda for maternal and newborn health. Worldwide attention to babies who die in stillbirth is rapidly increasing, from integration within the new Global Strategy for Women's, Children's and Adolescents' Health, to country policies inspired by the Every Newborn Action Plan. Supportive new guidance and metrics including stillbirth as a core health indicator and measure of quality of care are emerging. Prenatal health is a crucial biological foundation to life-long health. A key priority is to integrate action for prenatal health within the continuum of care for maternal and newborn health. Still, specific actions for stillbirths are needed for advocacy, policy formulation, monitoring, and research, including improvement in the dearth of data for effective coverage of proven interventions for prenatal survival. Strong leadership is needed worldwide and in countries. Institutions with a mandate to lead global efforts for mothers and their babies must assert their leadership to reduce stillbirths by promoting healthy and safe pregnancies.

Stillbirths: ending preventable deaths by 2030.

Efforts to achieve the new worldwide goals for maternal and child survival will also prevent stillbirth and improve health and developmental outcomes. However, the number of annual stillbirths remains unchanged since 2011 and is unacceptably high: an estimated 2.6 million in 2015. Failure to consistently include global targets or indicators for stillbirth in post-2015 initiatives shows that stillbirths are hidden in the worldwide agenda. This Series paper summarises findings from previous papers in this Series, presents new analyses, and proposes specific criteria for successful integration of stillbirths into post-2015 initiatives for women's and children's health. Five priority areas to change the stillbirth trend include intentional leadership; increased voice, especially of women; implementation of integrated interventions with commensurate investment; indicators to measure effect of interventions and especially to monitor progress; and investigation into crucial knowledge gaps. The post-2015 agenda represents opportunities for all stakeholders to act together to end all preventable deaths, including stillbirths.

A Community Health Worker "logic model": towards a theory of enhanced performance in low- and middle-income countries.

BACKGROUND: There has been a resurgence of interest in national Community Health Worker (CHW) programs in low- and middle-income countries (LMICs). A lack of strong research evidence persists, however, about the most efficient and effective strategies to ensure optimal, sustained performance of CHWs at scale. To facilitate learning and research to address this knowledge gap, the authors developed a generic CHW logic model that proposes a theoretical causal pathway to improved performance. The logic model draws upon available research and expert knowledge on CHWs in LMICs. METHODS: Construction of the model entailed a multi-stage, inductive, two-year process. It began with the planning and implementation of a structured review of the existing research on community and health system support for enhanced CHW performance. It continued with a facilitated discussion of review findings with experts during a two-day consultation. The process culminated with the authors' review of consultation-generated documentation, additional analysis, and production of multiple iterations of the model. RESULTS: The generic CHW logic model posits that optimal CHW performance is a function of high quality CHW programming, which is reinforced, sustained, and brought to scale by robust, high-performing health and community systems, both of which mobilize inputs and put in place processes needed to fully achieve performance objectives. Multiple contextual factors can influence CHW programming, system functioning, and CHW performance. CONCLUSIONS: The model is a novel contribution to current thinking about CHWs. It places CHW performance at the center of the discussion about CHW programming, recognizes the strengths and limitations of discrete, targeted programs, and is comprehensive, reflecting the current state of both scientific and tacit knowledge about support for improving CHW performance. The model is also a practical tool that offers guidance for continuous learning about what works. Despite the model's limitations and several challenges in translating the potential for learning into tangible learning, the CHW generic logic model provides a solid basis for exploring and testing a causal pathway to improved performance.

Validity of self-assessment in a quality improvement collaborative in Ecuador.

OBJECTIVE: Health care quality improvement (QI) efforts commonly use self-assessment to measure compliance with quality standards. This study investigates the validity of self-assessment of quality indicators. DESIGN: Cross sectional. SETTING: A maternal and newborn care improvement collaborative intervention conducted in health facilities in Ecuador in 2005. PARTICIPANTS: Four external evaluators were trained in abstracting medical records to calculate six indicators reflecting compliance with treatment standards. INTERVENTIONS: About 30 medical records per month were examined at 12 participating health facilities for a total of 1875 records. The same records had already been reviewed by QI teams at these facilities (self-assessment). MAIN OUTCOME MEASURES: Overall compliance, agreement (using the Kappa statistic), sensitivity and specificity were analyzed. We also examined patterns of disagreement and the effect of facility characteristics on levels of agreement. RESULTS: External evaluators reported compliance of 69-90%, while self-assessors reported 71-92%, with raw agreement of 71-95% and Kappa statistics ranging from fair to almost perfect agreement. Considering external evaluators as the gold standard, sensitivity of self-assessment ranged from 90 to 99% and specificity from 48 to 86%. Simpler indicators had fewer disagreements. When disagreements occurred between self-assessment and external valuators, the former tended to report more positive findings in five of six indicators, but this tendency was not of a magnitude to change program actions. Team leadership, understanding of the tools and facility size had no overall impact on the level of agreement. CONCLUSIONS: When compared with external evaluation (gold standard), self-assessment was found to be sufficiently valid for tracking QI team performance. Sensitivity was generally higher than specificity. Simplifying indicators may improve validity.

Effectiveness of collaborative improvement: evidence from 27 applications in 12 less-developed and middle-income countries.

INTRODUCTION: The improvement collaborative approach has been widely promoted in developed countries as an effective method to spread clinical practices, but little has been published on its effectiveness in developing country settings. Between 1998 and 2008, the United States Agency for International Development funded 54 collaboratives in 14 low- and middle-income countries, adapting the approach to resource-constrained environments. METHODS: The authors analysed data on provider compliance with standards and outcomes from 27 collaboratives in 12 countries that met study inclusion criteria (at least 12 months of data available for analysis and indicators measured as percentages). The dataset, representing 1338 facility-based teams, consisted of 135 time-series charts related to maternal, newborn and child health, HIV/AIDS, family planning, malaria and tuberculosis. An average of 28 months of data was available for each chart. RESULTS: Eighty-seven per cent of these charts achieved performance levels of 80% or higher, and 76% reached at least 90% performance, even though two-thirds had a baseline performance below 50%. Teams achieved average increases of 51.9 percentage points (SE = 28.0) per chart, with baseline value being the main determinant of absolute increase. Teams consistently maintained this level of performance for an average of 13 months (69% of months of observation). The average time to reach 80% performance was 9.2 months (SE 8.5), and to reach 90% performance, 14.4 months (SE = 12.0). CONCLUSION: Collaborative improvement can produce significant, sustained gains in compliance with standards and outcomes in less-developed settings and merits wider application as a strategy for health systems strengthening.

Evidence base for children affected by HIV and AIDS in low prevalence and concentrated epidemic countries: applicability to programming guidance from high prevalence countries.

As global commitment grows to protect and support children affected by HIV and AIDS, questions remain about how best to meet the needs of these children in low prevalence settings and whether information from high prevalence countries can appropriately guide programming in these settings. A 2007 search for the evidence in low prevalence settings on situational challenges of HIV and AIDS-affected children and interventions to address these challenges identified 413 documents. They were reviewed and judged for quality of documentation and scientific rigor. Information was compiled across eight types of challenges (health and health care, nutrition and food security, education, protection, placement, psychosocial development, socioeconomic status, and stigma/discrimination); and also assessed was strength of evidence for situational and intervention findings. Results were compared to three programming principles drawn from research in high prevalence countries: family-centered preventive efforts, treatment, and care; family-focused support to ensure capacity to care for and protect these children; and sustaining economic livelihood of HIV and AIDS-affected households. Findings show that children affected by HIV and AIDS in low prevalence settings face increased vulnerabilities similar to those in high prevalence settings. These findings support seeking and testing programmatic directions for interventions identified in high prevalence settings. However, low prevalence settings/countries are extremely diverse, and the strength of the evidence base among them was mixed (strong, moderate, and weak in study design and documentation), geographically limited, and had insufficient evidence on interventions to draw conclusions about how best to reduce additional vulnerabilities of affected children. Information on family, economic, sociocultural, and political factors within local contexts will be vital in the development of appropriate strategies to mitigate vulnerabilities.

Effects of mutual health organizations on use of priority health-care services in urban and rural Mali: a case-control study.

OBJECTIVE: To examine the effects of a community-based mutual health organization (MHO) on utilization of priority health services, financial protection of its members and inclusion of the poor and other target groups. METHODS: Four MHOs were established in two districts in Mali. A case-control study was carried out in which household survey data were collected from 817 MHO member households, 787 non-member households in MHO catchment areas, and 676 control households in areas without MHOs. We compiled MHO register data by household for a 22-month period. Outcome measures included utilization of priority services, health expenditures and out-of-pocket payments. Independent variables included individual, household and community demographic, socioeconomic and access characteristics, as determined through a household survey in 2004. FINDINGS: MHO members who were up to date on premium payments (controlling for education, distance to the nearest health facility and other factors) were 1.7 times more likely to get treated for fevers in modern facilities; three times more likely to take children with diarrhoea to a health facility and/or treat them with oral rehydration salts at home; twice as likely to make four or more prenatal visits; and twice as likely, if pregnant or younger than 5 years, to sleep under an insecticide-treated net (P < 0.10 or better in all cases). However, distance was also a significant negative predictor for the utilization of many services, particularly assisted deliveries. Household and individual enrolment in an MHO were not significantly associated with socioeconomic status (with the exception of the highest quintile), and MHOs seemed to provide some financial protection for their members. CONCLUSIONS: MHOs are one mechanism that countries strengthening the supply of primary care can use to increase financial access to - and equity in - priority health services.

Determinants and consequences of health worker motivation in hospitals in Jordan and Georgia.

Health worker motivation reflects the interactions between workers and their work environment. Because of the interactive nature of motivation, local organizational and broader sector policies have the potential to affect motivation of health workers, either positively or negatively, and as such to influence health system performance. Yet little is known about the key determinants and outcomes of motivation in developing and transition countries. This exploratory research, unique in its broader study of a whole range of motivational determinants and outcomes, was conducted in two hospitals in Jordan and two in Georgia. Three complementary approaches to data collection were used: (1) a contextual analysis; (2) a qualitative 360-degree assessment; and (3) a quantitative in-depth analysis focused on the individual determinants and outcomes of the worker's motivational process. A wide range of psychometric scales was used to assess personality differences, perceived contextual factors and motivational outcomes (feelings, thoughts and behaviors) on close to 500 employees in each country. Although Jordan and Georgia have very different cultural and socio-economic environments, the results from these two countries exhibited many similarities among key determinants: self-efficacy, pride, management openness, job properties, and values had significant effects on motivational outcomes in both countries. Where results were divergent, differences between the two countries highlight the importance of local culture on motivational issues, and the need to tailor motivational interventions to the specific issues related to particular professional or other groupings in the workforce. While workers themselves state that financial reward is critical for their work satisfaction, the data suggest a number of non-financial interventions that may be more effective means to improve worker motivation. This research highlights the complexity of worker motivation, and the need for a more comprehensive approach to increasing motivation, satisfaction and performance, and for interventions at both organizational and policy levels.

Health sector reform and public sector health worker motivation: a conceptual framework.

Motivation in the work context can be defined as an individual's degree of willingness to exert and maintain an effort towards organizational goals. Health sector performance is critically dependent on worker motivation, with service quality, efficiency, and equity, all directly mediated by workers' willingness to apply themselves to their tasks. Resource availability and worker competence are essential but not sufficient to ensure desired worker performance. While financial incentives may be important determinants of worker motivation, they alone cannot and have not resolved all worker motivation problems. Worker motivation is a complex process and crosses many disciplinary boundaries, including economics, psychology, organizational development, human resource management, and sociology. This paper discusses the many layers of influences upon health worker motivation: the internal individual-level determinants, determinants that operate at organizational (work context) level, and determinants stemming from interactions with the broader societal culture. Worker motivation will be affected by health sector reforms which potentially affect organizational culture, reporting structures, human resource management, channels of accountability, types of interactions with clients and communities, etc. The conceptual model described in this paper clarifies ways in which worker motivation is influenced and how health sector reform can positively affect worker motivation. Among others, health sector policy makers can better facilitate goal congruence (between workers and the organizations they work for) and improved worker motivation by considering the following in their design and implementation of health sector reforms: addressing multiple channels for worker motivation, recognizing the importance of communication and leadership for reforms, identifying organizational and cultural values that might facilitate or impede implementation of reforms, and understanding that reforms may have differential impacts on various cadres of health workers.

Methods for assessing quality of provider performance in developing countries.

OBJECTIVE: To compare the effectiveness of methods for assessing the quality of pediatric outpatient health provider performance in developing countries. DESIGN: Exit interviews, record reviews, and provider interview results were compared with those of direct observation of pediatric patient care. Thirty health care providers in 14 facilities in Lilongwe District, Malawi were interviewed and observed, treating 436 children in August 1994. Caretakers for 426 of the patients were interviewed, and 362 pediatric outpatient entries in the health center patient register were located and reviewed. MAIN MEASURES: Kappa statistics measuring the level of agreement on the same sample were used for three methods (record reviews, provider interviews, and exit interviews) in comparison with the fourth method, direct observation. RESULTS: All three methods had strengths and weaknesses. Exit interviews with caretakers provided reliable responses for many history-taking tasks, easily discernible physical exam tasks, and many counseling tasks. Record review took little time, but provided limited information: however, the results were reliable for treatments. Provider interviews had much lower reliability, but were usable for assessing more rare events (treating severely ill children). CONCLUSIONS: Although exit interviews and direct observation provide the 'best' data, they are most resource-intensive. Depending on the purpose of the assessment, various combinations of methods might be more effective.

A framework for institutionalizing quality assurance.

OBJECTIVE: To develop a framework to support the institutionalization of quality assurance (QA). DESIGN: The framework for institutionalizing QA consists of a model of eight essential elements and a 'roadmap' for the process of institutionalization. The essential elements are the building blocks required for implementing and sustaining QA activities. Core QA activities include defining, measuring and improving quality. The essential elements are grouped under three categories: the internal enabling environment (internal to the organization or system), organizing for quality, and support functions. The enabling environment contains the essential elements of leadership, policy, core values, and resources. Organizing for quality includes the structure for implementing QA. Three essential elements are primarily support functions: capacity building, communication and information, and rewarding quality. The model can be applied at the level of an organization or a system. The paper also describes the process of institutionalizing QA, starting from a state of preawareness, passing through four phases (awareness, experiential, expansion, and consolidation), and culminating in a state of maturity. The process is not linear; an organization may regress, vacillate between phases, or even remain stagnant. Some phases (e.g. awareness and experiential) may occur simultaneously. CONCLUSION: The framework has been introduced in nearly a dozen countries in Latin America and Africa. The conceptual model has been used to support strategic planning and directing Ministry of Health work plans, and also as a resource for determining the elements necessary to strengthen and sustain QA. The next step will be the development and evaluation of an assessment tool to monitor developmental progress in the institutionalization of QA.

Garantia de qualidade dos cuidados de saúde nos países em desenvolvimento / Quality assurance of health care in developing countries

Nos quinze anos desde a Declaração de Alma Ata, na qual a comunidade internacional engajou-se no fornecimento de cuidados primários de saúde (CPS) para todos, foram feitos grandes esforços em quase todos os países em desenvolvimento para a expansão dos CPS. Isto foi alcançado através do incremento dos recursos alocados por fontes nacionais e internacionais, expansão da formação de trabalhadores de saúde e vasta reorganização do sistema de saúde. Foram anunciadas melhorias importantes no alcance e cobertura de saúde pela maior parte de países, muitos dos quais salientaram modestos declínios na mortalidade infantil e algumas reduções em morbilidade especifica. Contudo, as melhorias indicadas não foram sempre comparadas com os recursos utilizados. Além disso, pouco se fez para avaliar a qualidade dos serviços ou para garantir que os recursos tenham um impacto óptimo. Os métodos da Garantia da Qualidade (GQ) podem ajudar aos gestores de programas de saúde na definição de directrizes clínicas e padrões de procedimentos operativos, para avaliar o desempenho comparado com os padrões definidos de desempenho e obter avanços tangíveis na melhoria e eficácia no desempenho do programa. Este monografia fornece uma visado introdutória de GQ para os países em desenvolvimento. Será de interesse para os fazedores da politicas, quadros superiores do Ministério da Saúde (MISAU) e chefes dos serviços de saúde a nível distrital. Será também útil aos Representantes de organizações no sector da saúde, tais como a Agência dos E.U. para o Desenvolvimento Internacional (A.I.D.), a Organização Mundial de Saúde (OMS) e o Fundo de Emergência das Nações Unidas para a Infância (UNICEF)....