Opening the 'black box' of collaborative improvement: a qualitative evaluation of a pilot intervention to improve quality of malaria surveillance data in public health centres in Uganda.

BACKGROUND: Demand for high-quality surveillance data for malaria, and other diseases, is greater than ever before. In Uganda, the primary source of malaria surveillance data is the Health Management Information System (HMIS). However, HMIS data may be incomplete, inaccurate or delayed. Collaborative improvement (CI) is a quality improvement intervention developed in high-income countries, which has been advocated for low-resource settings. In Kayunga, Uganda, a pilot study of CI was conducted in five public health centres, documenting a positive effect on the quality of HMIS and malaria surveillance data. A qualitative evaluation was conducted concurrently to investigate the mechanisms of effect and unintended consequences of the intervention, aiming to inform future implementation of CI. METHODS: The study intervention targeted health workers, including brief in-service training, plus CI with 'plan-do-study-act' (PDSA) cycles emphasizing self-reflection and group action, periodic learning sessions, and coaching from a CI mentor. Health workers collected data on standard HMIS out-patient registers. The qualitative evaluation (July 2015 to September 2016) included ethnographic observations at each health centre (over 12-14 weeks), in-depth interviews with health workers and stakeholders (n = 20), and focus group discussions with health workers (n = 6). RESULTS: The results suggest that the intervention did facilitate improvement in data quality, but through unexpected mechanisms. The CI intervention was implemented as planned, but the PDSA cycles were driven largely by the CI mentor, not the health workers. In this context, characterized by a rigid hierarchy within the health system of limited culture of self-reflection and inadequate training and supervision, CI became an effective form of high-quality training with frequent supervisory visits. Health workers appeared motivated to improve data collection habits by their loyalty to the CI mentor and the potential for economic benefits, rather than a desire for self-improvement. CONCLUSIONS: CI is a promising method of quality improvement and could have a positive impact on malaria surveillance data. However, successful scale-up of CI in similar settings may require deployment of highly skilled mentors. Further research, focusing on the effectiveness of 'real world' mentors using robust study designs, will be required to determine whether CI can be translated effectively and sustainably to low-resource settings.

Data value and care value in the practice of health systems: A case study in Uganda.

In anthropology, interest in how values are created, maintained and changed has been reinvigorated. In this case study, we draw on this literature to interrogate concerns about the relationship between data collection and the delivery of patient care within global health. We followed a pilot study conducted in Kayunga, Uganda that aimed to improve the collection of health systems data in five public health centres. We undertook ethnographic research from July 2015 to September 2016 in health centres, at project workshops, meetings and training sessions. This included three months of observations by three fieldworkers; in-depth interviews with health workers (n = 15) and stakeholders (n = 5); and six focus group discussions with health workers. We observed that measurement, calculation and narrative practices could be assigned care-value or data-value and that the attempt to improve data collection within health facilities transferred 'data-value' into health centres with little consideration among project staff for its impact on care. We document acts of acquiescence and resistance to data-value by health workers. We also describe the rare moments when senior health workers reconciled these two forms of value, and care-value and data-value were enacted simultaneously. In contrast to many anthropological accounts, our analysis suggests that data-value and care-value are not necessarily conflicting. Actors seeking to make changes in health systems must, however, take into account local forms of value and devise health systems interventions that reinforce and enrich existing ethically driven practice.

Behind the scenes of the PRIME intervention: designing a complex intervention to improve malaria care at public health centres in Uganda.

BACKGROUND: In Uganda, health system challenges limit access to good quality healthcare and contribute to slow progress on malaria control. We developed a complex intervention (PRIME), which was designed to improve quality of care for malaria at public health centres. OBJECTIVE: Responding to calls for increased transparency, we describe the PRIME intervention's design process, rationale, and final content and reflect on the choices and challenges encountered during the design of this complex intervention. DESIGN: To develop the intervention, we followed a multistep approach, including the following: 1) formative research to identify intervention target areas and objectives; 2) prioritization of intervention components; 3) review of relevant evidence; 4) development of intervention components; 5) piloting and refinement of workshop modules; and 6) consolidation of the PRIME intervention theories of change to articulate why and how the intervention was hypothesized to produce desired outcomes. We aimed to develop an intervention that was evidence-based, grounded in theory, and appropriate for the study context; could be evaluated within a randomized controlled trial; and had the potential to be scaled up sustainably. RESULTS: The process of developing the PRIME intervention package was lengthy and dynamic. The final intervention package consisted of four components: 1) training in fever case management and use of rapid diagnostic tests for malaria (mRDTs); 2) workshops in health centre management; 3) workshops in patient-centred services; and 4) provision of mRDTs and antimalarials when stocks ran low. CONCLUSIONS: The slow and iterative process of intervention design contrasted with the continually shifting study context. We highlight the considerations and choices made at each design stage, discussing elements we included and why, as well as those that were ultimately excluded. Reflection on and reporting of 'behind the scenes' accounts of intervention design may improve the design, assessment, and generalizability of complex interventions and their evaluations.

Challenging logics of complex intervention trials: community perspectives of a health care improvement intervention in rural Uganda.

Health systems in many African countries are failing to provide populations with access to good quality health care. Morbidity and mortality from curable diseases such as malaria remain high. The PRIME trial in Tororo, rural Uganda, designed and tested an intervention to improve care at health centres, with the aim of reducing ill-health due to malaria in surrounding communities. This paper presents the impact and context of this trial from the perspective of community members in the study area. Fieldwork was carried out for a year from the start of the intervention in June 2011, and involved informal observation and discussions as well as 13 focus group discussions with community members, 10 in-depth interviews with local stakeholders, and 162 context descriptions recorded through quarterly interviews with community members, health workers and district officials. Community members observed a small improvement in quality of care at most, but not all, intervention health centres. However, this was diluted by other shortfalls in health services beyond the scope of the intervention. Patients continued to seek care at health centres they considered inadequate as well as positioning themselves and their children to access care through other sources such as research and nongovernmental organization (NGO) projects. These findings point to challenges of designing and delivering interventions within a paradigm that requires factorial (reduced to predictable factors) problem definition with easily actionable and evaluable solutions by small-scale projects. Such requirements mean that interventions often work on the periphery of a health system rather than tackling the murky political and economic realities that shape access to care but are harder to change or evaluate with randomized controlled trials. Highly projectified settings further reduce the ability to genuinely 'control' for different health care access scenarios. We argue for a raised consciousness of how evaluation paradigms impact on intervention choices.

Community case management of malaria: exploring support, capacity and motivation of community medicine distributors in Uganda.

BACKGROUND: In Uganda, community services for febrile children are expanding from presumptive treatment of fever with anti-malarials through the home-based management of fever (HBMF) programme, to include treatment for malaria, diarrhoea and pneumonia through Integrated Community Case Management (ICCM). To understand the level of support available, and the capacity and motivation of community health workers to deliver these expanded services, we interviewed community medicine distributors (CMDs), who had been involved in the HBMF programme in Tororo district, shortly before ICCM was adopted. METHODS: Between October 2009 and April 2010, 100 CMDs were recruited to participate by convenience sampling. The survey included questionnaires to gather information about the CMDs' work experience and to assess knowledge of fever case management, and in-depth interviews to discuss experiences as CMDs including motivation, supervision and relationships with the community. All questionnaires and knowledge assessments were analysed. Summary contact sheets were made for each of the 100 interviews and 35 were chosen for full transcription and analysis. RESULTS: CMDs faced multiple challenges including high patient load, limited knowledge and supervision, lack of compensation, limited drugs and supplies, and unrealistic expectations of community members. CMDs described being motivated to volunteer for altruistic reasons; however, the main benefits of their work appeared related to 'becoming someone important', with the potential for social mobility for self and family, including building relationships with health workers. At the time of the survey, over half of CMDs felt demotivated due to limited support from communities and the health system. CONCLUSIONS: Community health worker programmes rely on the support of communities and health systems to operate sustainably. When this support falls short, motivation of volunteers can wane. If community interventions, in increasingly complex forms, are to become the solution to improving access to primary health care, greater attention to what motivates individuals, and ways to strengthen health system support are required.

Strengthening patient-centred communication in rural Ugandan health centres: A theory-driven evaluation within a cluster randomized trial.

This article describes a theory-driven evaluation of one component of an intervention to improve the quality of health care at Ugandan public health centres. Patient-centred services have been advocated widely, but such approaches have received little attention in Africa. A cluster randomized trial is evaluating population-level outcomes of an intervention with multiple components, including 'patient-centred services.' A process evaluation was designed within this trial to articulate and evaluate the implementation and programme theories of the intervention. This article evaluates one hypothesized mechanism of change within the programme theory: the impact of the Patient Centred Services component on health-worker communication. The theory-driven approach extended to evaluation of the outcome measures. The study found that the proximal outcome of patient-centred communication was rated 10 percent higher (p < 0.008) by care seekers consulting with the health workers who were at the intervention health centres compared with those at control health centres. This finding will strengthen interpretation of more distal trial outcomes.

The PROCESS study: a protocol to evaluate the implementation, mechanisms of effect and context of an intervention to enhance public health centres in Tororo, Uganda.

BACKGROUND: Despite significant investments into health improvement programmes in Uganda, health indicators and access to healthcare remain poor across the country. The PRIME trial aims to evaluate the impact of a complex intervention delivered in public health centres on health outcomes of children and management of malaria in rural Uganda. The intervention consists of four components: Health Centre Management; Fever Case Management; Patient- Centered Services; and support for supplies of malaria diagnostics and antimalarial drugs. METHODS: The PROCESS study will use mixed methods to evaluate the processes, mechanisms of change, and context of the PRIME intervention by addressing five objectives. First, to develop a comprehensive logic model of the intervention, articulating the project's hypothesised pathways to trial outcomes. Second, to evaluate the implementation of the intervention, including health worker training, health centre management tools, and the supply of artemether-lumefantrine (AL) and rapid diagnostic tests (RDTs) for malaria. Third, to understand mechanisms of change of the intervention components, including testing hypotheses and interpreting realities of the intervention, including resistance, in context. Fourth, to develop a contextual record over time of factors that may have affected implementation of the intervention, mechanisms of change, and trial outcomes, including factors at population, health centre and district levels. Fifth, to capture broader expected and unexpected impacts of the intervention and trial activities among community members, health centre workers, and private providers. Methods will include intervention logic mapping, questionnaires, recorded consultations, in-depth interviews, focus group discussions, and contextual data documentation. DISCUSSION: The findings of this PROCESS study will be interpreted alongside the PRIME trial results. This will enable a greater ability to generalise the findings of the main trial. The investigators will attempt to assess which methods are most informative in such evaluations of complex interventions in low-resource settings. TRIAL REGISTRATION: Clinicaltrials.gov, NCT01024426.

Aspirations for quality health care in Uganda: How do we get there?

BACKGROUND: Despite significant investments and reforms, health care remains poor for many in Africa. To design an intervention to improve access and quality of health care at health facilities in eastern Uganda, we aimed to understand local priorities for qualities in health care, and factors that enable or prevent these qualities from being enacted. METHODS: In 2009 to 2010, we carried out 69 in-depth interviews and 6 focus group discussions with 65 health workers at 17 health facilities, and 10 focus group discussions with 113 community members in Tororo District, Uganda. RESULTS: Health-care workers and seekers valued technical, interpersonal and resource qualities in their aspirations for health care. However, such qualities were frequently not enacted, and our analysis suggests that meeting aspirations required social and financial resources to negotiate various power structures. CONCLUSIONS: We argue that achieving aspirations for qualities valued in health care will require a genuine reorientation of focus by health workers and their managers toward patients, through renewed respect and support for these providers as professionals.