Using antenatal care as a platform for malaria surveillance data collection: study protocol.

BACKGROUND: While many malaria-endemic countries have health management information systems that can measure and report malaria trends in a timely manner, these routine systems have limitations. Periodic community cross-sectional household surveys are used to estimate malaria prevalence and intervention coverage but lack geographic granularity and are resource intensive. Incorporating malaria testing for all women at their first antenatal care (ANC) visit (i.e., ANC1) could provide a more timely and granular source of data for monitoring trends in malaria burden and intervention coverage. This article describes a protocol designed to assess if ANC-based surveillance could be a pragmatic tool to monitor malaria. METHODS: This is an observational, cross-sectional study conducted in Benin, Burkina Faso, Mozambique, Nigeria, Tanzania, and Zambia. Pregnant women attending ANC1 in selected health facilities will be tested for malaria infection by rapid diagnostic test and administered a brief questionnaire to capture key indicators of malaria control intervention coverage and care-seeking behaviour. In each location, contemporaneous cross-sectional household surveys will be leveraged to assess correlations between estimates obtained using each method, and the use of ANC data as a tool to track trends in malaria burden and intervention coverage will be validated. RESULTS: This study will assess malaria prevalence at ANC1 aggregated at health facility and district levels, and by gravidity relative to current pregnancy (i.e., gravida 1, gravida 2, and gravida 3 +). ANC1 malaria prevalence will be presented as monthly trends. Additionally, correlation between ANC1 and household survey-derived estimates of malaria prevalence, bed net ownership and use, and care-seeking will be assessed. CONCLUSION: ANC1-based surveillance has the potential to provide a cost-effective, localized measure of malaria prevalence that is representative of the general population and useful for tracking monthly changes in parasite prevalence, as well as providing population-representative estimates of intervention coverage and care-seeking behavior. This study will evaluate the representativeness of these measures and collect information on operational feasibility, usefulness for programmatic decision-making, and potential for scale-up of malaria ANC1 surveillance.

Predictors of health worker performance after Integrated Management of Childhood Illness training in Benin: a cohort study.

BACKGROUND: Correct treatment of potentially life-threatening illnesses (PLTIs) in children under 5 years, such as malaria, pneumonia, and diarrhea, can substantially reduce mortality. The Integrated Management of Childhood Illness (IMCI) strategy has been shown to improve treatment of child illnesses, but multiple studies have shown that gaps in health worker performance remain after training. To better understand factors related to health worker performance, we analyzed 9,330 patient consultations in Benin from 2001-2002, after training one of the first cohorts of 32 health workers in IMCI. METHODS: With data abstracted from patient registers specially designed for IMCI-trained health workers, we examined associations between health facility-, health worker-, and patient-level factors and 10 case-management outcomes for PLTIs. RESULTS: Altogether, 63.6% of children received treatment for all their PLTIs in accordance with IMCI guidelines, and 77.8% received life-saving treatment (i.e., clinically effective treatment, even if not exactly in accordance with IMCI guidelines). Performance of individual health workers varied greatly, from 15-88% of patients treated correctly, on average. Multivariate regression analyses identified several factors that might have influenced case-management quality, many outside a manager's direct control. Younger health workers significantly outperformed older ones, and infants received better care than older children. Children with danger signs, those with more complex illnesses, and those with anemia received worse care. Health worker supervision was associated with improved performance for some outcomes. CONCLUSIONS: A variety of factors, some outside the direct control of program managers, can influence health worker practices. An understanding of these influences can help inform the development of strategies to improve performance.

Antenatal care services in Benin and Tanzania 2021/2022: an equity analysis study.

Introduction: Antenatal care (ANC) interventions improve maternal and neonatal outcomes. However, access to ANC may be inequitable due to sociocultural, monetary and time factors. Examining drivers of ANC disparities may identify those amenable to policy change. Methods: We conducted an ANC services equity analysis in selected public facilities in Geita, Tanzania, where most services are free to the end-user, and Atlantique, Benin, where every visit incurs user fees. Data on total ANC contacts, quality of care (QoC) indicators and wait times were collected from representative household surveys in the catchment of 40 clinics per country and were analysed by education and wealth. We used indices of inequality, concentration indices and Oaxaca-Blinder decompositions to determine the distribution, direction and magnitude of inequalities and their contributing factors. We assessed out-of-pocket expenses and the benefit incidence of government funding. Results: ANC clients in both countries received less than the recommended minimum ANC contacts: 3.41 (95% CI 3.36 to 3.41) in Atlantique and 3.33 (95% CI 3.27 to 3.39) in Geita. Wealthier individuals had more ANC contacts than poorer ones at every education level in both countries; the wealthiest and most educated had two visits more than the poorest, least educated. In Atlantique, ANC attendees receive similar QoC regardless of socioeconomic status. In Geita, there are wide disparities in QoC received by education or wealth. In Atlantique, out-of-pocket expenses for the lowest wealth quintile are 2.7% of annual income compared with 0.8% for the highest, with user fees being the primary expense. In Geita, the values are 3.1% and 0.5%, respectively; transportation is the main expense. Conclusions: Inequalities in total ANC visits favouring wealthier, more educated individuals were apparent in both countries. In Atlantique, reduction of user-fees could improve ANC access. In Geita, training and equipping healthcare staff could improve QoC. Community health services could mitigate access barriers.

Trends in health worker performance after implementing the Integrated Management of Childhood Illness strategy in Benin.

OBJECTIVE: Training health workers to use Integrated Management of Childhood Illness (IMCI) guidelines can improve care for ill children in outpatient settings in developing countries. However, even after IMCI training, important performance gaps exist. One potential reason is that the effect of training can rapidly wane. Our aim was to determine if the performance of IMCI-trained health workers deteriorated over 3 years. METHODS: We studied two departments in Benin. First, we performed a record review of 32 IMCI-trained health workers during the first year of IMCI implementation (2001-2002). Second, we analysed data from cross-sectional health facility surveys from 2001 to 2004 that represented the entire study area. Primary outcomes were the proportion of children under 5 years old with potentially life-threatening illnesses who received either recommended or adequate treatment, and among all children, an index of overall guideline adherence. Secondary outcomes reflected the treatment of individual diseases. Outcomes were calculated monthly, and time trends were evaluated with regression modelling. RESULTS: The record review included 9393 consultations, and the surveys included 411 consultations performed by 105 health workers. For both data sources, performance trends were essentially flat for nearly all outcomes. Absolute levels of performance revealed substantial performance gaps. CONCLUSIONS: We found no evidence that performance declined over 3 years after IMCI training. However, important performance gaps found immediately after IMCI training persisted and should be addressed.

Impact of a malaria-control project in Benin that included the integrated management of childhood illness strategy.

OBJECTIVES: To estimate the impact of the Integrated Management of Childhood Illness (IMCI) strategy on early-childhood mortality, we evaluated a malaria-control project in Benin that implemented IMCI and promoted insecticide-treated nets (ITNs). METHODS: We conducted a before-and-after intervention study that included a nonrandomized comparison group. We used the preceding birth technique to measure early-childhood mortality (risk of dying before age 30 months), and we used health facility surveys and household surveys to measure process indicators. RESULTS: Most process indicators improved in the area covered by the intervention. Notably, because ITNs were also promoted in the comparison area children's ITN use increased by about 20 percentage points in both areas. Regarding early-childhood mortality, the trend from baseline (1999-2001) to follow-up (2002-2004) for the intervention area (13.0% decrease; P < .001) was 14.1% (P < .001) lower than was the trend for the comparison area (1.3% increase; P = .46). CONCLUSIONS: Mortality decreased in the intervention area after IMCI and ITN promotion. ITN use increased similarly in both study areas, so the mortality impact of ITNs in the 2 areas might have canceled each other out. Thus, the mortality reduction could have been primarily attributable to IMCI's effect on health care quality and care-seeking.

A multifaceted intervention to improve health worker adherence to integrated management of childhood illness guidelines in Benin.

OBJECTIVES: We evaluated an intervention to support health workers after training in Integrated Management of Childhood Illness (IMCI), a strategy that can improve outcomes for children in developing countries by encouraging workers' use of evidence-based guidelines for managing the leading causes of child mortality. METHODS: We conducted a randomized trial in Benin. We administered a survey in 1999 to assess health care quality before IMCI training. Health workers then received training plus either study supports (job aids, nonfinancial incentives, and supervision of workers and supervisors) or usual supports. Follow-up surveys conducted in 2001 to 2004 assessed recommended treatment, recommended or adequate treatment, and an index of overall guideline adherence. RESULTS: We analyzed 1244 consultations. Performance improved in both intervention and control groups, with no significant differences between groups. However, training proceeded slowly, and low-quality care from health workers without IMCI training diluted intervention effects. Per-protocol analyses revealed that workers with IMCI training plus study supports provided better care than did those with training plus usual supports (27.3 percentage-point difference for recommended treatment; P < .05), and both groups outperformed untrained workers. CONCLUSIONS: IMCI training was useful but insufficient. Relatively inexpensive supports can lead to additional improvements.

Improving pneumonia case-management in Benin: a randomized trial of a multi-faceted intervention to support health worker adherence to Integrated Management of Childhood Illness guidelines.

BACKGROUND: Pneumonia is a leading cause of death among children under five years of age. The Integrated Management of Childhood Illness strategy can improve the quality of care for pneumonia and other common illnesses in developing countries, but adherence to these guidelines could be improved. We evaluated an intervention in Benin to support health worker adherence to the guidelines after training, focusing on pneumonia case management. METHODS: We conducted a randomized trial. After a health facility survey in 1999 to assess health care quality before Integrated Management of Childhood Illness training, health workers received training plus either study supports (job aids, non-financial incentives and supervision of workers and supervisors) or "usual" supports. Follow-up surveys were conducted in 2001, 2002 and 2004. Outcomes were indicators of health care quality for Integrated Management-defined pneumonia. Further analyses included a graphical pathway analysis and multivariable logistic regression modelling to identify factors influencing case-management quality. RESULTS: We observed 301 consultations of children with non-severe pneumonia that were performed by 128 health workers in 88 public and private health facilities. Although outcomes improved in both intervention and control groups, we found no statistically significant difference between groups. However, training proceeded slowly, and low-quality care from untrained health workers diluted intervention effects. Per-protocol analyses suggested that health workers with training plus study supports performed better than those with training plus usual supports (20.4 and 19.2 percentage-point improvements for recommended treatment [p=0.08] and "recommended or adequate" treatment [p=0.01], respectively). Both groups tended to perform better than untrained health workers. Analyses of treatment errors revealed that incomplete assessment and difficulties processing clinical findings led to missed pneumonia diagnoses, and missed diagnoses led to inadequate treatment. Increased supervision frequency was associated with better care (odds ratio for recommended treatment=2.1 [95% confidence interval: 1.13.9] per additional supervisory visit). CONCLUSION: Integrated Management of Childhood Illness training was useful, but insufficient, to achieve high-quality pneumonia case management. Our study supports led to additional improvements, although large gaps in performance still remained. A simple graphical pathway analysis can identify specific, common errors that health workers make in the case-management process; this information could be used to target quality improvement activities, such as supervision (ClinicalTrials.gov number NCT00510679).

Care takers' recall of Integrated Management of Childhood Illness counselling messages in Benin.

A key goal of the Integrated Management of Childhood Illness (IMCI) strategy is to improve the management of childhood illness at health facilities. IMCIguidelines contain many counselling messages, and as it is not known how well caretakers recall these messages, we studied caretakers' recall of IMCI messages when given under ideal conditions. At a clinic in Benin, a study clinician performed counselling and confirmed caretakers'comprehension of all messages. Caretakers were randomly assigned to be interviewed either immediately after the consultation or a day later. Recall was assessed with general and focused open-ended questions. Recall was assessed for 55 caretakers, 29.1% of whom were literate. Caretakers received 3-75 messages (mean = 38.7). The mean percentage of messages recalled was 89.7% immediately after the consultation and 81.9% one day later. These results support IMCI's recommendation that health workers should verify caretakers' comprehension by asking caretakers to repeat counselling messages during consultations.

Risk and protective factors for two types of error in the treatment of children with fever at outpatient health facilities in Benin.

BACKGROUND: In developing countries, health workers often do not follow clinical practice guidelines. However, few studies have examined why different types of errors occur. METHODS: We analysed a sample of consultations of children with non-severe malaria (defined as fever without signs of severe illness) from a health facility survey conducted in Ouémé Département, Benin. Treatment was defined as correct (recommended antimalarial), a minor error (non-recommended antimalarial), or a major error (no antimalarial). RESULTS: In all, 85 health workers and 289 children were studied. In a multivariate logistic regression analysis, the following factors were significantly associated with major errors: treatment by a physician (adjusted odds ratio [aOR] = 13.57, 95% CI: 1.45-126.75), child's age <12 months (aOR = 3.41, 95% CI: 1.15-10.07), and child's temperature (aOR = 0.58 per degrees C, 95% CI: 0.34-0.97). Factors significantly associated with minor errors were: child's temperature (aOR = 1.43 per degrees C, 95% CI: 1.07-1.92), electricity at the health facility (aOR = 3.10, 95% CI: 1.05-9.17), >/=1 supervision visit in the past 6 months (aOR = 0.33, 95% CI: 0.14-0.77), fever treatment wall chart in the consultation room (aOR = 0.29, 95% CI: 0.12-0.73), and number of non-fever chief complaints (aOR = 0.67 per complaint, 95% CI: 0.48-0.93). In-service training in malaria treatment was not significantly associated with either error type. CONCLUSIONS: Many factors may influence health worker performance, and factors such as pre-service training may influence performance in unexpected ways. Identifying different errors and analysing them separately can help reveal potential causes that may be masked by combining errors into a single category.

Evaluating health worker performance in Benin using the simulated client method with real children.

BACKGROUND: The simulated client (SC) method for evaluating health worker performance utilizes surveyors who pose as patients to make surreptitious observations during consultations. Compared to conspicuous observation (CO) by surveyors, which is commonly done in developing countries, SC data better reflect usual health worker practices. This information is important because CO can cause performance to be better than usual. Despite this advantage of SCs, the method's full potential has not been realized for evaluating performance for pediatric illnesses because real children have not been utilized as SCs. Previous SC studies used scenarios of ill children that were not actually brought to health workers. During a trial that evaluated a quality improvement intervention in Benin (the Integrated Management of Childhood Illness [IMCI] strategy), we conducted an SC survey with adult caretakers as surveyors and real children to evaluate the feasibility of this approach and used the results to assess the validity of CO. METHODS: We conducted an SC survey and a CO survey (one right after the other) of health workers in the same 55 health facilities. A detailed description of the SC survey process was produced. Results of the two surveys were compared for 27 performance indicators using logistic regression modeling. RESULTS: SC and CO surveyors observed 54 and 185 consultations, respectively. No serious problems occurred during the SC survey. Performance levels measured by CO were moderately higher than those measured by SCs (median CO - SC difference = 16.4 percentage-points). Survey differences were sometimes much greater for IMCI-trained health workers (median difference = 29.7 percentage-points) than for workers without IMCI training (median difference = 3.1 percentage-points). CONCLUSION: SC surveys can be done safely with real children if appropriate precautions are taken. CO can introduce moderately large positive biases, and these biases might be greater for health workers exposed to quality improvement interventions. TRIAL NUMBER: http://clinicaltrials.gov Identifier NCT00510679.

The rise and fall of supervision in a project designed to strengthen supervision of Integrated Management of Childhood Illness in Benin.

OBJECTIVE: In developing countries, supervision is a widely recognized strategy for improving health worker performance; and anecdotally, maintaining regular, high-quality supervision is difficult. However, remarkably little research has explored in depth why supervision is so challenging. METHODS: In the context of a trial to improve health worker adherence to Integrated Management of Childhood Illness (IMCI) guidelines and strengthen supervision in southeastern Benin, we used record reviews, focus group discussions, key informant interviews, and cross-sectional surveys to examine the supervision process. FINDINGS: Initially, little IMCI supervision occurred. The frequency increased substantially after implementing a series of workshops, but then deteriorated. Quantitative and qualitative data revealed obstacles to supervision at multiple levels of the health system. Based on supervisors' opinions, the main problems were: poor coordination; inadequate management skills and ineffective management teams; a lack of motivation; problems related to decentralization; health workers sometimes resisting IMCI implementation; and less priority given to IMCI supervision because of incentives for non-supervision activities, a lack of leadership, and an expectation of integrated supervision. To this list, based on our observations, we add: the increasing supervision workload, time required for non-supervision activities, project interventions not always being implemented as planned, and the loss of particularly effective supervisors. In terms of correctly completing steps of the supervision process, the quality of supervision was generally good. CONCLUSIONS: Managers should monitor supervision, understand the evolving influences on supervision, and use their resources and authority to both promote supervision and remove impediments to supervision. Support from leaders can be crucial, thus donors and politicians should help make supervision a true priority. As with front-line clinicians, supervisors are health workers who need support. We emphasize the importance of research to identify effective and affordable strategies for improving supervision frequency and quality. (ClinicalTrials.gov number NCT00510679).