The effectiveness of supervision strategies to improve health care provider practices in low- and middle-income countries: secondary analysis of a systematic review.

BACKGROUND: Although supervision is a ubiquitous approach to support health programs and improve health care provider (HCP) performance in low- and middle-income countries (LMICs), quantitative evidence of its effects is unclear. The objectives of this study are to describe the effect of supervision strategies on HCP practices in LMICs and to identify attributes associated with greater effectiveness of routine supervision. METHODS: We performed a secondary analysis of data on HCP practice outcomes (e.g., percentage of patients correctly treated) from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series studies. We described distributions of effect sizes (defined as percentage-point [%-point] changes) for each supervision strategy. To identify attributes associated with supervision effectiveness, we performed random-effects linear regression modeling and examined studies that directly compared different approaches of routine supervision. RESULTS: We analyzed data from 81 studies from 36 countries. For professional HCPs, such as nurses and physicians, primarily working at health facilities, routine supervision (median improvement when compared to controls: 10.7%-points; IQR: 9.9, 27.9) had similar effects on HCP practices as audit with feedback (median improvement: 10.1%-points; IQR: 6.2, 23.7). Two attributes were associated with greater mean effectiveness of routine supervision (p < 0.10): supervisors received supervision (by 8.8-11.5%-points), and supervisors participated in problem-solving with HCPs (by 14.2-20.8%-points). Training for supervisors and use of a checklist during supervision visits were not associated with effectiveness. The effects of supervision frequency (i.e., number of visits per year) and dose (i.e., the number of supervision visits during a study) were unclear. For lay HCPs, the effect of routine supervision was difficult to characterize because few studies existed, and effectiveness in those studies varied considerably. Evidence quality for all findings was low primarily because many studies had a high risk of bias. CONCLUSIONS: Although evidence is limited, to promote more effective supervision, our study supports supervising supervisors and having supervisors engage in problem-solving with HCPs. Supervision's integral role in health systems in LMICs justifies a more deliberate research agenda to identify how to deliver supervision to optimize its effect on HCP practices.

Patterns of antibiotic use in the community and challenges of antibiotic surveillance in a lower-middle-income country setting: a repeated cross-sectional study in Vellore, South India.

OBJECTIVES: There is considerable evidence linking antibiotic usage to bacterial resistance. Intervention strategies are needed to contain antibiotic use and thereby resistance. To plan appropriate strategies, it is imperative to undertake surveillance in the community to monitor antibiotic encounters and drivers of specific antibiotic misuse. Such surveillance is rarely in place in lower-middle-income countries (LMICs). This study describes antibiotic patterns and challenges faced while developing such surveillance systems in an LMIC. PATIENTS AND METHODS: Surveillance of antibiotic encounters (prescriptions and dispensations) was carried out using a repeated cross-sectional design for 2 years in Vellore, south India. Every month, patients attending 30 health facilities (small hospitals, general practitioner clinics and pharmacy shops) were observed until 30 antibiotic encounters were attained in each. Antibiotic use was expressed as the percentage of encounters containing specific antibiotics and defined daily doses (DDDs)/100 patients. Bulk antibiotic sales data were also collected. RESULTS: Over 2 years, a total of 52,788 patients were observed and 21,600 antibiotic encounters (40.9%) were accrued. Fluoroquinolones and penicillins were widely used. Rural hospitals used co-trimoxazole more often and urban private hospitals used cephalosporins more often; 41.1% of antibiotic prescriptions were for respiratory infections. The main challenges in surveillance included issues regarding sampling, data collection, denominator calculation and sustainability. CONCLUSIONS: Patterns of antibiotic use varied across health facilities, suggesting that interventions should involve all types of health facilities. Although challenges were encountered, our study shows that it is possible to develop surveillance systems in LMICs and the data generated may be used to plan feasible interventions, assess impact and thereby contain resistance.

The effectiveness of training strategies to improve healthcare provider practices in low-income and middle-income countries.

INTRODUCTION: In low/middle-income countries (LMICs), training is often used to improve healthcare provider (HCP) performance. However, important questions remain about how well training works and the best ways to design training strategies. The objective of this study is to characterise the effectiveness of training strategies to improve HCP practices in LMICs and identify attributes associated with training effectiveness. METHODS: We performed a secondary analysis of data from a systematic review on improving HCP performance. The review included controlled trials and interrupted time series, and outcomes measuring HCP practices (eg, percentage of patients correctly treated). Distributions of effect sizes (defined as percentage-point (%-point) changes) were described for each training strategy. To identify effective training attributes, we examined studies that directly compared training approaches and performed random-effects linear regression modelling. RESULTS: We analysed data from 199 studies from 51 countries. For outcomes expressed as percentages, educational outreach visits (median effect size when compared with controls: 9.9 %-points; IQR: 4.3-20.6) tended to be somewhat more effective than in-service training (median: 7.3 %-points; IQR: 3.6-17.4), which seemed more effective than peer-to-peer training (4.0 %-points) and self-study (by 2.0-9.3 %-points). Mean effectiveness was greater (by 6.0-10.4 %-points) for training that incorporated clinical practice and training at HCPs' work site. Attributes with little or no effect were: training with computers, interactive methods or over multiple sessions; training duration; number of educational methods; distance training; trainers with pedagogical training and topic complexity. For lay HCPs, in-service training had no measurable effect. Evidence quality for all findings was low. CONCLUSIONS: Although additional research is needed, by characterising the effectiveness of training strategies and identifying attributes of effective training, decision-makers in LMICs can improve how these strategies are selected and implemented.

Community intervention to promote rational treatment of acute respiratory infection in rural Nepal.

OBJECTIVE: To evaluate a community education program about treatment of acute respiratory infection (ARI). METHODS: First, community case definitions for severe and mild ARI were developed. The intervention was then evaluated using a controlled before-and-after design. Household surveys collected data about ARI treatment in 20 clusters, each based around a school and health facility. Treatment indicators included percentages of cases attending health facilities and receiving antibiotics. The intervention consisted of an education program in schools culminating in street theater performances, discussions with mothers after performances and training for community leaders and drug retailers by paramedics. The intervention was conducted in mid-2003. Indicators were measured before the intervention in Nov/Dec 2002 and again in Dec 2003/Jan 2004. RESULTS: Two thousand and seven hundred and nineteen households were surveyed and 3654 under-fives were identified, of whom 377 had severe ARI. After implementing the intervention, health post (HP) attendance rose by 13% in under-fives with severe ARI and fell by 9% in under-fives with mild ARI (test of interaction, P = 0.01). Use of prescribed antibiotics increased in under-fives with severe ARI by 21% but only by 1% in under-fives with mild ARI (test of interaction, P = 0.38). Irrespective of ARI severity, the use of non-prescribed antibiotics dropped by 5% (P = 0.002), and consultation with female community health volunteers (FCHVs)and use of safe home remedies increased by 6.7% (P not estimated) and 5.7% (P = 0.008) respectively. CONCLUSION: The intervention was implemented using local structures and in difficult circumstances, yet had a moderate impact. Thus it has the potential to effect large scale changes in behaviour and merits replication elsewhere.

A systematic review of the effectiveness of strategies to improve health care provider performance in low- and middle-income countries: Methods and descriptive results.

BACKGROUND: Health care provider (HCP) performance in low- and middle-income countries (LMICs) is often inadequate. The Health Care Provider Performance Review (HCPPR) is a comprehensive systematic review of the effectiveness and cost of strategies to improve HCP performance in LMICs. We present the HCPPR's methods, describe methodological and contextual attributes of included studies, and examine time trends of study attributes. METHODS: The HCPPR includes studies from LMICs that quantitatively evaluated any strategy to improve HCP performance for any health condition, with no language restrictions. Eligible study designs were controlled trials and interrupted time series. In 2006, we searched 15 databases for published studies; in 2008 and 2010, we completed searches of 30 document inventories for unpublished studies. Data from eligible reports were double-abstracted and entered into a database, which is publicly available. The primary outcome measure was the strategy's effect size. We assessed time trends with logistic, Poisson, and negative binomial regression modeling. We were unable to register with PROSPERO (International Prospective Register of Systematic Reviews) because the protocol was developed prior to the PROSPERO launch. RESULTS: We screened 105,299 citations and included 824 reports from 499 studies of 161 intervention strategies. Most strategies had multiple components and were tested by only one study each. Studies were from 79 countries and had diverse methodologies, geographic settings, HCP types, work environments, and health conditions. Training, supervision, and patient and community supports were the most commonly evaluated strategy components. Only 33.6% of studies had a low or moderate risk of bias. From 1958-2003, the number of studies per year and study quality increased significantly over time, as did the proportion of studies from low-income countries. Only 36.3% of studies reported information on strategy cost or cost-effectiveness. CONCLUSIONS: Studies have reported on the efficacy of many strategies to improve HCP performance in LMICs. However, most studies have important methodological limitations. The HCPPR is a publicly accessible resource for decision-makers, researchers, and others interested in improving HCP performance.

The effect of user fees on prescribing quality in rural Nepal: two controlled pre-post studies to compare a fee per drug unit vs. a fee per drug item.

OBJECTIVE: To compare prescribing quality with a fee per drug unit vs. a fee per drug item. METHODS: Prescribing data were collected prospectively over 10 years from 21 health facilities in two districts of rural eastern Nepal. In 1995, both districts charged a fee per drug item. By 2000, one district was charging a fee per drug unit, and the second district continued to charge a fee per drug item (control group). By 2002, the second district was also charging a fee per drug unit. These fee changes allowed two pre-post 'cohort' with control analyses to compare INRUD/WHO drug use indicators for a fee per drug unit vs. a fee per drug item. RESULTS: Charging a fee per drug unit increased the percentage of antibiotics prescribed in under-dosage by 11-12% (P = 0.02 and 0.02), decreased the percentage of patients prescribed injections by 4-6% (P = 0.002 and 0.02), reduced the units per drug item prescribed by 1.7 (P = 0.02 and 0.03), and decreased compliance with standard treatment guidelines by 11-15% (P = 0.02 and 0.06). CONCLUSION: A fee per unit was associated with prescription of fewer units of drugs and fewer expensive drugs (such as injections), resulting in significantly poorer compliance with standard treatment guidelines. This finding is of great concern for public health in countries where patients are charged a fee per unit of drug.

Effectiveness of strategies to improve health-care provider practices in low-income and middle-income countries: a systematic review.

BACKGROUND: Inadequate health-care provider performance is a major challenge to the delivery of high-quality health care in low-income and middle-income countries (LMICs). The Health Care Provider Performance Review (HCPPR) is a comprehensive systematic review of strategies to improve health-care provider performance in LMICs. METHODS: For this systematic review we searched 52 electronic databases for published studies and 58 document inventories for unpublished studies from the 1960s to 2016. Eligible study designs were controlled trials and interrupted time series. We only included strategy-versus-control group comparisons. We present results of improving health-care provider practice outcomes expressed as percentages (eg, percentage of patients treated correctly) or as continuous measures (eg, number of medicines prescribed per patient). Effect sizes were calculated as absolute percentage-point changes. The summary measure for each comparison was the median effect size (MES) for all primary outcomes. Strategy effectiveness was described with weighted medians of MES. This study is registered with PROSPERO, number CRD42016046154. FINDINGS: We screened 216 477 citations and selected 670 reports from 337 studies of 118 strategies. Most strategies had multiple intervention components. For professional health-care providers (generally, facility-based health workers), the effects were near zero for only implementing a technology-based strategy (median MES 1·0 percentage points, IQR -2·8 to 9·9) or only providing printed information for health-care providers (1·4 percentage points, -4·8 to 6·2). For percentage outcomes, training or supervision alone typically had moderate effects (10·3-15·9 percentage points), whereas combining training and supervision had somewhat larger effects than use of either strategy alone (18·0-18·8 percentage points). Group problem solving alone showed large improvements in percentage outcomes (28·0-37·5 percentage points), but, when the strategy definition was broadened to include group problem solving alone or other strategy components, moderate effects were more typical (12·1 percentage points). Several multifaceted strategies had large effects, but multifaceted strategies were not always more effective than simpler ones. For lay health-care providers (generally, community health workers), the effect of training alone was small (2·4 percentage points). Strategies with larger effect sizes included community support plus health-care provider training (8·2-125·0 percentage points). Contextual and methodological heterogeneity made comparisons difficult, and most strategies had low quality evidence. INTERPRETATION: The impact of strategies to improve health-care provider practices varied substantially, although some approaches were more consistently effective than others. The breadth of the HCPPR makes its results valuable to decision makers for informing the selection of strategies to improve health-care provider practices in LMICs. These results also emphasise the need for researchers to use better methods to study the effectiveness of interventions. FUNDING: Bill & Melinda Gates Foundation, CDC Foundation.

The influence of user fees and patient demand on prescribers in rural Nepal.

Irrational prescribing and over-prescription is a world-wide problem. Prescribers often cite patient demand as one of the main reasons why they over-prescribe, but the degree to which this is so is unknown. This article describes a study to test the hypothesis that patient demand causes over-prescription. The study occurred within the context of different kinds of nominal user fee for drugs in Nepal, where it was assumed that charging per drug item would deter patient demand, and hence over-prescription, as compared to charging per prescription. Focus group discussions with patients attending rural health facilities explored patient attitudes towards drugs. Patients and health workers were interviewed to gather quantitative data on (1) patient demand, and (2) health worker views of patient demand and their own prescribing habits, and comparing these with the drugs actually prescribed and dispensed to patients. Patients felt they needed more drugs than they were prescribed or dispensed, but stated that they would be happy to accept advice from prescribers for fewer drugs. In all areas of whatever fee type, there was no association between the number of drug items patients felt they needed pre-consultation and the number of drug items that they actually received as observed postconsultation. However, there was a significant association between the average number of drug items per patient that prescribers stated they usually prescribed and the actual number that were prescribed. It was concluded that patient demand was not affected by different kinds of user fee and did not directly influence prescribing behaviour.

Does shortening the training on Integrated Management of Childhood Illness guidelines reduce its effectiveness? A systematic review.

OBJECTIVE: Implementation of the Integrated Management of Childhood Illness (IMCI) strategy with an 11-day training course for health workers improves care for ill children in outpatient settings in developing countries. The 11-day course duration is recommended by the World Health Organization, which developed IMCI. Our aim was to determine if shortening the training (to reduce cost) reduces its effectiveness. METHODS: We conducted a systematic review to compare IMCI's effectiveness with standard training (duration ≥ 11 days) versus shortened training (5-10 days). Studies were identified from a search of MEDLINE, two existing systematic reviews, and by contacting investigators. We included published or unpublished studies that evaluated IMCI's effectiveness in developing countries and reported quantitative measures of health worker practices related to managing ill children under 5 years old in public or private health facilities. Summary measures were the median of effect sizes for all outcomes from a given study, and the percentage of patients needing oral antimicrobials or rehydration who were treated according to IMCI guidelines. FINDINGS: Twenty-nine studies were included. Direct comparisons from three studies showed little difference between standard and shortened training. Indirect comparisons from 26 studies revealed that effect sizes for standard training versus no IMCI were greater than shortened training versus no IMCI. Across all comparisons, differences ranged from -3 to +23 percentage-points, and our best estimate was a 2 to 16 percentage-point advantage for standard training. No result was statistically significant. After IMCI training (of any duration), 34% of ill children needing oral antimicrobials or rehydration were not receiving these treatments according to IMCI guidelines. CONCLUSIONS: Based on limited evidence, standard IMCI training seemed more effective than shortened training, although the difference might be small. As sizable performance gaps often existed after IMCI training, countries should consider implementing other interventions to support health workers after training, regardless of training duration.