Measuring protective efficacy and quantifying the impact of drug resistance: A novel malaria chemoprevention trial design and methodology.

BACKGROUND: Recently revised WHO guidelines on malaria chemoprevention have opened the door to more tailored implementation. Countries face choices on whether to replace old drugs, target additional age groups, and adapt delivery schedules according to local drug resistance levels and malaria transmission patterns. Regular routine assessment of protective efficacy of chemoprevention is key. Here, we apply a novel modelling approach to aid the design and analysis of chemoprevention trials and generate measures of protection that can be applied across a range of transmission settings. METHODS AND FINDINGS: We developed a model of genotype-specific drug protection, which accounts for underlying risk of infection and circulating genotypes. Using a Bayesian framework, we fitted the model to multiple simulated scenarios to explore variations in study design, setting, and participant characteristics. We find that a placebo or control group with no drug protection is valuable but not always feasible. An alternative approach is a single-arm trial with an extended follow-up (>42 days), which allows measurement of the underlying infection risk after drug protection wanes, as long as transmission is relatively constant. We show that the currently recommended 28-day follow-up in a single-arm trial results in low precision of estimated 30-day chemoprevention efficacy and low power in determining genotype differences of 12 days in the duration of protection (power = 1.4%). Extending follow-up to 42 days increased precision and power (71.5%) in settings with constant transmission over this time period. However, in settings of unstable transmission, protective efficacy in a single-arm trial was overestimated by 24.3% if recruitment occurred during increasing transmission and underestimated by 15.8% when recruitment occurred during declining transmission. Protective efficacy was estimated with greater precision in high transmission settings, and power to detect differences by resistance genotype was lower in scenarios where the resistant genotype was either rare or too common. CONCLUSIONS: These findings have important implications for the current guidelines on chemoprevention efficacy studies and will be valuable for informing where these studies should be optimally placed. The results underscore the need for a comparator group in seasonal settings and provide evidence that the extension of follow-up in single-arm trials improves the accuracy of measures of protective efficacy in settings with more stable transmission. Extension of follow-up may pose logistical challenges to trial feasibility and associated costs. However, these studies may not need to be repeated multiple times, as the estimates of drug protection against different genotypes can be applied to different settings by adjusting for transmission intensity and frequency of resistance.

Feasibility, safety, and impact of the RTS,S/AS01E malaria vaccine when implemented through national immunisation programmes: evaluation of cluster-randomised introduction of the vaccine in Ghana, Kenya, and Malawi.

BACKGROUND: The RTS,S/AS01E malaria vaccine (RTS,S) was introduced by national immunisation programmes in Ghana, Kenya, and Malawi in 2019 in large-scale pilot schemes. We aimed to address questions about feasibility and impact, and to assess safety signals that had been observed in the phase 3 trial that included an excess of meningitis and cerebral malaria cases in RTS,S recipients, and the possibility of an excess of deaths among girls who received RTS,S than in controls, to inform decisions about wider use. METHODS: In this prospective evaluation, 158 geographical clusters (66 districts in Ghana; 46 sub-counties in Kenya; and 46 groups of immunisation clinic catchment areas in Malawi) were randomly assigned to early or delayed introduction of RTS,S, with three doses to be administered between the ages of 5 months and 9 months and a fourth dose at the age of approximately 2 years. Primary outcomes of the evaluation, planned over 4 years, were mortality from all causes except injury (impact), hospital admission with severe malaria (impact), hospital admission with meningitis or cerebral malaria (safety), deaths in girls compared with boys (safety), and vaccination coverage (feasibility). Mortality was monitored in children aged 1-59 months throughout the pilot areas. Surveillance for meningitis and severe malaria was established in eight sentinel hospitals in Ghana, six in Kenya, and four in Malawi. Vaccine uptake was measured in surveys of children aged 12-23 months about 18 months after vaccine introduction. We estimated that sufficient data would have accrued after 24 months to evaluate each of the safety signals and the impact on severe malaria in a pooled analysis of the data from the three countries. We estimated incidence rate ratios (IRRs) by comparing the ratio of the number of events in children age-eligible to have received at least one dose of the vaccine (for safety outcomes), or age-eligible to have received three doses (for impact outcomes), to that in non-eligible age groups in implementation areas with the equivalent ratio in comparison areas. To establish whether there was evidence of a difference between girls and boys in the vaccine's impact on mortality, the female-to-male mortality ratio in age groups eligible to receive the vaccine (relative to the ratio in non-eligible children) was compared between implementation and comparison areas. Preliminary findings contributed to WHO's recommendation in 2021 for widespread use of RTS,S in areas of moderate-to-high malaria transmission. FINDINGS: By April 30, 2021, 652 673 children had received at least one dose of RTS,S and 494 745 children had received three doses. Coverage of the first dose was 76% in Ghana, 79% in Kenya, and 73% in Malawi, and coverage of the third dose was 66% in Ghana, 62% in Kenya, and 62% in Malawi. 26 285 children aged 1-59 months were admitted to sentinel hospitals and 13 198 deaths were reported through mortality surveillance. Among children eligible to have received at least one dose of RTS,S, there was no evidence of an excess of meningitis or cerebral malaria cases in implementation areas compared with comparison areas (hospital admission with meningitis: IRR 0·63 [95% CI 0·22-1·79]; hospital admission with cerebral malaria: IRR 1·03 [95% CI 0·61-1·74]). The impact of RTS,S introduction on mortality was similar for girls and boys (relative mortality ratio 1·03 [95% CI 0·88-1·21]). Among children eligible for three vaccine doses, RTS,S introduction was associated with a 32% reduction (95% CI 5-51%) in hospital admission with severe malaria, and a 9% reduction (95% CI 0-18%) in all-cause mortality (excluding injury). INTERPRETATION: In the first 2 years of implementation of RTS,S, the three primary doses were effectively deployed through national immunisation programmes. There was no evidence of the safety signals that had been observed in the phase 3 trial, and introduction of the vaccine was associated with substantial reductions in hospital admission with severe malaria. Evaluation continues to assess the impact of four doses of RTS,S. FUNDING: Gavi, the Vaccine Alliance; the Global Fund to Fight AIDS, Tuberculosis and Malaria; and Unitaid.

Making the most of malaria chemoprevention.

Against a backdrop of stalled progress in malaria control, it is surprising that the various forms of malaria chemoprevention are not more widely used. The World Health Organization (WHO) has recommended several malaria chemoprevention strategies, some of them for over a decade, and each with documented efficacy and cost effectiveness. In 2022, the WHO updated and augmented its malaria chemoprevention guidelines to facilitate their wider use. This paper considers new insights into the empirical evidence that supports the broader application of chemoprevention and encourages its application as a default strategy for young children living in moderate to high transmission settings given their high risk of severe disease and death. Chemoprevention is an effective medium-term strategy with potential benefits far outweighing costs. There is a strong argument for urgently increasing malaria chemoprevention in endemic countries.

Design and selection of drug properties to increase the public health impact of next-generation seasonal malaria chemoprevention: a modelling study.

BACKGROUND: Seasonal malaria chemoprevention (SMC) is recommended for disease control in settings with moderate to high Plasmodium falciparum transmission and currently depends on the administration of sulfadoxine-pyrimethamine plus amodiaquine. However, poor regimen adherence and the increased frequency of parasite mutations conferring sulfadoxine-pyrimethamine resistance might threaten the effectiveness of SMC. Guidance is needed to de-risk the development of drug compounds for malaria prevention. We aimed to provide guidance for the early prioritisation of new and alternative SMC drugs and their target product profiles. METHODS: In this modelling study, we combined an individual-based malaria transmission model that has explicit parasite growth with drug pharmacokinetic and pharmacodynamic models. We modelled SMC drug attributes for several possible modes of action, linked to their potential public health impact. Global sensitivity analyses identified trade-offs between drug elimination half-life, maximum parasite killing effect, and SMC coverage, and optimisation identified minimum requirements to maximise malaria burden reductions. FINDINGS: Model predictions show that preventing infection for the entire period between SMC cycles is more important than drug curative efficacy for clinical disease effectiveness outcomes, but similarly important for impact on prevalence. When children younger than 5 years receive four SMC cycles with high levels of coverage (ie, 69% of children receiving all cycles), drug candidates require a duration of protection half-life higher than 23 days (elimination half-life >10 days) to achieve reductions higher than 75% in clinical incidence and severe disease (measured over the intervention period in the target population, compared with no intervention across a range of modelled scenarios). High coverage is crucial to achieve these targets, requiring more than 60% of children to receive all SMC cycles and more than 90% of children to receive at least one cycle regardless of the protection duration of the drug. INTERPRETATION: Although efficacy is crucial for malaria prevalence reductions, chemoprevention development should select drug candidates for their duration of protection to maximise burden reductions, with the duration half-life determining cycle timing. Explicitly designing or selecting drug properties to increase community uptake is paramount. FUNDING: Bill & Melinda Gates Foundation and the Swiss National Science Foundation.

Development of WHO Recommendations for the Final Phase of Elimination and Prevention of Re-Establishment of Malaria.

The WHO recommends that all affected countries work toward the elimination of malaria, even those still experiencing a high burden of disease. However, malaria programs in the final phase of elimination or those working to prevent re-establishment of transmission after elimination could benefit from specific evidence-based recommendations for these settings as part of comprehensive and quality-controlled malaria guidelines. The WHO convened an external guideline development group to formulate recommendations for interventions to reduce or prevent malaria transmission in areas with very low- to low-transmission levels and those that have eliminated malaria. In addition, several interventions that could be deployed in higher burden areas to accelerate elimination, such as mass drug administration, were reviewed. Systematic reviews were conducted that synthesized and evaluated evidence for the benefits and harms of public health interventions and summarized critical contextual factors from a health systems perspective. A total of 12 recommendations were developed, with five related to mass interventions that could be deployed at higher transmission levels and seven that would be most appropriate for programs in areas close to elimination or those working to prevent re-establishment of transmission. Four chemoprevention, two active case detection, and one vector control interventions were positively recommended, whereas two chemoprevention and three active case detection interventions were not recommended by the WHO. None of the recommendations were classified as strong given the limited and low-quality evidence base. Approaches to conducting higher quality research in very low- to low-transmission settings to improve the strength of WHO recommendations are discussed.

Chemoprevention for the Populations of Malaria Endemic Africa.

Drugs have been used to prevent malaria for centuries, but only recently have they been used on a large scale to prevent malaria in the resident population of malaria endemic areas in sub-Saharan Africa. This paper discusses some of the reasons for the hesitancy in adoption of chemopreventive strategies in sub-Saharan Africa, reasons why this hesitancy has been overcome in recent years and the range of target groups now identified by the World Health Organization as those who can benefit most from chemoprevention. Adoption of carefully targeted chemopreventive strategies could help reverse the recent stagnation in the decline in malaria in sub-Saharan Africa that had been taking place during the previous two decades.

Meeting report: WHO consultation on malaria vaccine development, Geneva, 15-16 July 2019.

Considerable progress has been made in malaria control in the last two decades, but progress has stalled in the last few years. New tools are needed to achieve public health goals in malaria control and elimination. A first generation vaccine, RTS,S/AS01, is currently being evaluated as it undergoes pilot implementation through routine health systems in parts of three African countries. The development of this vaccine took over 30 years and has been full of uncertainties. Even now, important unknowns remain as to its future role in public health. Lessons need to be learnt for second generation and future vaccines, including how to facilitate early planning of investments, streamlining of development, regulatory and policy pathways. A number of candidate vaccines populate the current development pipeline, some of which have the potential to contribute to burden reduction if efficacy is confirmed in conditions of natural exposure, and if they are amenable to affordable supply and programmatic implementation. New, innovative technologies will be needed if future malaria vaccines are to overcome important scientific hurdles and induce durable, high level protection. WHO convened a stakeholder consultation on the status of malaria vaccine research and development to inform the recently reconstituted Malaria Vaccine Advisory Committee (MALVAC) which will assist WHO in updating its current guidance and recommendations about priorities and product preferences for malaria vaccines.

Building momentum for malaria vaccine research and development: key considerations.

To maintain momentum towards improved malaria control and elimination, a vaccine would be a key addition to the intervention toolkit. Two approaches are recommended: (1) promote the development and short to medium term deployment of first generation vaccine candidates and (2) support innovation and discovery to identify and develop highly effective, long-lasting and affordable next generation malaria vaccines.

Supporting capacity for research on malaria in Africa.

Substantial progress has been made in the control of malaria in Africa but much remains to be done before malaria elimination on the continent can be achieved. Further progress can be made by enhancing uptake of existing control tools but, in high transmission areas, additional tools will be needed. Development and evaluation of these new tools will require a substantial cadre of African scientists well trained in many different disciplines. This paper describes the activities undertaken by the Malaria Capacity Development Consortium (MCDC) to support the careers of PhD students and postdoctoral fellows undertaking research on malaria at five African universities. A systematic assessment of constraints on PhD training and research support systems was undertaken at each partner African university at the beginning of the programme and many of these constraints were remedied. The success of the programme is shown by the fact that 18 of the 21 PhD students recruited to the programme completed their theses successfully within a 4-year period and that all 27 scientists recruited to the postdoctoral programme were still working in Africa on its completion. The work of the consortium will be continued through Career Development Groups established at each partner university and at an affiliated institution at the University of Nairobi and through the Developing Excellence in Leadership, Training and Science award from the Wellcome Trust made to one of the African partners. Lessons learnt during the MCDC programme may help the planning and execution of other research capacity development programmes in Africa.

Surveillance in easy to access population subgroups as a tool for evaluating malaria control progress: A systematic review.

BACKGROUND: The need for surveillance systems generating targeted, data-driven, responsive control efforts to accelerate and sustain malaria transmission reduction has been emphasized by programme managers, policy makers and scientists. Surveillance using easy-to-access population subgroups (EAGs) may result in considerable cost saving compared to household surveys as the identification and selection of individuals to be surveyed is simplified, fewer personnel are needed, and logistics are simpler. We reviewed available literature on the validation of estimates of key indicators of malaria control progress derived from EAGs, and describe the options to deal with the context specific bias that may occur. METHODS: A literature search was conducted of all documents reporting validation of estimates of malaria control indicators from EAG surveys before the 31st of December 2016. Additional records were identified through cross-reference from selected records, other applicable policy documents and grey literature. After removal of duplicates, 13, 180 abstracts were evaluated and 2,653 eligible abstracts were identified mentioning surveillance in EAGs, of which 29 full text articles were selected for detailed review. The nine articles selected for systematic review compared estimates from health facility and school surveys with those of a contemporaneous sample of the same population in the same geographic area. RESULTS: Review of the available literature on EAGs suitable for surveillance of malaria control progress revealed that little effort has been made to explore the potential approach and settings for use of EAGs; and that there was wide variation in the precision of estimates of control progress between and within studies, particularly for estimates of control intervention coverage. Only one of the studies evaluated the geospatial representativeness of EAG samples, or carried out geospatial analyses to assess or control for lack of geospatial representativeness. Two studies attempted to measure the degree of bias or improve the precision of estimates by controlling for bias in a multivariate analysis; and this was only successful in one study. The observed variability in accuracy of estimates is likely to be caused by selection and/or information bias due to the inherent nature of EAGs. The reviewed studies provided insight into the design and analytical approaches that could be used to limit bias. CONCLUSION: The utility EAGs for routine surveillance of progress in malaria control at the district or sub-district programmatic level will be driven by several factors including whether serial point estimates to measure transmission reduction or more precise geospatial distribution to track 'hot-spots' is required, the acceptable degree of precision, the target population, and the resources available for surveillance. The opportunities offered by novel geostatistical analyses and hybrid sampling frames to overcome bias justify a renewed exploration of use of EAGs for malaria monitoring and evaluation.

The Impact of Introducing Malaria Rapid Diagnostic Tests on Fever Case Management: A Synthesis of Ten Studies from the ACT Consortium.

Since 2010, the World Health Organization has been recommending that all suspected cases of malaria be confirmed with parasite-based diagnosis before treatment. These guidelines represent a paradigm shift away from presumptive antimalarial treatment of fever. Malaria rapid diagnostic tests (mRDTs) are central to implementing this policy, intended to target artemisinin-based combination therapies (ACT) to patients with confirmed malaria and to improve management of patients with nonmalarial fevers. The ACT Consortium conducted ten linked studies, eight in sub-Saharan Africa and two in Afghanistan, to evaluate the impact of mRDT introduction on case management across settings that vary in malaria endemicity and healthcare provider type. This synthesis includes 562,368 outpatient encounters (study size range 2,400-432,513). mRDTs were associated with significantly lower ACT prescription (range 8-69% versus 20-100%). Prescribing did not always adhere to malaria test results; in several settings, ACTs were prescribed to more than 30% of test-negative patients or to fewer than 80% of test-positive patients. Either an antimalarial or an antibiotic was prescribed for more than 75% of patients across most settings; lower antimalarial prescription for malaria test-negative patients was partly offset by higher antibiotic prescription. Symptomatic management with antipyretics alone was prescribed for fewer than 25% of patients across all scenarios. In community health worker and private retailer settings, mRDTs increased referral of patients to other providers. This synthesis provides an overview of shifts in case management that may be expected with mRDT introduction and highlights areas of focus to improve design and implementation of future case management programs.

Introducing malaria rapid diagnostic tests in private medicine retail outlets: A systematic literature review.

BACKGROUND: Many patients with malaria-like symptoms seek treatment in private medicine retail outlets (PMR) that distribute malaria medicines but do not traditionally provide diagnostic services, potentially leading to overtreatment with antimalarial drugs. To achieve universal access to prompt parasite-based diagnosis, many malaria-endemic countries are considering scaling up malaria rapid diagnostic tests (RDTs) in these outlets, an intervention that may require legislative changes and major investments in supporting programs and infrastructures. This review identifies studies that introduced malaria RDTs in PMRs and examines study outcomes and success factors to inform scale up decisions. METHODS: Published and unpublished studies that introduced malaria RDTs in PMRs were systematically identified and reviewed. Literature published before November 2016 was searched in six electronic databases, and unpublished studies were identified through personal contacts and stakeholder meetings. Outcomes were extracted from publications or provided by principal investigators. RESULTS: Six published and six unpublished studies were found. Most studies took place in sub-Saharan Africa and were small-scale pilots of RDT introduction in drug shops or pharmacies. None of the studies assessed large-scale implementation in PMRs. RDT uptake varied widely from 8%-100%. Provision of artemisinin-based combination therapy (ACT) for patients testing positive ranged from 30%-99%, and was more than 85% in five studies. Of those testing negative, provision of antimalarials varied from 2%-83% and was less than 20% in eight studies. Longer provider training, lower RDT retail prices and frequent supervision appeared to have a positive effect on RDT uptake and provider adherence to test results. Performance of RDTs by PMR vendors was generally good, but disposal of medical waste and referral of patients to public facilities were common challenges. CONCLUSIONS: Expanding services of PMRs to include malaria diagnostic services may hold great promise to improve malaria case management and curb overtreatment with antimalarials. However, doing so will require careful planning, investment and additional research to develop and sustain effective training, supervision, waste-management, referral and surveillance programs beyond the public sector.

Impact of introduction of rapid diagnostic tests for malaria on antibiotic prescribing: analysis of observational and randomised studies in public and private healthcare settings.

Objectives To examine the impact of use of rapid diagnostic tests for malaria on prescribing of antimicrobials, specifically antibiotics, for acute febrile illness in Africa and Asia.Design Analysisof nine preselected linked and codesigned observational and randomised studies (eight cluster or individually randomised trials and one observational study).Setting Public and private healthcare settings, 2007-13, in Afghanistan, Cameroon, Ghana, Nigeria, Tanzania, and Uganda.Participants 522 480 children and adults with acute febrile illness.Interventions Rapid diagnostic tests for malaria.Main outcome measures Proportions of patients for whom an antibiotic was prescribed in trial groups who had undergone rapid diagnostic testing compared with controls and in patients with negative test results compared with patients with positive results. A secondary aim compared classes of antibiotics prescribed in different settings.Results Antibiotics were prescribed to 127 052/238 797 (53%) patients in control groups and 167 714/283 683 (59%) patients in intervention groups. Antibiotics were prescribed to 40% (35 505/89 719) of patients with a positive test result for malaria and to 69% (39 400/57 080) of those with a negative result. All but one study showed a trend toward more antibiotic prescribing in groups who underwent rapid diagnostic tests. Random effects meta-analysis of the trials showed that the overall risk of antibiotic prescription was 21% higher (95% confidence interval 7% to 36%) in intervention settings. In most intervention settings, patients with negative test results received more antibiotic prescriptions than patients with positive results for all the most commonly used classes: penicillins, trimethoprim-sulfamethoxazole (one exception), tetracyclines, and metronidazole.Conclusions Introduction of rapid diagnostic tests for malaria to reduce unnecessary use of antimalarials-a beneficial public health outcome-could drive up untargeted use of antibiotics. That 69% of patients were prescribed antibiotics when test results were negative probably represents overprescription.This included antibiotics from several classes, including those like metronidazole that are seldom appropriate for febrile illness, across varied clinical, health system, and epidemiological settings. It is often assumed that better disease specific diagnostics will reduce antimicrobial overuse, but they might simply shift it from one antimicrobial class to another. Current global implementation of malaria testing might increase untargeted antibiotic use and must be examined.

Variability of respiratory rate measurements in children suspected with non-severe pneumonia in north-east Tanzania.

OBJECTIVE: Measurement of respiratory rate is an important clinical sign in the diagnosis of pneumonia but suffers from interobserver variation. Here, we assess the use of video recordings as a quality assurance tool that could be useful both in research and in training of staff. METHODS: Respiratory rates (RR) were recorded in children aged 2-59 months presenting with cough or difficulty breathing at two busy outpatient clinics in Tanzania. Measurements were repeated at 10-min intervals in a quiet environment with simultaneous video recordings that were independently reviewed by two paediatricians. RESULTS: Eight hundred and fifty-nine videos were sent to two paediatricians; 148 (17.2%) were considered unreadable by one or both. For the 711 (82.8%) videos that were readable by both paediatricians, there was perfect agreement for the presence of raised RR with a kappa value (κ) of 0.85 (P < 0.001); and in 476 (66.9%) cases, both paediatricians agreed on the RR within 2 breaths per minute (±2 bpm). A reported illness of 5 days or more was associated with unreadable video recordings (OR = 3.44, CI: 1.5-6.08; P < 0.001). The multilevel model showed that differences between observers accounted for only 13% of the variability in RR. CONCLUSION: Video recordings are reliable tools for quality assurance of RR measurements in children with suspected pneumonia. Videos with a clear view of respiratory movements may also be useful in training primary healthcare staff.

Fake anti-malarials: start with the facts.

This meeting report presents the key findings and discussion points of a 1-day meeting entitled 'Fake anti-malarials: start with the facts' held on 28th May 2015, in Geneva, Switzerland, to disseminate the findings of the artemisinin combination therapy consortium's drug quality programme. The teams purchased over 10,000 samples, using representative sampling approaches, from six malaria endemic countries: Equatorial Guinea (Bioko Island), Cambodia, Ghana, Nigeria, Rwanda and Tanzania. Laboratory analyses of these samples showed that falsified anti-malarials (<8 %) were found in just two of the countries, whilst substandard artemisinin-based combinations were present in all six countries and, artemisinin-based monotherapy tablets are still available in some places despite the fact that the WHO has urged regulatory authorities in malaria-endemic countries to take measures to halt the production and marketing of these oral monotherapies since 2007. This report summarizes the presentations that reviewed the public health impact of falsified and substandard drugs, sampling strategies, techniques for drug quality analysis, approaches to strengthen health systems capacity for the surveillance of drug quality, and the ensuing discussion points from the dissemination meeting.

Averting a malaria disaster: will insecticide resistance derail malaria control?

World Malaria Day 2015 highlighted the progress made in the development of new methods of prevention (vaccines and insecticides) and treatment (single dose drugs) of the disease. However, increasing drug and insecticide resistance threatens the successes made with existing methods. Insecticide resistance has decreased the efficacy of the most commonly used insecticide class of pyrethroids. This decreased efficacy has increased mosquito survival, which is a prelude to rising incidence of malaria and fatalities. Despite intensive research efforts, new insecticides will not reach the market for at least 5 years. Elimination of malaria is not possible without effective mosquito control. Therefore, to combat the threat of resistance, key stakeholders need to rapidly embrace a multifaceted approach including a reduction in the cost of bringing new resistance management methods to market and the streamlining of associated development, policy, and implementation pathways to counter this looming public health catastrophe.

Monitoring patient care through health facility exit interviews: an assessment of the Hawthorne effect in a trial of adherence to malaria treatment guidelines in Tanzania.

BACKGROUND: Survey of patients exiting health facilities is a common way to assess consultation practices. It is, however, unclear to what extent health professionals may change their practices when they are aware of such interviews taking place, possibly paying more attention to following recommended practices. This so-called Hawthorne effect could have important consequences for interpreting research and programme monitoring, but has rarely been assessed. METHODS: A three-arm cluster-randomised trial of interventions to improve adherence to guidelines for the use of anti-malarial drugs was conducted in Tanzania. Patient interviews were conducted outside health facilities on two randomly-selected days per week. Health workers also routinely documented consultations in their ledgers. The Hawthorne effect was investigated by comparing routine data according to whether exit interviews had been conducted on three key indicators of malaria care. Adjusted logistic mixed-effects models were used, taking into account the dependencies within health facilities and calendar days. RESULTS: Routine data were collected on 19,579 consultations in 18 facilities. The odds of having a malaria rapid diagnostic test (RDT) result reported were 11 % higher on days when exit surveys were conducted (adjusted odds ratio 95 % CI: 0.98-1.26, p = 0.097), 17 % lower for prescribing an anti-malarial drug to patients with a negative RDT result (0.56-1.23, p = 0.343), and 27 % lower for prescribing an anti-malarial when no RDT result was reported (0.53-1.00, p = 0.052). The effect varied with time, with a U-shaped association over the study period (p < 0.001). We also observed a higher number of consultations recorded on days when exit-interviews were conducted (adjusted mean difference = 2.03, p < 0.001). CONCLUSIONS: Although modest, there was some suggestion of better practice by health professionals on days when exit interviews were conducted. Researchers should be aware of the potential Hawthorne effect, and take into account assessment methods when generalising findings to the 'real word' setting. This effect is, however, likely to be context dependent, and further controlled evaluation across different settings should be conducted. TRIAL REGISTRATION: ClinicalTrials.gov: NCT01292707 . Registered on 29th January 2011.

Examining Intervention Design: Lessons from the Development of Eight Related Malaria Health Care Intervention Studies.

Abstract-Rigorous evidence of "what works" to improve health care is in demand, but methods for the development of interventions have not been scrutinized in the same ways as methods for evaluation. This article presents and examines intervention development processes of eight malaria health care interventions in East and West Africa. A case study approach was used to draw out experiences and insights from multidisciplinary teams who undertook to design and evaluate these studies. Four steps appeared necessary for intervention design: (1) definition of scope, with reference to evaluation possibilities; (2) research to inform design, including evidence and theory reviews and empirical formative research; (3) intervention design, including consideration and selection of approaches and development of activities and materials; and (4) refining and finalizing the intervention, incorporating piloting and pretesting. Alongside these steps, projects produced theories, explicitly or implicitly, about (1) intended pathways of change and (2) how their intervention would be implemented.The work required to design interventions that meet and contribute to current standards of evidence should not be underestimated. Furthermore, the process should be recognized not only as technical but as the result of micro and macro social, political, and economic contexts, which should be acknowledged and documented in order to infer generalizability. Reporting of interventions should go beyond descriptions of final intervention components or techniques to encompass the development process. The role that evaluation possibilities play in intervention design should be brought to the fore in debates over health care improvement.