Framework synthesis to inform the ideation and design of a paper-based health information system (PHISICC).

BACKGROUND: Health information systems (HIS) are meant to support decision-making at all levels of the system, including frontline health workers. In field studies in Côte d'Ivoire, Mozambique and Nigeria, we observed health workers' interactions with the HIS and identified twelve decision-making components of HIS. The objective of this framework synthesis is to portray these components in HIS research, in order to inform the ideation of a paper-based HIS intervention (PHISICC). METHODS: We searched studies in the Cochrane Central Register of Controlled Trials (CENTRAL), Embase, Epistemonikos, Medline, in-Process on the Ovid platform, OpenGrey, PDQ  Evidence ("pretty darnd quick" Evidence), the World Health Organization (WHO) Global Health Library and included studies focussing on HIS interventions, data quality, information support tools and data use for decision-making in the context of the governmental health care sector. We assessed the methodological quality of studies using the Critical Appraisal Skills Programme tool. We synthesised the findings based on the decision-making components of HIS and thematic areas. RESULTS: The search identified 6784 studies; 50 were included. Most of the 50 studies had quality concerns. All studies included at least one of the decision-making components: the most prominent were the technical aspects of 'recording' and 'reporting'. Data use for decision-making was much less represented. CONCLUSION: HIS research focuses on the more technical aspects of HIS. Further research on HIS, given the strong push towards HIS digitalisation, should consider putting at the centre the human experience of decision-making and data use, in order to make HIS relevant for quality of care.

Researching, co-creating and testing innovations in paper-based health information systems (PHISICC) to support health workers' decision-making: protocol of a multi-country, transdisciplinary, mixed-methods research programme in three sub-Saharan countries.

BACKGROUND: Health information systems are crucial to provide data for decision-making and demand for data is constantly growing. However, the link between data and decisions is not always rational or linear and the management of data ends up overloading frontline health workers, which may compromise quality of healthcare delivery. Despite limited evidence, there is an increasing push for the digitalization of health information systems, which poses enormous challenges, particularly in remote, rural settings in low- and middle-income countries. Paper-based tools will continue to be used in combination with digital solutions and this calls for efforts to make them more responsive to local needs. Paper-based Health Information Systems in Comprehensive Care (PHISICC) is a transdisciplinary, multi-country research initiative to create and test innovative paper-based health information systems in three sub-Saharan African countries. METHODS/DESIGN: The PHISICC initiative is being carried out in remote, rural settings in Côte d'Ivoire, Mozambique and Nigeria through partnership with ministries of health and research institutions. We began with research syntheses to acquire the most up-to-date knowledge on health information systems. These were coupled with fieldwork in the three countries to understand the current design, patterns and contexts of use, and healthcare worker perspectives. Frontline health workers, with designers and researchers, used co-creation methods to produce the new PHISICC tools. This suite of tools is being tested in the three countries in three cluster-randomized controlled trials. Throughout the project, we have engaged with a wide range of stakeholders and have maintained the highest scientific standards to ensure that results are relevant to the realities in the three countries. DISCUSSION: We have deployed a comprehensive research approach to ensure the robustness and future policy uptake of findings. Besides the innovative PHISICC paper-based tools, our process is in itself innovative. Rather than emphasizing the technical dimensions of data management, we focused instead on frontline health workers' data use and decision-making. By tackling the whole scope of primary healthcare areas rather than a subset of them, we have developed an entirely new design and visual language for a suite of tools across healthcare areas. The initiative is being tested in remote, rural areas where the most vulnerable live.

Factors contributing to drug-resistant tuberculosis treatment outcome in five countries in the Eastern Europe and Central Asia region.

Drug-resistant tuberculosis (DR-TB) is a global challenge and a major contributor of death from anti-microbial resistance. With the main aim to determine factors contributing to treatment outcomes observed among DR-TB patients in the countries in Eastern Europe and Central Asia (EECA), a multi-method study was conducted in: Azerbaijan, Belarus, Romania, Tajikistan and Ukraine. Both quantitative and qualitative methodologies were used for data collection and analysis. The quantitative approaches included a desk review of documents related to the DR-TB responses and an analysis of clinical records of DR-TB patients in selected health facilities of the five countries. Qualitative methods included in-depth interviews with national TB programme (NTP) managers, other healthcare providers and non-governmental organizations (NGOs) workers, as well as interviews and Focus Group Discussions (FGDs) with DR-TB patients. The desk review of 38 reports identified as the main challenges to address DR-TB financial and/or management issues and adverse events of the medicines. The most common recommendations related to treatment outcome focussed on general programme management, treatment regimen composition, clinical management and social support for the patients. In all the five countries the NTPs still have a vertical structure. Some integration into the primary health care system (PHC) already exists but further involvement of PHC facilities is feasible and recommended. Interviews with stakeholders indicated that alcoholism and homelessness and a lack of appropriate response to these issues remain as major challenges for a sub-set of patients. Civil society groups, NGOs and communities are substantially engaged in providing different services to DR-TB patients, especially in Ukraine, Romania and Tajikistan. Data from clinical records of 212 patients revealed that independent risk factors for unfavourable treatment outcome (death, loss to follow-up, failure) were culture-positivity at two months of treatment, history of treatment with second-line drugs and homelessness. More powerful, less toxic and shorter oral treatment regimens as well as comprehensive patient support are needed to improve treatment outcome of patients with DR-TB.

Validity and usability testing of a health systems guidance appraisal tool, the AGREE-HS.

BACKGROUND: Health systems guidance (HSG) provides recommendations to address health systems challenges. No tools exist to inform HSG developers and users about the components of high quality HSG and to differentiate between HSG of varying quality. In response, we developed a tool to assist with the development, reporting and appraisal of HSG - the Appraisal of Guidelines for Research and Evaluation-Health Systems (AGREE-HS). This paper reports on the validity, usability and initial measurement properties of the AGREE-HS. METHODS: To establish face validity (Study 1), stakeholders completed a survey about the AGREE-HS and provided feedback on its content and structure. Revisions to the tool were made in response. To establish usability (Study 2), the revised tool was applied to 85 HSG documents and the appraisers provided feedback about their experiences via an online survey. An initial test of the revised tool's measurement properties, including internal consistency, inter-rater reliability and criterion validity, was conducted. Additional revisions to the tool were made in response. RESULTS: In Study 1, the AGREE-HS Overview, User Manual, quality item content and structure, and overall assessment questions were rated favourably. Participants indicated that the AGREE-HS would be useful, feasible to use, and that they would apply it in their context. In Study 2, participants indicated that the quality items were easy to understand and apply, and the User Manual, usefulness and usability of the tool were rated favourably. Study 2 participants also indicated intentions to use the AGREE-HS. CONCLUSIONS: The AGREE-HS comprises a User Manual, five quality items and two overall assessment questions. It is available at agreetrust.org.

Research on subgroups is not research on equity attributes: Evidence from an overview of systematic reviews on vaccination.

BACKGROUND: Equity remains a priority in the international health development agenda. However, major inequities in vaccination coverage jeopardise the achievement of the Sustainable Development Goals. We aim at comprehensively describing how research has addressed equity issues related to vaccination. METHODS: We carried out an overview of systematic reviews (SRs) that explicitly explored the effects of interventions to improve vaccination in any context; for any vaccine and, in any language. We followed standard research synthesis methods to systematically search for SR, assess them for inclusion and extracting relevant data, particularly on vaccination related outcomes. To gather evidence on equity issues addressed in the SR, we used the PROGRESS-plus framework. FINDINGS: Our search obtained 2,003 hits which resulted in 54 included SRs, published between 1994 and 2014. The quality of SRs was generally poor, with less than half complying with most of the quality criteria. Reported vaccines included, by order of frequency, influenza and Expanded Programme on Immunisation vaccines. The types of interventions more frequently reported were related to vaccination delivery strategies, financial support and information, education and communication. Most of the SRs suggested effects favouring intervention groups as opposed to comparison groups. The most frequently reported equity attribute was 'place of residence' and the least reported equity attributes were sexual orientation and religion. Very few estimates of effects actually measured differences or changes between groups having those attributes and all of them referred to the place of residence. No data was found about reducing equity gaps for vulnerable groups or minorities, or attributes such as sexual orientation, education or specific religious groups. CONCLUSIONS: Although research on vulnerable populations as a subgroup is abundant, it fails to report on the interventions that will actually reduce inequities and consider how redistribution of health care resources could shrink the gap between the privileged and most vulnerable groups including minorities. Research, if aiming at being responsive to global health policy trends, needs to report not only on specific attributes but also on how a better redistribution of health care resources could contribute to alleviating the unjust situation of the most vulnerable populations.

The comprehensive 'Communicate to Vaccinate' taxonomy of communication interventions for childhood vaccination in routine and campaign contexts.

BACKGROUND: Communication can be used to generate demand for vaccination or address vaccine hesitancy, and is crucial to successful childhood vaccination programmes. Research efforts have primarily focused on communication for routine vaccination. However, vaccination campaigns, particularly in low- or middle-income countries (LMICs), also use communication in diverse ways. Without a comprehensive framework integrating communication interventions from routine and campaign contexts, it is not possible to conceptualise the full range of possible vaccination communication interventions. Therefore, vaccine programme managers may be unaware of potential communication options and researchers may not focus on building evidence for interventions used in practice. In this paper, we broaden the scope of our existing taxonomy of communication interventions for routine vaccination to include communication used in campaigns, and integrate these into a comprehensive taxonomy of vaccination communication interventions. METHODS: Building on our taxonomy of communication for routine vaccination, we identified communication interventions used in vaccination campaigns through a targeted literature search; observation of vaccination activities in Cameroon, Mozambique and Nigeria; and stakeholder consultations. We added these interventions to descriptions of routine vaccination communication and categorised the interventions according to their intended purposes, building from an earlier taxonomy of communication related to routine vaccination. RESULTS: The comprehensive taxonomy groups communication used in campaigns and routine childhood vaccination into seven purpose categories: 'Inform or Educate'; 'Remind or Recall'; 'Enhance Community Ownership'; 'Teach Skills'; 'Provide Support'; 'Facilitate Decision Making' and 'Enable Communication'. Consultations with LMIC stakeholders and experts informed the taxonomy's definitions and structure and established its potential uses. CONCLUSIONS: This taxonomy provides a standardised way to think and speak about vaccination communication. It is categorised by purpose to help conceptualise communication interventions as potential solutions to address needs or problems. It can be utilised by programme planners, implementers, researchers and funders to see the range of communication interventions used in practice, facilitate evidence synthesis and identify evidence gaps.

Factors affecting the implementation of childhood vaccination communication strategies in Nigeria: a qualitative study.

BACKGROUND: The role of health communication in vaccination programmes cannot be overemphasized: it has contributed significantly to creating and sustaining demand for vaccination services and improving vaccination coverage. In Nigeria, numerous communication approaches have been deployed but these interventions are not without challenges. We therefore aimed to explore factors affecting the delivery of vaccination communication in Nigeria. METHODS: We used a qualitative approach and conducted the study in two states: Bauchi and Cross River States in northern and southern Nigeria respectively. We identified factors affecting the implementation of communication interventions through interviews with relevant stakeholders involved in vaccination communication in the health services. We also reviewed relevant documents. Data generated were transcribed verbatim and analysed using thematic analysis. RESULTS: We used the SURE framework to organise the identified factors (barriers and facilitators) affecting vaccination communication delivery. We then grouped these into health systems and community level factors. Some of the commonly reported health system barriers amongst stakeholders interviewed included: funding constraints, human resource factors (health worker shortages, training deficiencies, poor attitude of health workers and vaccination teams), inadequate infrastructure and equipment and weak political will. Community level factors included the attitudes of community stakeholders and of parents and caregivers. We also identified factors that appeared to facilitate communication activities. These included political support, engagement of traditional and religious institutions and the use of organised communication committees. CONCLUSIONS: Communication activities are a crucial element of immunization programmes. It is therefore important for policy makers and programme managers to understand the barriers and facilitators affecting the delivery of vaccination communication so as to be able to implement communication interventions more effectively.

Mapping how information about childhood vaccination is communicated in two regions of Cameroon: What is done and where are the gaps?

BACKGROUND: The 'Communicate to vaccinate' (COMMVAC) project builds research evidence for improving communication with parents and communities about childhood vaccinations in low- and middle-income countries. Understanding and mapping the range of vaccination communication strategies used in different settings is an important component of this work. In this part of the COMMVAC project, our objectives were: (1) to identify the vaccination communication interventions used in two regions of Cameroon; (2) to apply the COMMVAC taxonomy, a global taxonomy of vaccination communication interventions, to these communication interventions to help us classify these interventions, including their purposes and target audiences; and identify whether gaps in purpose or target audiences exist; (3) to assess the COMMVAC taxonomy as a research tool for data collection and analysis. METHODS: We used the following qualitative methods to identify communication strategies in the Central and North West Regions of Cameroon in the first half of 2014: interviews with program managers, non-governmental organizations, vaccinators, parents and community members; observations and informal conversations during routine immunization clinics and three rounds of the National Polio Immunization Campaign; and document analysis of reports and mass media communications about vaccination. A survey of parents and caregivers was also done. We organised the strategies using the COMMVAC taxonomy and produced a map of Cameroon-specific interventions, which we presented to local stakeholders for feedback. RESULTS: Our map of the interventions used in Cameroon suggests that most childhood vaccination communication interventions focus on national campaigns against polio rather than routine immunisation. The map also indicates that most communication interventions target communities more broadly, rather than parents, and that very few interventions target health workers. The majority of the communication interventions aimed to inform or educate or remind or recall members of the community about vaccination. The COMMVAC taxonomy provided a useful framework for quickly and simply mapping existing vaccination communication strategies. CONCLUSIONS: By identifying the interventions used in Cameroon and developing an intervention map, we allowed stakeholders to see where they were concentrating their communication efforts and where gaps exist, allowing them to reflect on whether changes are needed to the communication strategies they are using.

The effects of radiofrequency electromagnetic fields exposure on tinnitus, migraine and non-specific symptoms in the general and working population: A systematic review and meta-analysis on human observational studies.

BACKGROUND: Applications emitting radiofrequency electromagnetic fields (RF-EMF; 100 kHz to 300 GHz) are widely used for communication (e.g. mobile phones), in medicine (diathermy) and in industry (RF heaters). OBJECTIVES: The objective is to systematically review the effects of longer-term or repeated local and whole human body radiofrequency electromagnetic field (RF-EMF) exposure on the occurrence of symptoms. Primary hypotheses were tinnitus, migraine and headaches in relation to RF-EMF exposure of the brain, sleep disturbances and composite symptom scores in relation to whole-body RF-EMF exposure. METHODS: Eligibility criteria: We included case-control and prospective cohort studies in the general population or workers estimating local or whole-body RF-EMF exposure for at least one week. INFORMATION SOURCES: We conducted a systematic literature search in various databases including Web of Science and Medline. Risk of bias: We used the Risk of Bias (RoB) tool developed by OHAT adapted to the topic of this review. SYNTHESIS OF RESULTS: We synthesized studies using random effects meta-analysis. RESULTS: Included studies: We included 13 papers from eight distinct cohort and one case-control studies with a total of 486,558 participants conducted exclusively in Europe. Tinnitus is addressed in three papers, migraine in one, headaches in six, sleep disturbances in five, and composite symptom scores in five papers. Only one study addressed occupational exposure. SYNTHESIS OF RESULTS: For all five priority hypotheses, available research suggests that RF-EMF exposure below guideline values does not cause symptoms, but the evidence is very uncertain. The very low certainty evidence is due the low number of studies, possible risk of bias in some studies, inconsistencies, indirectness, and imprecision. In terms of non-priority hypotheses numerous exposure-outcome combinations were addressed in the 13 eligible papers without indication for an association related to a specific symptom or exposure source. DISCUSSION: Limitations of evidence: This review topic includes various challenges related to confounding control and exposure assessment. Many of these aspects are inherently present and not easy to be solved in future research. Since near-field exposure from wireless communication devices is related to lifestyle, a particular challenge is to differentiate between potential biophysical effects and other potential effects from extensive use of wireless communication devices that may compete with healthy behaviour such as sleeping or physical activity. Future research needs novel and innovative methods to differentiate between these two hypothetical mechanisms. INTERPRETATION: This is currently the best available evidence to underpin safety of RF-EMF. There is no indication that RF-EMF below guideline values causes symptoms. However, inherent limitations of the research results in substantial uncertainty. OTHER: Funding: This review was partially funded by the WHO radioprotection programme. REGISTRATION: The protocol for this review has been registered in Prospero (reg no CRD42021239432) and published in Environment International (Röösli et al., 2021).

The effects of radiofrequency electromagnetic fields exposure on human self-reported symptoms: A systematic review of human experimental studies.

BACKGROUND: The technological applications of radiofrequency electromagnetic fields (RF-EMF) have been steadily increasing since the 1950s exposing large proportions of the population. The World Health Organization (WHO) is assessing the potential health effects of exposure to RF-EMF. OBJECTIVES: To systematically assess the effects of exposure to RF-EMF on self-reported non-specific symptoms in human subjects and to assess the accuracy of perceptions of presence or absence of RF-EMF exposure. METHODS: Eligibility criteria: experimental studies carried out in the general population and in individuals with idiopathic environmental intolerance attributed to EMF (IEI-EMF), in any language. INFORMATION SOURCES: Medline, Web of Science, PsycInfo, Cochrane Library, Epistemonikos, Embase and EMF portal, searched till April 2022. Risk of Bias (ROB): we used the RoB tool developed by OHAT adapted to the topic of this review. SYNTHESIS OF RESULTS: we synthesized studies using random effects meta-analysis and sensitivity analyses, where appropriate. RESULTS: Included studies: 41 studies were included, mostly cross over trials and from Europe, with a total of 2,874 participants. SYNTHESIS OF RESULTS: considering the primary outcomes, we carried out meta-analyses of 10 exposure-outcomes pairs. All evidence suggested no or small non-significant effects of exposure on symptoms with high (three comparisons), moderate (four comparisons), low (one comparison) and very low (two comparisons) certainty of evidence. The effects (standard mean difference, where positive values indicate presence of symptom being exposed) in the general population for head exposure were (95% confidence intervals) 0.08 (-0.07 to 0.22) for headache, -0.01 (-0.22 to 0.20) for sleeping disturbances and 0.13 (-0.51 to 0.76) for composite symptoms; and for whole-body exposure: 0.09 (-0.35 to 0.54), 0.00 (-0.15 to 0.15) for sleeping disturbances and -0.05 (-0.17 to 0.07) for composite symptoms. For IEI-EMF individuals SMD ranged from -0.19 to 0.11, all of them with confidence intervals crossing the value of zero. Further, the available evidence suggested that study volunteers could not perceive the EMF exposure status better than what is expected by chance and that IEI-EMF individuals could not determine EMF conditions better than the general population. DISCUSSION: Limitations of evidence: experimental conditions are substantially different from real-life situations in the duration, frequency, distance and position of the exposure. Most studies were conducted in young, healthy volunteers, who might be more resilient to RF-EMF than the general population. The outcomes of interest in this systematic review were symptoms, which are self-reported. The available information did not allow to assess the potential effects of exposures beyond acute exposure and in elderly or in chronically ill people. It cannot be ruled out that a real EMF effect in IEI-EMF groups is masked by a mix with insensitive subjects. However, studies on symptoms reporting and/or field perceptions did not find any evidence that there were particularly vulnerable individuals in the IEI-EMF group, although in open provocation studies, when volunteers were informed about the presence or absence of EMF exposure, such differences were consistently observed. INTERPRETATION: available evidence suggests that acute RF-EMF below regulatory limits does not cause symptoms and corresponding claims in the everyday life are related to perceived and not to real EMF exposure status.

"Communicate to vaccinate": the development of a taxonomy of communication interventions to improve routine childhood vaccination.

BACKGROUND: Vaccination is a cost-effective public health measure and is central to the Millennium Development Goal of reducing child mortality. However, childhood vaccination coverage remains sub-optimal in many settings. While communication is a key feature of vaccination programmes, we are not aware of any comprehensive approach to organising the broad range of communication interventions that can be delivered to parents and communities to improve vaccination coverage. Developing a classification system (taxonomy) organised into conceptually similar categories will aid in: understanding the relationships between different types of communication interventions; facilitating conceptual mapping of these interventions; clarifying the key purposes and features of interventions to aid implementation and evaluation; and identifying areas where evidence is strong and where there are gaps. This paper reports on the development of the 'Communicate to vaccinate' taxonomy. METHODS: The taxonomy was developed in two stages. Stage 1 included: 1) forming an advisory group; 2) searching for descriptions of interventions in trials (CENTRAL database) and general health literature (Medline); 3) developing a sampling strategy; 4) screening the search results; 5) developing a data extraction form; and 6) extracting intervention data. Stage 2 included: 1) grouping the interventions according to purpose; 2) holding deliberative forums in English and French with key vaccination stakeholders to gather feedback; 3) conducting a targeted search of grey literature to supplement the taxonomy; 4) finalising the taxonomy based on the input provided. RESULTS: The taxonomy includes seven main categories of communication interventions: inform or educate, remind or recall, teach skills, provide support, facilitate decision making, enable communication and enhance community ownership. These categories are broken down into 43 intervention types across three target groups: parents or soon-to-be-parents; communities, community members or volunteers; and health care providers. CONCLUSIONS: Our taxonomy illuminates and organises this field and identifies the range of available communication interventions to increase routine childhood vaccination uptake. We have utilised a variety of data sources, capturing information from rigorous evaluations such as randomised trials as well as experiences and knowledge of practitioners and vaccination stakeholders. The taxonomy reflects current public health practice and can guide the future development of vaccination programmes.

Prioritizing COVID-19 vaccine allocation in resource poor settings: Towards an Artificial Intelligence-enabled and Geospatial-assisted decision support framework.

OBJECTIVES: To propose a novel framework for COVID-19 vaccine allocation based on three components of Vulnerability, Vaccination, and Values (3Vs). METHODS: A combination of geospatial data analysis and artificial intelligence methods for evaluating vulnerability factors at the local level and allocate vaccines according to a dynamic mechanism for updating vulnerability and vaccine uptake. RESULTS: A novel approach is introduced including (I) Vulnerability data collection (including country-specific data on demographic, socioeconomic, epidemiological, healthcare, and environmental factors), (II) Vaccination prioritization through estimation of a unique Vulnerability Index composed of a range of factors selected and weighed through an Artificial Intelligence (AI-enabled) expert elicitation survey and scientific literature screening, and (III) Values consideration by identification of the most effective GIS-assisted allocation of vaccines at the local level, considering context-specific constraints and objectives. CONCLUSIONS: We showcase the performance of the 3Vs strategy by comparing it to the actual vaccination rollout in Kenya. We show that under the current strategy, socially vulnerable individuals comprise only 45% of all vaccinated people in Kenya while if the 3Vs strategy was implemented, this group would be the first to receive vaccines.

Guidance for evidence-informed policies about health systems: assessing how much confidence to place in the research evidence.

In the third paper in a three-part series on health systems guidance, Simon Lewin and colleagues explore the challenge of assessing how much confidence to place in evidence on health systems interventions.

Guidance for evidence-informed policies about health systems: rationale for and challenges of guidance development.

In the first paper in a three-part series on health systems guidance, Xavier Bosch-Capblanch and colleagues examine how guidance is currently formulated in low- and middle-income countries, and the challenges to developing such guidance.

Unvaccinated children in years of increasing coverage: how many and who are they? Evidence from 96 low- and middle-income countries.

OBJECTIVE: While childhood immunisation coverage levels have increased since the 70s, inequities in coverage between and within countries have been widely reported. Unvaccinated children remain undetected by routine monitoring systems and strikingly unreported. The objective of this study was to provide evidence on the magnitude of the problem and to describe predictors associated with non-vaccination. METHODS: Two hundred and forty-one nationally representative household surveys in 96 countries were analysed. Proportions and changes in time of 'unvaccinated' (children having not received a single dose of vaccine), 'partially vaccinated' and 'fully vaccinated' children were estimated. Predictors of non-vaccination were explored. RESULTS: The percentage of unvaccinated children was 9.9% across all surveys. 66 countries had more than one survey: 38 showed statistically significant reductions in the proportion of unvaccinated children between the first and last survey, 10 countries showed increases and the rest showed no significant changes. However, while 18 of the 38 countries also improved in terms of partially and fully vaccinated, in the other 20 the proportion of fully vaccinated decreased. The predictors more strongly associated with being unvaccinated were education of the caregiver, education of caregiver's partner, caregiver's tetanus toxoid (TT) status, wealth index and type of family member participation in decision-making when the child is ill. Multivariable logistic regression identified the TT status of the caregiver as the strongest predictors of unvaccinated children. Country-specific summaries were produced and sent to countries. CONCLUSION: The number of unvaccinated children is not negligible and their proportion and the predictors of non-vaccination have to be drawn from specific surveys. Specific vaccine indicators cannot properly describe the performance of immunisation programmes in certain situations. National immunisation programmes and national and international immunisation stakeholders should also consider monitoring the proportion of unvaccinated children (i.e. those who have received no vaccines at all) and draw specific plans on the determinants of non-vaccination.

The effects of radiofrequency electromagnetic fields exposure on human self-reported symptoms: A protocol for a systematic review of human experimental studies.

BACKGROUND: The technological applications of radiofrequency electromagnetic fields (RF-EMF) have been steadily increasing since the 1950s across multiple sectors exposing large proportions of the population. This fact has raised concerns related to the potential consequences to people's health. The World Health Organization (WHO) is assessing the potential health effects of exposure to RF-EMF and has carried out an international survey amongst experts, who have identified six priority topics to be further addressed through systematic reviews, whereof the effects on symptoms is one of them. We report here the systematic review protocol of experimental studies in humans assessing the effects of RF-EMF on symptoms. OBJECTIVE: Our objectives are to assess the effects of exposure to electromagnetic fields (compared to no or lower exposure levels) on symptoms in human subjects. We will also assess the accuracy of perception of presence of exposure in volunteers with and without idiopathic environmental intolerance attributed to electromagnetic fields (IEI-EMF). ELIGIBILITY CRITERIA: We will search relevant literature sources (e.g. the Web of Science, Medline, Embase, Epistemonikos) for randomized trials (comparing at least two arms) and randomised crossover trials of RF-EMF exposure that have assessed the effects on symptoms. We will also include studies that have measured the accuracy of the perception of the presence or absence of exposure. We will include studies in any language. STUDY APPRAISAL AND SYNTHESIS: Studies will be assessed against inclusion criteria by two independent reviewers. Data on study characteristics, participants, exposure, comparators and effects will be extracted using a specific template for this review, by two independent reviewers. Discrepancies will be solved by consensus. Risk of bias (ROB) will be assessed using the ROB Rating Tool for Human and Animal Studies and the level of confidence in the evidence of the exposure-outcome relations will be assessed using the GRADE approach. For the perception studies, we will use adapted versions of the ROB tool and GRADE assessment. Where appropriate, data will be combined using meta-analytical techniques.

Using and improving the PHISICC paper-based tools in the health facility laboratories: Examples of Human Centered Design taking systems thinking into practice, in Côte d'Ivoire and Nigeria.

Background: Health workers in low- and middle-income countries are increasingly demanded to collect more and more data to report them to higher levels of the health information system (HIS), in detriment of useful data for clinical and public health decision-making, potentially compromising the quality of their health care provison. In order to support health workers' decision-making, we engaged with partners in Côte d'Ivoire, Mozambique and Nigeria in a research project to conceive, design, produce, implement and test paper-based health information tools: the PHISICC tools. Our aim was to understand the use of PHISICC tools by health workers and to improve them based on their feedback. Methods: The design Health Facility Laboratories (HF Labs) in Côte d'Ivoire and in Nigeria were set up after months of use of PHISICC tools. Activities were structured in three phases or 'sprints' of co-creative research. We used a transdisciplinary approach, including anthropology and Human Centered Design (HCD), observations, shadowing, structured interviews and co-creation. Results: Health workers appreciated the standardization of the tools across different health care areas, with a common visual language that optimized use. Several design issues were raised, in terms of formats and contents. They strongly appreciated how the PHISICC registers guided their clinical decision-making and how it facilitated tallying and counting for monthly reporting. However, adherence to new procedures was not universal. The co-creation sessions resulted in modifications to the PHISICC tools of out-patient care and postnatal care. Discussion: Although health systems and systemic thinking allowed the teams to embrace complexity, it was the HCD approach that actually produced a shift in researchers' mind-set: from HIS as data management tools to HIS as quality of care instruments. HCD allowed navigating the complexity of health systems interventions due to its capacity to operate change: it not only allowed us to understand how the PHISICC tools were used but also how to further improve them. In the absence of (or even with) an analytical health systems framework, HCD approaches can work in real-life situations for the ideation, testing and implementation of interventions to improve health systems and health status outcomes.

Managerial supervision to improve primary health care in low- and middle-income countries.

BACKGROUND: Primary healthcare (PHC) workers often work alone or in isolation. Healthcare managerial supervision is recommended to help assure quality; but this requires skilled supervisors and takes time and resources. It is therefore important to assess to what extent supervision is beneficial and the ways in which it can be implemented. OBJECTIVES: To review the effects of managerial supervision of health workers to improve the quality of PHC (such as adherence to guidance or coverage of services) in low- and middle-income countries. SEARCH STRATEGY: We searched The Cochrane Central Register of Controlled Trials (CENTRAL) 2011, Issue 1, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 March 2011); MEDLINE, Ovid 1950 to March Week 1 2011 (searched 08 March 2011); EMBASE, Ovid 1980 to 2011 Week 12 (searched 08 March 2011); CINAHL, Ebsco 1981 - present (searched 10 March 2011); LILACS, VHL (searched 10 March 2011). SELECTION CRITERIA: Randomised controlled trials, controlled before-and-after studies, and interrupted time series studies, conducted in PHC in low- and middle-income countries. Supervision includes site visits from a central level of the health system, plus at least one supervisory activity. We excluded studies aimed solely at improving the clinical skills of PHC workers. DATA COLLECTION AND ANALYSIS: We extracted data using a predefined form and assessed for risk of bias using the EPOC risk of bias criteria. Data are presented in a narrative way without pooling the effects on the outcomes as studies and outcomes were diverse. MAIN RESULTS: Nine studies met the inclusion criteria: three compared supervision with no supervision, five compared enhanced supervision with routine supervision, and one study compared less intensive supervision with routine supervision. Most outcomes were scores relating to providers' practice, knowledge and provider or user satisfaction. The majority of the outcomes were measured within nine months after the interventions were introduced. In two studies comparing supervision with no supervision, small benefits on provider practice and knowledge were found. For methods of enhancing supervision, we identified five studies, and two studies of frequent supportive supervision demonstrated small benefits on workers performance. The one study examining the impact of less intensive supervision found no evidence that reducing the frequency of visits had any effect on the utilisation of services. The GRADE evidence quality for all comparisons and outcomes was "low" or "very low". AUTHORS' CONCLUSIONS: It is uncertain whether supervision has a substantive, positive effect on the quality of primary health care in low- and middle-income countries. The long term effectiveness of supervision is unknown.

Do existing research summaries on health systems match immunisation managers' needs in middle- and low-income countries? Analysis of GAVI health systems strengthening support.

BACKGROUND: The GAVI Alliance was created in 2000 to increase access to vaccines. More recently, GAVI has supported evidence-based health systems strengthening to overcome barriers to vaccination. Our objectives were: to explore countries' priorities for health systems strengthening; to describe published research summaries for each priority area in relation to their number, quality and relevance; and to describe the use of national data from surveys in identifying barriers to immunisation. METHODS: From 44 health systems strengthening proposals submitted to GAVI in 2007 and 2008, we analysed the topics identified, the coverage of these topics by existing systematic reviews and the use of nation-wide surveys with vaccination data to justify the needs identified in the proposals. RESULTS: Thirty topics were identified and grouped into three thematic areas: health workforce (10 topics); organisation and management (14); and supply, distribution and maintenance (6). We found 51 potentially relevant systematic reviews, although for the topic that appeared most frequently in the proposals ('Health information systems') no review was identified. Thematic and geographic relevance were generally categorised as "high" in 33 (65%) and 25 (49%) reviews, respectively, but few reviews were categorised as "highly relevant for policy" (7 reviews, 14%). With regard to methodological quality, 14 reviews (27%) were categorised as "high".The number of topics that were addressed by at least one high quality systematic review was: seven of the 10 topics in the 'health workforce' thematic area; six of the 14 topics in the area of 'organisation and management'; and none of the topics in the thematic area of 'supply, distribution and maintenance'. Only twelve of the 39 countries with available national surveys referred to them in their proposals. CONCLUSION: Relevant, high quality research summaries were found for few of the topics identified by managers. Few proposals used national surveys evidence to identify barriers to vaccination. Researchers generating or adapting evidence about health systems need to be more responsive to managers' needs. Use of available evidence from local or national surveys should be strongly encouraged.