The effects of radiofrequency electromagnetic fields exposure on human self-reported symptoms: A systematic review of human experimental studies.

BACKGROUND: The technological applications of radiofrequency electromagnetic fields (RF-EMF) have been steadily increasing since the 1950s exposing large proportions of the population. The World Health Organization (WHO) is assessing the potential health effects of exposure to RF-EMF. OBJECTIVES: To systematically assess the effects of exposure to RF-EMF on self-reported non-specific symptoms in human subjects and to assess the accuracy of perceptions of presence or absence of RF-EMF exposure. METHODS: Eligibility criteria: experimental studies carried out in the general population and in individuals with idiopathic environmental intolerance attributed to EMF (IEI-EMF), in any language. INFORMATION SOURCES: Medline, Web of Science, PsycInfo, Cochrane Library, Epistemonikos, Embase and EMF portal, searched till April 2022. Risk of Bias (ROB): we used the RoB tool developed by OHAT adapted to the topic of this review. SYNTHESIS OF RESULTS: we synthesized studies using random effects meta-analysis and sensitivity analyses, where appropriate. RESULTS: Included studies: 41 studies were included, mostly cross over trials and from Europe, with a total of 2,874 participants. SYNTHESIS OF RESULTS: considering the primary outcomes, we carried out meta-analyses of 10 exposure-outcomes pairs. All evidence suggested no or small non-significant effects of exposure on symptoms with high (three comparisons), moderate (four comparisons), low (one comparison) and very low (two comparisons) certainty of evidence. The effects (standard mean difference, where positive values indicate presence of symptom being exposed) in the general population for head exposure were (95% confidence intervals) 0.08 (-0.07 to 0.22) for headache, -0.01 (-0.22 to 0.20) for sleeping disturbances and 0.13 (-0.51 to 0.76) for composite symptoms; and for whole-body exposure: 0.09 (-0.35 to 0.54), 0.00 (-0.15 to 0.15) for sleeping disturbances and -0.05 (-0.17 to 0.07) for composite symptoms. For IEI-EMF individuals SMD ranged from -0.19 to 0.11, all of them with confidence intervals crossing the value of zero. Further, the available evidence suggested that study volunteers could not perceive the EMF exposure status better than what is expected by chance and that IEI-EMF individuals could not determine EMF conditions better than the general population. DISCUSSION: Limitations of evidence: experimental conditions are substantially different from real-life situations in the duration, frequency, distance and position of the exposure. Most studies were conducted in young, healthy volunteers, who might be more resilient to RF-EMF than the general population. The outcomes of interest in this systematic review were symptoms, which are self-reported. The available information did not allow to assess the potential effects of exposures beyond acute exposure and in elderly or in chronically ill people. It cannot be ruled out that a real EMF effect in IEI-EMF groups is masked by a mix with insensitive subjects. However, studies on symptoms reporting and/or field perceptions did not find any evidence that there were particularly vulnerable individuals in the IEI-EMF group, although in open provocation studies, when volunteers were informed about the presence or absence of EMF exposure, such differences were consistently observed. INTERPRETATION: available evidence suggests that acute RF-EMF below regulatory limits does not cause symptoms and corresponding claims in the everyday life are related to perceived and not to real EMF exposure status.

The effects of radiofrequency electromagnetic fields exposure on tinnitus, migraine and non-specific symptoms in the general and working population: A systematic review and meta-analysis on human observational studies.

BACKGROUND: Applications emitting radiofrequency electromagnetic fields (RF-EMF; 100 kHz to 300 GHz) are widely used for communication (e.g. mobile phones), in medicine (diathermy) and in industry (RF heaters). OBJECTIVES: The objective is to systematically review the effects of longer-term or repeated local and whole human body radiofrequency electromagnetic field (RF-EMF) exposure on the occurrence of symptoms. Primary hypotheses were tinnitus, migraine and headaches in relation to RF-EMF exposure of the brain, sleep disturbances and composite symptom scores in relation to whole-body RF-EMF exposure. METHODS: Eligibility criteria: We included case-control and prospective cohort studies in the general population or workers estimating local or whole-body RF-EMF exposure for at least one week. INFORMATION SOURCES: We conducted a systematic literature search in various databases including Web of Science and Medline. Risk of bias: We used the Risk of Bias (RoB) tool developed by OHAT adapted to the topic of this review. SYNTHESIS OF RESULTS: We synthesized studies using random effects meta-analysis. RESULTS: Included studies: We included 13 papers from eight distinct cohort and one case-control studies with a total of 486,558 participants conducted exclusively in Europe. Tinnitus is addressed in three papers, migraine in one, headaches in six, sleep disturbances in five, and composite symptom scores in five papers. Only one study addressed occupational exposure. SYNTHESIS OF RESULTS: For all five priority hypotheses, available research suggests that RF-EMF exposure below guideline values does not cause symptoms, but the evidence is very uncertain. The very low certainty evidence is due the low number of studies, possible risk of bias in some studies, inconsistencies, indirectness, and imprecision. In terms of non-priority hypotheses numerous exposure-outcome combinations were addressed in the 13 eligible papers without indication for an association related to a specific symptom or exposure source. DISCUSSION: Limitations of evidence: This review topic includes various challenges related to confounding control and exposure assessment. Many of these aspects are inherently present and not easy to be solved in future research. Since near-field exposure from wireless communication devices is related to lifestyle, a particular challenge is to differentiate between potential biophysical effects and other potential effects from extensive use of wireless communication devices that may compete with healthy behaviour such as sleeping or physical activity. Future research needs novel and innovative methods to differentiate between these two hypothetical mechanisms. INTERPRETATION: This is currently the best available evidence to underpin safety of RF-EMF. There is no indication that RF-EMF below guideline values causes symptoms. However, inherent limitations of the research results in substantial uncertainty. OTHER: Funding: This review was partially funded by the WHO radioprotection programme. REGISTRATION: The protocol for this review has been registered in Prospero (reg no CRD42021239432) and published in Environment International (Röösli et al., 2021).

Framework synthesis to inform the ideation and design of a paper-based health information system (PHISICC).

BACKGROUND: Health information systems (HIS) are meant to support decision-making at all levels of the system, including frontline health workers. In field studies in Côte d'Ivoire, Mozambique and Nigeria, we observed health workers' interactions with the HIS and identified twelve decision-making components of HIS. The objective of this framework synthesis is to portray these components in HIS research, in order to inform the ideation of a paper-based HIS intervention (PHISICC). METHODS: We searched studies in the Cochrane Central Register of Controlled Trials (CENTRAL), Embase, Epistemonikos, Medline, in-Process on the Ovid platform, OpenGrey, PDQ  Evidence ("pretty darnd quick" Evidence), the World Health Organization (WHO) Global Health Library and included studies focussing on HIS interventions, data quality, information support tools and data use for decision-making in the context of the governmental health care sector. We assessed the methodological quality of studies using the Critical Appraisal Skills Programme tool. We synthesised the findings based on the decision-making components of HIS and thematic areas. RESULTS: The search identified 6784 studies; 50 were included. Most of the 50 studies had quality concerns. All studies included at least one of the decision-making components: the most prominent were the technical aspects of 'recording' and 'reporting'. Data use for decision-making was much less represented. CONCLUSION: HIS research focuses on the more technical aspects of HIS. Further research on HIS, given the strong push towards HIS digitalisation, should consider putting at the centre the human experience of decision-making and data use, in order to make HIS relevant for quality of care.

The effects of radiofrequency electromagnetic fields exposure on human self-reported symptoms: A protocol for a systematic review of human experimental studies.

BACKGROUND: The technological applications of radiofrequency electromagnetic fields (RF-EMF) have been steadily increasing since the 1950s across multiple sectors exposing large proportions of the population. This fact has raised concerns related to the potential consequences to people's health. The World Health Organization (WHO) is assessing the potential health effects of exposure to RF-EMF and has carried out an international survey amongst experts, who have identified six priority topics to be further addressed through systematic reviews, whereof the effects on symptoms is one of them. We report here the systematic review protocol of experimental studies in humans assessing the effects of RF-EMF on symptoms. OBJECTIVE: Our objectives are to assess the effects of exposure to electromagnetic fields (compared to no or lower exposure levels) on symptoms in human subjects. We will also assess the accuracy of perception of presence of exposure in volunteers with and without idiopathic environmental intolerance attributed to electromagnetic fields (IEI-EMF). ELIGIBILITY CRITERIA: We will search relevant literature sources (e.g. the Web of Science, Medline, Embase, Epistemonikos) for randomized trials (comparing at least two arms) and randomised crossover trials of RF-EMF exposure that have assessed the effects on symptoms. We will also include studies that have measured the accuracy of the perception of the presence or absence of exposure. We will include studies in any language. STUDY APPRAISAL AND SYNTHESIS: Studies will be assessed against inclusion criteria by two independent reviewers. Data on study characteristics, participants, exposure, comparators and effects will be extracted using a specific template for this review, by two independent reviewers. Discrepancies will be solved by consensus. Risk of bias (ROB) will be assessed using the ROB Rating Tool for Human and Animal Studies and the level of confidence in the evidence of the exposure-outcome relations will be assessed using the GRADE approach. For the perception studies, we will use adapted versions of the ROB tool and GRADE assessment. Where appropriate, data will be combined using meta-analytical techniques.

Strengthening women's empowerment and gender equality in fragile contexts towards peaceful and inclusive societies: A systematic review and meta-analysis.

Background: Across the globe, gender disparities still exist with regard to equitable access to resources, participation in decision-making processes, and gender and sexual-based violence. This is particularly true in fragile and conflict-affected settings, where women and girls are affected by both fragility and conflict in unique ways. While women have been acknowledged as key actors in peace processes and post-conflict reconstruction (e.g., through the United Nations Security Council Resolution 1325 and the Women, Peace and Security Agenda) evidence on the effectiveness of gender-specific and gender-transformative interventions to improve women's empowerment in fragile and conflict-affected states and situations (FCAS) remains understudied. Objectives: The purpose of this review was to synthesize the body of evidence around gender-specific and gender-transformative interventions aimed at improving women's empowerment in fragile and conflict-affected settings with high levels of gender inequality. We also aimed to identify barriers and facilitators that could affect the effectiveness of these interventions and to provide implications for policy, practice and research designs within the field of transitional aid. Methods: We searched for and screened over 100,000 experimental and quasi-experimental studies focused on FCAS at the individual and community levels. We used standard methodological procedures outlined by the Campbell Collaboration for the data collection and analysis, including quantitative and qualitative analyses, and completed the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) methodology to assess the certainty around each body of evidence. Results: We identified 104 impact evaluations (75% randomised controlled trials) assessing the effects of 14 different types of interventions in FCAS. About 28% of included studies were assessed as having a high risk of bias (45% among quasi-experimental designs). Interventions supporting women's empowerment and gender equality in FCAS produced positive effects on the outcomes related to the primary focus of the intervention. There are no significant negative effects of any included interventions. However, we observe smaller effects on behavioural outcomes further along the causal chain of empowerment. Qualitative syntheses indicated that gender norms and practices are potential barriers to intervention effectiveness, while working with local powers and institutions can facilitate the uptake and legitimacy of interventions. Conclusions: We observe gaps of rigorous evidence in certain regions (notably MENA and Latin America) and in interventions specifically targeting women as actors of peacebuilding. Gender norms and practices are important elements to consider in programme design and implementation to maximise potential benefits: focusing on empowerment only might not be enough in the absence of targeting the restrictive gender norms and practices that may undermine intervention effectiveness. Lastly, programme designers and implementation should consider explicitly targeting specific empowerment outcomes, promoting social capital and exchange, and tailoring the intervention components to the desired empowerment-related outcomes.

Interventions to increase youth employment: An evidence and gap map.

Background: Globally, 13% of the youth are not in education, employment or training (NEET). Moreover, this persistent problem has been exacerbated by the shock of Covid-19 pandemic. More youth from disadvantaged backgrounds are likely unemployed than those from better off backgrounds. Thus, the need for increased use of evidence in the design and implementation of youth employment interventions to increase effectiveness and sustainability of interventions and outcomes. Evidence and gap maps (EGMs) can promote evidence-based decision making by guiding policy makers, development partners and researchers to areas with good bodies of evidence and those with little or no evidence. The scope of the Youth Employment EGM is global. The map covers all youth aged 15-35 years. The three broad intervention categories included in the EGM are: strengthening training and education systems, enhancing labour market and, transforming financial sector markets. There are five outcome categories: education and skills; entrepreneurship; employment; welfare and economic outcomes. The EGM contains impact evaluations of interventions implemented to increase youth employment and systematic reviews of such single studies, published or made available between 2000 and 2019. Objectives: The primary objective was to catalogue impact evaluations and systematic reviews on youth employment interventions to improve discoverability of evidence by decision makers, development patterners and researchers, so as to promote evidence-based decision making in programming and implementation of youth employment initiatives. Search Methods: Twenty databases and websites were searched using a validated search strategy. Additional searches included searching within 21 systematic reviews, snowballing 20 most recent studies and citation tracking of 10 most recent studies included in the EGM. Selection Criteria: The study selection criteria followed the PICOS approach of population, intervention, relevant comparison groups, outcomes and study design. Additional criterion is; study publication or availability period of between 2000 and 2021. Only impact evaluations and systematic reviews that included impact evaluations were selected. Data Collection and Analysis: A total of 14,511 studies were uploaded in EPPI Reviewer 4 software, upon which 399 were selected using the criteria provided above. Coding of data took place in EPPI Reviewer basing on predefined codes. The unit of analysis for the report is individual studies where every entry represents a combination of interventions and outcomes. Main Results: Overall, 399 studies (21 systematic reviews and 378 impact evaluations) are included in the EGM. Impact evaluations (n = 378) are much more than the systematic reviews (n = 21). Most impact evaluations are experimental studies (n = 177), followed by non-experimental matching (n = 167) and other regression designs (n = 35). Experimental studies were mostly conducted in both Lower-income countries and Lower Middle Income countries while non-experimental study designs are the most common in both High Income and Upper Middle Income countries. Most evidence is from low quality impact evaluations (71.2%) while majority of systematic reviews (71.4% of 21) are of medium and high quality rating. The area saturated with most evidence is the intervention category of 'training', while the underrepresented are three main intervention sub-categories: information services; decent work policies and; entrepreneurship promotion and financing. Older youth, youth in fragility, conflict and violence contexts, or humanitarian settings, or ethnic minorities or those with criminal backgrounds are least studied. Conclusions: The Youth Employment EGM identifies trends in evidence notably the following: Most evidence is from high-income countries, an indication of the relationship between a country's income status and research productivity.The most common study designs are experimental.Most of the evidence is of low quality. This finding serves to alert researchers, practitioners and policy makers that more rigorous work is needed to inform youth employment interventions. Blending of interventions is practiced. While this could be an indication that blended intervention could be offering better outcomes, this remains an area with a research gap.

Use of community engagement interventions to improve child immunisation in low- and middle-income countries: A systematic review and meta-analysis.

Immunisation is one of the most cost-effective interventions to prevent and control life-threatening infectious diseases. Nonetheless, rates of routine vaccination of children in low- and middle-income countries (LMICs) are strikingly low or stagnant. In 2019, an estimated 19.7 million infants did not receive routine immunisations. Community engagement interventions are increasingly being emphasised in international and national policy frameworks as a means to improve immunisation coverage and reach marginalised communities. This systematic review examines the effectiveness and cost-effectiveness of community engagement interventions on outcomes related to childhood immunisation in LMICs and identifies contextual, design and implementation features that may be associated with effectiveness. We identified 61 quantitative and mixed methods impact evaluations and 47 associated qualitative studies related to community engagement interventions for inclusion in the reteview. For cost-effectiveness analysis 14 of the 61 studies had the needed combination of cost and effectiveness data. The 61 included impact evaluations were concentrated in South Asia and Sub-Saharan Africa and spread across 19 LMICs. The review found that community engagement interventions had a small but significant, positive effect on all primary immunisation outcomes related to coverage and their timeliness. The findings are robust to exclusion of studies assessed as high risk of bias. Qualitative evidence indicates appropriate intervention design, including building in community engagement features; addressing common contextual barriers of immunisation and leveraging facilitators; and accounting for existing implementation constraints and practicalities on the ground are consistently cited as reasons for intervention success. Among the studies for which we were able to calculate cost-effectiveness, we find that the median non-vaccine cost per dose of intervention to increase immunisation coverage by 1% was US $3.68. Given the broad scope of the review in terms of interventions and outcomes, there is significant variation in findings. Among the various types of community engagement interventions, those that involve creation of community buy-in or development of new cadres of community-based structures were found to have consistent positive effect on more primary vaccination coverage outcomes than if the engagement is limited to the design or delivery of an intervention or is a combination of the various types. The evidence base for sub-group analysis for female children was sparse (only two studies) and the effect on coverage of both full immunisation and third dose of diphtheria pertussis tetanus for this group was insignificant.

The effects of radiofrequency electromagnetic fields exposure on tinnitus, migraine and non-specific symptoms in the general and working population: A protocol for a systematic review on human observational studies.

BACKGROUND: Applications emitting radiofrequency electromagnetic fields (RF-EMF; 100 kHz to 300 GHz) are widely used for communication (e.g. mobile phones), in medicine (diathermy) and in industry (RF heaters). Concern has been raised that RF-EMF exposure affects health related quality of life, because a part of the population reports to experience a variety of symptoms related to low exposure levels below regulatory limits. OBJECTIVES: To systematically review the effects of longer-term or repeated local and whole human body RF-EMF exposure on the occurrence of symptoms evaluating migraine, tinnitus, headaches, sleep disturbances and composite symptom scores as primary outcomes. METHODS: We will follow the WHO handbook for guideline development. For the development of the systematic review protocol we considered handbook for conducting systematic reviews for health effects evaluations from the National Toxicology Program-Office of Health Assessment and Translation (NTP-OHAT) and COSTER (Recommendations for the conduct of systematic reviews in toxicology and environmental health research). ELIGIBILITY CRITERIA: Peer-reviewed epidemiological studies in the general population or workers aiming to investigate the association between local or whole-body RF-EMF exposure for at least one week and symptoms are eligible for inclusion. Only cohort, case-control and panel studies will be included. INFORMATION SOURCES: We will search the scientific literature databases Medline, Web of Science, PsycInfo, Cochrane Library, Epistemonikos and Embase, using a predefined search strategy. This search will be supplemented by a search in the EMF-Portal and checks of reference lists of relevant papers and reviews. STUDY APPRAISAL AND SYNTHESIS METHOD: Data from included papers will be extracted according to predefined forms. Findings will be summarized in tables, graphical displays and in a narrative synthesis of the available evidence, complemented with meta-analyses. We will separately review effects of local, far field and occupational exposure. RISK OF BIAS: The internal validity of included studies will be assessed using the NTP-OHAT Risk of Bias Rating Tool for Human and Animal Studies, elaborated to observational RF-EMF studies. EVIDENCE APPRAISAL: To rate certainty of the evidence, we will use the OHAT GRADE-based approach for epidemiological studies. FRAMEWORK AND FUNDING: This protocol concerns one of the ten different systematic reviews considered in a larger systematic review of the World Health Organization to assess potential health effects of exposure to RF-EMF in the general and working population. REGISTRATION: PROSPERO CRD42021239432.

Birth and death notification via mobile devices: a mixed methods systematic review.

BACKGROUND: Ministries of health, donors, and other decision-makers are exploring how they can use mobile technologies to acquire accurate and timely statistics on births and deaths. These stakeholders have called for evidence-based guidance on this topic. This review was carried out to support World Health Organization (WHO) recommendations on digital interventions for health system strengthening. OBJECTIVES: Primary objective: To assess the effects of birth notification and death notification via a mobile device, compared to standard practice. Secondary objectives: To describe the range of strategies used to implement birth and death notification via mobile devices and identify factors influencing the implementation of birth and death notification via mobile devices. SEARCH METHODS: We searched CENTRAL, MEDLINE, Embase, the Global Health Library, and POPLINE (August 2, 2019). We searched two trial registries (August 2, 2019). We also searched Epistemonikos for related systematic reviews and potentially eligible primary studies (August 27, 2019). We conducted a grey literature search using mHealthevidence.org (August 15, 2017) and issued a call for papers through popular digital health communities of practice. Finally, we conducted citation searches of included studies in Web of Science and Google Scholar (May 15, 2020). We searched for studies published after 2000 in any language.  SELECTION CRITERIA: For the primary objective, we included individual and cluster-randomised trials; cross-over and stepped-wedge study designs; controlled before-after studies, provided they have at least two intervention sites and two control sites; and interrupted time series studies. For the secondary objectives, we included any study design, either quantitative, qualitative, or descriptive, that aimed to describe current strategies for birth and death notification via mobile devices; or to explore factors that influence the implementation of these strategies, including studies of acceptability or feasibility. For the primary objective, we included studies that compared birth and death notification via mobile devices with standard practice. For the secondary objectives, we included studies of birth and death notification via mobile device as long as we could extract data relevant to our secondary objectives. We included studies of all cadres of healthcare providers, including lay health workers; administrative, managerial, and supervisory staff; focal individuals at the village or community level; children whose births were being notified and their parents/caregivers; and individuals whose deaths were being notified and their relatives/caregivers. DATA COLLECTION AND ANALYSIS: For the primary objective, two authors independently screened all records, extracted data from the included studies and assessed risk of bias. For the analyses of the primary objective, we reported means and proportions, where appropriate. We used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to assess the certainty of the evidence and we prepared a 'Summary of Findings' table. For the secondary objectives, two authors screened all records, one author extracted data from the included studies and assessed methodological limitations using the WEIRD tool and a second author checked the data and assessments. We carried out a framework analysis using the Supporting the Use of Research Evidence (SURE) framework to identify themes in the data. We used the GRADE-CERQual (Confidence in the Evidence from Reviews of Qualitative research) approach to assess our confidence in the evidence and we prepared a 'Summary of Qualitative Findings' table. MAIN RESULTS: For the primary objective, we included one study, which used a controlled before-after study design. The study was conducted in Lao People's Democratic Republic and assessed the effect of using mobile devices for birth notification on outcomes related to coverage and timeliness of Hepatitis B vaccination. However, we are uncertain of the effect of this approach on these outcomes because the certainty of this evidence was assessed as very low. The included study did not assess resource use or unintended consequences. For the primary objective, we did not identify any studies using mobile devices for death notification. For the secondary objective, we included 21 studies. All studies were conducted in low- or middle-income settings. They focussed on identification of births and deaths in rural, remote, or marginalised populations who are typically under-represented in civil registration processes or traditionally seen as having poor access to health services. The review identified several factors that could influence the implementation of birth-death notification via mobile device. These factors were tied to the health system, the person responsible for notifying, the community and families; and include: - Geographic barriers that could prevent people's access to birth-death notification and post-notification services - Access to health workers and other notifiers with enough training, supervision, support, and incentives - Monitoring systems that ensure the quality and timeliness of the birth and death data - Legal frameworks that allow births and deaths to be notified by mobile device and by different types of notifiers - Community awareness of the need to register births and deaths - Socio-cultural norms around birth and death - Government commitment - Cost to the system, to health workers and to families - Access to electricity and network connectivity, and compatibility with existing systems - Systems that protect data confidentiality We have low to moderate confidence in these findings. This was mainly because of concerns about methodological limitations and data adequacy. AUTHORS' CONCLUSIONS: We need more, well-designed studies of the effect of birth and death notification via mobile devices and on factors that may influence its implementation.

Residential energy efficiency interventions: A meta-analysis of effectiveness studies.

Background: The residential sector releases around 17% of global greenhouse gas emissions and making residential buildings more energy efficient can help mitigate climate change. Engineering models are often used to predict the effects of residential energy efficiency interventions (REEI) on energy consumption, but empirical studies find that these models often over-estimate the actual impact of REEI installation. Different empirical studies often estimate different impacts for the same REEI, possibly due to variations in implementation, climate and population. Funding for this systematic review was provided by the evaluation function at the European Investment Bank Group. Objectives: The review aims to assess the effectiveness of installing REEIs on the following primary outcomes: energy consumption, energy affordability, CO2 emissions and air quality indices and pollution levels. Search Methods: We searched CAB Abst, Econlit, Greenfile, Repec, Academic Search Complete, WB e-lib, WoS (SCI and SSCI) and other 42 databases in November 2020. In addition, we searched for grey literature on websites, checked the reference lists of included studies and relevant reviews, used Google Scholar to identify studies citing included studies, and contacted the authors of studies for any ongoing and unpublished studies. We retrieved a total of 13,629 studies that we screened at title and abstract level, followed by full-text screening and data extraction. Selection Criteria: We included randomised control trials, and quasi-experimental studies that evaluated the impact of installing REEIs anywhere in the world and with any comparison. Data Collection and Analysis: Two independent reviewers screened studies for eligibility, extracted data and assessed risk of bias. When more than one included study examined the same installation of the same type of REEI for a similar outcome, we conducted a meta-analysis. We also performed subgroup analyses. Main Results: A total of 16 studies were eligible and included in the review: two studies evaluated the installation of efficient lighting, three studies the installation of attic/loft insulation, two studies the installation of efficient heat pumps, eight studies the installation of a bundle of energy efficiency measures (EEMs), and one study evaluated other EEMs. Two studies, neither appraised as having a low risk of bias, find that lighting interventions lead to a significant reduction in electricity energy consumption (Hedges' g = -0.29; 95% confidence interval [CI]: -0.48, -0.10). All the other interventions involved heating or cooling, and effects were synthesizised by warmer or colder climate and then across climates. Four studies examined the impact of attic/loft insulation on energy consumption, and two of these studies were appraised as having a low risk of bias. Three studies took place in colder climates with gas consumption as an outcome, and one study took place in a warmer climate, with the electricity consumption (air conditioning) as the outcome. The average impact across all climates was small (Hedges' g = 0.04; 95% CI: -0.09, 0.01) and statistically insignificant. However, two of the studies appear to have evaluated the effect of installing small amounts (less than 75 mm) of insulation. The other two studies, one of which was appraised as low risk of bias and the other involving air conditioning, found significant reductions in consumption. Two studies examined the impact of installing electric heat pumps. The average impact across studies was not statistically significant (Hedges' g = -0.11; 95% CI: -0.41, 0.20). However, there was substantial variation between the two studies. Replacing older pumps with more efficient versions significantly reduced electricity consumption in a colder climate (Hedges' g = -0.36; 95% CI, -0.57, -0.14) in a high risk of bias study. However, a low risk of bias study found a significant increase in electricity consumption from installing new heat pumps (Hedges' g = 0.09; 95% CI, 0.06, 0.12). Supplemental analyses in the latter study indicate that households also used the heat pumps for cooling and that the installed heat pumps most likely reduced overall energy consumption across all sources-that is, households used more electricity but less gas, wood and coal. Seven studies examined bundled REEIs where the households chose which EEMs to install (in five studies the installation occurred after an energy audit that recommended which EEMs to install). Overall, the studies estimated that installing an REEI bundle is associated with a significant reduction in energy consumption (Hedges' g = -0.36; 95% CI, -0.52, -0.19). In the two low risk of bias studies, conducted with mostly low-income households, installed bundles reduced energy consumption by a statistically significant amount (Hedges' g = -0.16; 95% CI, -0.13, -0.18). Authors' Conclusions: The 16 included studies indicate that installing REEIs can significantly reduce energy consumption. However, the same type of REEI installed in different studies caused different effects, indicating that effects are conditional on implementation and context. Exploring causes of this variation is usually not feasible because existing research often does not clearly report the features of installed interventions. Additional high quality impact evaluations should be commissioned in more diverse contexts (only one study was conducted in either Asia or Africa-both involved lighting interventions-and no studies were conducted in South America or Southern Europe).

PROTOCOL: Interventions to increase youth employment: An evidence and gap map.

The research question guiding the production of the youth employment evidence and gap map (EGM) is stated as follows: What is the nature and extent of the evidence base of impact evaluations and systematic reviews on youth employment programmes in the world? The primary objective of is to catalogue impact evaluations and systematic reviews on youth employment interventions to enhance discoverability of evidence by decision makers, development patterners and researchers, so as to promote evidence-based decision making in programming and delivery of youth employment initiatives. This evidence gap map is also a primary input into the implementation of Mastercard Foundation's strategy titled "Africa Works: Mastercard Foundation Strategy 2018-2030", which points out sharing of evidence-based knowledge and innovation with stakeholders as a key strategy to be used (Mastercard Foundation). The time frame for the development of the youth EGM will run from the last quarter of 2019 to December 2020. The five secondary objectives are: (i) To construct a framework for the classification of youth employment effectiveness studies. The objective will be achieved through the development of an intervention and outcome framework using an engaged consultative process involving the review team, Mastercard Foundation and other stakeholders. (ii) To identify available evidence, and clusters of evidence, including its quality rating. This will involve activities such as identification of studies using a standardised study search strategy, screening and coding of studies in EPPI Reviewer 4, which is a web-based software program for production of reviews. (iii) To create a map of youth employment effectiveness studies equipped with an appealing user-friendly web-based search content visualisation using interactive mapping software. To achieve this object, data coded in EPPI Reviewer 4 will be exported to another software (EPPI mapper) which is designed for generating EGMs. (iv) To produce a narrative report of the youth employment EGM. This will be achieved through analysis of data in EPPI Reviewer 4 and report writing. To disseminate the EGM to users to increase awareness to support evidence-informed decision-making across countries. We will achieve this objective by organising dissemination workshops, participating in conferences and hosting the evidence and gap on our websites.

PROTOCOL: Residential energy efficiency interventions: An effectiveness systematic review.

This review aims to identify, appraise and synthesise the evidence available on the effectiveness of energy efficiency measure installations, including those bundled with behavioural interventions. The synthesis will estimate the overall impact of these interventions as well as examine possible causes of variation in impacts. We will also attempt to assess the cost-effectiveness of residential energy efficiency interventions.

Studies of the effectiveness of transport sector interventions in low- and middle-income countries: An evidence and gap map.

Background: There are great disparities in the quantity and quality of infrastructure. European countries such as Denmark, Germany, Switzerland, and the UK have close to 200 km of road per 100 km2, and the Netherlands over 300 km per 100 km2. By contrast, Kenya and Indonesia have <30, Laos and Morocco <20, Tanzania and Bolivia <10, and Mauritania only 1 km per 100 km2. As these figures show, there is a significant backlog of transport infrastructure investment in both rural and urban areas, especially in sub-Saharan Africa. This situation is often exacerbated by weak governance and an inadequate regulatory framework with poor enforcement which lead to high costs and defective construction.The wellbeing of many poor people is constrained by lack of transport, which is called "transport poverty". Lucas et al. suggest that up to 90% of the world's population are transport poor when defined as meeting at least one of the following criteria: (1) lack of available suitable transport, (2) lack of transport to necessary destinations, (3) cost of necessary transport puts household below the income poverty line, (4) excessive travel time, or (5) unsafe or unhealthy travel conditions. Objectives: The aim of this evidence and gap map (EGM) is to identify, map, and describe existing evidence from studies reporting the quantitative effects of transport sector interventions related to all means of transport (roads, rail, trams and monorail, ports, shipping, and inland waterways, and air transport). Methods: The intervention framework of this EGM reframes Berg et al's three categories (infrastructure, prices, and regulations) broadly as infrastructure, incentives, and institutions as subcategories for each intervention category which are each mode of transport (road, rail trams and monorail, ports, shipping, and inlands waterways, and air transport). This EGM identifies the area where intervention studies have been conducted as well as the current gaps in the evidence base.This EGM includes ongoing and completed impact evaluations and systematic reviews (SRs) of the effectiveness of transport sector interventions. This is a map of effectiveness studies (impact evaluations). The impact evaluations include experimental designs, nonexperimental designs, and regression designs. We have not included the before versus after studies and qualitative studies in this map. The search strategies included both academic and grey literature search on organisational websites, bibliographic searches and hand search of journals.An EGM is a table or matrix which provides a visual presentation of the evidence in a particular sector or a subsector. The map is presented as a matrix in which rows are intervention categories (e.g., roads) and subcategories (e.g., infrastructure) and the column outcome domains (e.g., environment) and subcategories as (e.g., air quality). Each cell contains studies of the corresponding intervention for the relevant outcome, with links to the available studies. Included studies were coded according to the intervention and outcomes assessed and additional filters as region, population, and study design. Critical appraisal of included SR was done using A Measurement Tool to Assess Systematic Reviews (AMSTAR -2) rating scale. Selection Criteria: The search included both academic and grey literature available online. We included impact evaluations and SRs that assessed the effectiveness of transport sector interventions in low- and middle-income countries. Results: This EGM on the transport sector includes 466 studies from low- and middle-income countries, of which 34 are SRs and 432 impact evaluations. There are many studies of the effects of roads intervention in all three subcategories-infrastructure, incentives, and institutions, with the most studies in the infrastructure subcategories. There are no or fewer studies on the interventions category ports, shipping, and waterways and for civil aviation (Air Transport).In the outcomes, the evidence is most concentrated on transport infrastructure, services, and use, with the greatest concentration of evidence on transport time and cost (193 studies) and transport modality (160 studies). There is also a concentration of evidence on economic development and health and education outcomes. There are 139 studies on economic development, 90 studies on household income and poverty, and 101 studies on health outcomes.The major gaps in evidence are from all sectors except roads in the intervention. And there is a lack of evidence on outcome categories such as cultural heritage and cultural diversity and very little evidence on displacement (three studies), noise pollution (four studies), and transport equity (2). There is a moderate amount of evidence on infrastructure quantity (32 studies), location, land use and prices (49 studies), market access (29 studies), access to education facilities (23 studies), air quality (50 studies), and cost analysis including ex post CBA (21 studies).The evidence is mostly from East Asia and the Pacific Region (223 studies (40%), then the evidence is from the sub-Saharan Africa (108 studies), South Asia (96 studies), Latin America & Caribbean (79 studies). The least evidence is from Middle East & North Africa (30 studies) and Europe & Central Asia (20 studies). The most used study design is other regression design in all regions, with largest number from East Asia and Pacific (274). There is total 33 completed SRs identified and one ongoing, around 85% of the SR are rated low confidence, and 12% rated as medium confidence. Only one review was rated as high confidence. This EGM contains the available evidence in English. Conclusion: This map shows the available evidence and gaps on the effectiveness of transport sector intervention in low- and middle-income countries. The evidence is highly concentrated on the outcome of transport infrastructure (especially roads), service, and use (351 studies). It is also concentrated in a specific region-East Asia and Pacific (223 studies)-and more urban populations (261 studies). Sectors with great development potential, such as waterways, are under-examined reflecting also under-investment.The available evidence can guide the policymakers, and government-related to transport sector intervention and its effects on many outcomes across sectors. There is a need to conduct experimental studies and quality SRs in this area. Environment, gender equity, culture, and education in low- and middle-income countries are under-researched areas in the transport sector.

PROTOCOL: Aquaculture for improving productivity, income, nutrition and women's empowerment in low- and middle-income countries: A systematic review and meta-analysis.

The review aims to examine and synthesise the state of the evidence around what works to improve productivity, income, nutrition and women's empowerment outcomes of households involved in aquaculture in low- and middle-income countries. We are particularly interested in addressing the following research questions: (1) Do aquaculture interventions increase the productivity, income, nutrition and empowerment of individuals engaged in aquaculture and their households in low- and middle-income countries? (2) Do aquaculture interventions generate income and nutrition spillover effects beyond the farmers' households? (3) To what extent do the effects of aquaculture interventions vary by intervention type, population group, and location? In particular, to what extent do effects vary by gender? (4) What are the potential barriers and facilitating factors that impact the effectiveness of aquaculture interventions? (5) What is the cost-effectiveness of different aquaculture interventions focused on productivity, income, nutrition and empowerment outcomes?

Aquaculture for improving productivity, income, nutrition and women's empowerment in low- and middle-income countries: A systematic review and meta-analysis.

Background: A steady increase in the international production and consumption of fish has positioned aquaculture as a development option. Previous literature has highlighted the potential of aquaculture to improve economic, nutritional and gender equality outcomes, however, the evidence on the effectiveness of these programmes remains unclear. Objectives: The review assessed whether aquaculture interventions increase the productivity, income, nutrition, and women's empowerment of individuals. We additionally aimed to identify barriers and facilitators that could affect the effectiveness of these interventions, and the cost-effectiveness of such programmes. Methods: We searched for experimental and quasi-experimental studies focused on low- and middle-income countries. We used standard methodological procedures expected by The Campbell Collaboration for the data collection and analysis. Results: We identified 21 impact evaluations assessing the effect of 13 aquaculture interventions in low- and lower-middle income countries. Twelve of these studies have a high risk of bias. Aquaculture interventions lead to a small increase in the production value, income, total expenditures and food consumption of participants. The limited availability of evidence prevented us from assessing other nutritional and women's empowerment outcomes. We identified barriers and facilitators affecting the programmes' set up, the participation of beneficiaries, and the level of productive activities. Insufficient cost data hindered full comparisons across programmes. Conclusions: The review suggests a lack of rigorous evidence assessing the effectiveness of aquaculture programmes. Future research could focus on evaluating nutrition and women's empowerment impacts, promoting reporting standards, and the use of cost data to continue building quality evidence around aquaculture interventions.

PROTOCOL: Strengthening women's empowerment and gender equality in fragile contexts towards peaceful and inclusive societies: A systematic review and meta-analysis.

This review builds on 3ie's (international initiative for impact evaluation) evidence gap map (EGM) of the impact evaluation and systematic review (SR) evidence base of interventions aiming to promote peaceful and inclusive societies in fragile contexts. The EGM identified a cluster of studies evaluating gender equality-focused behaviour change communication programmes and raised interest in investigating the evidence base for understanding the role of women more broadly as agents of change in developing peaceful and inclusive societies. Building on the cluster of evidence identified in the EGM, our review will increase generalisability of findings from single studies and focus on interventions across a broad range of geographical locations, settings and populations, types of implementations and outcomes. We will also address (when possible) the identified gaps in literature regarding metaanalysis in conflict-affected contexts. As such, we propose the following objectives: (1) The primary objective of this review is to identify, assess and synthesise evidence on the effect of gender specific and gender transformative interventions within the context of the four pillars of United Nations Security Council Resolution (UNSCR) 1325 on women's empowerment and gender equality in Fragile and Conflict Affected States/Situations (FCAS). The SR will facilitate the use of evidence in informing policy and practice decisions within the field of transition aid, particularly as it relates to gender focused programming. (2) Our second objective is to assess how these interventions contribute to inclusive and sustainable peace in conflict affected situations. We will compare the effectiveness of these different types of interventions through the lenses of their ecological level, types of impact on women's empowerment, local context of gender inequality and conflict. To achieve these objectives we aim to answer the following questions: (1) What are the impacts of gender transformative and specific interventions on women's empowerment and gender equality in FCAS? (2) What are the effects of these interventions on sustainable peace? (3) To what extent do effects vary by population group, ecological level and types of interventions? (4) What are contextual barriers to and facilitators of intervention effectiveness?

Institutionalizing research capacity strengthening in LMICs: A systematic review and meta-synthesis.

Background: Evidence on effective strategies to ensure sustainability of research capacity strengthening interventions in low- and middle-income country (LMIC) institutions is lacking. This systematic review identified publications describing research capacity building programs and noted their effect, their contexts, and the mechanisms, processes and social actors employed in them. Methods: We searched online databases for the period 2011-2018. Inclusion criteria were that the publications 1) described the intervention; 2) were implemented in LMICs; 3) were based in, or relevant to, university staff or post docs; 4) aimed to improve research capacity; 5) aimed to effect change at the institutional level. Two reviewers screened titles, abstracts and full text in consecutive rounds, a third resolved disagreements. Two people extracted the data of each full text using a data extraction tool covering data relevant to our question. Results: In total 4052 citations were identified and 19 papers were included, which referred to 14 interventions. Only three interventions mentioned using a conceptual framework to develop their approach and none described using a theory of change to assess outcomes. The most frequent inputs described were some method of formal training, promotion of a research-conducive environment and establishment of research support systems. A range of outcomes were reported, most frequently an increased number of publications and proportion of staff with PhDs. When factors of success were discussed, this was attributed to a rigorous approach to implementation, adequate funding, and local buy-in. Those who mentioned sustainability linked it to availability of funds and local buy-in. The lack of a common lexicon and a framework against which to report outcomes made comparison between initiatives difficult. Conclusions: The reduced number of interventions that met the inclusion criteria suggests that programs should be well-described, evaluated systematically, and findings published so that the research capacity strengthening community can extract important lessons.

Incentives for climate mitigation in the land use sector-the effects of payment for environmental services on environmental and socioeconomic outcomes in low- and middle-income countries: A mixed-methods systematic review.

Unsustainable practices in the land use sector contribute to climate change through the release of greenhouse gases. Payment for environmental services (PESs) provide economic incentives to reduce the negative environmental impacts of land use and are a popular approach to mitigate climate change in low- and middle-income countries. Some PES programmes also aim to improve socioeconomic outcomes and reduce poverty. This systematic review examines the effect of programmes on environmental and socioeconomic outcomes. We identified 44 quantitative impact evaluations and 60 qualitative studies of PES programmes for inclusion in the review, to assess both the effects of PES and identify context, design and implementation features that may influence PES effectiveness. The studies covered 18 programmes from 12 countries in Latin America and the Caribbean, East Asia and Pacific, South Asia and Sub-Saharan Africa. The review finds that PES may increase household income, reduce deforestation and improve forest cover, but the findings are, however, based on low and very low quality evidence from a small number of programmes and should be treated with caution. Qualitative evidence indicates that several factors influence whether PES programmes are likely to be effective in different contexts and suggests that the inclusion of strong governance structures and the effective targeting of both locations and participants may improve intervention effectiveness. Funders, implementing agencies and researchers should collaborate to develop a coordinated programme of rigorous, mixed-methods impact evaluation implemented across contexts. Until such evidence is available, PES programmes remain a high-risk strategy for climate change mitigation.