Comparison of national surveillance systems for Lyme disease in humans in Europe and North America: a policy review.

BACKGROUND: Lyme disease incidence is increasing in Europe, the USA, and Canada. In 2010, a comparison of surveillance systems for Lyme disease (LD) in humans in 28 European countries showed that systems highly varied, making epidemiological comparisons difficult. Details by country were not published. In 2018, one of LD clinical manifestations, neuroborreliosis, was added under European Union (EU) surveillance to standardise definitions. In this study, we identified and compared, 10 years after the European inventory, the characteristics of national surveillance systems and policies for LD in humans, with additional countries. METHODS: Thirty-four European and North American countries were included. Information on national "traditional" systems (which compile data reported by clinicians and laboratories) and "public participatory" websites and mobile applications (which collect information directly from the public) were searched in MEDLINE, a systematic evidence map, and Google. An existing framework on LD surveillance was adapted to capture information on the administration level, indicators, reporting entities, coverage, and obligation to report. RESULTS: A surveillance system was found for 29 (85%) countries. Twenty-four had a traditional system alone, one had a public participatory system alone, and the remaining had both. Among countries with traditional systems, 23 (82%) administered them at the national level. Nineteen (68%) required mandatory reporting. Sixteen (57%) used both clinicians and laboratories as reporting entities. Eighteen (64%) employed case definitions, most of which considered both neuroborreliosis and erythema migrans (n = 14). Others monitored the number of positive laboratory tests and/or patient consultations. Public participatory systems were only implemented in countries employing either also sentinels or voluntary surveys, or no traditional system, suggesting their use as a complementary tool. Only 56% of EU countries had neuroborreliosis as an indicator. CONCLUSION: The situation remains similar to 2010 with persisting heterogeneity between systems, suggesting that countries prioritise different surveillance objectives for LD. Without a common indicator in Europe, it is difficult to get a clear epidemiological picture. We discuss four factors that potentially influence LD surveillance strategies: perceptions of severity, burden on resources, two-way communication, and the medical conflicts about LD. Addressing these with countries might help moving towards the adoption of common practices.

Use and value of systematic reviews in English local authority public health: a qualitative study.

BACKGROUND: Responsibility for public health in England transferred from the National Health Service to local authorities in 2013, representing a different decision-making environment. Systematic reviews are considered the gold standard of evidence for clinical decision-making but little is known about their use in local government public health. This study aimed to explore the extent to which public health decision-makers in local authorities engage with systematic reviews and how they do so. METHODS: Semi-structured interviews were conducted with senior public health practitioners (n = 14) in Yorkshire and the Humber local authorities. Sampling was purposive and involved contacting Directors of Public Health directly and snowballing through key contacts. Face-to-face or telephone interviews were digitally recorded, transcribed verbatim and analysed using the Framework Method. RESULTS: Public health practitioners described using systematic reviews directly in decision-making and engaging with them more widely in a range of ways, often through a personal commitment to professional development. They saw themselves as having a role to advocate for the use of rigorous evidence, including systematic reviews, in the wider local authority. Systematic reviews were highly valued in principle and public health practitioners had relevant skills to find and appraise them. However, the extent of use varied by individual and local authority and was limited by the complexity of decision-making and various barriers. Barriers included that there were a limited number of systematic reviews available on certain public health topics, such as the wider determinants of health, and that the narrow focus of reviews was not reflective of complex public health decisions facing local authorities. Reviews were used alongside a range of other evidence types, including grey literature. The source of evidence was often considered an indicator of quality, with specific organisations, such as Public Health England, NICE and Cochrane, particularly trusted. CONCLUSIONS: Research use varies and should be considered within the specific decision-making and political context. There is a need for systematic reviews to be more reflective of the decisions facing local authority public health teams.

Interventions to support people exposed to adverse childhood experiences: systematic review of systematic reviews.

BACKGROUND: Adverse Childhood Experiences (ACEs) such as abuse, neglect or household adversity may have a range of serious negative impacts. There is a need to understand what interventions are effective to improve outcomes for people who have experienced ACEs. METHODS: Systematic review of systematic reviews. We searched 18 database sources from 2007 to 2018 for systematic reviews of effectiveness data on people who experienced ACEs aged 3-18, on any intervention and any outcome except incidence of ACEs. We included reviews with a summary quality score (AMSTAR) of 5.5 or above. RESULTS: Twenty-five reviews were included. Most reviews focus on psychological interventions and mental health outcomes. The strongest evidence is for cognitive-behavioural therapy for people exposed to abuse. For other interventions - including psychological therapies, parent training, and broader support interventions - the findings overall are inconclusive, although there are some positive results. CONCLUSIONS: There are significant gaps in the evidence on interventions for ACEs. Most approaches focus on mitigating individual psychological harms, and do not address the social pathways which may mediate the negative impacts of ACEs. Many negative impacts of ACEs (e.g. on health behaviours, social relationships and life circumstances) have also not been widely addressed by intervention studies.

Understanding the unintended consequences of public health policies: the views of policymakers and evaluators.

BACKGROUND: Public health policies sometimes have unexpected effects. Understanding how policies and interventions lead to outcomes is essential if policymakers and researchers are to intervene effectively and reduce harmful and other unintended consequences (UCs) of their actions. Yet, evaluating complex mechanisms and outcomes is challenging, even before considering how to predict assess and understand outcomes and UCs when interventions are scaled up. We aimed to explore with UK policymakers why some policies have UCs, and how researchers and policymakers should respond. METHODS: We convened a one-day workshop with 14 people involved in developing, implementing or evaluating social and public health policies, and/or evaluating possible unintended effects. This included senior evaluators, policymakers from government and associated agencies, and researchers, covering policy domains from public health, social policy, poverty, and international development. RESULTS: Policymakers suggested UCs happen for a range of reasons: poor policy design, unclear articulation of policy mechanisms or goals, or unclear or inappropriate evidence use, including evaluation techniques. While not always avoidable, it was felt that UCs could be partially mitigated by better use of theory and evidence, better involvement of stakeholders in concurrent design and evaluation of policies, and appropriate evaluation systems. CONCLUSIONS: UCs can be used to explore the mechanisms underpinning social change caused by public health policies. Articulating these mechanisms is essential for truly evidence-informed decision-making, to enable informed debate about policy options, and to develop evaluation techniques. Future work includes trying to develop a holistic stakeholder-led evaluation process.

Seasonal influenza vaccination of healthcare workers: systematic review of qualitative evidence.

BACKGROUND: Most countries recommend that healthcare workers (HCWs) are vaccinated seasonally against influenza in order to protect themselves and patients. However, in many cases coverage remains low. A range of strategies have been implemented to increase uptake. Qualitative evidence can help in understanding the context of interventions, including why interventions may fail to achieve the desired effect. This study aimed to synthesise evidence on HCWs' perceptions and experiences of vaccination for seasonal influenza. METHODS: Systematic review of qualitative evidence. We searched MEDLINE, EMBASE and CINAHL and included English-language studies which reported substantive qualitative data on the vaccination of HCWs for seasonal influenza. Findings were synthesised thematically. RESULTS: Twenty-five studies were included in the review. HCWs may be motivated to accept vaccination to protect themselves and their patients against infection. However, a range of beliefs may act as barriers to vaccine uptake, including concerns about side-effects, scepticism about vaccine effectiveness, and the belief that influenza is not a serious illness. HCWs value their autonomy and professional responsibility in making decisions about vaccination. The implementation of interventions to promote vaccination uptake may face barriers both from HCWs' personal beliefs and from the relationships between management and employees within the targeted organisations. CONCLUSIONS: HCWs' vaccination behaviour needs to be understood in the context of HCWs' relationships with each other, with management and with patients. Interventions to promote vaccination should take into account both the individual beliefs of targeted HCWs and the organisational context within which they are implemented.

Evaluating the effect of HIV prevention strategies on uptake of HIV counselling and testing among male most-at-risk-populations in Nigeria; a cross-sectional analysis.

OBJECTIVE: The aim of this study was to evaluate the effects of three strategies in increasing uptake of HIV counselling and testing (HCT) among male most-at-risk-population (M-MARPs) using programmatic data. DESIGN: HIV prevention strategies were evaluated in a cross-sectional analysis. METHODS: Three HCT strategies were implemented between July 2009 and July 2012 among men who have sex with men (MSM) and people who inject drugs (PWIDs) in four states in Nigeria. The first strategy (S1), involved key opinion leaders (KOLs) who referred M-MARPs to health facilities for HCT. The second strategy (S2) involved KOLs referring M-MARPs to nearby mobile HCT teams while the third (S3) involved mobile M-MARPs peers conducting the HCT. χ(2) statistics were used to test for differences in the distribution of categorical variables across groups while logistic regression was used to measure the effect of the different strategies while controlling for confounding factors. RESULTS: A total of 1988, 14 726 and 14 895 M-MARPs were offered HCT through S1, S2 and S3 strategies, respectively. Overall, S3 (13%) identified the highest proportion of HIV-positive M-MARPs compared with S1 (9%) and S2 (3%), p≤0.001. Also S3 (13%) identified the highest proportion of new HIV diagnosis compared with S1 (8%) and S2 (3%), respectively, p≤0.001. When controlled for age, marital status and occupation, MSM reached via S3 were 9 times (AOR: 9.21; 95% CI 5.57 to 15.23) more likely to uptake HCT when compared with S1 while PWIDs were 21 times (AOR: 20.90; 95% CI 17.33 to 25.21) more likely to uptake to HCT compared with those reached via S1. CONCLUSIONS: Peer-led HCT delivered by S3 had the highest impact on the total number of M-MARPs reached and in identifying HIV-positive M-MARPs and new testers. Training M-MARPs peers to provide HCT is a high impact approach in delivering HCT to M-MARPs.

The social ecology of girls' bullying practices: exploratory research in two London schools.

This exploratory study adopts a socio-ecological approach to examine the context of school bullying. It asks: (1) what are students' accounts of bullying practices?; (2) how are these enabled and constrained by the school-environment?; (3) how is gender implicated? Qualitative data were collected from girls in two schools in London via focus groups (one in each school; students aged 12-15) and seven semi-structured interviews (in one school; students aged 16-18); and from school policy documents. Our interpretation of girls' accounts, informed by Giddens' structuration theory, suggests that bullying practices were spatially patterned in the schools and often characterised by the regulation of girls' sexuality and sexual-harassment. Repeated acts of aggression were fluid with regard to the bully and victim role, challenging the dominant view of bullying as characterised by consistent disparities in power between individuals. Schools structured bullying behaviour via policies and practices that ignored these forms of abuse and which focused on and may have been complicit in the making of stable 'bully' and 'victim' roles, thus indirectly contributing to the reproduction of unhealthy relationships between students. In terms of gender, traditional gendered and sexual discourses appear to structure the identities of the schools and girls in our study.

A qualitative study into the development of a physical activity legacy from the London 2012 Olympic Games.

Olympic Games have sometimes been considered as public health interventions capable of improving population health by encouraging increased physical activity levels. However, the evidence base does not appear to support this and is of poor quality, focussing on population level outcomes, usually related only to participation in organised sports. A new approach to research into the effects of such events is required focussing on the processes and mechanisms by which population physical activity levels might be increased enabling more effective use of such events in the future. Two separate processes, the 'demonstration effect' and 'festival effect,' have been proposed in Government guidance and are explored using qualitative methods in eight inactive people and four physical activity promotion specialists in Brighton & Hove. The findings appear to support the idea that watching elite athletes compete is unlikely to inspire participation among inactive people and may even discourage it by reducing self-efficacy as a result of the perceived competence gap. Despite this, positive attitudes towards the London Olympics were observed among inactive members of the public and a desire to become actively involved in the event. Examples of intention to continue participating in community events and physical activities as a result of positive experiences of Olympic related events were also observed.

Cultures of evidence across policy sectors: systematic review of qualitative evidence.

BACKGROUND: It is important to understand the decision-making process, and the role of research evidence within it, across sectors other than health, as interventions delivered within these sectors may have substantial impacts on public health and health inequalities. METHODS: Systematic review of qualitative evidence. Twenty-eight databases covering a range of sectors were searched. Studies were eligible if they included local decision-makers in a policy field relevant to the social determinants of health (including housing, transport, urban planning and regeneration, crime, licensing or trading standards), were conducted in a high-income country, and reported primary qualitative data on perceptions of research evidence. Study quality was assessed and a thematic synthesis undertaken. RESULTS: Sixteen studies were included, most using interview designs, and most focusing on planning or transport policy. Several factors are seen to influence decision-makers' views of evidence, including practical factors such as resources or organizational support; the credibility of the evidence; its relevance or applicability to practice; considerations of political support or feasibility; and legislative constraints. There are limited data on how evidence is used: it is sometimes used to not only support decision-making, but also to lend legitimacy to decisions that have already been made. CONCLUSION: Although cultures of evidence in non-health sectors are similar to those in health in some ways, there are some key differences, particularly as regards the political context of decision-making. Intersectoral public health research could benefit from taking into account non-health decision makers' needs and preferences, particularly around relevance and political feasibility.

A systematic review of barriers to and facilitators of the use of evidence by policymakers.

BACKGROUND: The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review. METHODS: Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population. RESULTS: 145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage. CONCLUSIONS: Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

New directions in evidence-based policy research: a critical analysis of the literature.

Despite 40 years of research into evidence-based policy (EBP) and a continued drive from both policymakers and researchers to increase research uptake in policy, barriers to the use of evidence are persistently identified in the literature. However, it is not clear what explains this persistence - whether they represent real factors, or if they are artefacts of approaches used to study EBP. Based on an updated review, this paper analyses this literature to explain persistent barriers and facilitators. We critically describe the literature in terms of its theoretical underpinnings, definitions of 'evidence', methods, and underlying assumptions of research in the field, and aim to illuminate the EBP discourse by comparison with approaches from other fields. Much of the research in this area is theoretically naive, focusing primarily on the uptake of research evidence as opposed to evidence defined more broadly, and privileging academics' research priorities over those of policymakers. Little empirical data analysing the processes or impact of evidence use in policy is available to inform researchers or decision-makers. EBP research often assumes that policymakers do not use evidence and that more evidence - meaning research evidence - use would benefit policymakers and populations. We argue that these assumptions are unsupported, biasing much of EBP research. The agenda of 'getting evidence into policy' has side-lined the empirical description and analysis of how research and policy actually interact in vivo. Rather than asking how research evidence can be made more influential, academics should aim to understand what influences and constitutes policy, and produce more critically and theoretically informed studies of decision-making. We question the main assumptions made by EBP researchers, explore the implications of doing so, and propose new directions for EBP research, and health policy.

Communicating cardiovascular risk: Systematic review of qualitative evidence.

INTRODUCTION: Cardiovascular risk prediction models are widely used to help individuals understand risk and make decisions. METHODS: Systematic review of qualitative evidence. We searched MEDLINE, Embase, PsycINFO and CINAHL. We included English-language qualitative studies on the communication of cardiovascular risk. We assessed study quality using Hawker et al.'s tool and synthesised data thematically. RESULTS: Thirty-seven studies were included. Many patients think that risk scores are of limited practical value. Other sources of information feed into informal estimates of risk, which may lead patients to reject the results of clinical risk assessment when the two conflict. Clinicians identify a number of barriers to risk communication, including patients' limited understanding of risk and excessive anxiety. They use a range of strategies for adapting risk communication. Both clinicians and individuals express specific preferences for risk communication formats. DISCUSSION: Ways of communicating risk that provide some comparison or reference point seem more promising. The broader context of communication around risk may be more important than the risk scoring instrument. Risk communication interventions, in practice, may be more about appeals to emotion than a rationalistic model of decision-making.

Population-level interventions to reduce alcohol-related harm: an overview of systematic reviews.

OBJECTIVE: To analyse available review-level evidence on the effectiveness of population-level interventions in non-clinical settings to reduce alcohol consumption or related health or social harm. METHOD: Health, social policy and specialist review databases between 2002 and 2012 were searched for systematic reviews of the effectiveness of population-level alcohol interventions on consumption or alcohol-related health or social outcomes. Data were extracted on review research aim, inclusion criteria, outcome indicators, results, conclusions and limitations. Reviews were quality-assessed using AMSTAR criteria. A narrative synthesis was conducted overall and by policy area. RESULTS: Fifty-two reviews were included from ten policy areas. There is good evidence for policies and interventions to limit alcohol sale availability, to reduce drink-driving, to increase alcohol price or taxation. There is mixed evidence for family- and community-level interventions, school-based interventions, and interventions in the alcohol server setting and the mass media. There is weak evidence for workplace interventions and for interventions targeting illicit alcohol sales. There is evidence of the ineffectiveness of interventions in higher education settings. CONCLUSION: There is a pattern of support from the evidence base for regulatory or statutory enforcement interventions over local non-regulatory approaches targeting specific population groups.

Fear of crime and the environment: systematic review of UK qualitative evidence.

BACKGROUND: The fear of crime may have negative consequences for health and wellbeing. It is influenced by factors in the physical and social environment. This study aimed to review and synthesize qualitative evidence from the UK on fear of crime and the environment. METHODS: Eighteen databases were searched, including crime, health and social science databases. Qualitative studies conducted in the UK which presented data on fear of crime and the environment were included. Quality was assessed using Hawker et al.'s framework. Data were synthesized thematically. RESULTS: A total of 40 studies were included in the review. Several factors in the physical environment are perceived to impact on fear of crime, including visibility and signs of neglect. However, factors in the local social environment appear to be more important as drivers of fear of crime, including social networks and familiarity. Broader social factors appear to be of limited relevance. There is considerable evidence for limitations on physical activity as a result of fear of crime, but less for mental health impacts. CONCLUSIONS: Fear of crime represents a complex set of responses to the environment. It may play a role in mediating environmental impacts on health and wellbeing.

Resource provision and environmental change for the prevention of skin cancer: systematic review of qualitative evidence from high-income countries.

This paper presents the findings of a systematic review of qualitative studies from high-income (OECD) countries relating to sun protection and skin cancer, with a focus on barriers and facilitators for the following interventions: resource provision; environmental change; and multi-component interventions. Twenty-three study reports were included in the review. Data were analysed using a thematic analysis methodology with the Health Belief Model as a framework. The risk and potential severity of skin cancer are not seen as important concerns, and tanning which is not deliberate is seen as less dangerous. There are a number of social and practical barriers to the use of sun protection resources, including cost, inconvenience and social norms. There are important differences between age groups and between men and women in attitudes.

Can Peer-based Interventions Improve Adolescent Sexual and Reproductive Health Outcomes? An Overview of Reviews.

PURPOSE: An overview of reviews was conducted to summarize the evidence and synthesize the results from systematic reviews. METHODS: The Cochrane and Preferred Reporting Items for Overviews of Reviews reporting guidelines were followed and the protocol was registered. Electronic and manual searches were conducted to identify systematic reviews, published between January 1990 and July 2022. Studies with outcomes relating to all areas of adolescent sexual and reproductive health (SRH) (changes in knowledge, attitudes, beliefs, skills, and practices) were considered. The ROBIS (Risk of Bias in Systematic Reviews) tool was used to assess quality. RESULTS: A total 1849 articles were retrieved, and eight reviews met the inclusion criteria. Three of the eight reviews included meta-analyses. All three of these reviews demonstrated a significant improvement in HIV knowledge. One reported improved attitudes toward people living with HIV but none found any statistically significant effect on condom use or other SRH behaviors. The remaining five reviews included reports of positive individual study outcomes related to knowledge and attitudes and provided narrative syntheses with regard to recruitment, training, support, and participation of peers. Five of the eight reviews were judged to have a low risk of bias. DISCUSSION: Our overview demonstrates that peer-based interventions can improve SRH knowledge and attitudes. Evidence of their effectiveness in promoting healthier SRH behaviors is less certain. Any future studies need to investigate which adolescent health outcomes peer-based programs could reasonably be expected to improve using robust methodologies. Additionally, peers need to be meaningfully engaged and acknowledged as experience-based experts.

Promoting the uptake of HIV testing among men who have sex with men: systematic review of effectiveness and cost-effectiveness.

What interventions are effective and cost-effective in increasing the uptake of HIV testing among men who have sex with men (MSM)? A systematic review was conducted of the following databases: AEGIS, ASSIA, BL Direct, BNI, Centre for Reviews and Dissemination, Cochrane Database of Systematic Reviews, CINAHL, Current Contents Connect, EconLit, EMBASE, ERIC, HMIC, Medline, Medline In-Process, NRR, PsychINFO, Scopus, SIGLE, Social Policy and Practice, Web of Science, websites, journal hand-searching, citation chasing and expert recommendations. Prospective studies of the effectiveness or cost-effectiveness of interventions (randomised controlled trial (RCT), controlled trial, one-group or any economic analysis) were included if the intervention aimed to increase the uptake of HIV testing among MSM in a high-income (Organization for Economic Co-operation and Development) country. Quality was assessed and data were extracted using standardised tools. Results were synthesised narratively. Twelve effectiveness studies and one cost-effectiveness study were located, covering a range of intervention types. There is evidence that rapid testing and counselling in community settings (one RCT), and intensive peer counselling (one RCT), can increase the uptake of HIV testing among MSM. There are promising results regarding the introduction of opt-out testing in sexually transmitted infection clinics (two one-group studies). Findings regarding other interventions, including bundling HIV tests with other tests, peer outreach in community settings, and media campaigns, are inconclusive. Findings indicate several promising approaches to increasing HIV testing among MSM. However, there is limited evidence overall, and evidence for the effectiveness of key intervention types (particularly peer outreach and media campaigns) remains lacking.

HIV testing among men who have sex with men (MSM): systematic review of qualitative evidence.

We conducted a systematic review of qualitative evidence relating to the views and attitudes of men who have sex with men (MSM) concerning testing for HIV. Studies conducted in high-income countries (Organisation for Economic Co-operation and Development members) since 1996 were included. Seventeen studies were identified, most of gay or bisexual men. Data were analysed using a thematic analysis methodology. The uncertainty of unknown HIV status is an important motive for testing; however, denial is also a common response to uncertainty. Fear of the consequences of a positive HIV test is widespread and may take several forms. A sense of responsibility towards oneself or one's partner may be a motive for testing. The perception of stigma, from other gay men or from the wider culture, is a barrier to testing. Gay and other MSM have clear preferences regarding testing services, particularly for those that are community based, include non-judgemental and gay-positive service providers, and offer a high degree of confidentiality.

What you see depends on where you sit: The effect of geographical location on web-searching for systematic reviews: A case study.

There is limited guidance on how to web-search in systematic reviews and concern relates to the reproducibility of searches using search engines such as Google. The aim of this paper is to address one potential source of variation in Google searches: does the geographical location of a researcher affect Google search returns? Using a virtual private network, we ran the same web-search for the medical technology Dasatinib in 12 different countries. Two researchers independently extracted the search returns by country organised by page rank. We compared: C1. any difference in the items returned by Google searches between countries and C2. any difference in the page rank of items returned between countries. Searches were undertaken on Monday September 28th 2020. From 12 countries, 43 items were identified. For C1: 19 items were common to all 12 countries. Twenty-four items were missed by searches in some countries. This means that there were differences in search returns between countries. For C2: a randomised trial reported by Raddich et al was the first search return for all countries. All other items, common to all countries, varied in their page-rank. We find that geographic location would appear to influence Google search returns based on the findings of this case study. The findings suggest that recording the location of the researcher undertaking web-searching may now be an important factor to report alongside detail on steps taken to minimise personalisation of web-searches covered by recent guidance. This finding also has implications for stopping-rules.

Cost-effectiveness of Microsoft Academic Graph with machine learning for automated study identification in a living map of coronavirus disease 2019 (COVID-19) research.

Background: Identifying new, eligible studies for integration into living systematic reviews and maps usually relies on conventional Boolean updating searches of multiple databases and manual processing of the updated results. Automated searches of one, comprehensive, continuously updated source, with adjunctive machine learning, could enable more efficient searching, selection and prioritisation workflows for updating (living) reviews and maps, though research is needed to establish this. Microsoft Academic Graph (MAG) is a potentially comprehensive single source which also contains metadata that can be used in machine learning to help efficiently identify eligible studies. This study sought to establish whether: (a) MAG was a sufficiently sensitive single source to maintain our living map of COVID-19 research; and (b) eligible records could be identified with an acceptably high level of specificity. Methods: We conducted an eight-arm cost-effectiveness analysis to assess the costs, recall and precision of semi-automated workflows, incorporating MAG with adjunctive machine learning, for continually updating our living map. Resource use data (time use) were collected from information specialists and other researchers involved in map production. Our systematic review software, EPPI-Reviewer, was adapted to incorporate MAG and associated machine learning workflows, and also used to collect data on recall, precision, and manual screening workload. Results: The semi-automated MAG-enabled workflow dominated conventional workflows in both the base case and sensitivity analyses. At one month our MAG-enabled workflow with machine learning, active learning and fixed screening targets identified 469 additional, eligible articles for inclusion in our living map, and cost £3,179 GBP per week less, compared with conventional methods relying on Boolean searches of Medline and Embase. Conclusions: We were able to increase recall and coverage of a large living map, whilst reducing its production costs. This finding is likely to be transferrable to OpenAlex, MAG's successor database platform.