National strategies for knowledge translation in health policy-making: A scoping review of grey literature.

BACKGROUND AND OBJECTIVES: Without strategic actions in its support, the translation of scientific research evidence into health policy is often absent or delayed. This review systematically maps and assesses national-level strategic documents in the field of knowledge translation (KT) for health policy, and develops a practical template that can support Evidence-informed Policy Network (EVIPNet) Europe countries in producing national strategies for evidence-informed policy-making. METHODS: Websites of organizations with strategic responsibilities in KT were electronically searched, on the basis of pre-defined criteria, in July-August 2017, and an updated search was carried out in April-June 2021. We included national strategies or elements of national strategies that dealt with KT activities, as well as similar strategies of individual institutions with a national policy focus. Two reviewers screened the strategies for inclusion. Data were analysed using qualitative content analysis. RESULTS: A total of 65 unique documents were identified, of which 17 were eligible and analysed for their structure and content. Of the 17, 1 document was a national health KT action plan and 6 documents were institution-level KT strategies. The remaining 10 strategies, which were also included were 2 national health strategies, 5 national health research strategies and 3 national KT strategies (not specific to the field of health alone). In all, 13 structural elements and 7 major themes of health policy KT strategies were identified from the included documents. CONCLUSION: KT in health policy, as emerged from the national strategies that our mapping identified, is based on the production and accessibility of policy-relevant research, its packaging for policy-making and the activities related to knowledge exchange. KT strategies may play different roles in the complex and context-specific process of policy-making. Our findings show that the main ideas of health-specific evidence-informed policy literature appear in these strategies, but their effectiveness depends on the way stakeholders use them. Specific knowledge-brokering institutions and organizational capacity, advocacy about the use of evidence, and close collaboration and co-decision-making with key stakeholders are essential in furthering the policy uptake of research results.

Research evidence communication for policy-makers: a rapid scoping review on frameworks, guidance and tools, and barriers and facilitators.

BACKGROUND: Communication is a multifaceted process, ranging from linear, one-way approaches, such as transmitting a simple message, to continuous exchanges and feedback loops among stakeholders. In particular the COVID-19 pandemic underscored the critical need for timely, effective and credible evidence communication to increase awareness, levels of trust, and evidence uptake in policy and practice. However, whether to improve policy responses in crises or address more commonplace societal challenges, comprehensive guidance on evidence communication to decision-makers in health policies and systems remains limited. Our objective was to identify and systematize the global evidence on frameworks, guidance and tools supporting effective communication of research evidence to facilitate knowledge translation and evidence-informed policy-making processes, while also addressing barriers and facilitators. METHODS: We conducted a rapid scoping review following the Joanna Briggs Manual. Literature searches were performed across eight indexed databases and two sources of grey literature, without language or time restrictions. The methodological quality of included studies was assessed, and a narrative-interpretative synthesis was applied to present the findings. RESULTS: We identified 16 documents presenting either complete frameworks or framework components, including guidance and tools, aimed at supporting evidence communication for policy development. These frameworks outlined strategies, theoretical models, barriers and facilitators, as well as insights into policy-makers' perspectives, communication needs, and preferences. Three primary evidence communication strategies, comprising eleven sub-strategies, emerged: "Health information packaging", "Targeting and tailoring messages to the audience", and "Combined communication strategies". Based on the documented barriers and facilitators at micro, meso and macro levels, critical factors for successful communication of evidence to policy-makers were identified. CONCLUSIONS: Effective communication is indispensable for facilitating knowledge translation and evidence-informed policy-making. Nonetheless gaps persist in frameworks designed to enhance research communication to policy-makers, particularly regarding the effectiveness of multiple communication strategies. To advance in this field, the development of comprehensive frameworks incorporating implementation strategies is warranted. Additionally, barriers and facilitators to implementing effective communication must be recognized and addressed taking diverse contexts into consideration. Registration https://zenodo.org/record/5578550.

An ethical analysis of policy dialogues.

BACKGROUND: A policy dialogue is a tool which promotes evidence-informed policy-making. It involves deliberation about a high-priority issue, informed by a synthesis of the best-available evidence, where potential policy interventions are discussed by stakeholders. We offer an ethical analysis of policy dialogues - an argument about how policy dialogues ought to be conceived and executed - to guide those organizing and participating in policy dialogues. Our analysis focuses on the deliberative dialogues themselves, rather than ethical issues in the broader policy context within which they are situated. METHODS: We conduct a philosophical conceptual analysis of policy dialogues, informed by a formal and an interpretative literature review. RESULTS: We identify the objectives of policy dialogues, and consider the procedural and substantive values that should govern them. As knowledge translation tools, the chief objective of policy dialogues is to ensure that prospective evidence-informed health policies are appropriate for and likely to support evidence-informed decision-making in a particular context. We identify five core characteristics which serve this objective: policy dialogues are (i) focused on a high-priority issue, (ii) evidence-informed, (iii) deliberative, (iv) participatory and (v) action-oriented. In contrast to dominant ethical frameworks for policy-making, we argue that transparency and accountability are not central procedural values for policy dialogues, as they are liable to inhibit the open deliberation that is necessary for successful policy dialogues. Instead, policy dialogues are legitimate insofar as they pursue the objectives and embody the core characteristics identified above. Finally, we argue that good policy dialogues need to actively consider a range of substantive values other than health benefit and equity. CONCLUSIONS: Policy dialogues should recognize the limits of effectiveness as a guiding value for policy-making, and operate with an expansive conception of successful outcomes. We offer a set of questions to support those organizing and participating in policy dialogues.

Factors to Consider During Identification and Invitation of Individuals in a Multi-stakeholder Research Partnership.

BACKGROUND: Health research teams increasingly partner with stakeholders to produce research that is relevant, accessible, and widely used. Previous work has covered stakeholder group identification. OBJECTIVE: We aimed to develop factors for health research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership, with the aim of forming equitable and informed teams. DESIGN: Consensus development. PARTICIPANTS: We involved 16 stakeholders from the international Multi-Stakeholder Engagement (MuSE) Consortium, including patients and the public, providers, payers of health services/purchasers, policy makers, programme managers, peer review editors, and principal investigators. APPROACH: We engaged stakeholders in factor development and as co-authors of this manuscript. Using a modified Delphi approach, we gathered stakeholder views concerning a preliminary list of 18 factors. Over two feedback rounds, using qualitative and quantitative analysis, we concentrated these into ten factors. KEY RESULTS: We present seven highly desirable factors: 'expertise or experience', 'ability and willingness to represent the stakeholder group', 'inclusivity (equity, diversity and intersectionality)', 'communication skills', 'commitment and time capacity', 'financial and non-financial relationships and activities, and conflict of interest', 'training support and funding needs'. Additionally, three factors are desirable: 'influence', 'research relevant values', 'previous stakeholder engagement'. CONCLUSIONS: We present factors for research teams to consider during identification and invitation of individual representatives in a multi-stakeholder research partnership. Policy makers and guideline developers may benefit from considering the factors in stakeholder identification and invitation. Research funders may consider stipulating consideration of the factors in funding applications. We outline how these factors can be implemented and exemplify how their use has the potential to improve the quality and relevancy of health research.

Integrating citizen engagement into evidence-informed health policy-making in eastern Europe and central Asia: scoping study and future research priorities.

BACKGROUND: The perspectives of citizens are an important and often overlooked source of evidence for informing health policy. Despite growing encouragement for its adoption, little is known regarding how citizen engagement may be integrated into evidence-informed health policy-making in low- and middle-income counties (LMICs) and newly democratic states (NDSs). We aimed to identify the factors and variables affecting the potential integration of citizen engagement into evidence-informed health policy-making in LMICs and NDSs and understand whether its implementation may require a different approach outside of high-income western democracies. Further, we assessed the context-specific considerations for the practical implementation of citizen engagement in one focus region-eastern Europe and central Asia. METHODS: First, adopting a scoping review methodology, we conducted and updated searches of six electronic databases, as well as a comprehensive grey literature search, on citizen engagement in LMICs and NDSs, published before December 2019. We extracted insights about the approaches to citizen engagement, as well as implementation considerations (facilitators and barriers) and additional political factors, in developing an analysis framework. Second, we undertook exploratory methods to identify relevant literature on the socio-political environment of the focus region, before subjecting these sources to the same analysis framework. RESULTS: Our searches identified 479 unique sources, of which 28 were adjudged to be relevant. The effective integration of citizen engagement within policy-making processes in LMICs and NDSs was found to be predominantly dependent upon the willingness and capacity of citizens and policy-makers. In the focus region, the implementation of citizen engagement within evidence-informed health policy-making is constrained by a lack of mutual trust between citizens and policy-makers. This is exacerbated by inadequate incentives and capacity for either side to engage. CONCLUSIONS: This research found no reason why citizen engagement could not adopt the same form in LMICs and NDSs as it does in high-income western democracies. However, it is recognized that certain political contexts may require additional support in developing and implementing citizen engagement, such as through trialling mechanisms at subnational scales. While specifically outlining the potential for citizen engagement, this study highlights the need for further research on its practical implementation.

Domains and processes for institutionalizing evidence-informed health policy-making: a critical interpretive synthesis.

BACKGROUND: While calls for institutionalization of evidence-informed policy-making (EIP) have become stronger in recent years, there is a paucity of methods that governments and organizational knowledge brokers can use to sustain and integrate EIP as part of mainstream health policy-making. The objective of this paper was to conduct a knowledge synthesis of the published and grey literatures to develop a theoretical framework with the key features of EIP institutionalization. METHODS: We applied a critical interpretive synthesis (CIS) that allowed for a systematic, yet iterative and dynamic analysis of heterogeneous bodies of literature to develop an explanatory framework for EIP institutionalization. We used a "compass" question to create a detailed search strategy and conducted electronic searches to identify papers based on their potential relevance to EIP institutionalization. Papers were screened and extracted independently and in duplicate. A constant comparative method was applied to develop a framework on EIP institutionalization. The CIS was triangulated with the findings of stakeholder dialogues that involved civil servants, policy-makers and researchers. RESULTS: We identified 3001 references, of which 88 papers met our eligibility criteria. This CIS resulted in a definition of EIP institutionalization as the "process and outcome of (re-)creating, maintaining and reinforcing norms, regulations, and standard practices that, based on collective meaning and values, actions as well as endowment of resources, allow evidence to become-over time-a legitimate and taken-for-granted part of health policy-making". The resulting theoretical framework comprised six key domains of EIP institutionalization that capture both structure and agency: (1) governance; (2) standards and routinized processes; (3) partnership, collective action and support; (4) leadership and commitment; (5) resources; and (6) culture. Furthermore, EIP institutionalization is being achieved through five overlapping stages: (i) precipitating events; (ii) de-institutionalization; (iii) semi-institutionalization (comprising theorization and diffusion); (iv) (re)-institutionalization; and (v) renewed de-institutionalization processes. CONCLUSIONS: This CIS advances the theoretical and conceptual discussions on EIP institutionalization, and provides new insights into an evidence-informed framework for initiating, strengthening and/or assessing efforts to institutionalize EIP.

An evaluation of the evidence brief for policy development process in WHO EVIPNet Europe countries.

BACKGROUND: Evidence briefs for policy (EBPs) represent a potentially powerful tool for supporting evidence-informed policy-making. Since 2012, WHO Evidence-Informed Policy Network (EVIPNet) Europe has been supporting Member States in developing EBPs. The aim of this study was to evaluate the process of developing EBPs in Estonia, Hungary and Slovenia. METHODS: We used a rapid appraisal approach, combining semi-structured interviews and document review, guided by the Medical Research Council (MRC) process evaluation framework. Interviews were conducted with a total of 20 individuals familiar with the EBP process in the three study countries. Data were analysed thematically, and emerging themes were related back to the MRC framework components (implementation, mechanisms of impact, and context). We also reflected on the appropriateness of this evaluation approach for EVIPNet teams without evaluation research expertise to conduct themselves. RESULTS: The following themes emerged as important to the EBP development process: how the focus problem is prioritized, who initiates this process, EBP team composition, EBP team leadership, availability of external support in the process, and the culture of policy-making in a country. In particular, the EBP process seemed to be supported by early engagement of the Ministry of Health and other stakeholders as initiators, clear EBP team roles and expectations, including a strong leader, external support to strengthen EBP team capacity and cultural acceptance of the necessity of evidence-informed policy-making. Overall, the evaluation approach was considered feasible by the EBP teams and captured rich qualitative data, but may be limited by the absence of external reviewers and long lag times between the EBP process and the evaluation. CONCLUSIONS: This process occurs in a complex system and must be conceptualized in each country and each EBP project in a way that fits local policy-making culture, priorities, leadership and team styles, roles and available resources. The use of a rapid appraisal approach, combining qualitative interviews and document review, is a feasible method of process evaluation for EVIPNet member countries.

Assessing the impact of knowledge communication and dissemination strategies targeted at health policy-makers and managers: an overview of systematic reviews.

BACKGROUND: The use of research evidence as an input for health decision-making is a need for most health systems. There are a number of approaches for promoting evidence use at different levels of the health system, but knowledge of their effectiveness is still scarce. The objective of this overview was to evaluate the effectiveness of knowledge communication and dissemination interventions, strategies or approaches targeting policy-makers and health managers. METHODS: This overview of systematic reviews used systematic review methods and was conducted according to a predefined and published protocol. A comprehensive electronic search of 13 databases and a manual search in four websites were conducted. Both published and unpublished reviews in English, Spanish or Portuguese were included. A narrative synthesis was undertaken, and effectiveness statements were developed, informed by the evidence identified. RESULTS: We included 27 systematic reviews. Three studies included only a communication strategy, while eight only included dissemination strategies, and the remaining 16 included both. None of the selected reviews provided "sufficient evidence" for any of the strategies, while four provided some evidence for three communication and four dissemination strategies. Regarding communication strategies, the use of tailored and targeted messages seemed to successfully lead to changes in the decision-making practices of the target audience. Regarding dissemination strategies, interventions that aimed at improving only the reach of evidence did not have an impact on its use in decisions, while interventions aimed at enhancing users' ability to use and apply evidence had a positive effect on decision-making processes. Multifaceted dissemination strategies also demonstrated the potential for changing knowledge about evidence but not its implementation in decision-making. CONCLUSIONS: There is limited evidence regarding the effectiveness of interventions targeting health managers and policy-makers, as well as the mechanisms required for achieving impact. More studies are needed that are informed by theoretical frameworks or specific tools and using robust methods, standardized outcome measures and clear descriptions of the interventions. We found that passive communication increased access to evidence but had no effect on uptake. Some evidence indicated that the use of targeted messages, knowledge-brokering and user training was effective in promoting evidence use by managers and policy-makers.

Evaluation of the performance and achievements of the WHO Evidence-informed Policy Network (EVIPNet) Europe.

BACKGROUND: The Evidence-informed Policy Network (EVIPNet) is one of the key mechanisms introduced by WHO to reduce the research-to-policy gap. EVIPNet Europe was launched in 2012. We evaluated the performance and achievements of EVIPNet Europe with the overall aims (1) to inform future developments and strategic planning of EVIPNet Europe and (2) to contribute to the evidence base for organisational knowledge translation activities by sharing the lessons learnt. METHODS: The evaluation covered the WHO Secretariat of EVIPNet Europe and its 21 member countries, from its inception to mid-2018. A mixed methods design was used to assess changes in three domains, including triangulation of quantitative and qualitative methods, based on the EVIPNet Europe Monitoring & Evaluation framework and theory of change. Data were collected between August and October 2018. Data collection comprised documentary review, social media analysis, online country evaluation, key informant interviews and validated tools. Two case studies were also developed. RESULTS: The evaluation showed promising results as well as lessons to guide the future development of EVIPNet in the WHO European Region and other regions of the world. EVIPNet Europe appears to be filling a niche in promoting the capacity of Network member countries for evidence-informed policy-making. There is evidence that EVIPNet Europe's capacity-building programme of work is improving knowledge and skills at the individual level. There has been an increase in activity and outputs since its establishment and evidence has been used to inform new policies in some member countries. However, the speed at which member countries are developing or publishing products varies greatly and no formalised knowledge translation platforms have yet been created. Financial and human resources are limited and staff turnover is a cause for concern, both at the WHO Secretariat and country team levels. CONCLUSIONS: Six years since the launch of EVIPNet Europe, the Network has grown quickly, is clearly valued and has had some successes. However, more work and support are needed if it is to achieve its vision of a Europe in which high-quality, context-sensitive evidence routinely informs health decision-making processes that ultimately serve to strengthen health outcomes across the Region.

Indicators to evaluate organisational knowledge brokers: a scoping review.

BACKGROUND: Knowledge translation (KT) is currently endorsed by global health policy actors as a means to improve outcomes by institutionalising evidence-informed policy-making. Organisational knowledge brokers, comprised of researchers, policy-makers and other stakeholders, are increasingly being used to undertake and promote KT at all levels of health policy-making, though few resources exist to guide the evaluation of these efforts. Using a scoping review methodology, we identified, synthesised and assessed indicators that have been used to evaluate KT infrastructure and capacity-building activities in a health policy context in order to inform the evaluation of organisational knowledge brokers. METHODS: A scoping review methodology was used. This included the search of Medline, Global Health and the WHO Library databases for studies regarding the evaluation of KT infrastructure and capacity-building activities between health research and policy, published in English from 2005 to 2016. Data on study characteristics, outputs and outcomes measured, related indicators, mode of verification, duration and/or frequency of collection, indicator methods, KT model, and targeted capacity level were extracted and charted for analysis. RESULTS: A total of 1073 unique articles were obtained and 176 articles were qualified to be screened in full-text; 32 articles were included in the analysis. Of a total 213 indicators extracted, we identified 174 (174/213; 81.7%) indicators to evaluate the KT infrastructure and capacity-building that have been developed using methods beyond expert opinion. Four validated instruments were identified. The 174 indicators are presented in 8 domains based on an adaptation of the domains of the Lavis et al. framework of linking research to action - general climate, production of research, push efforts, pull efforts, exchange efforts, integrated efforts, evaluation and capacity-building. CONCLUSION: This review presents a total of 174 method-based indicators to evaluate KT infrastructure and capacity-building. The presented indicators can be used or adapted globally by organisational knowledge brokers and other stakeholders in their monitoring and evaluation work.

Qualitative assessment of opportunities and challenges to improve evidence-informed health policy-making in Hungary - an EVIPNet situation analysis pilot.

BACKGROUND: In evidence-informed policy-making (EIP), major knowledge gaps remain in understanding the context and possibilities for institutionalisation of knowledge translation. In 2014, the WHO Evidence-informed Policy Network (EVIPNet) Europe initiated a number of pilot countries, with Hungary among them, to engage in a 'situation analysis' (SA) in order to fill some of those gaps. This contribution discusses the results of the SA in Hungary on research-policy interactions, facilitating factors and potential barriers to establish a knowledge translation platform (KTP). METHODS: In line with the EVIPNet Europe SA Manual, a document analysis, 13 interviews, 3 focus group discussions with 21 participants, and an online survey with 31 respondents were carried out from April to October, 2015. A SA aims to assess the context in which EIP takes form and seeks opportunities to establish a KTP, so information was gathered on the current practice of EIP and knowledge translation, its relevant actors, enablers and barriers for EIP, and opinions on a future KTP. Methodological and researcher triangulation resulted in a narrative synthesis of data, including a comparison with literature. A stakeholder consultation was organised to validate findings. RESULTS: This study reveals that stakeholders show commitment to produce and use research evidence in Hungarian health policy-making. All stakeholders endorsed the idea of strengthening the systematic use of evidence in decision-making and favoured the idea of establishing a KTP. In line with literature on other countries, some good practices exist on the uptake of evidence in policy-making; however, a systematic approach of developing, translating and using research evidence in health policy processes is lacking. EIP is currently hampered by scattered capacity, coordination problems, high fluctuation in government, an often legalistic and a more 'symbolic' rather than practical support for knowledge translation and EIP. The article summarises recommendations on a Hungarian KTP. CONCLUSIONS: Pragmatic adaptation of the SA Manual to local needs proved to be a useful mechanism to provide insight into the Hungarian EIP field and the establishment of a potential KTP. Despite the success of a KTP pilot, it remains unclear how a KTP in Hungary will be institutionalised in a sustainable way.

Routinizing the Use of Evidence in Policy - What Is Needed? Comment on "Sustaining Knowledge Translation Practices: A Critical Interpretive Synthesis".

In their study of sustaining knowledge translation (KT) practices, Borst et al found that this process is an interplay of: (i) constructing and extending networks, (ii) creating contexts that support KT practices, and (iii) understanding how actors create, maintain, and disrupt institutions. Their article is an important contribution to the body of research promoting KT. In this commentary we reflect on the convergences and differences between the concepts of 'sustaining' and 'institutionalizing' KT, highlighting domains and processes related to the institutionalization, providing an analysis of KT landscape in Brazil and making a case for the need to increase countries' routine use of evidence.

Identifying priority questions regarding rapid systematic reviews' methods: protocol for an eDelphi study.

INTRODUCTION: Rapid systematic reviews (RRs) have the potential to provide timely information to decision-makers, thus directly impacting healthcare. However, consensus regarding the most efficient approaches to performing RRs and the presence of several unaddressed methodological issues pose challenges. With such a large potential research agenda for RRs, it is unclear what should be prioritised. OBJECTIVE: To elicit a consensus from RR experts and interested parties on what are the most important methodological questions (from the generation of the question to the writing of the report) for the field to address in order to guide the effective and efficient development of RRs. METHODS AND ANALYSIS: An eDelphi study will be conducted. Researchers with experience in evidence synthesis and other interested parties (eg, knowledge users, patients, community members, policymaker, industry, journal editors and healthcare providers) will be invited to participate. The following steps will be taken: (1) a core group of experts in evidence synthesis will generate the first list of items based on the available literature; (2) using LimeSurvey, participants will be invited to rate and rank the importance of suggested RR methodological questions. Questions with open format responses will allow for modifications to the wording of items or the addition of new items; (3) three survey rounds will be performed asking participants to re-rate items, with items deemed of low importance being removed at each round; (4) a list of items will be generated with items believed to be of high importance by ≥75% of participants being included and (5) this list will be discussed at an online consensus meeting that will generate a summary document containing the final priority list. Data analysis will be performed using raw numbers, means and frequencies. ETHICS AND DISSEMINATION: This study was approved by the Concordia University Human Research Ethics Committee (#30015229). Both traditional, for example, scientific conference presentations and publication in scientific journals, and non-traditional, for example, lay summaries and infographics, knowledge translation products will be created.

Integration of evidence into Theory of Change frameworks in the healthcare sector: A rapid systematic review.

BACKGROUND: Theory of Change (ToC) has become an established approach to design and evaluate interventions. While ToC should-in line with the growing international focus on evidence-informed health decision-making-consider explicit approaches to incorporate evidence, there is limited guidance on how this should be done. This rapid review aims to identify and synthesize the available literature on how to systematically use research evidence when developing or adapting ToCs in the health sector. METHODS: A rapid review methodology using a systematic approach, was designed. Eight electronic databases were consulted to search for peer-reviewed and gray publications detailing tools, methods, and recommendations promoting the systematic integration of research evidence in ToCs. The included studies were compared, and the findings summarized qualitatively into themes to identify key principles, stages, and procedures, guiding the systematic integration of research evidence when developing or revising a ToC. RESULTS: This review included 18 studies. The main sources from which evidence was retrieved in the ToC development process were institutional data, literature searches, and stakeholder consultation. There was a variety of ways of finding and using evidence in ToC. Firstly, the review provided an overview of existing definitions of ToC, methods applied in ToC development and the related ToC stages. Secondly, a typology of 7 stages relevant for evidence integration into ToCs was developed, outlining the types of evidence and research methods the included studies applied for each of the proposed stages. CONCLUSION: This rapid review adds to the existing literature in two ways. First, it provides an up-to-date and comprehensive review of the existing methods for incorporating evidence into ToC development in the health sector. Second, it offers a new typology guiding any future endeavors of incorporating evidence into ToCs.

Key issues for stakeholder engagement in the development of health and healthcare guidelines.

Established in 2015, the Multi-Stakeholder Engagement (MuSE) Consortium is an international network of over 120 individuals interested in stakeholder engagement in research and guidelines. The MuSE group is developing guidance for stakeholder engagement in the development of health and healthcare guideline development. The development of this guidance has included multiple meetings with stakeholders, including patients, payers/purchasers of health services, peer review editors, policymakers, program managers, providers, principal investigators, product makers, the public, and purchasers of health services and has identified a number of key issues. These include: (1) Definitions, roles, and settings (2) Stakeholder identification and selection (3) Levels of engagement, (4) Evaluation of engagement, (5) Documentation and transparency, and (6) Conflict of interest management. In this paper, we discuss these issues and our plan to develop guidance to facilitate stakeholder engagement in all stages of the development of health and healthcare guideline development.

A group of international researchers, patient partners, and other stakeholders are working together to create a checklist for when and how to involve stakeholders in health guideline development. Health guidelines include clinical practice guidelines, which your healthcare provider uses to determine treatments for health conditions. While working on this checklist, the team identified key issues to work on, including: (1) Definitions, roles, and settings (2) Stakeholder identification and selection (3) Levels of engagement, (4) Evaluation of engagement, (5) Documentation and transparency, and (6) Conflict of interest management. This paper describes each issue and how the team plans to produce guidance papers to address them.

Translating health information into policy-making: A pragmatic framework.

Knowledge translation (KT) is increasingly acknowledged to have the potential to improve policy-making. The value of health information (HI), as part of the KT context, is now also increasingly understood. This paper aims to identify existing tools for the translation of HI into policy-making and to develop a related framework facilitating future application of these identified tools. Updating and building upon a scoping review undertaken for the Health Evidence Network (HEN) Synthesis Report No. 54, commissioned by the World Health Organization (WHO) Regional Office for Europe in 2017, a literature search was conducted using the same databases (PubMed and Scopus) and the same keywords as in the WHO/HEN scoping review. All papers elaborating on tools enhancing the use of HI in policy-making were included. Of the 2549 records screened, 17 publications were included in this study. This review identified four different types of tools: 1) Visualisation and modelling tools, 2) Information packaging and synthesis tools, 3) Communication and dissemination tools and 4) Information linkage and exchange tools. The distinctions between these are fluid as different tools can be combined or incorporated into one another to complement each other. Our framework shows that communication/dissemination or linkage tools are crucial to effectively inform policy decisions through HI. This study helps to understand and guide the processes of KT of HI.

What do we know about evidence-informed priority setting processes to set population-level health-research agendas: an overview of reviews.

BACKGROUND: This overview aimed to synthesize existing systematic reviews to produce a draft framework of evidence-informed health priority setting that supports countries in identifying appropriate steps and methods when developing and implementing national research agendas. MAIN BODY: We searched Ovid MEDLINE® and the WHO Institutional Repository for Information Sharing from 2010 to 2020 for critical or systematic reviews that evaluated research priority setting exercises. We adapted the AMSTAR checklist to assess the quality of included reviews and used adapted frameworks for data extraction and analysis. The search resulted in 2395 titles, of which 31 were included. Populations included in the reviews typically involved patients, families and carers, researchers, clinicians, policymakers and research funders. The topics covered in the reviews varied from specific diseases or conditions, approaches for healthcare practice or research priority setting methods itself. All the included systematic reviews were of low or critically low quality. The studies were thematically grouped based on their main focus: identifying and engaging with stakeholders; methods; context; and health area. CONCLUSION: Our overview of reviews has reconfirmed aspects of existing frameworks, but has also identified new concepts for countries to consider while developing their national research agendas. We propose a preliminary framework for consideration that highlights four key phases: (1) preparatory, (2) priority setting, (3) follow-up phase and (4) sustainability phase, which have thirteen sub-domains to consider.

A comprehensive monitoring and evaluation framework for evidence to policy networks.

OBJECTIVE: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. METHOD: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. RESULTS: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. CONCLUSION: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.