A living critical interpretive synthesis to yield a framework on the production and dissemination of living evidence syntheses for decision-making.

BACKGROUND: The COVID-19 pandemic has had an unprecedented impact in the global research production and has also increased research waste. Living evidence syntheses (LESs) seek to regularly update a body of evidence addressing a specific question. During the COVID-19 pandemic, the production and dissemination of LESs emerged as a cornerstone of the evidence infrastructure. This critical interpretive synthesis answers the questions: What constitutes an LES to support decision-making?; when should one be produced, updated, and discontinued?; and how should one be disseminated? METHODS: Searches included the Cochrane Library, EMBASE (Ovid), Health Systems Evidence, MEDLINE (Ovid), PubMed, and Web of Science up to 23 April 2024 and included articles that provide any insights on addressing the compass questions on LESs. Articles were selected and appraised, and their insights extracted. An interpretive and iterative coding process was used to identify relevant thematic categories and create a conceptual framework. RESULTS: Among the 16,630 non-duplicate records identified, 208 publications proved eligible. Most were non-empirical articles, followed by actual LESs. Approximately one in three articles were published in response to the COVID-19 pandemic. The conceptual framework addresses six thematic categories: (1) what is an LES; (2) what methodological approaches facilitate LESs production; (3) when to produce an LES; (4) when to update an LES; (5) how to make available the findings of an LES; and (6) when to discontinue LES updates. CONCLUSION: LESs can play a critical role in reducing research waste and ensuring alignment with advisory and decision-making processes. This critical interpretive synthesis provides relevant insights on how to better organize the global evidence architecture to support their production. TRIAL REGISTRATION: PROSPERO registration: CRD42021241875.

An examination of mental health policy implementation efforts and the intermediaries that support them in New Zealand, Canada and Sweden: a comparative case study.

Introduction: The implementation of evidence-informed policies and practices across systems is a complex, multifaceted endeavor, often requiring the mobilization of multiple organizations from a range of contexts. In order to facilitate this process, policy makers, innovation developers and service deliverers are increasingly calling upon intermediaries to support implementation, yet relatively little is known about precisely how they contribute to implementation. This study examines the role of intermediaries supporting the implementation of evidence-informed policies and practices in the mental health and addictions systems of New Zealand, Ontario, Canada and Sweden. Methods: Using a comparative case study methodology and taking an integrated knowledge translation approach, we drew from established explanatory frameworks and implementation theory to address three questions: (1) Why were the intermediaries established? (2) How are intermediaries structured and what strategies do they use in systems to support the implementation of policy directions? and (3) What explains the lack of use of particular strategies? Data collection included three site visits, 49 key informant interviews and document analysis. Results: In each jurisdiction, a unique set of problems (e.g., negative events involving people with mental illness), policies (e.g., feedback on effectiveness of existing policies) and political events (e.g., changes in government) were coupled by a policy entrepreneur to bring intermediaries onto the decision agenda. While intermediaries varied greatly in their structure and characteristics, both the strategies they used and the strategies they didn't use were surprisingly similar. Specifically it was notable that none of the intermediaries used strategies that directly targeted the public, nor used audit and feedback. This emerged as the principle policy puzzle. Our analysis identified five reasons for these strategies not being employed: (1) their need to build/maintain healthy relationships with policy actors; (2) their need to build/maintain healthy relationships with service delivery system actors; (3) role differentiation with other system actors; (4) perceived lack of "fit" with the role of policy intermediaries; and (5) resource limitations that preclude intensive distributed (program-level) work. Conclusion: Policy makers and implementers must consider capacity to support implementation, and our study identifies how intermediaries can be developed and harnessed to support the implementation process.

A taxonomy of demand-driven questions for use by evidence producers, intermediaries and decision-makers: results from a cross-sectional survey.

BACKGROUND: Globally, a growing number of calls to formalize and strengthen evidence-support systems have been released, all of which emphasize the importance of evidence-informed decision making. To achieve this, it is critical that evidence producers and decision-makers interact, and that decision-makers' evidence needs can be efficiently translated into questions to which evidence producers can respond. This paper aims to create a taxonomy of demand-driven questions for use by evidence producers, intermediaries (i.e., people working in between researchers and decision-makers) and decision-makers. METHODS: We conducted a global cross-sectional survey of units providing some type of evidence support at the explicit request of decision-makers. Unit representatives were invited to answer an online questionnaire where they were asked to provide a list of the questions that they have addressed through their evidence-support mechanism. Descriptive analyses were used to analyze the survey responses, while the questions collected from each unit were iteratively analyzed to create a mutually exclusive and collectively exhaustive list of types of questions that can be answered with some form of evidence. RESULTS: Twenty-nine individuals completed the questionnaire, and more than 250 submitted questions were analysed to create a taxonomy of 41 different types of demand-driven questions. These 41 questions were organized by the goal to be achieved, and the goals were grouped in the four decision-making stages (i) clarifying a societal problem, its causes and potential impacts; (ii) finding and selecting options to address a problem; (iii) implementing or scaling-up an option; and (iv) monitoring implementation and evaluating impacts. CONCLUSION: The mutually exclusive and collectively exhaustive list of demand-driven questions will help decision-makers (to ask and prioritize questions), evidence producers (to organize and present their work), and evidence-intermediaries (to connect evidence needs with evidence supply).

Enhancing the delivery of comprehensive care for people living with HIV in Canada: insights from citizen panels and a national stakeholder dialogue.

BACKGROUND: People living with human immunodeficiency virus (HIV) are living longer with health-related disability associated with ageing, including complex conditions. However, health systems in Canada have not adapted to meet these comprehensive care needs. METHODS: We convened three citizen panels and a national stakeholder dialogue. The panels were informed by a plain-language citizen brief that outlined data and evidence about the challenge/problem, elements of an approach for addressing it and implementation considerations. The national dialogue was informed by a more detailed version of the same brief that included a thematic analysis of the findings from the panels. RESULTS: The 31 citizen panel participants emphasized the need for more prevention, testing and social supports, increased public education to address stigma and access to more timely data to inform system changes. The 21 system leaders emphasized the need to enhance person-centred care and for implementing learning and improvement across provinces, territories and Indigenous communities. Citizens and system leaders highlighted that policy actions need to acknowledge that HIV remains unique among conditions faced by Canadians. CONCLUSIONS: Action will require a national learning collaborative to support spread and scale of successful prevention, care and support initiatives. Such a collaborative should be grounded in a rapid-learning and improvement approach that is anchored on the needs, perspectives and aspirations of people living with HIV; driven by timely data and evidence; supported by appropriate decision supports and aligned governance, financial and delivery arrangements; and enabled with a culture of and competencies for rapid learning and improvement.

Matching the right study design to decision-maker questions: Results from a Delphi study.

Research evidence can play an important role in each stage of decision-making, evidence-support systems play a key role in aligning the demand for and supply of evidence. This paper provides guidance on what type of study designs most suitably address questions asked by decision-makers. This study used a two-round online Delphi approach, including methodological experts in different areas, disciplines, and geographic locations. Participants prioritized study designs for each of 40 different types of question, with a Kendall's W greater than 0.6 and reaching statistical significance (p<0.05) considered as a consensus. For each type of question, we sorted the final rankings based on their median ranks and interquartile ranges, and listed the four study designs with the highest median ranks. Participants provided 29 answers in the two rounds of the Delphi, and reached a consensus for 28 (out of the 40) questions (eight in the first round and 20 in the second). Participants achieved a consensus for 8 of 15 questions in stage I (clarifying a societal problem, its causes, and potential impacts), 12 of 13 in stage II (finding options to address a problem) and four of six in each of stages III (implementing or scaling-up an option) and IV (monitoring implementation and evaluating impact). This paper provides guidance on what study designs are more suitable to give insights on 28 different types of questions. Decision-makers, evidence intermediaries (, researchers and funders can use this guidance to make better decisions on what type of study design to commission, use or fund when answering specific needs.

User-experience testing of an evidence-to-decision framework for selecting essential medicines.

Essential medicine lists (EMLs) are important medicine prioritization tools used by the World Health Organization (WHO) EML and over 130 countries. The criteria used by WHO's Expert Committee on the Selection and Use of Essential Medicines has parallels to the GRADE Evidence-to-Decision (EtD) frameworks. In this study, we explored the EtD frameworks and a visual abstract as adjunctive tools to strengthen the integrate evidence and improve the transparency of decisions of EML applications. We conducted user-experience testing interviews of key EML stakeholders using Morville's honeycomb model. Interviews explored multifaceted dimensions (e.g., usability) on two EML applications for the 2021 WHO EML-long-acting insulin analogues for diabetes and immune checkpoint inhibitors for lung cancer. Using a pre-determined coding framework and thematic analysis we iteratively improved both the EtD framework and the visual abstract. We coded the transcripts of 17 interviews with 13 respondents in 103 locations of the interview texts across all dimensions of the user-experience honeycomb. Respondents felt the EtD framework and visual abstract presented complementary useful and findable adjuncts to the traditional EML application. They felt this would increase transparency and efficiency in evidence assessed by EML committees. As EtD frameworks are also used in health practice guidelines, including those by the WHO, respondents articulated that the adoption of the EtD by EML applications represents a tangible mechanism to align EMLs and guidelines, decrease duplication of work and improve coordination. Improvements were made to clarify instructions for the EtD and visual abstract, and to refine the design and content included. 'Availability' was added as an additional criterion for EML applications to highlight this criterion in alignment with WHO EML criteria. EtD frameworks and visual abstracts present additional important tools to communicate evidence and support decision-criteria in EML applications, which have global health impact. Access to essential medicines is important for achieving universal health coverage, and the development of essential medicine lists should be as evidence-based and trustworthy as possible.

GRADE Concept 7: Issues and Insights Linking Guideline Recommendations to Trustworthy Essential Medicine Lists.

OBJECTIVES: Guidelines and essential medicine lists (EMLs) bear similarities and differences in the process that lead to decisions. Access to essential medicines is central to achieve universal health coverage. The World Health Organization (WHO) EML has guided prioritization of essential medicines globally for nearly 50 years, and national EMLs (NEMLs) exist in over 130 countries. Guideline and EML decisions, at WHO or national levels, are not always coordinated and aligned. We sought to explore challenges, and potential solutions, for decision-making to support trustworthy medicine selection for EMLs from a Grading of Recommendations, Assessment, Development and Evaluations (GRADE) Working Group perspective. We primarily focus on the WHO EML; however, our findings may be applicable to NEML decisions as well. STUDY DESIGN AND SETTING: We identified key challenges in connecting the EML to health guidelines by involving a broad group of stakeholders and assessing case studies including real applications to the WHO EML, South Africa NEML, and a multiple sclerosis guideline connected to a WHO EML application for multiple sclerosis treatments. To address challenges, we utilized the results of a survey and feedback from the stakeholders, and iteratively met as a project group. We drafted a conceptual framework of challenges and potential solutions. We presented a summary of the results for feedback to all attendees of the GRADE Working Group meetings in November 2022 (approximately 120 people) and in May 2023 (approximately 100 people) before finalizing the framework. RESULTS: We prioritized issues and insights/solutions that addressed the connections between the EML and health guidelines. Our suggested solutions include early planning alignment of guideline groups and EMLs, considering shared participation to strengthen linkage, further clarity on price/cost considerations, and using explicit shared criteria to make guideline and EML decisions. We also provide recommendations to strengthen the connection between WHO EML and NEMLs including through contextualization methods. CONCLUSION: This GRADE concept article, jointly developed by key stakeholders from the guidelines and EMLs field, identified key conceptual issues and potential solutions to support the continued advancement of trustworthy EMLs. Adopting structured decision criteria that can be linked to guideline recommendations bears the potential to advance health equity and gaps in availability of essential medicines within and between countries.

Living evidence and adaptive policy: perfect partners?

BACKGROUND: While there has been widespread global acceptance of the importance of evidence-informed policy, many opportunities to inform health policy with research are missed, often because of a mismatch between when and where reliable evidence is needed, and when and where it is available. 'Living evidence' is an approach where systematic evidence syntheses (e.g. living reviews, living guidelines, living policy briefs, etc.) are continually updated to incorporate new relevant evidence as it becomes available. Living evidence approaches have the potential to overcome a major barrier to evidence-informed policy, making up-to-date systematic summaries of policy-relevant research available at any time that policy-makers need them. These approaches are likely to be particularly beneficial given increasing calls for policy that is responsive, and rapidly adaptive to changes in the policy context. We describe the opportunities presented by living evidence for evidence-informed policy-making and highlight areas for further exploration. DISCUSSION: There are several elements of living approaches to evidence synthesis that might support increased and improved use of evidence to inform policy. Reviews are explicitly prioritised to be 'living' by partnerships between policy-makers and researchers based on relevance to decision-making, as well as uncertainty of existing evidence, and likelihood that new evidence will arise. The ongoing nature of the work means evidence synthesis teams can be dynamic and engage with policy-makers in a variety of ways over time; and synthesis topics, questions and methods can be adapted as policy interests or contextual factors shift. Policy-makers can sign-up to be notified when relevant new evidence is found, and can be confident that living syntheses are up-to-date and contain all research whenever they access them. The always up-to-date nature of living evidence syntheses means producers can rapidly demonstrate availability of relevant, reliable evidence when it is needed, addressing a frequently cited barrier to evidence-informed policymaking. CONCLUSIONS: While there are challenges to be overcome, living evidence provides opportunities to enable policy-makers to access up-to-date evidence whenever they need it and also enable researchers to respond to the issues of the day with up-to-date research; and update policy-makers on changes in the evidence base as they arise. It also provides an opportunity to build flexible partnerships between researchers and policy-makers to ensure that evidence syntheses reflect the changing needs of policy-makers.

Future leaders in a Learning Health System: Exploring the Health System Impact Fellowship.

The Canadian health system is reeling following the COVID-19 pandemic. Strains have become growing cracks, with long emergency department wait times, shortage of human health resources, and growing dissatisfaction from both clinicians and patients. To address long needed health system reform in Canada, a modernization of training is required for the next generation health leaders. The Canadian Institutes of Health Research Health System Impact Fellowship is an example of a well-funded and connected training program which prioritizes embedded research and embedding technically trained scholars with health system partners. The program has been successful in the scope and impact of its training outcomes as well as providing health system partners with a pool of connected and capable scholars. Looking forward, integrating aspects of evidence synthesis from both domestic and international sources and adapting a general contractor approach to implementation within the HSIF could help catalyze Learning Health System reform in Canada.

Next generation support and stronger institutions for evidence-informed policy-making.

Evidence-informed policy-making benefitted from much-needed attention and resources during the COVID-19 pandemic (1). As a result, 3 key movements and innovations are now making it possible to provide better evidence support (higher quality and more aligned to the speed of advisory and decision-making) for policy-making than ever.

Quality improvement strategies for diabetes care: Effects on outcomes for adults living with diabetes.

BACKGROUND: There is a large body of evidence evaluating quality improvement (QI) programmes to improve care for adults living with diabetes. These programmes are often comprised of multiple QI strategies, which may be implemented in various combinations. Decision-makers planning to implement or evaluate a new QI programme, or both, need reliable evidence on the relative effectiveness of different QI strategies (individually and in combination) for different patient populations. OBJECTIVES: To update existing systematic reviews of diabetes QI programmes and apply novel meta-analytical techniques to estimate the effectiveness of QI strategies (individually and in combination) on diabetes quality of care. SEARCH METHODS: We searched databases (CENTRAL, MEDLINE, Embase and CINAHL) and trials registers (ClinicalTrials.gov and WHO ICTRP) to 4 June 2019. We conducted a top-up search to 23 September 2021; we screened these search results and 42 studies meeting our eligibility criteria are available in the awaiting classification section. SELECTION CRITERIA: We included randomised trials that assessed a QI programme to improve care in outpatient settings for people living with diabetes. QI programmes needed to evaluate at least one system- or provider-targeted QI strategy alone or in combination with a patient-targeted strategy. - System-targeted: case management (CM); team changes (TC); electronic patient registry (EPR); facilitated relay of clinical information (FR); continuous quality improvement (CQI). - Provider-targeted: audit and feedback (AF); clinician education (CE); clinician reminders (CR); financial incentives (FI). - Patient-targeted: patient education (PE); promotion of self-management (PSM); patient reminders (PR). Patient-targeted QI strategies needed to occur with a minimum of one provider or system-targeted strategy. DATA COLLECTION AND ANALYSIS: We dual-screened search results and abstracted data on study design, study population and QI strategies. We assessed the impact of the programmes on 13 measures of diabetes care, including: glycaemic control (e.g. mean glycated haemoglobin (HbA1c)); cardiovascular risk factor management (e.g. mean systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), proportion of people living with diabetes that quit smoking or receiving cardiovascular medications); and screening/prevention of microvascular complications (e.g. proportion of patients receiving retinopathy or foot screening); and harms (e.g. proportion of patients experiencing adverse hypoglycaemia or hyperglycaemia). We modelled the association of each QI strategy with outcomes using a series of hierarchical multivariable meta-regression models in a Bayesian framework. The previous version of this review identified that different strategies were more or less effective depending on baseline levels of outcomes. To explore this further, we extended the main additive model for continuous outcomes (HbA1c, SBP and LDL-C) to include an interaction term between each strategy and average baseline risk for each study (baseline thresholds were based on a data-driven approach; we used the median of all baseline values reported in the trials). Based on model diagnostics, the baseline interaction models for HbA1c, SBP and LDL-C performed better than the main model and are therefore presented as the primary analyses for these outcomes. Based on the model results, we qualitatively ordered each QI strategy within three tiers (Top, Middle, Bottom) based on its magnitude of effect relative to the other QI strategies, where 'Top' indicates that the QI strategy was likely one of the most effective strategies for that specific outcome. Secondary analyses explored the sensitivity of results to choices in model specification and priors.  Additional information about the methods and results of the review are available as Appendices in an online repository. This review will be maintained as a living systematic review; we will update our syntheses as more data become available. MAIN RESULTS: We identified 553 trials (428 patient-randomised and 125 cluster-randomised trials), including a total of 412,161 participants. Of the included studies, 66% involved people living with type 2 diabetes only. Participants were 50% female and the median age of participants was 58.4 years. The mean duration of follow-up was 12.5 months. HbA1c was the commonest reported outcome; screening outcomes and outcomes related to cardiovascular medications, smoking and harms were reported infrequently. The most frequently evaluated QI strategies across all study arms were PE, PSM and CM, while the least frequently evaluated QI strategies included AF, FI and CQI. Our confidence in the evidence is limited due to a lack of information on how studies were conducted.  Four QI strategies (CM, TC, PE, PSM) were consistently identified as 'Top' across the majority of outcomes. All QI strategies were ranked as 'Top' for at least one key outcome. The majority of effects of individual QI strategies were modest, but when used in combination could result in meaningful population-level improvements across the majority of outcomes. The median number of QI strategies in multicomponent QI programmes was three.  Combinations of the three most effective QI strategies were estimated to lead to the below effects:  - PR + PSM + CE: decrease in HbA1c by 0.41% (credibility interval (CrI) -0.61 to -0.22) when baseline HbA1c < 8.3%; - CM + PE + EPR: decrease in HbA1c by 0.62% (CrI -0.84 to -0.39) when baseline HbA1c > 8.3%;  - PE + TC + PSM: reduction in SBP by 2.14 mmHg (CrI -3.80 to -0.52) when baseline SBP < 136 mmHg; - CM + TC + PSM: reduction in SBP by 4.39 mmHg (CrI -6.20 to -2.56) when baseline SBP > 136 mmHg;  - TC + PE + CM: LDL-C lowering of 5.73 mg/dL (CrI -7.93 to -3.61) when baseline LDL < 107 mg/dL; - TC + CM + CR: LDL-C lowering by 5.52 mg/dL (CrI -9.24 to -1.89) when baseline LDL > 107 mg/dL. Assuming a baseline screening rate of 50%, the three most effective QI strategies were estimated to lead to an absolute improvement of 33% in retinopathy screening (PE + PR + TC) and 38% absolute increase in foot screening (PE + TC + Other). AUTHORS' CONCLUSIONS: There is a significant body of evidence about QI programmes to improve the management of diabetes. Multicomponent QI programmes for diabetes care (comprised of effective QI strategies) may achieve meaningful population-level improvements across the majority of outcomes. For health system decision-makers, the evidence summarised in this review can be used to identify strategies to include in QI programmes. For researchers, this synthesis identifies higher-priority QI strategies to examine in further research regarding how to optimise their evaluation and effects. We will maintain this as a living systematic review.

Decision criteria for selecting essential medicines and their connection to guidelines: an interpretive descriptive qualitative interview study.

BACKGROUND AND OBJECTIVES: The World Health Organization Model List of Essential Medicines has led to at least 137 national lists. Essential medicines should be grounded in evidence-based guideline recommendations and explicit decision criteria. Essential medicines should be available, accessible, affordable, and the supporting evidence should be accompanied by a rating of the certainty one can place in it. Our objectives were to identify criteria and considerations that should be addressed in moving from a guideline recommendation regarding a medicine to the decision of whether to add, maintain, or remove a medicine from an essential medicines list. We also seek to explore opportunities to improve organizational processes to support evidence-based health decision-making more broadly. METHODS: We conducted a qualitative study with semistructured interviews of key informant stakeholders in the development and use of guidelines and essential medicine lists (EMLs). We used an interpretive descriptive analysis approach and thematic analysis of interview transcripts in NVIVO v12. RESULTS: We interviewed 16 key informants working at national and global levels across all WHO regions. We identified five themes: three descriptive/explanatory themes 1) EMLs and guidelines, the same, but different; 2) EMLs can drive price reductions and improve affordability and access; 3) Time lag and disconnect between guidelines and EMLs; and two prescriptive themes 4) An "evidence pipeline" could improve coordination between guidelines and EMLs; 5) Facilitating the link between the WHO Model List of Essential Medicines (WHO EML) and national EMLs could increase alignment. CONCLUSION: We found significant overlap and opportunities for alignment between guideline and essential medicine decision processes. This finding presents opportunities for guideline and EML developers to enhance strategies for collaboration. Future research should assess and evaluate these strategies in practice to support the shared goal of guidelines and EMLs: improvements in health.

Facilitators, barriers and strategies for health-system guidance implementation: a critical interpretive synthesis protocol.

BACKGROUND: As systematically developed statements regarding possible courses of action, health system guidance (HSG) can assist with making decisions about addressing problems or achieving goals in health systems. However, there are conceptual and methodological challenges in HSG implementation due to the complexity of health-system policy-making, the diversity of available evidence and vast differences in contexts. To address these gaps, we aim to develop a theoretical framework for supporting HSG implementation as part of a broader effort to promote evidence-informed policy-making in health systems. METHODS: To develop a theoretical framework about facilitators, barriers and strategies for HSG implementation, we will apply a critical interpretive synthesis (CIS) approach to synthesize the findings from a range of relevant literature. We will search 11 electronic databases and seven organizational websites to identify relevant published and grey literature. We will check the references of included studies and contact experts to identify additional eligible papers. Finally, we will conduct purposively sampling of the literature to fill any identified conceptual gaps. We will use relevance and five quality criteria to assess included papers. A standardized form will be developed for extracting information. We will use an interpretive analytic approach to synthesize the findings, including a constant comparative method throughout the analysis. Two independent reviewers will conduct the literature screening and relevance assessment, and disagreements will be resolved through discussion. The principal investigator will conduct data extraction and synthesis, and a second reviewer will check the sample of extracted data for consistency and accuracy. DISCUSSION: A new theoretical framework about facilitators, barriers and strategies for HSG implementation will be developed using a CIS approach. The HSG implementation framework could be widely used for supporting the implementation of HSG covering varied topics and in different contexts (including low-, middle- and high-income countries). In later work, we will develop a tool for supporting HSG implementation based on the theoretical framework. Registration PROSPERO CRD42020214072. Date of Registration: 14 December 2020.

The impact of OHIP+ pharmacare on use and costs of public drug plans among children and youth in Ontario: a time-series analysis.

BACKGROUND: In 2018, Ontario implemented a pharmacare program (Ontario Health Insurance Plan Plus [OHIP+]) to provide children and youth younger than 25 years with full coverage for prescription medications in the provincial formulary. We aimed to assess the use of public drug plans and costs of publicly covered prescriptions before and after the program's implementation and modification. METHODS: We conducted a population-based, interrupted time-series analysis using data on prescription drug claims, from the Canadian Institute for Health Information's National Prescription Drug Utilization Information System, for people younger than 25 years from January 2016 to October 2019 in Ontario, using British Columbia as the control. We assessed changes in the level and trend of publicly covered prescriptions and expenditures after the introduction of OHIP+ in January 2018 and after program modifications in April 2019. We also assessed plan use and expenditures for publicly covered prescriptions for diabetes and asthma. RESULTS: Publicly covered prescriptions in Ontario increased by 290%, from 756 per 1000 people before OHIP+ to 2952 per 1000 (p < 0.001) after its implementation. After program modification, prescriptions decreased by 52% to 1421 per 1000 (p < 0.001). Similarly, total public drug expenditures increased by 254%, from $379 million in 2017 to $839 million in 2018, then reduced by 49% to $204 million in 2019. Monthly public plan expenditures increased by $115.94 (95% confidence interval [CI] $100.93 to $130.94) post-OHIP+ implementation and decreased by $99.97 (95% CI -$119.79 to -$80.15) per person per month after April 2019. INTERPRETATION: Adopting OHIP+ increased use of public drug plans and expenditures for publicly funded prescription medicines, and the program modification was associated with decreases in both outcomes. This study's findings can inform the national pharmacare debate; future research should investigate associations with health outcomes.

International treaties have mostly failed to produce their intended effects.

There are over 250,000 international treaties that aim to foster global cooperation. But are treaties actually helpful for addressing global challenges? This systematic field-wide evidence synthesis of 224 primary studies and meta-analysis of the higher-quality 82 studies finds treaties have mostly failed to produce their intended effects. The only exceptions are treaties governing international trade and finance, which consistently produced intended effects. We also found evidence that impactful treaties achieve their effects through socialization and normative processes rather than longer-term legal processes and that enforcement mechanisms are the only modifiable treaty design choice with the potential to improve the effectiveness of treaties governing environmental, human rights, humanitarian, maritime, and security policy domains. This evidence synthesis raises doubts about the value of international treaties that neither regulate trade or finance nor contain enforcement mechanisms.

Enhancing the use of technology in the long-term care sector in Canada: Insights from citizen panels and a national stakeholder dialogue.

Enhancing the use of technology in long-term care has been identified as a key part of broader efforts to strengthen the sector in the wake of the COVID-19 pandemic. To inform such efforts, we convened a series of citizen panels, followed by a national stakeholder dialogue with system leaders focused on reimagining the long-term care sector using technology. Key actions prioritized through the deliberations convened included: developing an innovation roadmap/agenda (including national standards and guidelines); using co-design approaches for the strengthening the long-term care sector and for technological innovation; identifying and coordinating existing innovation projects to support scale and spread; enabling rapid-learning and improvement cycles to support the development, evaluation, and implementation of new technologies; and using funding models that enable the flexibility needed for such rapid-learning cycles.

Development of a STandard reporting guideline for Evidence briefs for Policy (STEP): context and study protocol.

BACKGROUND: Evidence briefs for policy (EBP) draw on best-available data and research evidence (e.g., systematic reviews) to help clarify policy problems, frame options for addressing them, and identify implementation considerations for policymakers in a given context. An increasing number of governments, non-governmental organizations and research groups have been developing EBP on a wide variety of topics. However, the reporting characteristics of EBP vary across organizations due to a lack of internationally accepted standard reporting guidelines. This project aims to develop a STandard reporting guideline of Evidence briefs for Policy (STEP), which will encompass a reporting checklist and a STEP statement and a user manual. METHODS: We will refer to and adapt the methods recommended by the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) network. The key actions include: (1) developing a protocol; (2) establishing an international multidisciplinary STEP working group (consisting of a Coordination Team and a Delphi Panel); (3) generating an initial draft of the potential items for the STEP reporting checklist through a comprehensive review of EBP-related literature and documents; (4) conducting a modified Delphi process to select and refine the reporting checklist; (5) using the STEP to evaluate published policy briefs in different countries; (6) finalizing the checklist; (7) developing the STEP statement and the user manual (8) translating the STEP into different languages; and (9) testing the reliability through real world use. DISCUSSION: Our protocol describes the development process for STEP. It will directly address what and how information should be reported in EBP and contribute to improving their quality. The decision-makers, researchers, journal editors, evaluators, and other stakeholders who support evidence-informed policymaking through the use of mechanisms like EBP will benefit from the STEP. Registration We registered the protocol on the EQUATOR network. ( https://www.equator-network.org/library/reporting-guidelines-under-development/#84 ).