Evidence on Scaling in Health and Social Care: An Umbrella Review.

Policy Points More rigorous methodologies and systematic approaches should be encouraged in the science of scaling. This will help researchers better determine the effectiveness of scaling, guide stakeholders in the scaling process, and ultimately increase the impacts of health innovations. The practice and the science of scaling need to expand worldwide to address complex health conditions such as noncommunicable and chronic diseases. Although most of the scaling experiences described in the literature are occurring in the Global South, most of the authors publishing on it are based in the Global North. As the science of scaling spreads across the world with the aim of reducing health inequities, it is also essential to address the power imbalance in how we do scaling research globally. CONTEXT: Scaling of effective innovations in health and social care is essential to increase their impact. We aimed to synthesize the evidence base on scaling and identify current knowledge gaps. METHODS: We conducted an umbrella review according to the Joanna Briggs Institute Reviewers' Manual. We included any type of review that 1) focused on scaling, 2) covered health or social care, and 3) presented a methods section. We searched MEDLINE (Ovid), Embase, PsycINFO (Ovid), CINAHL (EBSCO), Web of Science, The Cochrane Library, Sociological Abstracts (ProQuest), Academic Search Premier (EBSCO), and ProQuest Dissertations & Theses Global from their inception to August 6, 2020. We searched the gray literature using, e.g., Google and WHO-ExpandNet. We assessed methodological quality with AMSTAR2. Paired reviewers independently selected and extracted eligible reviews and assessed study quality. A narrative synthesis was performed. FINDINGS: Of 24,269 records, 137 unique reviews were included. The quality of the 58 systematic reviews was critically low (n = 42). The most frequent review type was systematic review (n = 58). Most reported on scaling in low- and middle-income countries (n = 59), whereas most first authors were from high-income countries (n = 114). Most reviews concerned infectious diseases (n = 36) or maternal-child health (n = 28). They mainly focused on interventions (n = 37), barriers and facilitators (n = 29), frameworks (n = 24), scalability (n = 24), and costs (n = 14). The WHO/ExpandNet scaling definition was the definition most frequently used (n = 26). Domains most reported as influencing scaling success were building scaling infrastructure (e.g., creating new service sites) and human resources (e.g., training community health care providers). CONCLUSIONS: The evidence base on scaling is evolving rapidly as reflected by publication trends, the range of focus areas, and diversity of scaling definitions. Our study highlights knowledge gaps around methodology and research infrastructures to facilitate equitable North-South research relationships. Common efforts are needed to ensure scaling expands the impacts of health and social innovations to broader populations.

Evidence on scaling in health and social care: protocol for a living umbrella review.

BACKGROUND: There is a growing interest in scaling effective health innovations to promote equitable access to high-quality health services worldwide. However, multiple challenges persist in scaling innovations. In this study, we aim to summarize the scaling evidence in the health and social care literature and identify current knowledge gaps. METHODS: We will conduct a living umbrella review according to the Joanna Briggs Institute Reviewers' Manual. We will consider all knowledge syntheses addressing scaling in health or social care (e.g., any setting, any clinical area) and conducted in a systematic way. We will search the following electronic databases: MEDLINE (Ovid), Embase, PsychINFO (Ovid), CINAHL (EBSCO), Web of Science, The Cochrane Library, Sociological Abstract (Proquest), Academic Search Premier (EBSCO), and Proquest Dissertations & Theses Global, from inception. Furthermore, we will conduct searches of the grey literature. No restriction regarding date or language will be applied. Each phase of the review will be processed by two independent reviewers. We will develop a data extraction form on Covidence. We will assess the methodological quality of the included reviews using AMSTAR2 and the risk of bias using ROBIS. Results will be presented in tabular form and accompanied by a narrative synthesis covering the traditional themes of scaling science that emerge from the analysis, such as coverage, range, and sustainability, as well as themes less covered in the literature, including reporting guidance, models, tools, barriers, and/or facilitators to scaling innovations, evidence regarding application in high-income or low-income countries, and end-user engagement. We will disseminate the findings via publications and through relevant networks. DISCUSSION: The findings of the umbrella review will facilitate access to scaling evidence in the literature and help strengthen the science of scaling for researchers, policy makers, and program managers. Finally, this work will highlight important knowledge gaps and help prioritize future research questions. SYSTEMATIC REVIEW REGISTRATION: This protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) on November 11, 2020 (registration number: CRD42020183774 ).

Strategies for involving patients and the public in scaling-up initiatives in health and social services: protocol for a scoping review and Delphi survey.

BACKGROUND: The scale-up of evidence-based innovations is required to reduce waste and inequities in health and social services (HSS). However, it often tends to be a top-down process initiated by policy makers, and the values of the intended beneficiaries are forgotten. Involving multiple stakeholders including patients and the public in the scaling-up process is thus essential but highly complex. We propose to identify relevant strategies for meaningfully and equitably involving patients and the public in the science and practice of scaling up in HSS. METHODS: We will adapt our overall method from the RAND/UCLA Appropriateness Method. Following this, we will perform a two-prong study design (knowledge synthesis and Delphi study) grounded in an integrated knowledge translation approach. This approach involves extensive participation of a network of stakeholders interested in patient and public involvement (PPI) in scaling up and a multidisciplinary steering committee. We will conduct a systematic scoping review following the methodology recommended in the Joanna Briggs Institute Reviewers Manual. We will use the following eligibility criteria: (1) participants-any stakeholder involved in creating or testing a strategy for PPI; (2) intervention-any PPI strategy proposed for scaling-up initiatives; (3) comparator-no restriction; (4) outcomes: any process or outcome metrics related to PPI; and (5) setting-HSS. We will search electronic databases (e.g., Medline, Web of Science, Sociological Abstract) from inception onwards, hand search relevant websites, screen the reference lists of included records, and consult experts in the field. Two reviewers will independently select and extract eligible studies. We will summarize data quantitatively and qualitatively and report results using the PRISMA extension for Scoping Reviews (PRISMA-ScR) checklist. We will conduct an online Delphi survey to achieve consensus on the relevant strategies for PPI in scaling-up initiatives in HSS. Participants will include stakeholders from low-, middle-, and high-income countries. We anticipate that three rounds will allow an acceptable degree of agreement on research priorities. DISCUSSION: Our findings will advance understanding of how to meaningfully and equitably involve patients and the public in scaling-up initiatives for sustainable HSS. SYSTEMATIC REVIEW REGISTRATION: We registered this protocol with the Open Science Framework on August 19, 2020 ( https://osf.io/zqpx7/ ).

Translating research into action: an international study of the role of research funders.

BACKGROUND: It is widely accepted that research can lead to improved health outcomes. However, translating research into meaningful impacts in peoples' lives requires actions that stretch well beyond those traditionally associated with knowledge creation. The research reported in this manuscript provides an international review of health research funders' efforts to encourage this process of research uptake, application and scaling, often referred to as knowledge translation. METHODS: We conducted web-site review, document review and key informant interviews to investigate knowledge translation at 26 research funding agencies. The sample comprises the regions of Australia, Europe and North America, and a diverse range of funder types, including biomedical, clinical, multi-health domain, philanthropic, public and private organisations. The data builds on a 2008 study by the authors with the same international sample, which permitted longitudinal trend analysis. RESULTS: Knowledge translation is an objective of growing significance for funders across each region studied. However, there is no clear international consensus or standard on how funders might support knowledge translation. We found that approaches and mechanisms vary across region and funder type. Strategically tailored funding opportunities (grants) are the most prevalent modality of support. The most common funder-driven strategy for knowledge translation within these grants is the linking of researchers to research users. Funders could not to provide empirical evidence to support the majority of the knowledge translation activities they encourage or undertake. CONCLUSIONS: Knowledge translation at a research funder relies on context. Accordingly, we suggest that the diversity of approaches uncovered in our research is fitting. We argue that evaluation of funding agency efforts to promote and/or support knowledge translation should be prioritised and actioned. It is paradoxical that funders' efforts to get evidence into practice are not themselves evidence based.

Understanding the performance and impact of public knowledge translation funding interventions: protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs.

BACKGROUND: The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. DESIGN: The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. DISCUSSION: The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated.