Translating research into action: an international study of the role of research funders.

BACKGROUND: It is widely accepted that research can lead to improved health outcomes. However, translating research into meaningful impacts in peoples' lives requires actions that stretch well beyond those traditionally associated with knowledge creation. The research reported in this manuscript provides an international review of health research funders' efforts to encourage this process of research uptake, application and scaling, often referred to as knowledge translation. METHODS: We conducted web-site review, document review and key informant interviews to investigate knowledge translation at 26 research funding agencies. The sample comprises the regions of Australia, Europe and North America, and a diverse range of funder types, including biomedical, clinical, multi-health domain, philanthropic, public and private organisations. The data builds on a 2008 study by the authors with the same international sample, which permitted longitudinal trend analysis. RESULTS: Knowledge translation is an objective of growing significance for funders across each region studied. However, there is no clear international consensus or standard on how funders might support knowledge translation. We found that approaches and mechanisms vary across region and funder type. Strategically tailored funding opportunities (grants) are the most prevalent modality of support. The most common funder-driven strategy for knowledge translation within these grants is the linking of researchers to research users. Funders could not to provide empirical evidence to support the majority of the knowledge translation activities they encourage or undertake. CONCLUSIONS: Knowledge translation at a research funder relies on context. Accordingly, we suggest that the diversity of approaches uncovered in our research is fitting. We argue that evaluation of funding agency efforts to promote and/or support knowledge translation should be prioritised and actioned. It is paradoxical that funders' efforts to get evidence into practice are not themselves evidence based.

Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651].

BACKGROUND: Evidence on the effectiveness of printed educational messages in contributing to increasing evidence-based clinical practice is contradictory. Nonetheless, these messages flood physician offices, in an attempt to promote treatments that can reduce costs while improving patient outcomes. This study evaluated the ability of printed educational messages to promote the choice of thiazides as the first-line treatment for individuals newly diagnosed with hypertension, a practice supported by good evidence and included in guidelines, and one which could reduce costs to the health care system. METHODS: The study uses a pragmatic, cluster randomized controlled trial (randomized by physician practice group). SETTING: The setting involves all Ontario general/family practice physicians. Messages advising the use of thiazides as the first-line treatment of hypertension were mailed to each physician in conjunction with a widely read professional newsletter. Physicians were randomized to receive differing versions of printed educational messages: an "insert" (two-page evidence-based article) and/or one of two different versions of an "outsert" (short, directive message stapled to the outside of the newsletter). One outsert was developed without an explicit theory and one with messages developed targeting factors from the theory of planned behaviour or neither (newsletter only, with no mention of thiazides). The percentage of patients aged over 65 and newly diagnosed with hypertension who were prescribed a thiazide as the sole initial prescription medication. The effect of the intervention was estimated using a logistic regression model estimated using generalized estimating equation methods to account for the clustering of patients within physician practices. RESULTS: Four thousand five hundred four physicians (with 23,508 patients) were randomized, providing 97 % power to detect a 5 % absolute increase in prescription of thiazides. No intervention effect was detected. Thiazides were prescribed to 27.6 % of the patients who saw control physicians, 27.4 % for the insert, 26.8 % for the outsert and 28.3 % of the patients who saw insert + outsert physicians, p = 0.54. CONCLUSIONS: The study conclusively failed to demonstrate any impact of the printed educational messages on increasing prescribing of thiazide diuretics for first-line management of hypertension. TRIAL REGISTRATION: ISRCTN72772651.

A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651].

BACKGROUND: Pragmatic trials of implementation interventions focus on evaluating whether an intervention changes professional behaviour under real-world conditions rather than investigating the mechanism through which change occurs. Theory-based process evaluations conducted alongside pragmatic randomised trials address this by assessing whether the intervention changes theoretical constructs proposed to mediate change. The Ontario Printed Educational Materials (PEM) cluster trial was designed to increase family physicians' guideline-recommended prescription of thiazide diuretics. The trial found no intervention effect. Using the theory of planned behaviour (TPB), we hypothesised that changes in thiazide prescribing would be reflected in changes in intention, consistent with changes in attitude and subjective norm, with no change to their perceived behavioural control (PBC), and tested this alongside the RCT. METHODS: We developed and sent TPB postal questionnaires to a random sub-sample of family physicians in each trial arm 2 months before and 6 months after dissemination of the PEMs. We used analysis of covariance to test for group differences using a 2 × 3 factorial design. We content-analysed an open-ended question about perceived barriers to thiazide prescription. Using control group data, we tested whether baseline measures of TPB constructs predicted self-reported thiazide prescribing at follow-up. RESULTS: Four hundred twenty-six physicians completed pre- and post-intervention questionnaires. Baseline scores on measures of TPB constructs were high: intention mean = 5.9 out of 7 (SD = 1.4), attitude mean = 5.8 (SD = 1.1), subjective norm mean = 5.8 (SD = 1.1) and PBC mean = 6.2 (SD = 1.0). The arms did not significantly differ post-intervention on any of the theory-based constructs, suggesting a possible ceiling effect. Content analysis of perceived barriers suggested post-intentional barriers to prescribing thiazides most often focused on specific patient clinical characteristics and potential side effects. Baseline intention (ß = 0.63, p < 0.01) but not PBC (ß = 0.04, p = 0.78) predicted 42.6 % of the variance in self-reported behaviour at follow-up in the control group. CONCLUSIONS: Congruent with the Ontario Printed Educational Messages trial results and aligned with the TPB, we saw no impact of the intervention on any TPB constructs. The theoretical basis of this evaluation suggests possible explanations for the failure of the PEM intervention to change professional behaviour, which can directly inform the design and content of future theory-based PEM interventions to change professional behaviour. TRIAL REGISTRATION: ISRCTN, Canada ISRCTN72772651.

Research funder required research partnerships: a qualitative inquiry.

BACKGROUND: Researchers and funding agencies are increasingly showing interest in the application of research findings and focusing attention on engagement of knowledge-users in the research process as a means of increasing the uptake of research findings. The expectation is that research findings derived from these researcher-knowledge-user partnerships will be more readily applied when they became available. The objective of this study was to investigate the experiences, perceived barriers, successes, and opinions of researchers and knowledge-users funded under the Canadian Institutes of Health Research's integrated Knowledge Translation funding opportunities for a better understanding of these collaborations. METHODS: Participants, both researchers and knowledge-users, completed an online survey followed by an individual semi-structured phone interview supporting a mixed methods study. The interviews were analyzed qualitatively using a modified grounded theory approach. RESULTS: Survey analysis identified three major partnership types: token, asymmetric, and egalitarian. Interview analysis revealed trends in perceived barriers and successes directly related to the partnership formation and style. While all partnerships experienced barriers, token partnerships had the most challenges and general poor perception of partnerships. The majority of respondents found that common goals and equality in partnerships did not remove barriers but increased participants' ability to look for solutions. CONCLUSIONS: We learned of effective mechanisms and strategies used by researchers and knowledge-users for mitigating barriers when collaborating. Funders could take a larger role in helping facilitate, nurture, and sustain the partnerships to which they award grants.

Looking inside the black box: results of a theory-based process evaluation exploring the results of a randomized controlled trial of printed educational messages to increase primary care physicians' diabetic retinopathy referrals [Trial registration number ISRCTN72772651].

BACKGROUND: Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians' intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control. METHODS: Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main Outcome Measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control. RESULTS: At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening. CONCLUSIONS: Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior. TRIAL REGISTRATION: ISRCTN72772651.

Understanding the performance and impact of public knowledge translation funding interventions: protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs.

BACKGROUND: The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. DESIGN: The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. DISCUSSION: The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated.

Mining the management literature for insights into implementing evidence-based change in healthcare.

OBJECTIVE: We synthesized the management and health literatures for insights into implementing evidence-based change in healthcare drawn from industry-specific data. Because change principles based on evidence often fail to be translated into organizational practice or policy, we sought studies at the nexus of organizational change and knowledge translation. METHODS: We reviewed five top management journals to identify an initial pool of 3,091 studies, which yielded a final sample of 100 studies. Data were abstracted, verified by the original authors and revised before entry into a database. We employed a systematic narrative synthesis approach using words and text to distill data and explain relationships. We categorized studies by varying levels of relevance for knowledge translation as (1) primary, direct; (2) intermediate; and (3) secondary, indirect. We also identified recurring categories of change-related organizational factors. The current analysis examines these factors in studies of primary relevance to knowledge translation, which we also coded for intervention readiness to reflect how readily change can be implemented. Preliminary RESULTS AND CONCLUSIONS: Results centred on five change-related categories: Tailoring the Intervention Message; Institutional Links/Social Networks; Training; Quality of Work Relationships; and Fit to Organization. In particular, networks across institutional and individual levels appeared as prominent pathways for changing healthcare organizations. Power dynamics, positive social relations and team structures also played key roles in implementing change and translating it into practice. We analyzed journals in which first authors of these studies typically publish, and found evidence that management and health sciences remain divided. Bridging these disciplines through research syntheses promises a wealth of evidence and insights, well worth mining in the search for change that works in healthcare transformation.

What does it mean to transform knowledge into action in falls prevention research? Perspectives from the Canadian Institutes of Health Research.

INTRODUCTION: The concept of knowledge translation as defined by the Canadian Institutes for Health Research and the Knowledge to Action Cycle, described by Graham et al (Graham et al., 2006), are used to make a case for the importance of using a conceptual model to describe moving knowledge into action in the area of falls prevention. METHOD: There is a large body of research in the area of falls prevention. It would seem that in many areas it is clear what is needed to prevent falls and further syntheses can determine where the evidence is sufficiently robust to warrant its implementation as well as where the gaps are that require further basic research. CONCLUSION: The phases of the action cycle highlight seven areas that should be paid attention to in order to maximize chances of successful implementation.

Knowledge translation is the use of knowledge in health care decision making.

OBJECTIVE: To provide an overview of the science and practice of knowledge translation. STUDY DESIGN: Narrative review outlining what knowledge translation is and a framework for its use. RESULTS: Knowledge translation is defined as the use of knowledge in practice and decision making by the public, patients, health care professionals, managers, and policy makers. Failures to use research evidence to inform decision making are apparent across all these key decision maker groups. There are several proposed theories and frameworks for achieving knowledge translation. A conceptual framework developed by Graham et al., termed the knowledge-to-action cycle, provides an approach that builds on the commonalities found in an assessment of planned action theories. CONCLUSIONS: Review of the evidence base for the science and practice of knowledge translation has identified several gaps including the need to develop valid strategies for assessing the determinants of knowledge use and for evaluating sustainability of knowledge translation interventions.

Learning from the U.S. Department of Veterans Affairs Quality Enhancement Research Initiative: QUERI Series.

As the recent collection of papers from the Quality Enhancement Research Initiative (QUERI) Series indicates, knowledge is leading to considerable action in the United States (U.S.) Department of Veterans Affairs (VA). The QUERI Series offers clinical researchers, implementation scientists, health systems, and health research funders from around the globe a unique window into the both the practice and science of implementation or knowledge translation (KT) in the VA. By describing successes and challenges as well as setbacks and disappointments, the QUERI Series is all the more useful. From the vantage point of Canadian KT researchers and officials at a national health research funding agency, we offer a number of observations and lessons that can be learned from QUERI. "Knowledge, if it does not determine action, is dead to us." Plotinus (Roman philosopher 205AD-270AD).

An international survey indicated that unpublished systematic reviews exist.

OBJECTIVE: To determine the frequency of unpublished systematic reviews (SRs) and explore factors contributing to their occurrence. STUDY DESIGN AND SETTING: First or corresponding authors from a sample of SRs published in 2005 were asked to participate in a 26-item survey administered through the Internet, facsimile, and postal mail. Outcomes included median and range of published and unpublished SRs, and barriers, facilitators, and reasons for not publishing SRs. Descriptive analyses were performed. RESULTS: 55.7% (348 of 625) of those invited participated, half of which were from Europe and 22.7% were from the United States. Participants reported 1,405 published (median: 2.0, range: 1-150) and 199 unpublished (median: 2.0, range: 1-33) SRs. Lack of time and lack of funding and organizational support were barriers, whereas time availability and self-motivation were facilitators to publishing reviews. For most recent unpublished SRs (n=52), the reasons for not publishing included lack of time (12 of 52, 23.0%), the manuscript being rejected (10 of 52, 19.0%), and operational issues (six of 52, 11.5%). CONCLUSION: Unpublished SRs do exist. Lack of time, funding, and organizational support were consistent reasons for not publishing SRs. Statistical significance of SR results was not reported as being a major barrier or reason for not publishing. Further research on unpublished SRs is warranted.

Funding agencies in low- and middle-income countries: support for knowledge translation.

OBJECTIVE: The aim was to describe how selected health research funding agencies active in low- and middle-income countries promote the translation of their funded research into policy and practice. METHODS: We conducted inductive analysis of semi-structured interviews with key informants from a purposive sample of 23 national and international funding agencies that fund health research in Brazil, Colombia, India, the Philippines, South Africa and Thailand. We also surveyed web sites. FINDINGS: We found a commitment to knowledge translation in the mandate of 18 of 23 agencies. However, there was a lack of common terminology. Most of the activities were traditional efforts to disseminate to a broad audience, for example using web sites and publications. In addition, more than half (13 of 23) of the agencies encouraged linkage/exchange between researchers and potential users, and 6 of 23 agencies described "pull" activities to generate interest in research from decision-makers. One-third (9 of 23) of funding agencies described a mandate to enhance health equity through improving knowledge translation. Only 3 of 23 agencies were able to describe evaluation of knowledge translation activities. Furthermore, we found national funding agencies made greater knowledge translation efforts when compared to international agencies. CONCLUSION: Funding agencies are engaged in a wide range of creative knowledge translation activities. They might consider their role as knowledge brokers, with an ability to promote research syntheses and a focus on health equity. There is an urgent need to evaluate the knowledge translation activities of funding agencies.

Health research funding agencies' support and promotion of knowledge translation: an international study.

CONTEXT: The process of knowledge translation (KT) in health research depends on the activities of a wide range of actors, including health professionals, researchers, the public, policymakers, and research funders. Little is known, however, about health research funding agencies' support and promotion of KT. Our team asked thirty-three agencies from Australia, Canada, France, the Netherlands, Scandinavia, the United Kingdom, and the United States about their role in promoting the results of the research they fund. METHODS: Semistructured interviews were conducted with a sample of key informants from applied health funding agencies identified by the investigators. The interviews were supplemented with information from the agencies' websites. The final coding was derived from an iterative thematic analysis. FINDINGS: There was a lack of clarity between agencies as to what is meant by KT and how it is operationalized. Agencies also varied in their degree of engagement in this process. The agencies' abilities to create a pull for research findings; to engage in linkage and exchange between agencies, researchers, and decision makers; and to push results to various audiences differed as well. Finally, the evaluation of the effectiveness of KT strategies remains a methodological challenge. CONCLUSIONS: Funding agencies need to think about both their conceptual framework and their operational definition of KT, so that it is clear what is and what is not considered to be KT, and adjust their funding opportunities and activities accordingly. While we have cataloged the range of knowledge translation activities conducted across these agencies, little is known about their effectiveness and so a greater emphasis on evaluation is needed. It would appear that "best practice" for funding agencies is an elusive concept depending on the particular agency's size, context, mandate, financial considerations, and governance structure.

Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada.

BACKGROUND: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths).This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/DESIGN: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.