Translating research into action: an international study of the role of research funders.

BACKGROUND: It is widely accepted that research can lead to improved health outcomes. However, translating research into meaningful impacts in peoples' lives requires actions that stretch well beyond those traditionally associated with knowledge creation. The research reported in this manuscript provides an international review of health research funders' efforts to encourage this process of research uptake, application and scaling, often referred to as knowledge translation. METHODS: We conducted web-site review, document review and key informant interviews to investigate knowledge translation at 26 research funding agencies. The sample comprises the regions of Australia, Europe and North America, and a diverse range of funder types, including biomedical, clinical, multi-health domain, philanthropic, public and private organisations. The data builds on a 2008 study by the authors with the same international sample, which permitted longitudinal trend analysis. RESULTS: Knowledge translation is an objective of growing significance for funders across each region studied. However, there is no clear international consensus or standard on how funders might support knowledge translation. We found that approaches and mechanisms vary across region and funder type. Strategically tailored funding opportunities (grants) are the most prevalent modality of support. The most common funder-driven strategy for knowledge translation within these grants is the linking of researchers to research users. Funders could not to provide empirical evidence to support the majority of the knowledge translation activities they encourage or undertake. CONCLUSIONS: Knowledge translation at a research funder relies on context. Accordingly, we suggest that the diversity of approaches uncovered in our research is fitting. We argue that evaluation of funding agency efforts to promote and/or support knowledge translation should be prioritised and actioned. It is paradoxical that funders' efforts to get evidence into practice are not themselves evidence based.

A theory-based process evaluation alongside a randomised controlled trial of printed educational messages to increase primary care physicians' prescription of thiazide diuretics for hypertension [ISRCTN72772651].

BACKGROUND: Pragmatic trials of implementation interventions focus on evaluating whether an intervention changes professional behaviour under real-world conditions rather than investigating the mechanism through which change occurs. Theory-based process evaluations conducted alongside pragmatic randomised trials address this by assessing whether the intervention changes theoretical constructs proposed to mediate change. The Ontario Printed Educational Materials (PEM) cluster trial was designed to increase family physicians' guideline-recommended prescription of thiazide diuretics. The trial found no intervention effect. Using the theory of planned behaviour (TPB), we hypothesised that changes in thiazide prescribing would be reflected in changes in intention, consistent with changes in attitude and subjective norm, with no change to their perceived behavioural control (PBC), and tested this alongside the RCT. METHODS: We developed and sent TPB postal questionnaires to a random sub-sample of family physicians in each trial arm 2 months before and 6 months after dissemination of the PEMs. We used analysis of covariance to test for group differences using a 2 × 3 factorial design. We content-analysed an open-ended question about perceived barriers to thiazide prescription. Using control group data, we tested whether baseline measures of TPB constructs predicted self-reported thiazide prescribing at follow-up. RESULTS: Four hundred twenty-six physicians completed pre- and post-intervention questionnaires. Baseline scores on measures of TPB constructs were high: intention mean = 5.9 out of 7 (SD = 1.4), attitude mean = 5.8 (SD = 1.1), subjective norm mean = 5.8 (SD = 1.1) and PBC mean = 6.2 (SD = 1.0). The arms did not significantly differ post-intervention on any of the theory-based constructs, suggesting a possible ceiling effect. Content analysis of perceived barriers suggested post-intentional barriers to prescribing thiazides most often focused on specific patient clinical characteristics and potential side effects. Baseline intention (ß = 0.63, p < 0.01) but not PBC (ß = 0.04, p = 0.78) predicted 42.6 % of the variance in self-reported behaviour at follow-up in the control group. CONCLUSIONS: Congruent with the Ontario Printed Educational Messages trial results and aligned with the TPB, we saw no impact of the intervention on any TPB constructs. The theoretical basis of this evaluation suggests possible explanations for the failure of the PEM intervention to change professional behaviour, which can directly inform the design and content of future theory-based PEM interventions to change professional behaviour. TRIAL REGISTRATION: ISRCTN, Canada ISRCTN72772651.

Understanding the performance and impact of public knowledge translation funding interventions: protocol for an evaluation of Canadian Institutes of Health Research knowledge translation funding programs.

BACKGROUND: The Canadian Institutes of Health Research (CIHR) has defined knowledge translation (KT) as a dynamic and iterative process that includes the synthesis, dissemination, exchange, and ethically-sound application of knowledge to improve the health of Canadians, provide more effective health services and products, and strengthen the healthcare system. CIHR, the national health research funding agency in Canada, has undertaken to advance this concept through direct research funding opportunities in KT. Because CIHR is recognized within Canada and internationally for leading and funding the advancement of KT science and practice, it is essential and timely to evaluate this intervention, and specifically, these funding opportunities. DESIGN: The study will employ a novel method of participatory, utilization-focused evaluation inspired by the principles of integrated KT. It will use a mixed methods approach, drawing on both quantitative and qualitative data, and will elicit participation from CIHR funded researchers, knowledge users, KT experts, as well as other health research funding agencies. Lines of inquiry will include an international environmental scan, document/data reviews, in-depth interviews, targeted surveys, case studies, and an expert review panel. The study will investigate how efficiently and effectively the CIHR model of KT funding programs operates, what immediate outcomes these funding mechanisms have produced, and what impact these programs have had on the broader state of health research, health research uptake, and health improvement. DISCUSSION: The protocol and results of this evaluation will be of interest to those engaged in the theory, practice, and evaluation of KT. The dissemination of the study protocol and results to both practitioners and theorists will help to fill a gap in knowledge in three areas: the role of a public research funding agency in facilitating KT, the outcomes and impacts KT funding interventions, and how KT can best be evaluated.

What does it mean to transform knowledge into action in falls prevention research? Perspectives from the Canadian Institutes of Health Research.

INTRODUCTION: The concept of knowledge translation as defined by the Canadian Institutes for Health Research and the Knowledge to Action Cycle, described by Graham et al (Graham et al., 2006), are used to make a case for the importance of using a conceptual model to describe moving knowledge into action in the area of falls prevention. METHOD: There is a large body of research in the area of falls prevention. It would seem that in many areas it is clear what is needed to prevent falls and further syntheses can determine where the evidence is sufficiently robust to warrant its implementation as well as where the gaps are that require further basic research. CONCLUSION: The phases of the action cycle highlight seven areas that should be paid attention to in order to maximize chances of successful implementation.

Knowledge translation is the use of knowledge in health care decision making.

OBJECTIVE: To provide an overview of the science and practice of knowledge translation. STUDY DESIGN: Narrative review outlining what knowledge translation is and a framework for its use. RESULTS: Knowledge translation is defined as the use of knowledge in practice and decision making by the public, patients, health care professionals, managers, and policy makers. Failures to use research evidence to inform decision making are apparent across all these key decision maker groups. There are several proposed theories and frameworks for achieving knowledge translation. A conceptual framework developed by Graham et al., termed the knowledge-to-action cycle, provides an approach that builds on the commonalities found in an assessment of planned action theories. CONCLUSIONS: Review of the evidence base for the science and practice of knowledge translation has identified several gaps including the need to develop valid strategies for assessing the determinants of knowledge use and for evaluating sustainability of knowledge translation interventions.

Health research funding agencies' support and promotion of knowledge translation: an international study.

CONTEXT: The process of knowledge translation (KT) in health research depends on the activities of a wide range of actors, including health professionals, researchers, the public, policymakers, and research funders. Little is known, however, about health research funding agencies' support and promotion of KT. Our team asked thirty-three agencies from Australia, Canada, France, the Netherlands, Scandinavia, the United Kingdom, and the United States about their role in promoting the results of the research they fund. METHODS: Semistructured interviews were conducted with a sample of key informants from applied health funding agencies identified by the investigators. The interviews were supplemented with information from the agencies' websites. The final coding was derived from an iterative thematic analysis. FINDINGS: There was a lack of clarity between agencies as to what is meant by KT and how it is operationalized. Agencies also varied in their degree of engagement in this process. The agencies' abilities to create a pull for research findings; to engage in linkage and exchange between agencies, researchers, and decision makers; and to push results to various audiences differed as well. Finally, the evaluation of the effectiveness of KT strategies remains a methodological challenge. CONCLUSIONS: Funding agencies need to think about both their conceptual framework and their operational definition of KT, so that it is clear what is and what is not considered to be KT, and adjust their funding opportunities and activities accordingly. While we have cataloged the range of knowledge translation activities conducted across these agencies, little is known about their effectiveness and so a greater emphasis on evaluation is needed. It would appear that "best practice" for funding agencies is an elusive concept depending on the particular agency's size, context, mandate, financial considerations, and governance structure.

Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada.

BACKGROUND: Randomised controlled trials of implementation strategies tell us whether (or not) an intervention results in changes in professional behaviour but little about the causal mechanisms that produce any change. Theory-based process evaluations collect data on theoretical constructs alongside randomised trials to explore possible causal mechanisms and effect modifiers. This is similar to measuring intermediate endpoints in clinical trials to further understand the biological basis of any observed effects (for example, measuring lipid profiles alongside trials of lipid lowering drugs where the primary endpoint could be reduction in vascular related deaths).This study protocol describes a theory-based process evaluation alongside the Ontario Printed Educational Message (OPEM) trial. We hypothesize that the OPEM interventions are most likely to operate through changes in physicians' behavioural intentions due to improved attitudes or subjective norms with little or no change in perceived behavioural control. We will test this hypothesis using a well-validated social cognition model, the theory of planned behaviour (TPB) that incorporates these constructs. METHODS/DESIGN: We will develop theory-based surveys using standard methods based upon the TPB for the second and third replications, and survey a subsample of Ontario family physicians from each arm of the trial two months before and six months after the dissemination of the index edition of informed, the evidence based newsletter used for the interventions. In the third replication, our study will converge with the "TRY-ME" protocol (a second study conducted alongside the OPEM trial), in which the content of educational messages was constructed using both standard methods and methods informed by psychological theory. We will modify Dillman's total design method to maximise response rates. Preliminary analyses will initially assess the internal reliability of the measures and use regression to explore the relationships between predictor and dependent variable (intention to advise diabetic patients to have annual retinopathy screening and to prescribe thiazide diuretics for first line treatment of uncomplicated hypertension). We will then compare groups using methods appropriate for comparing independent samples to determine whether there have been changes in the predicted constructs (attitudes, subjective norms, or intentions) across the study groups as hypothesised, and will assess the convergence between the process evaluation results and the main trial results.

Physicians' intentions and use of three patient decision aids.

BACKGROUND: Decision aids are evidence based tools that assist patients in making informed values-based choices and supplement the patient-clinician interaction. While there is evidence to show that decision aids improve key indicators of patients' decision quality, relatively little is known about physicians' acceptance of decision aids or factors that influence their decision to use them. The purpose of this study was to describe physicians' perceptions of three decision aids, their expressed intent to use them, and their subsequent use of them. METHODS: We conducted a cross-sectional survey of random samples of Canadian respirologists, family physicians, and geriatricians. Three decision aids representing a range of health decisions were evaluated. The survey elicited physicians' opinions on the characteristics of the decision aid and their willingness to use it. Physicians who indicated a strong likelihood of using the decision aid were contacted three months later regarding their actual use of the decision aid. RESULTS: Of the 580 eligible physicians, 47% (n = 270) returned completed questionnaires. More than 85% of the respondents felt the decision aid was well developed and that it presented the essential information for decision making in an understandable, balanced, and unbiased manner. A majority of respondents (>80%) also felt that the decision aid would guide patients in a logical way, preparing them to participate in decision making and to reach a decision. Fewer physicians (<60%) felt the decision aid would improve the quality of patient visits or be easily implemented into practice and very few (27%) felt that the decision aid would save time. Physicians' intentions to use the decision aid were related to their comfort with offering it to patients, the decision aid topic, and the perceived ease of implementing it into practice. While 54% of the surveyed physicians indicated they would use the decision aid, less than a third followed through with this intention. CONCLUSION: Despite strong support for the format, content, and quality of patient decision aids, and physicians' stated intentions to adopt them into clinical practice, most did not use them within three months of completing the survey. There is a wide gap between intention and behaviour. Further research is required to study the determinants of this intention-behaviour gap and to develop interventions aimed at barriers to physicians' use of decision aids.