Research for Policy (R4P): development of a reflection tool for researchers to improve knowledge utilization.

BACKGROUND: To improve knowledge utilization in policymaking, alignment between researchers and policymakers during knowledge production is essential, but difficult to maintain. In three previously reported case studies, we extensively evaluated complex research projects commissioned by policymakers to investigate how alignment is achieved in a research process and to discover ways to enhance knowledge contributions to health policy. In the present study, we investigated how the findings of these three research projects could be integrated into a practical tool for researchers to enhance their contribution to evidence-based policy. METHODS: A cross-case analysis was conducted to integrate the findings of the evaluation of the three research projects and to identify important alignment areas in these projects. By means of an iterative process, we prepared a tool that includes reflection questions for researchers. The "Research for Policy" tool was tested with input from the project managers of three new research projects. Based on the findings, the final version of the Research for Policy tool was prepared. RESULTS: By cross-case analysis of the three case studies, the following important alignment areas were identified: the goal, quality, relevance, timing, and presentation of research, the tasks and authorities of actors, the consultative structure and vertical alignment within organizations, and the organizational environment. The project managers regarded the Research for Policy tool as a useful checklist for addressing the important alignment areas in a research project. Based on their feedback, the illustrative examples from the case studies were added to the reflection questions. The project managers suggested making the tool accessible not only to researchers but also to policymakers. The format of the Research for Policy tool was further adjusted to users' needs by adding clickable links. CONCLUSIONS: Alignment between research and policymaking requires continuous efforts and a clear understanding of process issues in the research project. The Research for Policy tool offers practical alignment guidance and facilitates reflection on process issues, which supports researchers in aligning with policymakers and in acting in a context-sensitive way.

Enhancing the contribution of research to health care policy-making: a case study of the Dutch Health Care Performance Report.

OBJECTIVES: The Dutch Health Care Performance Report, issued by the National Institute of Public Health and the Environment, aims to monitor health care performance in The Netherlands. Both the National Institute and the Ministry of Health wish to increase the contribution of the Report to health care policy-making. Our aim was to identify ways to achieve that. METHOD: We used contribution mapping as a theoretical framework that recognizes alignment of research as crucial to managing contributions to policy-making. To investigate which areas need alignment efforts by researchers and/or policy-makers, we interviewed National Institute researchers and policy-makers from the Ministry of Health and assessed the process for developing the 2010 Report. RESULTS: We identified six areas where alignment is specifically relevant for enhancing the contributions of future versions of the Dutch Health Care Performance Report: well-balanced information for different ministerial directorates; backstage work; double role actors; reports of other knowledge institutes; data collection/generation and presentation forms. CONCLUSION: The contribution of health care performance reporting to policy-making is complex and requires continuous alignment efforts between researchers and policy-makers. These efforts should form an inseparable part of health care performance reporting and although this demands considerable resources, it is worth considering since it may pay back in better contributions to policy-making.

The Dutch Health Care Performance Report: seven years of health care performance assessment in the Netherlands.

In 2006, the first edition of a monitoring tool for the performance of the Dutch health care system was released: the Dutch Health Care Performance Report (DHCPR). The Netherlands was among the first countries in the world developing such a comprehensive tool for reporting performance on quality, access, and affordability of health care. The tool contains 125 performance indicators; the choice for specific indicators resulted from a dialogue between researchers and policy makers. In the 'policy cycle', the DHCPR can rationally be placed between evaluation (accountability) and agenda-setting (for strategic decision making). In this paper, we reflect on important lessons learned after seven years of health care system performance assessment. These lessons entail the importance of a good conceptual framework for health system performance assessment, the importance of repeated measurement, the strength of combining multiple perspectives (e.g., patient, professional, objective, subjective) on the same issue, the importance of a central role for the patients' perspective in performance assessment, how to deal with the absence of data in relevant domains, the value of international benchmarking and the continuous exchange between researchers and policy makers.