Translating Evaluation Policy Into Practice in Government Organizations.

Organizational evaluation policies describe how evaluation practices should be structured and implemented. As such, they provide key insights into organizational priorities and values regarding evaluation. However, the link between evaluation policies and how evaluation policies translate into concrete practices has seldom been explored until now. Our study examines the implementation of two Canadian federal government evaluation policies over a 10-year timespan, through the secondary analysis of reports produced on behalf of governmental evaluation functions. Our findings show that some policy elements have been fully implemented, but the way in which these have been implemented varies between organizations. Further, we observed that the level of control of various organizational members responsible for implementing policy elements, as well as time, can influence implementation of certain policy requirements. We conclude by proposing further directions for research to examine the policy-practice link.

Laying a Solid Foundation for the Next Generation of Evaluation Capacity Building: Findings from an Integrative Review.

Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation journals. More specifically, the article aims to answer three questions: What types of articles and themes comprise the current literature on ECB? How are current practices of ECB described in the literature? And what is the current status of research on ECB? Informed by the findings of the review, the article concludes with suggestions for future ECB practice and scholarship.

[Improving the complementarity of patient education proposals: Experience feedback and recommendations]. / Améliorer la complémentarité des offres d'éducation thérapeutique du patient : retour d'expérience et recommandations.

INTRODUCTION: Implementing patient education (PE) in a defined geographic area, based on a population-based approach, implies using community resources according to a logic of complementarity, in order to mitigate the risk of rupture in patient care. METHODS: The PE Resource Centre for the Ile-de-France Region convened a multidisciplinary and multi-setting meeting attended by 45 participants in order to define the ways to improve the complementarity of all available PE resources, while taking into account the diversity of patients' needs. Three working groups successively explored three dimensions: structure, processes and outcomes, in order to assess this complementarity. RESULTS: Each group worked on three aspects: PE resources; patient's health trajectory in a defined geographic area, and a multidisciplinary team approach.Participants identified various deficits: clustering and lack of visibility for PE resources, programme framing constraints and difficulties of access for patients. Nevertheless, they highlighted several positive elements emerging from their shared experience. They recommend: 1) sharing of the available resources by developing communication and multidisciplinary training and more flexible programme formats; 2) building links between stakeholders, by promoting local PE programmes, and by encouraging coordination and practice analysis; 3) using and articulating a diversity of evaluation approaches, while reinforcing the multidimensional nature of PE contributions, not only for patients but also for professionals and the healthcare system. DISCUSSION: PE Resource Centres may facilitate implementation of these recommendations by supporting a collective and dynamic approach, contributing to a reduction of social inequalities in PE access.

[Cognitive dimensions of public health intervention: support for two primary healthcare projects in rural areas]. / Les dimensions cognitives de l’intervention en santé publique : l’accompagnement de deux projets de santé de premier recours en milieu rural.

Some public health interventions are designed to support transformation of primary health care services, by transforming an individual structure into a collective healthcare structure. These interventions can be considered to be knowledge-generating processes, as they help the actors involved in development of a healthcare project to objectify and collectively share a common position on the future supply of primary care. This shared vision helps them to adopt a project approach in that this shared knowledge provides meaning to their action. They can also help project stakeholders to know and recognize each other as primary care partners, thus initiating the development of a health care team. This approach helps to enhance and formalize coordination of existing practices and event new coordination practices. Collective knowledge is therefore generated by actors and capitalized by the third party. This knowledge can be used to objectify individual experiences and consequently facilitates reflexivity of the actors. Finally, the field response can be considered to be a dynamic conversion.

Examining the competencies required by evaluation capacity builders in community-based organizations.

Increasing demand for evidence generated through program evaluation has led many community-based organizations (CBOs) to seek external support for evaluation capacity building (ECB). However, studies have yet to explore the essential competencies required by evaluation capacity builders working in the community sector. Our qualitative study aimed to examine the perceptions of ECB practitioners (n = 12) regarding essential competencies for building evaluation capacity in this sector. Our findings reveal that ECB practice requires competencies not found in known evaluation competency frameworks, such as instructional design, knowledge of organizational change models, motivating stakeholders, and understanding of the community sector. Our findings provide valuable information to help guide future education and training related to building the evaluation capacity of community organizations.

Mapping the evaluation capacity building landscape: A bibliometric analysis of scholarly communities and themes.

Evaluation capacity building (ECB) continues to attract attention. Over the past two decades, a broad literature has emerged-covering the dimensions, contexts, and practices of ECB. This article presents findings from a bibliometric analysis of ECB articles published in six evaluation journals from 2000 to 2019. The findings shed light on the communities of scholars that contribute to the ECB knowledge base, the connections between these communities, and the themes they cover. Informed by the findings, future directions for ECB scholarship and how bibliometric analysis can supplement more established approaches to literature reviews are discussed.

Polyethlyene Glycol 200 Can Protect Rats Against Drug-Induced Kidney Toxicity Through Inhibition of the Renal Organic Anion Transporter 3.

MK-7680, a cyclic nucleotide prodrug, caused significant kidney tubule injury in female rats when administered orally at 1000 mg/kg/day for 2 weeks using 10% Polysorbate 80 as vehicle. However, kidney injury was absent when MK-7680 was administered at the same dose regimen using 100% Polyethylene Glycol 200 (PEG 200) as the vehicle. Subsequent investigations revealed that MK-7680 triphosphate concentrations in kidney were much lower in rats treated with MK-7680 using PEG 200 compared with 10% Polysorbate 80 vehicle, whereas plasma exposures of MK-7680 prodrug were similar. In vitro studies demonstrated that PEG 200 is an inhibitor of human renal uptake transporter organic anion transporter 3 (OAT3), of which MK-7680 is a substrate. Furthermore, PEG 200 and PEG 400 were found to interfere in vitro with human renal transporters OAT3, organic cation transporter (OCT) 2, multidrug resistance-associated protein (MRP) 2 and 4, and multidrug and toxin extrusion protein (MATE) 1 and 2K, but not OAT1. These results support a conclusion that PEG 200 may prevent MK-7680-induced kidney injury by inhibiting its active uptake into proximal tubular cells by OAT3. Caution should be exercised therefore when using PEGs as vehicles for toxicity assessment for compounds that are substrates of renal transporters.

The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis.

Evaluation recommendations are sometimes included in evaluation reports to highlight specific actions to be taken to improve a program or to make other changes to its operational context. This preliminary study sought to examine evaluation recommendations drawn from 25 evaluation reports published by Canadian federal government departments and agencies, in order to examine the evaluation issues covered and the focus of the recommendations. Our results show that in keeping with policy requirements, the evaluation recommendations focused on program relevance, effectiveness and efficiency and economy. Furthermore, a significant number of recommendations also focused on the implementation of more rigorous performance measurement strategies. The focus of the recommendations did not vary by publication date, recommendation type, and organizational sector. The findings also show that for the most part, the management responses produced as part of the broader evaluation process support the recommendations included in the report and identify specific timelines for implementation.

Application of an organizational evaluation capacity self-assessment instrument to different organizations: similarities and lessons learned.

Organizational evaluation capacity (EC) has received significant attention in the evaluation research literature in the past decade. Much of the focus has been on defining organizational evaluation capacity, which can be thought of as the competencies and structures required to conduct high-quality evaluation studies (capacity to do), as well as the organization's ability to integrate evaluation findings into its decision-making processes (capacity to use). This paper seeks to contribute to this growing body of knowledge through a multiple case study of EC across three different organizations (e.g., non-profit, provincial government and federal government, herein named sectors); the novelty of this particular study is that each case study is based on the use of a common measurement tool developed by Bourgeois, Toews, Whynot and Lamarche (2013). The cross-case analysis presented in the paper reveals that evaluation capacity tends to be higher, both in terms of capacity to do and capacity to use, in organizations that have developed systematic mechanisms to institute an evaluation culture within their walls. Interestingly, however, we also found that capacity to use does not first require capacity to do, as evidenced in the non-profit organization under study.

Using hybrid models to support the development of organizational evaluation capacity: a case narrative.

The ongoing need for public sector organizations to enhance their internal evaluation capacity is increasingly resulting in the use of hybrid evaluation project models, where internal evaluators work with external contracted evaluators to complete evaluative work. This paper first seeks to identify what is currently known about internal evaluation through a synthesis of the literature in this area. It then presents a case narrative illustrating how internal and external evaluation approaches may be used together to strengthen an evaluation project and to develop the evaluation capacity of the organization. Lessons learned include the need to integrate internal and external resources throughout the evaluation and to clarify expectations at the outset of the project.