A comprehensive monitoring and evaluation framework for evidence to policy networks.

OBJECTIVE: To describe the development of a framework for monitoring and evaluating knowledge translation (KT) networks. METHOD: The framework was developed using mixed methods over four phases, including i) a targeted literature review of KT networks, activities and indicators, ii) two scoping reviews to further enhance the set of indicators, iii) peer-reviews by international KT experts and an online expert consultation, and iv) piloting. RESULTS: A comprehensive theory of change (ToC) and indicators, both for the Network Secretariat and its participating member countries, were identified to develop the monitoring and evaluation framework. The framework includes (i) a ToC, including three key indicator domains across the results chain (outputs, short term outcomes, intermediate outcomes), and (ii) indicators for the three key domains, that can be selected depending on the stage of network maturity, along with suggested data collection methods. The three key indicator domains are 1) KT capacity and skill building; 2) network (structure, governance and leadership); and 3) KT/evidence-informed policy value and culture. CONCLUSION: The monitoring and evaluation framework that links KT activities with policy and health outcomes fills an important gap in optimizing KT procedures, generating lessons learned and increasing accountability of major multipartner KT networks.

Evaluation of the performance and achievements of the WHO Evidence-informed Policy Network (EVIPNet) Europe.

BACKGROUND: The Evidence-informed Policy Network (EVIPNet) is one of the key mechanisms introduced by WHO to reduce the research-to-policy gap. EVIPNet Europe was launched in 2012. We evaluated the performance and achievements of EVIPNet Europe with the overall aims (1) to inform future developments and strategic planning of EVIPNet Europe and (2) to contribute to the evidence base for organisational knowledge translation activities by sharing the lessons learnt. METHODS: The evaluation covered the WHO Secretariat of EVIPNet Europe and its 21 member countries, from its inception to mid-2018. A mixed methods design was used to assess changes in three domains, including triangulation of quantitative and qualitative methods, based on the EVIPNet Europe Monitoring & Evaluation framework and theory of change. Data were collected between August and October 2018. Data collection comprised documentary review, social media analysis, online country evaluation, key informant interviews and validated tools. Two case studies were also developed. RESULTS: The evaluation showed promising results as well as lessons to guide the future development of EVIPNet in the WHO European Region and other regions of the world. EVIPNet Europe appears to be filling a niche in promoting the capacity of Network member countries for evidence-informed policy-making. There is evidence that EVIPNet Europe's capacity-building programme of work is improving knowledge and skills at the individual level. There has been an increase in activity and outputs since its establishment and evidence has been used to inform new policies in some member countries. However, the speed at which member countries are developing or publishing products varies greatly and no formalised knowledge translation platforms have yet been created. Financial and human resources are limited and staff turnover is a cause for concern, both at the WHO Secretariat and country team levels. CONCLUSIONS: Six years since the launch of EVIPNet Europe, the Network has grown quickly, is clearly valued and has had some successes. However, more work and support are needed if it is to achieve its vision of a Europe in which high-quality, context-sensitive evidence routinely informs health decision-making processes that ultimately serve to strengthen health outcomes across the Region.

Alcohol Misuse and Injury Outcomes in Young People Aged 10-24.

PURPOSE: The burden of alcohol-attributable disease is a global problem. Young people often present to emergency health-care services with alcohol intoxication but little is known about how best to intervene at that point to improve future health outcomes. This study aimed to assess whether young people with an alcohol-specific hospital admission are at increased risk of injury following discharge. METHODS: A cohort study was conducted using a general population of 10- to 24-year-olds identified using primary care medical records with linked hospital admission records between 1998 and 2013. Exposed individuals had an alcohol-specific admission. Unexposed individuals did not and were frequency matched by age (±5 years) and general practice (ratio 10:1). Incidence rates of injury-related hospital admission post discharge were calculated, and hazard ratios (HR) were estimated by Cox regression. RESULTS: The cohort comprised 11,042 exposed and 110,656 unexposed individuals with 4,944 injury-related admissions during follow-up (2,092 in exposed). Injury rates were six times higher in those with a prior alcohol admission (73.92 per 1,000 person-years, 95% confidence interval (CI) 70.82-77.16 vs. 12.36, 11.91-12.81). The risk of an injury admission was highest in the month following an alcohol-specific admission (adjusted HR = 15.62, 95% CI 14.08-17.34), and remained higher compared to those with no previous alcohol-specific admission at 1 year (HR 5.28 (95% CI 4.97-5.60)) and throughout follow-up. CONCLUSIONS: Young people with an alcohol-specific admission are at increased risk of subsequent injury requiring hospitalization, especially immediately post discharge, indicating a need for prompt intervention as soon as alcohol misuse behaviors are identified.

The impact of patient participation direct enhanced service on patient reference groups in primary care: a qualitative study.

BACKGROUND: NHS policy documents continue to make a wide-ranging commitment to patient involvement. The Patient Participation Direct Enhanced Service (PP-DES), launched in 2011, aimed to ensure patients are involved in decisions about the range and quality of services provided and commissioned by their practice through patient reference groups (PRGs). The aim of this exploratory study is to review the impact of the PP-DES (2011-13) on a sample of PRGs and assess how far it has facilitated their involvement in decisions about the services of their general practices. METHODS: A qualitative methods design, using semi- structured interviews and focus groups, was employed to explore the experiences and views of GP practice staff (n = 24), PRG members (n = 80) at 12 GP practices, and other stakeholders (n = 4). RESULTS: Wide variation in the role and remit of the participating PRGs was found, which broadly ranged from activities to improve practice resources to supporting health promotion activities. The majority of PRG members were unfamiliar with the PP-DES scheme and its aims and purpose. Stakeholders and practice staff felt strongly that the main success of the PP-DES was that it had led to an increase in the number of PRGs being established in the locality. CONCLUSION: The PP-DES scheme has been a catalyst to establish PRGs. However, the picture was mixed in terms of the PRGs involvement in decisions about the services provided at their general practice as there was wide variation in the PRGs role and remit. The financial incentive alone, provided via the DES scheme, did not secure greater depth of PRG activity and power, however, as social factors were identified as playing an important role in PRGs' level of participation in decision making. Many PRGs have to become more firmly established before they are involved as partners in commissioning decisions at their practice.