Theories, models and frameworks used in capacity building interventions relevant to public health: a systematic review.

BACKGROUND: There is limited research on capacity building interventions that include theoretical foundations. The purpose of this systematic review is to identify underlying theories, models and frameworks used to support capacity building interventions relevant to public health practice. The aim is to inform and improve capacity building practices and services offered by public health organizations. METHODS: Four search strategies were used: 1) electronic database searching; 2) reference lists of included papers; 3) key informant consultation; and 4) grey literature searching. Inclusion and exclusion criteria are outlined with included papers focusing on capacity building, learning plans, professional development plans in combination with tools, resources, processes, procedures, steps, model, framework, guideline, described in a public health or healthcare setting, or non-government, government, or community organizations as they relate to healthcare, and explicitly or implicitly mention a theory, model and/or framework that grounds the type of capacity building approach developed. Quality assessment were performed on all included articles. Data analysis included a process for synthesizing, analyzing and presenting descriptive summaries, categorizing theoretical foundations according to which theory, model and/or framework was used and whether or not the theory, model or framework was implied or explicitly identified. RESULTS: Nineteen articles were included in this review. A total of 28 theories, models and frameworks were identified. Of this number, two theories (Diffusion of Innovations and Transformational Learning), two models (Ecological and Interactive Systems Framework for Dissemination and Implementation) and one framework (Bloom's Taxonomy of Learning) were identified as the most frequently cited. CONCLUSIONS: This review identifies specific theories, models and frameworks to support capacity building interventions relevant to public health organizations. It provides public health practitioners with a menu of potentially usable theories, models and frameworks to support capacity building efforts. The findings also support the need for the use of theories, models or frameworks to be intentional, explicitly identified, referenced and for it to be clearly outlined how they were applied to the capacity building intervention.

Tools to support evidence-informed public health decision making.

BACKGROUND: Public health professionals are increasingly expected to engage in evidence-informed decision making to inform practice and policy decisions. Evidence-informed decision making involves the use of research evidence along with expertise, existing public health resources, knowledge about community health issues, the local context and community, and the political climate. The National Collaborating Centre for Methods and Tools has identified a seven step process for evidence-informed decision making. Tools have been developed to support public health professionals as they work through each of these steps. This paper provides an overview of tools used in three Canadian public health departments involved in a study to develop capacity for evidence-informed decision making. METHODS: As part of a knowledge translation and exchange intervention, a Knowledge Broker worked with public health professionals to identify and apply tools for use with each of the steps of evidence-informed decision making. The Knowledge Broker maintained a reflective journal and interviews were conducted with a purposive sample of decision makers and public health professionals. This paper presents qualitative analysis of the perceived usefulness and usability of the tools. RESULTS: Tools were used in the health departments to assist in: question identification and clarification; searching for the best available research evidence; assessing the research evidence for quality through critical appraisal; deciphering the 'actionable message(s)' from the research evidence; tailoring messages to the local context to ensure their relevance and suitability; deciding whether and planning how to implement research evidence in the local context; and evaluating the effectiveness of implementation efforts. Decision makers provided descriptions of how the tools were used within the health departments and made suggestions for improvement. Overall, the tools were perceived as valuable for advancing and sustaining evidence-informed decision making. CONCLUSION: Tools are available to support the process of evidence-informed decision making among public health professionals. The usability and usefulness of these tools for advancing and sustaining evidence-informed decision making are discussed, including recommendations for the tools' application in other public health settings beyond this study. Knowledge and awareness of these tools may assist other health professionals in their efforts to implement evidence-informed practice.

A realist review of interventions and strategies to promote evidence-informed healthcare: a focus on change agency.

BACKGROUND: Change agency in its various forms is one intervention aimed at improving the effectiveness of the uptake of evidence. Facilitators, knowledge brokers and opinion leaders are examples of change agency strategies used to promote knowledge utilization. This review adopts a realist approach and addresses the following question: What change agency characteristics work, for whom do they work, in what circumstances and why? METHODS: The literature reviewed spanned the period 1997-2007. Change agency was operationalized as roles that are aimed at effecting successful change in individuals and organizations. A theoretical framework, developed through stakeholder consultation formed the basis for a search for relevant literature. Team members, working in sub groups, independently themed the data and developed chains of inference to form a series of hypotheses regarding change agency and the role of change agency in knowledge use. RESULTS: 24, 478 electronic references were initially returned from search strategies. Preliminary screening of the article titles reduced the list of potentially relevant papers to 196. A review of full document versions of potentially relevant papers resulted in a final list of 52 papers. The findings add to the knowledge of change agency as they raise issues pertaining to how change agents' function, how individual change agent characteristics effect evidence-informed health care, the influence of interaction between the change agent and the setting and the overall effect of change agency on knowledge utilization. Particular issues are raised such as how accessibility of the change agent, their cultural compatibility and their attitude mediate overall effectiveness. Findings also indicate the importance of promoting reflection on practice and role modeling. The findings of this study are limited by the complexity and diversity of the change agency literature, poor indexing of literature and a lack of theory-driven approaches. CONCLUSION: This is the first realist review of change agency. Though effectiveness evidence is weak, change agent roles are evolving, as is the literature, which requires more detailed description of interventions, outcomes measures, the context, intensity, and levels at which interventions are implemented in order to understand how change agent interventions effect evidence-informed health care.

School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18.

BACKGROUND: The World Health Organization (WHO) estimates that 1.9 million deaths worldwide are attributable to physical inactivity and at least 2.6 million deaths are a result of being overweight or obese. In addition, WHO estimates that physical inactivity causes 10% to 16% of cases each of breast cancer, colon, and rectal cancers as well as type 2 diabetes, and 22% of coronary heart disease and the burden of these and other chronic diseases has rapidly increased in recent decades. OBJECTIVES: The purpose of this systematic review was to summarize the evidence of the effectiveness of school-based interventions in promoting physical activity and fitness in children and adolescents. SEARCH METHODS: The search strategy included searching several databases to October 2011. In addition, reference lists of included articles and background papers were reviewed for potentially relevant studies, as well as references from relevant Cochrane reviews. Primary authors of included studies were contacted as needed for additional information. SELECTION CRITERIA: To be included, the intervention had to be relevant to public health practice (focused on health promotion activities), not conducted by physicians, implemented, facilitated, or promoted by staff in local public health units, implemented in a school setting and aimed at increasing physical activity, included all school-attending children, and be implemented for a minimum of 12 weeks. In addition, the review was limited to randomized controlled trials and those that reported on outcomes for children and adolescents (aged 6 to 18 years). Primary outcomes included: rates of moderate to vigorous physical activity during the school day, time engaged in moderate to vigorous physical activity during the school day, and time spent watching television. Secondary outcomes related to physical health status measures including: systolic and diastolic blood pressure, blood cholesterol, body mass index (BMI), maximal oxygen uptake (VO2max), and pulse rate. DATA COLLECTION AND ANALYSIS: Standardized tools were used by two independent reviewers to assess each study for relevance and for data extraction. In addition, each study was assessed for risk of bias as specified in the Cochrane Handbook for Systematic Reviews of Interventions. Where discrepancies existed, discussion occurred until consensus was reached. The results were summarized narratively due to wide variations in the populations, interventions evaluated, and outcomes measured. MAIN RESULTS: In the original review, 13,841 records were identified and screened, 302 studies were assessed for eligibility, and 26 studies were included in the review. There was some evidence that school-based physical activity interventions had a positive impact on four of the nine outcome measures. Specifically positive effects were observed for duration of physical activity, television viewing, VO2 max, and blood cholesterol. Generally, school-based interventions had little effect on physical activity rates, systolic and diastolic blood pressure, BMI, and pulse rate. At a minimum, a combination of printed educational materials and changes to the school curriculum that promote physical activity resulted in positive effects.In this update, given the addition of three new inclusion criteria (randomized design, all school-attending children invited to participate, minimum 12-week intervention) 12 of the original 26 studies were excluded. In addition, studies published between July 2007 and October 2011 evaluating the effectiveness of school-based physical interventions were identified and if relevant included. In total an additional 2378 titles were screened of which 285 unique studies were deemed potentially relevant. Of those 30 met all relevance criteria and have been included in this update. This update includes 44 studies and represents complete data for 36,593 study participants. Duration of interventions ranged from 12 weeks to six years.Generally, the majority of studies included in this update, despite being randomized controlled trials, are, at a minimum, at moderate risk of bias. The results therefore must be interpreted with caution. Few changes in outcomes were observed in this update with the exception of blood cholesterol and physical activity rates. For example blood cholesterol was no longer positively impacted upon by school-based physical activity interventions. However, there was some evidence to suggest that school-based physical activity interventions led to an improvement in the proportion of children who engaged in moderate to vigorous physical activity during school hours (odds ratio (OR) 2.74, 95% confidence interval (CI), 2.01 to 3.75). Improvements in physical activity rates were not observed in the original review. Children and adolescents exposed to the intervention also spent more time engaged in moderate to vigorous physical activity (with results across studies ranging from five to 45 min more), spent less time watching television (results range from five to 60 min less per day), and had improved VO2max (results across studies ranged from 1.6 to 3.7 mL/kg per min). However, the overall conclusions of this update do not differ significantly from those reported in the original review. AUTHORS' CONCLUSIONS: The evidence suggests the ongoing implementation of school-based physical activity interventions at this time, given the positive effects on behavior and one physical health status measure. However, given these studies are at a minimum of moderate risk of bias, and the magnitude of effect is generally small, these results should be interpreted cautiously. Additional research on the long-term impact of these interventions is needed.

The effect of general surgery clerkship rotation on the attitude of medical students towards general surgery as a future career.

BACKGROUND: Literature suggests declining interest in General Surgery (GS) and other surgical specialties, with fewer Canadian medical residency applicants identifying a surgical specialty as their first choice. Although perceptions of surgical careers may begin before enrollment in clerkship, clerkship itself provides the most concentrated environment for perceptions to evolve. Most students develop perceptions about specialties during their clinical clerkships. This study examines the immediate impact of GS clerkship on student attitudes toward GS as a career, and on preferences towards GS compared with other specialties. METHODS: A pre-post design involved 61 McMaster clinical clerks. Two instruments were used to collect data from students over the course of clerkship (2008-2009). Paired comparison (PC) compared ranking of career choices before and after clerkship. Semantic differential (SD) measured attitudes toward GS and variables that may have affected attitudes before and after clerkship. Analyses used SPSS 16.0 (SPSS Inc., Chicago, IL). RESULTS: Clerks ranked preferences for GS changed substantially after clerkship, moving from the 10th to the 5th position compared with other specialties. Ranks of surgical subspecialties also changed, though GS demonstrated the largest improvement. SD results were consistent with PC, showing improved attitudes after rotation, with differences both statistically and practically significant (t = 3.81, p < 0.000, effect size = 0.23). Results indicated that attitudes toward all areas related to GS clerkship (attending physicians, surgical residents, ward nurses, scrub nurses, workload, knowledge achieved, technical skills acquired) improved significantly except attitude toward technical skills acquired. CONCLUSIONS: Clinical clerkship at McMaster was a positive experience and significantly enhanced preferences towards GS and attitudes towards GS as a career. Medical schools should foster positive interaction between clinical clerks and staff (including attending surgeons and nurses), ensure that teaching hospital staff provide a positive experience for clerks, and should provide opportunities to learn basic technical skills during GS clerkship.

An optimal search filter for retrieving systematic reviews and meta-analyses.

BACKGROUND: Health-evidence.ca is an online registry of systematic reviews evaluating the effectiveness of public health interventions. Extensive searching of bibliographic databases is required to keep the registry up to date. However, search filters have been developed to assist in searching the extensive amount of published literature indexed. Search filters can be designed to find literature related to a certain subject (i.e. content-specific filter) or particular study designs (i.e. methodological filter). The objective of this paper is to describe the development and validation of the health-evidence.ca Systematic Review search filter and to compare its performance to other available systematic review filters. METHODS: This analysis of search filters was conducted in MEDLINE, EMBASE, and CINAHL. The performance of thirty-one search filters in total was assessed. A validation data set of 219 articles indexed between January 2004 and December 2005 was used to evaluate performance on sensitivity, specificity, precision and the number needed to read for each filter. RESULTS: Nineteen of 31 search filters were effective in retrieving a high level of relevant articles (sensitivity scores greater than 85%). The majority achieved a high degree of sensitivity at the expense of precision and yielded large result sets. The main advantage of the health-evidence.ca Systematic Review search filter in comparison to the other filters was that it maintained the same level of sensitivity while reducing the number of articles that needed to be screened. CONCLUSIONS: The health-evidence.ca Systematic Review search filter is a useful tool for identifying published systematic reviews, with further screening to identify those evaluating the effectiveness of public health interventions. The filter that narrows the focus saves considerable time and resources during updates of this online resource, without sacrificing sensitivity.

Realist synthesis: illustrating the method for implementation research.

BACKGROUND: Realist synthesis is an increasingly popular approach to the review and synthesis of evidence, which focuses on understanding the mechanisms by which an intervention works (or not). There are few published examples of realist synthesis. This paper therefore fills a gap by describing, in detail, the process used for a realist review and synthesis to answer the question 'what interventions and strategies are effective in enabling evidence-informed healthcare?' The strengths and challenges of conducting realist review are also considered. METHODS: The realist approach involves identifying underlying causal mechanisms and exploring how they work under what conditions. The stages of this review included: defining the scope of the review (concept mining and framework formulation); searching for and scrutinising the evidence; extracting and synthesising the evidence; and developing the narrative, including hypotheses. RESULTS: Based on key terms and concepts related to various interventions to promote evidence-informed healthcare, we developed an outcome-focused theoretical framework. Questions were tailored for each of four theory/intervention areas within the theoretical framework and were used to guide development of a review and data extraction process. The search for literature within our first theory area, change agency, was executed and the screening procedure resulted in inclusion of 52 papers. Using the questions relevant to this theory area, data were extracted by one reviewer and validated by a second reviewer. Synthesis involved organisation of extracted data into evidence tables, theming and formulation of chains of inference, linking between the chains of inference, and hypothesis formulation. The narrative was developed around the hypotheses generated within the change agency theory area. CONCLUSIONS: Realist synthesis lends itself to the review of complex interventions because it accounts for context as well as outcomes in the process of systematically and transparently synthesising relevant literature. While realist synthesis demands flexible thinking and the ability to deal with complexity, the rewards include the potential for more pragmatic conclusions than alternative approaches to systematic reviewing. A separate publication will report the findings of the review.

Missing and accounted for: gaps and areas of wealth in the public health review literature.

BACKGROUND: High-quality review evidence is useful for informing and influencing public health policy and practice decisions. However, certain topic areas lack representation in terms of the quantity and quality of review literature available. The objectives of this paper are to identify the quantity, as well as quality, of review-level evidence available on the effectiveness of public health interventions for public health decision makers. METHODS: Searches conducted on http://www.health-evidence.ca produced an inventory of public health review literature in 21 topic areas. Gaps and areas of wealth in the review literature, as well as the proportion of reviews rated methodologically strong, moderate, or weak were identified. The top 10 topic areas of interest for registered users and visitors of http://www.health-evidence.ca were extracted from user profile data and Google Analytics. RESULTS: Registered users' top three interests included: 1) healthy communities, 2) chronic diseases, and 3) nutrition. The top three preferences for visitors included: 1) chronic diseases, 2) physical activity, and 3) addiction/substance use. All of the topic areas with many (301+) available reviews were of interest to registered users and/or visitors (mental health, physical activity, addiction/substance use, adolescent health, child health, nutrition, adult health, and chronic diseases). Conversely, the majority of registered users and/or visitors did not have preference for topic areas with few (≤ 150) available reviews (food safety and inspection, dental health, environmental health) with the exception of social determinants of health and healthy communities. Across registered users' and visitors' topic areas of preference, 80.2% of the reviews were of well-done methodological quality, with 43.5% of reviews having a strong quality rating and 36.7% a moderate review quality rating. CONCLUSIONS: In topic areas in which many reviews are available, higher level syntheses are needed to guide policy and practice. For other topic areas with few reviews, it is necessary to determine whether primary study evidence exists, or is needed, so that reviews can be conducted in the future. Considering that less than half of the reviews available on http://www.health-evidence.ca are of strong methodological quality, the quality of the review-level evidence needs to improve across the range of public health topic areas.

A knowledge management tool for public health: health-evidence.ca.

BACKGROUND: The ultimate goal of knowledge translation and exchange (KTE) activities is to facilitate incorporation of research knowledge into program and policy development decision making. Evidence-informed decision making involves translation of the best available evidence from a systematically collected, appraised, and analyzed body of knowledge. Knowledge management (KM) is emerging as a key factor contributing to the realization of evidence-informed public health decision making. The goal of health-evidence.ca is to promote evidence-informed public health decision making through facilitation of decision maker access to, retrieval, and use of the best available synthesized research evidence evaluating the effectiveness of public health interventions. METHODS: The systematic reviews that populate health evidence.ca are identified through an extensive search (1985-present) of 7 electronic databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Sociological Abstracts, BIOSIS, and SportDiscus; handsearching of over 20 journals; and reference list searches of all relevant reviews. Reviews are assessed for relevance and quality by two independent reviewers. Commonly-used public health terms are used to assign key words to each review, and project staff members compose short summaries highlighting results and implications for policy and practice. RESULTS: As of June 2010, there are 1913 reviews in the health-evidence.ca registry in 21 public health and health promotion topic areas. Of these, 78% have been assessed as being of strong or moderate methodological quality. Health-evidence.ca receives approximately 35,000 visits per year, 20,596 of which are unique visitors, representing approximately 100 visits per day. Just under half of all visitors return to the site, with the average user spending six minutes and visiting seven pages per visit. Public health nurses, program managers, health promotion workers, researchers, and program coordinators are among the largest groups of registered users, followed by librarians, dieticians, medical officers of health, and nutritionists. The majority of users (67%) access the website from direct traffic (e.g., have the health-evidence.ca webpage bookmarked, or type it directly into their browser). CONCLUSIONS: Consistent use of health-evidence.ca and particularly the searching for reviews that correspond with current public health priorities illustrates that health-evidence.ca may be playing an important role in achieving evidence-informed public health decision making.

Facilitating access to pre-processed research evidence in public health.

BACKGROUND: Evidence-informed decision making is accepted in Canada and worldwide as necessary for the provision of effective health services. This process involves: 1) clearly articulating a practice-based issue; 2) searching for and accessing relevant evidence; 3) appraising methodological rigor and choosing the most synthesized evidence of the highest quality and relevance to the practice issue and setting that is available; and 4) extracting, interpreting, and translating knowledge, in light of the local context and resources, into practice, program and policy decisions. While the public health sector in Canada is working toward evidence-informed decision making, considerable barriers, including efficient access to synthesized resources, exist. METHODS: In this paper we map to a previously developed 6 level pyramid of pre-processed research evidence, relevant resources that include public health-related effectiveness evidence. The resources were identified through extensive searches of both the published and unpublished domains. RESULTS: Many resources with public health-related evidence were identified. While there were very few resources dedicated solely to public health evidence, many clinically focused resources include public health-related evidence, making tools such as the pyramid, that identify these resources, particularly helpful for public health decisions makers. A practical example illustrates the application of this model and highlights its potential to reduce the time and effort that would be required by public health decision makers to address their practice-based issues. CONCLUSIONS: This paper describes an existing hierarchy of pre-processed evidence and its adaptation to the public health setting. A number of resources with public health-relevant content that are either freely accessible or requiring a subscription are identified. This will facilitate easier and faster access to pre-processed, public health-relevant evidence, with the intent of promoting evidence-informed decision making. Access to such resources addresses several barriers identified by public health decision makers to evidence-informed decision making, most importantly time, as well as lack of knowledge of resources that house public health-relevant evidence.

A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies.

CONTEXT: Significant resources and time are invested in the production of research knowledge. The primary objective of this randomized controlled trial was to evaluate the effectiveness of three knowledge translation and exchange strategies in the incorporation of research evidence into public health policies and programs. METHODS: This trial was conducted with a national sample of public health departments in Canada from 2004 to 2006. The three interventions, implemented over one year in 2005, included access to an online registry of research evidence; tailored messaging; and a knowledge broker. The primary outcome assessed the extent to which research evidence was used in a recent program decision, and the secondary outcome measured the change in the sum of evidence-informed healthy body weight promotion policies or programs being delivered at health departments. Mixed-effects models were used to test the hypotheses. FINDINGS: One hundred and eight of 141 (77%) health departments participated in this study. No significant effect of the intervention was observed for primary outcome (p < 0.45). However, for public health policies and programs (HPPs), a significant effect of the intervention was observed only for tailored, targeted messages (p < 0.01). The treatment effect was moderated by organizational research culture (e.g., value placed on research evidence in decision making). CONCLUSION: The results of this study suggest that under certain conditions tailored, targeted messages are more effective than knowledge brokering and access to an online registry of research evidence. Greater emphasis on the identification of organizational factors is needed in order to implement strategies that best meet the needs of individual organizations. TRIAL REGISTRATION: The trial registration number and title are as follows: ISRCTN35240937 -- Is a knowledge broker more effective than other strategies in promoting evidence-based physical activity and healthy body weight programming?

A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies.

BACKGROUND: A knowledge broker (KB) is a popular knowledge translation and exchange (KTE) strategy emerging in Canada to promote interaction between researchers and end users, as well as to develop capacity for evidence-informed decision making. A KB provides a link between research producers and end users by developing a mutual understanding of goals and cultures, collaborates with end users to identify issues and problems for which solutions are required, and facilitates the identification, access, assessment, interpretation, and translation of research evidence into local policy and practice. Knowledge-brokering can be carried out by individuals, groups and/or organizations, as well as entire countries. In each case, the KB is linked with a group of end users and focuses on promoting the integration of the best available evidence into policy and practice-related decisions. METHODS: A KB intervention comprised one of three KTE interventions evaluated in a randomized controlled trial. RESULTS: KB activities were classified into the following categories: initial and ongoing needs assessments; scanning the horizon; knowledge management; KTE; network development, maintenance, and facilitation; facilitation of individual capacity development in evidence informed decision making; and g) facilitation of and support for organizational change. CONCLUSION: As the KB role developed during this study, central themes that emerged as particularly important included relationship development, ongoing support, customized approaches, and opportunities for individual and organizational capacity development. The novelty of the KB role in public health provides a unique opportunity to assess the need for and reaction to the role and its associated activities. Future research should include studies to evaluate the effectiveness of KBs in different settings and among different health care professionals, and to explore the optimal preparation and training of KBs, as well as the identification of the personality characteristics most closely associated with KB effectiveness. Studies should also seek to better understand which combination of KB activities are associated with optimal evidence-informed decision making outcomes, and whether the combination changes in different settings and among different health care decision makers.

Effective practices for school-based tobacco use prevention.

BACKGROUND: Research evidence addressing effectiveness of tobacco use prevention interventions has accumulated since the 1970s. Systematic reviews 1985-2006 were considered, building on previous syntheses and spanning tobacco control and prevention efforts to date. Practitioners' experience was drawn upon to supplement research evidence. METHODS: A systematic, comprehensive approach was used to synthesize published literature evaluating the effectiveness of school-based tobacco use prevention interventions. Systematic reviews conducted on all populations published in English, peer-reviewed journals were included. Reviews were screened for relevance and assessed for methodological quality using pre-tested, standardized tools. The best available evidence was extracted and integrated with experiential evidence from individual interview and focus group results from practitioners involved in tobacco use prevention programming. RESULTS: Considerable consensus among the three evidence sources indicates that school-based tobacco use prevention interventions are effective in reducing smoking prevalence, reducing smoking initiation and intended smoking intentions in the short term. There is adequate evidence from over three decades of research and years of experience to recommend ongoing implementation of school-based tobacco use prevention interventions. CONCLUSION: There is strong evidence that school-based tobacco use prevention programs are largely effective for most tobacco use related outcomes, at least in the short term.