Practices Among Local Public Health Agencies to Support Evidence-Based Decision Making: A Qualitative Study.

OBJECTIVES: Evidence-based decision making (EBDM) capacity in local public health departments is foundational to meeting both organizational and individual competencies and fulfilling expanded roles. In addition to on-the-job training, organizational supports are needed to prepare staff; yet, less is known in this area. This qualitative study explores supportive management practices instituted as part of a training and technical assistance intervention. DESIGN: This qualitative study used a semistructured interview guide to elicit participants' descriptions and perceptions via key informant interviews. Verbatim transcripts were coded and thematic analyses were conducted. SETTING: Local public health departments in a US Midwestern state participated in the project. PARTICIPANTS: Seventeen middle managers and staff from 4 local health departments participated in remote, audio-recorded interviews. INTERVENTION: Following delivery of a 3½-day in-person training, the study team met with health department leadership teams for department selection of supportive agency policies and procedures to revise or newly create. Periodic remote meetings included collaborative problem-solving, sharing of informational resources, and encouragement. MAIN OUTCOME MEASURES: Included management practices instituted to support EBDM and impact on day-to-day work as described by the interview participants. RESULTS: Leadership and middle management practices deemed most helpful included dedicating staff; creating specific guidelines; setting expectations; and providing trainings, resources, and guidance. Health departments with a preexisting supportive organizational culture and climat e were able to move more quickly and fully to integrate supportive management practices. Workforce development included creation of locally tailored overviews for all staff members and onboarding of new staff. Staff wanted additional hands-on skill-building trainings. Several worked with partners to incorporate evidence-based processes into community health improvement plans. CONCLUSIONS: Ongoing on-the-job experiential learning is needed to integrate EBDM principles into day-to-day public health practice. Management practices established by leadership teams and middle managers can create supportive work environments for EBDM integration.

Understanding Health Equity in Public Health Practice in the United States.

CONTEXT: Understanding the extent to which equity-focused work is occurring in public health departments (eg, in chronic disease programs) can identify areas of success and what is needed to move the needle on health equity. OBJECTIVE: The study objective was to characterize the patterns and correlates of equity-related practices in US state and territorial public health practice. DESIGN: The design was a multimethod (quantitative and qualitative), cross-sectional study. SETTING: The setting included US state and territorial public health departments. PARTICIPANTS: Chronic disease prevention practitioners (N = 600) completed self-report surveys in July 2022 through August 2022 (analyzed in September 2022 through December 2022). MAIN OUTCOME MEASURES: Health equity data were obtained across 4 domains: (1) staff skills, (2) work unit practices, (3) organizational priorities and values, and (4) partnerships and networks. RESULTS: There was a wide range in self-reported performance across the health equity variables. The highest values (those agreeing and strongly agreeing) were related to staff skills (eg, the ability to describe the causes of inequities [82%]). Low agreement was reported for multiple items, indicating the lack of systems for tracking progress on health equity (32%), the lack of hiring of staff members who represent disadvantaged communities (33%), and limited use of principles for community engagement (eg, sharing decision-making authority with partners [34%]). Qualitative data provided tangible examples showing how practitioners and their agencies are turning an array of health equity concepts into actions. CONCLUSIONS: There is urgency in addressing health equity and our data suggest considerable room for enhancing health equity practices in state and territorial public health. To support these activities, our findings provide some of the first information on areas of progress, gaps in practice, and where to target technical assistance, capacity building efforts, and accreditation planning.

Perspectives on program mis-implementation among U.S. local public health departments.

BACKGROUND: Public health resources are limited and best used for effective programs. This study explores associations of mis-implementation in public health (ending effective programs or continuing ineffective programs) with organizational supports for evidence-based decision making among U.S. local health departments. METHODS: The national U.S. sample for this cross-sectional study was stratified by local health department jurisdiction population size. One person was invited from each randomly selected local health department: the leader in chronic disease, or the director. Of 600 selected, 579 had valid email addresses; 376 completed the survey (64.9% response). Survey items assessed frequency of and reasons for mis-implementation. Participants indicated agreement with statements on organizational supports for evidence-based decision making (7-point Likert). RESULTS: Thirty percent (30.0%) reported programs often or always ended that should have continued (inappropriate termination); organizational supports for evidence-based decision making were not associated with the frequency of programs ending. The main reason given for inappropriate termination was grant funding ended (86.0%). Fewer (16.4%) reported programs often or always continued that should have ended (inappropriate continuation). Higher perceived organizational supports for evidence-based decision making were associated with less frequent inappropriate continuation (odds ratio = 0.86, 95% confidence interval 0.79, 0.94). All organizational support factors were negatively associated with inappropriate continuation. Top reasons were sustained funding (55.6%) and support from policymakers (34.0%). CONCLUSIONS: Organizational supports for evidence-based decision making may help local health departments avoid continuing programs that should end. Creative mechanisms of support are needed to avoid inappropriate termination. Understanding what influences mis-implementation can help identify supports for de-implementation of ineffective programs so resources can go towards evidence-based programs.

The "secret sauce" for a mentored training program: qualitative perspectives of trainees in implementation research for cancer control.

BACKGROUND: Mentored training approaches help build capacity for research through mentoring networks and skill building activities. Capacity for dissemination and implementation (D&I) research in cancer is needed and mentored training programs have been developed. Evaluation of mentored training programs through quantitative approaches often provides us with information on "what" improved for participants. Qualitative approaches provide a deeper understanding of "how" programs work best. METHODS: Qualitative interviews were conducted with 21 fellows of the National Cancer Institute-funded Mentored Training for Dissemination and Implementation in Cancer to gain understanding of their experiences with mentoring received during the program. Fellows were selected from all 55 trained participants based upon their gain in D&I research skills (highest and lowest) and number of collaborative connections in the program network (highest and lowest) reported in previous quantitative surveys. Phone interviews were recorded with permission, transcribed verbatim, and de-identified for analysis. Codes were developed a priori to reflect interview guide concepts followed by further development and iterative coding of three common themes that emerged: 1) program and mentoring structure, 2) importance of mentor attributes, and 3) enhanced capacity: credentials, confidence, credibility and connections. RESULTS: Interviews provided valuable information about program components that worked best and impacts attributed to participation in the program. Fellows reported that regular monthly check-in calls with mentors helped to keep their research moving forward and that group mentoring structures aided in their learning of basic D&I research concepts and their application. Accessible, responsive, and knowledgeable mentors were commonly mentioned by fellows as a key to their success in the program. Fellows mentioned various forms of impact that they attributed to their participation in the program including gaining credibility in the field, a network of peers and experts, and career developments (e.g., collaborative publications and grant funding). CONCLUSIONS: These findings suggest that mentored training works best when mentoring is structured and coupled with applied learning and when respected and dedicated mentors are on board. Increased scientific collaborations and credibility within a recognized network are important trainee experiences that should be considered when designing, implementing, and sustaining mentored training programs.

Organizational Supports for Research Evidence Use in State Public Health Agencies: A Latent Class Analysis.

OBJECTIVE: Use of research evidence in public health decision making can be affected by organizational supports. Study objectives are to identify patterns of organizational supports and explore associations with research evidence use for job tasks among public health practitioners. DESIGN: In this longitudinal study, we used latent class analysis to identify organizational support patterns, followed by mixed logistic regression analysis to quantify associations with research evidence use. SETTING: The setting included 12 state public health department chronic disease prevention units and their external partnering organizations involved in chronic disease prevention. PARTICIPANTS: Chronic disease prevention staff from 12 US state public health departments and partnering organizations completed self-report surveys at 2 time points, in 2014 and 2016 (N = 872). MAIN OUTCOME MEASURES: Latent class analysis was employed to identify subgroups of survey participants with distinct patterns of perceived organizational supports. Two classify-analyze approaches (maximum probability assignment and multiple pseudo-class draws) were used in 2017 to investigate the association between latent class membership and research evidence use. RESULTS: The optimal model identified 4 latent classes, labeled as "unsupportive workplace," "low agency leadership support," "high agency leadership support," and "supportive workplace." With maximum probability assignment, participants in "high agency leadership support" (odds ratio = 2.08; 95% CI, 1.35-3.23) and "supportive workplace" (odds ratio = 1.74; 95% CI, 1.10-2.74) were more likely to use research evidence in job tasks than "unsupportive workplace." The multiple pseudo-class draws produced comparable results with odds ratio = 2.09 (95% CI, 1.31-3.30) for "high agency leadership support" and odds ratio = 1.74 (95% CI, 1.07-2.82) for "supportive workplace." CONCLUSIONS: Findings suggest that leadership support may be a crucial element of organizational supports to encourage research evidence use. Organizational supports such as supervisory expectations, access to evidence, and participatory decision making may need leadership support as well to improve research evidence use in public health job tasks.

Lessons Learned in Promoting Evidence-Based Public Health: Perspectives from Managers in State Public Health Departments.

Evidence-based public health (EBPH) practice, also called evidence-informed public health, can improve population health and reduce disease burden in populations. Organizational structures and processes can facilitate capacity-building for EBPH in public health agencies. This study involved 51 structured interviews with leaders and program managers in 12 state health department chronic disease prevention units to identify factors that facilitate the implementation of EBPH. Verbatim transcripts of the de-identified interviews were consensus coded in NVIVO qualitative software. Content analyses of coded texts were used to identify themes and illustrative quotes. Facilitator themes included leadership support within the chronic disease prevention unit and division, unit processes to enhance information sharing across program areas and recruitment and retention of qualified personnel, training and technical assistance to build skills, and the ability to provide support to external partners. Chronic disease prevention leaders' role modeling of EBPH processes and expectations for staff to justify proposed plans and approaches were key aspects of leadership support. Leaders protected staff time in order to identify and digest evidence to address the common barrier of lack of time for EBPH. Funding uncertainties or budget cuts, lack of political will for EBPH, and staff turnover remained challenges. In conclusion, leadership support is a key facilitator of EBPH capacity building and practice. Section and division leaders in public health agencies with authority and skills can institute management practices to help staff learn and apply EBPH processes and spread EBPH with partners.

Management Practices to Build Evidence-Based Decision-Making Capacity for Chronic Disease Prevention in Georgia: A Case Study.

BACKGROUND: Research shows that training can improve skills needed for evidence-based decision making, but less is known about instituting organizational supports to build capacity for evidence-based chronic disease prevention. COMMUNITY CONTEXT: The objectives of this case study were to assess facilitators and challenges of applying management practices to support evidence-based decision making in chronic disease prevention programs in the public health system in Georgia through key informant interviews and quantitatively test for changes in perceived management practices and skills through a pre-post survey. METHODS: Leadership of the chronic disease prevention section hosted a multiday training, provided regular supplemental training, restructured the section and staff meetings, led and oversaw technical assistance with partners, instituted transparent performance-based contracting, and made other changes. A 65-item online survey measured perceived importance of skills and the availability of skilled staff, organizational supports, and use of research evidence at baseline (2014) and in 2016 (after training). A structured interview guide asked about management practices, context, internal and external facilitators and barriers, and recommendations. CAPACITY-BUILDING ACTIVITIES AND SURVEY FINDINGS: Seventy-four staff members and partners completed both surveys (70.5% response). Eleven participants also completed a 1-hour telephone interview. Interview participants deemed leadership support and implementation of multiple concurrent management practices key facilitators to increase capacity. Main challenges included competing priorities, lack of political will, and receipt of requests counter to evidence-based approaches. At posttest, health department staff had significantly reduced gaps in skills overall (10-item sum) and in 4 of 10 individual skills, and increased use of research evidence to justify interventions. Use of research evidence for evaluation, but not skills, increased among partners. INTERPRETATION: The commitment of leaders with authority to establish multiple management practices to help staff members learn and apply evidence-based decision-making processes is key to increased use of evidence-based chronic disease prevention to improve population health.

Controlling Chronic Diseases Through Evidence-Based Decision Making: A Group-Randomized Trial.

INTRODUCTION: Although practitioners in state health departments are ideally positioned to implement evidence-based interventions, few studies have examined how to build their capacity to do so. The objective of this study was to explore how to increase the use of evidence-based decision-making processes at both the individual and organization levels. METHODS: We conducted a 2-arm, group-randomized trial with baseline data collection and follow-up at 18 to 24 months. Twelve state health departments were paired and randomly assigned to intervention or control condition. In the 6 intervention states, a multiday training on evidence-based decision making was conducted from March 2014 through March 2015 along with a set of supplemental capacity-building activities. Individual-level outcomes were evidence-based decision making skills of public health practitioners; organization-level outcomes were access to research evidence and participatory decision making. Mixed analysis of covariance models was used to evaluate the intervention effect by accounting for the cluster randomized trial design. Analysis was performed from March through May 2017. RESULTS: Participation 18 to 24 months after initial training was 73.5%. In mixed models adjusted for participant and state characteristics, the intervention group improved significantly in the overall skill gap (P = .01) and in 6 skill areas. Among the 4 organizational variables, only access to evidence and skilled staff showed an intervention effect (P = .04). CONCLUSION: Tailored and active strategies are needed to build capacity at the individual and organization levels for evidence-based decision making. Our study suggests several dissemination interventions for consideration by leaders seeking to improve public health practice.

Evaluating a train-the-trainer approach for improving capacity for evidence-based decision making in public health.

BACKGROUND: Evidence-based public health gives public health practitioners the tools they need to make choices based on the best and most current evidence. An evidence-based public health training course developed in 1997 by the Prevention Research Center in St. Louis has been taught by a transdisciplinary team multiple times with positive results. In order to scale up evidence-based practices, a train-the-trainer initiative was launched in 2010. METHODS: This study examines the outcomes achieved among participants of courses led by trained state-level faculty. Participants from trainee-led courses in four states (Indiana, Colorado, Nebraska, and Kansas) over three years were asked to complete an online survey. Attempts were made to contact 317 past participants. One-hundred forty-four (50.9 %) reachable participants were included in analysis. Outcomes measured include frequency of use of materials, resources, and other skills or tools from the course; reasons for not using the materials and resources; and benefits from attending the course. Survey responses were tabulated and compared using Chi-square tests. RESULTS: Among the most commonly reported benefits, 88 % of respondents agreed that they acquired knowledge about a new subject, 85 % saw applications for the knowledge to their work, and 78 % agreed the course also improved abilities to make scientifically informed decisions at work. The most commonly reported reasons for not using course content as much as intended included not having enough time to implement evidence-based approaches (42 %); other staff/peers lack training (34 %); and not enough funding for continued training (34 %). The study findings suggest that utilization of course materials and teachings remains relatively high across practitioner groups, whether they were taught by the original trainers or by state-based trainers. CONCLUSIONS: The findings of this study suggest that train-the-trainer is an effective method for broadly disseminating evidence-based public health principles. Train-the-trainer is less costly than the traditional method and allows for courses to be tailored to local issues, thus making it a viable approach to dissemination and scale up of new public health practices.

Training needs and supports for evidence-based decision making among the public health workforce in the United States.

BACKGROUND: Preparing the public health workforce to practice evidence-based decision making (EBDM) is necessary to effectively impact health outcomes. Few studies report on training needs in EBDM at the national level in the United States. We report competency gaps to practice EBDM based on four U.S. national surveys we conducted with the state and local public health workforce between 2008 and 2013. METHODS: We compared self-reported data from four U.S. national online surveys on EBDM conducted between 2008 and 2013. Participants rated the importance of each EBDM competency then rated how available the competency is to them when needed on a Likert scale. We calculated a gap score by subtracting availability scores from importance scores. We compared mean gaps across surveys and utilized independent samples t tests and Cohen's d values to compare state level gaps. In addition, participants in the 2013 state health department survey selected and ranked three items that "would most encourage you to utilize EBDM in your work" and items that "would be most useful to you in applying EBDM in your work". We calculated the percentage of participants who ranked each item among their top three. RESULTS: The largest competency gaps were consistent across all four surveys: economic evaluation, communicating research to policymakers, evaluation designs, and adapting interventions. Participants from the 2013 state level survey reported significantly larger mean importance and availability scores (p <0.001, d =1.00, and p <0.001, d = .78 respectively) and smaller mean gaps (p <0.01, d = .19) compared to the 2008 survey. Participants most often selected "leaders prioritizing EBDM" (67.9%) among top ways to encourage EBDM use. "EBDM training for specific areas" was most commonly ranked as important in applying EBDM (64.3%). CONCLUSION: Perceived importance and availability of EBDM competencies may be increasing as supports for EBDM continue to grow through trends in funding, training, and resources. However, more capacity building is needed overall, with specific attention to the largest competency gaps. More work with public health departments to both situate trainings to boost competency in these areas and continued improvements for organizational practices (leadership prioritization) are possible next steps to sustain EBDM efforts.

Information-seeking among chronic disease prevention staff in state health departments: use of academic journals.

Use of scientific evidence aids in ensuring that public health interventions have the best possible health and economic return on investment. We describe use of academic journals by state health department chronic disease prevention staff to find public health evidence. We surveyed more than 900 state health department staff from all states and the District of Columbia. Participants identified top journals or barriers to journal use. We used descriptive statistics to examine individual and aggregate state health department responses. On average, 45.7% of staff per state health department use journals. Common barriers to use included lack of time, lack of access, and expense. Strategies for increasing journal use are provided.

Health care system collaboration to address chronic diseases: a nationwide snapshot from state public health practitioners.

INTRODUCTION: Until recently, health care systems in the United States often lacked a unified approach to prevent and manage chronic disease. Recent efforts have been made to close this gap through various calls for increased collaboration between public health and health care systems to better coordinate provision of services and programs. Currently, the extent to which the public health workforce has responded is relatively unknown. The objective of this study is to explore health care system collaboration efforts and activities among a population-based sample of state public health practitioners. METHODS: During spring 2013, a national survey was administered to state-level chronic disease public health practitioners. Respondents were asked to indicate whether or not they collaborate with health care systems. Those who reported "yes" were asked to indicate all topic areas in which they collaborate and provide qualitative examples of their collaborative work. RESULTS: A total of 759 respondents (84%) reported collaboration. Common topics of collaboration activities were tobacco, cardiovascular health, and cancer screening. More client-oriented interventions than system-wide interventions were found in the qualitative examples provided. Respondents who collaborated were also more likely to use the Community Guide, use evidence-based decision making, and work in program areas that involved secondary, rather than primary, prevention. CONCLUSION: The study findings indicate a need for greater guidance on collaboration efforts that involve system-wide and cross-system interventions. Tools such as the Community Guide and evidence-based training courses may be useful in providing such guidance.

Effectively communicating with local policymakers: a randomized trial of policy brief dissemination to address obesity.

Introduction: Evidence-based policies are a powerful tool for impacting health and addressing obesity. Effectively communicating evidence to policymakers is critical to ensure evidence is incorporated into policies. While all public health is local, limited knowledge exists regarding effective approaches for improving local policymakers' uptake of evidence-based policies. Methods: Local policymakers were randomized to view one of four versions of a policy brief (usual care, narrative, risk-framing, and narrative/risk-framing combination). They then answered a brief survey including questions about their impressions of the brief, their likelihood of using it, and how they determine legislative priorities. Results: Responses from 331 participants indicated that a majority rated local data (92%), constituent needs/opinions (92%), and cost-effectiveness data (89%) as important or very important in determining what issues they work on. The majority of respondents agreed or strongly agreed that briefs were understandable (87%), believable (77%), and held their attention (74%) with no brief version rated significantly higher than the others. Across the four types of briefs, 42% indicated they were likely to use the brief. Logistic regression models showed that those indicating that local data were important in determining what they work on were over seven times more likely to use the policy brief than those indicating that local data were less important in determining what they work on (aOR = 7.39, 95% CI = 1.86,52.57). Discussion: Among local policymakers in this study there was no dominant format or type of policy brief; all brief types were rated similarly highly. This highlights the importance of carefully crafting clear, succinct, credible, and understandable policy briefs, using different formats depending on communication objectives. Participants indicated a strong preference for receiving materials incorporating local data. To ensure maximum effect, every effort should be made to include data relevant to a policymaker's local area in policy communications.

Participatory logic modeling in a multi-site initiative to advance implementation science.

BACKGROUND: Logic models map the short-term and long-term outcomes that are expected to occur with a program, and thus are an essential tool for evaluation. Funding agencies, especially in the United States (US), have encouraged the use of logic models among their grantees. They also use logic models to clarify expectations for their own funding initiatives. It is increasingly recognized that logic models should be developed through a participatory approach which allows input from those who carry out the program being evaluated. While there are many positive examples of participatory logic modeling, funders have generally not engaged grantees in developing the logic model associated with their own initiatives. This article describes an instance where a US funder of a multi-site initiative fully engaged the funded organizations in developing the initiative logic model. The focus of the case study is Implementation Science Centers in Cancer Control (ISC3), a multi-year initiative funded by the National Cancer Institute. METHODS: The reflective case study was collectively constructed by representatives of the seven centers funded under ISC3. Members of the Cross-Center Evaluation (CCE) Work Group jointly articulated the process through which the logic model was developed and refined. Individual Work Group members contributed descriptions of how their respective centers reviewed and used the logic model. Cross-cutting themes and lessons emerged through CCE Work Group meetings and the writing process. RESULTS: The initial logic model for ISC3 changed in significant ways as a result of the input of the funded groups. Authentic participation in the development of the logic model led to strong buy-in among the centers, as evidenced by their utilization. The centers shifted both their evaluation design and their programmatic strategy to better accommodate the expectations reflected in the initiative logic model. CONCLUSIONS: The ISC3 case study demonstrates how participatory logic modeling can be mutually beneficial to funders, grantees and evaluators of multi-site initiatives. Funded groups have important insights about what is feasible and what will be required to achieve the initiative's stated objectives. They can also help identify the contextual factors that either inhibit or facilitate success, which can then be incorporated into both the logic model and the evaluation design. In addition, when grantees co-develop the logic model, they have a better understanding and appreciation of the funder's expectations and thus are better positioned to meet those expectations.

Participatory Logic Modeling in a Multi-Site Initiative to Advance Implementation Science.

Background: It is increasingly being recognized that logic models should be developed through a participatory approach which allows input from those who carry out the program being evaluated. While there are many positive examples of participatory logic modeling, funders have generally not used this approach in the context of multi-site initiatives. This article describes an instance where the funder and evaluator of a multi-site initiative fully engaged the funded organizations in developing the initiative logic model. The focus of the case study is Implementation Science Centers in Cancer Control (ISC 3 ), a multi-year initiative funded by the National Cancer Institute (NCI). Methods: The case study was collectively constructed by representatives of the seven centers funded under ISC 3 . Members of the Cross-Center Evaluation (CCE) Work Group jointly articulated the process through which the logic model was developed and refined. Individual Work Group members contributed descriptions of how their respective centers reviewed and used the logic model. Cross-cutting themes and lessons emerged through CCE Work Group meetings and the writing process. Results: The initial logic model for ISC 3 changed in significant ways as a result of the input of the funded groups. Authentic participation in the development of the logic model led to strong buy-in among the centers, as evidenced by their utilization. The centers shifted both their evaluation design and their programmatic strategy to better accommodate the expectations reflected in the initiative logic model. Conclusions: The ISC 3 case study provides a positive example of how participatory logic modeling can be mutually beneficial to funders, grantees and evaluators of multi-site initiatives. Funded groups have important insights about what is feasible and what will be required to achieve the initiative's stated objectives. They can also help identify the contextual factors that either inhibit or facilitate success, which can then be incorporated into both the logic model and the evaluation design. In addition, when grantees co-develop the logic model, they have a better understanding and appreciation of the funder's expectations, and thus are better positioned to meet those expectations.

How to "Start Small and Just Keep Moving Forward": Mixed Methods Results From a Stepped-Wedge Trial to Support Evidence-Based Processes in Local Health Departments.

Background: Local health departments (LHDs) in the United States are charged with preventing disease and promoting health in their respective communities. Understanding and addressing what supports LHD's need to foster a climate and culture supportive of evidence-based decision making (EBDM) processes can enhance delivery of effective practices and services. Methods: We employed a stepped-wedge trial design to test staggered delivery of implementation supports in 12 LHDs (Missouri, USA) to expand capacity for EBDM processes. The intervention was an in-person training in EBDM and continued support by the research team over 24 months (March 2018-February 2020). We used a mixed-methods approach to evaluate: (1) individuals' EBDM skills, (2) organizational supports for EBDM, and (3) administered evidence-based interventions. LHD staff completed a quantitative survey at 4 time points measuring their EBDM skills, organizational supports, and evidence-based interventions. We selected 4 LHDs with high contact and engagement during the intervention period to interview staff (n = 17) about facilitators and barriers to EBDM. We used mixed-effects linear regression to examine quantitative survey outcomes. Interviews were transcribed verbatim and coded through a dual independent process. Results: Overall, 519 LHD staff were eligible and invited to complete quantitative surveys during control periods and 593 during intervention (365 unique individuals). A total of 434 completed during control and 492 during intervention (83.6 and 83.0% response, respectively). In both trial modes, half the participants had at least a master's degree (49.7-51.7%) and most were female (82.1-83.8%). No significant intervention effects were found in EBDM skills or in implementing evidence-based interventions. Two organizational supports scores decreased in intervention vs. control periods: awareness (-0.14, 95% CI -0.26 to -0.01, p < 0.05) and climate cultivation (-0.14, 95% CI -0.27 to -0.02, p < 0.05) but improved over time among all participants. Interviewees noted staff turnover, limited time, resources and momentum as challenges to continue EBDM work. Setting expectations, programmatic reviews, and pre-existing practices were seen as facilitators. Conclusions: Challenges (e.g., turnover, resources) may disrupt LHDs' abilities to fully embed organizational processes which support EBDM. This study and related literature provides understanding on how best to support LHDs in building capacity to use and sustain evidence-based practices.

Collaboration networks of the implementation science centers for cancer control: a social network analysis.

BACKGROUND: Multi-center research initiatives offer opportunities to develop and strengthen connections among researchers. These initiatives often have goals of increased scientific collaboration which can be examined using social network analysis. METHODS: The National Cancer Institute (NCI)-funded Implementation Science Centers in Cancer Control (ISC3) initiative conducted an online social network survey in its first year of funding (2020) to (1) establish baseline network measures including the extent of cross-center collaboration and (2) assess factors associated with a network member's access to the network such as one's implementation science (IS) expertise. Members of the seven funded centers and NCI program staff identified collaborations in planning/conducting research, capacity building, product development, scientific dissemination, and practice/policy dissemination. RESULTS: Of the 192 invitees, 182 network members completed the survey (95%). The most prevalent roles were faculty (60%) and research staff (24%). Almost one-quarter (23%) of members reported advanced expertise in IS, 42% intermediate, and 35% beginner. Most members were female (69%) and white (79%). One-third (33%) of collaboration ties were among members from different centers. Across all collaboration activities, the network had a density of 14%, suggesting moderate cohesion. Degree centralization (0.33) and betweenness centralization (0.07) measures suggest a fairly dispersed network (no single or few central member(s) holding all connections). The most prevalent and densely connected collaboration was in planning/conducting research (1470 ties; 8% density). Practice/policy dissemination had the fewest collaboration, lowest density (284 ties' 3% density), and the largest number of non-connected members (n=43). Access to the ISC3 network varied significantly depending on members' level of IS expertise, role within the network, and racial/ethnic background. Across all collaboration activities, most connected members included those with advanced IS expertise, faculty and NCI staff, and Hispanic or Latino and white members. CONCLUSIONS: Results establish a baseline for assessing the growth of cross-center collaborations, highlighting specific areas in need of particular growth in network collaborations such as increasing engagement of racial and ethnic minorities and trainees or those with less expertise in IS.

The Relationships Between State Health Department Practitioners' Perceptions of Organizational Supports and Evidence-Based Decision-Making Skills.

OBJECTIVES: Evidence-based decision making (EBDM) allows public health practitioners to implement effective programs and policies fitting the preferences of their communities. To engage in EBDM, practitioners must have skills themselves, their agencies must engage in administrative evidence-based practices (A-EBPs), and leaders must encourage the use of EBDM. We conducted this longitudinal study to quantify perceptions of individual EBDM skills and A-EBPs, as well as the longitudinal associations between the 2. METHODS: An online survey completed among US state health department practitioners in 2016 and 2018 assessed perceptions of respondents' skills in EBDM and A-EBPs. We used χ2 tests, t tests, and linear regressions to quantify changes over time, differences by demographic characteristics, and longitudinal associations between individual skills and A-EBPs among respondents who completed both surveys (N = 336). RESULTS: Means of most individual EBDM skills and A-EBPs did not change significantly from 2016 to 2018. We found significant positive associations between changes in A-EBPs and changes in EBDM skill gaps: for example, a 1-point increase in the relationships and partnerships score was associated with a narrowing of the EBDM skill gap (ß estimate = 0.38; 95% CI, 0.15-0.61). At both time points, perceived skills and A-EBPs related to financial practices were low. CONCLUSIONS: Findings from this study can guide the development and dissemination of initiatives designed to simultaneously improve individual and organizational capacity for EBDM in public health settings. Future studies should focus on types of strategies most effective to build capacity in particular types of agencies and practitioners, to ultimately improve public health practice.

Building the Next Generation of Researchers: Mentored Training in Dissemination and Implementation Science.

PROBLEM: Dissemination and implementation (D&I) science provides the tools needed to close the gap between known intervention strategies and their effective application. The authors report on the Mentored Training for Dissemination and Implementation Research in Cancer (MT-DIRC) program-a D&I training program for postdoctoral or early-career cancer prevention and control scholars. APPROACH: MT-DIRC was a 2-year training institute in which fellows attended 2 annual Summer Institutes and other conferences and received didactic, group, and individual instruction; individualized mentoring; and other supports (e.g., pilot funding). A quasi-experimental design compared changes in 3 areas: mentoring, skills, and network composition. To evaluate mentoring and D&I skills, data from fellows on their mentors' mentoring competencies, their perspectives on the importance of and satisfaction with mentoring priority areas, and their self-rated skills in D&I competency domains were collected. Network composition data were collected from faculty and fellows for 3 core social network domains: contact, mentoring, and collaboration. Paired t tests (mentoring), linear mixed models (skills), and descriptive analyses (network composition) were performed. OUTCOMES: Mentors were rated as highly competent across all mentoring competencies, and each mentoring priority area showed reductions in gaps between satisfaction and importance between the 6 and 18 months post-first Summer Institute. Fellows' self-rated skills in D&I competencies improved significantly in all domains over time (range: 42.5%-52.9% increase from baseline to 18 months post-first Summer Institute). Mentorship and collaboration networks grew over time, with the highest number of collaboration network ties for scholarly manuscripts (n = 199) in 2018 and for research projects (n = 160) in 2019. NEXT STEPS: Building on study findings and existing literature, mentored training of scholars is an important approach for building D&I skills and networks, and thus to better applying the vast amount of available intervention evidence to benefit cancer control.

Long-Term Evaluation of a Course on Evidence-Based Public Health in the U.S. and Europe.

The evidence-based public health course equips public health professionals with skills and tools for applying evidence-based frameworks and processes in public health practice. To date, training has included participants from all the 50 U.S. states, 2 U.S. territories, and multiple other countries besides the U.S. This study pooled follow-up efforts (5 surveys, with 723 course participants, 2005-2019) to explore the benefits, application, and barriers to applying the evidence-based public health course content. All analyses were completed in 2020. The most common benefits (reported by >80% of all participants) were identifying ways to apply knowledge in their work, acquiring new knowledge, and becoming a better leader who promotes evidence-based approaches. Participants most frequently applied course content to searching the scientific literature (72.9%) and least frequently to writing grants (42.7%). Lack of funds for continued training (35.3%), not having enough time to implement evidence-based public health approaches (33.8%), and not having coworkers trained in evidence-based public health (33.1%) were common barriers to applying the content from the course. Mean scores were calculated for benefits, application, and barriers to explore subgroup differences. European participants generally reported higher benefits from the course (mean difference=0.12, 95% CI=0.00, 0.23) and higher frequency of application of the course content to their job (mean difference=0.17, 95% CI=0.06, 0.28) than U.S. participants. Participants from later cohorts (2012-2019) reported more overall barriers to applying course content in their work (mean difference=0.15, 95% CI=0.05, 0.24). The evidence-based public health course represents an important strategy for increasing the capacity (individual skills) for evidence-based processes within public health practice. Organization-level methods are also needed to scale up and sustain capacity-building efforts.