Good practice recommendations on implementation evaluation for policies targeting diet, physical activity, and sedentary behaviour.

Health policies aim to achieve specific health goals through system-level changes, unlike common health interventions that focus on promoting specific health behaviors on individual level. However, reliable data on the feasibility and implementation of policy actions across Europe are lacking. Moreover, no practice-oriented guidance exists for policy makers and implementers on how to evaluate policy implementation.As part of the Policy Evaluation Network, we aimed to synthesise knowledge on how to evaluate the implementation of policies promoting healthy diets, physical activity, and reducing sedentary behaviours. The multidisciplinary working group comprised 16 researchers and conducted two scoping reviews, three systematic reviews, two meta-reviews, two qualitative case studies and one quantitative case study over three years. The target populations included the general population, those at risk for obesity, and school children. Based on these reviews and case studies, this article summarises and presents the findings and lessons learned regarding the implementation evaluation of policies in nine case reports.Drawing on these experiences, three critical requirements for policy implementation evaluation were set: 1) conduct a comprehensive policy implementation evaluation from a multi-level perspective, 2) use implementation frameworks to address processes, determinants, and outcomes, and 3) engage relevant stakeholders in policy implementation evaluation. Finally, the consensus process resulted in 10 steps for the implementation evaluation of policies to promote physical activity and a healthy diet and to reduce sedentary behaviours, which adhere to the requirements and resources of the targeted policy.The findings of an implementation evaluation can lead to a better understanding of why policies work or not and can serve as a basis for developing solutions. This practice-oriented guidance outlines factors that should be considered in policy implementation evaluation to address its complexity. In this way, involved researchers and practitioners are empowered to engage in the evaluation process to close the knowledge gap regarding policy implementation.

Frameworks for implementation of policies promoting healthy nutrition and physically active lifestyle: systematic review.

BACKGROUND: Policy frameworks focusing on policy implementation may vary in terms of their scope, included constructs, relationships between the constructs, and context factors. Although multiple policy implementation frameworks exist, the overarching synthesis characterizing differences between the frameworks is missing. This study investigated frameworks guiding implementation of policies aiming at healthy nutrition, physical activity promotion, and a reduction of sedentary behavior. In particular, we aimed at examining the scope of the frameworks and the content of included constructs (e.g., referring to implementation processes, determinants, or implementation evaluation), the level at which these constructs operate (e.g., the individual level, the organizational/community level), relationships between the constructs, and the inclusion of equity factors. METHODS: A systematic review (the PROSPERO registration no. CRD42019133251) was conducted using 9 databases and 8 stakeholder websites. The content of 38 policy implementation frameworks was coded and analyzed. RESULTS: Across the frameworks, 47.4% (18 in 38) addressed three aims: description of the process, determinants, and the evaluation of implementation. The majority of frameworks (65.8%; 25 in 38) accounted for constructs from three levels: individual, organizational/community, and the system level. System-level constructs were included less often (76.3%; 29 in 38) than individual-level or organizational/community-level constructs (86.8% [33 in 38 frameworks] and 94.7% [36 in 38 frameworks] respectively). The majority of frameworks (84.2%, 32 in 38) included at least some sections that were solely of descriptive character (a list of unassociated constructs); 50.0% (19 in 38) included sections of prescriptive character (general steps of implementation); 60.5% (23 in 38) accounted for explanatory sections (assuming bi- or uni-directorial associations). The complex system approach was accounted for only in 21.1% (8 in 38) of frameworks. More than half (55.3%; 21 in 38) of frameworks did not account for any equity constructs (e.g., socioeconomic status, culture). CONCLUSIONS: The majority of policy implementation frameworks have two or three aims (combining processes, determinants and/or the evaluation of implementation), include multi-level constructs (although the system-level determinants are less frequently included than those from the individual- or organizational/community-level), combine sections of purely descriptive character with sections accounting for prescriptive and/or explanatory associations, and are likely to include a little or no equity constructs. REGISTRATION: PROSPERO, #CRD42019133251.

Social, economic, political, and geographical context that counts: meta-review of implementation determinants for policies promoting healthy diet and physical activity.

BACKGROUND: This meta-review investigated the context-related implementation determinants from seven domains (geographical, epidemiological, sociocultural, economic, ethics-related, political, and legal) that were systematically indicated as occurring during the implementation of obesity prevention policies targeting a healthy diet and a physically active lifestyle. METHODS: Data from nine databases and documentation of nine major stakeholders were searched for the purpose of this preregistered meta-review (#CRD42019133341). Context-related determinants were considered strongly supported if they were indicated in ≥60% of the reviews/stakeholder documents. The ROBIS tool and the Methodological Quality Checklist-SP were used to assess the quality-related risk of bias. RESULTS: Published reviews (k = 25) and stakeholder documents that reviewed the evidence of policy implementation (k = 17) were included. Across documents, the following six determinants from three context domains received strong support: economic resources at the macro (66.7% of analyzed documents) and meso/micro levels (71.4%); sociocultural context determinants at the meso/micro level, references to knowledge/beliefs/abilities of target groups (69.0%) and implementers (73.8%); political context determinants (interrelated policies supported in 71.4% of analyzed reviews/documents; policies within organizations, 69.0%). CONCLUSIONS: These findings indicate that sociocultural, economic, and political contexts need to be accounted for when formulating plans for the implementation of a healthy diet and physical activity/sedentary behavior policies.

What we know about the actual implementation process of public physical activity policies: results from a scoping review.

BACKGROUND: Physical inactivity rates have remained high worldwide since 2001. Public policies are an essential upstream lever to target individual physical activity (PA) behaviour. However, implementers have different strategies and face implementation challenges that are poorly understood. The present study analyzes the implementation processes of public policies to promote PA in terms of: (i) the policies covered and their legal quality, (ii) the actors and stakeholders involved in the implementation process and (iii) the used implementation strategies (vertical, horizontal or a mix). METHODS: A scoping review was systematically conducted (registered Open Science Framework: osf.io/7w84q/), searching 10 databases and grey literature until March 2022. Of the 7741 titles and abstracts identified initially, 10 studies were included. RESULTS: The current evidence includes high-income countries (USA, n = 7; UK, New Zealand and Oman, n = 1 each). Policy areas covered are education (school sector) and PA promotion in general (national PA plans or city-wide approaches). The legal classification ranges from laws (school sector) to coordination and budgeting to non-legally binding recommendations. The jurisdictions covered were federal (n = 4), state (n = 1), county (n = 1), school district (n = 1) and city (n = 3). Implementation strategies for city-wide approaches are characterized by a coordinated approach with vertical and horizontal integration; federal PA policies by a mix of implementation strategies; and the school sector by a strict horizontal top-down integration without the involvement of other actors. CONCLUSION: Implementation strategies differ by policy field. Therefore, continuous evaluation of the implementation process is necessary to align policy implementation with policy goals to promote individual PA behaviour.

Acceptability of policies targeting dietary behaviours and physical activity: a systematic review of tools and outcomes.

BACKGROUND: Successful implementation of health policies require acceptance from the public and policy-makers. This review aimed to identify tools used to assess the acceptability of policies targeting physical activity and dietary behaviour, and examine if acceptability differs depending on characteristics of the policy and of the respondents. METHODS: A systematic review (PROSPERO: CRD42021232326) was conducted using three databases (Science Direct, PubMed and Web of Science). RESULTS: Of the initial 7780 hits, we included 48 eligible studies (n = 32 on dietary behaviour, n = 11 on physical activity and n = 5 on both), using qualitative and quantitative designs (n = 25 cross-sectional, quantitative; n = 15 qualitative; n = 5 randomized controlled trials; n = 3 mixed-methods design). Acceptability was analysed through online surveys (n = 24), interviews (n = 10), focus groups (n = 10), retrospective textual analysis (n = 3) and a taste-test experiment (n = 1). Notably, only 3 (out of 48) studies applied a theoretical foundation for their assessment. Less intrusive policies such as food labels and policies in a later stage of the implementation process received higher levels of acceptability. Women, older participants and respondents who rated policies as appropriate and effective showed the highest levels of acceptability. CONCLUSION: Highly intrusive policies such as taxations or restrictions are the least accepted when first implemented, but respondents' confidence in the relevance and effectiveness of the policy may boost acceptability over the course of implementation. Studies using validated tools and a theoretical foundation are needed to further examine opportunities to increase acceptability.

Sugar-sweetened beverage tax implementation processes: results of a scoping review.

Taxing sugar-sweetened beverages (SSB) is seen as a win-win situation for governments. It is argued that SSB taxes are relatively easy to implement from a practical perspective compared to for example other nutrition policies. However, the implementation of SSB taxation laws does not happen by itself. Therefore, this work examines implementation processes for SSB taxation in terms of (1) pre-implementation context, (2) taxation instruments used and (3) interactions in the implementation process. Ten databases and grey literature were systematically searched for studies reporting on SSB taxation implementation processes up to February 2020. All studies (N = 1248) were screened independently by two reviewers according to predefined criteria. The selection of variables to be extracted was based on the policy cycle heuristic and informed by intervention implementation research. Information on the process of implementing SSB taxation is limited. Only six cases based on three publications were identified, indicating a gap in this research area. SSB taxation implementation was accomplished by hiring a subcontractor for the implementation or using pre-existing tax collection structures. Political and public support within the implementation process seems to be supportive for the city of Berkeley and for Portugal but was not reported for the Pacific Islands. However, the existing data are very limited, and further research on SSB taxation implementation processes is needed to determine whether the aim of the policy and the envisaged outcome are linked in practice. Registration The protocol was registered with the Open Science Framework (OSF) (osf.io/7w84q/).

Barriers and facilitators to the adoption of physical activity policies in elementary schools from the perspective of principals: An application of the consolidated framework for implementation research-A cross-sectional study.

Background: Studies have shown that policies to promote physical activity in schools can have a positive impact on children's physical activity behavior. However, a large research gap exists as to what determinants may influence the adoption of such policies. Applying the Consolidated Framework for Implementation Research (CFIR), we investigated barriers and facilitators to the adoption of physical activity policies in elementary schools in Baden-Wuerttemberg, Germany, from the perspective of school principals. Methods: A cross-sectional study was conducted between May and June 2021. School principals from elementary and special needs schools (n = 2,838) were invited to participate in the study. The online questionnaire used was developed based on the CFIR and included questions on school characteristics and constructs of the CFIR domains inner setting, characteristics of individuals, and process. Logistic regression analyses were performed to examine associations between policy adoption and school characteristics as well as CFIR determinants. Results: In total, 121 schools (4%) participated in the survey, of which 49 (40.5%) reported having adopted a policy to promote physical activity. Positive associations with policy adoption were found for general willingness among teaching staff [odds ratio (OR): 5.37, 95% confidence interval (CI): 1.92-15.05], available resources (OR: 2.15, 95% CI: 1.18-3.91), access to knowledge and information (OR: 2.11, 95% CI: 1.09-4.09), and stakeholder engagement (OR: 3.47, 95% CI: 1.24-9.75). Conclusions: This study provides a first insight into potential barriers and facilitators at the organizational level of schools that may be relevant to the adoption of physical activity policies, from the perspective of school principals. However, due to a low response rate, the results must be interpreted with caution. A strength of this study includes theoretical foundation through the use of the CFIR. The CFIR could be well-adapted to the school setting and provided valuable support for developing the questionnaire and interpreting the study results.

The Healthy Food Environment Policy Index in Poland: Implementation Gaps and Actions for Improvement.

BACKGROUND: Poland is facing the growing problem of overweight and obesity in the population, which makes it necessary to conduct a thorough assessment of the existing food environment policies. The aims of the study were: (1) to depict the strength of healthy food environment policies in Poland and identify implementation policies and infrastructure support gaps; (2) to identify and prioritise improvement policies, taking into account their importance, achievability and equity. METHODS: We used the Healthy Food Environment Policy Index (Food-EPI). An experts' panel rated Polish policies and infrastructure compared to international best practices and developed a list of recommended improvement actions addressing both components. RESULTS: eight of the twenty-two policy and four of the twenty-two infrastructure indicators achieved the "no/very weak policy" result. Another four policy and five infrastructure indicators were considered "weak". Another seven and eight indicators, respectively, were assessed as "moderate". Among the identified actions, the highest priority was given to a food labelling system and training for persons involved in nutrition in schools. CONCLUSIONS: The Polish healthy food environment has been assessed as very weak or weak in most aspects. The infrastructure was assessed as slightly better compared to the policies domain, with more indicators receiving the "moderate" score.

Meta-review of implementation determinants for policies promoting healthy diet and physically active lifestyle: application of the Consolidated Framework for Implementation Research.

BACKGROUND: Although multiple systematic reviews indicate that various determinants (barriers and facilitators) occur in the implementation processes of policies promoting healthy diet, physical activity (PA), and sedentary behavior (SB) reduction, the overarching synthesis of such reviews is missing. Applying the Consolidated Framework for Implementation Research (CFIR), this meta-review aims to (1) identify determinants that were systematically indicated as occurring during the implementation processes and (2) identify differences in the presence of determinants across reviews versus stakeholder documents on healthy diet/PA/SB policies, reviews/stakeholder documents addressing healthy diet policies versus PA/SB policies targeting any population/setting, and healthy diet/PA/SB policies focusing on school settings. METHODS: A meta-review of published systematic scoping or realist reviews (k = 25) and stakeholder documents (k = 17) was conducted. Data from nine bibliographic databases and documentation of nine major stakeholders were systematically searched. Included reviews (72%) and stakeholder documents (100%) provided qualitative synthesis of original research on implementation determinants of policies promoting healthy diet or PA or SB reduction, and 28% of reviews provided some quantitative synthesis. Determinants were considered strongly supported if they were indicated by ≥ 60.0% of included reviews/stakeholder documents. RESULTS: Across the 26 CFIR-based implementation determinants, seven were supported by 66.7-76.2% of reviews/stakeholder documents. These determinants were cost, networking with other organizations/communities, external policies, structural characteristics of the setting, implementation climate, readiness for implementation, and knowledge/beliefs of involved individuals. Most frequently, published reviews provided support for inner setting and individual determinants, whereas stakeholder documents supported outer and inner setting implementation determinants. Comparisons between policies promoting healthy diet with PA/SB policies revealed shared support for only three implementation determinants: cost, implementation climate, and knowledge/beliefs. In the case of healthy diet/PA/SB policies targeting school settings, 14 out of 26 implementation determinants were strongly supported. CONCLUSIONS: The strongly supported (i.e., systematically indicated) determinants may guide policymakers and researchers who need to prioritize potential implementation determinants when planning and monitoring the implementation of respective policies. Future research should quantitatively assess the importance or role of determinants and test investigate associations between determinants and progress of implementation processes. TRIAL REGISTRATION: PROSPERO, # CRD42019133341.

Parental and Child Self-Efficacy Explaining Food Intake through Self-Regulation: A Dyadic Prospective Study.

BACKGROUND: According to social cognitive theory and socio-ecological models, self-efficacy and temptation-related self-regulation (the use of distraction or suppression) are modifiable predictors of health behaviors, such as food intake. Yet, there is limited evidence explaining how these factors are interlinked among parent-child dyads. This study investigated indirect effects of parental and child self-efficacy on food intake, via parental and child self-regulation. METHODS: The prospective study (the baseline [T1] and the 10-month follow-up [T2]) enrolled 924 parent-child dyads (1,848 individuals; 54.3% girls, aged 5-11 years, 88.9% mothers). Dyads were interviewed or completed self-report measures. Path analyses with maximum likelihood estimation were conducted. RESULTS: Child self-efficacy and distraction (T1) mediated between parental self-efficacy (T1) and higher levels of child fruit and vegetable intake (T2). No significant mediating effects of suppression were found, nor indirect effects of parental self-efficacy (T1) on energy-dense food intake (T2). CONCLUSION: Health promotion interventions aiming at changing fruit and vegetable intake among 5-11-year-old children should target enhancing parental and child self-efficacy that may facilitate the use of self-regulation and, in turn, healthy diet.

Do Parent-Child Dyads with Excessive Body Mass Differ from Dyads with Normal Body Mass in Perceptions of Obesogenic Environment?

BACKGROUND: This study addressed differences between parent-child dyads with excessive body mass (overweight or obesity) and dyads with normal body mass in obesity determinants, derived from social-ecological models. It was hypothesized that parents and their 5-11 years-old children with excessive body mass would (1) report lower availability of healthy food at home, (2) perceive fewer school/local community healthy eating promotion programs, (3) report lower persuasive value of food advertising. METHODS: Data were collected twice (T1, baseline; T2, 10-month follow-up), including n = 129 parent-child dyads with excessive body mass and n = 377 parent-child dyads with normal body mass. Self-reported data were collected from parents and children; with body weight and height assessed objectively. General linear models (including analysis of variance with repeated measures) were performed to test the hypotheses. RESULTS: Compared to dyads with normal body mass, dyads of parents and children with excessive body mass perceived lower availability of healthy food at home and fewer healthy eating promotion programs at school/local community (T1 and T2). These effects remained significant after controlling for sociodemographic variables. No significant differences in persuasive value of food advertising were found. CONCLUSIONS: Perceptions of availability of healthy food at home and healthy nutrition promotion may be relatively low in parent-child dyads with excessive weight which, in turn, may constitute a risk factor for maintenance of obesity.