Tensions and Paradoxes of Scaling Up: A Critical Reflection on Physical Activity Promotion.

BACKGROUND: Achieving system-level, sustainable 'scale-up' of interventions is the epitome of successful translation of evidence-based approaches in population health. In physical activity promotion, few evidence-based interventions reach implementation at scale or become embedded within systems for sustainable health impact. This is despite the vast published literature describing efficacy studies of small-scale physical activity interventions. Research into physical activity scale-up (through case-study analysis; evaluations of scale-up processes in implementation trials; and mapping the processes, strategies, and principles for scale-up) has identified barriers and facilitators to intervention expansion. Many interventions are implemented at scale by governments but have not been evaluated or have unpublished evaluation information. Further, few public health interventions have evaluations that reveal the costs and benefits of scaled-up implementation. This lack of economic information introduces an additional element of risk for decision makers when deciding which physical activity interventions should be supported with scarce funding resources. Decision-makers face many other challenges when scaling interventions which do not relate to formal research trials of scale-up; Methods: To explore these issues, a multidisciplinary two-day workshop involving experts in physical activity scale-up was convened by the University of Newcastle, Australia, and the University of Ottawa, Canada (February 2019); Results: In this paper we discuss some of the scale-up tensions (challenges and conflicts) and paradoxes (things that are contrary to expectations) that emerged from this workshop in the context of the current literature and our own experiences in this field. We frame scale-up tensions according to epistemology, methodology, time, and partnerships; and paradoxes as 'reach without scale', 'planned serendipity' and 'simple complexity'. We reflect on the implications of these scale-up tensions and paradoxes, providing considerations for future scale-up research and practice moving forward; Conclusions: In this paper, we delve deeper into stakeholders' assumptions, processes and expectations of scaling up, and challenge in what ways as stakeholders, we all contribute to desired or undesired outcomes. Through a lens of 'tensions' and 'paradoxes', we make an original contribution to the scale-up literature that might influence current perspectives of scaling-up, provide future approaches for physical activity promotion, and contribute to understanding of dynamic of research-practice partnerships.

"Getting Ireland Active"-Application of a Systems Approach to Increase Physical Activity in Ireland Using the GAPPA Framework.

Physical activity (PA) promotion is a complex challenge, with the Global Action Plan on Physical Activity (GAPPA) endorsing a systems approach and recommending countries assess existing areas of progress which can be strengthened. This paper reports a process facilitating a systems approach for identifying current good practice and gaps for promoting PA in Ireland. Elements of participatory action research were enabled through 3 stages: (1) aligning examples of actions from Irish policy documents (n = 3) to the GAPPA, (2) workshop with stakeholders across multiple sectors, and (3) review of outputs. Data collected through the workshop were analyzed using a deductive thematic analysis guided by the GAPPA. The policy context in Ireland aligns closely to the GAPPA with the creation of Active Systems the most common strategic objective across policy documents. Forty participants (50% male) took part in the systems approach workshop, which after revision resulted in 80 examples of good practice and 121 actions for greater impact. A pragmatic and replicable process facilitating a systems approach was adopted and showed current Irish policy and practices align with the GAPPA "good practices." The process provides existing areas of progress which can be strengthened, as well as the policy opportunities and practice gaps.

Systematic Review to Update 'Value of a Statistical Life' Estimates for Australia.

The value of a statistical life (VSL) estimates individuals' willingness to trade wealth for mortality risk reduction. This economic parameter is often a major component of the quantified benefits estimated in the evaluation of government policies related to health and safety. This study reviewed the literature to update the VSL recommended for Australian policy appraisals. A systematic literature review was conducted to capture Australian primary studies and international review papers reporting VSL estimates published from 2007 to January 2019. International estimates were adjusted for income differences and the median VSL estimate was extracted from each review study. VSL estimates were used to calculate the value of a statistical life year. Of the 18 studies that met the inclusion criteria, two studies were primary Australian studies with a weighted mean VSL of A$7.0 million in 2017 values. The median VSL in the review studies was A$7.3 million. For Australian public policy appraisals, we recommend the consideration of a base case VSL for people of all ages and across all risk contexts of A$7.0 million. Sensitivity analyses could use a high value of A$7.3 million and a low value that reflects the value (A$4.3 million) currently recommended by the Australian government.

Strategies for involving patients and the public in scaling-up initiatives in health and social services: protocol for a scoping review and Delphi survey.

BACKGROUND: The scale-up of evidence-based innovations is required to reduce waste and inequities in health and social services (HSS). However, it often tends to be a top-down process initiated by policy makers, and the values of the intended beneficiaries are forgotten. Involving multiple stakeholders including patients and the public in the scaling-up process is thus essential but highly complex. We propose to identify relevant strategies for meaningfully and equitably involving patients and the public in the science and practice of scaling up in HSS. METHODS: We will adapt our overall method from the RAND/UCLA Appropriateness Method. Following this, we will perform a two-prong study design (knowledge synthesis and Delphi study) grounded in an integrated knowledge translation approach. This approach involves extensive participation of a network of stakeholders interested in patient and public involvement (PPI) in scaling up and a multidisciplinary steering committee. We will conduct a systematic scoping review following the methodology recommended in the Joanna Briggs Institute Reviewers Manual. We will use the following eligibility criteria: (1) participants-any stakeholder involved in creating or testing a strategy for PPI; (2) intervention-any PPI strategy proposed for scaling-up initiatives; (3) comparator-no restriction; (4) outcomes: any process or outcome metrics related to PPI; and (5) setting-HSS. We will search electronic databases (e.g., Medline, Web of Science, Sociological Abstract) from inception onwards, hand search relevant websites, screen the reference lists of included records, and consult experts in the field. Two reviewers will independently select and extract eligible studies. We will summarize data quantitatively and qualitatively and report results using the PRISMA extension for Scoping Reviews (PRISMA-ScR) checklist. We will conduct an online Delphi survey to achieve consensus on the relevant strategies for PPI in scaling-up initiatives in HSS. Participants will include stakeholders from low-, middle-, and high-income countries. We anticipate that three rounds will allow an acceptable degree of agreement on research priorities. DISCUSSION: Our findings will advance understanding of how to meaningfully and equitably involve patients and the public in scaling-up initiatives for sustainable HSS. SYSTEMATIC REVIEW REGISTRATION: We registered this protocol with the Open Science Framework on August 19, 2020 ( https://osf.io/zqpx7/ ).

Translational Research Grants Scheme (TRGS): a new approach to strengthening health system research capacity.

BACKGROUND: Bridging the 'gap' between research evidence and the complexities of policy and practice is central to health improvement. The Translational Research Grants Scheme (TRGS) in New South Wales (NSW), Australia, is a funding scheme aimed at reducing the time between research generation and translation to policy and practice. The TRGS is also an important part of NSW Health's efforts to harness and strengthen research capacity to improve health service delivery. METHODS: A document review and interviews (n = 12) with key stakeholders were undertaken following the first round of TRGS funding in November 2016. The communications from continuing quality improvement processes over the three funding rounds have provided further insight. RESULTS AND DISCUSSION: A total of 53 projects have been funded under the scheme, with recipients across many NSW Health organisations. NSW Health has committed more than $24 million to date. Round one of the TRGS was received well by the policy makers, Local Health Districts and research stakeholders interviewed. Of particular note were: the requirement for Chief Executives to demonstrate strong support for the implementation of findings; requirements to partner with state-wide policy leads and clinical networks; and capacity-building outcomes of the scheme. The ongoing quality improvement processes indicate that the program continues to be well received, with improvements to partnership arrangements, and an acknowledgement of the challenge that arises because the scheme, by nature of its capacity-building aim, attracts proposals from a range of research experience. LESSONS LEARNT: The TRGS is filling an important gap in the research funding landscape in NSW and is well regarded by stakeholders. To ensure that the TRGS is achieving its intended aims, an evaluation of the impact of the scheme will take place during 2018-19.

Codesign of the Population Health Information Management System to measure reach and practice change of childhood obesity programs.

INTRODUCTION: Childhood obesity prevalence is an issue of international public health concern and governments have a significant role to play in its reduction. The Healthy Children Initiative (HCI) has been delivered in New South Wales (NSW), Australia, since 2011 to support implementation of childhood obesity prevention programs at scale. Consequently, a system to support local implementation and data collection, analysis and reporting at local and state levels was necessary. The Population Health Information Management System (PHIMS) was developed to meet this need. Design and development: A collaborative and iterative process was applied to the design and development of the system. The process comprised identifying technical requirements, building system infrastructure, delivering training, deploying the system and implementing quality measures. Use of PHIMS: Implementation of PHIMS resulted in rapid data retrieval and reporting against agreed performance measures for the HCI. The system has 150 users who account for the monitoring and reporting of more than 6000 HCI intervention sites (early childhood services and primary schools). LESSONS LEARNT: Developing and implementing PHIMS presented a number of complexities including: applying an information technology (IT) development methodology to a traditional health promotion setting; data access and confidentiality issues; and managing system development and deployment to intended timelines and budget. PHIMS was successfully codesigned as a flexible, scalable and sustainable IT solution that supports state-wide HCI program implementation, monitoring and reporting.

The Prevention Research Support Program: supporting innovation in research, translation and capability building.

OBJECTIVES: The Prevention Research Support Program (PRSP) is a New South Wales (NSW) Ministry of Health funding scheme. The scheme aims to build capability, and strengthen prevention and early intervention research that is important to the NSW public health system (NSW Health) and that leads to improved health and reduced health inequities for the people of NSW. This paper describes how PRSP funding has supported recipients to produce high-quality, policy-relevant research, and increase the impact of research on policy and practice. Type of program: The PRSP is a competitive funding program that supports NSW research organisations that conduct prevention and early intervention research that aligns with NSW Health priorities. The objectives of the PRSP are to: increase high-quality and internationally recognised prevention research in NSW; support the generation of research evidence that addresses NSW Health prevention priorities, including cross-government priorities; encourage the adoption of research evidence in relevant policies, programs and services in NSW; and build the prevention research capability of NSW Health staff and the NSW Health system. METHODS: Funding recipients provide information about their research, translation and capability building achievements in their funding applications and submit annual progress reports. Data from these sources were aggregated to illustrate trends in indicators of research excellence over time. Prior to the most recent call for applications, the program was reviewed. The review included consultations with funding recipients, policy and practice partners, and key funding stakeholders. Stakeholders' perceptions of the benefits and challenges associated with the PRSP were drawn from the consultation data. RESULTS: PRSP funding recipients demonstrate considerable increases over time on several indicators of research excellence, including peer-reviewed journal publications, grant income, and research students supervised. Recipients use a range of strategies to ensure dialogue with health system partners, and report research impacts at the local, state, national and international levels. PRSP funding also supports the development of research capability. LESSONS LEARNT: The PRSP is a unique scheme that is highly valued by both funding recipients and health system stakeholders. The continuity of funding provided under the scheme enables recipients to adopt a strategic approach to their research and develop innovative strategies to support its conduct and use.

Tracking funded health intervention research.

OBJECTIVE: To describe the research publication outputs from intervention research funded by Australia's National Health and Medical Research Council (NHMRC). DESIGN AND SETTING: Analysis of descriptive data and data on publication outputs collected between 23 July 2012 and 10 December 2013 relating to health intervention research project grants funded between 1 January 2003 and 31 December 2007. MAIN OUTCOME MEASURES: Stages of development of intervention studies (efficacy, effectiveness, replication, adaptation or dissemination of intervention); types of interventions studied; publication output per NHMRC grant; and whether interventions produced statistically significant changes in primary outcome variables. RESULTS: Most of the identified studies tested intervention efficacy or effectiveness in clinical or community settings, with few testing the later stages of intervention development, such as replication, adaptation or dissemination. Studies focused largely on chronic disease treatment and management, and encompassed various medical and allied health disciplines. Equal numbers of studies had interventions that produced statistically significant results on primary outcomes, (27) and those that did not (27). The mean number of total published articles per grant was 3.3, with 2.0 articles per grant focusing on results, and the remainder covering descriptive, exploratory or methodological aspects of intervention research. CONCLUSIONS: Our study provides a benchmark for the publication outputs of NHMRC-funded health intervention research in Australia. Research productivity is particularly important for intervention research, where findings are likely to have more immediate and direct applicability to health policy and practice. Tracking research outputs in this way provides information on whether current research investment patterns match the need for evidence about health care interventions.

A mixed methods study of the factors that influence whether intervention research has policy and practice impacts: perceptions of Australian researchers.

OBJECTIVES: To investigate researchers' perceptions about the factors that influenced the policy and practice impacts (or lack of impact) of one of their own funded intervention research studies. DESIGN: Mixed method, cross-sectional study. SETTING: Intervention research conducted in Australia and funded by Australia's National Health and Medical Research Council between 2003 and 2007. PARTICIPANTS: The chief investigators from 50 funded intervention research studies were interviewed to determine if their study had achieved policy and practice impacts, how and why these impacts had (or had not) occurred and the approach to dissemination they had employed. RESULTS: We found that statistically significant intervention effects and publication of results influenced whether there were policy and practice impacts, along with factors related to the nature of the intervention itself, the researchers' experience and connections, their dissemination and translation efforts, and the postresearch context. CONCLUSIONS: This study indicates that sophisticated approaches to intervention development, dissemination actions and translational efforts are actually widespread among experienced researches, and can achieve policy and practice impacts. However, it was the links between the intervention results, further dissemination actions by researchers and a variety of postresearch contextual factors that ultimately determined whether a study had policy and practice impacts. Given the complicated interplay between the various factors, there appears to be no simple formula for determining which intervention studies should be funded in order to achieve optimal policy and practice impacts.

Piloting proactive marketing to recruit disadvantaged adults to a community-wide obesity prevention program.

Population-wide obesity prevention and treatment programs are fundamental to addressing the increasing overweight and obesity rates in socioeconomically disadvantaged populations. Innovative recruitment strategies, including proactive marketing strategies, are needed to ensure such programs have universal reach and target vulnerable populations. This study aimed to determine the success of proactive recruitment to Australia's Get Healthy Information and Coaching Service® (GHS) and to assess whether the recruitment strategy influenced participants' outcomes. Sociodemographic information was collected from all GHS participants who joined the service between February 2009 and August 2013, and anthropometric information regarding behavioural risk factors was collected from all GHS coaching participants at baseline and six months. Data were analysed according to the participants' referral source (self-referral and secondary referral versus proactive recruitment). Participants recruited through proactive marketing were more likely to be male, aged 50 years or older, have high school education, not be in paid employment and be from the lowest three quintiles of socioeconomic advantage. The risk factor profile of coaching participants recruited through proactive marketing did not vary significantly from those recruited via other mechanisms, although they were less likely to be obese and less likely to have a higher 'at risk' waist circumference measurement. Proactively recruited coaching participants reported significant improvements from baseline to six months (consistent with improvements made by participants recruited through other strategies), although they were significantly more likely to withdraw from coaching before they completed the six-month program.Proactive marketing facilitated use of an obesity prevention service; similar services may have greater reach if proactive marketing recruitment strategies are used. These strategies could be encouraged to assist such services to achieve optimal population impact among hard-to-reach populations.

A narrative review of research impact assessment models and methods.

BACKGROUND: Research funding agencies continue to grapple with assessing research impact. Theoretical frameworks are useful tools for describing and understanding research impact. The purpose of this narrative literature review was to synthesize evidence that describes processes and conceptual models for assessing policy and practice impacts of public health research. METHODS: The review involved keyword searches of electronic databases, including MEDLINE, CINAHL, PsycINFO, EBM Reviews, and Google Scholar in July/August 2013. Review search terms included 'research impact', 'policy and practice', 'intervention research', 'translational research', 'health promotion', and 'public health'. The review included theoretical and opinion pieces, case studies, descriptive studies, frameworks and systematic reviews describing processes, and conceptual models for assessing research impact. The review was conducted in two phases: initially, abstracts were retrieved and assessed against the review criteria followed by the retrieval and assessment of full papers against review criteria. RESULTS: Thirty one primary studies and one systematic review met the review criteria, with 88% of studies published since 2006. Studies comprised assessments of the impacts of a wide range of health-related research, including basic and biomedical research, clinical trials, health service research, as well as public health research. Six studies had an explicit focus on assessing impacts of health promotion or public health research and one had a specific focus on intervention research impact assessment. A total of 16 different impact assessment models were identified, with the 'payback model' the most frequently used conceptual framework. Typically, impacts were assessed across multiple dimensions using mixed methodologies, including publication and citation analysis, interviews with principal investigators, peer assessment, case studies, and document analysis. The vast majority of studies relied on principal investigator interviews and/or peer review to assess impacts, instead of interviewing policymakers and end-users of research. CONCLUSIONS: Research impact assessment is a new field of scientific endeavour and there are a growing number of conceptual frameworks applied to assess the impacts of research.

Does health intervention research have real world policy and practice impacts: testing a new impact assessment tool.

BACKGROUND: There is a growing emphasis on the importance of research having demonstrable public benefit. Measurements of the impacts of research are therefore needed. We applied a modified impact assessment process that builds on best practice to 5 years (2003-2007) of intervention research funded by Australia's National Health and Medical Research Council to determine if these studies had post-research real-world policy and practice impacts. METHODS: We used a mixed method sequential methodology whereby chief investigators of eligible intervention studies who completed two surveys and an interview were included in our final sample (n = 50), on which we conducted post-research impact assessments. Data from the surveys and interviews were triangulated with additional information obtained from documentary analysis to develop comprehensive case studies. These case studies were then summarized and the reported impacts were scored by an expert panel using criteria for four impact dimensions: corroboration; attribution, reach, and importance. RESULTS: Nineteen (38%) of the cases in our final sample were found to have had policy and practice impacts, with an even distribution of high, medium, and low impact scores. While the tool facilitated a rigorous and explicit criterion-based assessment of post-research impacts, it was not always possible to obtain evidence using documentary analysis to corroborate the impacts reported in chief investigator interviews. CONCLUSIONS: While policy and practice is ideally informed by reviews of evidence, some intervention research can and does have real world impacts that can be attributed to single studies. We recommend impact assessments apply explicit criteria to consider the corroboration, attribution, reach, and importance of reported impacts on policy and practice. Impact assessments should also allow sufficient time between impact data collection and completion of the original research and include mechanisms to obtain end-user input to corroborate claims and reduce biases that result from seeking information from researchers only.

Harnessing the power of advertising to prevent childhood obesity.

BACKGROUND: Social marketing integrates communication campaigns with behavioural and environmental change strategies. Childhood obesity programs could benefit significantly from social marketing but communication campaigns on this issue tend to be stand-alone. METHODS: A large-scale multi-setting child obesity prevention program was implemented in the Hunter New England (HNE) region of New South Wales (NSW), Australia from 2005-2010. The program included a series of communication campaigns promoting the program and its key messages: drinking water; getting physically active and; eating more vegetables and fruit. Pre-post telephone surveys (n = 9) were undertaken to evaluate awareness of the campaigns among parents of children aged 2-15 years using repeat cross-sections of randomly selected cohorts. A total of 1,367 parents (HNE = 748, NSW = 619) participated. RESULTS: At each survey post baseline, HNE parents were significantly more likely to have seen, read or heard about the program and its messages in the media than parents in the remainder of the state (p < 0.001). Further, there was a significant increase in awareness of the program and each of its messages over time in HNE compared to no change over time in NSW (p < 0.001). Awareness was significantly higher (p < 0.05) in HNE compared to NSW after each specific campaign (except the vegetable one) and significantly higher awareness levels were sustained for each campaign until the end of the program. At the end of the program participants without a tertiary education were significantly more likely (p = 0.04) to be aware of the brand campaign (31%) than those with (20%) but there were no other statistically significant socio-demographic differences in awareness. CONCLUSIONS: The Good for Kids communication campaigns increased and maintained awareness of childhood obesity prevention messages. Moreover, messages were delivered equitably to diverse socio-demographic groups within the region.

Evaluation framework for translational research: case study of Australia's get healthy information and coaching service(R).

The Get Healthy Information and Coaching Service® (GHS), a free government-funded telephone-delivered information and coaching service was launched in February 2009 by the Australian New South Wales state government. It represents the translation of research evidence applied in the real world (T4 or Phase 4 translation), aimed at addressing the modifiable risk factors associated with the overweight and obesity. In controlled settings, it has been established that telephone-based lifestyle counseling programs are efficacious in reducing anthropometric and behavioral risk factors. This article presents the GHS case study as a population-wide intervention and describes the quasi-experimental evaluation framework used to evaluate both the process (statewide implementation) and impact (effectiveness) of the GHS in a real-world environment. It details the data collection, measures, and statistical analysis required in assessing the process of implementation-reach and recruitment, marketing and promotion, service satisfaction, intervention fidelity, and GHS setting up and operations costs-and in assessing the impact of GHS-increasing physical activity, improving dietary practices, and reducing body weight and waist circumference. The comprehensive evaluation framework designed for the GHS provides a method for building effectiveness evidence of a rare translation of efficacy trial evidence into population-wide practice.

Impact of a population based intervention to increase the adoption of multiple physical activity practices in centre based childcare services: a quasi experimental, effectiveness study.

BACKGROUND: There is considerable scope to improve the delivery of practices that increase the physical activity of children in centre based childcare services. Few studies have reported the effectiveness of interventions to address this, particularly at a population level. The primary aim of this study was to describe the impact of an intervention to increase the adoption of multiple policies and practices to promote physical activity in centre based childcare services. METHODS: A quasi experimental study was conducted in centre based childcare services (n =228) in New South Wales (NSW), Australia and involved a three month intervention to increase the adoption of eight practices within childcare services that have been suggested to promote child physical activity. Intervention strategies to support the adoption of practices included staff training, resources, incentives, follow-up support and performance monitoring and feedback. Randomly selected childcare services in the remainder of NSW acted as a comparison group (n = 164) and did not receive the intervention but may have been exposed to a concurrent NSW government healthy eating and physical activity initiative. Self reported information on physical activity policies, fundamental movement skills sessions, structured physical activity opportunities, staff involvement in active play and provision of verbal prompts to encourage physical activity, small screen recreation opportunities, sedentary time, and staff trained in physical activity were collected by telephone survey with childcare service managers at baseline and 18 months later. RESULTS: Compared with the comparison area, the study found significantly greater increases in the prevalence of intervention services with a written physical activity policy, with policy referring to placing limits on small screen recreation, and with staff trained in physical activity. In addition, non-significant trends towards a greater increase in the proportion of intervention services conducting daily fundamental movement skill sessions, and such services having a physical activity policy supporting physical activity training for staff were also evident. CONCLUSION: The intervention was effective in improving a number of centre based childcare service policies and practices associated with promoting child physical activity. Adoption of a broader range of practices may require more intensive and prolonged intervention support.

Effectiveness of a multi-strategy intervention in increasing the implementation of vegetable and fruit breaks by Australian primary schools: a non-randomized controlled trial.

BACKGROUND: Limited evidence exists describing the effectiveness of strategies in facilitating the implementation of vegetable and fruit programs by schools on a population wide basis. The aim of this study was to examine the effectiveness of a multi-strategy intervention in increasing the population-wide implementation of vegetable and fruit breaks by primary schools and to determine if intervention effectiveness varied by school characteristics. METHODS: A quasi-experimental study was conducted in primary schools in the state of New South Wales, Australia. All primary schools in one region of the state (n = 422) received a multi-strategy intervention. A random sample of schools (n = 406) in the remainder of the state served as comparison schools. The multi-strategy intervention to increase vegetable and fruit breaks involved the development and provision of: program consensus and leadership; staff training; program materials; incentives; follow-up support; and implementation feedback. Comparison schools had access to routine information-based Government support. Data to assess the prevalence of vegetable and fruit breaks were collected by telephone from Principals of the intervention and comparison schools at baseline (2006-2007) and 11 to 15 months following the commencement of the intervention (2009-2010). GEE analysis was used to examine the change in the prevalence of vegetable and fruit breaks in intervention schools compared to comparison schools. RESULTS: At follow-up, prevalence of vegetable and fruit breaks increased significantly in both intervention (50.3% to 82.0%, p < 0.001) and comparison (45.4% to 60.9% p < 0.001) schools. The increase in prevalence in intervention schools was significantly larger than among comparison schools (OR 2.36; 95% CI 1.60-3.49, p <0.001). The effect size was similar between schools regardless of the rurality or socioeconomic status of school location, school size or government or non-government school type. CONCLUSION: The findings suggest that a multi-strategy intervention can significantly increase the implementation of vegetable and fruit breaks by a large number of Australian primary schools.

Research to practice: application of an evidence-building framework to a childhood obesity prevention initiative in New South Wales.

ISSUE ADDRESSED: Building evidence-based health promotion programs involves a number of steps. This paper aims to develop a set of criteria for assessing the evidence available according to a five-stage evidence-building framework, and apply these criteria to current child obesity prevention programs in NSW to determine the usefulness of the framework in identifying gaps in evidence and opportunities for future research and evaluation. METHODS: A set of scoring criteria were developed for application within the five stages of an 'evidence-building' framework: problem definition, solution generation, intervention testing (efficacy), intervention replication, and dissemination research. The research evidence surrounding the 10 childhood obesity prevention programs planned for state-wide implementation in the New South Wales Healthy Children Initiative (HCI) was identified and examined using these criteria within the framework. RESULTS: The evidence for the component programs of the HCI is at different stages of development. While problem definition and, to a lesser extent, solution generation was thoroughly addressed across all programs, there were a number of evidence gaps, indicating research opportunities for efficacy testing and intervention replication across a variety of settings and populations. CONCLUSIONS: The five-stage evidence-building framework helped identify important research and evaluation opportunities that could improve health promotion practice in NSW. More work is needed to determine the validity and reliability of the criteria for rating the extent and quality of the evidence for each stage.

The strategic development of the NSW Health Plan for Prevention of Falls and Harm from Falls Among Older People: 2011-2015; translating research into policy and practice.

With our rapidly ageing population there is an urgent imperative to minimise the rate of falls and associated injuries. A key challenge to public health is to better conceptualise and contextualise falls prevention evidence for more effective policy making and practice. This paper describes how NSW Health adopted the Nutbeam and Bauman Stages of Research and Evaluation Model in the strategic development of the NSW Health Plan for Prevention of Falls and Harm from Falls Among Older People: 2011-2015. Research evidence has been comprehensively applied to every stage of the development of the Plan and research and evaluation is a key action area within the new Plan. The Stages of Research and Evaluation Model provides a useful overarching framework for policy makers to contextualise and more effectively apply research evidence throughout the policy making process from problem definition to program monitoring.