Evolution of a multilevel framework for health program evaluation.

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Physical Symptoms at the Time of Dying Was Diagnosed: A Consecutive Cohort Study To Describe the Prevalence and Intensity of Problems Experienced by Imminently Dying Palliative Care Patients by Diagnosis and Place of Care.

OBJECTIVE: The aim of this work was to analyze routine assessments recorded, when a patient was documented as likely to die in hours to days, to determine the prevalence, intensity, and associations of physical symptoms. BACKGROUND: Although death inevitably occurs, very little prospective data describe at population level the physical symptoms confronting imminently dying people. METHODS: Using prospectively collected data from participating palliative care services in the Australian Palliative Care Outcomes Collaboration between July 1, 2013, and December 31, 2014, factors associated with worse symptom experiences were explored using logistic regression modeling. RESULTS: The experiences of 18,975 patients who died after being identified as imminently terminal were analyzed, with 75% (n = 14,238) of these being cancer deaths. Seventy percent (n = 13,051) occurred in a palliative care unit, 8.7% (n = 1657) in an acute hospital with palliative care support, and 22.5% (n = 4266) at home. More than half were assessed as experiencing acceptable symptom control especially those with nonmalignant disease. The notable exception was breathing problems, where compared to cancer patients, those with nonmalignant disease were 34% more likely to experience distressing breathlessness (odds ratio 1.34; 95% confidence interval 1.23-147). Regardless of the cause, deaths in a community setting were more likely to be complicated by more severe symptoms with the exception of breathlessness, where those dying in acute hospitals were most likely to be assessed as requiring further help. DISCUSSION: The terminal phase is perceived as a time where the majority will experience distressing symptoms, but this work suggests a contrary view. However, there did seem to be a detrimental effect depending on place of care with more significant problems recorded when people were dying at home. More work is needed to clarify this given the current push for more home deaths.

Evaluating return on investment in a school based health promotion and prevention program: the investment multiplier for the Stephanie Alexander Kitchen Garden National Program.

Successful health promotion and disease prevention strategies in complex community settings such as primary schools rely on acceptance and ownership across community networks. Assessing multiplier impacts from investment on related community activity over time are suggested as key alongside evidence of program health effects on targeted groups of individuals in gauging community network engagement and ownership, dynamic impacts, and program long term success and return on investment. An Australian primary school based health promotion and prevention strategy, the Stephanie Alexander Kitchen Garden National Program (SAKGNP), which has been providing garden and kitchen classes for year 3-6 students since 2008, was evaluated between 2011 and 2012. Returns on Australian Federal Government investment for school infrastructure grants up to $60,000 are assessed up to and beyond a two year mutual obligation period with: (i) Impacts on student lifestyle behaviours, food choices and eating habits surveyed across students (n = 491 versus 260) and parents (n = 300 versus 234) in 28 SAKGNP and 14 matched schools, controlling for school and parent level confounders and triangulated with SAKGNP pre-post analysis; (ii) Multiplier impacts of investment on related school and wider community activity up to two years; and (iii) Evidence of continuation and program evolution in schools observed beyond two years. SAKGNP schools showed improved student food choices (p = 0.024) and kitchen lifestyle behaviour (p = 0.019) domains compared to controls and in pre-post analysis where 20.0% (58/290) reported eating fruit and vegetables more often and 18.6% (54/290) preparing food at home more often. No significant differences were found in case control analysis for eating habits or garden lifestyle behaviour domains, although 32.3% of children helped more in the garden (91/278) and 15.6% (45/289) ate meals together more often in pre-post analysis. The multiplier impact on total community activity up to two years was 5.07 ($226,737/$44,758); 1.60 attributable to school, and 2.47 to wider community, activity. All 8 schools observed beyond two years continued garden and kitchen classes, with an average 17% scaling up and one school fully integrating staff into the curriculum. In conclusion evidence supports the SAKGNP to be a successful health promotion program with high community network impacts and return on investment in practice.