The impact of a regionally based translational cancer research collaborative in Australia using the FAIT methodology.

BACKGROUND: Translating research, achieving impact, and assessing impact are important aspirations for all research collaboratives but can prove challenging. The Hunter Cancer Research Alliance (HCRA) was funded from 2014 to 2021 to enhance capacity and productivity in cancer research in a regional centre in Australia. This study aimed to assess the impact and benefit of the HCRA to help inform future research investments of this type. METHOD: The Framework to Assess the Impact from Translational health research (FAIT) was selected as the preferred methodology. FAIT incorporates three validated methodologies for assessing impact: 1) Modified Payback; 2) Economic Analysis; and 3) Narrative overview and case studies. All three FAIT methods are underpinned by a Program Logic Model. Data were collected from HCRA and the University of Newcastle administrative records, directly from HCRA members, and website searches. RESULTS: In addition to advancing knowledge and providing capacity building support to members via grants, fellowships, scholarships, training, events and targeted translation support, key impacts of HCRA-member research teams included: (i) the establishment of a regional biobank that has distributed over 13,600 samples and became largely self-sustaining; (ii) conservatively leveraging $43.8 M (s.a.$20.5 M - $160.5 M) in funding and support from the initial $9.7 M investment; (iii) contributing to clinical practice guidelines and securing a patent for identification of stem cells for endometrial cell regeneration; (iv) shifting the treatment paradigm for all tumour types that rely on nerve cell innervation, (v) development and implementation of the world's first real-time patient treatment verification system (Watchdog); (vi) inventing the effective 'EAT' psychological intervention to improve nutrition and outcomes in people experiencing radiotherapy for head and neck cancer; (vi) developing effective interventions to reduce smoking rates among priority groups, currently being rolled out to disadvantaged populations in NSW; and (vii) establishing a Consumer Advisory Panel and Consumer Engagement Committee to increase consumer involvement in research. CONCLUSION: Using FAIT methodology, we have demonstrated the significant impact and downstream benefits that can be achieved by the provision of infrastructure-type funding to regional and rural research collaboratives to help address inequities in research activity and health outcomes and demonstrates a positive return on investment.

Prioritising and incentivising productivity within indicator-based approaches to Research Impact Assessment: a commentary.

Research Impact Assessment (RIA) represents one of a suite of policies intended to improve the impact generated from investment in health and medical research (HMR). Positivist indicator-based approaches to RIA are widely implemented but increasingly criticised as theoretically problematic, unfair, and burdensome. This commentary proposes there are useful outcomes that emerge from the process of applying an indicator-based RIA framework, separate from those encapsulated in the metrics themselves. The aim for this commentary is to demonstrate how the act of conducting an indicator-based approach to RIA can serve to optimise the productive gains from the investment in HMR. Prior research found that the issues regarding RIA are less about the choice of indicators/metrics, and more about the discussions prompted and activities incentivised by the process. This insight provides an opportunity to utilise indicator-based methods to purposely optimise the research impact. An indicator-based RIA framework specifically designed to optimise research impacts should: focus on researchers and the research process, rather than institution-level measures; utilise a project level unit of analysis that provides control to researchers and supports collaboration and accountability; provide for prospective implementation of RIA and the prospective orientation of research; establish a line of sight to the ultimate anticipated beneficiaries and impacts; Include process metrics/indicators to acknowledge interim steps on the pathway to final impacts; integrate 'next' users and prioritise the utilisation of research outputs as a critical measure; Integrate and align the incentives for researchers/research projects arising from RIA, with those existing within the prevailing research system; integrate with existing peer-review processes; and, adopt a system-wide approach where incremental improvements in the probability of translation from individual research projects, yields higher impact across the whole funding portfolio.Optimisation of the impacts from HMR investment represents the primary purpose of Research Impact policy. The process of conducting an indicator-based approach to RIA, which engages the researcher during the inception and planning phase, can directly contribute to this goal through improvements in the probability that an individual project will generate interim impacts. The research project funding process represents a promising forum to integrate this approach within the existing research system.

Impact assessment of the Centre for Research Excellence in Stroke Rehabilitation and Brain Recovery.

BACKGROUND: Research impact is an emerging measure of research achievement alongside traditional academic outputs such as publications. We present the results of applying the Framework to Assess the Impact from Translational health research (FAIT) to the Centre for Research Excellence (CRE) in Stroke Rehabilitation and Brain Recovery (CRE-Stroke, 2014-2019) and report on the feasibility and lessons from the application of FAIT to a CRE rather than a discrete research project. METHODS: Data were gathered via online surveys, in-depth interviews, document analysis and review of relevant websites/databases to report on the three major FAIT methods: the modified Payback Framework, an assessment of costs against monetized consequences, and a narrative account of the impact generated from CRE-Stroke activities. FAIT was applied during the last 4 years of CRE-Stroke operation. RESULTS: With an economic investment of AU$ 3.9 million over 5 years, CRE-Stroke delivered a return on investment that included AU$ 18.8 million in leveraged grants, fellowships and consultancies. Collectively, CRE-Stroke members produced 354 publications that were accessed 470,000 times and cited over 7220 times. CRE-Stroke supported 26 PhDs, 39 postdocs and seven novice clinician researchers. There were 59 capacity-building events benefiting 744 individuals including policy-makers and consumers. CRE-Stroke created research infrastructure (including a research register of stroke survivors and a brain biobank), and its global leadership produced international consensus recommendations to influence the stroke research landscape worldwide. Members contributed to the Australian Living Stroke Guidelines: four researchers' outputs were directly referenced. Based only on the consequences that could be monetized, CRE-Stroke returned AU$ 4.82 for every dollar invested in the CRE. CONCLUSION: This case example in the developing field of impact assessment illustrates how researchers can use evidence to demonstrate and report the impact of and returns on research investment. The prospective application of FAIT by a dedicated research impact team demonstrated impact in broad categories of knowledge-gain, capacity-building, new infrastructure, input to policy and economic benefits. The methods can be used by other research teams to provide comprehensive evidence to governments and other research funders about what has been generated from their research investment but requires dedicated resources to complete.

Evaluation of an online intervention for improving stroke survivors' health-related quality of life: A randomised controlled trial.

BACKGROUND: The aim of this trial was to evaluate the effectiveness of an online health behaviour change intervention-Prevent 2nd Stroke (P2S)-at improving health-related quality of life (HRQoL) amongst stroke survivors at 6 months of follow-up. METHODS AND FINDINGS: A prospective, blinded-endpoint randomised controlled trial, with stroke survivors as the unit of randomisation, was conducted between March 2018 and November 2019. Adult stroke survivors between 6 and 36 months post-stroke with capacity to use the intervention (determined by a score of ≥4 on the Modified Rankin Scale) and who had access and willingness to use the internet were recruited via mail-out invitations from 1 national and 1 regional stroke registry. Participants completed baseline (n = 399) and 6-month follow-up (n = 356; 89%) outcome assessments via computer-assisted telephone interviewing (CATI). At baseline the sample had an average age of 66 years (SD 12), and 65% were male. Randomisation occurred at the end of the baseline survey; CATI assessors and independent statisticians were blind to group allocation. The intervention group received remote access for a 12-week period to the online-only P2S program (n = 199; n = 28 lost at follow-up). The control group were emailed and posted a list of internet addresses of generic health websites (n = 200; n = 15 lost at follow-up). The primary outcome was HRQoL as measured by the EuroQol Visual Analogue Scale (EQ-VAS; self-rated global health); the outcome was assessed for differences between treatment groups at follow-up, adjusting for baseline measures. Secondary outcomes were HRQoL as measured by the EQ-5D (descriptive health state), diet quality, physical activity, alcohol consumption, smoking status, mood, physical functioning, and independent living. All outcomes included the variable 'stroke event (stroke/transient ischaemic attack/other)' as a covariate, and analysis was intention-to-treat. At 6 months, median EQ-VAS HRQoL score was significantly higher in the intervention group than the control group (85 vs 80, difference 5, 95% CI 0.79-9.21, p = 0.020). The results were robust to the assumption the data were missing at random; however, the results were not robust to the assumption that the difference in HRQoL between those with complete versus missing data was at least 3 points. Significantly higher proportions of people in the intervention group reported no problems with personal care (OR 2.17, 95% CI 1.05-4.48, p = 0.0359) and usual activities (OR 1.66, 95% CI 1.06-2.60, p = 0.0256) than in the control group. There were no significant differences between groups on all other secondary outcomes. The main limitation of the study is that the sample comprises mostly 'well' stroke survivors with limited to no disability. CONCLUSIONS: The P2S online healthy lifestyle program improved stroke survivors' self-reported global ratings of HRQoL (as measured by EQ-VAS) at 6-month follow-up. Online platforms represent a promising tool to engage and support some stroke survivors. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12617001205325.

Effect of asthma management with exhaled nitric oxide versus usual care on perinatal outcomes.

INTRODUCTION: Asthma exacerbations in pregnancy are associated with adverse perinatal outcomes. We aimed to determine whether fractional exhaled nitric oxide (F ENO)-based asthma management improves perinatal outcomes compared to usual care. METHODS: The Breathing for Life Trial was a multicentre, parallel-group, randomised controlled trial conducted in six hospital antenatal clinics, which compared asthma management guided by F ENO (adjustment of asthma treatment according to exhaled nitric oxide and symptoms each 6-12 weeks) to usual care (no treatment adjustment as part of the trial). The primary outcome was a composite of adverse perinatal events (preterm birth, small for gestational age (SGA), perinatal mortality or neonatal hospitalisation) assessed using hospital records. Secondary outcomes included maternal asthma exacerbations. Concealed random allocation, stratified by study site and self-reported smoking status was used, with blinded outcome assessment and statistical analysis (intention to treat). RESULTS: Pregnant women with current asthma were recruited; 599 to the control group (608 infants) and 601 to the intervention (615 infants). There were no significant group differences for the primary composite perinatal outcome (152 (25.6%) out of 594 control, 177 (29.4%) out of 603 intervention; OR 1.21, 95% CI 0.94-1.56; p=0.15), preterm birth (OR 1.14, 95% CI 0.78-1.68), SGA (OR 1.06, 95% CI 0.78-1.68), perinatal mortality (OR 3.62, 95% CI 0.80-16.5), neonatal hospitalisation (OR 1.24, 95% CI 0.89-1.72) or maternal asthma exacerbations requiring hospital admission or emergency department presentation (OR 1.19, 95% CI 0.69-2.05). CONCLUSION: F ENO-guided asthma pharmacotherapy delivered by a nurse or midwife in the antenatal clinic setting did not improve perinatal outcomes.

SISTAQUIT: training health care providers to help pregnant Aboriginal and Torres Strait Islander women quit smoking. A cluster randomised controlled trial.

BACKGROUND: About 44% of Indigenous Australian women smoke during pregnancy, compared with 12% of pregnant non-Indigenous women. Health care providers can assist smoking cessation, but they are not typically trained in culturally appropriate methods. OBJECTIVES: To determine whether a health care worker training intervention increases smoking cessation rates among Indigenous pregnant smokers compared with usual care. METHODS AND ANALYSIS: Supporting Indigenous Smokers to Assist Quitting (SISTAQUIT) study is a multicentre, hybrid type 1, pragmatic, cluster randomised controlled trial that compares the effects of an intervention for improving smoking cessation by pregnant Indigenous women (16 years or older, 32 weeks' gestation or less) with usual care. Twenty-one health services caring for Indigenous people in five Australian jurisdictions were randomised to the intervention (ten sites) or control groups (eleven sites). Health care providers at intervention sites received smoking cessation care training based on the ABCD (ask/assess; brief advice; cessation; discuss psychosocial context) approach to smoking cessation for Indigenous women, an educational resource package, free oral nicotine replacement therapy for participating women, implementation support, and trial implementation training. Health care providers in control group services provided usual care. PRIMARY OUTCOME: abstinence from smoking (self-reported abstinence via survey, validated by carbon monoxide breath testing when possible) four weeks after enrolment in the study. SECONDARY OUTCOMES: health service process evaluations; knowledge, attitudes, and practices of health care providers; and longer term abstinence, perinatal outcomes, and respiratory outcomes for babies (to six months). Ethics approval: The human research ethics committees of the University of Newcastle (H-2015-0438) and the Aboriginal Health and Medical Research Council of NSW (1140/15) provided the primary ethics approval. Dissemination of results: Findings will be disseminated in peer-reviewed publications, at local and overseas conferences, and via public and social media, and to participating health services in art-based formats and reports. Policy briefs will be communicated to relevant government organisations. TRIAL REGISTRATION: Australia New Zealand Clinical Trials Registry, ACTRN12618000972224 (prospective).

Impact assessment of the medical practice assisting (MPA) program in general practice in the hunter New England and central coast regions of Australia.

BACKGROUND: A regional Australian Primary Health Network (PHN) has been subsidising administrative staff from local general practices to undertake the Medical Practice Assisting (MPA) course as part of its MPA Program. The MPA Program aimed to upskill administrative staff to undertake clinical tasks and fill in for busy or absent Practice Nurses (PNs), freeing up PNs to increase revenue-generating activity, avoiding casual replacement staff wages, and increasing patient throughput. An impact assessment was undertaken to evaluate the impact and estimate the economic costs of the MPA program to the PHN, general practices, and students to inform future uptake of the intervention. METHODS: The Framework to Assess the Impact of Translational Health Research (FAIT) was utilised. Originally designed to assess the impact of health research, this was its first application to a health services project. FAIT combines three validated methods of impact assessment-Payback, economic analysis and narratives underpinned by a program logic model. Quantified metrics describe the impacts of the program within various "domains of benefit", the economic model costs the intervention and monetises potential consequences, and the narrative tells the story of the MPA Program and the difference it has made. Data were collected via online surveys from general practitioners (GPs), PNs, practice managers; MPA graduates and PHN staff were interviewed by phone and on Zoom. RESULTS: FAIT was effective in evidencing the impacts and economic viability of the MPA Program. GPs and PNs reported greater work satisfaction, PNs reported less stress and reduced workloads and MPA graduates reported higher job satisfaction and greater confidence performing a range of clinical skills. MPA Program economic costs for general practices during candidature, and 12 month post-graduation was estimated at $69,756. With effective re-integration planning, this investment was recoverable within 12 months through increased revenue for practices. Graduates paid appropriately for their new skills also recouped their investment within 24 months. CONCLUSION: Utilisation of MPA graduates varied substantially between practices and COVID-19 impacted on their utilisation. More strategic reintegration of the MPA graduate back into the practice to most effectively utilise their new skillset could optimise potential benefits realised by participating practices.

Budget impact analysis of a multifaceted nurse-led intervention to reduce indwelling urinary catheter use in New South Wales Hospitals.

BACKGROUND: In hospitals, catheter acquired urinary tract infection causes significant resource waste and discomfort among admitted patients. An intervention for reducing indwelling catheterisations - No-CAUTI - was trialled across four hospitals in New South Wales, Australia. No-CAUTI includes: train-the-trainer workshops, site champions, compliance audits, and point prevalence surveys. The trial showed reductions on usual care catheterisation rates at 4- and 9-month post-intervention. This result was statistically non-significant; and post-intervention catheterisation rates rebounded between 4 and 9 months. However, No-CAUTI showed statistically significant catheterisation decreases for medical wards, female patients and for short-term catheterisations. This study presents a budget impact analysis of a projected five year No-CAUTI roll out across New South Wales public hospitals, from the cost perspective of the New South Wales Ministry of Health. METHODS: Budget forecasts were made for five year roll outs of: i) No-CAUTI; and ii) usual care, among all public hospitals in New South Wales hosting overnight stays (n=180). The roll out design maintains intervention effectiveness with ongoing workshops, quality audits, and hospital surveys. Forecasts of catheterisations, procedures and treatments were modelled on No-CAUTI trial observations. Costs were sourced from trial records, the Medical Benefits Scheme, the Pharmaceutical Benefits Scheme and public wage awards. Cost and parameter uncertainties were considered with sensitivity scenarios. RESULTS: The estimated five-year No-CAUTI roll-out cost was $1.5 million. It had an overall budget saving of $640,000 due to reductions of 100,100 catheterisations, 33,300 urine tests and 6,700 antibiotics administrations. Non-Metropolitan hospitals had a net saving of $1.2 million, while Metropolitan hospitals had a net cost of $0.54 million. CONCLUSIONS: Compared to usual care, NO-CAUTI is expected to realise overall budget savings and decreases in catheterisations over five years. These findings allow a consideration of the affordability of a wide implementation. TRIAL REGISTRATION: Registered with the Australian New Zealand Clinical Trials Registry ( ACTRN12617000090314 ). First registered 17 January 2017, retrospectively. First enrolment, 15/11/2016.

Relational aspects of building capacity in economic evaluation in an Australian Primary Health Network using an embedded researcher approach.

BACKGROUND: Health organisations are increasingly implementing 'embedded researcher' models to translate research into practice. This paper examines the impact of an embedded researcher model known as the embedded Economist (eE) Program that was implemented in an Australian Primary Health Network (PHN) located in regional New South Wales, Australia. The site, participants, program aims and design are described. Insights into the facilitators, challenges and barriers to the integration of economic evaluation perspectives into the work of the PHN are provided. METHODS: The eE Program consisted of embedding a lead health economist on site, supported by offsite economists, part-time, for fifteen weeks to collaborate with PHN staff. Evaluation of the eE at the PHN included qualitative data collection via semi-structured interviews (N= 34), observations (N=8) and a field diary kept by the embedded economists. A thematic analysis was undertaken through the triangulation of this data. RESULTS: The eE Program successfully met its aims of increasing PHN staff awareness of the value of economic evaluation principles in decision-making and their capacity to access and apply these principles. There was also evidence that the program resulted in PHN staff applying economic evaluations when commissioning service providers. Evaluation of the eE identified two key facilitators for achieving these results. First, a highly receptive organisational context characterised by a work ethic, and site processes and procedures that were dedicated to improvement. Second was the development of trusted relationships between the embedded economist and PHN staff that was enabled through: the commitment of the economist to bi-directional learning; facilitating access to economic tools and techniques; personality traits (likeable and enthusiastic); and because the eE provided ongoing support for PHN projects beyond the fifteen-week embedding period. CONCLUSIONS: This study provides the first detailed case description of an embedded health economics program. The results demonstrate how the process, context and relational factors of engaging and embedding the support of a health economist works and why. The findings reinforce international evidence in this area and are of practical utility to the future deployment of such programs.

Network evaluation of an innovation platform in continuous quality improvement in Australian Indigenous primary healthcare.

BACKGROUND: From 2014 to 2019, the Centre for Research Excellence in Integrated Quality Improvement (CRE-IQI) was evaluated as an innovation platform focusing on continuous quality improvement in Indigenous Australian primary healthcare. Although social network analysis (SNA) is a recognized method for evaluating the functioning, collaboration and effectiveness of innovation platforms, applied research is limited. This study applies SNA to evaluate the CRE-IQI's functioning as an innovation platform. METHODS: Two surveys (2017, 2019) were conducted using social survey and network methods. Survey items covered respondent characteristics, their perceptions of the CRE-IQI's performance, and its impact and sociometric relationships. Members' relationship information was captured for the CRE-IQI at three time points, namely start (retrospectively), midpoint and final year, on three network types (knew, shared information, collaborated). SNA software was used to compute standard network metrics including diameter, density and centrality, and to develop visualizations. Survey and network results were addressed in a workshop held by members to develop improvement strategies. RESULTS: The response rate was 80% in 2017 and 65% in 2019 (n = 49 and 47, respectively). Between 2017 and 2019, respondents' mean ratings of the CRE-IQI's functioning and achievements in meeting its goals were sustained. They perceived the CRE-IQI as multidisciplinary, having effective management and governance, and incorporating Indigenous research leadership, representation and ways of working. Respondents recognized high levels of trust amongst members, rated "good communication and coordination with participants" highly, and "facilitating collaboration" as the CRE's most strongly recognized achievement. In collaboration and information-sharing networks, average path length remained low in 2017 and 2019, indicating good small-world network properties for relaying information. On average, respondents shared information and collaborated with more CRE members in 2017 than 2019. However, in both 2017 and 2019 there were new collaborations and information-sharing outside of direct collaborations. CRE-IQI outcomes included: evidence generation; knowledge transfer and skills development in quality improvement; research capacity-building, career development; mentoring; grant support; development of new projects; health service support; and policy impact. CONCLUSIONS: This study shows the utility of network analysis in evaluating the functioning, and collaboration, at the individual, organizational and health system levels, of an innovation platform, and adds to our understanding of factors enabling successful innovation platforms.

Scale-up of the Physical Activity 4 Everyone (PA4E1) intervention in secondary schools: 24-month implementation and cost outcomes from a cluster randomised controlled trial.

BACKGROUND: Physical Activity 4 Everyone (PA4E1) is an evidence-based program effective at increasing adolescent physical activity (PA) and improving weight status. This study aimed to determine a) the effectiveness of an adapted implementation intervention to scale-up PA4E1 at 24-month follow-up, b) fidelity and reach, and c) the cost and cost-effectiveness of the implementation support intervention. METHODS: A cluster randomised controlled trial using a type III hybrid implementation-effectiveness design in 49 lower socio-economic secondary schools, randomised to a program (n = 24) or control group (n = 25). An adapted implementation intervention consisting of seven strategies was developed to support schools to implement PA4E1 over 24-months. The primary outcome was the proportion of schools implementing at least four of the 7 PA practices, assessed via computer assisted telephone interviews (CATI) with Head Physical Education Teachers. Secondary outcomes included the mean number of PA practices implemented, fidelity and reach, cost and cost-effectiveness. Logistic regression models assessed program effects. RESULTS: At baseline, no schools implemented four of the 7 PA practices. At 24-months, significantly more schools in the program group (16/23, 69.6%) implemented at least four of the 7 PA practices than the control group (0/25, 0%) (p < 0.001). At 24-months, program schools were implementing an average of 3.6 more practices than control schools (4.1 (1.7) vs. 0.5 (0.8), respectively) (P < 0.001). Fidelity and reach of the implementation intervention were high (> 75%). The total cost of the program was $415,112 AUD (2018) ($17,296 per school; $117.30 per student). CONCLUSIONS: The adapted implementation intervention provides policy makers and researchers with an effective and potentially cost-effective model for scaling-up the delivery of PA4E1 in secondary schools. Further assessment of sustainability is warranted. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12617000681358 prospectively registered 12th May 2017.

Administration of indwelling urinary catheters in four Australian Hospitals: cost-effectiveness analysis of a multifaceted nurse-led intervention.

BACKGROUND: Urinary catheters are useful among hospital patients for allowing urinary flows and preparing patients for surgery. However, urinary infections associated with catheters cause significant patient discomfort and burden hospital resources. A nurse led intervention aiming to reduce inpatient catheterisation rates was recently trialled among adult overnight patients in four New South Wales hospitals. It included: 'train-the trainer' workshops, site champions, compliance audits and promotional materials. This study is the 'in-trial' cost-effectiveness analysis, conducted from the perspective of the New South Wales Ministry of Health. METHODS: The primary outcome variable was catheterisation rates. Catheterisation and procedure/treatment data were collected in three point prevalence patient surveys: pre-intervention (n = 1630), 4-months (n = 1677), and 9-months post-intervention (n = 1551). Intervention costs were based on trial records while labour costs were gathered from wage awards. Incremental cost effectiveness ratios were calculated for 4- and 9-months post-intervention and tested with non-parametric bootstrapping. Sensitivity scenarios recalculated results after adjusting costs and parameters. RESULTS: The trial found reductions in catheterisations across the four hospitals between preintervention (12.0 % (10.4 - 13.5 %), n = 195) and the 4- (9.9 % (8.5 - 11.3 %), n = 166 ) and 9- months (10.2 % (8.7 - 11.7 %) n = 158) post-intervention points. The trend was statistically non-significant (p = 0.1). Only one diagnosed CAUTI case was observed across the surveys. However, statistically and clinically significant decreases in catheterisation rates occurred for medical and critical care wards, and among female patients and short-term catheterisations. Incremental cost effectiveness ratios at 4-months and 9-months post-intervention were $188 and $264. Bootstrapping found reductions in catheterisations at positive costs over at least 72 % of iterations. Sensitivity scenarios showed that cost effectiveness was most responsive to changes in catheterisation rates. CONCLUSIONS: Analysis showed that the association between the intervention and changes in catheterisation rates was not statistically significant. However, the intervention resulted in statistically significant reductions for subgroups including among short-term catheterisations and female patients. Cost-effectiveness analysis showed that reductions in catheterisations were most likely achieved at positive cost. TRIAL REGISTRATION: Registered with the Australian New Zealand Clinical Trials Registry (ACTRN12617000090314). First hospital enrolment, 15/11/2016; last hospital enrolment, 8/12/2016.

Embedding an economist in regional and rural health services to add value and reduce waste by improving local-level decision-making: protocol for the 'embedded Economist' program and evaluation.

BACKGROUND: Systematic approaches to the inclusion of economic evaluation in national healthcare decision-making are usual. It is less common for economic evaluation to be routinely undertaken at the 'local-level' (e.g. in a health service or hospital) despite the largest proportion of health care expenditure being determined at this service level and recognition by local health service decision makers of the need for capacity building in economic evaluation skills. This paper describes a novel program - the embedded Economist (eE) Program. The eE Program aims to increase local health service staff awareness of, and develop their capacity to access and apply, economic evaluation principles in decision making. The eE program evaluation is also described. The aim of the evaluation is to capture the contextual, procedural and relational aspects that assist and detract from the eE program aims; as well as the outcomes and impact from the specific eE projects. METHODS: The eE Program consists of a embedding a health economist in six health services and the provision of supported education in applied economic evaluation, provided via a community of practice and a university course. The embedded approach is grounded in co-production, embedded researchers and 'slow science'. The sites, participants, and program design are described. The program evaluation includes qualitative data collection via surveys, semi-structured interviews, observations and field diaries. In order to share interim findings, data are collected and analysed prior, during and after implementation of the eE program, at each of the six health service sites. The surveys will be analysed by calculating frequencies and descriptive statistics. A thematic analysis will be conducted on interview, observation and filed diary data. The Framework to Assess the Impact from Translational health research (FAIT) is utilised to assess the overall impact of the eE Program. DISCUSSION: This program and evaluation will contribute to knowledge about how best to build capacity and skills in economic evaluation amongst decision-makers working in local-level health services. It will examine the extent to which participants are able to improve their ability to utilise evidence to inform decisions, avoid waste and improve the value of care delivery.

Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study.

BACKGROUND: Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM. OBJECTIVE: The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks. METHODS: SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8). RESULTS: Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8- week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI -2.02 to 2.24) was reported. CONCLUSIONS: Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/15113.

A Multicomponent mHealth-Based Intervention (SWAP IT) to Decrease the Consumption of Discretionary Foods Packed in School Lunchboxes: Type I Effectiveness-Implementation Hybrid Cluster Randomized Controlled Trial.

BACKGROUND: There is significant opportunity to improve the nutritional quality of foods packed in children's school lunchboxes. Interventions that are effective and scalable targeting the school and home environment are therefore warranted. OBJECTIVE: This study aimed to assess the effectiveness of a multicomponent, mobile health-based intervention, SWAP IT, in reducing the energy contribution of discretionary (ie, less healthy) foods and drinks packed for children to consume at school. METHODS: A type I effectiveness-implementation hybrid cluster randomized controlled trial was conducted in 32 primary schools located across 3 local health districts in New South Wales, Australia, to compare the effects of a 6-month intervention targeting foods packed in children's lunchboxes with those of a usual care control. Primary schools were eligible if they were not participating in other nutrition studies and used the required school communication app. The Behaviour Change Wheel was used to co-design the multicomponent SWAP IT intervention, which consisted of the following: school lunchbox nutrition guidelines, curriculum lessons, information pushed to parents digitally via an existing school communication app, and additional parent resources to address common barriers to packing healthy lunchboxes. The primary outcome, mean energy (kilojoules) content of discretionary lunchbox foods and drinks packed in lunchboxes, was measured via observation using a validated school food checklist at baseline (May 2019) and at 6-month follow-up (October 2019). Additional secondary outcomes included mean lunchbox energy from discretionary foods consumed, mean total lunchbox energy packed and consumed, mean energy content of core lunchbox foods packed and consumed, and percentage of lunchbox energy from discretionary and core foods, all of which were also measured via observation using a validated school food checklist. Measures of school engagement, consumption of discretionary foods outside of school hours, and lunchbox cost were also collected at baseline and at 6-month follow-up. Data were analyzed via hierarchical linear regression models, with controlling for clustering, socioeconomic status, and remoteness. RESULTS: A total of 3022 (3022/7212, 41.90%) students consented to participate in the evaluation (mean age 7.8 years; 1487/3022, 49.22% girls). There were significant reductions between the intervention and control groups in the primary trial outcome, mean energy (kilojoules) content of discretionary foods packed in lunchboxes (-117.26 kJ; 95% CI -195.59 to -39.83; P=.003). Relative to the control, the intervention also significantly reduced secondary outcomes regarding the mean total lunchbox energy (kilojoules) packed (-88.38 kJ; 95% CI -172.84 to -3.92; P=.04) and consumed (-117.17 kJ; 95% CI -233.72 to -0.62; P=.05). There was no significant difference between groups in measures of student engagement, consumption of discretionary foods outside of school hours, or cost of foods packed in children's lunchboxes. CONCLUSIONS: The SWAP IT intervention was effective in reducing the energy content of foods packed for and consumed by primary school-aged children at school. Dissemination of the SWAP IT program at a population level has the potential to influence a significant proportion of primary school-aged children, impacting weight status and associated health care costs. TRIAL REGISTRATION: Australian Clinical Trials Registry ACTRN12618001731280; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=376191&isReview=true. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s12889-019-7725-x.

Translation and Impact of Funded Australian Cardiovascular Research: A Review With Perspective.

This aim of this paper is to set the scene for the need for impact assessment and return on investment in funded cardiovascular research in Australia, starting with the historical perspective on waste in health and medical research. Recently there has been a substantial move from discussion and policy about the need for research translation, into practice and application via the evolution of funding streams like the Australian Medical Research Future Fund (MRFF). Health and medical research funders play a critical role in both setting the expectations for research translation and impact and helping researchers to meet these expectations. As a leading cause of death, cardiovascular disease is a national health priority, recognised as such with a AUD$220 million MRFF allocation to the Cardiovascular Health Mission. Focussing on cardiovascular research, we address some of the barriers researchers face in prospectively planning for research translation and impact assessment, and call for an ecosystem that supports a return on investment for all stakeholders, especially the community and patient end-users.

Scale-up of the Physical Activity 4 Everyone (PA4E1) intervention in secondary schools: 12-month implementation outcomes from a cluster randomized controlled trial.

BACKGROUND: 'Physical Activity 4 Everyone' (PA4E1) was an efficacious multi-component school-based physical activity (PA) program targeting adolescents. PA4E1 has seven PA practices. It is essential to scale-up, evaluate effectiveness and assess implementation of such programs. Therefore, the aim is to assess the impact of implementation support on school practice uptake of the PA4E1 program at 12 and 24 months. METHODS: A cluster randomised controlled trial, utilising a type III hybrid implementation-effectiveness design, was conducted in 49 randomly selected disadvantaged Australian Government and Catholic secondary schools. A blinded statistician randomly allocated schools to a usual practice control (n = 25) or the PA4E1 program group (n = 24), with the latter receiving seven implementation support strategies to support school PA practice uptake of the seven practices retained from the efficacy trial. The primary outcome was the proportion of schools adopting at least four of the seven practices, assessed via telephone surveys with Head Physical Education Teachers and analysed using exact logistic regression modelling. This paper reports the 12-month outcomes. RESULTS: Schools were recruited from May to November 2017. At baseline, no schools implemented four of the seven practices. At 12 months significantly more schools in the program group had implemented four of the seven practices (16/24, 66.7%) than the control group (1/25, 4%) (OR = 33.0[4.15-1556.4], p < 0.001). The program group implemented on average 3.2 (2.5-3.9) more practices than the control group (p < 0.001, mean 3.9 (SD 1.5) vs 0.7 (1.0)). Fidelity and reach of the implementation support intervention were high (both > 80%). CONCLUSIONS: Through the application of multiple implementation support strategies, secondary schools were able to overcome commonly known barriers to implement evidence based school PA practices. As such practices have been shown to result in an increase in adolescent PA and improvements in weight status, policy makers and practitioners responsible for advocating PA in schools should consider this implementation approach more broadly when working with schools. Follow-up is required to determine whether practice implementation is sustained. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry ACTRN12617000681358 registered 12th May 2017.

Improving Academic Biobank Value and Sustainability Through an Outputs Focus.

Although it is generally accepted that human tissue biobanks are important to facilitate progress in health and medical research, many academic biobanks face sustainability challenges. We propose that biobank sustainability is challenged by a lack of available data describing the outputs and benefits that are produced by biobanks, as reflected by a dearth of publications that enumerate biobank outputs. We further propose that boosting the available information on biobank outputs and using a broader range of output metrics will permit economic analyses such as cost-consequence analyses of biobank activity. Output metrics and cost-consequence analyses can allow biobanks to achieve efficiencies, and improve the quality and/or quantity of their outputs. In turn, biobank output measures provide all stakeholders with explicit and accountable data on biobank value, which could contribute to the evolution of biobank operations to best match research needs, and mitigate some threats to biobank sustainability.

Correction to: Study protocol the Continuing Care Project: a randomised controlled trial of a continuing care telephone intervention following residential substance dependence treatment.

It was highlighted that in the original article [1] author Amanda Baker was erroneously omitted from the authorship during the copy editing stage.

Study protocol the Continuing Care Project: a randomised controlled trial of a continuing care telephone intervention following residential substance dependence treatment.

BACKGROUND: A priority area in the field of substance dependence treatment is reducing the rates of relapse. Previous research has demonstrated that telephone delivered continuing care interventions are both clinically and cost effective when delivered as a component of outpatient treatment. This protocol describes a NSW Health funded study that assesses the effectiveness of delivering a telephone delivered continuing care intervention for people leaving residential substance treatment in Australia. METHODS/DESIGN: All participants will be attending residential alcohol and other drug treatment provided by The Salvation Army or We Help Ourselves. The study will be conducted as a randomised controlled trial, where participants will be randomised to one of three treatment arms. The treatment arms will be: (i) 12-session continuing care telephone intervention; (ii) 4-session continuing care telephone intervention, or (iii) continuing care plan only. Baseline assessment batteries and development of the participants' continuing care plan will be completed prior to participants being randomised to a treatment condition. Research staff blind to the treatment condition will complete follow-up assessments with participants at 3-months and 6-months after they have been discharged from their residential service. DISCUSSION: This study will provide comprehensive data on the effect of delivering the continuing care intervention for people exiting residential alcohol and other drug treatment. If shown to be effective, this intervention can be disseminated to improve the rates of relapse among people leaving residential alcohol and other drug treatment. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry, ACTRN12618001231235. Registered on 23rd July 2018. https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=375621&isReview=true.