Process evaluation of a tailored nudge intervention to promote appropriate care and treatment of older patients at the end-of-life.

BACKGROUND: Non-beneficial treatment affects a considerable proportion of older people in hospital, and some will choose to decline invasive treatments when they are approaching the end of their life. The Intervention for Appropriate Care and Treatment (InterACT) intervention was a 12-month stepped wedge randomised controlled trial with an embedded process evaluation in three hospitals in Brisbane, Australia. The aim was to increase appropriate care and treatment decisions for older people at the end-of-life, through implementing a nudge intervention in the form of a prospective feedback loop. However, the trial results indicated that the expected practice change did not occur. The process evaluation aimed to assess implementation using the Consolidated Framework for Implementation Research, identify barriers and enablers to implementation and provide insights into the lack of effect of the InterACT intervention. METHODS: Qualitative data collection involved 38 semi-structured interviews with participating clinicians, members of the executive advisory groups overseeing the intervention at a site level, clinical auditors, and project leads. Online interviews were conducted at two times: implementation onset and completion. Data were coded to the Consolidated Framework for Implementation Research and deductively analysed. RESULTS: Overall, clinicians felt the premise and clinical reasoning behind InterACT were strong and could improve patient management. However, several prominent barriers affected implementation. These related to the potency of the nudge intervention and its integration into routine clinical practice, clinician beliefs and perceived self-efficacy, and wider contextual factors at the health system level. CONCLUSIONS: An intervention designed to change clinical practice for patients at or near to end-of-life did not have the intended effect. Future interventions targeting this area of care should consider using multi-component strategies that address the identified barriers to implementation and clinician change of practice. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry (ANZCTR), ACTRN12619000675123p (approved 06/05/2019).

From pilot to a multi-site trial: refining the Early Detection of Deterioration in Elderly Residents (EDDIE +) intervention.

BACKGROUND: Early Detection of Deterioration in Elderly Residents (EDDIE +) is a multi-modal intervention focused on empowering nursing and personal care workers to identify and proactively manage deterioration of residents living in residential aged care (RAC) homes. Building on successful pilot trials conducted between 2014 and 2017, the intervention was refined for implementation in a stepped-wedge cluster randomised trial in 12 RAC homes from March 2021 to May 2022. We report the process used to transition from a small-scale pilot intervention to a multi-site intervention, detailing the intervention to enable future replication. METHODS: The EDDIE + intervention used the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework to guide the intervention development and refinement process. We conducted an environmental scan; multi-level context assessments; convened an intervention working group (IWG) to develop the program logic, conducted a sustainability assessment and deconstructed the intervention components into fixed and adaptable elements; and subsequently refined the intervention for trial. RESULTS: The original EDDIE pilot intervention included four components: nurse and personal care worker education; decision support tools; diagnostic equipment; and facilitation and clinical support. Deconstructing the intervention into core components and what could be flexibly tailored to context was essential for refining the intervention and informing future implementation across multiple sites. Intervention elements considered unsustainable were updated and refined to enable their scalability. Refinements included: an enhanced educational component with a greater focus on personal care workers and interactive learning; decision support tools that were based on updated evidence; equipment that aligned with recipient needs and available organisational support; and updated facilitation model with local and external facilitation. CONCLUSION: By using the i-PARIHS framework in the scale-up process, the EDDIE + intervention was tailored to fit the needs of intended recipients and contexts, enabling flexibility for local adaptation. The process of transitioning from a pilot to larger scale implementation in practice is vastly underreported yet vital for better development and implementation of multi-component interventions across multiple sites. We provide an example using an implementation framework and show it can be advantageous to researchers and health practitioners from pilot stage to refinement, through to larger scale implementation. TRIAL REGISTRATION: The trial was prospectively registered with the Australia New Zealand Clinical Trial Registry (ACTRN12620000507987, registered 23/04/2020).

Impact of a prospective feedback loop on care review activities in older patients at the end of life. A stepped-wedge randomised trial.

BACKGROUND: Hospitalisation rates for older people are increasing, with end-of-life care becoming a more medicalised experience. Innovative approaches are warranted to support early identification of the end-of-life phase, communicate prognosis, provide care consistent with people's preferences, and improve the use of healthcare resources. The Intervention for Appropriate Care and Treatment (InterACT) trial aimed to increase appropriate care and treatment decisions for older people at the end of life, through implementation of a prospective feedback loop. This paper reports on the care review outcomes. METHODS: A stepped-wedge randomised controlled trial was conducted in three large acute hospitals in Queensland, Australia between May 2020 and June 2021. The trial identified older people nearing the end of life using two validated tools for detecting deterioration and short-term death. Admitting clinical teams were provided with details of patients identified as at-risk with the goal of increasing awareness that end of life was approaching to facilitate appropriate patient centred care and avoid non-beneficial treatment. We examined the time between when the patient was identified as 'at-risk' and three outcomes: clinician-led care review discussions, review of care directive measures and palliative care referrals. These were considered useful indicators of appropriate care at the end of life. RESULTS: In two hospitals there was a reduction in the review of care directive measures during the intervention compared with usual care at 21 days (reduced probability of - 0.08; 95% CI: - 0.12 to - 0.04 and - 0.14; 95% CI: - 0.21 to - 0.06). In one hospital there was a large reduction in clinician-led care review discussions at 21 days during the intervention (reduced probability of - 0.20; 95% CI: - 0.28 to - 0.13). There was little change in palliative care referrals in any hospital, with average probability differences at 21 days of - 0.01, 0.02 and 0.04. DISCUSSION: The results are disappointing as an intervention designed to improve care of hospitalised older people appeared to have the opposite effect on care review outcomes. The reasons for this may be a combination of the intervention design and health system challenges due to the pandemic that highlight the complexity of providing more appropriate care at the end of life. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry, ACTRN12619000675123 (registered 6 May 2019).

A stepped-wedge randomised controlled trial assessing the implementation, effectiveness and cost-consequences of the EDDIE+ hospital avoidance program in 12 residential aged care homes: study protocol.

BACKGROUND: Older people living in residential aged care homes experience frequent emergency transfers to hospital. These events are associated with risks of hospital acquired complications and invasive treatments or interventions. Evidence suggests that some hospital transfers may be unnecessary or avoidable. The Early Detection of Deterioration in Elderly residents (EDDIE) program is a multi-component intervention aimed at reducing unnecessary hospital admissions from residential aged care homes by empowering nursing and care staff to detect and manage early signs of resident deterioration. This study aims to implement and evaluate the program in a multi-site randomised study in Queensland, Australia. METHODS: A stepped-wedge randomised controlled trial will be conducted at 12 residential aged care homes over 58 weeks. The program has four components: education and training, decision support tools, diagnostic equipment, and implementation facilitation with clinical systems support. The integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework will be used to guide the program implementation and process evaluation. The primary outcome measure will be the number of hospital bed days used by residents, with secondary outcomes assessing emergency department transfer rates, admission rates, length of stay, family awareness and experience, staff self-efficacy and costs of both implementation and health service use. A process evaluation will assess the extent and fidelity of program implementation, mechanisms of impact and the contextual barriers and enablers. DISCUSSION: The intervention is expected to improve outcomes by reducing unnecessary hospital transfers. Fewer hospital transfers and admissions will release resources for other patients with potentially greater needs. Residential aged care home staff might benefit from feelings of empowerment in their ability to proactively manage early signs of resident deterioration. The process evaluation will be useful for supporting wider implementation of this intervention and other similar initiatives. TRIAL REGISTRATION: The trial is prospectively registered with the Australia New Zealand Clinical Trial Registry ( ACTRN12620000507987 , registered 23/04/2020).

The effectiveness and cost effectiveness of a hospital avoidance program in a residential aged care facility: a prospective cohort study and modelled decision analysis.

BACKGROUND: Residential aged care facility residents experience high rates of hospital admissions which are stressful, costly and often preventable. The EDDIE program is a hospital avoidance initiative designed to enable nursing and care staff to detect, refer and quickly respond to early signals of a deteriorating resident. The program was implemented in a 96-bed residential aged care facility in regional Australia. METHODS: A prospective pre-post cohort study design was used to collect data on costs of program delivery, hospital admission rates and length of stay for the 12 months prior to, and following, the intervention. A Markov decision model was developed to synthesize study data with published literature in order to estimate the cost-effectiveness of the program. Quality adjusted life years (QALYs) were adopted as the measure of effectiveness. RESULTS: The EDDIE program was associated with a 19% reduction in annual hospital admissions and a 31% reduction in the average length of stay. The cost-effectiveness analysis found the program to be both more effective and less costly than usual care, with 0.06 QALYs gained and $249,000 health system costs saved in a modelled cohort of 96 residents. A probabilistic sensitivity analysis estimated that there was an 86% probability that the program was cost-effective after taking the uncertainty of the model inputs into account. CONCLUSIONS: This study provides promising evidence for the effectiveness and cost-effectiveness of a nurse led, early intervention program in preventing unnecessary hospital admissions within a residential aged care facility. Further research in multi-site randomised studies is needed to confirm the generalisability of these results.

Clinical and Economic Outcomes of Genome Sequencing Availability on Containing a Hospital Outbreak of Resistant Escherichia coli in Australia.

OBJECTIVES: To evaluate the outbreak size and hospital cost effects of bacterial whole-genome sequencing availability in managing a large-scale hospital outbreak. METHODS: We built a hybrid discrete event/agent-based simulation model to replicate a serious bacterial outbreak of resistant Escherichia coli in a large metropolitan public hospital during 2017. We tested the 3 strategies of using whole-genome sequencing early, late (actual outbreak), or not using it and assessed their associated outbreak size and hospital cost. The model included ward dynamics, pathogen transmission, and associated hospital costs during a 5-month outbreak. Model parameters were determined using data from the Queensland Hospital Admitted Patient Data Collection (N = 4809 patient admissions) and local clinical knowledge. Sensitivity analyses were performed to address model and parameter uncertainty. RESULTS: An estimated 197 patients were colonized during the outbreak, with 75 patients detected. The total outbreak cost was A$460 137 (US$317 117), with 6.1% spent on sequencing. Without sequencing, the outbreak was estimated to result in 352 colonized patients, costing A$766 921 (US$528 547). With earlier detection from use of routine sequencing, the estimated outbreak size was 3 patients and cost A$65 374 (US$45 054). CONCLUSIONS: Using whole-genome sequencing in hospital outbreak management was associated with smaller outbreaks and cost savings, with sequencing costs as a small fraction of total hospital costs, supporting the further investigation of the use of routine whole-genome sequencing in hospitals.

A stepped-wedge randomised-controlled trial assessing the implementation, impact and costs of a prospective feedback loop to promote appropriate care and treatment for older patients in acute hospitals at the end of life: study protocol.

BACKGROUND: Hospitalisation rates for the older population have been increasing with end-of-life care becoming a more medicalised and costly experience. There is evidence that some of these patients received non-beneficial treatment during their final hospitalisation with a third of the non-beneficial treatment duration spent in intensive care units. This study aims to increase appropriate care and treatment decisions and pathways for older patients at the end of life in Australia. This study will implement and evaluate a prospective feedback loop and tailored clinical response intervention at three hospitals in Queensland, Australia. METHODS: A stepped-wedge cluster randomised trial will be conducted with up to 21 clinical teams in three acute hospitals over 70 weeks. The study involves clinical teams providing care to patients aged 75 years or older, who are prospectively identified to be at risk of non-beneficial treatment using two validated tools for detecting death and deterioration risks. The intervention's feedback loop will provide the teams with a summary of these patients' risk profiles as a stimulus for a tailored clinical response in the intervention phase. The Consolidated Framework for Implementation Research will be used to inform the intervention's implementation and process evaluation. The study will determine the impact of the intervention on patient outcomes related to appropriate care and treatment at the end of life in hospitals, as well as the associated healthcare resource use and costs. The primary outcome is the proportion of patients who are admitted to intensive care units. A process evaluation will be carried out to assess the implementation, mechanisms of impact, and contextual barriers and enablers of the intervention. DISCUSSION: This intervention is expected to have a positive impact on the care of older patients near the end of life, specifically to improve clinical decision-making about treatment pathways and what constitutes appropriate care for these patients. These will reduce the incidence of non-beneficial treatment, and improve the efficiency of hospital resources and quality of care. The process evaluation results will be useful to inform subsequent intervention implementation at other hospitals. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry (ANZCTR), ACTRN12619000675123p (approved 6 May 2019).

Estimating the costs of genomic sequencing in cancer control.

BACKGROUND: Despite the rapid uptake of genomic technologies within cancer care, few studies provide detailed information on the costs of sequencing across different applications. The objective of the study was to examine and categorise the complete costs involved in genomic sequencing for a range of applications within cancer settings. METHODS: We performed a cost-analysis using gross and micro-costing approaches for genomic sequencing performed during 2017/2018 across different settings in Brisbane, Australia. Sequencing was undertaken for patients with lung, breast, oesophageal cancers, melanoma or mesothelioma. Aggregated resource data were captured for a total of 1433 patients and point estimates of per patient costs were generated. Deterministic sensitivity analyses addressed the uncertainty in the estimates. Estimated costs to the public health system for resources were categorised into seven distinct activities in the sequencing process: sampling, extraction, library preparation, sequencing, analysis, data storage and clinical reporting. Costs were also aggregated according to labour, consumables, testing, equipment and 'other' categories. RESULTS: The per person costs were AU$347-429 (2018 US$240-297) for targeted panels, AU$871-$2788 (2018 US$604-1932) for exome sequencing, and AU$2895-4830 (2018 US$2006-3347) for whole genome sequencing. Cost proportions were highest for library preparation/sequencing materials (average 76.8% of total costs), sample extraction (8.1%), data analysis (9.2%) and data storage (2.6%). Capital costs for the sequencers were an additional AU$34-197 (2018 US$24-67) per person. CONCLUSIONS: Total costs were most sensitive to consumables and sequencing activities driven by commercial prices. Per person sequencing costs for cancer are high when tumour/blood pairs require testing. Using the natural steps involved in sequencing and categorising resources accordingly, future evaluations of costs or cost-effectiveness of clinical genomics across cancer projects could be more standardised and facilitate easier comparison of cost drivers.

A hybrid simulation model approach to examine bacterial genome sequencing during a hospital outbreak.

BACKGROUND: Hospital infection control requires timely detection and identification of organisms, and their antimicrobial susceptibility. We describe a hybrid modeling approach to evaluate whole genome sequencing of pathogens for improving clinical decisions during a 2017 hospital outbreak of OXA-181 carbapenemase-producing Escherichia coli and the associated economic effects. METHODS: Combining agent-based and discrete-event paradigms, we built a hybrid simulation model to assess hospital ward dynamics, pathogen transmission and colonizations. The model was calibrated to exactly replicate the real-life outcomes of the outbreak at the ward-level. Seven scenarios were assessed including genome sequencing (early or late) and no sequencing (usual care). Model inputs included extent of microbiology and sequencing tests, patient-level data on length of stay, hospital ward movement, cost data and local clinical knowledge. The main outcomes were outbreak size and hospital costs. Model validation and sensitivity analyses were performed to address uncertainty around data inputs and calibration. RESULTS: An estimated 197 patients were colonized during the outbreak with 75 patients detected. The total outbreak cost was US$318,654 with 6.1% of total costs spent on sequencing. Without sequencing, the outbreak was estimated to result in 352 colonized patients costing US$531,109. Microbiology tests were the largest cost component across all scenarios. CONCLUSION: A hybrid simulation approach using the advantages of both agent-based and discrete-event modeling successfully replicated a real-life bacterial hospital outbreak as a foundation for evaluating clinical outcomes and efficiency of outbreak management. Whole genome sequencing of a potentially serious pathogen appears effective in containing an outbreak and minimizing hospital costs.

Comparison of EQ-5D-5L and SPVU-5D for measuring quality of life in patients with venous leg ulcers in an Australian setting.

PURPOSE: Given the importance of measuring health-related quality of life (HRQoL) for cost-utility studies, this study aimed to determine the validity and responsiveness of two preference-based HRQoL instruments, the EuroQol-five dimensions-five levels questionnaire (EQ-5D-5L) and the Sheffield Preference-based Venous Ulcer questionnaire (SPVU-5D) in patients with venous leg ulcers (VLUs) in an Australian setting. METHODS: This study analysed de-identified data collected from 80 patients with VLUs recruited by a prospective study in Brisbane, Queensland, Australia. Patients were asked to complete EQ-5D-5L and SPVU-5D surveys at baseline, 1-month, 3-month and 6-month follow-up as part of the prospective study. Baseline data and follow-up data were pooled to test the construct validity and level of agreement of the two instruments. Follow-up data were used to test the responsiveness. RESULTS: The ceiling effects were negligible for EQ-5D-5L and SPVU-5D utility scores. Both instruments were able to discriminate between healed VLU and unhealed VLU and showed great responsiveness when healing status changed over time. Weak to strong correlations were found between dimensions of EQ-5D-5L and SPVU-5D. The utility scores produced from EQ-5D-5L were generally lower. CONCLUSIONS: This study found that both EQ-5D-5L and SPVU-5D were valid and responsive in detecting change of VLU healing status among a small Australian population. Both instruments may be used in economic evaluation studies that involve patients with healed or unhealed VLUs. However, given the limitations presented in this study, further research is necessary to make sound recommendations on the preferred instrument in economic evaluation of VLU-related interventions.

Using the best available data to estimate the cost of antimicrobial resistance: a systematic review.

Background: Valuation of the economic cost of antimicrobial resistance (AMR) is important for decision making and should be estimated accurately. Highly variable or erroneous estimates may alarm policy makers and hospital administrators to act, but they also create confusion as to what the most reliable estimates are and how these should be assessed. This study aimed to assess the quality of methods used in studies that quantify the costs of AMR and to determine the best available evidence of the incremental cost of these infections. Methods: In this systematic review, we searched PubMed, Embase, Cinahl, Cochrane databases and grey literature sources published between January 2012 and October 2016. Articles reporting the additional burden of Enterococcus spp., Escherichia coli (E. coli), Klebsiella pneumoniae (K. pneumoniae), Pseudomonas aeruginosa (P. aeruginosa) and Staphylococcus aureus (S. aureus) resistant versus susceptible infections were sourced. The included studies were broadly classified as reporting oncosts from the healthcare/hospital/hospital charges perspective or societal perspective. Risk of bias was assessed based on three methodological components: (1) adjustment for length of stay prior to infection onset and consideration of time-dependent bias, (2) adjustment for comorbidities or severity of disease, and (3) adjustment for inappropriate antibiotic therapy. Results: Of 1094 identified studies, we identified 12 peer-reviewed articles and two reports that quantified the economic burden of clinically important resistant infections. Two studies used multi-state modelling to account for the timing of infection minimising the risk of time dependent bias and these were considered to generate the best available cost estimates. Studies report an additional CHF 9473 per extended-spectrum beta-lactamases -resistant Enterobacteriaceae bloodstream infections (BSI); additional €3200 per third-generation cephalosporin resistant Enterobacteriaceae BSI; and additional €1600 per methicillin-resistant S. aureus (MRSA) BSI. The remaining studies either partially adjusted or did not consider the timing of infection in their analysis. Conclusions: Implementation of AMR policy and decision-making should be guided only by reliable, unbiased estimates of effect size. Generating these estimates requires a thorough understanding of important biases and their impact on measured outcomes. This will ensure that researchers, clinicians, and other key decision makers concerned with increasing public health threat of AMR are accurately guided by the best available evidence.

Cost-utility analysis of low-intensity case management to increase contact with health services among ex-prisoners in Australia.

OBJECTIVES: The economic burden of incarceration is substantial in Australia. People released from prison are at high risk of poor health and this is an important predictor of recidivism. The 'Passports Study' was a randomised controlled trial of an intervention designed to increase health service utilisation after release from prison. The aim of this study is to conduct a cost-utility analysis of this transitional programme. SETTING: Australia DESIGN: A hybrid simulation model was developed to estimate the changes to total economic costs and effectiveness expressed as quality-adjusted life-years (QALYs) from the adoption of the 'Passports' intervention compared with the control group. Model parameters were informed by linked data from Queensland Corrective Services, Medicare, Pharmaceutical Benefits Scheme, Queensland Hospital Admission Patient Data Collection, Emergency Department Information System and National Death Index. Health-related quality of life was measured using the Short-Form 8 Health Survey (SF-8). The primary outcomes were the costs and estimated QALYs associated with the intervention group and the control group. Probabilistic sensitivity analysis was conducted to test parameter uncertainties. RESULTS: Compared with the control group where no attempt was made to encourage health service utilisation, an average participant in the intervention group incurred an extra cost of AUD 1790 and experienced slightly reduced QALYs, which indicated that the intervention was dominated in the baseline analysis. Probabilistic sensitivity analysis revealed that the transitional programme had a low probability of being cost-effective with the outcome measures selected. CONCLUSION: The findings of this study do not provide economic evidence to support the widespread adoption of the Passports intervention. Due to the reductionist nature of the cost-utility approach, it may be that important health-related benefits have been omitted. Another research approach using a wider range of health-related measures might generate different conclusions.

Quantifying the relative effect of environmental contamination on surgical ward MRSA incidence: An exploratory analysis.

BACKGROUND: To investigate and quantify the contribution of environmental contamination towards methicillin-resistant Staphylococcus aureus (MRSA) incidence observed in a hospital ward using stochastic modelling. METHODS: A non-homogeneous Poisson process model was developed to investigate the relationship between environmental contamination and MRSA incidence in a UK surgical ward during a cleaning intervention study. The model quantified the fractional risks (FRs) from colonised patients, environmental contamination and a generic background source as a measure of their relative importance in describing the observed MRSA incidence. RESULTS: While the background source remained the most likely MRSA acquisition source for this ward (as measured by the FRs), environmental contamination was the second most likely source, ahead of colonised patients in the ward. The relative importance of environmental contamination was smaller in the enhanced cleaning period compared with the normal cleaning period, albeit with notable variability in the estimates. CONCLUSIONS: Accounting for environmental contamination in stochastic modelling of MRSA transmission within a hospital ward provides a richer interpretation of the FRs, and is particularly pertinent in quantitative investigations of hospital cleaning interventions to reduce MRSA acquisition.