Implementation of large, multi-site hospital interventions: a realist evaluation of strategies for developing capability.

BACKGROUND: This study presents guidelines for implementation distilled from the findings of a realist evaluation. The setting was local health districts in New South Wales, Australia that implemented three clinical improvement initiatives as part of a state-wide program. We focussed on implementation strategies designed to develop health professionals' capability to deliver value-based care initiatives for multisite programs. Capability, which increases implementers' ability to cope with unexpected scenarios is key to managing change. METHODS: We used a mixed methods realist evaluation which tested and refined program theories elucidating the complex dynamic between context (C), mechanism (M) and outcome (O) to determine what works, for whom, under what circumstances. Data was drawn from program documents, a realist synthesis, informal discussions with implementation designers, and interviews with 10 key informants (out of 37 identified) from seven sites. Data analysis employed a retroductive approach to interrogate the causal factors identified as contributors to outcomes. RESULTS: CMO statements were refined for four initial program theories: Making it Relevant- where participation in activities was increased when targeted to the needs of the staff; Investment in Quality Improvement- where engagement in capability development was enhanced when it was valued by all levels of the organisation; Turnover and Capability Loss- where the effects of staff turnover were mitigated; and Community-Wide Priority- where there was a strategy of spanning sites. From these data five guiding principles for implementers were distilled: (1) Involve all levels of the health system to effectively implement large-scale capability development, (2) Design capability development activities in a way that supports a learning culture, (3) Plan capability development activities with staff turnover in mind, (4) Increased capability should be distributed across teams to avoid bottlenecks in workflows and the risk of losing key staff, (5) Foster cross-site collaboration to focus effort, reduce variation in practice and promote greater cohesion in patient care. CONCLUSIONS: A key implementation strategy for interventions to standardise high quality practice is development of clinical capability. We illustrate how leadership support, attention to staff turnover patterns, and making activities relevant to current issues, can lead to an emergent learning culture.

Experience-based codesign approach to improve care in Australian emergency departments for complex consumer cohorts: the MyED project protocol, Stages 1.1-1.3.

INTRODUCTION: Emergency department (ED) care must adapt to meet current and future demands. In Australia, ED quality measures (eg, prolonged length of stay, re-presentations or patient experience) are worse for older adults with multiple comorbidities, people who have a disability, those who present with a mental health condition, Indigenous Australians, and those with a culturally and linguistically diverse (CALD) background. Strengthened ED performance relies on understanding the social and systemic barriers and preferences for care of these different cohorts, and identifying viable solutions that may result in sustained improvement by service providers. A collaborative 5-year project (MyED) aims to codesign, with ED users and providers, new or adapted models of care that improve ED performance, improve patient outcomes and improve patient experience for these five cohorts. METHODS AND ANALYSIS: Experience-based codesign using mixed methods, set in three hospitals in one health district in Australia. This protocol introduces the staged and incremental approach to the whole project, and details the first research elements: ethnographic observations at the ED care interface, interviews with providers and interviews with two patient cohorts-older adults and adults with a CALD background. We aim to sample a diverse range of participants, carefully tailoring recruitment and support. ETHICS AND DISSEMINATION: Ethics approval has been obtained from the Western Sydney Local Health District Human Research Ethics Committee (2022/PID02749-2022/ETH02447). Prior informed written consent will be obtained from all research participants. Findings from each stage of the project will be submitted for peer-reviewed publication. Project outputs will be disseminated for implementation more widely across New South Wales, Australia.