Producing knowledge together: a participatory approach to synthesising research across a large-scale collaboration in Aboriginal and Torres Strait Islander health.

BACKGROUND: Despite that stakeholder participation in evidence synthesis could result in more useful outcomes, there are few examples of processes that actively involve them in synthesis work. Techniques are needed that engage diverse stakeholders as equal partners in knowledge co-production. The aims of this paper are to describe an innovative participatory process of synthesising a large body of academic research products and compare the findings of the participatory process against two traditional approaches to synthesis: a rapid review and a structured review. METHODS: First, a rapid synthesis of all research outputs (n = 86) was conducted by researchers with in-depth knowledge of the collaboration's research. Second, a team of researchers and service providers conducted a structured synthesis of seventy-eight peer-reviewed articles and reports generated by the collaboration. Fifty-five publications were brought forward for further synthesis in part three, a facilitated participatory synthesis. Finally, we explored the value added by the participatory method by comparing findings generated across the three synthesis approaches. RESULTS: Twelve researchers and 11 service providers/policy partners-8 self-identified as Aboriginal and/or Torres Strait Islander-participated in two facilitated workshops (totalling 4 h). Workshop activities engaged participants in reviewing publication summaries, identifying key findings, and evoked review, discussion and refinement. The process explicitly linked experiential knowledge to citations of academic research, clearly connecting the two knowledge types. In comparing the findings generated across all three methods we found mostly consistencies; the few discrepancies did not contradict but gave deeper insights into statements created by the other methods. The participatory synthesis generated the most, detailed, and unique findings, and contextual insights about the relevance of the key messages for practice. CONCLUSION: The participatory synthesis engaged stakeholders with diverse backgrounds and skillsets in synthesising a large body of evidence in a relatively short time. The participatory approach produced findings comparable to traditional synthesis methods while extending knowledge and identifying lessons most relevant for the participants who, ultimately, are the end users of the research. This process will interest other large-scale research collaborations seeking to engage stakeholders in evidence synthesis.

Social Support and Diabetes Management Among Older American Indians.

Objective: Greater understanding how relationships that can facilitate or impede type 2 diabetes (T2D) management and control among older American Indian people is an overlooked, yet urgently needed strategy. Thus, we examined social support among older American Indian people in relation to their T2D management. Methods: During the fall 2015, we conducted qualitative interviews with 28 participants aged ≥ 60 years who were members of a federally-recognized tribe. Drawing upon the buffering and direct effects theoretical models of how social support affects health, we examined transcribed audio recordings of the interviews with a systematic text analysis approach. We used a low-inference qualitative descriptive design to provide a situated understanding of participants' life experiences using their naturalistic expressions. Results: The mean age of our participants was 73.0 ± 6.4 years with a mean HbA1c of 7.3 ± 1.5. Main social support sources were family, clinicians/formal services, community/culture, and spiritual/God. All four common social support types were represented, namely emotional, instrumental, informational, and appraisal support with most being instrumental in nature. A prominent gender difference was seen with respect to men receiving more instrumental support family/friends support than women. Discussion: Value orientations among American Indian people often reflect extended social systems and interdependence. A deeper understanding is needed of how social relationships can be better leveraged to aid in effective T2D management among older American Indian people. The development and implementation of evidence-based social network interventions with an assets-based orientation that build upon the cultural value of reciprocity hold promise to improve T2D outcomes of older American Indian people.

Scale-up of prevention programmes: sustained state-wide use of programme delivery software is explained by normalised self-organised adoption and non-adoption.

BACKGROUND: Population-level health promotion is often conceived as a tension between "top-down" and "bottom-up" strategy and action. We report behind-the-scenes insights from Australia's largest ever investment in the "top-down" approach, the $45m state-wide scale-up of two childhood obesity programmes. We used Normalisation Process Theory (NPT) as a template to interpret the organisational embedding of the purpose-built software designed to facilitate the initiative. The use of the technology was mandatory for evaluation, i.e. for reporting the proportion of schools and childcare centres which complied with recommended health practices (the implementation targets). Additionally, the software was recommended as a device to guide the implementation process. We set out to study its use in practice. METHODS: Short-term, high-intensity ethnography with all 14 programme delivery teams across New South Wales was conducted, cross-sectionally, 4 years after scale-up began. The four key mechanisms of NPT (coherence/sensemaking, cognitive participation/engagement, collective action and reflexive monitoring) were used to describe the ways the technology had normalised (embedded). RESULTS: Some teams and practitioners embraced how the software offered a way of working systematically with sites to encourage uptake of recommended practices, while others rejected it as a form of "mechanisation". Conscious choices had to be made at an individual and team level about the practice style offered by the technology-thus prompting personal sensemaking, re-organisation of work, awareness of choices by others and reflexivity about professional values. Local organisational arrangements allowed technology users to enter data and assist the work of non-users-collective action that legitimised opposite behaviours. Thus, the technology and the programme delivery style it represented were normalised by pathways of adoption and non-adoption. Normalised use and non-use were accepted and different choices made by local programme managers were respected. State-wide, implementation targets are being reported as met. CONCLUSION: We observed a form of self-organisation where individual practitioners and teams are finding their own place in a new system, consistent with complexity-based understandings of fostering scale-up in health care. Self-organisation could be facilitated with further cross-team interaction to continuously renew and revise sensemaking processes and support diverse adoption choices across different contexts.

Utility of the AHRQ Learning Collaboratives Taxonomy for Analyzing Innovations from an Australian Collaborative.

BACKGROUND: Despite the proliferation of learning collaborations such as innovation platforms, the factors contributing to their success or failure are rarely documented. The Agency for Healthcare Research and Quality learning collaboratives taxonomy provides a framework for understanding how such collaborations work in different settings according to four primary elements: innovation, communication, time, and social systems. This study applied the taxonomy to assess an innovation platform and the utility of applying the taxonomy. METHODS: The study focus was a five-year national research collaboration operating as an innovation platform to strengthen primary health care quality improvement efforts for Indigenous Australians. The study team analyzed project records, reports and publications, and interviews that were conducted with 35 stakeholders. Data were mapped retrospectively against the taxonomy domains and thematically analyzed. RESULTS: The taxonomy proved useful in understanding how and why the innovation platform generated innovations. It revealed that time was particularly important, both to see innovations through and to establish a social system that enabled interconnectivity between members. However, the taxonomy did not provide useful guidance on identifying the types of innovations from the collaboration or the importance of a culture of continuous adaptation and learning. The study also found that the primary and secondary elements of the taxonomy were not discrete, which meant that it was difficult to align themes with only one element. CONCLUSION: To improve the utility of the taxonomy, several elaborations are proposed, including reconfiguring it to a more dynamic form that recognizes the interconnections and links between the elements.

Collaboration and knowledge generation in an 18-year quality improvement research programme in Australian Indigenous primary healthcare: a coauthorship network analysis.

OBJECTIVES: Though multidisciplinary research networks support the practice and effectiveness of continuous quality improvement (CQI) programmes, their characteristics and development are poorly understood. In this study, we examine publication outputs from a research network in Australian Indigenous primary healthcare (PHC) to assess to what extent the research network changed over time. SETTING: Australian CQI research network in Indigenous PHC from 2002 to 2019. PARTICIPANTS: Authors from peer-reviewed journal articles and books published by the network. DESIGN: Coauthor networks across four phases of the network (2002-2004; 2005-2009; 2010-2014; 2015-2019) were constructed based on author affiliations and examined using social network analysis methods. Descriptive characteristics included organisation types, Indigenous representation, gender, student authorship and thematic research trends. RESULTS: We identified 128 publications written by 308 individual authors from 79 different organisations. Publications increased in number and diversity over each funding phase. During the final phase, publication outputs accelerated for organisations, students, project officers, Indigenous and female authors. Over time there was also a shift in research themes to encompass new clinical areas and social, environmental or behavioural determinants of health. Average degree (8.1), clustering (0.81) and diameter (3) indicated a well-connected network, with a core-periphery structure in each phase (p≤0.03) rather than a single central organisation (degree centralisation=0.55-0.65). Academic organisations dominated the core structure in all funding phases. CONCLUSION: Collaboration in publications increased with network consolidation and expansion. Increased productivity was associated with increased authorship diversity and a decentralised network, suggesting these may be important factors in enhancing research impact and advancing the knowledge and practice of CQI in PHC. Publication diversity and growth occurred mainly in the fourth phase, suggesting long-term relationship building among diverse partners is required to facilitate participatory research in CQI. Despite improvements, further work is needed to address inequities in female authorship and Indigenous authorship.

Principles guiding ethical research in a collaboration to strengthen Indigenous primary healthcare in Australia: learning from experience.

INTRODUCTION: Indigenous communities worldwide are leading calls for all research involving Indigenous people to be underpinned by values and principles articulated by them. Many researchers are explicitly adopting these principles to guide what, where, how and when research is undertaken with Indigenous people. With critical reflection to support the implementation of such principles largely absent from published literature, this paper explores both the implementation of, and the outcomes from a set of guiding principles used in a large-scale Australian research collaboration to improve Indigenous health. METHODS: In this inductive qualitative study, we adopted a principles-focused evaluation approach. Based on interviews with 35 actors in the collaboration and a review of project documents, we generated themes that were then iteratively discussed, refined and categorised into (1) 'strategies'-activities by which implementation of our guiding principles were recognised; (2) 'outcomes'-results seen from implementing the principles and (3) 'conditions'-aspects of the context that facilitated and constrained implementation of the principles. RESULTS: Respondents found it difficult to articulate how the guiding principles were actually implemented, and frequently referred to them as part of the fabric of the collaboration. They viewed the set of principles as mutually reinforcing, and as providing a rudder for navigating complexity and conflict. Implementation of the principles occurred through five strategies-honouring the principles; being dynamic and adaptable; sharing and dispersing leadership; collaborating purposefully and adopting a culture of mutual learning. Outcomes included increased Indigenous leadership and participation; the ability to attract principled and values-driven researchers and stakeholders, and the development of trusting and respectful relationships. The conditions that facilitated the implementation of the principles were collaborating over time; an increasing number of Indigenous researchers and taking an 'innovation platform' approach. CONCLUSION: Our findings show that principles guiding collaborations are valuable in providing a focus, direction and a way of working together when they are collaboratively developed, hold genuine meaning for all members and are implemented within a culture of continuous critical reflection, learning and adaptation, with ongoing reinterpretation of the principles over time.

The Feasibility of Recruiting and Training Lay Leaders During Real-World Program Delivery and Scale-up: The Case of Walk With Ease.

Introduction. To maximize limited resources, many health promotion programs are designed to be delivered by volunteer lay leaders. But this model poses challenges to implementation in real-world settings and barriers to successfully scaling-up programs. This study examines the current lay leader training model for Walk With Ease, a Centers for Disease Control and Prevention-funded evidence-based arthritis program delivered at-scale. Method. Recruited volunteers (n = 106) opted into free online or in-person training and agreed to deliver one Walk With Ease program within the following year-only 49%, however, did. Using logistic regression models and qualitative interviews, we explored predictors of volunteer delivery. Results. Volunteers had higher odds of delivering programs if they trained online (odds ratio [OR] = 9.04, 95% confidence interval [CI: 2.30, 48.36]), previously taught health programs (OR = 15.52, 95% CI [3.51, 103.55]) or trained in the second year of implementation (OR = 27.08, 95% CI [2.63, 415.78]). Qualitative findings underscored that successful volunteers were readied by their previous health education experience. Conclusions. While online training modes appear effective to prepare experienced volunteers, lay leaders required additional support. This calls into question whether lay-led delivery models are suitable for scaling-up programs with limited resources. Given the many lay-led health interventions for chronic disease self-management, investing in common training and infrastructures for lay leader development could advance the quality and sustainability of real-world program delivery.

The Weight of Words: Co-Analysis of Thick Ethnographic Description and "Friction" as Methodological Strategies in a Health Policy Research Partnership.

Co-production partnerships between policymakers, practitioners, and researchers are designed to facilitate production of relevant and readily usable research in health policy and practice contexts. We describe methodological strategies for in-depth collaborative analysis based on a co-produced ethnography of health promotion practice, involving ethnographic researchers and government-based research partners. We draw on a co-production dialogue to reflect critically on the role and value of co-analyzing research findings using thick ethnographic descriptions. The ambiguity of ethnographic imagery allowed flexibility in interpretation of findings and also generated friction. Specific ethnographic images became focal points for productive friction that crystallized ethical and analytical imperatives underpinning the diverse expertise in the team. To make the most of co-analysis of thick ethnographic descriptions, we assert that friction points must be reflexively considered as key learning opportunities for (a) higher order analysis informed by diverse analytical perspectives and (b) more cohesive and useful interpretations of research findings.

Core and peripheral organisations in prevention: Insights from social network analysis.

ISSUE: Formal (eg funded) community-level organisational collaborations are becoming more common in prevention. Rapid methods to assess organisational relationships could allow us to consider the significance of any pre-existing relationship patterns in communities that might impact on collaboration effectiveness. Insights may identify new options for practice. METHODS: We used social network analysis to study organisations engaged in prevention but not (yet) part of a formal purposive collaboration. Within a single community, we identified organisations providing programs in chronic disease prevention. We used whole network analysis methods to describe the extent to which organisations were aware, had contact, coordinated activity and/or collaborated more intensively. We also identified the contribution made to prevention locally. Results were compared with key informant interviews. RESULTS: There was an identifiable network structure, with more relationships across the network than one would expect by chance. The network had a core-periphery structure, meaning that, in terms of the relationships we measured, there were highly connected organisations who were strongly interlinked with each other (the core), alongside less connected organisations that were linked to the core but not to each other (the periphery). Core organisations were significantly more likely to have expertise in prevention and to have prevention staff. CONCLUSIONS: To our knowledge, it is new to identify inherent or "pre-existing" core-periphery structures in interorganisational health promotion. Yet, core-periphery structures are common in many social settings. They advantage entities in the core and are prone to further entrenchment. SO WHAT?: Our results map and quantify intuitive understandings about organisational "key players", thus enabling practitioners/organisations to critically reflect on what their role should be when it comes to activating communities ie to embed, or attempt to counterbalance, pre-existing power structures.

Could health information systems enhance the quality of Aboriginal health promotion? A retrospective audit of Aboriginal health programs in the Northern Territory of Australia.

BACKGROUND: In Australia, health services are seeking innovative ways to utilize data stored in health information systems to report on, and improve, health care quality and health system performance for Aboriginal Australians. However, there is little research about the use of health information systems in the context of Aboriginal health promotion. In 2008, the Northern Territory's publicly funded healthcare system introduced the quality improvement program planning system (QIPPS) as the centralized online system for recording information about health promotion programs. The purpose of this study was to explore the potential for utilizing data stored in QIPPS to report on quality of Aboriginal health promotion, using chronic disease prevention programs as exemplars. We identify the potential benefits and limitations of health information systems for enhancing Aboriginal health promotion. METHODS: A retrospective audit was undertaken on a sample of health promotion projects delivered between 2013 and 2016. A validated, paper-based audit tool was used to extract information stored in the QIPPS online system and report on Aboriginal health promotion quality. Simple frequency counts were calculated for dichotomous and categorical items. Text was extracted and thematically analyzed to describe community participation processes and strategies used in Aboriginal health promotion. RESULTS: 39 Aboriginal health promotion projects were included in the analysis. 34/39 projects recorded information pertaining to the health promotion planning phases, such as statements of project goals, 'needs assessment' findings, and processes for consulting Aboriginal people in the community. Evaluation findings were reported in approximately one third of projects and mostly limited to a recording of numbers of participants. For almost half of the projects analyzed, community participation strategies were not recorded. CONCLUSION: This is the first Australian study to shed light on the feasibility of utilizing data stored in a purposefully designed health promotion information system. Data availability and quality were limiting factors for reporting on Aboriginal health promotion quality. Based on our learnings of QIPPS, strategies to improve the quality and accuracy of data entry together with the use of quality improvement approaches are needed to reap the potential benefits of future health promotion information systems.

Scaling up population health interventions from decision to sustainability - a window of opportunity? A qualitative view from policy-makers.

BACKGROUND: While known efficacious preventive health interventions exist, the current capacity to scale up these interventions is limited. In recent years, much attention has focussed on developing frameworks and methods for scale-up yet, in practice, the pathway for scale-up is seldom linear and may be highly dependent on contextual circumstances. Few studies have examined the process of scaling up from decision to implementation nor examined the sustainability of scaled-up interventions. This study explores decision-makers' perceptions from real-world scaled-up case studies to examine how scale-up decisions were made and describe enablers of successful scale-up and sustainability. METHODS: This qualitative study included 29 interviews conducted with purposively sampled key Australian policy-makers, practitioners and researchers experienced in scale-up. Semi-structured interview questions obtained information regarding case studies of scaled-up interventions. The Framework Analysis method was used as the primary method of analysis of the interview data to inductively generate common and divergent themes within qualitative data across cases. RESULTS: A total of 31 case studies of public health interventions were described by interview respondents based on their experiences. According to the interviewees' perceptions, decisions to scale up commonly occurred either opportunistically, when funding became available, or when a deliberate decision was made and funding allocated. The latter scenario was more common when the intervention aligned with specific political or strategic goals. Decisions to scale up were driven by a variety of key actors such as politicians, senior policy-makers and practitioners in the health system. Drivers of a successful scale-up process included good governance, clear leadership, and adequate resourcing and expertise. Establishing accountability structures and appropriate engagement mechanisms to encourage the uptake of interventions were also key enablers. Sustainability was influenced by evidence of impact as well as good acceptability among the general or target population. CONCLUSIONS: Much like Kingdon's Multiple Streams Theory of 'policy windows', there is a conceptually similar 'window for scale-up', driven by a complex interplay of factors such as political need, strategic context, funding and key actors. Researchers and policy-makers need to consider scalability from the outset and prepare for when the window for scale-up opens. Decision-makers need to provide longer term funding for scale-up to facilitate longer term sustainability and build on the resources already invested for the scale-up process.

The Intervention Scalability Assessment Tool: a pilot study assessing five interventions for scalability.

OBJECTIVES: This study tested the utility of the Intervention Scalability Assessment Tool (ISAT) with real-world interventions considered for scale-up in the Australian context. We explored user perceptions of the usefulness of the ISAT in making scalability decisions and conducted an analysis of completed ISATs. Type of program/service: The ISAT was designed to assist policy makers/practitioners to make structured and reflective assessments of the potential scalability of their interventions. METHODS: Participants (n = 26) were invited via email and needed to be considering a population intervention for scale-up, to be able to pilot the ISAT, and to be willing to complete an online survey to provide feedback. Survey data and completed ISATs were collated and common responses were identified, with exceptions noted. RESULTS: Thirteen participants accepted the invitation to pilot the ISAT; six completed ISATs and returned surveys and five of each were included in the final analysis. The process by which participants completed the ISAT varied, some involving up to six stakeholders in the process and others only one. The time taken to complete the ISAT ranged from 2 hours to 3 days. Interventions considered for scalability were public health interventions and all but one involved a potential statewide scale-up. In terms of outcome, scalability scores across interventions varied, however, all but one intervention was recommended for scale-up. The remaining intervention was deemed to be promising but further information was required before assessing scalability. LESSONS LEARNT: The ISAT was perceived as a useful tool to assess the scalability of real-world health programs, with participants noting only minor limitations and challenges. The ISAT can be applied to a variety of population health interventions and identifies strengths and weaknesses in the evidence base for scale-up. This study revealed that decisions to scale up are often made despite potential weaknesses highlighted through the ISAT. This is likely a reflection of the critically influential role of contextual factors in decisions to scale up, whereby decision makers may balance a variety of considerations, of which evidence of scalability is only one factor.

Can an electronic monitoring system capture implementation of health promotion programs? A focussed ethnographic exploration of the story behind program monitoring data.

BACKGROUND: There is a pressing need for policy makers to demonstrate progress made on investments in prevention, but few examples of monitoring systems capable of tracking population-level prevention policies and programs and their implementation. In New South Wales, Australia, the scale up of childhood obesity prevention programs to over 6000 childcare centres and primary schools is monitored via an electronic monitoring system, "PHIMS". METHODS: Via a focussed ethnography with all 14 health promotion implementation teams in the state, we set out to explore what aspects of program implementation are captured via PHIMS, what aspects are not, and the implications for future IT implementation monitoring systems as a result. RESULTS: Practitioners perform a range of activities in the context of delivering obesity prevention programs, but only specific activities are captured via PHIMS. PHIMS thereby defines and standardises certain activities, while non-captured activities can be considered as "extra" work by practitioners. The achievement of implementation targets is influenced by multi-level contextual factors, with only some of the factors accounted for in PHIMS. This evidences incongruencies between work done, recorded and, therefore, recognised. CONCLUSIONS: While monitoring systems cannot and should not capture every aspect of implementation, better accounting for aspects of context and "extra" work involved in program implementation could help illuminate why implementation succeeds or fails. Failure to do so may result in policy makers drawing false conclusions about what is required to achieve implementation targets. Practitioners, as experts of context, are well placed to assist policy makers to develop accurate and meaningful implementation targets and approaches to monitoring.

Using developmental evaluation to enhance continuous reflection, learning and adaptation of an innovation platform in Australian Indigenous primary healthcare.

Effective efforts to strengthen health systems need diverse, multi-stakeholder networks working together on complex or 'wicked' problems such as prevention and control of chronic diseases, solutions to which go beyond the role and capability of one organisation. The contextual complexities inherent in 'wicked' problems mean that solutions warrant a systems approach that encompasses innovation and new ways of thinking about, facilitating and implementing collective decision-making processes and change practices.Innovation platforms are a mechanism for facilitating communication and collaboration among diverse stakeholders, promoting joint action and stimulating innovation. Developmental evaluation is an approach that is increasingly being used to evaluate innovative and emergent programmes and projects, as it enables evaluators to provide real-time feedback so that evaluation findings can be used to guide development and adaptations. Developmental evaluation emphasises learning and adaptation, and aligns well with the implementation of innovation platforms that have continuous reflection, learning and adaptation as a specific design principle.Here, we outline our rationale for applying a developmental evaluation to enhance the formation, functioning and outcomes of an innovation platform aimed at accelerating and strengthening large-scale quality improvement efforts in Australian Aboriginal and Torres Strait Islander primary healthcare. We provide examples to explain how the developmental evaluation findings were used for adaptation of the innovation platform and assess to what extent our application of developmental evaluation was consistent with, and reflective of, its essential principles.Our evaluation aligned strongly with the principles of developmental evaluation, and the approach we took was well suited to situations with a developmental purpose, innovation niche and complexity such as innovation platforms. As a result, along with the increasing interest in multi-stakeholder platforms (e.g. innovation platforms) and the inherent challenges with evaluating these complex networks, we anticipate our use of this approach being of interest globally.

Using a 'rich picture' to facilitate systems thinking in research coproduction.

BACKGROUND: In coproduction research, traditional 'end-users' are involved in the entire research process. The aim is to facilitate research translation by improving the timeliness and relevance of research. Because end-users often come from multiple sectors and hold diverse perspectives and priorities, involving them in coproduction can be challenging. Tools and approaches are needed to support coproduction teams to successfully navigate divergent viewpoints while producing rigorous but meaningful research outcomes. Rich pictures are a systems thinking tool to help make sense of complexity. In this paper, we describe how we developed and applied a 'rich picture' in a coproduction project with policy-level partners. METHODS: Guided by systems thinking principles, we conducted a systemic analysis of ethnographic fieldnotes collected as part of a broader study that examined the dynamics between an IT system and the implementation of the state-wide childhood obesity prevention programmes it was designed to monitor. Translating qualitative themes into metaphor and imagery, we created a visual depiction of the system to reflect the experience of the system's users (health promotion practitioners) and facilitated a workshop with policy-level programme administrators (i.e. participants, n = 7). Our aim was to increase the transparency of the system for our research partners and to spark new insights to improve the quality of programme implementation. RESULTS: Guided by provocative questions, participants discussed and challenged each other's thinking on the current functioning of the system. They identified future lines of inquiry to explore for quality improvement. Participants strongly agreed that the picture was a constructive way to engage with the ethnographic data but were challenged by the information and its implications. The opportunity for participants to co-learn from each other as well as from the picture was an added value. CONCLUSION: In the context of the facilitated workshop, the rich picture enabled research partners to engage with complex research findings and gain new insights. Its value was harnessed via the guided participatory process. This demonstrates the importance that, in the future, such tools should be accompanied by practices that enable participants to think with and apply systems thinking concepts and principles.

Key Performance Indicators for program scale-up and divergent practice styles: a study from NSW, Australia.

Implementing programs at scale has become a vital part of the government response to the continuing childhood obesity epidemic. We are studying the largest ever scale-up of school and child care obesity prevention programs in Australia. Health promotion teams support primary schools and early childhood services in their area to achieve a number of specified, evidence-based practices aimed at organizational changes to improve healthy eating and physical activity. Key performance indicators (KPIs) were devised to track program uptake across different areas-measuring both the proportion of schools and early childhood services reached and the proportion of practices achieved in each setting (i.e. the proportion of sites implementing programs as planned). Using a 'tight-loose-tight' model, all local health districts receive funding and are held accountable to reaching KPI implementation targets. However, local teams have independent discretion over how to best use funds to reach targets. Based on 12 months of ethnographic fieldwork and interviews across all districts, this study examines variations in the decision making and strategizing processes of the health promotion teams. We identified three distinct styles of practice: KPI-driven practice (strategic, focussed on targets); relationship-driven practice (focussed on long-term goals); and equity-driven practice (directing resources to sites most in need). In adapting to KPIs, teams make trade-offs and choices. Some teams struggled to balance a moral imperative to attend to equity issues, with a practical need to meet implementation targets. We discuss how models of program scale-up and tracking could possibly evolve to recognize this complexity.

Intervention Scalability Assessment Tool: A decision support tool for health policy makers and implementers.

BACKGROUND: Promising health interventions tested in pilot studies will only achieve population-wide impact if they are implemented at scale across communities and health systems. Scaling up effective health interventions is vital as not doing so denies the community the most effective services and programmes. However, there remains a paucity of practical tools to assess the suitability of health interventions for scale-up. The Intervention Scalability Assessment Tool (ISAT) was developed to support policy-makers and practitioners to make systematic assessments of the suitability of health interventions for scale-up. METHODS: The ISAT was developed over three stages; the first stage involved a literature review to identify similar tools and frameworks that could be used to guide scalability assessments, and expert input to develop draft ISAT content. In the second stage, the draft ISAT tool was tested with end users. The third stage involved revising and re-testing the ISAT with end users to further refine the language and structure of the final ISAT. RESULTS: A variety of information and sources of evidence should be used to complete the ISAT. The ISAT consists of three parts. Part A: 'setting the scene' requires consideration of the context in which the intervention is being considered for scale-up and consists of five domains, as follows: (1) the problem; (2) the intervention; (3) strategic/political context; (4) evidence of effectiveness; and (5) intervention costs and benefits. Part B asks users to assess the potential implementation and scale-up requirements within five domains, namely (1) fidelity and adaptation; (2) reach and acceptability; (3) delivery setting and workforce; (4) implementation infrastructure; and (5) sustainability. Part C generates a graphical representation of the strengths and weaknesses of the readiness of the proposed intervention for scale-up. Users are also prompted for a recommendation as to whether the intervention (1) is recommended for scale-up, (2) is promising but needs further information before scaling up, or (3) does not yet merit scale-up. CONCLUSION: The ISAT fills an important gap in applied scalability assessment and can become a critical decision support tool for policy-makers and practitioners when selecting health interventions for scale-up. Although the ISAT is designed to be a health policy and practitioner tool, it can also be used by researchers in the design of research to fill important evidence gaps.

Making space for Aboriginal and Torres Strait Islander community health workers in health promotion.

Despite a clear need, 'closing the gap' in health disparities for Aboriginal and Torres Strait Islander communities (hereafter, respectfully referred to as Aboriginal) continues to be challenging for western health care systems. Globally, community health workers (CHWs) have proven effective in empowering communities and improving culturally appropriate health services. The global literature on CHWs reflects a lack of differentiation between the types of roles these workers carry out. This in turn impedes evidence syntheses informing how different roles contribute to improving health outcomes. Indigenous CHW roles in Australia are largely operationalized by Aboriginal Health Workers (AHWs)-a role situated primarily within the clinical health system. In this commentary, we consider whether the focus on creating professional AHW roles, although important, has taken attention away from the benefits of other types of CHW roles particularly in community-based health promotion. We draw on the global literature to illustrate the need for an Aboriginal CHW role in health promotion; one that is distinct from, but complementary to, that of AHWs in clinical settings. We provide examples of barriers encountered in developing such a role based on our experiences of employing Aboriginal health promoters to deliver evidence-based programmes in rural and remote communities. We aim to draw attention to the systemic and institutional barriers that persist in denying innovative employment and engagement opportunities for Aboriginal people in health.

Capturing implementation knowledge: applying focused ethnography to study how implementers generate and manage knowledge in the scale-up of obesity prevention programs.

BACKGROUND: Bespoke electronic information management systems are being used for large-scale implementation delivery of population health programs. They record sites reached, coordinate activity, and track target achievement. However, many systems have been abandoned or failed to integrate into practice. We investigated the unusual endurance of an electronic information management system that has supported the successful statewide implementation of two evidence-based childhood obesity prevention programs for over 5 years. Upwards of 80% of implementation targets are being achieved. METHODS: We undertook co-designed partnership research with policymakers, practitioners, and IT designers. Our working hypothesis was that the science of getting evidence-based programs into practice rests on an in-depth understanding of the role programs play in the ongoing system of local relationships and multiple accountabilities. We conducted a 12-month multisite ethnography of 14 implementation teams, including their use of an electronic information management system, the Population Health Information Management System (PHIMS). RESULTS: All teams used PHIMS, but also drew on additional informal tools and technologies to manage, curate, and store critical information for implementation. We identified six functions these tools performed: (1) relationship management, (2) monitoring progress towards target achievement, (3) guiding and troubleshooting PHIMS use, (4) supporting teamwork, (5) evaluation, and (6) recording extra work at sites not related to program implementation. Informal tools enabled practitioners to create locally derived implementation knowledge and provided a conduit between knowledge generation and entry into PHIMS. CONCLUSIONS: Implementation involves knowing and formalizing what to do, as well as how to do it. Our ethnography revealed the importance of hitherto uncharted knowledge about how practitioners develop implementation knowledge about how to do implementation locally, within the context of scaling up. Harnessing this knowledge for local use required adaptive and flexible systems which were enabled by informal tools and technologies. The use of informal tools also complemented and supported PHIMS use suggesting that both informal and standardized systems are required to support coordinated, large-scale implementation. While the content of the supplementary knowledge required to deliver the program was specific to context, functions like managing relationships with sites and helping others in the team may be applicable elsewhere.

Variation in the operationalisation of dose in implementation of health promotion interventions: insights and recommendations from a scoping review.

BACKGROUND: While 'dose' is broadly understood as the 'amount' of an intervention, there is considerable variation in how this concept is defined. How we conceptualise, and subsequently measure, the dose of interventions has important implications for understanding how interventions produce their effects and are subsequently resourced and scaled up. This paper aims to explore the degree to which dose is currently understood as a distinct and well-defined implementation concept outside of clinical settings. METHODS: We searched four databases (MEDLINE, PsycINFO, EBM Reviews and Global Health) to identify original research articles published between 2000 and 2015 on health promotion interventions that contained the word 'dose' or 'dosage' in the title, abstract or keywords. We identified 130 articles meeting inclusion criteria and extracted data on how dose/dosage was defined and operationalised, which we then synthesised to reveal key themes in the use of this concept across health promotion interventions. RESULTS: Dose was defined in a variety of ways, including in relation to the amount of intervention delivered and/or received, the level of participation in the intervention and, in some instances, the quality of intervention delivery. We also observed some conflation of concepts that are traditionally kept separate (such as fidelity) either as slippage or as part of composite measures (such as 'intervention dose'). DISCUSSION: Dose is not a well-defined or consistently applied concept in evaluations of health promotion interventions. While current approaches to conceptualisation and measurement of dose are suitable for interventions in organisational settings, they are less well suited to policies delivered at a population level. Dose often accompanies a traditional monotonic linear view of causality (e.g. dose response) which may or may not fully represent the intervention's theory of how change is brought about. Finally, we found dose and dosage to be used interchangeably. We recommend a distinction between these terms, with 'dosage' having the advantage of capturing change to amount 'dispensed' over time (in response to effects achieved). Dosage therefore acknowledges the inevitable dynamic and complexity of implementation.