Factors Influencing the Effectiveness of Adopting Electronic Medical Record-Based Reporting Systems for Notifiable Disease Surveillance: A Quantitative Analysis.

The coronavirus disease 2019 (COVID-19) pandemic has led to greater attention being given to infectious disease surveillance systems and their notification functionalities. Although numerous studies have explored the benefits of integrating functionalities with electronic medical record (EMR) systems, empirical studies on the topic are rare. The current study assessed which factors influence the effectiveness of EMR-based reporting systems (EMR-RSs) for notifiable disease surveillance. This study interviewed staff from hospitals with a coverage that represented 51.39% of the notifiable disease reporting volume in Taiwan. Exact logistic regression was employed to determine which factors influenced the effectiveness of Taiwan's EMR-RS. The results revealed that the influential factors included hospitals' early participation in the EMR-RS project, frequent consultation with the information technology (IT) provider of the Taiwan Centers for Disease Control (TWCDC), and retrieval of data from at least one internal database. They also revealed that using an EMR-RS resulted in more timely, accurate, and convenient reporting in hospitals. In addition, developing by an internal IT unit instead of outsourcing EMR-RS development led to more accurate and convenient reporting. Automatically loading the required data enhanced the convenience, and designing input fields that may be unavailable in current databases to enable physicians to add data to legacy databases also boosted effectiveness of the reporting system.

Co-designing a methodology for workforce development during the personalisation of allied health service funding for people with disability in Australia.

BACKGROUND: Internationally, health and social services are undergoing creative and extensive redesign to meet population demands with rationed budgets. This has critical implications for the health workforces that serve such populations. Within the workforce literature, few approaches are described that enable workforce development for health professions in the service contexts that emerge from large scale service redesign in times of industry shift. We contribute an innovative and robust methodology for workforce development that was co-designed by stakeholders in allied health during the personalisation of disability funding in Australia (the introduction of the National Disability Insurance Scheme). METHODS: In the context of a broad action research project, we used program logic modelling to identify and enact opportunities for sustainable allied health education and workforce integration amidst the changed service provision context. We engaged with 49 industry stakeholders across 92 research engagements that included interviews (n = 43), a workshop explicitly for model development (n = 8) and a Project Advisory Group (n = 15). Data from these activities were inductively coded, analysed, and triangulated against each other. During the program logic modelling workshop, we worked with involved stakeholders to develop a conceptual model which could be used to guide trial and evaluation of allied health education which was fit-for-purpose to emerging workforce requirements. RESULTS: Stakeholder interviews showed that drivers of workforce design during industry shift were that (1) service provision was happening in turbulent times; (2) new concerns around skills and professional engagement were unfolding for AHP in the NDIS; and (3) impacts to AHP education were being experienced. The conceptual model we co-designed directly accounted for these contextual features by highlighting five underpinning principles that should inform methodologies for workforce development and AHP education in the transforming landscape: being (1) pedagogically sound; (2) person- or family-centred; (3) NDIS compliant; (4) informed by evidence and (5) having quality for all. We use a case study to illustrate how the co-designed conceptual model stimulated agility and flexibility in workforce and service redesign. CONCLUSIONS: Proactive and situated education of the emerging workforce during policy shift is essential to realise future health workforces that can appropriately and effectively service populations under a variety of changing service and funding structures - as well as their transitions. We argue that collaborative program logic modelling in partnership with key stakeholders including existing workforce can be useful for broad purposes of workforce (re)design in diverse contexts.

Implementation support practitioners - a proposal for consolidating a diverse evidence base.

BACKGROUND: Workforce development for implementation practice has been identified as a grand challenge in health services. This is due to the embryonic nature of the existing research in this area, few available training programs and a general shortage of frontline service staff trained and prepared for practicing implementation in the field. The interest in the role of "implementation support" as a way to effectively build the implementation capacities of the human service sector has therefore increased. However, while frequently used, little is known about the skills and competencies required to effectively provide such support. MAIN BODY: To progress the debate and the research agenda on implementation support competencies, we propose the role of the "implementation support practitioner" as a concept unifying the multiple streams of research focused on e.g. consultation, facilitation, or knowledge brokering. Implementation support practitioners are professionals supporting others in implementing evidence-informed practices, policies and programs, and in sustaining and scaling evidence for population impact. They are not involved in direct service delivery or management and work closely with the leadership and staff needed to effectively deliver direct clinical, therapeutic or educational services to individuals, families and communities. They may be specialists or generalists and be located within and/or outside the delivery system they serve. To effectively support the implementation practice of others, implementation support practitioners require an ability to activate implementation-relevant knowledge, skills and attitudes, and to operationalize and apply these in the context of their support activities. In doing so, they aim to trigger both relational and behavioral outcomes. This thinking is reflected in an overarching logic outlined in this article. CONCLUSION: The development of implementation support practitioners as a profession necessitates improved conceptual thinking about their role and work and how they enable the uptake and integration of evidence in real world settings. This article introduces a preliminary logic conceptualizing the role of implementation support practitioners informing research in progress aimed at increasing our knowledge about implementation support and the competencies needed to provide this support.

What works, why and how? A scoping review and logic model of rural clinical placements for allied health students.

BACKGROUND: Allied health services are core to the improvement in health outcomes for remote and rural residents. Substantial infrastructure has been put into place to facilitate rural work-ready allied health practitioners, yet it is difficult to understand or measure how successful this is and how it is facilitated. METHODS: A scoping review and thematic synthesis of the literature using program logic was undertaken to identify and describe the contexts, mechanisms and outcomes of successful models of rural clinical placements for allied health students. This involved all empirical literature examining models of regional, rural and remote clinical placements for allied health students between 1995 and 2019. RESULTS: A total of 292 articles were identified; however, after removal of duplicates and article screening, 18 were included in the final synthesis. Australian papers dominated the evidence base (n = 11). Drivers for rural allied health clinical placements include: attracting allied health students to the rural workforce; increasing the number of allied health clinical placements available; exposing students to and providing skills in rural and interprofessional practice; and improving access to allied health services in rural areas. Depending on the placement model, a number of key mechanisms were identified that facilitated realisation of these drivers and therefore the success of the model. These included: support for students; engagement, consultation and partnership with key stakeholders and organisations; and regional coordination, infrastructure and support. Placement success was measured in terms of student, rural, community and/or program outcomes. Although the strength and quality of the evidence was found to be low, there is a trend for placements to be more successful when the driver for the placement is specifically reflected in the structure of the placement model and outcomes measured. This was seen most effectively in placement models that were driven by the need to meet rural community needs and upskill students in interprofessional rural practice. CONCLUSION: This study identifies the factors that can be manipulated to ensure more successful models of allied health rural clinical placements and provides an evidence based framework for improved planning and evaluation.

Mechanisms to achieve a successful rural physiotherapy public-private partnership: a qualitative study.

INTRODUCTION: Longstanding gaps in physiotherapy service delivery exist in rural areas across Australia. In response to this, a large public rural health organisation contracted a private physiotherapy business to implement a public-private partnership (PPP) to supply physiotherapy to hospital inpatients, aged care facility residents and outpatients in four outer regional Australian towns. Treatment rooms were provided by the health organisation for the private physiotherapists to see clients. This study explored how stakeholders defined the success of a PPP model of service delivery in a rural setting and examined if the model was successful according to stakeholder definitions. Barriers and enablers (mechanisms) were identified and linked to stakeholder-defined success measures. METHODS: A qualitative study was conducted using a constructive inquiry design. Participants were purposively recruited, via email invitation and telephone follow-up. Participants comprised managers and clinicians from the rural public health organisation and the private physiotherapy business involved in setting up, working within or alongside the partnership. Semi-structured interviews were undertaken with all participants. Data were transcribed verbatim and analysed using framework analysis. Program logic was used to synthesise all information. RESULTS: Individual interviews were conducted with five staff from each partnering organisation, including managers and clinicians (total n=10). Two main themes and three subthemes were identified. All participants described the model as being successful. Elements of success included improved access to local services, and satisfied stakeholders. There were three mechanisms identified to successfully implement the service delivery model. The first mechanism was the provision of human and several other resources, which included the workforce model and the use of several resources for the partnership. The second mechanism was stakeholder engagement, which included having motivated stakeholders and consistent stakeholders. The third mechanism was streamlined processes, which included the content of the contract and referral schedule, streamlined administration processes for contracting and accounting, having processes for managing private therapists in a public setting as well as processes for communication. CONCLUSION: This study demonstrates that an innovative physiotherapy PPP model of service delivery can be a successful way to improve access to physiotherapy services in rural areas. Success of service models varies depending on the viewpoint of the stakeholder and achieving success for all stakeholders is contingent on mechanisms such as those identified in this study. PPPs have potential to address service gaps in hospitals, residential aged care and primary care in rural areas.

Partners in Recovery: an early phase evaluation of an Australian mental health initiative using program logic and thematic analysis.

BACKGROUND: Mental illness is a leading cause of illness and disability and around 75% of people suffering mental illness do not have access to adequate care. In Australia, nearly half the population experiences mental illness at some point in their life. The Australian Government developed a National program called Partners in Recovery (PIR) to support those with severe and persistent mental illness. The program was implemented through 48 consortia across Australia. One of these was led by the Nepean Blue Mountains Medicare Local who adapted the program according to its specific local needs. METHODS: We conducted an early evaluation of the PIR program in Nepean Blue Mountains (NBMPIR) using a program logic model (PLM) to frame the evaluation and complemented this with an additional thematic analysis. Participants (n = 73) included clients and carers, program management and staff of the Consortium and other partners and agencies, and clinical, allied health, and other service providers. Our PLM utilised multiple data sources that included document review, open and closed survey questions, and semi-structured interviews. Quantitative data received a descriptive analysis and qualitative data was analysed both in alignment with the PLM framework and inductively. RESULTS: We aligned our results to PLM domains of inputs, activities, outputs, outcomes and impacts. The NBMPIR consortium implemented a recovery approach and provided greater access to services by enhancing healthcare provider partnerships. Our thematic analysis further described five key themes of collaboration; communication; functioning of PIR; structural/organisational challenges; and understanding of PIR approaches. Facilitators and barriers to the NBMPIR program centred on the alignment of vision and purpose; building an efficient system; getting the message out and sharing information; understanding roles and support and training of staff; building capacity and systems change; addressing service gaps; and engaging peers. CONCLUSIONS: Our study provided helpful insights into the coordinated management of complex mental illness. The NBMPIR's focus on partnerships and governance, service coordination, and systems change has relevance for others engaged in this work. This PLM effectively mapped the program, including its processes and resources, and is a useful framework providing a baseline for future evaluations. Full report available at https://researchdirect.westernsydney.edu.au/islandora/object/uws:33977/.

Reorientation of the Rural Adversity Mental Health Program: the value of a program logic model.

CONTEXT: The Rural Adversity Mental Health Program (RAMHP) was founded in 2007 with the specific focus of responding to drought-related mental health needs among farmers in rural and remote New South Wales (NSW), Australia. Successive re-funding enabled the program to evolve strategically and increase its reach. Over a decade, the program's focus has expanded to include all people in rural and remote NSW in need of mental health assistance, and not just in times of adversity such as drought. ISSUE: The program's longest re-funding period, 2016-2020, provided the opportunity for a comprehensive review and longer term planning. Several priorities influencing program renewal were evident at this time: the need to improve data collection and evaluation methods, a reassessment of the program's primary focus and the need to align with significant government mental health reforms. A program logic model (PLM) was developed, in collaboration with frontline RAMHP coordinators, to steer reorientation, clarify objectives, activities and outcomes, and improve data collection. A PLM is a graphic depiction of a program, showing the rationale of how inputs and activities lead to outcomes. LESSONS LEARNED: Four key lessons were identified. (1) The development of the PLM in collaboration with the RAMHP coordinators (frontline staff) was found to be an important vehicle for ensuring their acceptance and adoption of strategic changes. (2) The collaborative development process also provided the opportunity to decide upon consistent terminology to describe the program, facilitating communication of the value of RAMHP to external stakeholders. (3) The PLM enabled a clear but flexible program structure that aligned with changes in the mental health system to be described. (4) The PLM provided the foundation for the development of an evaluation framework, including a mobile app, to aid data collection to underpin accountability. Investing in the development of a PLM early in program reorientation provided many benefits for RAMHP, including improved role clarity and communication, staff commitment to program changes and a foundation for comprehensive program evaluation that integrates with program planning. The PLM proved a key foundational tool to reorient RAMHP by producing a clear program structure that was agreed upon by all staff.

Using the Program Logic Model to Evaluate ¡Cuídate!: A Sexual Health Program for Latino Adolescents in a School-Based Health Center.

BACKGROUND: Addressing the disparities in pregnancy and sexually transmitted infection (STI) rates for Latino youth in the United States requires an evidence-based approach. Although randomized controlled trials for sexual risk reduction interventions have shown promise in improving short-term outcomes, program sustainability has not been extensively examined in school settings where teens spend time. Latina teen pregnancy rates are nearly twice the national average. Adolescents comprise only 17% of the U.S. population, yet they account for 50% of STIs. ¡Cuídate! is a high-impact sexual health group program endorsed by the Centers for Disease Control and Prevention that has not been replicated in a real-world setting. AIMS: The program logic model (PLM) was used as the systematic approach to plan, implement, and evaluate a sustainable model of sexual health group programing (¡Cuídate!) in a U.S. high school with a large Latino student population. METHODS: The PLM provided the framework for the evaluation of outputs, outcome, and impact. A multivariate repeated measures analysis of variance was used as the means to evaluate the participant outcomes immediately postprogram and at 8-12 weeks. RESULTS: ¡Cuídate! was executed within an existing school structure and time constraints, below cost projections, and with high participant retention (95.8%). Three cohorts (N = 24) of female teens demonstrated significant increases in STI or HIV knowledge, self-efficacy, and intention to use condoms (p < .01). Condom use increased postprogram. No participants initiated sexual behavior, nor were there any reported pregnancies or STIs. CONCLUSIONS: An evidence-based intervention previously tested in randomized controlled trials can be sustained in a school-based health center with similar results of efficacy. LINKING EVIDENCE TO ACTION: Our success served as a platform for a sustainable program. We continue to extend the impact of the program by delivering ¡Cuídate! in the school setting using a community health worker.

Advancing the decadal plan for the science of nutrition: Progressing a framework for implementation.

AIMS: In 2019, the Australian Academy of Science in collaboration with the nutrition community published the decadal plan for the science of nutrition. This article aims to review progress towards each of its pillar goals (societal determinants, nutrition mechanisms, precision and personalised nutrition, and education and training) and two enabling platforms (a national data capability and a trusted voice for nutrition science), prioritise actions, and conceptualise program logic implementation models. This process also brought together public health nutrition researchers to reflect on societal determinants of health, and advise how the next 5 years of the decadal plan could reflect contemporary issues. METHODS: Two engagement events, in 2023, brought together experienced and mid- and early-career nutrition professionals for co-creation of implementation logic models. RESULTS: One hundred and nine early and mid-career professionals were involved. A revised model for the decadal plan pillars emerged from synthesis of all logic models. This new model integrated the precision and personalised nutrition pillar with nutrition mechanisms pillar. These combined pillars build towards the national data capability enabling platform and created new cross-cutting themes for education and training. The need arose for greater focus on respectful engagement with Aboriginal and Torres Strait Islander communities and sustained effort to build cross-disciplinary collaboration to realise the plan's societal determinants goals. A new alliance for nutrition science is proposed to become a unified advocacy voice and build trust in nutrition professionals. CONCLUSIONS: A programmatic approach provides a road map for implementing the decadal plan for the final 5 years.

Program logic of a mental health outreach service for socially anxious youth.

Youth mental health is a major concern both in Australia and internationally. Identifying at-risk young people is a core service priority. This report describes a "Youth Social Inclusion Program" developed in Australia to assist young people identified as having social difficulties that prevent them linking into formal mental health services. This report describes the Australian service context and uses the "program explication" methodology to document: the program activities, therapeutic processes, and underpinning evidence for the benefits of this service. Program explication is a consulting method designed to assist services to identify and review implicit program logic assumptions against evaluation literature. We demonstrate the application of this method in exploring the assumptions and evidence for the Youth Social Inclusion Program, targeting outreach to socially anxious young people in Australia. The Youth Social Inclusion Program involved seven logically consistent activities. Our literature search revealed moderate evidence for the expected benefits of the activities. This practice-based design drew on several theoretical perspectives. Given that the program logic has been established, we outline a proposal for further evaluation.

Remotely and collaboratively evaluating a campus-based therapy dog program during the COVID-19 pandemic.

The COVID-19 pandemic adversely affected the wellbeing of university students and adults in general, emphasizing the need for mental health programming that was compliant with physical distancing mandates. The present evaluation investigated mental health and social connection within the context of COVID-19 by remotely evaluating a virtual animal-assisted activity at the University of Saskatchewan - PAWS Your Stress. The purpose of this article is to outline our evaluation methods and findings, while calling specific attention to the collaborative strategies that were implemented within a remote, time-sensitive context. The evaluation findings revealed that remote animal-assisted programming can facilitate connections with humans and animals, and promote multiple mental health benefits, despite the lack of physical interaction with the animals. Our lessons learned indicate that remote program logic modelling workshops are feasible when suited to audience demographics. Further, our experience suggests that the Most Significant Change technique (a qualitative, participatory, storytelling method that elicits outcome data) can be useful in time-restricted evaluations, and the necessity of central steps in the process may vary depending on evaluation goals. This project has implications for future evaluation work, by demonstrating the effective use of remote methods that allowed for successful stakeholder collaboration.

Transforming Lives of Former Foster Youths: A Campus-Based Support Program Grounded in Social Work Values.

Support programs to improve higher education outcomes for former foster youths have emerged in the past 20 years, but literature to guide their development and implementation is limited. This conceptual article presents the program logic model for ACE [Achieving College Excellence] Scholars Services, the comprehensive, campus-based program supporting former foster youths grounded in social work values at California State University San Marcos (CSUSM). ACE has a noncompetitive application process that accepts an unrestricted number of students, known as ACE Scholars. To focus on the unique needs of former foster youths, students who are on probation, experiencing homeless, and unaccompanied minors are included if they have also experienced foster care. Funded by private donors, the Center for ACE Scholars on CSUSM's campus provides an inviting, welcoming space that reflects the inclusive support ACE Scholars receive. By increasing educational attainment and opportunities for this vulnerable population, ACE aims to improve outcomes for former foster youths and their next generation. Articulating this program logic model provides implications for developing and implementing support programs for former foster youths on college campuses and sets the foundation for evaluating the impact of ACE Scholars Services.

Ensuring Best Practice in Genomic Education and Evaluation: A Program Logic Approach.

Targeted genomic education and training of professionals have been identified as core components of strategies and implementation plans for the use of genomics in health care systems. Education needs to be effective and support the sustained and appropriate use of genomics in health care. Evaluation of education programs to identify effectiveness is challenging. Furthermore, those responsible for development and delivery are not necessarily trained in education and/or evaluation. Program logic models have been used to support the development and evaluation of education programs by articulating a logical explanation as to how a program intends to produce the desired outcomes. These are highly relevant to genomic education programs, but do not appear to have been widely used to date. To assist those developing and evaluating genomic education programs, and as a first step towards enabling identification of effective genomic education approaches, we developed a consensus program logic model for genomic education. We drew on existing literature and a co-design process with 24 international genomic education and evaluation experts to develop the model. The general applicability of the model to the development of programs was tested by program convenors across four diverse settings. Conveners reported on the utility and relevance of the logic model across development, delivery and evaluation. As a whole, their feedback suggests that the model is flexible and adaptive across university award programs, competency development and continuing professional development activities. We discuss this program logic model as a potential best practice mechanism for developing genomic education, and to support development of an evaluation framework and consistent standards to evaluate and report genomic education program outcomes and impacts.