The Impact of Implementation Fidelity of a School-Based Multi-Component Smoking Prevention Intervention on Vocational Students' Smoking Behavior: A Cluster-Randomized Controlled Trial.

Preventing young people's cigarette smoking is a major public health priority, and smoking is especially prevalent in vocational schools. Well-enforced comprehensive school tobacco policies accompanied by preventive efforts show potential to reduce smoking, but the implementation process is crucial to achieve the intended effect. We investigate whether and how implementation fidelity of a multi-component smoking prevention intervention impacted student smoking outcomes after 4-5 months among students in Danish vocational education and training (national age range 15-65 years, mean 25.6) and preparatory basic education (national age range 15-25 years, mean 17.6) institutions using questionnaire data from a cluster-RCT. The intervention included a smoke-free school hours policy, educational curriculum, and class competition. We calculated an overall implementation fidelity measure combining staff-reported school-level delivery (fidelity) and student-reported receipt (participation, responsiveness), and used multilevel regression models to analyze associations with smoking outcomes (smoking daily, regularly, and during school hours). We supplemented the analysis with restricted cubic spline regression. Additionally, we stratified the analyses by school types and analyzed associations between implementation fidelity of the separate intervention components and smoking outcomes. High implementation was associated with lower odds of regular smoking (OR: 0.37, 95% CI: 0.18-0.78) and smoking during school hours, but not daily smoking, and these associations varied between the school settings. When analyzed separately, implementation fidelity of the components did not affect the outcomes significantly. Our findings underline the need to support the implementation process of school tobacco policy interventions to ensure the intended effects of reducing students' smoking.

Methodology for evaluation of complex school-based health promotion interventions.

There is a need for careful examination of large volumes of collected (structured and unstructured) information related to school-based evaluation. There is also no published, comprehensive framework/s for evaluating complex interventions in Irish primary schools. The aim of this paper is to outline a methodology for process evaluation of an Irish primary school-based physical activity (PA) and nutrition intervention. Evaluation followed the three themes outlined by the British Medical Research Council: implementation, context, and mechanism of impact that we further divided into six dimensions. Methodological tools included questionnaires, PA logs, reflective journals, write and draw, and semi-structured interviews. We triangulated findings across these multiple tools to assess each dimension. We designed a unique framework to enable comparisons and offer researchers a template for evaluating complex health promotion interventions in primary schools. We present a methodology for evaluating a complex school-based health promotion intervention. The framework we propose integrates process and outcome data. It aims to enhance future result interpretation and facilitate informed comparisons among intervention schools.

Using formative process evaluation to improve program implementation and accessibility of competitive group-based physical activity in the TEAM-PA trial.

BACKGROUND: This study demonstrates how formative process evaluation was used to assess implementation and improve dose and fidelity in the Together Everyone Achieves More Physical Activity (TEAM-PA) randomized controlled trial. TEAM-PA uses a randomized group cohort design to evaluate the efficacy of a group-based intervention for increasing physical activity among African American women. METHODS: Intervention groups met for 10 weeks and were co-led by female African American facilitators, with intervention sessions consisting of group feedback, a health curriculum, group-based physical activity games, and group-based goal-setting. Drawing from a multi-theoretical framework, the intervention targeted social affiliation using collaborative and competitive group strategies, including essential elements focused on group-based behavioral skills, peer-to-peer positive communication, collectivism, optimal challenge, social facilitation, and peer to peer challenges. Formative process evaluation was used to monitor reach, dose, and fidelity, and implement feedback and solutions. RESULTS: Across two cohorts, four groups (n = 54) were randomized to the TEAM-PA intervention. On average 84.8% of participants attended each week, which exceeded the a priori criteria. Results from the systematic observations indicated that on average 93% of the dose items were completed in each session and adequate levels of fidelity were achieved at both the facilitator and group-levels. Participants were compliant with wearing the FitBits (6.73 ± 0.42 days/week) and most participants successfully contributed to meeting the group-based goals. The use of open-ended items also revealed the need for additional modifications to the group-based PA games, including allowing for individuals to take breaks, incorporating a broader range of exercises, minimizing activities that required bending/reaching down without assistance, and providing facilitators with additional training for implementing the games. Initial evidence suggests that these changes were successful in increasing participants' comprehension of the games from Cohort 1 (M = 1.83, SD = 0.71) to Cohort 2 (M = 3.33, SD = 0.69). CONCLUSION: Findings from this study demonstrated high levels of reach, dose, and fidelity, while also highlighting strategies for implementing competitive group-based PA games that are accessible across physical fitness levels. Formative process evaluation, including open-ended items and collaborative brainstorming, holds tremendous potential for improving future interventions. TRIAL REGISTRATION: This study was registered on Clinicaltrials.gov (# NCT05519696) on August 22, 2022 prior to the enrollment of the first participant on September 12, 2022 ( https://clinicaltrials.gov/study/NCT05519696?term=NCT05519696&rank=1 ).

Group-based pelvic floor muscle training for pregnant women: A randomized controlled feasibility study.

AIM: This study aims to test the feasibility and acceptability of a group-based pelvic floor muscle training for pregnant women in China and facilitate women's adherence to the pelvic floor muscle training programme. BACKGROUND: Urinary incontinence is a prevalent health problem in women worldwide, especially in pregnant women. Supervised pelvic floor muscle training is recommended as the first-line conservative treatment for urinary incontinence. However, the implementation and effectiveness of pelvic floor muscle training are limited by insufficient human resources and low adherence. Group-based interventions may improve people's adherence to interventions by facilitating peer support. However, it has been investigated in a limited number of maternity studies. DESIGN: Feasibility testing randomized controlled trial, accompanied by a mixed methods process evaluation. METHODS: This study was guided by the Medical Research Council framework for complex interventions and the Behaviour Change Wheel guide to developing interventions. A three-phase, mixed-methods design was used in this study. This study reported the feasibility of the group-based pelvic floor muscle training programme. Semi-structured reviews were conducted following the intervention to explore the acceptability of the programme. RESULTS: The study included 48 pregnant women with a recruitment rate of 52.17%. The adherence rate to the training programme was 66.67%. The intervention was positively valued, in particular the support promoting participants' adherence, but additional changes need to be made to the programme for a future trial. CONCLUSIONS: Group-based pelvic floor muscle training programme provides a possible way of delivering pelvic floor muscle training with limited health professionals in China. The study showed promising results concerning the acceptability and feasibility of the intervention, which were well perceived by both pregnant women and the midwife. IMPLICATIONS FOR PATIENT CARE: Group-based pelvic floor muscle training may have the potential of reducing the prevalence of urinary incontinence in pregnant women with insufficient healthcare professionals. IMPACT: This study assessed the feasibility of delivering group-based pelvic floor muscle training in pregnant women in China. The group-based pelvic floor muscle training is acceptable to both pregnant women and the midwife, but integrating online and face-to-face sessions need to be considered. The findings of this study provided evidence for delivering group-based pelvic floor muscle training to pregnant women in China. REPORTING METHOD: The study has adhered to CONSORT guidelines (Table S1) and TIDier checklist (Table S2). PATIENT AND PUBLIC CONTRIBUTION: The patient and public have been invited as stakeholders during the development of the intervention. They worked with healthcare professionals to co-design the group-based pelvic floor muscle training programme. REGISTRATION: The trial was registered on ClinicalTrials.gov (NCT05242809) under the title 'Development and Feasibility Testing of a Group-based PFMT Programme for Antenatal Women in Nanjing City in China'.

Process evaluation of a New psychosocial goal-setting and manualised support intervention for Independence in Dementia (NIDUS-Family).

INTRODUCTION: We report a mixed-methods process evaluation embedded within a randomised controlled trial. We aimed to test and refine a theory of change model hypothesising key causal assumptions to understand how the New Interventions for Independence in Dementia Study (NIDUS)-Family (a manualised, multimodal psychosocial intervention), was effective relative to usual care, on the primary outcome of Goal Attainment Scaling (GAS) over 1 year. METHODS: In 2021-2022, intervention-arm dyads completed an acceptability questionnaire developed to test causal assumptions. We conducted qualitative interviews with dyads and intervention facilitators, purposively selected for diverse follow-up GAS scores. We collected observational data from intervention session recordings. We thematically analysed data, then integrated qualitative and quantitative data. RESULTS: 174/204 (85.3%) dyads allocated to NIDUS-Family, fully completed it, 18 partially completed, while 12 received no intervention. We interviewed 27/192 (14%) of dyads receiving any sessions, and 9/10 facilitators; and observed 12 sessions. 47/192 (24.5%) of carers completed the acceptability questionnaire. We identified four themes: (A) 'Someone to talk to helps dyads feel supported'; (B) 'NIDUS-Family helps carers change their perspective'; (C) 'Personalisation helps people living with dementia maintain their identity' and (D) 'Small steps help dyads move forward'. CONCLUSION: Key causal pathway mechanisms were: a respectful, trusting and impartial relationship with the facilitator: supporting the development of meaningful goals and support to find manageable solutions. Core implementation factors were delivery of the modules from a consistent facilitator across regular sessions. Core contextual factors influencing these mechanisms were dyadic participation and understanding of abilities.

Enabling AI in Radiology: Evaluation of an AI Deployment Process.

Artificial intelligence (AI) is expected to transform healthcare systems and make them more sustainable. Despite the increased availability of AI tools for disease detection, evidence of their impact on healthcare organisations and patient care remains limited. Drawing on previous research underscoring the need for comprehensive evaluations of real-world AI deployments, this paper explores the challenges and opportunities encountered while procuring and implementing AI solutions for radiology. The paper aims to contribute to a better understanding of the complexities surrounding AI deployments in real-world clinical settings through a process evaluation study.

Process evaluation of a randomised controlled trial intervention designed to improve rehabilitation services for Aboriginal Australians after brain injury: the Healing Right Way Trial.

BACKGROUND: Healing Right Way (HRW) aimed to improve health outcomes for Aboriginal Australians with stroke or traumatic brain injury by facilitating system-level access to culturally secure rehabilitation services. Using a stepped-wedge randomised controlled trial (RCT) design (ACTRN12618000139279, 30/01/2018), a two-pronged intervention was introduced in four rural and four urban hospitals, comprising 1.Cultural security training (CST) for staff and 2.Training/employment of Aboriginal Brain Injury Coordinators (ABIC) to support Aboriginal patients for 6-months post-injury. Three-quarters of recruited patients lived rurally. The main outcome measure was quality-of-life, with secondary outcomes including functional measures, minimum processes of care (MPC); number rehabilitation occasions of service received, and improved hospital experience. Assessments were undertaken at baseline, 12- and 26-weeks post-injury. Only MPCs and hospital experience were found to improve among intervention patients. We report on the process evaluation aiming to support interpretation and translation of results. METHODS: Using mixed methods, the evaluation design was informed by the Consolidated Framework for Implementation Research. Data sources included minutes, project logs, surveys, semi-structured interviews, and observations. Four evaluation questions provided a basis for systematic determination of the quality of the trial. Findings from separate sources were combined to synthesise the emerging themes that addressed the evaluation questions. Three components were considered separately: the trial process, CST and ABIC. RESULTS: The complex HRW trial was implemented to a satisfactory level despite challenging setting factors, particularly rural-urban system dynamics. Patient recruitment constraints could not be overcome. The vulnerability of stepped-wedge designs to time effects influenced recruitment and trial results, due to COVID. Despite relatively high follow-up, including to rural/remote areas, data points were reduced. The lack of culturally appropriate assessment tools influenced the quality/completeness of assessment data. The ABIC role was deemed feasible and well-received. The CST involved complex logistics, but rated highly although online components were often incomplete. Project management was responsive to staff, patients and setting factors. CONCLUSIONS: Despite mostly equivocal results, the ABIC role was feasible within mainstream hospitals and the CST was highly valued. Learnings will help build robust state-wide models of culturally secure rehabilitation for Aboriginal people after brain injury, including MPC, workforce, training and follow-up.

Process evaluation of an mHealth-based school education program to reduce salt intake scaling up in China (EduSaltS): a mixed methods study using the RE-AIM framework.

BACKGROUND: An mHealth-based school health education platform (EduSaltS) was promoted in real-world China to reduce salt intake among children and their families. This progress evaluation explores its implementation process and influencing factors using mixed methods. METHODS: The mixed-methods process evaluation employed the RE-AIM framework. Quantitative data were collected from a management website monitoring 54,435 third-grade students across two cities. Questionnaire surveys (n = 27,542) assessed pre- and post-education effectiveness. Mixed-effects models were used to control cluster effects. Qualitative interviews (23 individuals and 8 focus groups) identified program performance, facilitators, and barriers. Findings were triangulated using the RE-AIM framework. RESULTS: The program achieved 100% participation among all the third-grade classes of the 208 invited primary schools, with a 97.7% registration rate among all the 54,435 families, indicating high "Reach." Qualitative interviews revealed positive engagement from children and parents through the "small hands leading big hands" strategy. The high completion rate of 84.9% for each health cloud lesson and the significant improvement in salt reduction knowledge and behaviors scores from 75.0 (95%CI: 74.7-75.3) to 80.9 (95%CI: 80.6-81.2) out of 100 demonstrated the "Effect" of EduSaltS. The program's "Adoption" and "Implementation" were supported by attractive materials, reduced workload via auto-delivered lessons/activities and performance evaluation, and high fidelity to recommended activities, with medians 3.0 (IQR: 2.0-8.0)/class and 9.0 (IQR: 5.0-14.0)/school. Stable course completion rates (79.4%-93.4%) over one year indicated promising "Maintenance." Apart from the facilitating features praised by the interviewees, government support was the basis for the scaling up of EduSaltS. Barriers included the lack of smartphone skills among some parents and competing priorities for schools. Unhealthy off-campus environments, such as excessive use of salt in pre-packaged and restaurant foods, also hindered salt reduction efforts. The program's scalability was evident through its integration into existing health education, engagement of local governments and adaptation across various mobile devices. CONCLUSIONS: The mHealth-based school health education program is scalable and effective for public salt reduction in China. Identified barriers and facilitators can inform future health program scale-ups. The program's successful implementation demonstrates its potential for broader application in public health initiatives aimed at reducing dietary salt intake.

Rapid qualitative analysis of recruitment obstacles in the FORVAD (Posterior Cervical Foraminotomy surgery versus Anterior Cervical Discectomy surgery in the treatment of cervical brachialgia) randomised, controlled trial.

BACKGROUND: The number of surgical trials is increasing but such trials can be complex to deliver and pose specific challenges. A multi-centre, Phase III, RCT comparing Posterior Cervical Foraminotomy versus Anterior Cervical Discectomy and Fusion in the Treatment of Cervical Brachialgia (FORVAD Trial) was unable to recruit to target. A rapid qualitative study was conducted during trial closedown to understand the experiences of healthcare professionals who participated in the FORVAD Trial, with the aim of informing future research in this area. METHODS: Semi-structured interviews were conducted with 18 healthcare professionals who had participated in the FORVAD Trial. Interviews explored participants' experiences of the FORVAD trial. A rapid qualitative analysis was conducted, informed by Normalisation Process Theory. RESULTS: Four main themes were generated in the data analysis: (1) individual vs. community equipoise; (2) trial set-up and delivery; (3) identifying and approaching patients; and (4) timing of randomisation. The objectives of the FORVAD trial made sense to participants and they supported the idea that there was clinical or collective equipoise regarding the two FORVAD interventions; however, many surgeons had treatment preferences and lacked individual equipoise. The site which had most recruitment success had adopted a more structured process for identification and recruitment of patients, whereas other sites that adopted more "ad hoc" screening strategies struggled to identify patients. Randomisation on the day of surgery caused both medico-legal and practical concerns at some sites. CONCLUSIONS: Organisation and implementation of a surgical trial in neurosurgery is complex and presents many challenges. Sites often reported low recruitment and discussed the logistical issues of conducting a complex surgical RCT. Future trials in neurosurgery may need to offer more flexibility and time during set-up to maximise opportunities for larger recruitment numbers. Rapid qualitative analysis informed by Normalisation Process Theory was able to quickly identify key issues with trial implementation so rapid qualitative analysis may be a useful approach for teams conducting qualitative research in trials. TRIAL REGISTRATION: ISRCTN, ISRCTN reference: 10,133,661. Registered 23rd November 2018.

Protocol for a pilot cluster randomised controlled trial of PRoGRAM-A (preventing gambling-related harm in adolescents): a secondary school-based social network intervention.

BACKGROUND: In the UK, recent evidence of young people and gambling indicates a higher prevalence of gambling in comparison to other addictive behaviours. Engaging in gambling-related behaviour at a young age is associated with short and long-term consequences, including financial, emotional, academic, interpersonal, and physical and mental health detriments; otherwise known as gambling-related harms (GRH). Given the unique vulnerability of this younger group, early interventions aimed at delaying or preventing gambling are critical. PRoGRAM-A (Preventing Gambling-Related Harm in Adolescents) is a school-based, social network intervention to protect young people from future GRH, by delaying or preventing gambling experimentation. METHODS: Pilot cluster RCT with an embedded process evaluation and health economic scoping study. PARTICIPANTS: PRoGRAM-A will be delivered in four schools, with two control schools acting as a comparator. All are secondary schools in Scotland. Baseline surveys were conducted with students in S3 (ages 13-14). Follow-up surveys were conducted with the same cohort, six months post-baseline. INTERVENTION: PRoGRAM-A trainers will deliver a 2-day, out-of-school training workshop to Peer supporters. Peer supporters will be nominated by peers among their school year group (S3, age 13-14). Workshops will provide peer supporters with information on four gambling-related topics: (1) what is gambling? (2) gambling and gaming, (3) gambling marketing, (4) identifying harm and reducing risk. Peer supporters will disseminate the information (message diffusion) they have learned among their friends and family over a 10-week period. After the 2-day workshop, PRoGRAM-A trainers will conduct × 3 in-school follow-up sessions with peer supporters to offer support, encouragement, and advice to Peer Supporters as well as monitor and explore the extent of their message diffusion. PRIMARY OUTCOME: The primary outcome of the pilot cluster RCT (cRCT) will be whether progression to a phase III RCT is justified. DISCUSSION: This will be the first pilot cluster RCT (cRCT) of an intervention to prevent gambling-related harms among young people within the UK. If findings indicate feasibility and acceptability, funding will be sought for a phase III RCT of effectiveness. TRIAL REGISTRATION: Researchregistry8699. Registered 21st February 2023.

Implementing workplace health promotion in nursing - A process evaluation in different care settings.

OBJECTIVE: Workplace health promotion (WHP) in Germany is receiving increasing support from health insurance funds. Nevertheless, there is hardly any knowledge on the process of how health outcomes are achieved, especially in nursing. The aim of the study was to find out how and what can be implemented in different care settings and to examine the reactions and interactions of the participants under routine conditions. METHODS: Guided by a logic model, a holistic WHP approach was implemented in four acute care hospitals, seven inpatient care facilities and four outpatient care services from April 2021 to October 2022. Data on realized WHP interventions, participant assessment and topics of work design was collected and analyzed descriptively. RESULTS: The realized WHP interventions were adapted depending on the content and context. Mainly short relaxation interventions were delivered or those with an event character were received by participants. The highest participation rate of planned participants was achieved in team building training. Participants predominantly assessed WHP interventions as useful, the quality as (very) good and were generally (very) satisfied with the intervention components. For work design topics, intentions for the design of work organization were mainly documented in action plans. CONCLUSION: Cooperation with practitioners in research should be continued as a contribution to quality development. This could provide suggestions as to which content adjustments lead to greater acceptance by the target group in a specific context. TRIAL REGISTRATION: The project was registered in the German Clinical Trial Register (DRKS00024961, 2021/04/09).

Experiences with implementing advance care planning (ACP-GP) in Belgian general practice in the context of a cluster RCT: a process evaluation using the RE-AIM framework.

BACKGROUND: General practice is often recommended as an ideal setting to initiate advance care planning (ACP), but uptake of ACP in this setting is low. ACP-GP is a complex intervention to facilitate ACP for patients with chronic, life-limiting illness in Belgian general practice. It aims to increase patient ACP engagement and general practitioner (GP) ACP self-efficacy. In a cluster-randomized controlled trial, the intervention was not superior to control in increasing these outcomes. A parallel process evaluation aimed to enhance understanding of how the intervention was implemented, and which factors might have influenced trial results. METHODS: We conducted a mixed-methods process evaluation following the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework. Data sources include recruitment and implementation monitoring, questionnaires for patients and GPs, and semi-structured (focus group) interviews with patients and GPs. Questionnaire data were analyzed descriptively. Qualitative data were first analyzed inductively; themes were then assigned deductively to RE-AIM dimensions. RESULTS: Thirty-five GPs and 95 patients were recruited to the trial; GP reach was low. Sixteen GPs and 46 patients provided questionnaire data at 3 months post-baseline; qualitative data were transcribed for 14 GPs and 11 patients. Adoption of intervention components was moderate to good, with the exception of the documentation template for GPs. Interviews revealed varying patient attitudes towards ACP, but patients nonetheless emphasized that conversations made them feel reassured. GPs especially valued a positive framing of ACP. When adopted, the intervention was well-implemented and participant satisfaction was high. However, intention for maintenance was moderate, with GPs raising questions of how to sustainably implement ACP conversations in the future. CONCLUSIONS: Implementing the complex ACP-GP intervention in general practice is feasible, and can be successful. However, the implementation process is challenging and the sustainability is suboptimal. Our findings will guide future research and recommendations for facilitating and implementing ACP in general practice. TRIAL REGISTRATION: ISRCTN12995230; prospectively registered on 19/06/2020.

Process evaluation of a parenting intervention for pre-schoolers with intellectual disabilities who display behaviours that challenge in the UK.

BACKGROUND: Stepping Stones Triple P (SSTP) is a complex parent-mediated intervention aimed to reduce behaviours that challenge in children with moderate to severe intellectual disabilities, aged 30-59 months. METHODS: To formulate a comprehensive understanding of SSTP implementation in the UK, we conducted a process evaluation collecting stakeholder views and considering intervention fidelity, dose, reach, delivery adaptations, and acceptability. RESULTS: Fidelity and quality of delivery ratings were high. Parents perceived SSTP as valuable, reporting increased parental confidence and understanding of the child's behaviours. However, only 30% of families received an adequate dose of the intervention. Parents who only received treatment as usual described feeling abandoned by current services. Service managers emphasised the importance of availability of resources and therapist training for successful intervention delivery. CONCLUSIONS: SSTP supports effective management of early-onset behaviours that challenge. Further work is needed to ensure equitable access to the intervention across health and social care services. TRIAL REGISTRATION: NCT03086876 - https://www. CLINICALTRIALS: gov/ct2/show/NCT03086876?term=Hassiotis+Angela&draw=1&rank=1.

Optimizing short-term in-class process evaluation: analyzing the effectiveness of teaching interventions in pharmaceutical education using repeated measures analysis.

BACKGROUND: The assessment of the effectiveness of teaching interventions in enhancing students' understanding of the Pharmaceutical Care Network Europe (PCNE) Classification System is crucial in pharmaceutical education. This is especially true in regions like China, where the integration of the PCNE system into undergraduate teaching is limited, despite its recognized benefits in addressing drug-related problems in clinical pharmacy practice. Therefore, this study aimed to evaluate the effectiveness of teaching interventions in improving students' understanding of the PCNE Classification System in pharmaceutical education. METHODS: Undergraduate pharmacy students participated in a series of sessions focused on the PCNE system, including lectures (t1), case analyses (t2), and practical implementation (t3). The levels of understanding were evaluated using time-course questionnaires. Initially, paired samples t-Tests were used to compare understanding levels between different time points. Subsequently, Repeated Measures Analysis (RMA) was employed. Pearson correlation analysis was conducted to examine the relationship between understanding levels and the usability and likelihood of using the PCNE system, as reported in the questionnaires. RESULTS: The paired samples t-Tests indicated insignificant differences between t2 and t3, suggesting limited improvement following the practical implementation of the PCNE system. However, RMA revealed significant time effects on understanding levels in effective respondents and the focused subgroup without prior experience (random intercept models: all p < 0.001; random slope models: all p < 0.001). These results confirmed the effectiveness of all three teaching interventions. Pearson correlation analysis demonstrated significant positive correlations between understanding levels and the usability and likelihood of using the PCNE system at all examined time points. This finding highlighted the reliability of the understanding levels reported in the questionnaires. The homework scores were used as external calibration standards, providing robust external validation of the questionnaire's validity. CONCLUSION: The implementation of RMA provided robust evidence of the positive impact of time on understanding levels. This affirmed the effectiveness of all teaching interventions in enhancing students' comprehension of the PCNE Classification System. By utilizing RMA, potential errors inherent in common statistical methods, such as t-Tests, were mitigated. This ensured a more comprehensive and accurate assessment of the effectiveness of the teaching interventions.

An Artificial Intelligence-Based App for Self-Management of Low Back and Neck Pain in Specialist Care: Process Evaluation From a Randomized Clinical Trial.

BACKGROUND: Self-management is endorsed in clinical practice guidelines for the care of musculoskeletal pain. In a randomized clinical trial, we tested the effectiveness of an artificial intelligence-based self-management app (selfBACK) as an adjunct to usual care for patients with low back and neck pain referred to specialist care. OBJECTIVE: This study is a process evaluation aiming to explore patients' engagement and experiences with the selfBACK app and specialist health care practitioners' views on adopting digital self-management tools in their clinical practice. METHODS: App usage analytics in the first 12 weeks were used to explore patients' engagement with the SELFBACK app. Among the 99 patients allocated to the SELFBACK interventions, a purposive sample of 11 patients (aged 27-75 years, 8 female) was selected for semistructured individual interviews based on app usage. Two focus group interviews were conducted with specialist health care practitioners (n=9). Interviews were analyzed using thematic analysis. RESULTS: Nearly one-third of patients never accessed the app, and one-third were low users. Three themes were identified from interviews with patients and health care practitioners: (1) overall impression of the app, where patients discussed the interface and content of the app, reported on usability issues, and described their app usage; (2) perceived value of the app, where patients and health care practitioners described the primary value of the app and its potential to supplement usual care; and (3) suggestions for future use, where patients and health care practitioners addressed aspects they believed would determine acceptance. CONCLUSIONS: Although the app's uptake was relatively low, both patients and health care practitioners had a positive opinion about adopting an app-based self-management intervention for low back and neck pain as an add-on to usual care. Both described that the app could reassure patients by providing trustworthy information, thus empowering them to take actions on their own. Factors influencing app acceptance and engagement, such as content relevance, tailoring, trust, and usability properties, were identified. TRIAL REGISTRATION: ClinicalTrials.gov NCT04463043; https://clinicaltrials.gov/study/NCT04463043.

Feasibility of an implementation strategy for preventing falls in homecare services.

BACKGROUND: Falls among older adults represent a major health hazard across the world. In 2022, the World Falls Guidelines was published, summarising research evidence and expert recommendations on how to prevent falls, but we need more knowledge on how the evidence can be successfully implemented into routine practice. In this study we used an implementation strategy co-created by healthcare providers, older adults who had fallen and researchers, to facilitate uptake of fall prevention recommendations. This current study aimed to evaluate the feasibility of this co-created implementation strategy in homecare services and provide information on the intervention and measurements for a full-scale cluster-randomized trial. METHODS: This study was a single-armed feasibility study with an embedded mixed-method approach completed in two city districts of Oslo, Norway, over a period of ten weeks. The co-created implementation strategy consists of a package for implementing national recommendations for preventing falls, empowering leaders to facilitate implementation, establish implementation teams, competence improvement and implementation support. City districts established implementation teams who were responsible for the implementation. Feasibility was assessed both qualitatively and quantitatively, using focus group interviews with implementation team members and individual interviews with leaders and staff members and the Feasibility of Intervention Measure (FIM). Qualitative data were analysed using thematic analysis and the Normalisation Process Theory. RESULTS: Qualitative data were collected from 19 participants: 12 implementation team members, 2 leaders and 5 staff members. 8 of the implementation team members responded to FIM. The analysis revealed four themes: 1) Fostering consensus through tailored implementation and discussions on fall prevention, 2) The importance of multi-level and interdisciplinary collaboration in fall prevention implementation, 3) Minimizing perceived time usage through utilization of existing areas for implementation activities, and 4) Reflective monitoring demonstrates the importance of facilitation and structure in the implementation strategy. For FIM, there were a high level of agreement related to how implementable, possible, doable, and easy to use the implementation strategy was. CONCLUSIONS: Overall, we found the implementation strategy to be feasible to enhance uptake of fall prevention recommendations in the Norwegian homecare services. To succeed with the implementation, a dedicated implementation team should receive support through the implementation process, they should choose small implementation activities to enhance fall prevention competence and managers should possess implementation knowledge. TRIAL REGISTRATION: The trial is registered in the Open Science Registry: https://doi.org/10.17605/OSF.IO/2JFHV Registered: January 11, 2023.

Process evaluation of the implementation of the assessment of burden of chronic conditions tool in Dutch primary care - lessons from a qualitative implementation study.

BACKGROUND: The Assessment of Burden of Chronic Conditions (ABCC-)tool is developed to facilitate a personalized approach to care in the patient-healthcare provider (HCP) conversation based on shared decision-making and individualized care plans. An effectiveness study highlighted its effect on the perceived quality of care and patient activation. Successful implementation of novel interventions necessitates an understanding of the user's actual application, user experiences and an evaluation of implementation outcomes. This study aims to evaluate the implementation of the ABCC-tool by HCPs in Dutch primary care. METHODS: This study is the process evaluation of a larger type 1 effectiveness-implementation hybrid trial. Semi-structured interviews with HCPs, who were interventionists in the hybrid trial, were held at three and twelve months after they started using the ABCC-tool. The Reach-Effectiveness-Adoption-Implementation-Maintenance (RE-AIM) framework was used to evaluate implementation outcomes. The Implementation domain was further strengthened with an evaluation of implementation fidelity using Carroll's framework. Inductive coding and thematic analysis were applied to identify relevant participant experiences and implementation outcomes within the RE-AIM framework. RESULTS: Seventeen HCPs (1 general practitioner, 16 practice nurses) participated in the study, representing 39% of potentially eligible participants. Most HCPs applied the tool after finishing their own routines instead of how it is intended to be used, namely from the beginning of the consultation. HCPs reached 2-6 patients. The ABCC-tool was initially adopted, but twelve HCPs stopped using the tool due to COVID-19 related cancellation of consultations. High fidelity was found for applying the questionnaire and visualization. Low fidelity was present for applying shared decision-making, formulating care goals and monitoring progress. HCPs indicated that maintaning the ABCC-tool depended on accompanying training and implementation support. CONCLUSIONS: HCPs applied the ABCC-tool critically different from intended, potentially diminishing its benefits and ease of use. This evaluation stresses the need for a tailored implementation plan that includes more detailed training and guidance on how and when to use the ABCC-tool.

Acceptability of Four Intervention Components Supporting Medication Adherence in Women with Breast Cancer: a Process Evaluation of a Fractional Factorial Pilot Optimization Trial.

Adjuvant endocrine therapy (AET) reduces mortality in early-stage breast cancer, but adherence is low. We developed a multicomponent intervention to support AET adherence comprising: text messages, information leaflet, acceptance and commitment therapy (ACT), and side-effect website. Guided by the multiphase optimization strategy, the intervention components were tested in the ROSETA pilot optimization trial. Our mixed-methods process evaluation investigated component acceptability. The pilot optimization trial used a 24-1 fractional factorial design. Fifty-two women prescribed AET were randomized to one of eight experimental conditions, containing unique component combinations. An acceptability questionnaire was administered 4 months post-randomization, and semi-structured interviews with 20 participants further explored acceptability. Assessments were guided by four constructs of the theoretical framework of acceptability: affective attitude, burden, perceived effectiveness, and coherence. Quantitative and qualitative findings were triangulated to identify agreements/disagreements. There were high overall acceptability scores (median = 14-15/20, range = 11-20). There was agreement between the qualitative and quantitative findings when triangulated. Most participants "liked" or "strongly liked" all components and reported they required low effort to engage in. Between 50% (leaflet) and 65% (SMS) "agreed" or "strongly agreed," it was clear how each component would help adherence. Perceived effectiveness was mixed, with 35.0% (text messages) to 55.6% (ACT) of participants "agreeing" or "strongly agreeing" that each component would improve their adherence. Interview data provided suggestions for improvements. The four components were acceptable to women with breast cancer and will be refined. Mixed-methods and triangulation were useful methodological approaches and could be applied in other optimization trial process evaluations.

Implementation of a fluid balance control strategy in critically ill patients: POINCARE-2 trial process evaluation.

BACKGROUND: POINCARE-2 trial aimed to assess the effectiveness of a strategy designed to tackle fluid overload through daily weighing and subsequent administration of treatments in critically ill patients. Even in highly standardized care settings, such as intensive care units, effectiveness of such a complex intervention depends on its actual efficacy but also on the extent of its implementation. Using a process evaluation, we aimed to provide understanding of the implementation, context, and mechanisms of change of POINCARE-2 strategy during the trial, to gain insight on its effectiveness and inform the decision regarding the dissemination of the intervention. METHODS: We conducted a mixed-method process evaluation following the Medical Research Council guideline. Both quantitative data derived from the trial, and qualitative data from semi-structured interviews with professionals were used to explain implementation, mechanisms of change of the POINCARE-2 strategy, as well as contextual factors potentially influencing implementation of the strategy. RESULTS: Score of actual exposure to the strategy ranged from 29.1 to 68.2% during the control period, and from 61.9 to 92.3% during the intervention period, suggesting both potential contamination and suboptimal fidelity to the strategy. Lack of appropriate weighing devices, lack of human resources dedicated to research, pre-trial rooted prescription habits, and anticipated knowledge of the strategy have been identified as the main barriers to optimal implementation of the strategy in the trial context. CONCLUSIONS: Both contamination and suboptimal fidelity to POINCARE-2 strategy raised concerns about a potential bias towards the null of intention-to-treat (ITT) analyses. However, optimal fidelity seemed reachable. Consequently, a clinical strategy should not be rejected solely on the basis of the negativity of ITT analyses' results. Our findings showed that, even in highly standardized care conditions, the implementation of clinical strategies may be hindered by numerous contextual factors, which demonstrates the critical importance of assessing the viability of an intervention, prior to any evaluation of its effectiveness. TRIAL REGISTRATION: Number NCT02765009.

Process evaluation of comprehensive sexuality education programme in Zambia: a focus on contextual factors, mechanisms of impact, quality of development and implementation process.

BACKGROUND: Comprehensive sexuality education (CSE) is critical in addressing negative sexual and reproductive health (SRH) outcomes among adolescents. Yet in many low- and middle-income countries (LMICs) including Zambia, little is known about the impact, realities of CSE implementation, the quality of teaching and the comprehensiveness of the content covered. METHODS: Our approach was informed by a process evaluation incorporating recommendations by the European Expert Group guidance on evaluating sexuality education programmes and the Medical Research Council (MRC) guidelines on process evaluation. The development process and quality of CSE implementation were assessed using eight and six quality criteria respectively. In-depth interviews (IDIs), focus group discussions (FGDs), document analysis and classroom observation were employed to assess contextual factors, implementation process and mechanisms of impact of CSE. In-depth interviews (50) and focus group discussions (2) with seven pupils in each group were conducted among 64 purposefully selected participants. The sample comprised pupils (35), parents (4) and teachers (17) from nine secondary schools (four peri-urban, four urban and one rural), policymakers (4), and religious leaders (4). We employed deductive content analysis to analyse the data. RESULTS: Contextual factors that influenced the implementation of CSE included: (1) piecemeal funding for the CSE programme; (2) lack of monitoring programmes in schools; (3) lack of community engagement; (4) religious and socio-cultural barriers; (5) lack of skills and competency to teach CSE; and (6) insufficient time allocation for CSE. The assessment of the quality of the development of CSE revealed: (1) a lack of sexual diversity; (2) no meaningful participation of pupils in programme implementation; (3) a lack of stakeholder engagement during programme implementation; (4)  lack of gender sensitivity; and (5) lack of human rights approach. Assessment of the quality of the implementation of CSE revealed: (1) no evidence of skill-based CSE teaching; (2) no linkage between CSE and SRH services in the communities; and (3) a lack of incorporation of multiple delivery methods during CSE teaching. The mechanisms of impact of CSE were related to the acceptability and positive changes in pupils' SRH practices. CONCLUSION: The complex influences of contextual factors during CSE implementation highlight the need for contextual analysis during the interventional design. Co-creation of the CSE programme through stakeholder participation could reduce social opposition and enable a culturally sensitive CSE. Comprehensive teacher training, a guiding curriculum as well as setting of appropriate monitoring tools and indicators are likely to enhance the quality of CSE implementation.