Implementing a complex mental health intervention in occupational settings: process evaluation of the MENTUPP pilot study.

BACKGROUND: According to the Medical Research Council (MRC) framework, the theorisation of how multilevel, multicomponent interventions work and the understanding of their interaction with their implementation context are necessary to be able to evaluate them beyond their complexity. More research is needed to provide good examples following this approach in order to produce evidence-based information on implementation practices. OBJECTIVES: This article reports on the results of the process evaluation of a complex mental health intervention in small and medium enterprises (SMEs) tested through a pilot study. The overarching aim is to contribute to the evidence base related to the recruitment, engagement and implementation strategies of applied mental health interventions in the workplace. METHOD: The Mental Health Promotion and Intervention in Occupational Settings (MENTUPP) intervention was pilot tested in 25 SMEs in three work sectors and nine countries. The evaluation strategy of the pilot test relied on a mixed-methods approach combining qualitative and quantitative research methods. The process evaluation was inspired by the RE-AIM framework and the taxonomy of implementation outcomes suggested by Proctor and colleagues and focused on seven dimensions: reach, adoption, implementation, acceptability, appropriateness, feasibility and maintenance. RESULTS: Factors facilitating implementation included the variety of the provided materials, the support provided by the research officers (ROs) and the existence of a structured plan for implementation, among others. Main barriers to implementation were the difficulty of talking about mental health, familiarisation with technology, difficulty in fitting the intervention into the daily routine and restrictions caused by COVID-19. CONCLUSIONS: The results will be used to optimise the MENTUPP intervention and the theoretical framework that we developed to evaluate the causal mechanisms underlying MENTUPP. Conducting this systematic and comprehensive process evaluation contributes to the enhancement of the evidence base related to mental health interventions in the workplace and it can be used as a guide to overcome their contextual complexity. TRIAL REGISTRATION NUMBER: ISRCTN14582090.

Implementation and evaluation of a multi-level mental health promotion intervention for the workplace (MENTUPP): study protocol for a cluster randomised controlled trial.

BACKGROUND: Well-organised and managed workplaces can be a source of wellbeing. The construction, healthcare and information and communication technology sectors are characterised by work-related stressors (e.g. high workloads, tight deadlines) which are associated with poorer mental health and wellbeing. The MENTUPP intervention is a flexibly delivered, multi-level approach to supporting small- and medium-sized enterprises (SMEs) in creating mentally healthy workplaces. The online intervention is tailored to each sector and designed to support employees and leaders dealing with mental health difficulties (e.g. stress), clinical level anxiety and depression, and combatting mental health-related stigma. This paper presents the protocol for the cluster randomised controlled trial (cRCT) of the MENTUPP intervention in eight European countries and Australia. METHODS: Each intervention country will aim to recruit at least two SMEs in each of the three sectors. The design of the cRCT is based on the experiences of a pilot study and guided by a Theory of Change process that describes how the intervention is assumed to work. SMEs will be randomly assigned to the intervention or control conditions. The aim of the cRCT is to assess whether the MENTUPP intervention is effective in improving mental health and wellbeing (primary outcome) and reducing stigma, depression and suicidal behaviour (secondary outcome) in employees. The study will also involve a process and economic evaluation. CONCLUSIONS: At present, there is no known multi-level, tailored, flexible and accessible workplace-based intervention for the prevention of non-clinical and clinical symptoms of depression, anxiety and burnout, and the promotion of mental wellbeing. The results of this study will provide a comprehensive overview of the implementation and effectiveness of such an intervention in a variety of contexts, languages and cultures leading to the overall goal of delivering an evidence-based intervention for mental health in the workplace. TRIAL REGISTRATION: Please refer to Item 2a and registration ISRCTN14104664. Registered on 12th July 2022.

Outcome assessment of a complex mental health intervention in the workplace. Results from the MENTUPP pilot study.

OBJECTIVE: Multicomponent interventions are recommendable to achieve the greatest mental health benefits, but are difficult to evaluate due to their complexity. Defining long-term outcomes, arising from a Theory of Change (ToC) and testing them in a pilot phase, is a useful approach to plan a comprehensive and meaningful evaluation later on. This article reports on the pilot results of an outcome evaluation of a complex mental health intervention and examines whether appropriate evaluation measures and indicators have been selected ahead of a clustered randomised control trial (cRCT). METHODS: The MENTUPP pilot is an evidence-based intervention for Small and Medium Enterprises (SMEs) active in three work sectors and nine countries. Based on our ToC, we selected the MENTUPP long-term outcomes, which are reported in this article, are measured with seven validated scales assessing mental wellbeing, burnout, depression, anxiety, stigma towards depression and anxiety, absenteeism and presenteeism. The pilot MENTUPP intervention assessment took place at baseline and at 6 months follow-up. RESULTS: In total, 25 SMEs were recruited in the MENTUPP pilot and 346 participants completed the validated scales at baseline and 96 at follow-up. Three long-term outcomes significantly improved at follow-up (p < 0.05): mental wellbeing, symptoms of anxiety, and personal stigmatising attitudes towards depression and anxiety. CONCLUSIONS: The results of this outcome evaluation suggest that MENTUPP has the potential to strengthen employees' wellbeing and decrease anxiety symptoms and stigmatising attitudes. Additionally, this study demonstrates the utility of conducting pilot workplace interventions to assess whether appropriate measures and indicators have been selected. Based on the results, the intervention and the evaluation strategy have been optimised.

Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions.

BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace.

Evidence for the effectiveness of interventions to reduce mental health related stigma in the workplace: a systematic review.

OBJECTIVES: Increasing access to mental health support is a key factor for treating mental disorders, however, important barriers complicate help-seeking, among them, mental health related stigma being most prominent. We aimed to systematically review the current evidence for interventions focusing on reducing stigma related to mental health problems in small and medium enterprises (SMEs). DESIGN: Systematic review with a focus on interventions targeting mental health related stigma in the workplace in accordance with PRISMA guidelines. The methodological quality of included articles was assessed using the Quality Assessment Tool for Quantitative Studies Scale. DATA SOURCES: PubMed, Ovid Medline, PsycINFO, Scopus, and Cochrane databases and Google Scholar were searched from January 2010 until November 2022. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included experimental or quasi-experimental studies about workplace interventions aiming to reduce stigma, where the outcomes were measured in terms of stigmatisation against depression, anxiety and/or other mental health problems. DATA EXTRACTION AND SYNTHESIS: Records were screened by two independent reviewers after inspecting titles and abstracts and a full-text read of the articles to assess whether they meet inclusion criteria. The results were synthesised narratively. RESULTS: We identified 22 intervention studies, 3 with high quality, 13 with moderate quality and 6 with weak quality. Only 2 studies included SMEs, but no study focused on SMEs exclusively . The mode of delivery of the intervention was face to face in 15 studies, online in 4 studies and mixed in 3 studies. We found a significant reduction in stigmatising attitudes in almost all studies (20/22), using 10 different instruments/scales. Effects seemed to be independent of company size. Online interventions were found to be shorter, but seemed to be as effective as face-to-face interventions. CONCLUSIONS: Although we did not find interventions focusing exclusively on SMEs, it is likely that antistigma interventions also will work in smaller workplaces. TRIAL REGISTRATION: PROSPERO: ID: CRD42020191307.

Mental Health Promotion and Intervention in Occupational Settings: Protocol for a Pilot Study of the MENTUPP Intervention.

Depression and anxiety are the most prevalent mental health difficulties in the EU, causing immense suffering and costing the global economy EUR 1 trillion each year in lost productivity. Employees in construction, health and information and communications technology have an elevated risk of mental health difficulties. Most mental health interventions for the workplace have been targeted at larger companies and small and medium-sized enterprises (SMEs) are often overlooked despite most people being employed in SMEs. The MENTUPP intervention aims to improve mental health and wellbeing and reduce depression, anxiety, and suicidal behaviour. The MENTUPP project involves the development, implementation, and evaluation of a multilevel intervention targeting both clinical and non-clinical mental health issues and combating the stigma of mental (ill-)health, with a specific focus on SMEs. The intervention is underpinned by a framework of how to create a mentally healthy workplace by employing an integrated approach and has been informed by several systematic reviews designed to understand organisational mental health interventions and a consultation survey with key experts in the area. The intervention is facilitated through the MENTUPP Hub, an online platform that presents interactive psychoeducational materials, toolkits, and links to additional resources in an accessible and user-friendly manner. This paper presents the pilot study protocol for delivering the MENTUPP intervention in eight European countries and Australia. Each intervention country will aim to recruit at least 23 participants in 1-3 SMEs in one of the three high-risk sectors. The central aim of the pilot study will be to examine the feasibility, acceptability, and uptake of the MENTUPP intervention across the target SMEs. The findings will contribute to devising the protocol for a cluster randomised controlled trial (cRCT) of the MENTUPP intervention. Findings from this study will also be used to inform the optimisation phase of the MENTUPP intervention which will aim to improve the materials and the implementation of the intervention as well as enhancing the evaluation strategy which will be employed for the cRCT.