Towards an assessment of psychosocial work factors in a multi-level mental health intervention in the workplace: results from the MENTUPP pilot-study.

BACKGROUND: Mental health in the workplace is a growing concern for enterprises and policy makers. MENTUPP is a multi-level mental health intervention implemented in small and medium size enterprises from three work sectors in nine countries. This pilot study aimed to evaluate the feasibility, delivery, and instruments for the MENTUPP intervention to inform the planning of a clustered randomized controlled trial. METHODS: We administered items from the Copenhagen Psychosocial Questionnaire and the Danish Work Environment Cohort Study measuring psychosocial workplace factors. The questionnaire was answered by 382 participants at baseline, of which 98 participants also answered after six months at follow-up. We calculated mean scores of 19 psychosocial factors at baseline and conducted repeated measures ANOVAs to assess differences in eight psychosocial factors at follow-up. We also examined whether outcomes differed between work sectors and job positions at follow-up. RESULTS: The construction sector and workers with no or a lower leadership role reported more negative working environment factors at baseline. We observed a statistically significant decline in social support from colleagues and social community at work, and a marginally significant decline in justice at work. For the rest of the constructs, we did not observe statistically significant changes. CONCLUSIONS: We found significant differences in psychosocial work environment factors among work sectors and job positions at baseline. Contrary to our hypotheses, three psychosocial work environment factors decreased at follow-up. Possible explanations are the utilization of specific psychosocial factors as resources to cope with psychosocial stressors, high participant expectations that were not met by the intervention, insufficient time for structural changes, or the intervention prompting critical evaluations of the work environment. These findings will inform the design and implementation of the forthcoming clustered randomized controlled trial, where they will also be further investigated to validate their significance.

Outcome assessment of a complex mental health intervention in the workplace. Results from the MENTUPP pilot study.

OBJECTIVE: Multicomponent interventions are recommendable to achieve the greatest mental health benefits, but are difficult to evaluate due to their complexity. Defining long-term outcomes, arising from a Theory of Change (ToC) and testing them in a pilot phase, is a useful approach to plan a comprehensive and meaningful evaluation later on. This article reports on the pilot results of an outcome evaluation of a complex mental health intervention and examines whether appropriate evaluation measures and indicators have been selected ahead of a clustered randomised control trial (cRCT). METHODS: The MENTUPP pilot is an evidence-based intervention for Small and Medium Enterprises (SMEs) active in three work sectors and nine countries. Based on our ToC, we selected the MENTUPP long-term outcomes, which are reported in this article, are measured with seven validated scales assessing mental wellbeing, burnout, depression, anxiety, stigma towards depression and anxiety, absenteeism and presenteeism. The pilot MENTUPP intervention assessment took place at baseline and at 6 months follow-up. RESULTS: In total, 25 SMEs were recruited in the MENTUPP pilot and 346 participants completed the validated scales at baseline and 96 at follow-up. Three long-term outcomes significantly improved at follow-up (p < 0.05): mental wellbeing, symptoms of anxiety, and personal stigmatising attitudes towards depression and anxiety. CONCLUSIONS: The results of this outcome evaluation suggest that MENTUPP has the potential to strengthen employees' wellbeing and decrease anxiety symptoms and stigmatising attitudes. Additionally, this study demonstrates the utility of conducting pilot workplace interventions to assess whether appropriate measures and indicators have been selected. Based on the results, the intervention and the evaluation strategy have been optimised.

Developing a framework for evaluation: a Theory of Change for complex workplace mental health interventions.

BACKGROUND: There is a gap between the necessity of effective mental health interventions in the workplace and the availability of evidence-based information on how to evaluate them. The available evidence outlines that mental health interventions should follow integrated approaches combining multiple components related to different levels of change. However, there is a lack of robust studies on how to evaluate multicomponent workplace interventions which target a variety of outcomes at different levels taking into account the influence of different implementation contexts. METHOD: We use the MENTUPP project as a research context to develop a theory-driven approach to facilitate the evaluation of complex mental health interventions in occupational settings and to provide a comprehensive rationale of how these types of interventions are expected to achieve change. We used a participatory approach to develop a ToC involving a large number of the project team representing multiple academic backgrounds exploiting in tandem the knowledge from six systematic reviews and results from a survey among practitioners and academic experts in the field of mental health in SMEs. RESULTS: The ToC revealed four long-term outcomes that we assume MENTUPP can achieve in the workplace: 1) improved mental wellbeing and reduced burnout, 2) reduced mental illness, 3) reduced mental illness-related stigma, and 4) reduced productivity losses. They are assumed to be reached through six proximate and four intermediate outcomes according to a specific chronological order. The intervention consists of 23 components that were chosen based on specific rationales to achieve change on four levels (employee, team, leader, and organization). CONCLUSIONS: The ToC map provides a theory of how MENTUPP is expected to achieve its anticipated long-term outcomes through intermediate and proximate outcomes assessing alongside contextual factors which will facilitate the testing of hypotheses. Moreover, it allows for a structured approach to informing the future selection of outcomes and related evaluation measures in either subsequent iterations of complex interventions or other similarly structured programs. Hence, the resulting ToC can be employed by future research as an example for the development of a theoretical framework to evaluate complex mental health interventions in the workplace.

Promoting employee wellbeing and preventing non-clinical mental health problems in the workplace: a preparatory consultation survey.

BACKGROUND: Small and medium-sized enterprises (SMEs) face major financial losses due to mental health issues affecting employees at all levels but seldom apply programs to promote wellbeing and prevent mental health issues among employees. To support the development of a multi-country workplace-based mental health intervention for SMEs (MENTUPP), a multinational consultation study was conducted. The study aimed to examine the experiences and needs of SMEs concerning the promotion of employee wellbeing, and the prevention and management of non-clinical mental health problems in workplaces. METHODS: A survey consisting of open and closed questions was designed to assess key informants' opinion about the acceptability, the use, and the implementation of interventions to promote wellbeing and prevent mental health issues in the workplace. Academic experts and representatives of SME organisations, specific sector organisations, labour or advocacy groups, and occupational health organisations across the nine MENTUPP intervention countries (eight European countries and Australia) were invited to complete the survey. Data were collected via the online platform Qualtrics. Sixty-five of 146 informants responded, representing a 44.5% response rate. Descriptive statistics were used to analyse the quantitative data and qualitative data were analysed through thematic analysis. RESULTS: Measures to create mentally healthy workplaces were most used in SMEs, while more specific mental health interventions, such as training staff on how to promote wellbeing, were hardly used. Managers lack resources to implement mental health interventions and are concerned about employees spending too much time on these interventions during working hours. Receiving information about the economic benefits of mental health interventions and hearing successful testimonials from other SMEs can persuade managers otherwise. Employees have concerns about confidentiality, discrimination and stigma, and career opportunities when using such interventions. CONCLUSIONS: The study identifies a variety of challenges, needs and possibilities related to implementing mental health interventions in SMEs. Employers need to be convinced that investing in mental health in the workplace is worth their time and money. This requires more studies on the (cost-)effectiveness of mental health interventions. Once employers are engaged, their knowledge and competencies about how to implement such interventions should be increased and privacy concerns of employees to participate in them should be addressed.