The Evaluation of the GET.ON Nationwide Web-Only Treatment Service for Depression- and Stress-Related Symptoms: Naturalistic Trial.

BACKGROUND: GET.ON (HelloBetter) treatment interventions have been shown to be efficacious in multiple randomized controlled trials. OBJECTIVE: This study evaluated the effectiveness of 2 GET.ON interventions, GET.ON Mood Enhancer and GET.ON Stress, in a national digital mental health service implemented across Germany. METHODS: Following an initial web-based questionnaire, participants were allocated to either intervention based on their baseline symptom severity and personal choice and received a semistandardized guided, feedback-on-demand guided, or self-guided version of the treatment. Uncontrolled routine care data from 851 participants were analyzed using a pretest-posttest design. Half of the participants (461/851, 54.2%) were allocated to the stress intervention (189/461, 41% semistandardized; 240/461, 52% feedback on demand; and 32/461, 6.9% self-guided), and almost all participants in the mood intervention (349/352, 99.2%) received semistandardized guidance. RESULTS: Results on depression-related symptom severity indicated a reduction in reported symptoms, with a large effect size of d=-0.92 (95% CI -1.21 to -0.63). Results on perceived stress and insomnia indicated a reduction in symptom severity, with large effect sizes of d=1.02 (95% CI -1.46 to -0.58) and d=-0.75 (95% CI -1.10 to -0.40), respectively. A small percentage of participants experienced deterioration in depression-related symptoms (11/289, 3.8%), perceived stress (6/296, 2%), and insomnia (5/252, 2%). After completing treatment, 51.9% (150/289) of participants showed a clinically reliable change in depression-related symptoms, whereas 20.4% (59/289) achieved a close to symptom-free status. Similar improvements were observed in perceived stress and insomnia severity. Guidance moderated the effectiveness of and adherence to the interventions in reducing depressive symptom severity. Effect sizes on depression-related symptom severity were d=-1.20 (95% CI -1.45 to -0.93) for the semistandardized group, d=-0.36 (95% CI -0.68 to -0.04) for the feedback-on-demand group, and d=-0.83 (95% CI -1.03 to -0.63) for the self-guided group. Furthermore, 47.6% (405/851) of the participants completed all modules of the intervention. Participant satisfaction was high across all patient groups and both interventions; 89.3% (242/271) of participants would recommend it to a friend in need of similar help. Limitations include the assignment to treatments and guidance formats based on symptom severity. Furthermore, part of the differences in symptom change between groups must be assumed to be due to this baseline difference in the measures. CONCLUSIONS: Future digital health implementation and routine care research should focus on monitoring symptom deterioration and other negative effects, as well as possible predictors of deterioration and the investigation of individual patient trajectories. In conclusion, this study supports the effectiveness of tailored digital mental health services in routine care for depression- and stress-related symptoms in Germany. The results highlight the importance of guidance in delivering internet-based cognitive behavioral therapy interventions and provide further evidence for its potential delivered as web-only solutions for increasing access to and use of psychological treatments.

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial.

BACKGROUND: Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary. OBJECTIVE: This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia. METHODS: A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit. RESULTS: In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it. CONCLUSIONS: The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice. TRIAL REGISTRATION: ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.1186/s13063-020-04686-4.

Online consultations in mental healthcare during the COVID-19 outbreak: An international survey study on professionals' motivations and perceived barriers.

INTRODUCTION: While the general uptake of e-mental health interventions remained low over the past years, physical distancing and lockdown measures relating to the COVID-19 pandemic created a need and demand for online consultations in only a matter of weeks. OBJECTIVE: This study investigates the uptake of online consultations provided by mental health professionals during lockdown measures in the first wave of the COVID-19 pandemic in the participating countries, with a specific focus on professionals' motivations and perceived barriers regarding online consultations. METHODS: An online survey on the use of online consultations was set up in March 2020. The Unified Theory of Acceptance and Use of Technology (UTAUT) guided the deductive qualitative analysis of the results. RESULTS: In total, 2082 mental health professionals from Austria, Belgium, Cyprus, France, Germany, Italy, Lebanon, Lithuania, the Netherlands, Norway, Portugal, Spain, and Sweden were included. The results showed a high uptake of online consultations during the COVID-19 pandemic but limited previous training on this topic undergone by mental health professionals. Most professionals reported positive experiences with online consultations, but concerns about the performance of online consultations in a mental health context (e.g., in terms of relational aspects) and practical considerations (e.g., relating to privacy and security of software) appear to be major barriers that hinder implementation. CONCLUSIONS: This study provides an overview of the mental health professionals' actual needs and concerns regarding the use of online consultations in order to highlight areas of possible intervention and allow the implementation of necessary governmental, educational, and instrumental support so that online consultations can become a feasible and stable option in mental healthcare.

Guided Internet-Based Cognitive Behavioral Therapy for Depression: Implementation Cost-Effectiveness Study.

BACKGROUND: Major depressive disorder is a chronic condition; its prevalence is expected to grow with the aging trend of high-income countries. Internet-based cognitive-behavioral therapy has proven efficacy in treating major depressive disorder. OBJECTIVE: The objective of this study was to assess the cost-effectiveness of implementing a community internet-based cognitive behavioral therapy intervention (Super@, the Spanish program for the MasterMind project) for treating major depressive disorder. METHODS: The cost-effectiveness of the Super@ program was assessed with the Monitoring and Assessment Framework for the European Innovation Partnership on Active and Healthy Ageing tool, using a 3-state Markov model. Data from the cost and effectiveness of the intervention were prospectively collected from the implementation of the program by a health care provider in Badalona, Spain; the corresponding data for usual care were gathered from the literature. The health states, transition probabilities, and utilities were computed using Patient Health Questionnaire-9 scores. RESULTS: The analysis was performed using data from 229 participants using the Super@ program. Results showed that the intervention was more costly than usual care; the discounted (3%) and nondiscounted incremental cost-effectiveness ratios were €29,367 and €26,484 per quality-adjusted life-year, respectively (approximately US $35,299 and $31,833, respectively). The intervention was cost-effective based on the €30,000 willingness-to-pay threshold typically applied in Spain (equivalent to approximately $36,060). According to the deterministic sensitivity analyses, the potential reduction of costs associated with intervention scale-up would reduce the incremental cost-effectiveness ratio of the intervention, although it remained more costly than usual care. A discount in the incremental effects up to 5% exceeded the willingness-to-pay threshold of €30,000. CONCLUSIONS: The Super@ program, an internet-based cognitive behavioral therapy intervention for treating major depressive disorder, cost more than treatment as usual. Nevertheless, its implementation in Spain would be cost-effective from health care and societal perspectives, given the willingness-to-pay threshold of €30,000 compared with treatment as usual.

Effects of Internet-Based Cognitive Behavioral Therapy in Routine Care for Adults in Treatment for Depression and Anxiety: Systematic Review and Meta-Analysis.

BACKGROUND: Although there is evidence for the efficacy of internet-based cognitive behavioral therapy (iCBT), the generalizability of results to routine care is limited. OBJECTIVE: This study systematically reviews effectiveness studies of guided iCBT interventions for the treatment of depression or anxiety. METHODS: The acceptability (uptake, participants' characteristics, adherence, and satisfaction), effectiveness, and negative effects (deterioration) of nonrandomized pre-post designs conducted under routine care conditions were synthesized using systematic review and meta-analytic approaches. RESULTS: A total of 19 studies including 30 groups were included in the analysis. Despite high heterogeneity, individual effect sizes of investigated studies indicate clinically relevant changes, with effect sizes ranging from Hedges' g=0.42-1.88, with a pooled effect of 1.78 for depression and 0.94 for anxiety studies. Uptake, participants' characteristics, adherence, and satisfaction indicate a moderate to high acceptability of the interventions. The average deterioration across studies was 2.9%. CONCLUSIONS: This study provides evidence supporting the acceptability and effectiveness of guided iCBT for the treatment of depression and anxiety in routine care. Given the high heterogeneity between interventions and contexts, health care providers should select interventions that have been proven in randomized controlled clinical trials. The successful application of iCBT may be an effective way of increasing health care in multiple contexts.

Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis.

BACKGROUND: The System Usability Scale (SUS) is used to measure usability of internet-based Cognitive Behavioural Therapy (iCBT). However, whether the SUS is a valid instrument to measure usability in this context is unclear. The aim of this study is to assess the factor structure of the SUS, measuring usability of iCBT for depression in a sample of professionals. In addition, the psychometric properties (reliability, convergent validity) of the SUS were tested. METHODS: A sample of 242 professionals using iCBT for depression from 6 European countries completed the SUS. Confirmatory Factor Analysis (CFA) was conducted to test whether a one-factor, two-factor, tone-model or bi-direct model would fit the data best. Reliability was assessed using complementary statistical indices (e.g. omega). To assess convergent validity, the SUS total score was correlated with an adapted Client Satisfaction Questionnaire (CSQ-3). RESULTS: CFA supported the one-factor, two-factor and tone-model, but the bi-factor model fitted the data best (Comparative Fit Index = 0.992, Tucker Lewis Index = 0.985, Root Mean Square Error of Approximation = 0.055, Standardized Root Mean Square Residual = 0.042 (respectively χ2diff (9) = 69.82, p < 0.001; χ2diff (8) = 33.04, p < 0.001). Reliability of the SUS was good (ω = 0.91). The total SUS score correlated moderately with the CSQ-3 (CSQ1 rs = .49, p < 0.001; CSQ2 rs = .46, p < 0.001; CSQ3 rs = .38, p < 0.001), indicating convergent validity. CONCLUSIONS: Although the SUS seems to have a multidimensional structure, the best model showed that the total sumscore of the SUS appears to be a valid and interpretable measure to assess the usability of internet-based interventions when used by professionals in mental healthcare.

Patient's experience with blended video- and internet based cognitive behavioural therapy service in routine care.

INTRODUCTION: Internet-based guided self-help and face-to-face CBT have shown to be effective in the treatment of depression, but both approaches might not be an available treatment option for all patients. A treatment which blends internet-based guided self-help with video-based psychotherapy might reduce potential disadvantages of both approaches, while maintaining major advantages such as being location-independent. Additionally, it could provide a stronger focus on patient empowerment and lower resource use compared to traditional face-to-face treatment. AIM: The aim of this study is to evaluate patient's experiences with blended internet- and video-based CBT (blended iCBT) treatment and to derive suggestions for the improvement of such services. METHODS: Semi-structured interviews were conducted with 15 participants of the blended iCBT treatment as part of the European MasterMind trial. Participants included adults suffering from Major Depressive Disorder. The interview guide assessed patient's experiences regarding the four treatment components program, 1. face-to-face diagnostic interviews, 2. video-based synchronous therapy sessions (VTS), 3. online self-help treatment modules (OTM) as well as 4. behaviour diaries and symptom monitoring. Interviews were analyzed using the framework method and outcomes regarding connections within and between participants and categories were generated by counting the statements within relevant themes. RESULTS: Overall, patients indicated to have been satisfied with all components of the treatment, highlighting the option to independently work from home in their own pace. While the OTMs allowed for a deeper reflection of the content, the VTS with the therapist were mentioned to provide the personal character of the service. The working alliance with the therapist was experienced as fostering the individual fit of the treatment. Patients reported a high self-perceived treatment effectiveness. Negative effects included that some patients felt overwhelmed by the service, e.g. by working with the content of the OTM as they forced them to address their problems. Within the combination of OTM and VTS, both components were rated as equally important and patients felt that the combination depicted a treatment at least equal to regular face-to-face treatment regarding the perceived effectiveness. Other identified themes included patient's individual factors, reactions in their social environment and suggestions for improvement of the service. DISCUSSION: Predominantly, patients reported positive experiences with the blended iCBT service and rate the treatment as adequate and effective to treat their condition. The importance of the VTS is highlighted. Following this approach might be an option to make affordable and effective evidence-based CBT available independent from regional barriers.