Methods for Human-Centered eHealth Development: Narrative Scoping Review.

BACKGROUND: Thorough holistic development of eHealth can contribute to a good fit among the technology, its users, and the context. However, despite the availability of frameworks, not much is known about specific research activities for different aims, phases, and settings. This results in researchers having to reinvent the wheel. Consequently, there is a need to synthesize existing knowledge on research activities for participatory eHealth development processes. OBJECTIVE: The 3 main goals of this review are to create an overview of the development strategies used in studies based on the CeHRes (Center for eHealth Research) Roadmap, create an overview of the goals for which these methods can be used, and provide insight into the lessons learned about these methods. METHODS: We included eHealth development studies that were based on the phases and/or principles of the CeHRes Roadmap. This framework was selected because of its focus on participatory, iterative eHealth design in context and to limit the scope of this review. Data were extracted about the type of strategy used, rationale for using the strategy, research questions, and reported information on lessons learned. The most frequently mentioned lessons learned were summarized using a narrative, inductive approach. RESULTS: In the included 160 papers, a distinction was made between overarching development methods (n=10) and products (n=7). Methods are used to gather new data, whereas products can be used to synthesize previously collected data and support the collection of new data. The identified methods were focus groups, interviews, questionnaires, usability tests, literature studies, desk research, log data analyses, card sorting, Delphi studies, and experience sampling. The identified products were prototypes, requirements, stakeholder maps, values, behavior change strategies, personas, and business models. Examples of how these methods and products were applied in the development process and information about lessons learned were provided. CONCLUSIONS: This study shows that there is a plethora of methods and products that can be used at different points in the development process and in different settings. To do justice to the complexity of eHealth development, it seems that multiple strategies should be combined. In addition, we found no evidence for an optimal single step-by-step approach to develop eHealth. Rather, researchers need to select the most suitable research methods for their research objectives, the context in which data are collected, and the characteristics of the participants. This study serves as a first step toward creating a toolkit to support researchers in applying the CeHRes Roadmap to practice. In this way, they can shape the most suitable and efficient eHealth development process.

Psychometric Evaluation of the TWente Engagement with Ehealth Technologies Scale (TWEETS): Evaluation Study.

BACKGROUND: Engagement emerges as a predictor for the effectiveness of digital health interventions. However, a shared understanding of engagement is missing. Therefore, a new scale has been developed that proposes a clear definition and creates a tool to measure it. The TWente Engagement with Ehealth Technologies Scale (TWEETS) is based on a systematic review and interviews with engaged health app users. It defines engagement as a combination of behavior, cognition, and affect. OBJECTIVE: This paper aims to evaluate the psychometric properties of the TWEETS. In addition, a comparison is made with the experiential part of the Digital Behavior Change Intervention Engagement Scale (DBCI-ES-Ex), a scale that showed some issues in previous psychometric analyses. METHODS: In this study, 288 participants were asked to use any step counter app on their smartphones for 2 weeks. They completed online questionnaires at 4 time points: T0=baseline, T1=after 1 day, T2=1 week, and T3=2 weeks. At T0, demographics and personality (conscientiousness and intellect/imagination) were assessed; at T1-T3, engagement, involvement, enjoyment, subjective usage, and perceived behavior change were included as measures that are theoretically related to our definition of engagement. Analyses focused on internal consistency, reliability, and the convergent, divergent, and predictive validity of both engagement scales. Convergent validity was assessed by correlating the engagement scales with involvement, enjoyment, and subjective usage; divergent validity was assessed by correlating the engagement scales with personality; and predictive validity was assessed by regression analyses using engagement to predict perceived behavior change at later time points. RESULTS: The Cronbach alpha values of the TWEETS were .86, .86, and .87 on T1, T2, and T3, respectively. Exploratory factor analyses indicated that a 1-factor structure best fits the data. The TWEETS is moderately to strongly correlated with involvement and enjoyment (theoretically related to cognitive and affective engagement, respectively; P<.001). Correlations between the TWEETS and frequency of use were nonsignificant or small, and differences between adherers and nonadherers on the TWEETS were significant (P<.001). Correlations between personality and the TWEETS were nonsignificant. The TWEETS at T1 was predictive of perceived behavior change at T3, with an explained variance of 16%. The psychometric properties of the TWEETS and the DBCI-ES-Ex seemed comparable in some aspects (eg, internal consistency), and in other aspects, the TWEETS seemed somewhat superior (divergent and predictive validity). CONCLUSIONS: The TWEETS performs quite well as an engagement measure with high internal consistency, reasonable test-retest reliability and convergent validity, good divergent validity, and reasonable predictive validity. As the psychometric quality of a scale is a reflection of how closely a scale matches the conceptualization of a concept, this paper is also an attempt to conceptualize and define engagement as a unique concept, providing a first step toward an acceptable standard of defining and measuring engagement.

Evaluation of the Perceived Persuasiveness Questionnaire: User-Centered Card-Sort Study.

BACKGROUND: eHealth technologies aim to change users' health-related behavior. Persuasive design and system features can make an eHealth technology more motivating, engaging, or supportive to its users. The Persuasive Systems Design (PSD) model incorporates software features that have the possibility to increase the persuasiveness of technologies. However, the effects of specific PSD software features on the effectiveness of an intervention are still largely unknown. The Perceived Persuasiveness Questionnaire (PPQ) was developed to gain insight into the working mechanisms of persuasive technologies. Although the PPQ seems to be a suitable method for measuring subjective persuasiveness, it needs to be further evaluated to determine how suitable it is for measuring perceived persuasiveness among the public. OBJECTIVE: This study aims to evaluate the face and construct validity of the PPQ, identify points of improvement, and provide suggestions for further development of the PPQ. METHODS: A web-based closed-ended card-sort study was performed wherein participants grouped existing PPQ items under existing PPQ constructs. Participants were invited via a Massive Open Online Course on eHealth. A total of 398 people (average age 44.15 years, SD 15.17; 251/398, 63.1% women) completed the card sort. Face validity was evaluated by determining the item-level agreement of the original PPQ constructs. Construct validity was evaluated by determining the construct in which each item was placed most often, regardless of the original placement and how often 2 items were (regardless of the constructs) paired together and what interitem correlations were according to a cluster analysis. RESULTS: Four PPQ constructs obtained relatively high face validity scores: perceived social support, use continuance, perceived credibility, and perceived effort. Item-level agreement on the other constructs was relatively low. Item-level agreement for almost all constructs, except perceived effort and perceived effectiveness, would increase if items would be grouped differently. Finally, a cluster analysis of the PPQ indicated that the strengths of the newly identified 9 clusters varied strongly. Unchanged strong clusters were only found for perceived credibility support, perceived social support, and use continuance. The placement of the other items was much more spread out over the other constructs, suggesting an overlap between them. CONCLUSIONS: The findings of this study provide a solid starting point toward a redesigned PPQ that is a true asset to the field of persuasiveness research. To achieve this, we advocate that the redesigned PPQ should adhere more closely to what persuasiveness is according to the PSD model and to the mental models of potential end users of technology. The revised PPQ should, for example, enquire if the user thinks anything is done to provide task support but not how this is done exactly.

Integrating People, Context, and Technology in the Implementation of a Web-Based Intervention in Forensic Mental Health Care: Mixed-Methods Study.

BACKGROUND: While eMental health interventions can have many potential benefits for mental health care, implementation outcomes are often disappointing. In order to improve these outcomes, there is a need for a better understanding of complex, dynamic interactions between a broad range of implementation-related factors. These interactions and processes should be studied holistically, paying attention to factors related to context, technology, and people. OBJECTIVE: The main objective of this mixed-method study was to holistically evaluate the implementation strategies and outcomes of an eMental health intervention in an organization for forensic mental health care. METHODS: First, desk research was performed on 18 documents on the implementation process. Second, the intervention's use by 721 patients and 172 therapists was analyzed via log data. Third, semistructured interviews were conducted with all 18 therapists of one outpatient clinic to identify broad factors that influence implementation outcomes. The interviews were analyzed via a combination of deductive analysis using the nonadoption, abandonment, scale-up, spread, and sustainability framework and inductive, open coding. RESULTS: The timeline generated via desk research showed that implementation strategies focused on technical skills training of therapists. Log data analyses demonstrated that 1019 modules were started, and 18.65% (721/3865) of patients of the forensic hospital started at least one module. Of these patients, 18.0% (130/721) completed at least one module. Of the therapists using the module, 54.1% (93/172 sent at least one feedback message to a patient. The median number of feedback messages sent per therapist was 1, with a minimum of 0 and a maximum of 460. Interviews showed that therapists did not always introduce the intervention to patients and using the intervention was not part of their daily routine. Also, therapists indicated patients often did not have the required conscientiousness and literacy levels. Furthermore, they had mixed opinions about the design of the intervention. Important organization-related factors were the need for more support and better integration in organizational structures. Finally, therapists stated that despite its current low use, the intervention had the potential to improve the quality of treatment. CONCLUSIONS: Synthesis of different types of data showed that implementation outcomes were mostly disappointing. Implementation strategies focused on technical training of therapists, while little attention was paid to changes in the organization, design of the technology, and patient awareness. A more holistic approach toward implementation strategies-with more attention to the organization, patients, technology, and training therapists-might have resulted in better implementation outcomes. Overall, adaptivity appears to be an important concept in eHealth implementation: a technology should be easily adaptable to an individual patient, therapists should be trained to deal flexibly with an eMental health intervention in their treatment, and organizations should adapt their implementation strategies and structures to embed a new eHealth intervention.

Applying an Agent-based Model to Simulate Just-In-Time Support for Keeping Users of eLearning Courses Motivated.

Persuasive technology can support users of self-paced eLearning courses during critical moments of low motivation. Agent-based models (ABMs) - a relatively unfamiliar phenomenon within the persuasive technology and eLearning domains- offers a potentially relevant methodology to understand when the support should be delivered. Using ABMs, the dynamics of motivational user states can be simulated. Subsequently, emerging user patterns can be traced that can potentially provide insight in the ebb and flow of motivation. For the purpose of this study, we designed an exploratory ABM on motivation based on the mental energy notion of which the foundations can be found both within the literature of motivational psychology and agent-based modeling. During the simulations we succeeded in generating moments of critically low user motivation. In addition, we were able to simulate the positive impact of external user support at those critical moments. These results suggest that it is plausible to put further energy in developing ABM models with the ultimate goal of feeding persuasive technology with the ability to deliver just-in-time user support during eLearning.

The Importance of Systematically Reporting and Reflecting on eHealth Development: Participatory Development Process of a Virtual Reality Application for Forensic Mental Health Care.

BACKGROUND: The use of electronic health (eHealth) technologies in practice often is lower than expected, mostly because there is no optimal fit among a technology, the characteristics of prospective users, and their context. To improve this fit, a thorough systematic development process is recommended. However, more knowledge about suitable development methods is necessary to create a tool kit that guides researchers in choosing development methods that are appropriate for their context and users. In addition, there is a need for reflection on the existing frameworks for eHealth development to be able to constantly improve them. OBJECTIVE: The two main objectives of this case study were to present and reflect on the (1) methods used in the development process of a virtual reality application for forensic mental health care and (2) development model that was used: the CeHRes Roadmap (the Centre for eHealth Research Roadmap). METHODS: In the development process, multiple methods were used to operationalize the first 2 phases of the CeHRes Roadmap: the contextual inquiry and value specification. To summarize the most relevant information for the goals of this study, the following information was extracted per method: (1) research goal, (2) explanation of the method used, (3) main results, (4) main conclusions, and (5) lessons learned about the method. RESULTS: Information on 10 methods used is presented in a structured manner. These 10 methods were stakeholder identification, project team composition, focus groups, literature study, semistructured interviews, idea generation with scenarios, Web-based questionnaire, value specification, idea generation with prototyping, and a second round of interviews. The lessons learned showed that although each method added new insights to the development process, not every method appeared to be the most appropriate for each research goal. CONCLUSIONS: Reflection on the methods used pointed out that brief methods with concrete examples or scenarios fit the forensic psychiatric patients the best, among other things, because of difficulties with abstract reasoning and low motivation to invest much time in participating in research. Formulating clear research questions based on a model's underlying principles and composing a multidisciplinary project team with prospective end users appeared to be important in this study. The research questions supported the project team in keeping the complex development processes structured and prevented tunnel vision. With regard to the CeHRes Roadmap, continuous stakeholder involvement and formative evaluations were evaluated as strong points. A suggestion to further improve the Roadmap is to explicitly integrate the use of domain-specific theories and models. To create a tool kit with a broad range of methods for eHealth development and further improve development models, studies that report and reflect on development processes in a consistent and structured manner are needed.

Implementation Strategies to Enhance the Implementation of eHealth Programs for Patients With Chronic Illnesses: Realist Systematic Review.

BACKGROUND: There is growing evidence of the positive effects of electronic health (eHealth) interventions for patients with chronic illness, but implementation of such interventions into practice is challenging. Implementation strategies that potentially impact implementation outcomes and implementation success have been identified. Which strategies are actually used in the implementation of eHealth interventions for patients with chronic illness and which ones are the most effective is unclear. OBJECTIVE: This systematic realist review aimed to summarize evidence from empirical studies regarding (1) which implementation strategies are used when implementing eHealth interventions for patients with chronic illnesses living at home, (2) implementation outcomes, and (3) the relationship between implementation strategies, implementation outcomes, and degree of implementation success. METHODS: A systematic literature search was performed in the electronic databases MEDLINE, Embase, PsycINFO, Scopus, Allied and Complementary Medicine Database, Cumulative Index to Nursing and Allied Health Literature, and Cochrane Library. Studies were included if they described implementation strategies used to support the integration of eHealth interventions into practice. Implementation strategies were categorized according to 9 categories defined by the Expert Recommendations for Implementing Change project: (1) engage consumers, (2) use evaluative and iterative strategies, (3) change infrastructure, (4) adapt and tailor to the context, (5) develop stakeholder interrelationships, (6) use financial strategies, (7) support clinicians, (8) provide interactive assistance, and (9) train and educate stakeholders. Implementation outcomes were extracted according to the implementation outcome framework by Proctor and colleagues: (1) acceptability, (2) adoption, (3) appropriateness, (4) cost, (5) feasibility, (6) fidelity, (7) penetration, and (8) sustainability. Implementation success was extracted according to the study authors' own evaluation of implementation success in relation to the used implementation strategies. RESULTS: The implementation strategies management support and engagement, internal and external facilitation, training, and audit and feedback were directly related to implementation success in several studies. No clear relationship was found between the number of implementation strategies used and implementation success. CONCLUSIONS: This is the first review examining implementation strategies, implementation outcomes, and implementation success of studies reporting the implementation of eHealth programs for patients with chronic illnesses living at home. The review indicates that internal and external facilitation, audit and feedback, management support, and training of clinicians are of importance for eHealth implementation. The review also points to the lack of eHealth studies that report implementation strategies in a comprehensive way and highlights the need to design robust studies focusing on implementation strategies in the future. TRIAL REGISTRATION: PROSPERO CRD42018085539; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=85539.

Evaluating the implementation of a personal health record for chronic primary and secondary care: a mixed methods approach.

BACKGROUND: Personal health records (PHRs) provide the opportunity for self-management support, enhancing communication between patients and caregivers, and maintaining and/or improving the quality of chronic disease management. Their implementation is a multi-level and complex process, requiring a holistic approach that takes into account the technology, its users and the context of implementation. The aim of this research is to evaluate the fidelity of a PHR in chronic care (the degree to which it was implemented as intended) in order to explain the found effects. METHODS: A convergent parallel mixed methods design was used, where qualitative and quantitative data were collected in parallel, analyzed separately, and finally merged. Log data of 536 users were used to gain insight into the actual long-term use of the PHR (the dose). Focus group meetings among caregivers (n = 13) were conducted to assess program differentiation (or intended use). Interviews with caregivers (n = 28) and usability tests with potential end-users (n = 13) of the PHR were used to understand the responsiveness and the differences and similarities between the intended and actual use of the PHR. RESULTS: The results of the focus groups showed that services for coaching are strongly associated with monitoring health values and education. However, the PHR was not used that way during the study period. In the interviews, caregivers indicated that they were ignorant on how to deploy the PHR in current working routines. Therefore, they find it difficult to motivate their patients in using the PHR. Participants in the usability study indicate that they would value a PHR in the future, given that the usability will be improved and that the caregivers will use it in daily practice as well. CONCLUSIONS: In this study, actual use of the PHRs by patients was influenced by the responsiveness of caregivers. This responsiveness is likely to be strongly influenced by the perceived support when defining the differentiation and delivery of the PHR. A mixed-methods approach to understand intervention fidelity was of added value in providing explanations for the found effects that could not be revealed by solely focusing on the effectiveness of the technology in an experimental trial.

Investigating the Direct Impact of a Gamified Versus Nongamified Well-Being Intervention: An Exploratory Experiment.

BACKGROUND: Gamification is a promising strategy to increase the effectiveness of Web-based mental health interventions by enhancing engagement. However, because most studies focus on the longer term effects of gamification (eg, effectiveness or adherence at the end of the intervention period), there is limited insight into how gamification may enhance engagement. Research implies that gamification has a direct impact at the time of use of the intervention, which changes the experience of the users, and thereby motivates users. However, it is unclear what this direct impact of gamification might be and how it can be measured. OBJECTIVE: The objective of this study was to explore the direct impact of gamification on behavioral, cognitive, and affective engagement in the context of a Web-based mental health intervention and to explore whether and how the different components of engagement are related. METHODS: A pilot (n=19) and a real-life (n=75) randomized between-groups experiment was carried out, where participants used a gamified or nongamified version of the same Web-based well-being intervention for a single session. Participants (68%, 64/94 female, mean age 23 years) were asked to use the intervention in one session for research purposes. Gamification elements included a map as visualization of the different lessons, a virtual guide, and badges. Later, behavioral, cognitive, and affective engagement were measured. RESULTS: The pilot experiment showed no differences between the gamified and nongamified intervention. However, in the real-life experiment, participants in the gamified intervention scored higher on cognitive engagement, that is, involvement (P=.02) and some elements of affective engagement, that is, flow as a combination of cognitive and affective engagement (P=.049), and the emotions "interest" (P=.03) and "inspiration" (P=.009). Furthermore, the effect of gamification on cognitive engagement was mediated by the influence of gamification on specific positive emotions. CONCLUSIONS: The gamified intervention seemed to be able to increase cognitive engagement and the combination of cognitive and affective engagement but not behavioral and affective engagement alone. However, positive emotions seem to play an important role in mediating the effect of gamification on engagement. In conclusion, we cannot say that gamification "works" but that the design of an intervention, in this case, gamification, can have an impact on how participants experience the intervention.

Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence.

BACKGROUND: In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use. However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology. OBJECTIVE: The study aimed to improve eHealth evaluations by gaining insight into when, how, and by whom the concept of adherence has been used in previous eHealth evaluations and finding a concise way to operationalize adherence to and intended use of different eHealth technologies. METHODS: A systematic review of eHealth evaluations was conducted to gain insight into how the use of the technology was measured, how adherence to different types of technologies was operationalized, and if and how the intended use of the technology was justified. Differences in variables between the use of the technology and the operationalization of adherence were calculated using a chi-square test of independence. RESULTS: In total, 62 studies were included in this review. In 34 studies, adherence was operationalized as "the more use, the better," whereas 28 studies described a threshold for intended use of the technology as well. Out of these 28, only 6 reported a justification for the intended use. The proportion of evaluations of mental health technologies reporting a justified operationalization of intended use is lagging behind compared with evaluations of lifestyle and chronic care technologies. The results indicated that a justification of intended use does not require extra measurements to determine adherence to the technology. CONCLUSIONS: The results of this review showed that to date, justifications for intended use are often missing in evaluations of adherence. Evidently, it is not always possible to estimate the intended use of a technology. However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology. Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature. When defining the intended use of a technology and selecting valid measures for adherence, the goal or the assumed working mechanisms should be leading. Adherence can then be standardized, which will improve the comparison of adherence rates to different technologies with the same goal and will provide insight into how adherence to different elements contributed to the outcomes.

Self-Guided Web-Based Interventions: Scoping Review on User Needs and the Potential of Embodied Conversational Agents to Address Them.

BACKGROUND: Web-based mental health interventions have evolved from innovative prototypes to evidence-based and clinically applied solutions for mental diseases such as depression and anxiety. Open-access, self-guided types of these solutions hold the promise of reaching and treating a large population at a reasonable cost. However, a considerable factor that currently hinders the effectiveness of these self-guided Web-based interventions is the high level of nonadherence. The absence of a human caregiver apparently has a negative effect on user adherence. It is unknown to what extent this human support can be handed over to the technology of the intervention to mitigate this negative effect. OBJECTIVE: The first objective of this paper was to explore what is known in literature about what support a user needs to stay motivated and engaged in an electronic health (eHealth) intervention that requires repeated use. The second objective was to explore the current potential of embodied conversational agents (ECAs) to provide this support. METHODS: This study reviews and interprets the available literature on (1) support within eHealth interventions that require repeated use and (2) the potential of ECAs by means of a scoping review. The rationale for choosing a scoping review is that the subject is broad, diverse, and largely unexplored. Themes for (1) and (2) were proposed based on grounded theory and mapped on each other to find relationships. RESULTS: The results of the first part of this study suggest the presence of user needs that largely remain implicit and unaddressed. These support needs can be categorized as task-related support and emotion-related support. The results of the second part of this study suggest that ECAs are capable of engaging and motivating users of information technology applications in the domains of learning and behavioral change. Longitudinal studies must be conducted to determine under what circumstances ECAs can create and maintain a productive user relationship. Mapping the user needs on the ECAs' capabilities suggests that different kinds of ECAs may provide different solutions for improving the adherence levels. CONCLUSIONS: Autonomous ECAs that do not respond to a user's expressed emotion in real time but take on empathic roles may be sufficient to motivate users to some extent. It is unclear whether those types of ECAs are competent enough and create sufficient believability among users to address the user's deeper needs for support and empathy. Responsive ECAs may offer a better solution. However, at present, most of these ECAs have difficulties to assess a user's emotional state in real time during an open dialogue. By conducting future research with relationship theory-based ECAs, the added value of ECAs toward user needs can be better understood.

How to Increase Reach and Adherence of Web-Based Interventions: A Design Research Viewpoint.

Nowadays, technology is increasingly used to increase people's well-being. For example, many mobile and Web-based apps have been developed that can support people to become mentally fit or to manage their daily diet. However, analyses of current Web-based interventions show that many systems are only used by a specific group of users (eg, women, highly educated), and that even they often do not persist and drop out as the intervention unfolds. In this paper, we assess the impact of design features of Web-based interventions on reach and adherence and conclude that the power that design can have has not been used to its full potential. We propose looking at design research as a source of inspiration for new (to the field) design approaches. The paper goes on to specify and discuss three of these approaches: personalization, ambient information, and use of metaphors. Central to our viewpoint is the role of positive affect triggered by well-designed persuasive features to boost adherence and well-being. Finally, we discuss the future of persuasive eHealth interventions and suggest avenues for follow-up research.

Understanding the usage of content in a mental health intervention for depression: an analysis of log data.

BACKGROUND: Web-based interventions for the early treatment of depressive symptoms can be considered effective in reducing mental complaints. However, there is a limited understanding of which elements in an intervention contribute to effectiveness. For efficiency and effectiveness of interventions, insight is needed into the use of content and persuasive features. OBJECTIVE: The aims of this study were (1) to illustrate how log data can be used to understand the uptake of the content of a Web-based intervention that is based on the acceptance and commitment therapy (ACT) and (2) to discover how log data can be of value for improving the incorporation of content in Web-based interventions. METHODS: Data from 206 participants (out of the 239) who started the first nine lessons of the Web-based intervention, Living to the Full, were used for a secondary analysis of a subset of the log data of the parent study about adherence to the intervention. The log files used in this study were per lesson: login, start mindfulness, download mindfulness, view success story, view feedback message, start multimedia, turn on text-message coach, turn off text-message coach, and view text message. Differences in usage between lessons were explored with repeated measures ANOVAs (analysis of variance). Differences between groups were explored with one-way ANOVAs. To explore the possible predictive value of the login per lesson quartiles on the outcome measures, four linear regressions were used with login quartiles as predictor and with the outcome measures (Center for Epidemiologic Studies-Depression [CES-D] and the Hospital Anxiety and Depression Scale-Anxiety [HADS-A] on post-intervention and follow-up) as dependent variables. RESULTS: A significant decrease in logins and in the use of content and persuasive features over time was observed. The usage of features varied significantly during the treatment process. The usage of persuasive features increased during the third part of the ACT (commitment to value-based living), which might indicate that at that stage motivational support was relevant. Higher logins over time (9 weeks) corresponded with a higher usage of features (in most cases significant); when predicting depressive symptoms at post-intervention, the linear regression yielded a significant model with login quartile as a significant predictor (explained variance is 2.7%). CONCLUSIONS: A better integration of content and persuasive features in the design of the intervention and a better intra-usability of features within the system are needed to identify which combination of features works best for whom. Pattern recognition can be used to tailor the intervention based on usage patterns from the earlier lessons and to support the uptake of content essential for therapy. An adaptable interface for a modular composition of therapy features supposes a dynamic approach for Web-based treatment; not a predefined path for all, but a flexible way to go through all features that have to be used.

Guided web app intervention for reducing symptoms of depression in postpartum women: Results of a feasibility randomized controlled trial.

Background: Chile faces a significant postpartum depression prevalence and treatment gap, necessitating accessible interventions. While cognitive-behavioral internet-based interventions have proven effective in high-income countries, this field is underdeveloped in Chile. Based on the country's widespread use of digital technology, a guided 8-week cognitive-behavioral web app intervention named "Mamá, te entiendo" was developed. Objective: This study aimed to assess the acceptability and feasibility of "Mamá, te entiendo", for reducing depressive symptomatology in postpartum women. Methods: Sixty-five postpartum women with minor or major depression were randomly assigned to either intervention or waitlist. Primary outcomes centered on study feasibility, intervention feasibility, and acceptability. Semi-structured interviews with a sub-sample enriched the understanding of participants' experiences. Secondary outcomes included mental health variables assessed at baseline, post-intervention, and 1-month follow-up. Results: Chilean women displayed great interest in the intervention. 44.8 % of participants completed the intervention. Participants reported high satisfaction and engagement levels, with interviewees highlighting the value of the intervention's content, exercises, and therapist's feedback. However, preliminary efficacy analysis didn't reveal a significant interaction between group and time for outcome measures. Discussion: This research represents a pioneering effort in Chile to evaluate an internet-based intervention for postpartum depression symptoms. The demonstrated feasibility and acceptability highlight the potential of integrating technology-driven approaches into mental health interventions. However, the intervention did not demonstrate superiority, as both groups exhibited similar positive progress in several outcomes. Therefore, the following research phase should involve a larger and more diverse sample to assess the intervention's effectiveness, identify influencing factors, and determine the individuals who benefit the most.

Group, Blended and Individual, Unguided Online Delivery of Mindfulness-Based Cognitive Therapy for People With Cancer: Feasibility Uncontrolled Trial.

BACKGROUND: Online mindfulness based cognitive therapy (eMBCT) has been shown to reduce psychological distress in people with cancer. However, this population has reported lack of support and asynchronous communication as barriers to eMBCT, resulting in higher nonadherence rates than with face-to-face MBCT. Using a co-creation process, we developed 2 formats of eMBCT: group, blended (combination of therapist-guided group and individual online sessions) and individual, unguided (individual, unguided online sessions only). Group, blended eMBCT offers peer support and guidance, whereas individual, unguided eMBCT offers flexibility and the possibility of large-scale implementation. OBJECTIVE: The objective of this nonrandomized feasibility study was to assess aspects of feasibility of the group, blended and individual, unguided eMBCT interventions. METHODS: Participants were people with cancer who chose between group, blended and individual, unguided eMBCT. Both intervention conditions followed the same 8-week eMBCT program, including an introductory session and a silent day (10 sessions total). All sessions for individual, unguided eMBCT occurred via the platform Minddistrict, whereas group, blended eMBCT consisted of 3 online videoconference sessions guided by a mindfulness teacher and 5 sessions via Minddistrict. We assessed the feasibility of the intervention quantitatively and qualitatively by evaluating its acceptability among participants. Additionally, we assessed limited efficacy by looking at the number of questionnaires participants completed pre- and postintervention. RESULTS: We included 12 participants for each eMBCT condition. Participants in group, blended eMBCT completed, on average, 9.7 of 10 sessions, compared with an average 8.3 sessions for individual, unguided eMBCT (excluding dropouts). Of the 24 participants, 13 (54%) agreed to be interviewed (5 unguided and 8 blended). Participants in both conditions reported positive experiences, including the convenience of not having to travel and the flexibility to choose when and where to participate. However, among the barriers for participation, participants in the group, blended condition reported a preference for more group sessions, and participants in the individual, unguided condition reported a lack of guidance. Additionally, for the group, blended condition, the effect sizes were small for all outcome measures (Hedges g range=0.01-0.36), except for fatigue, which had a moderate effect size (Hedges g=0.57). For the individual, unguided condition, the effect sizes were small for all outcome measures (Hedges g range=0.24-0.46), except for mindfulness skills (Hedges g=0.52) and engagement with the intervention (Hedges g=1.53). CONCLUSIONS: Participants in this study had a positive experience with group, blended and individual, unguided eMBCT. Based on the results from this study, we will adjust the intervention prior to conducting a full-scale randomized controlled trial to evaluate effectiveness; we will add 1 group session to the group, blended eMBCT using Zoom as the platform for the group sessions; and we will send reminders to participants to complete questionnaires. TRIAL REGISTRATION: ClinicalTrials.gov NCT05336916; https://clinicaltrials.gov/ct2/show/NCT05336916.

Benefits, Recruitment, Dropout, and Acceptability of the Strength Back Digital Health Intervention for Patients Undergoing Spinal Surgery: Nonrandomized, Qualitative, and Quantitative Pilot Feasibility Study.

BACKGROUND: Patients undergoing spinal surgery report high levels of insecurity, pain, stress, and anxiety before and after surgery. Unfortunately, there is no guarantee that surgery will resolve all issues; postsurgical recovery often entails moderate to severe postoperative pain, and some patients undergoing spinal surgery do not experience (long-term) pain relief after surgery. Therefore, focusing on sustainable coping skills and resilience is crucial for these patients. A digital health intervention based on acceptance and commitment therapy (ACT) and positive psychology (PP) was developed to enhance psychological flexibility and well-being and reduce postsurgical pain. OBJECTIVE: The objective of this study was 3-fold: to explore the potential benefits for patients undergoing spinal surgery of the digital ACT and PP intervention Strength Back (research question [RQ] 1), explore the feasibility of a future randomized controlled trial in terms of recruitment and dropout (RQ 2), and assess the acceptability of Strength Back by patients undergoing spinal surgery (RQ 3). METHODS: We used a nonrandomized experimental design with an intervention group (n=17) and a control group (n=20). To explore the potential benefits of the intervention, participants in both groups filled out questionnaires before and after surgery. These questionnaires included measurements of pain intensity (Numeric Pain Rating Scale), pain interference (Multidimensional Pain Inventory), anxiety and depression (Hospital Anxiety and Depression Scale), valued living (Engaged Living Scale), psychological flexibility (Psychological Inflexibility in Pain Scale), and mental well-being (Mental Health Continuum-Short Form). Semistructured interviews combined with log data and scores on the Twente Engagement With eHealth Technologies Scale were used to assess the acceptability of the intervention. RESULTS: A significant improvement over time in emotional (V=99; P=.03) and overall (V=55; P=.004) well-being (Mental Health Continuum-Short Form) was observed only in the intervention group. In addition, the intervention group showed a significantly larger decline in pain intensity (Numeric Pain Rating Scale) than did the control group (U=75; P=.003). Of the available weekly modules on average 80% (12/15) was completed by patients undergoing spinal fusion and 67% (6/9) was completed by patients undergoing decompression surgery. A total of 68% (17/25) of the participants used the intervention until the final interview. Most participants (15/17, 88%) in the intervention group would recommend the intervention to future patients. CONCLUSIONS: This pilot feasibility study showed that combining ACT and PP in a digital health intervention is promising for patients undergoing spinal surgery as the content was accepted by most of the participants and (larger) improvements in pain intensity and well-being were observed in the intervention group. A digital intervention for patients undergoing (spinal) surgery can use teachable moments, when patients are open to learning more about the surgery and rehabilitation afterward. A larger randomized controlled trial is now warranted.

Participants, usage, and use patterns of a web-based intervention for the prevention of depression within a randomized controlled trial.

BACKGROUND: Although Web-based interventions have been shown to be effective, they are not widely implemented in regular care. Nonadherence (ie, participants not following the intervention protocol) is an issue. By studying the way Web-based interventions are used and whether there are differences between adherers (ie, participants that started all 9 lessons) and nonadherers, more insight can be gained into the process of adherence. OBJECTIVE: The aims of this study were to (1) describe the characteristics of participants and investigate their relationship with adherence, (2) investigate the utilization of the different features of the intervention and possible differences between adherers and nonadherers, and (3) identify what use patterns emerge and whether there are differences between adherers and nonadherers. METHODS: Data were used from 206 participants that used the Web-based intervention Living to the full, a Web-based intervention for the prevention of depression employing both a fully automated and human-supported format. Demographic and baseline characteristics of participants were collected by using an online survey. Log data were collected within the Web-based intervention itself. Both quantitative and qualitative analyses were performed. RESULTS: In all, 118 participants fully adhered to the intervention (ie, started all 9 lessons). Participants with an ethnicity other than Dutch were more often adherers (χ²1=5.5, P=.02), and nonadherers used the Internet more hours per day on average (F1,203=3.918, P=.049). A logistic regression showed that being female (OR 2.02, 95% CI 1.01-4.04; P=.046) and having a higher need for cognition (OR 1.02; 95% CI 1.00-1.05; P=.02) increased the odds of adhering to the intervention. Overall, participants logged in an average of 4 times per lesson, but adherers logged in significantly more times per lesson than nonadherers (F1,204=20.710; P<.001). For use patterns, we saw that early nonadherers seemed to use fewer sessions and spend less time than late nonadherers and adherers, and fewer sessions to complete the lesson than adherers. Furthermore, late nonadherers seemed to have a shorter total duration of sessions than adherers. CONCLUSIONS: By using log data combined with baseline characteristics of participants, we extracted valuable lessons for redesign of this intervention and the design of Web-based interventions in general. First, although characteristics of respondents can significantly predict adherence, their predictive value is small. Second, it is important to design Web-based interventions to foster adherence and usage of all features in an intervention. TRIAL REGISTRATION: Dutch Trial Register Number: NTR3007; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=3007 (Archived by WebCite at http://www.webcitation.org/6ILhI3rd8).

Development of a web-based intervention for the indicated prevention of depression.

BACKGROUND: To reduce the large public health burden of the high prevalence of depression, preventive interventions targeted at people at risk are essential and can be cost-effective. Web-based interventions are able to provide this care, but there is no agreement on how to best develop these applications and often the technology is seen as a given. This seems to be one of the main reasons that web-based interventions do not reach their full potential. The current study describes the development of a web-based intervention for the indicated prevention of depression, employing the CeHRes (Center for eHealth Research and Disease Management) roadmap. The goals are to create a user-friendly application which fits the values of the stakeholders and to evaluate the process of development. METHODS: The employed methods are a literature scan and discussion in the contextual inquiry; interviews, rapid prototyping and a requirement session in the value specification stage; and user-based usability evaluation, expert-based usability inspection and a requirement session in the design stage. RESULTS: The contextual inquiry indicated that there is a need for easily accessible interventions for the indicated prevention of depression and web-based interventions are seen as potentially meeting this need. The value specification stage yielded expected needs of potential participants, comments on the usefulness of the proposed features and comments on two proposed designs of the web-based intervention. The design stage yielded valuable comments on the system, content and service of the web-based intervention. CONCLUSIONS: Overall, we found that by developing the technology, we successfully (re)designed the system, content and service of the web-based intervention to match the values of stakeholders. This study has shown the importance of a structured development process of a web-based intervention for the indicated prevention of depression because: (1) it allows the development team to clarify the needs that have to be met for the intervention to be of use to the target audience; and (2) it yields feedback on the design of the application that is broader than color and buttons, but encompasses comments on the quality of the service that the application offers.

A Chilean survey of perinatal women and health care professionals' views towards perinatal apps.

Background: Women around the globe are increasingly engaging with pregnancy and parenting apps, almost becoming a routine part of the maternity experience. However, little is known about what perinatal women and health care professionals feel about those apps in Latin American countries, where the digital transformation has been slower but where digital technologies could also bridge gaps in access to quality health care. Methods: This study aimed to assess views towards pregnancy and parenting apps in perinatal women and perinatal health care professionals in Chile through an online survey. In perinatal women, we explored app use, what they value in the apps they use, and what an "ideal app" would be for them. In health professionals, we explored opinions about women using perinatal apps and what they think a perfect app for their clients would be. Results: The survey was completed by 451 perinatal women and 54 perinatal health care professionals. Results show that perinatal women in Chile frequently use perinatal apps, and they and health care professionals show a positive attitude towards them. The most valued attributes are information and monitoring of body changes during pregnancy, information and monitoring of the baby's development (in the uterus and after birth), information and tips on how to stay healthy, and having the possibility to interact with other women. Conclusions: Perinatal apps are accepted by perinatal women and health care professionals in Chile. Some needs for an "ideal app" emerged. Participants mentioned the need to address mental health, including the mental health of their partner, and the need for support during the transition to parenthood.

Compassion apps for better mental health: qualitative review.

BACKGROUND: There is increasing empirical evidence for the positive mental health effects of compassion-based interventions. Although numerous smartphone apps offering compassion-based interventions ('compassion apps') are now available for the general public, the quality of these apps has not yet been reviewed. A qualitative review of existing compassion apps serves as a crucial first step toward testing the efficacy of these apps, by identifying good-quality compassion apps that might be worth the investment of a scientific trial. AIMS: The current study focuses on reviewing the quality of existing compassion apps. METHOD: Existing compassion apps were identified through searches in the Google Play Store and App Store. The 24 included apps were reviewed on their quality by using the Mobile App Rating Scale, and on their consistency with current evidence by comparing them to existing and studied compassion-based interventions. RESULTS: Of the 24 included apps, eight were identified that met the criteria of being consistent with existing and studied compassion-based interventions, and acceptable to good overall quality. The other 16 apps failed to meet one or both of these criteria. CONCLUSIONS: Good-quality compassion apps are available, but many of the available apps fail to meet certain quality criteria. In particular, many apps failed to offer sufficient relevant and correct information, or failed to offer this information in an entertaining and interesting way. It is recommended that future compassion apps are based on a clear definition of compassion, offer evidence- and theory-based exercises and implement tools for increasing engagement.