A Multilingual Digital Mental Health and Well-Being Chatbot (ChatPal): Pre-Post Multicenter Intervention Study.

BACKGROUND: In recent years, advances in technology have led to an influx of mental health apps, in particular the development of mental health and well-being chatbots, which have already shown promise in terms of their efficacy, availability, and accessibility. The ChatPal chatbot was developed to promote positive mental well-being among citizens living in rural areas. ChatPal is a multilingual chatbot, available in English, Scottish Gaelic, Swedish, and Finnish, containing psychoeducational content and exercises such as mindfulness and breathing, mood logging, gratitude, and thought diaries. OBJECTIVE: The primary objective of this study is to evaluate a multilingual mental health and well-being chatbot (ChatPal) to establish if it has an effect on mental well-being. Secondary objectives include investigating the characteristics of individuals that showed improvements in well-being along with those with worsening well-being and applying thematic analysis to user feedback. METHODS: A pre-post intervention study was conducted where participants were recruited to use the intervention (ChatPal) for a 12-week period. Recruitment took place across 5 regions: Northern Ireland, Scotland, the Republic of Ireland, Sweden, and Finland. Outcome measures included the Short Warwick-Edinburgh Mental Well-Being Scale, the World Health Organization-Five Well-Being Index, and the Satisfaction with Life Scale, which were evaluated at baseline, midpoint, and end point. Written feedback was collected from participants and subjected to qualitative analysis to identify themes. RESULTS: A total of 348 people were recruited to the study (n=254, 73% female; n=94, 27% male) aged between 18 and 73 (mean 30) years. The well-being scores of participants improved from baseline to midpoint and from baseline to end point; however, improvement in scores was not statistically significant on the Short Warwick-Edinburgh Mental Well-Being Scale (P=.42), the World Health Organization-Five Well-Being Index (P=.52), or the Satisfaction With Life Scale (P=.81). Individuals that had improved well-being scores (n=16) interacted more with the chatbot and were significantly younger compared to those whose well-being declined over the study (P=.03). Three themes were identified from user feedback, including "positive experiences," "mixed or neutral experiences," and "negative experiences." Positive experiences included enjoying exercises provided by the chatbot, while most of the mixed, neutral, or negative experiences mentioned liking the chatbot overall, but there were some barriers, such as technical or performance errors, that needed to be overcome. CONCLUSIONS: Marginal improvements in mental well-being were seen in those who used ChatPal, albeit nonsignificant. We propose that the chatbot could be used along with other service offerings to complement different digital or face-to-face services, although further research should be carried out to confirm the effectiveness of this approach. Nonetheless, this paper highlights the need for blended service offerings in mental health care.

Dolores: A Mobile Chatbot for People Living with Chronic Pain.

We provide an outline of the Dolores chatbot designed to gather data and provide information to people living with chronic pain. Dolores is equipped with selective language levels to provide language appropriate responses for all ages. A recent pilot study (N = 60) of adolescents, young-adults and adults was completed and the frequented topics that were accessed are summarised here.

Acceptability of a Pain History Assessment and Education Chatbot (Dolores) Across Age Groups in Populations With Chronic Pain: Development and Pilot Testing.

BACKGROUND: The delivery of education on pain neuroscience and the evidence for different treatment approaches has become a key component of contemporary persistent pain management. Chatbots, or more formally conversation agents, are increasingly being used in health care settings due to their versatility in providing interactive and individualized approaches to both capture and deliver information. Research focused on the acceptability of diverse chatbot formats can assist in developing a better understanding of the educational needs of target populations. OBJECTIVE: This study aims to detail the development and initial pilot testing of a multimodality pain education chatbot (Dolores) that can be used across different age groups and investigate whether acceptability and feedback were comparable across age groups following pilot testing. METHODS: Following an initial design phase involving software engineers (n=2) and expert clinicians (n=6), a total of 60 individuals with chronic pain who attended an outpatient clinic at 1 of 2 pain centers in Australia were recruited for pilot testing. The 60 individuals consisted of 20 (33%) adolescents (aged 10-18 years), 20 (33%) young adults (aged 19-35 years), and 20 (33%) adults (aged >35 years) with persistent pain. Participants spent 20 to 30 minutes completing interactive chatbot activities that enabled the Dolores app to gather a pain history and provide education about pain and pain treatments. After the chatbot activities, participants completed a custom-made feedback questionnaire measuring the acceptability constructs pertaining to health education chatbots. To determine the effect of age group on the acceptability ratings and feedback provided, a series of binomial logistic regression models and cumulative odds ordinal logistic regression models with proportional odds were generated. RESULTS: Overall, acceptability was high for the following constructs: engagement, perceived value, usability, accuracy, responsiveness, adoption intention, esthetics, and overall quality. The effect of age group on all acceptability ratings was small and not statistically significant. An analysis of open-ended question responses revealed that major frustrations with the app were related to Dolores' speech, which was explored further through a comparative analysis. With respect to providing negative feedback about Dolores' speech, a logistic regression model showed that the effect of age group was statistically significant (χ22=11.7; P=.003) and explained 27.1% of the variance (Nagelkerke R2). Adults and young adults were less likely to comment on Dolores' speech compared with adolescent participants (odds ratio 0.20, 95% CI 0.05-0.84 and odds ratio 0.05, 95% CI 0.01-0.43, respectively). Comments were related to both speech rate (too slow) and quality (unpleasant and robotic). CONCLUSIONS: This study provides support for the acceptability of pain history and education chatbots across different age groups. Chatbot acceptability for adolescent cohorts may be improved by enabling the self-selection of speech characteristics such as rate and personable tone.

Effect of Hidden Vector on the Speech of PRVA.

This study aimed to propose a novel method for designing a product recommendation virtual agent (PRVA) that can keep users motivated to interact with the agent. In prior papers, many methods of keeping users motivated postulated real-time and multi-modal interactions. The proposed novel method can be used in one-direction interaction. We defined the notion of the "hidden vector," that is, information that is not mentioned by a PRVA and that the user can suppose spontaneously. We conducted an experiment to verify the hypothesis that PRVAs having a hidden vector are more effective than other PRVAs. As a result, it was shown that PRVAs having a hidden vector were perceived as being more persuasive than other PRVAs and strongly motivated the users to use the PRVAs. From these results, the proposed method was shown to be effective.

Introducing Edna: A trainee chatbot designed to support communication about additional (secondary) genomic findings.

OBJECTIVE: To support informed decision-making about reanalysis of clinical genomic data for risk of preventable conditions ('additional findings') by developing a chatbot (electronic genetic resource, 'eDNA'). METHODS: Interactions in pre-test genetic counseling sessions (13.5 h) about additional findings were characterized using proponent, thematic and semantic analyses of transcripts. We then wrote interfaces to draw supplementary data from external genetics applications. To create Edna, this content was programmed using a chatbot framework which interacts with patients via speech-to-text. RESULTS: Conditions, terms, explanations of concepts, and key factors to consider in decision making were all encoded into chatbot conversations emulating counseling session flows. Patient agency can be enhanced by prompted consideration of the personal and familial implications of testing. Similarly, health literacy can be broadened through explanation of genetic conditions and terminology. Novel aspects include sentiment analysis and collection of family history. Medical advice and the impact of existing genetic conditions were deemed inappropriate for inclusion. CONCLUSION: Edna's successful development represents a movement towards accessible, acceptable and well-supported digital health processes for patients to make informed decisions for additional findings. PRACTICE IMPLICATIONS: Edna complements genetic counseling by collecting and providing genomic information before or after pre-test consultations.