Persuasive technologies design for mental and behavioral health platforms: A scoping literature review.

This review investigates persuasive design frameworks within eHealth, concentrating on methodologies, their prevalence in mental and behavioral health applications, and identifying current research gaps. An extensive search was conducted across 8 databases, focusing on English publications with full text available. The search prioritized primary research articles, post-2011 applications, and eHealth platforms emphasizing treatment or support. The inclusion process was iterative, involving multiple authors, and relied on detailed criteria to ensure the relevance and contemporaneity of selected works. The final review set comprised 161 articles, providing an overview of persuasive design frameworks in eHealth. The review highlights the state of the art in the domain, emphasizing the utilization and effectiveness of these frameworks in eHealth platforms. This review details the restricted adoption of persuasive design frameworks within the field of eHealth, particularly in the mental and behavioral sectors. Predominant gaps include the scarcity of comparative evaluations, the underrepresentation of tailored interventions, and the unclear influence of persuasive components on user experience. There is a notable requirement for further scrutiny and refinement of persuasive design frameworks. Addressing these concerns promises a more substantial foundation for persuasive design in eHealth, potentially enhancing user commitment and platform efficiency.

Exploring Comprehension Strategies of Modular Process Models: A Combined Eye-Tracking and Concurrent Think-Aloud Study.

The study of complex process models often encounters challenges in terms of comprehensibility. This paper explores using modularization as a strategy to mitigate such challenges, notably the reduction in complexity. Previous research has delved into the comprehensibility of modularized process models, yet an unresolved question about the cognitive factors at play during their comprehension still needs to be answered. Addressing the latter, the paper presents findings from an innovative study combining eye-tracking and concurrent think-aloud techniques involving 25 participants. The study aimed to comprehend how individuals comprehend process models when presented in three different modular formats: flattened process models, models with grouped elements, and models with subprocesses. The results shed light on varying comprehension strategies employed by participants when navigating through these modularized process models. The paper concludes by suggesting avenues for future research guided by these insights.

Call to Action: Investigating Interaction Delay in Smartphone Notifications.

Notifications are an essential part of the user experience on smart mobile devices. While some apps have to notify users immediately after an event occurs, others can schedule notifications strategically to notify them only on opportune moments. This tailoring allows apps to shorten the users' interaction delay. In this paper, we present the results of a comprehensive study that identified the factors that influence users' interaction delay to their smartphone notifications. We analyzed almost 10 million notifications collected in-the-wild from 922 users and computed their response times with regard to their demographics, their Big Five personality trait scores and the device's charging state. Depending on the app category, the following tendencies can be identified over the course of the day: Most notifications were logged in late morning and late afternoon. This number decreases in the evening, between 8 p.m. and 11 p.m., and at the same time exhibits the lowest average interaction delays at daytime. We also found that the user's sex and age is significantly associated with the response time. Based on the results of our study, we encourage developers to incorporate more information on the user and the executing device in their notification strategy to notify users more effectively.

Mobile Crowdsensing in Ecological Momentary Assessment mHealth Studies: A Systematic Review and Analysis.

As mobile devices have become a central part of our daily lives, they are also becoming increasingly important in research. In the medical context, for example, smartphones are used to collect ecologically valid and longitudinal data using Ecological Momentary Assessment (EMA), which is mostly implemented through questionnaires delivered via smart notifications. This type of data collection is intended to capture a patient's condition on a moment-to-moment and longer-term basis. To collect more objective and contextual data and to understand patients even better, researchers can not only use patients' input via EMA, but also use sensors as part of the Mobile Crowdsensing (MCS) approach. In this paper, we examine how researchers have embraced the topic of MCS in the context of EMA through a systematic literature review. This PRISMA-guided review is based on the databases PubMed, Web of Science, and EBSCOhost. It is shown through the results that both EMA research in general and the use of sensors in EMA research are steadily increasing. In addition, most of the studies reviewed used mobile apps to deliver EMA to participants, used a fixed-time prompting strategy, and used signal-contingent or interval-contingent self-assessment as sampling/assessment strategies. The most commonly used sensors in EMA studies are the accelerometer and GPS. In most studies, these sensors are used for simple data collection, but sensor data are also commonly used to verify study participant responses and, less commonly, to trigger EMA prompts. Security and privacy aspects are addressed in only a subset of mHealth EMA publications. Moreover, we found that EMA adherence was negatively correlated with the total number of prompts and was higher in studies using a microinteraction-based EMA (µEMA) approach as well as in studies utilizing sensors. Overall, we envision that the potential of the technological capabilities of smartphones and sensors could be better exploited in future, more automated approaches.

A Critical Assessment of Generative Models for Synthetic Data Augmentation on Limited Pneumonia X-ray Data.

In medical imaging, deep learning models serve as invaluable tools for expediting diagnoses and aiding specialized medical professionals in making clinical decisions. However, effectively training deep learning models typically necessitates substantial quantities of high-quality data, a resource often lacking in numerous medical imaging scenarios. One way to overcome this deficiency is to artificially generate such images. Therefore, in this comparative study we train five generative models to artificially increase the amount of available data in such a scenario. This synthetic data approach is evaluated on a a downstream classification task, predicting four causes for pneumonia as well as healthy cases on 1082 chest X-ray images. Quantitative and medical assessments show that a Generative Adversarial Network (GAN)-based approach significantly outperforms more recent diffusion-based approaches on this limited dataset with better image quality and pathological plausibility. We show that better image quality surprisingly does not translate to improved classification performance by evaluating five different classification models and varying the amount of additional training data. Class-specific metrics like precision, recall, and F1-score show a substantial improvement by using synthetic images, emphasizing the data rebalancing effect of less frequent classes. However, overall performance does not improve for most models and configurations, except for a DreamBooth approach which shows a +0.52 improvement in overall accuracy. The large variance of performance impact in this study suggests a careful consideration of utilizing generative models for limited data scenarios, especially with an unexpected negative correlation between image quality and downstream classification improvement.

Augmentation strategies for an imbalanced learning problem on a novel COVID-19 severity dataset.

Since the beginning of the COVID-19 pandemic, many different machine learning models have been developed to detect and verify COVID-19 pneumonia based on chest X-ray images. Although promising, binary models have only limited implications for medical treatment, whereas the prediction of disease severity suggests more suitable and specific treatment options. In this study, we publish severity scores for the 2358 COVID-19 positive images in the COVIDx8B dataset, creating one of the largest collections of publicly available COVID-19 severity data. Furthermore, we train and evaluate deep learning models on the newly created dataset to provide a first benchmark for the severity classification task. One of the main challenges of this dataset is the skewed class distribution, resulting in undesirable model performance for the most severe cases. We therefore propose and examine different augmentation strategies, specifically targeting majority and minority classes. Our augmentation strategies show significant improvements in precision and recall values for the rare and most severe cases. While the models might not yet fulfill medical requirements, they serve as an appropriate starting point for further research with the proposed dataset to optimize clinical resource allocation and treatment.

Exploring the usability of an internet-based intervention and its providing eHealth platform in an eye-tracking study.

The proliferation of online eHealth has made it much easier for users to access healthcare services and interventions from the comfort of their own homes. This study looks at how well one such platform-eSano-performs in terms of user experience when delivering mindfulness interventions. In order to assess usability and user experience, several tools such as eye-tracking technology, think-aloud sessions, a system usability scale questionnaire, an application questionnaire, and post-experiment interviews were employed. Participants were evaluated while they accessed the first module of the mindfulness intervention provided by eSano to measure their interaction with the app, and their level of engagement, and to obtain feedback on both the intervention and its overall usability. The results revealed that although users generally rated their experience with the app positively in terms of overall satisfaction, according to data collected through the system usability scale questionnaire, participants rated the first module of the mindfulness intervention as below average. Additionally, eye-tracking data showed that some users skipped long text blocks in favor of answering questions quickly while others spent more than half their time reading them. Henceforth, recommendations were put forward to improve both the usability and persuasiveness of the app-such as incorporating shorter text blocks and more engaging interactive elements-in order to raise adherence rates. Overall findings from this study provide valuable insights into how users interact with the eSano's participant app which can be used as guidelines for the future development of more effective and user-friendly platforms. Moreover, considering these potential improvements will help foster more positive experiences that promote regular engagement with these types of apps; taking into account emotional states and needs that vary across different age groups and abilities. Supplementary Information: The online version contains supplementary material available at 10.1007/s12652-023-04635-4.

Predicting the presence of tinnitus using ecological momentary assessments.

Mobile applications have gained popularity in healthcare in recent years. These applications are an increasingly important pillar of public health care, as they open up new possibilities for data collection and can lead to new insights into various diseases and disorders thanks to modern data analysis approaches. In this context, Ecological Momentary Assessment (EMA) is a commonly used research method that aims to assess phenomena with a focus on ecological validity and to help both the user and the researcher observe these phenomena over time. One phenomenon that benefits from this capability is the chronic condition tinnitus. TrackYourTinnitus (TYT) is an EMA-based mobile crowdsensing platform designed to provide more insight into tinnitus by repeatedly assessing various dimensions of tinnitus, including perception (i.e., perceived presence). Because the presence of tinnitus is the dimension that is of great importance to chronic tinnitus patients and changes over time in many tinnitus patients, we seek to predict the presence of tinnitus based on the not directly related dimensions of mood, stress level, arousal, and concentration level that are captured in TYT. In this work, we analyzed a dataset of 45,935 responses to a harmonized EMA questionnaire using different machine learning techniques. In addition, we considered five different subgroups after consultation with clinicians to further validate our results. Finally, we were able to predict the presence of tinnitus with an accuracy of up to 78% and an AUC of up to 85.7%.

Leveraging human expert image annotations to improve pneumonia differentiation through human knowledge distillation.

In medical imaging, deep learning models can be a critical tool to shorten time-to-diagnosis and support specialized medical staff in clinical decision making. The successful training of deep learning models usually requires large amounts of quality data, which are often not available in many medical imaging tasks. In this work we train a deep learning model on university hospital chest X-ray data, containing 1082 images. The data was reviewed, differentiated into 4 causes for pneumonia, and annotated by an expert radiologist. To successfully train a model on this small amount of complex image data, we propose a special knowledge distillation process, which we call Human Knowledge Distillation. This process enables deep learning models to utilize annotated regions in the images during the training process. This form of guidance by a human expert improves model convergence and performance. We evaluate the proposed process on our study data for multiple types of models, all of which show improved results. The best model of this study, called PneuKnowNet, shows an improvement of + 2.3% points in overall accuracy compared to a baseline model and also leads to more meaningful decision regions. Utilizing this implicit data quality-quantity trade-off can be a promising approach for many scarce data domains beyond medical imaging.

Industrial Transfer Learning for Multivariate Time Series Segmentation: A Case Study on Hydraulic Pump Testing Cycles.

Industrial data scarcity is one of the largest factors holding back the widespread use of machine learning in manufacturing. To overcome this problem, the concept of transfer learning was developed and has received much attention in recent industrial research. This paper focuses on the problem of time series segmentation and presents the first in-depth research on transfer learning for deep learning-based time series segmentation on the industrial use case of end-of-line pump testing. In particular, we investigate whether the performance of deep learning models can be increased by pretraining the network with data from other domains. Three different scenarios are analyzed: source and target data being closely related, source and target data being distantly related, and source and target data being non-related. The results demonstrate that transfer learning can enhance the performance of time series segmentation models with respect to accuracy and training speed. The benefit can be most clearly seen in scenarios where source and training data are closely related and the number of target training data samples is lowest. However, in the scenario of non-related datasets, cases of negative transfer learning were observed as well. Thus, the research emphasizes the potential, but also the challenges, of industrial transfer learning.

Self-Assessment of Having COVID-19 With the Corona Check mHealth App.

At the beginning of the COVID-19 pandemic, with a lack of knowledge about the novel virus and a lack of widely available tests, getting first feedback about being infected was not easy. To support all citizens in this respect, we developed the mobile health app Corona Check. Based on a self-reported questionnaire about symptoms and contact history, users get first feedback about a possible corona infection and advice on what to do. We developed Corona Check based on our existing software framework and released the app on Google Play and the Apple App Store on April 4, 2020. Until October 30, 2021, we collected 51,323 assessments from 35,118 users with explicit agreement of the users that their anonymized data may be used for research purposes. For 70.6% of the assessments, the users additionally shared their coarse geolocation with us. To the best of our knowledge, we are the first to report about such a large-scale study in this context of COVID-19 mHealth systems. Although users from some countries reported more symptoms on average than users from other countries, we did not find any statistically significant differences between symptom distributions (regarding country, age, and sex). Overall, the Corona Check app provided easily accessible information on corona symptoms and showed the potential to help overburdened corona telephone hotlines, especially during the beginning of the pandemic. Corona Check thus was able to support fighting the spread of the novel coronavirus. mHealth apps further prove to be valuable tools for longitudinal health data collection.

Dealing With Inaccurate Sensor Data in the Context of Mobile Crowdsensing and mHealth.

The technological capabilities and ubiquity of smart mobile devices favor the combined utilization of Ecological Momentary Assessments (EMA) and Mobile Crowdsensing (MCS). In the healthcare domain, this combination particularly enables the collection of ecologically valid and longitudinal data. Furthermore, the context in which these data are collected can be captured through the use of smartphone sensors as well as externally connected sensors. The TrackYourTinnitus (TYT) mobile platform uses these concepts to collect the user's individual subjective perception of tinnitus as well as an objective environmental sound level. However, the sound level data in the TYT database are subject to several possible sensor errors and therefore do not allow a meaningful interpretation in terms of correlation with tinnitus symptoms. To this end, a data-centric approach based on Principal Component Analysis (PCA) is proposed in this paper to cleanse MCS mHealth data sets from erroneous sensor data. To further improve the approach, additional information (i.e., responses to the EMA questionnaire) is considered in the PCA and a prior check for constant values is performed. To demonstrate the practical feasibility of the approach, in addition to TYT data, where it is generally unknown which sensor measurements are actually erroneous, a simulation with generated data was designed and performed to evaluate the performance of the approach with different parameters based on different quality metrics. The results obtained show that the approach is able to detect an average of 29.02% of the errors, with an average false-positive rate of 14.11%, yielding an overall error reduction of 22.74%.

The Impact of Coping Styles and Gender on Situational Coping: An Ecological Momentary Assessment Study With the mHealth Application TrackYourStress.

The aim of this study was to investigate the impact of different coping styles on situational coping in everyday life situations and gender differences. An ecological momentary assessment study with the mobile health app TrackYourStress was conducted with 113 participants. The coping styles Positive Thinking, Active Stress Coping, Social Support, Support in Faith, and Alcohol and Cigarette Consumption of the Stress and Coping Inventory were measured at baseline. Situational coping was assessed by the question "How well can you cope with your momentary stress level" over 4 weeks. Multilevel models were conducted to test the effects of the coping styles on situational coping. Additionally, gender differences were evaluated. Positive Thinking (p = 0.03) and Active Stress Coping (p = 0.04) had significant positive impacts on situational coping in the total sample. For women, Social Support had a significant positive effect on situational coping (p = 0.046). For men, Active Stress Coping had a significant positive effect on situational coping (p = 0.001). Women had higher scores on the SCI scale Social Support than men (p = 0.007). These results suggest that different coping styles could be more effective in daily life for women than for men. Taking this into account, interventions tailored to users' coping styles might lead to better coping outcomes than generalized interventions.

An Albanian translation of a questionnaire for self-reported tinnitus assessment.

OBJECTIVE: To our knowledge, there is no published study investigating the characteristics of people experiencing tinnitus in Albania. Such a study would be important, providing the basis for further research in this region and contributing to a wider understanding of tinnitus heterogeneity across different geographic locations. The main objective of this study was to develop an Albanian translation of a standardised questionnaire for tinnitus research, namely the European School for Interdisciplinary Tinnitus Research-Screening Questionnaire (ESIT-SQ). A secondary objective was to assess its applicability and usefulness by conducting an exploratory survey on a small sample of the Albanian tinnitus population. DESIGN AND STUDY SAMPLE: Three translators were recruited to create the Albanian ESIT-SQ translation following good practice guidelines. Using this questionnaire, data from 107 patients attending otolaryngology clinics in Albania were collected. RESULTS: Participants reporting various degrees of tinnitus symptom severity had distinct phenotypic characteristics. Application of a random forest approach on this preliminary dataset showed that self-reported hearing difficulty, and tinnitus duration, pitch and temporal manifestation were important variables for predicting tinnitus symptom severity. CONCLUSIONS: Our study provided an Albanian translation of the ESIT-SQ and demonstrated that it is a useful tool for tinnitus profiling and subgrouping.

eSano - An eHealth Platform for Internet- and Mobile-based Interventions.

The prevention and treatment of mental disorders and chronic somatic diseases is a core challenge for health care systems of the 21th century. Mental- and behavioral health interventions provide the means for lowering the public health burden. However, structural deficits, reluctance to use existing services, perceived stigma and further personal and environmental reasons restrict the uptake of these evidence-based approaches. Internet- and mobile-based interventions (IMIs) might overcome some of the limitations of on-site interventions by providing an anonymous, scalable, time- and location-independent, yet evidence-based approach. In order to implement digital mental and behavioral health concepts across the life-span into practice, a technical solution to support the design, creation, and execution of IMIs is needed. However, there are various conceptual, technical as well as legal challenges to implementing a corresponding software solution in the healthcare domain. Therefore, the work at hand (1) identifies these challenges and derives a number of respective requirements, (2) introduces the eHealth platform eSano, a software project developed by an interdisciplinary team of computer scientists, psychologists, therapists, and other domain experts, with the aim to serve as a flexible basis for mental and behavioral research and health care, and (3) provides technical insights into the developed platform and its approach to address the aforementioned requirements.

Exploring the Usability of the German COVID-19 Contact Tracing App in a Combined Eye Tracking and Retrospective Think Aloud Study.

In the course of the corona virus (COVID-19) pandemic, many digital solutions for mobile devices (e.g., apps) were presented in order to provide additional resources supporting the control of the pandemic. Contact tracing apps (i.e., identify persons who may have been in contact with a COVID-19 infected) constitute one of the most popular as well as promising solutions. However, as a prerequisite for an effective application, such apps highly depend on being used by large numbers of the population. Consequently, it is important that these apps offer a high usability for everyone. We therefore conducted an exploratory study to learn more about the usability of the German COVID-19 contact tracing app Corona-Warn-App (CWA). More specifically, N = 15 participants assessed the CWA, relying on a combined eye tracking and retrospective think aloud approach. The results indicate, on the one hand, that the CWA leaves a promising impression for pandemic control, as essential functions are easily recognized. However, on the other hand, issues were revealed (e.g., privacy policy) that could be addressed in future updates more properly.

Corona Health-A Study- and Sensor-Based Mobile App Platform Exploring Aspects of the COVID-19 Pandemic.

Physical and mental well-being during the COVID-19 pandemic is typically assessed via surveys, which might make it difficult to conduct longitudinal studies and might lead to data suffering from recall bias. Ecological momentary assessment (EMA) driven smartphone apps can help alleviate such issues, allowing for in situ recordings. Implementing such an app is not trivial, necessitates strict regulatory and legal requirements, and requires short development cycles to appropriately react to abrupt changes in the pandemic. Based on an existing app framework, we developed Corona Health, an app that serves as a platform for deploying questionnaire-based studies in combination with recordings of mobile sensors. In this paper, we present the technical details of Corona Health and provide first insights into the collected data. Through collaborative efforts from experts from public health, medicine, psychology, and computer science, we released Corona Health publicly on Google Play and the Apple App Store (in July 2020) in eight languages and attracted 7290 installations so far. Currently, five studies related to physical and mental well-being are deployed and 17,241 questionnaires have been filled out. Corona Health proves to be a viable tool for conducting research related to the COVID-19 pandemic and can serve as a blueprint for future EMA-based studies. The data we collected will substantially improve our knowledge on mental and physical health states, traits and trajectories as well as its risk and protective factors over the course of the COVID-19 pandemic and its diverse prevention measures.

Using a visual analog scale (VAS) to measure tinnitus-related distress and loudness: Investigating correlations using the Mini-TQ results of participants from the TrackYourTinnitus platform.

INTRODUCTION: Tinnitus, a perception of ringing and buzzing sound in the ear, has not been completely understood yet. It is well known that tinnitus-related distress and loudness can change over time. However, proper comparability for the data collection approaches requires further focused studies. In this context, technology such as the use of mobile devices may be a promising approach. Repeated assessments of tinnitus-related distress and loudness in Ecological Momentary Assessment (EMA) studies require a short assessment, and a Visual Analogic Scale (VAS) is often used in this context. Yet, their comparability with psychometric questionnaires remains unclear and thus was the focus of this study. Research goals: The evaluation of the appropriateness of VAS in measuring tinnitus-related distress and loudness is pursued in this paper. METHODS: The Mini Tinnitus Questionnaire (Mini-TQ) measured tinnitus-related distress once. Tinnitus-related distress and tinnitus loudness were measured repeatedly using VAS on a daily basis during 7 days in the TrackYourTinnitus (TYT) smartphone app and were summarized per day using mean and median results. Then, correlations between summarized VAS tinnitus-related distress and summarized VAS tinnitus loudness, on the one side, and Mini-TQ, on the other side, were calculated. RESULTS: Correlations between Mini-TQ and VAS tinnitus-related distress ranged between r = 0.36 and r = 0.52, while correlations between Mini-TQ and VAS tinnitus loudness ranged between r = 0.25 and r = 0.36. The more time difference between the Mini-TQ and the VAS assessments is, the lower the correlations between them. Mean and median VAS values per day resulted in similar correlations. CONCLUSIONS: Mobile-based VAS seems to be an appropriate approach to utilize daily measurements of tinnitus-related distress.