Personas for Better Targeted eHealth Technologies: User-Centered Design Approach.

BACKGROUND: The full potential of eHealth technologies to support self-management and disease management for patients with chronic diseases is not being reached. A possible explanation for these lacking results is that during the development process, insufficient attention is paid to the needs, wishes, and context of the prospective end users. To overcome such issues, the user-centered design practice of creating personas is widely accepted to ensure the fit between a technology and the target group or end users throughout all phases of development. OBJECTIVE: In this study, we integrate several approaches to persona development into the Persona Approach Twente to attain a more holistic and structured approach that aligns with the iterative process of eHealth development. METHODS: In 3 steps, a secondary analysis was carried out on different parts of the data set using the Partitioning Around Medoids clustering method. First, we used health-related electronic patient record data only. Second, we added person-related data that were gathered through interviews and questionnaires. Third, we added log data. RESULTS: In the first step, 2 clusters were found, with average silhouette widths of 0.12 and 0.27. In the second step, again 2 clusters were found, with average silhouette widths of 0.08 and 0.12. In the third step, 3 clusters were identified, with average silhouette widths of 0.09, 0.12, and 0.04. CONCLUSIONS: The Persona Approach Twente is applicable for mixed types of data and allows alignment of this user-centered design method to the iterative approach of eHealth development. A variety of characteristics can be used that stretches beyond (standardized) medical and demographic measurements. Challenges lie in data quality and fitness for (quantitative) clustering.

Integrating People, Context, and Technology in the Implementation of a Web-Based Intervention in Forensic Mental Health Care: Mixed-Methods Study.

BACKGROUND: While eMental health interventions can have many potential benefits for mental health care, implementation outcomes are often disappointing. In order to improve these outcomes, there is a need for a better understanding of complex, dynamic interactions between a broad range of implementation-related factors. These interactions and processes should be studied holistically, paying attention to factors related to context, technology, and people. OBJECTIVE: The main objective of this mixed-method study was to holistically evaluate the implementation strategies and outcomes of an eMental health intervention in an organization for forensic mental health care. METHODS: First, desk research was performed on 18 documents on the implementation process. Second, the intervention's use by 721 patients and 172 therapists was analyzed via log data. Third, semistructured interviews were conducted with all 18 therapists of one outpatient clinic to identify broad factors that influence implementation outcomes. The interviews were analyzed via a combination of deductive analysis using the nonadoption, abandonment, scale-up, spread, and sustainability framework and inductive, open coding. RESULTS: The timeline generated via desk research showed that implementation strategies focused on technical skills training of therapists. Log data analyses demonstrated that 1019 modules were started, and 18.65% (721/3865) of patients of the forensic hospital started at least one module. Of these patients, 18.0% (130/721) completed at least one module. Of the therapists using the module, 54.1% (93/172 sent at least one feedback message to a patient. The median number of feedback messages sent per therapist was 1, with a minimum of 0 and a maximum of 460. Interviews showed that therapists did not always introduce the intervention to patients and using the intervention was not part of their daily routine. Also, therapists indicated patients often did not have the required conscientiousness and literacy levels. Furthermore, they had mixed opinions about the design of the intervention. Important organization-related factors were the need for more support and better integration in organizational structures. Finally, therapists stated that despite its current low use, the intervention had the potential to improve the quality of treatment. CONCLUSIONS: Synthesis of different types of data showed that implementation outcomes were mostly disappointing. Implementation strategies focused on technical training of therapists, while little attention was paid to changes in the organization, design of the technology, and patient awareness. A more holistic approach toward implementation strategies-with more attention to the organization, patients, technology, and training therapists-might have resulted in better implementation outcomes. Overall, adaptivity appears to be an important concept in eHealth implementation: a technology should be easily adaptable to an individual patient, therapists should be trained to deal flexibly with an eMental health intervention in their treatment, and organizations should adapt their implementation strategies and structures to embed a new eHealth intervention.

Evaluating the implementation of a personal health record for chronic primary and secondary care: a mixed methods approach.

BACKGROUND: Personal health records (PHRs) provide the opportunity for self-management support, enhancing communication between patients and caregivers, and maintaining and/or improving the quality of chronic disease management. Their implementation is a multi-level and complex process, requiring a holistic approach that takes into account the technology, its users and the context of implementation. The aim of this research is to evaluate the fidelity of a PHR in chronic care (the degree to which it was implemented as intended) in order to explain the found effects. METHODS: A convergent parallel mixed methods design was used, where qualitative and quantitative data were collected in parallel, analyzed separately, and finally merged. Log data of 536 users were used to gain insight into the actual long-term use of the PHR (the dose). Focus group meetings among caregivers (n = 13) were conducted to assess program differentiation (or intended use). Interviews with caregivers (n = 28) and usability tests with potential end-users (n = 13) of the PHR were used to understand the responsiveness and the differences and similarities between the intended and actual use of the PHR. RESULTS: The results of the focus groups showed that services for coaching are strongly associated with monitoring health values and education. However, the PHR was not used that way during the study period. In the interviews, caregivers indicated that they were ignorant on how to deploy the PHR in current working routines. Therefore, they find it difficult to motivate their patients in using the PHR. Participants in the usability study indicate that they would value a PHR in the future, given that the usability will be improved and that the caregivers will use it in daily practice as well. CONCLUSIONS: In this study, actual use of the PHRs by patients was influenced by the responsiveness of caregivers. This responsiveness is likely to be strongly influenced by the perceived support when defining the differentiation and delivery of the PHR. A mixed-methods approach to understand intervention fidelity was of added value in providing explanations for the found effects that could not be revealed by solely focusing on the effectiveness of the technology in an experimental trial.

Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence.

BACKGROUND: In electronic health (eHealth) evaluations, there is increasing attention for studying the actual usage of a technology in relation to the outcomes found, often by studying the adherence to the technology. On the basis of the definition of adherence, we suggest that the following three elements are necessary to determine adherence to eHealth technology: (1) the ability to measure the usage behavior of individuals; (2) an operationalization of intended use; and (3) an empirical, theoretical, or rational justification of the intended use. However, to date, little is known on how to operationalize the intended usage of and the adherence to different types of eHealth technology. OBJECTIVE: The study aimed to improve eHealth evaluations by gaining insight into when, how, and by whom the concept of adherence has been used in previous eHealth evaluations and finding a concise way to operationalize adherence to and intended use of different eHealth technologies. METHODS: A systematic review of eHealth evaluations was conducted to gain insight into how the use of the technology was measured, how adherence to different types of technologies was operationalized, and if and how the intended use of the technology was justified. Differences in variables between the use of the technology and the operationalization of adherence were calculated using a chi-square test of independence. RESULTS: In total, 62 studies were included in this review. In 34 studies, adherence was operationalized as "the more use, the better," whereas 28 studies described a threshold for intended use of the technology as well. Out of these 28, only 6 reported a justification for the intended use. The proportion of evaluations of mental health technologies reporting a justified operationalization of intended use is lagging behind compared with evaluations of lifestyle and chronic care technologies. The results indicated that a justification of intended use does not require extra measurements to determine adherence to the technology. CONCLUSIONS: The results of this review showed that to date, justifications for intended use are often missing in evaluations of adherence. Evidently, it is not always possible to estimate the intended use of a technology. However, such measures do not meet the definition of adherence and should therefore be referred to as the actual usage of the technology. Therefore, it can be concluded that adherence to eHealth technology is an underdeveloped and often improperly used concept in the existing body of literature. When defining the intended use of a technology and selecting valid measures for adherence, the goal or the assumed working mechanisms should be leading. Adherence can then be standardized, which will improve the comparison of adherence rates to different technologies with the same goal and will provide insight into how adherence to different elements contributed to the outcomes.

'heartfailurematters.org', an educational website for patients and carers from the Heart Failure Association of the European Society of Cardiology: objectives, use and future directions.

AIMS: In 2007, the Heart Failure Association of the European Society of Cardiology (ESC) launched the information website heartfailurematters.org (HFM site) with the aim of creating a practical tool through which to provide advice and guidelines for living with heart failure to patients, their carers, health care professionals and the general public worldwide. The website is managed by the ESC at the European Heart House and is currently available in nine languages. The aim of this study is to describe the background, objectives, use, lessons learned and future directions of the HFM site. METHODS AND RESULTS: Data on the number of visitor sessions on the site as measured by Google Analytics were used to explore use of the HFM site from 2010 to 2015. Worldwide, the annual number of sessions increased from 416 345 in 2010 to 1 636 368 in 2015. Most users (72-75%) found the site by using a search engine. Desktops and, more recently, smartphones were used to visit the website, accounting for 50% and 38%, respectively, of visits to the site in 2015. CONCLUSIONS: Although its use has increased, the HFM site has not yet reached its full potential: fewer than 2 million users have visited the website, whereas the number of people living with heart failure worldwide is estimated to be 23 million. Uptake and use could be further improved by a continuous process of qualitative assessment of users' preferences, and the provision of professional helpdesk facilities, comprehensive information technology, and promotional support.

Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data.

In electronic health (eHealth) research, limited insight has been obtained on process outcomes or how the use of technology has contributed to the users' ability to have a healthier life, improved well-being, or activate new attitudes in their daily tasks. As a result, eHealth is often perceived as a black box. To open this black box of eHealth, methodologies must extend beyond the classic effect evaluations. The analyses of log data (anonymous records of real-time actions performed by each user) can provide continuous and objective insights into the actual usage of the technology. However, the possibilities of log data in eHealth research have not been exploited to their fullest extent. The aim of this paper is to describe how log data can be used to improve the evaluation and understand the use of eHealth technology with a broader approach than only descriptive statistics. This paper serves as a starting point for using log data analysis in eHealth research. Here, we describe what log data is and provide an overview of research questions to evaluate the system, the context, the users of a technology, as well as the underpinning theoretical constructs. We also explain the requirements for log data, the starting points for the data preparation, and methods for data collection. Finally, we describe methods for data analysis and draw a conclusion regarding the importance of the results for both scientific and practical applications. The analysis of log data can be of great value for opening the black box of eHealth. A deliberate log data analysis can give new insights into how the usage of the technology contributes to found effects and can thereby help to improve the persuasiveness and effectiveness of eHealth technology and the underpinning behavioral models.

Differences Between Patients With Type 2 Diabetes Mellitus Interested and Uninterested in the Use of a Patient Platform (e-VitaDM-2/ZODIAC-41).

The prevalence of type 2 diabetes mellitus (T2DM) is rising in the Netherlands, and health care's workload will increase. e-Health applications may increase patients' participation in their care and could help reducing workload. To explore potential users, differences in patients interested and uninterested in e-Health are characterized. A prospective cohort study was initiated in the Drenthe region of the Netherlands. This study included inviting T2DM patients to use e-Health (the e-Vita platform). Patients were offered access to clinical data, laboratory results, educational modules, and a self-management support program. Data were obtained from health record systems of general practices and questionnaires. Out of 2674 patients, 1378 (51.5%) participated in the study. Of the 1378 patients, 974 (70.7%) were interested in e-Health. Of 974, 405 (41.6%) were registered for e-Health. Interested patients were more often male, were younger, had shorter T2DM duration, and were higher educated. Of 405, 110 (27.2%) used the e-Health. No differences were found between users and nonusers of e-Health. Patients interested in e-Health were more often male, were younger, had shorter T2DM duration, and were more often higher educated. However, even in this interested group, the actual participation rate remained low. Together with characteristics and attitudes of caregivers and T2DM patients, the look and content of the e-Health platform strategies that increase interest and participation need to be developed.

The Added Value of Log File Analyses of the Use of a Personal Health Record for Patients With Type 2 Diabetes Mellitus: Preliminary Results.

The electronic personal health record (PHR) is a promising technology for improving the quality of chronic disease management. Until now, evaluations of such systems have provided only little insight into why a particular outcome occurred. The aim of this study is to gain insight into the navigation process (what functionalities are used, and in what sequence) of e-Vita, a PHR for patients with type 2 diabetes mellitus (T2DM), to increase the efficiency of the system and improve the long-term adherence. Log data of the first visits in the first 6 weeks after the release of a renewed version of e-Vita were analyzed to identify the usage patterns that emerge when users explore a new application. After receiving the invitation, 28% of all registered users visited e-Vita. In total, 70 unique usage patterns could be identified. When users visited the education service first, 93% of all users ended their session. Most users visited either 1 or 5 or more services during their first session, but the distribution of the routes was diffuse. In conclusion, log file analyses can provide valuable prompts for improving the system design of a PHR. In this way, the match between the system and its users and the long-term adherence has the potential to increase.

Design of the e-Vita diabetes mellitus study: effects and use of an interactive online care platform in patients with type 2 diabetes (e-VitaDM-1/ZODIAC-40).

UNLABELLED: Trial registration: NCT01570140. BACKGROUND: Due to ongoing rise in need for care for people with chronic diseases and lagging increase in number of care providers, alternative forms of care provision and self-management support are needed. Empowering patients through an online care platform could help to improve patients' self-management and reduce the burden on the healthcare system. METHODS: Access to laboratory results and educational modules on diabetes will be offered through a platform for subjects with type 2 diabetes mellitus treated in primary care. Differences in socio-demographic and clinical characteristics between subjects expressing interest vs. disinterest to use the platform will be explored. Platform usage will be tracked and compared. Patient satisfaction and quality of life will be measured by validated questionnaires and economic analyses will be performed. DISCUSSION: This study is designed to assess the feasibility of use of an online platform in routine primary healthcare for subjects with type 2 diabetes mellitus in the Netherlands, and to study effects of use of the platform on treatment satisfaction, quality of life and clinical parameters. Although providing access to a online platform is not a novel intervention, usage and effects have not yet been studied in this patient population.