Investigating Patterns of Participation in an Online Support Group for Problem Drinking: a Social Network Analysis.

PURPOSE: This study contributes to emerging literature on online health networks by modeling communication patterns between members of a moderated online support group for problem drinking. Using social network analysis, we described members' patterns of joint participation in threads, parsing out the role of site moderators, and explored differences in member characteristics by network position. METHODS: Posts made to the online support group of Alcohol Help Centre during 2013 were structured as a two-mode network of members (n = 205) connected via threads (n = 506). Metrics included degree centrality, clique membership, and tie strength. RESULTS: The network consisted of one component and no cliques of members, although most made few posts and a small number communicated only with the site's moderators. Highly active members were older and tended to have started posting prior to 2013. The distribution of members across threads varied from threads containing posts by one member to others that connected multiple members. Moderators accounted for sizable proportions of the connectivity between both members and threads. CONCLUSIONS: After 5 years of operation, the AHC online support group appears to be fairly cohesive and stable, in the sense that there were no isolated subnetworks comprised of specific types of members or devoted to specific topics. Participation and connectedness at the member-level was varied, however, and tended to be low on average. The moderators were among the most central in the network, although there were also members who emerged as central and dedicated contributors to the online discussions across topics. Study findings highlight a number of areas for consideration by online support group developers and managers.

Demographic and Indication-Specific Characteristics Have Limited Association With Social Network Engagement: Evidence From 24,954 Members of Four Health Care Support Groups.

BACKGROUND: Digital health social networks (DHSNs) are widespread, and the consensus is that they contribute to wellness by offering social support and knowledge sharing. The success of a DHSN is based on the number of participants and their consistent creation of externalities through the generation of new content. To promote network growth, it would be helpful to identify characteristics of superusers or actors who create value by generating positive network externalities. OBJECTIVE: The aim of the study was to investigate the feasibility of developing predictive models that identify potential superusers in real time. This study examined associations between posting behavior, 4 demographic variables, and 20 indication-specific variables. METHODS: Data were extracted from the custom structured query language (SQL) databases of 4 digital health behavior change interventions with DHSNs. Of these, 2 were designed to assist in the treatment of addictions (problem drinking and smoking cessation), and 2 for mental health (depressive disorder, panic disorder). To analyze posting behavior, 10 models were developed, and negative binomial regressions were conducted to examine associations between number of posts, and demographic and indication-specific variables. RESULTS: The DHSNs varied in number of days active (3658-5210), number of registrants (5049-52,396), number of actors (1085-8452), and number of posts (16,231-521,997). In the sample, all 10 models had low R2 values (.013-.086) with limited statistically significant demographic and indication-specific variables. CONCLUSIONS: Very few variables were associated with social network engagement. Although some variables were statistically significant, they did not appear to be practically significant. Based on the large number of study participants, variation in DHSN theme, and extensive time-period, we did not find strong evidence that demographic characteristics or indication severity sufficiently explain the variability in number of posts per actor. Researchers should investigate alternative models that identify superusers or other individuals who create social network externalities.

The Development and Refinement of an e-Health Screening, Brief Intervention, and Referral to Treatment for Parents to Prevent Childhood Obesity in Primary Care.

BACKGROUND: Nearly one-third of Canadian children can be categorized as overweight or obese. There is a growing interest in applying e-health approaches to prevent unhealthy weight gain in children, especially in settings that families access regularly. Our objective was to develop and refine an e-health screening, brief intervention, and referral to treatment (SBIRT) for parents to help prevent childhood obesity in primary care. MATERIALS AND METHODS: Our SBIRT, titled the Resource Information Program for Parents on Lifestyle and Education (RIPPLE), was developed by our research team and an e-health intervention development company. RIPPLE was based on existing SBIRT models and contemporary literature on children's lifestyle behaviors. Refinements to RIPPLE were guided by feedback from five focus groups (6-10 participants per group) that documented perceptions of the SBIRT by participants (healthcare professionals [n = 20], parents [n = 10], and researchers and graduate trainees [n = 8]). Focus group commentaries were transcribed in real time using a court reporter. Data were analyzed thematically. RESULTS: Participants viewed RIPPLE as a practical, well-designed, and novel tool to facilitate the prevention of childhood obesity in primary care. However, they also perceived that RIPPLE may elicit negative reactions from some parents and suggested improvements to specific elements (e.g., weight-related terms). CONCLUSIONS: RIPPLE may enhance parents' awareness of children's weight status and motivation to change their children's lifestyle behaviors but should be improved prior to implementation. Findings from this research directly informed revisions to our SBIRT, which will undergo preliminary testing in a randomized controlled trial.

Mapping Power Law Distributions in Digital Health Social Networks: Methods, Interpretations, and Practical Implications.

BACKGROUND: Social networks are common in digital health. A new stream of research is beginning to investigate the mechanisms of digital health social networks (DHSNs), how they are structured, how they function, and how their growth can be nurtured and managed. DHSNs increase in value when additional content is added, and the structure of networks may resemble the characteristics of power laws. Power laws are contrary to traditional Gaussian averages in that they demonstrate correlated phenomena. OBJECTIVES: The objective of this study is to investigate whether the distribution frequency in four DHSNs can be characterized as following a power law. A second objective is to describe the method used to determine the comparison. METHODS: Data from four DHSNs­Alcohol Help Center (AHC), Depression Center (DC), Panic Center (PC), and Stop Smoking Center (SSC)­were compared to power law distributions. To assist future researchers and managers, the 5-step methodology used to analyze and compare datasets is described. RESULTS: All four DHSNs were found to have right-skewed distributions, indicating the data were not normally distributed. When power trend lines were added to each frequency distribution, R(2) values indicated that, to a very high degree, the variance in post frequencies can be explained by actor rank (AHC .962, DC .975, PC .969, SSC .95). Spearman correlations provided further indication of the strength and statistical significance of the relationship (AHC .987. DC .967, PC .983, SSC .993, P<.001). CONCLUSIONS: This is the first study to investigate power distributions across multiple DHSNs, each addressing a unique condition. Results indicate that despite vast differences in theme, content, and length of existence, DHSNs follow properties of power laws. The structure of DHSNs is important as it gives insight to researchers and managers into the nature and mechanisms of network functionality. The 5-step process undertaken to compare actor contribution patterns can be replicated in networks that are managed by other organizations, and we conjecture that patterns observed in this study could be found in other DHSNs. Future research should analyze network growth over time and examine the characteristics and survival rates of superusers.

The 1% rule in four digital health social networks: an observational study.

BACKGROUND: In recent years, cyberculture has informally reported a phenomenon named the 1% rule, or 90-9-1 principle, which seeks to explain participatory patterns and network effects within Internet communities. The rule states that 90% of actors observe and do not participate, 9% contribute sparingly, and 1% of actors create the vast majority of new content. This 90%, 9%, and 1% are also known as Lurkers, Contributors, and Superusers, respectively. To date, very little empirical research has been conducted to verify the 1% rule. OBJECTIVE: The 1% rule is widely accepted in digital marketing. Our goal was to determine if the 1% rule applies to moderated Digital Health Social Networks (DHSNs) designed to facilitate behavior change. METHODS: To help gain insight into participatory patterns, descriptive data were extracted from four long-standing DHSNs: the AlcoholHelpCenter, DepressionCenter, PanicCenter, and StopSmokingCenter sites. RESULTS: During the study period, 63,990 actors created 578,349 posts. Less than 25% of actors made one or more posts. The applicability of the 1% rule was confirmed as Lurkers, Contributors, and Superusers accounted for a weighted average of 1.3% (n=4668), 24.0% (n=88,732), and 74.7% (n=276,034) of content. CONCLUSIONS: The 1% rule was consistent across the four DHSNs. As social network sustainability requires fresh content and timely interactions, these results are important for organizations actively promoting and managing Internet communities. Superusers generate the vast majority of traffic and create value, so their recruitment and retention is imperative for long-term success. Although Lurkers may benefit from observing interactions between Superusers and Contributors, they generate limited or no network value. The results of this study indicate that DHSNs may be optimized to produce network effects, positive externalities, and bandwagon effects. Further research in the development and expansion of DHSNs is required.

Nudges and Prompts Increase Engagement in Self-Guided Digital Health Treatment for Depression and Anxiety: Results From a 3-Arm Randomized Controlled Trial.

BACKGROUND: Accessible and effective approaches to mental health treatment are important because of common barriers such as cost, stigma, and provider shortage. The effectiveness of self-guided treatment is well established, and its use has intensified because of the COVID-19 pandemic. Engagement remains important as dose-response relationships have been observed. Platforms such as Facebook (Meta Platform, Inc), LinkedIn (Microsoft Corp), and X Corp (formerly known as Twitter, Inc) use principles of behavioral economics to increase engagement. We hypothesized that similar concepts would increase engagement in self-guided digital health. OBJECTIVE: This 3-arm randomized controlled trial aimed to test whether members of 2 digital self-health courses for anxiety and depression would engage with behavioral nudges and prompts. Our primary hypothesis was that members would click on 2 features: tips and a to-do checklist. Our secondary hypothesis was that members would prefer to engage with directive tips in arm 2 versus social proof and present bias tips in arm 3. Our tertiary hypothesis was that rotating tips and a to-do checklist would increase completion rates. The results of this study will form a baseline for future artificial intelligence-directed research. METHODS: Overall, 13,224 new members registered between November 2021 and May 2022 for Evolution Health's self-guided treatment courses for anxiety and depression. The control arm featured a member home page without nudges or prompts. Arm 2 featured a home page with a tip-of-the-day section. Arm 3 featured a home page with a tip-of-the-day section and a to-do checklist. The research protocol for this study was published in JMIR Research Protocols on August 15, 2022. RESULTS: Arm 3 had significantly younger members (F2,4564=40.97; P<.001) and significantly more female members (χ24=92.2; P<.001) than the other 2 arms. Control arm members (1788/13,224, 13.52%) completed an average of 1.5 course components. Arm 2 members (865/13,224, 6.54%) clicked on 5% of tips and completed an average of 1.8 course components. Arm 3 members (1914/13,224, 14.47%) clicked on 5% of tips, completed 2.7 of 8 to-do checklist items, and completed an average of 2.11 course components. Completion rates in arm 2 were greater than those in arm 1 (z score=3.37; P<.001), and completion rates in arm 3 were greater than those in arm 1 (z score=12.23; P<.001). Engagement in all 8 components in arm 3 was higher than that in arm 2 (z score=1.31; P<.001). CONCLUSIONS: Members engaged with behavioral nudges and prompts. The results of this study may be important because efficacy is related to increased engagement. Due to its novel approach, the outcomes of this study should be interpreted with caution and used as a guideline for future research in this nascent field. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/37231.

Superusers in social networks for smoking cessation: analysis of demographic characteristics and posting behavior from the Canadian Cancer Society's smokers' helpline online and StopSmokingCenter.net.

BACKGROUND: Online social networks are popular components of behavior-change websites. Research has identified the participation of certain network members who assume leadership roles by providing support, advice, and direction to other members. In the literature, these individuals have been variously defined as key players, posters, active users, or caretakers. Despite their identification, very little research has been conducted on the contributions or demographic characteristics of this population. For this study, we collectively categorized key players, posters, active users, and caretakers as superusers. OBJECTIVES: To analyze data from two large but distinct Web-assisted tobacco interventions (WATI) to help gain insight into superuser demographic characteristics and how they use social networks. METHODS: We extracted cross-sectional data sets containing posting behaviors and demographic characteristics from a free, publicly funded program (the Canadian Cancer Society's Smokers' Helpline Online: SHO), and a free, privately run program (StopSmokingCenter.net: SSC). RESULTS: Within the reporting period (SHO: June 26, 2008 to October 12, 2010; SSC: May 17, 2007 to October 12, 2010), 21,128 individuals registered for the SHO and 11,418 registered for the SSC. Within the same period, 1670 (7.90%) registrants made at least one post in the SHO social network, and 1627 (14.25%) registrants made at least one post in the SSC social network. SHO and SSC superusers accounted for 0.4% (n = 95) and 1.1% (n = 124) of all registrants, and 5.7% (95/1670) and 7.62% (124/1627) of all social network participants, and contributed to 34.78% (29,422/84,599) and 46.22% (61,820/133,753) of social network content, respectively. Despite vast differences in promotion and group management rules, and contrary to the beliefs of group moderators, there were no statistically significant differences in demographic characteristics between the two superuser groups. CONCLUSIONS: To our knowledge, this is the first study that compared demographic characteristics and posting behavior from two separate eHealth social networks. Despite vast differences in promotional efforts and management styles, both WATI attracted superusers with similar characteristics. As superusers drive network traffic, organizations promoting or supporting WATI should dedicate resources to encourage superuser participation. Further research regarding member dynamics and optimization of social networks for health care purposes is required.

Testing Behavioral Nudges and Prompts in Digital Courses for the Self-guided Treatment of Depression and Anxiety: Protocol for a 3-Arm Randomized Controlled Trial.

BACKGROUND: Despite showing strong evidence of positive outcomes, a common problem in the field of digital health is poor engagement and adherence. Non-health care, for-profit digital ventures, such as Facebook, LinkedIn, and Twitter, conduct behavioral experiments to increase user engagement. To our knowledge, digital health organizations have not published similar types of experiments in ad libitum environments, and there are limited published data indicating whether nudges and prompts can be leveraged to increase engagement with digital health interventions. OBJECTIVE: The main objective of our 3-arm randomized controlled trial is to test whether registered members in two well-established digital health courses for anxiety and depression will engage with four different types of nudges and prompts, and whether engaging with nudges and prompts increases engagement within the courses. METHODS: New members who register for the self-guided anxiety and depression courses on the Evolution Health platform will be randomized into 1 of 3 arms. The first control arm will feature a member home page without any behavioral nudges or prompts. The second arm will feature a member home page with a Tip-of-the-Day section containing directive content. Arm 3 will feature a member home page with a Tip-of-the-Day section containing social proof and present bias content. The third arm will also feature a to-do item checklist. RESULTS: The experiment was designed in August 2021 and was launched in November 2021. Initially, we will measure engagement with the tips and the to-do checklist by calculating the frequency of use by age and gender. If members do engage, we will then, according to age and gender, examine whether nudges and prompts result in higher course completion rates and whether specific types of prompts and nudges are more popular than others. CONCLUSIONS: Our 3-arm randomized controlled trial will be the first to compare four distinct types of behavioral prompts and nudges in two self-guided digital health courses that were designed to treat mental health issues. We expect the results to generate insights into which types of behavioral prompts and nudges work best in the population. If they are shown to increase engagement, the insights will then be used to apply prompts and nudges to the platform's addiction-focused courses. Based on the results of the experiment, the insights will be applied to using artificial intelligence to train the platform to recognize different usage patterns and provide specific engagement recommendations to stratified users. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/37231.

A Digital Health Tool to Understand and Prevent Cannabis-Impaired Driving Among Youth: A Cross-sectional Study of Responses to a Brief Intervention for Cannabis Use.

BACKGROUND: Cannabis legalization has raised concern about an increased risk of cannabis-impaired driving, particularly among youth. Youth advocates and policy makers require cost-effective tools to target educational resources to promote responsible cannabis use. OBJECTIVE: The objective of this paper is threefold. First, it describes how a youth advocacy organization disseminated a low-cost digital brief intervention to educate and inform young people about responsible cannabis use. Second, it illustrates how digital tools can help promote understanding about attitudes and behaviors toward cannabis while simultaneously offering tailored education. Finally, this paper contributes to examining behavioral factors associated with youth cannabis-impaired driving by quantifying relationships between cannabis users' willingness to drive impaired and self-reported demographic and behavioral factors. METHODS: This paper analyzed data from 1110 completed Check Your Cannabis (CYC) brief interventions between March 2019 and October 2020. The CYC asks respondents a brief set of questions about their cannabis use and their personal beliefs and behaviors. Respondents receive comprehensive feedback about their cannabis use and how it compares with others. They also receive a summary of reported behaviors with brief advice. An ordered probit model was used to test relationships between cannabis use, demographics, and driving behaviors to gain further insights. RESULTS: The vast majority (817/1110, 73.6%) of respondents reported using cannabis. However, a much smaller share of respondents reported problems associated with their cannabis use (257/1110, 23.2%) or driving after cannabis use (342/1110, 30.8%). We found statistically significant relationships between driving after cannabis use and age; Alcohol, Smoking, and Substance Involvement Screening Test (ASSIST) risk score; and polysubstance use. However, we did not find gender to be a significant determinant of driving after cannabis use. We estimated that every 10-point increase in the ASSIST score increased the probability of sometimes driving after cannabis use by 7.3% (P<.001). Relative to respondents who reported never drinking alcohol or using other substances with cannabis, those who sometimes drink or use other substances with cannabis were 13% (P<.001) more likely to sometimes or always drive after using cannabis. CONCLUSIONS: The digital health tool cost the youth advocacy organization approximately Can $0.90 (US $0.71) per use. Due to the tool's unlimited use structure, the per-use cost would further decrease with increased use by the organization's target population. Based on our results, public health campaigns and other interventions may consider tailoring resources to frequent cannabis users, youth with high ASSIST scores, and those with polysubstance abuse. The cost-effectiveness of delivering digital brief interventions with unlimited use is attractive, as increased use decreases the per-user cost. Further research examining the efficacy of digital health interventions targeting problematic cannabis use is required.

Twelve-month follow-up results from a randomized controlled trial of a brief personalized feedback intervention for problem drinkers.

AIMS: To examine the impact of a web-based personalized feedback intervention, the Check Your Drinking (CYD; www.CheckYourDrinking.net) screener at 12-month follow-up. METHODS: Respondents (N = 185) were recruited from a general population telephone survey of Ontario, Canadian adults (> or =18 years) by asking risky drinkers if they were willing to help develop and evaluate Internet-based interventions for drinkers. Those randomly assigned to the intervention condition were provided with the web address and a unique password to a study-specific copy of the CYD. Respondents assigned to the control condition were sent a written description of the different components of the CYD and asked how useful they thought each of the components might be. Respondents were followed up at 3, 6 and 12 months. RESULTS: By the 12-month follow-up, the impact of the intervention previously reported at 3 and 6 months of CYD on problem drinkers' alcohol consumption was no longer apparent (P > 0.05). CONCLUSIONS: Recognizing that many people with alcohol concerns will never seek treatment, recent years have seen an increase in efforts to find ways to take treatment to problem drinkers. The CYD is one such intervention that has a demonstrated effect on reducing alcohol consumption in the short term (i.e. 6 months). Other more intensive Internet-based interventions or interventions via other modalities may enhance this positive outcome over the short and long term among problem drinkers who would be otherwise unlikely to access treatment for their alcohol concerns.

Utilization patterns and user characteristics of an ad libitum Internet weight loss program.

BACKGROUND: The Internet holds promise for the delivery of evidence-based weight loss treatment to underserved populations. However, most studies do not reflect the more naturalistic and common ad libitum, or freely at will, use of the Internet. Randomized clinical trials, for example, typically include at least some direct contact with participants and often have restrictive selection criteria. There is a paucity of research examining utilization patterns of online weight loss programs, particularly in the rapidly expanding direct-to-consumer arena. OBJECTIVES: To examine self-reported characteristics (age, body mass index [BMI], gender), behaviors, and Internet site utilization patterns of a sample of users of a direct-to-consumer ad libitum Internet weight loss program. METHODS: This study is based on analysis of archival data from the initial 15 weeks of an ongoing, free, evidence-based, direct-to-consumer Internet weight loss program, the Healthy Weight Center, which included standard information about nutrition, fitness, and behavioral strategies; monitoring tools; and moderated support group message boards. Participants encountered the program through self-directed Internet searches and anonymously registered to utilize the site. Self-reported user characteristics and electronically tracked utilization data were extracted from existing program data, compiled, and examined. Pearson correlations were computed to examine the association of program utilization with age and BMI. One-way analysis of variance (ANOVA) was used for gender comparisons. RESULTS: We examined data from the first 204 adult users of the program who were classified as either overweight (BMI 25 to < 30 kg/m(2)) or obese (BMI > or = 30 kg/m(2)). The mean age of participants was 42.0 years (SD 11.7), 81.9% (167/204) were women, and mean BMI was 32.01 kg/m(2) (SD 6.26). The percent of participants who used program tools was as follows: 13.7%, meal planner; 10.8%, nutrition lookup: 17.6%, activity log; 14.2%, journal; and 22.1%, weight tracker. Participants also used the following educational resources: nutrition, 13.2%; fitness, 6.4%; and behavioral, 7.4%. Of the personal self-assessments available through the program, 57.8% of participants assessed personal barriers, and 50.5% assessed relationship with food. Only 7.8% used the support group message boards. No significant associations between site utilization and age, gender, or BMI were found. Reasons for wanting to lose weight were: health, 87%; appearance, 74%; mobility, 44%; doctor recommendation, 23%; and spouse/friend suggested, 12%. The age participants reported first becoming overweight was young adulthood, 31%; late adulthood, 28%; childhood, 22%; adolescence, 17%; and as a toddler, 3%. Self-perceived factors contributing to weight gain were lack of exercise for 70% of participants, emotions for 62%, overeating for 61%, and slow metabolism for 33%. CONCLUSIONS: Internet weight loss programs reach many people who cannot access traditional treatment. However, users appear not to be optimally utilizing key aspects of the weight loss intervention, such as education, monitoring, and support. This study provides insight into the patterns of ad libitum use of an online weight loss program across multiple treatment-related domains in a naturalistic Internet environment.

Online social and professional support for smokers trying to quit: an exploration of first time posts from 2562 members.

BACKGROUND: Both intratreatment and extratreatment social support are associated with increased rates of smoking cessation. Internet-based social support groups have the capability of connecting widely dispersed groups of people trying to quit smoking, making social support available 24 hours a day, seven days a week, at minimal cost. However, to date there has been little research to guide development of this particular feature of Web-assisted tobacco interventions (WATIs). OBJECTIVE: Our objectives were to compare the characteristics of smokers who post in an online smoking cessation support group with smokers who do not post, conduct a qualitative analysis of discussion board content, and determine the time it takes for new users to receive feedback from existing members or moderators. METHODS: Data were collected from StopSmokingCenter.net version 5.0, a WATI equipped with an online social support network moderated by trained program health educators that was operational from November 6, 2004, to May 15, 2007. Demographic and smoking characteristics for both users and nonusers of the online social support network were analyzed, and qualitative analyses were conducted to explore themes in message content. Posting patterns and their frequency were also analyzed. RESULTS: During the study period, 16,764 individuals registered; of these, 70% (11,723) reported being American. The mean age of registrants was 38.9 years and 65% (10,965) were female. The mean number of cigarettes smoked was 20.6 per day. The mean score for the 41% (6849) of users who completed the Fagerström Test for Nicotine Dependence was 5.6. Of all registered members, 15% (2562) made at least one post in the online social support network; 25% of first posts received a response from another member within 12 minutes, 50% within 29 minutes. The most frequent first posts were from recent quitters who were struggling with their quit attempts, and most responses were from members who had quit for a month or more. Differences in demographic and smoking characteristics between members who posted on the support group board at least once and those who did not post were statistically but not clinically significant. CONCLUSIONS: Peer responses to new users were rapid, indicating that online social support networks may be particularly beneficial to smokers requiring more immediate assistance with their cessation attempt. This function may be especially advantageous for relapse prevention. Accessing this kind of rapid in-person support from a professional would take an inordinate amount of time and money. Further research regarding the effectiveness of WATIs with online social support networks is required to better understand the contribution of this feature to cessation, for both active users (posters) and passive users ("lurkers") alike.

An online support group for problem drinkers: AlcoholHelpCenter.net.

OBJECTIVE: Social support networks have been identified as one factor that can help people resolve their problem drinking. A relatively new phenomenon is online support groups, such as the one provided on the Alcohol Help Center (AHC; http://www.alcoholhelpcenter.net). Preliminary use of the AHC support group will be summarized and lessons learned in the initial development of an online support group will be discussed. METHODS: The AHC support group can be viewed by anyone interested in its content. However, only registered users of the AHC can make postings and trained professional staff moderates all support group content. The amount and content of traffic on this support group were recorded. Qualitative analyses were conducted to identify the types of message content. RESULTS: There were 674 posts on the AHC during the first 10 months of operation, including those made by the professional moderators. Content analyses of these postings identified common themes, including introductions, greetings, general supportive statements, suggested strategies, success stories, and discussion of difficulties. In addition, it appeared that the amount of traffic on the support group varied over time and clustered around nodes that consisted of one or more active users. This variation in traffic may disappear over time as overall use of the AHC support group increases. CONCLUSIONS: Online support groups are developing into a new venue of support for those with drinking problems and other addictions concerns. PRACTICE IMPLICATIONS: Consider referring clients to an online, professionally moderated, support group as another means to help problem drinkers.

An Assessment Framework for e-Mental Health Apps in Canada: Results of a Modified Delphi Process.

BACKGROUND: The number of e-mental health apps is increasing rapidly. Studies have shown that the use of some apps is beneficial, whereas others are ineffective or do not meet users' privacy expectations. Individuals and organizations that curate, recommend, host, use, or pay for apps have an interest in categorizing apps according to the consensus criteria of usability and effectiveness. Others have previously published recommendations for assessing health-related apps; however, the extent to which these recommendations can be generalized across different population groups (eg, culture, gender, and language) remains unclear. This study describes an attempt by Canadian stakeholders to develop an e-mental health assessment framework that responds to the unique needs of people living in Canada in an evidence-based manner. OBJECTIVE: The objective of our study was to achieve consensus from a broad group of Canadian stakeholders on guiding principles and criteria for a framework to assess e-mental health apps in Canada. METHODS: We developed an initial set of guiding principles and criteria from a rapid review and environmental scan of pre-existing app assessment frameworks. The initial list was refined through a two-round modified Delphi process. Participants (N=25) included app developers and users, health care providers, mental health advocates, people with lived experience of a mental health problem or mental illness, policy makers, and researchers. Consensus on each guideline or criterion was defined a priori as at least 70% agreement. The first round of voting was conducted electronically. Prior to Round 2 voting, in-person presentations from experts and a persona empathy mapping process were used to explore the perspectives of diverse stakeholders. RESULTS: Of all respondents, 68% (17/25) in Round 1 and 100% (13/13) in Round 2 agreed that a framework for evaluating health apps is needed to help Canadian consumers identify high-quality apps. Consensus was reached on 9 guiding principles: evidence based, gender responsive, culturally appropriate, user centered, risk based, internationally aligned, enabling innovation, transparent and fair, and based on ethical norms. In addition, 15 informative and evaluative criteria were defined to assess the effectiveness, functionality, clinical applicability, interoperability, usability, transparency regarding security and privacy, security or privacy standards, supported platforms, targeted users, developers' transparency, funding transparency, price, user desirability, user inclusion, and meaningful inclusion of a diverse range of communities. CONCLUSIONS: Canadian mental health stakeholders reached the consensus on a framework of 9 guiding principles and 15 criteria important in assessing e-mental health apps. What differentiates the Canadian framework from other scales is explicit attention to user inclusion at all stages of the development, gender responsiveness, and cultural appropriateness. Furthermore, an empathy mapping process markedly influenced the development of the framework. This framework may be used to inform future mental health policies and programs.

Formative evaluation and three-month follow-up of an online personalized assessment feedback intervention for problem drinkers.

BACKGROUND: In recent years, online services for problem drinkers have been developed. This paper describes ongoing efforts to improve one of these services, the Alcohol Help Center. OBJECTIVE: This report summarizes new modules added to the Check Your Drinking (CYD) screener, a component of the Alcohol Help Center, to make the CYD screener more useful to periodic heavy drinkers, as well as to regular alcohol consumers. Participants' initial reactions to the CYD screener and the changes in their drinking habits at a three-month follow-up are presented. METHODS: The CYD screener provides a free personalized Final Report that compares the user's drinking to that of others in the general population of the same age, gender, and country of origin. Current alcohol consumption and demographic characteristics are collected as part of the CYD screening process. After users were presented with a customized Final Report, they were hot-linked to a volunteer feedback survey. The voluntary feedback survey asked about impressions of the CYD Final Report. Respondents agreeing to participate were sent a follow-up survey after three months. RESULTS: We recruited 388 volunteers (69% female) who were registered users of another free-to-consumer online eHealth service. Of the 343 respondents agreeing to participate in the three-month follow-up, 138 accessed the survey, and 97 provided complete data (participation rate = 40%; completion rate = 70%). Compared to moderate drinkers, current problem drinkers judged the Final Report to be more useful (34% vs. 69%, chi2 (1) = 41.5, P < .001) and accurate (43% vs. 76%, chi2 (1) = 36.0, P < .001). Respondents who participated in the three-month follow-up displayed reductions in drinking compared to baseline (F(4,76) = 12.2, P = .001). CONCLUSIONS: Improvements can still be made to make the CYD screener more relevant to specific populations, particularly periodic heavy drinkers. There is a need to further tailor algorithms that can present questions only relevant to specific populations. There also appears to be a need to further customize the Final Report for respondents who identify themselves as infrequent heavy drinkers. These improvements will be made, and a randomized controlled trial is planned to conduct a rigorous evaluation of the CYD screener as an intervention to help problem drinkers.

Employing the Gini coefficient to measure participation inequality in treatment-focused Digital Health Social Networks.

Digital Health Social Networks (DHSNs) are common; however, there are few metrics that can be used to identify participation inequality. The objective of this study was to investigate whether the Gini coefficient, an economic measure of statistical dispersion traditionally used to measure income inequality, could be employed to measure DHSN inequality. Quarterly Gini coefficients were derived from four long-standing DHSNs. The combined data set included 625,736 posts that were generated from 15,181 actors over 18,671 days. The range of actors (8-2323), posts (29-28,684), and Gini coefficients (0.15-0.37) varied. Pearson correlations indicated statistically significant associations between number of actors and number of posts (0.527-0.835, p < .001), and Gini coefficients and number of posts (0.342-0.725, p < .001). However, the association between Gini coefficient and number of actors was only statistically significant for the addiction networks (0.619 and 0.276, p < .036). Linear regression models had positive but mixed R2 results (0.333-0.527). In all four regression models, the association between Gini coefficient and posts was statistically significant (t = 3.346-7.381, p < .002). However, unlike the Pearson correlations, the association between Gini coefficient and number of actors was only statistically significant in the two mental health networks (t = -4.305 and -5.934, p < .000). The Gini coefficient is helpful in measuring shifts in DHSN inequality. However, as a standalone metric, the Gini coefficient does not indicate optimal numbers or ratios of actors to posts, or effective network engagement. Further, mixed-methods research investigating quantitative performance metrics is required.

Behavioral Economics, Wearable Devices, and Cooperative Games: Results From a Population-Based Intervention to Increase Physical Activity.

BACKGROUND: Health care literature supports the development of accessible interventions that integrate behavioral economics, wearable devices, principles of evidence-based behavior change, and community support. However, there are limited real-world examples of large scale, population-based, member-driven reward platforms. Subsequently, a paucity of outcome data exists and health economic effects remain largely theoretical. To complicate matters, an emerging area of research is defining the role of Superusers, the small percentage of unusually engaged digital health participants who may influence other members. OBJECTIVE: The objective of this preliminary study is to analyze descriptive data from GOODcoins, a self-guided, free-to-consumer engagement and rewards platform incentivizing walking, running and cycling. Registered members accessed the GOODcoins platform through PCs, tablets or mobile devices, and had the opportunity to sync wearables to track activity. Following registration, members were encouraged to join gamified group challenges and compare their progress with that of others. As members met challenge targets, they were rewarded with GOODcoins, which could be redeemed for planet- or people-friendly products. METHODS: Outcome data were obtained from the GOODcoins custom SQL database. The reporting period was December 1, 2014 to May 1, 2015. Descriptive self-report data were analyzed using MySQL and MS Excel. RESULTS: The study period includes data from 1298 users who were connected to an exercise tracking device. Females consisted of 52.6% (n=683) of the study population, 33.7% (n=438) were between the ages of 20-29, and 24.8% (n=322) were between the ages of 30-39. 77.5% (n=1006) of connected and active members met daily-recommended physical activity guidelines of 30 minutes, with a total daily average activity of 107 minutes (95% CI 90, 124). Of all connected and active users, 96.1% (n=1248) listed walking as their primary activity. For members who exchanged GOODcoins, the mean balance was 4,000 (95% CI 3850, 4150) at time of redemption, and 50.4% (n=61) of exchanges were for fitness or outdoor products, while 4.1% (n=5) were for food-related items. Participants were most likely to complete challenges when rewards were between 201-300 GOODcoins. CONCLUSIONS: The purpose of this study is to form a baseline for future research. Overall, results indicate that challenges and incentives may be effective for connected and active members, and may play a role in achieving daily-recommended activity guidelines. Registrants were typically younger, walking was the primary activity, and rewards were mainly exchanged for fitness or outdoor products. Remaining to be determined is whether members were already physically active at time of registration and are representative of healthy adherers, or were previously inactive and were incentivized to change their behavior. As challenges are gamified, there is an opportunity to investigate the role of superusers and healthy adherers, impacts on behavioral norms, and how cooperative games and incentives can be leveraged across stratified populations. Study limitations and future research agendas are discussed.

Targeting Medication Non-Adherence Behavior in Selected Autoimmune Diseases: A Systematic Approach to Digital Health Program Development.

BACKGROUND: 29 autoimmune diseases, including Rheumatoid Arthritis, gout, Crohn's Disease, and Systematic Lupus Erythematosus affect 7.6-9.4% of the population. While effective therapy is available, many patients do not follow treatment or use medications as directed. Digital health and Web 2.0 interventions have demonstrated much promise in increasing medication and treatment adherence, but to date many Internet tools have proven disappointing. In fact, most digital interventions continue to suffer from high attrition in patient populations, are burdensome for healthcare professionals, and have relatively short life spans. OBJECTIVE: Digital health tools have traditionally centered on the transformation of existing interventions (such as diaries, trackers, stage-based or cognitive behavioral therapy programs, coupons, or symptom checklists) to electronic format. Advanced digital interventions have also incorporated attributes of Web 2.0 such as social networking, text messaging, and the use of video. Despite these efforts, there has not been little measurable impact in non-adherence for illnesses that require medical interventions, and research must look to other strategies or development methodologies. As a first step in investigating the feasibility of developing such a tool, the objective of the current study is to systematically rate factors of non-adherence that have been reported in past research studies. METHODS: Grounded Theory, recognized as a rigorous method that facilitates the emergence of new themes through systematic analysis, data collection and coding, was used to analyze quantitative, qualitative and mixed method studies addressing the following autoimmune diseases: Rheumatoid Arthritis, gout, Crohn's Disease, Systematic Lupus Erythematosus, and inflammatory bowel disease. Studies were only included if they contained primary data addressing the relationship with non-adherence. RESULTS: Out of the 27 studies, four non-modifiable and 11 modifiable risk factors were discovered. Over one third of articles identified the following risk factors as common contributors to medication non-adherence (percent of studies reporting): patients not understanding treatment (44%), side effects (41%), age (37%), dose regimen (33%), and perceived medication ineffectiveness (33%). An unanticipated finding that emerged was the need for risk stratification tools (81%) with patient-centric approaches (67%). CONCLUSIONS: This study systematically identifies and categorizes medication non-adherence risk factors in select autoimmune diseases. Findings indicate that patients understanding of their disease and the role of medication are paramount. An unexpected finding was that the majority of research articles called for the creation of tailored, patient-centric interventions that dispel personal misconceptions about disease, pharmacotherapy, and how the body responds to treatment. To our knowledge, these interventions do not yet exist in digital format. Rather than adopting a systems level approach, digital health programs should focus on cohorts with heterogeneous needs, and develop tailored interventions based on individual non-adherence patterns.

Don't Forget the Doctor: Gastroenterologists' Preferences on the Development of mHealth Tools for Inflammatory Bowel Disease.

BACKGROUND: Inflammatory bowel disease (IBD) encompasses a number of disorders of the gastrointestinal tract. Treatment for IBD is lifelong and complex, and the majority of IBD patients seek information on the Internet. However, research has found existing digital resources to be of questionable quality and that patients find content lacking. Gastroenterologists are frontline sources of information for North American IBD patients, but their opinions and preferences for digital content, design, and utility have not been investigated. The purpose of this study is to systematically explore gastroenterologists' perceptions of, and design preferences for, mHealth tools. OBJECTIVE: Our goal was to critically assess these issues and elicit expert feedback by seeking consensus with Canadian gastroenterologists. METHODS: Using a qualitative approach, a closed meeting with 7 gastroenterologists was audio recorded and field notes taken. To synthesize results, an anonymous questionnaire was collected at the end of the session. Participant-led discussion themes included methodological approaches to non-adherence, concordance, patient-centricity, and attributes of digital tools that would be actively supported and promoted. RESULTS: Survey results indicated that 4 of the 7 gastroenterologists had experienced patients bringing digital resources to a visit, but 5 found digital patient resources to be inaccurate or irrelevant. All participants agreed that digital tools were of increasing importance and could be leveraged to aid in consultations and save time. When asked to assess digital attributes that they would be confident to refer patients to, all seven indicated that the inclusion of evidence-based facts were of greatest importance. Patient peer-support networks were deemed an asset but only if closely monitored by experts. When asked about interventions, nearly all (6/7) preferred tools that addressed a mix of compliance and concordance, and only one supported the development of tools that focused on compliance. Participants confirmed that they would actively refer patients and other physicians to digital resources. However, while a number of digital IBD tools exist, gastroenterologists would be reluctant to endorse them. CONCLUSIONS: Gastroenterologists appear eager to use digital resources that they believe benefit the physician-patient relationship, but despite the trend of patient-centric tools that focus on concordance (shared decision making and enlightened communication between patients and their health care providers), they would prefer digital tools that highlight compliance (patient following orders). This concordance gap highlights an issue of disparity in digital health: patients may not use tools that physicians promote, and physicians may not endorse tools that patients will use. Further research investigating the concordance gap, and tensions between physician preferences and patient needs, is required.

Lessons Learned From Using Focus Groups to Refine Digital Interventions.

There is growing interest in applying novel eHealth approaches for the prevention and management of various health conditions, with the ultimate goal of increasing positive patient outcomes and improving the effectiveness and efficiency of health services delivery. Coupled with the use of innovative approaches is the possibility for adverse outcomes, highlighting the need to strategically refine digital practices prior to implementation with patients. One appropriate method for modification purposes includes focus groups. Although it is a well-established method in qualitative research, there is a lack of guidance regarding the use of focus groups for digital intervention refinement. To address this gap, the purpose of our paper is to highlight several lessons our research team has learned in using focus groups to help refine digital interventions prior to use with patients.