Lessons Learned: Beta-Testing the Digital Health Checklist for Researchers Prompts a Call to Action by Behavioral Scientists.

Digital technologies offer unique opportunities for health research. For example, Twitter posts can support public health surveillance to identify outbreaks (eg, influenza and COVID-19), and a wearable fitness tracker can provide real-time data collection to assess the effectiveness of a behavior change intervention. With these opportunities, it is necessary to consider the potential risks and benefits to research participants when using digital tools or strategies. Researchers need to be involved in the risk assessment process, as many tools in the marketplace (eg, wellness apps, fitness sensors) are underregulated. However, there is little guidance to assist researchers and institutional review boards in their evaluation of digital tools for research purposes. To address this gap, the Digital Health Checklist for Researchers (DHC-R) was developed as a decision support tool. A participatory research approach involving a group of behavioral scientists was used to inform DHC-R development. Scientists beta-tested the checklist by retrospectively evaluating the technologies they had chosen for use in their research. This paper describes the lessons learned because of their involvement in the beta-testing process and concludes with recommendations for how the DHC-R could be useful for a variety of digital health stakeholders. Recommendations focus on future research and policy development to support research ethics, including the development of best practices to advance safe and responsible digital health research.

Modelling multiple health behavior change with network analyses: results from a one-year study conducted among overweight and obese adults.

This study examined the between-person associations of seven health behaviors in adults with obesity participating in a weight loss intervention, as well as the covariations between these behaviors within-individuals across the intervention. The present study included data from a 12-month weight loss trial (N = 278). Seven health behaviors (physical activity, sedentary behavior, sleep duration, and consumption of fruits, vegetables, total fat and added sugar) were measured at baseline, 6- and 12-months. Between- and within-participants network analyses were conducted to examine how these behaviors were associated through the 12-month intervention and covaried across months. At the between-participants level, associations were found within the different diet behaviors and between total fat and sedentary behaviors. At the within-participants level, covariations were found between sedentary and diet behaviors, and within diet behaviors. Findings suggest that successful multiple health behaviors change interventions among adults with obesity will need to (1) simultaneously target sedentary and diet behaviors; and (2) prevent potential compensatory behaviors in the diet domain.

Development of a Control-Oriented Model of Social Cognitive Theory for Optimized mHealth Behavioral Interventions.

Mobile health (mHealth) technologies are contributing to the increasing relevance of control engineering principles in understanding and improving health behaviors, such as physical activity. Social Cognitive Theory (SCT), one of the most influential theories of health behavior, has been used as the conceptual basis for behavioral interventions for smoking cessation, weight management, and other health-related outcomes. This paper presents a control-oriented dynamical systems model of SCT based on fluid analogies that can be used in system identification and control design problems relevant to the design and analysis of intensively adaptive interventions. Following model development, a series of simulation scenarios illustrating the basic workings of the model are presented. The model's usefulness is demonstrated in the solution of two important practical problems: 1) semiphysical model estimation from data gathered in a physical activity intervention (the MILES study) and 2) as a means for discerning the range of "ambitious but doable" daily step goals in a closed-loop behavioral intervention aimed at sedentary adults. The model is the basis for ongoing experimental validation efforts, and should encourage additional research in applying control engineering technologies to the social and behavioral sciences.

Why we need a small data paradigm.

BACKGROUND: There is great interest in and excitement about the concept of personalized or precision medicine and, in particular, advancing this vision via various 'big data' efforts. While these methods are necessary, they are insufficient to achieve the full personalized medicine promise. A rigorous, complementary 'small data' paradigm that can function both autonomously from and in collaboration with big data is also needed. By 'small data' we build on Estrin's formulation and refer to the rigorous use of data by and for a specific N-of-1 unit (i.e., a single person, clinic, hospital, healthcare system, community, city, etc.) to facilitate improved individual-level description, prediction and, ultimately, control for that specific unit. MAIN BODY: The purpose of this piece is to articulate why a small data paradigm is needed and is valuable in itself, and to provide initial directions for future work that can advance study designs and data analytic techniques for a small data approach to precision health. Scientifically, the central value of a small data approach is that it can uniquely manage complex, dynamic, multi-causal, idiosyncratically manifesting phenomena, such as chronic diseases, in comparison to big data. Beyond this, a small data approach better aligns the goals of science and practice, which can result in more rapid agile learning with less data. There is also, feasibly, a unique pathway towards transportable knowledge from a small data approach, which is complementary to a big data approach. Future work should (1) further refine appropriate methods for a small data approach; (2) advance strategies for better integrating a small data approach into real-world practices; and (3) advance ways of actively integrating the strengths and limitations from both small and big data approaches into a unified scientific knowledge base that is linked via a robust science of causality. CONCLUSION: Small data is valuable in its own right. That said, small and big data paradigms can and should be combined via a foundational science of causality. With these approaches combined, the vision of precision health can be achieved.

Efficacy of Contextually Tailored Suggestions for Physical Activity: A Micro-randomized Optimization Trial of HeartSteps.

BACKGROUND: HeartSteps is an mHealth intervention that encourages regular walking via activity suggestions tailored to the individuals' current context. PURPOSE: We conducted a micro-randomized trial (MRT) to evaluate the efficacy of HeartSteps' activity suggestions to optimize the intervention. METHODS: We conducted a 6-week MRT with 44 adults. Contextually tailored suggestions could be delivered up to five times per day at user-selected times. At each of these five times, for each participant on each day of the study, HeartSteps randomized whether to provide an activity suggestion, and, if so, whether to provide a walking or an antisedentary suggestion. We used a centered and weighted least squares method to analyze the effect of suggestions on the 30-min step count following suggestion randomization. RESULTS: Averaging over study days and types of activity suggestions, delivering a suggestion versus no suggestion increased the 30-min step count by 14% (p = .06), 35 additional steps over the 253-step average. The effect was not evenly distributed in time. Providing any type of suggestion versus no suggestion initially increased the step count by 66% (167 steps; p < .01), but this effect diminished over time. Averaging over study days, delivering a walking suggestion versus no suggestion increased the average step count by 24% (59 steps; p = .02). This increase was greater at the start of study (107% or 271 additional steps; p < .01), but decreased over time. Antisedentary suggestions had no detectable effect on the 30-min step count. CONCLUSION: Contextually tailored walking suggestions are a promising way of initiating bouts of walking throughout the day. CLINICAL TRIAL INFORMATION: This study was registered on ClinicalTrials.gov number NCT03225521.

The history and future of digital health in the field of behavioral medicine.

Since its earliest days, the field of behavioral medicine has leveraged technology to increase the reach and effectiveness of its interventions. Here, we highlight key areas of opportunity and recommend next steps to further advance intervention development, evaluation, and commercialization with a focus on three technologies: mobile applications (apps), social media, and wearable devices. Ultimately, we argue that future of digital health behavioral science research lies in finding ways to advance more robust academic-industry partnerships. These include academics consciously working towards preparing and training the work force of the twenty first century for digital health, actively working towards advancing methods that can balance the needs for efficiency in industry with the desire for rigor and reproducibility in academia, and the need to advance common practices and procedures that support more ethical practices for promoting healthy behavior.

Modeling individual differences: A case study of the application of system identification for personalizing a physical activity intervention.

BACKGROUND: Control systems engineering methods, particularly, system identification (system ID), offer an idiographic (i.e., person-specific) approach to develop dynamic models of physical activity (PA) that can be used to personalize interventions in a systematic, scalable way. The purpose of this work is to: (1) apply system ID to develop individual dynamical models of PA (steps/day measured using Fitbit Zip) in the context of a goal setting and positive reinforcement intervention informed by Social Cognitive Theory; and (2) compare insights on potential tailoring variables (i.e., predictors expected to influence steps and thus moderate the suggested step goal and points for goal achievement) selected using the idiographic models to those selected via a nomothetic (i.e., aggregated across individuals) approach. METHOD: A personalized goal setting and positive reinforcement intervention was deployed for 14 weeks. Baseline PA measured in weeks 1-2 was used to inform personalized daily step goals delivered in weeks 3-14. Goals and expected reward points (granted upon goal achievement) were pseudo-randomly assigned using techniques from system ID, with goals ranging from their baseline median steps/day up to 2.5× baseline median steps/day, and points ranging from 100 to 500 (i.e., $0.20-$1.00). Participants completed a series of daily self-report measures. Auto Regressive with eXogenous Input (ARX) modeling and multilevel modeling (MLM) were used as the idiographic and nomothetic approaches, respectively. RESULTS: Participants (N = 20, mean age = 47.25 ±â€¯6.16 years, 90% female) were insufficiently active, overweight (mean BMI = 33.79 ±â€¯6.82 kg/m2) adults. Results from ARX modeling suggest that individuals differ in the factors (e.g., perceived stress, weekday/weekend) that influence their observed steps/day. In contrast, the nomothetic model from MLM suggested that goals and weekday/weekend were the key variables that were predictive of steps. Assuming the ARX models are more personalized, the obtained nomothetic model would have led to the identification of the same predictors for 5 of the 20 participants, suggesting a mismatch of plausible tailoring variables to use for 75% of the sample. CONCLUSION: The idiographic approach revealed person-specific predictors beyond traditional MLM analyses and unpacked the inherent complexity of PA; namely that people are different and context matters. System ID provides a feasible approach to develop personalized dynamical models of PA and inform person-specific tailoring variable selection for use in adaptive behavioral interventions.

Adaptive step goals and rewards: a longitudinal growth model of daily steps for a smartphone-based walking intervention.

Adaptive interventions are an emerging class of behavioral interventions that allow for individualized tailoring of intervention components over time to a person's evolving needs. The purpose of this study was to evaluate an adaptive step goal + reward intervention, grounded in Social Cognitive Theory delivered via a smartphone application (Just Walk), using a mixed modeling approach. Participants (N = 20) were overweight (mean BMI = 33.8 ± 6.82 kg/m2), sedentary adults (90% female) interested in participating in a 14-week walking intervention. All participants received a Fitbit Zip that automatically synced with Just Walk to track daily steps. Step goals and expected points were delivered through the app every morning and were designed using a pseudo-random multisine algorithm that was a function of each participant's median baseline steps. Self-report measures were also collected each morning and evening via daily surveys administered through the app. The linear mixed effects model showed that, on average, participants significantly increased their daily steps by 2650 (t = 8.25, p < 0.01) from baseline to intervention completion. A non-linear model with a quadratic time variable indicated an inflection point for increasing steps near the midpoint of the intervention and this effect was significant (t2 = -247, t = -5.01, p < 0.001). An adaptive step goal + rewards intervention using a smartphone app appears to be a feasible approach for increasing walking behavior in overweight adults. App satisfaction was high and participants enjoyed receiving variable goals each day. Future mHealth studies should consider the use of adaptive step goals + rewards in conjunction with other intervention components for increasing physical activity.

Tutorial for Using Control Systems Engineering to Optimize Adaptive Mobile Health Interventions.

BACKGROUND: Adaptive behavioral interventions are individualized interventions that vary support based on a person's evolving needs. Digital technologies enable these adaptive interventions to function at scale. Adaptive interventions show great promise for producing better results compared with static interventions related to health outcomes. Our central thesis is that adaptive interventions are more likely to succeed at helping individuals meet and maintain behavioral targets if its elements can be iteratively improved via data-driven testing (ie, optimization). Control systems engineering is a discipline focused on decision making in systems that change over time and has a wealth of methods that could be useful for optimizing adaptive interventions. OBJECTIVE: The purpose of this paper was to provide an introductory tutorial on when and what to do when using control systems engineering for designing and optimizing adaptive mobile health (mHealth) behavioral interventions. OVERVIEW: We start with a review of the need for optimization, building on the multiphase optimization strategy (MOST). We then provide an overview of control systems engineering, followed by attributes of problems that are well matched to control engineering. Key steps in the development and optimization of an adaptive intervention from a control engineering perspective are then summarized, with a focus on why, what, and when to do subtasks in each step. IMPLICATIONS: Control engineering offers exciting opportunities for optimizing individualization and adaptation elements of adaptive interventions. Arguably, the time is now for control systems engineers and behavioral and health scientists to partner to advance interventions that can be individualized, adaptive, and scalable. This tutorial should aid in creating the bridge between these communities.

Behavior change interventions: the potential of ontologies for advancing science and practice.

A central goal of behavioral medicine is the creation of evidence-based interventions for promoting behavior change. Scientific knowledge about behavior change could be more effectively accumulated using "ontologies." In information science, an ontology is a systematic method for articulating a "controlled vocabulary" of agreed-upon terms and their inter-relationships. It involves three core elements: (1) a controlled vocabulary specifying and defining existing classes; (2) specification of the inter-relationships between classes; and (3) codification in a computer-readable format to enable knowledge generation, organization, reuse, integration, and analysis. This paper introduces ontologies, provides a review of current efforts to create ontologies related to behavior change interventions and suggests future work. This paper was written by behavioral medicine and information science experts and was developed in partnership between the Society of Behavioral Medicine's Technology Special Interest Group (SIG) and the Theories and Techniques of Behavior Change Interventions SIG. In recent years significant progress has been made in the foundational work needed to develop ontologies of behavior change. Ontologies of behavior change could facilitate a transformation of behavioral science from a field in which data from different experiments are siloed into one in which data across experiments could be compared and/or integrated. This could facilitate new approaches to hypothesis generation and knowledge discovery in behavioral science.

A qualitative study of shopper experiences at an urban farmers' market using the Stanford Healthy Neighborhood Discovery Tool.

OBJECTIVE: To understand factors which enhance or detract from farmers' market shopper experiences to inform targeted interventions to increase farmers' market utilization, community-building and social marketing strategies. DESIGN: A consumer-intercept study using the Stanford Healthy Neighborhood Discovery Tool to capture real-time perceptions via photographs and audio narratives. SETTING: An urban farmers' market in a large metropolitan US city. PARTICIPANTS: Thirty-eight farmers' market shoppers, who recorded 748 unique coded elements through community-based participatory research methods. RESULTS: Shoppers were primarily women (65 %), 18-35 years of age (54 %), non-Hispanic (81 %) and white (73 %). Shoppers captured 291 photographs (7·9 (sd 6·3) per shopper), 171 audio narratives (5·3 (sd 4·7) per shopper), and ninety-one linked photograph + audio narrative pairs (3·8 (sd 2·8) per shopper). A systematic content analysis of the photographs and audio narratives was conducted by eight independent coders. In total, nine common elements emerged from the data that enhanced the farmers' market experience (61·8 %), detracted from the experience (5·7 %) or were neutral (32·4 %). The most frequently noted elements were freshness/abundance of produce (23·3 %), product presentation (12·8 %), social interactions (12·4 %) and farmers' market attractions (e.g. live entertainment, dining offerings; 10·3 %). CONCLUSIONS: While produce quality (i.e. freshness/abundance) was of primary importance, other contextual factors also appeared important to the shoppers' experiences. These results may inform social marketing strategies to increase farmers' market utilization and community-building efforts that target market venues.

Reallocating time to sleep, sedentary behaviors, or active behaviors: associations with cardiovascular disease risk biomarkers, NHANES 2005-2006.

Sleep and sedentary and active behaviors are linked to cardiovascular disease risk biomarkers, and across a 24-hour day, increasing time in 1 behavior requires decreasing time in another. We explored associations of reallocating time to sleep, sedentary behavior, or active behaviors with biomarkers. Data (n = 2,185 full sample; n = 923 fasting subanalyses) from the cross-sectional 2005-2006 US National Health and Nutrition Examination Survey were analyzed. The amounts of time spent in sedentary behavior, light-intensity activity, and moderate-to-vigorous physical activity (MVPA) were derived from ActiGraph accelerometry (ActiGraph LLC, Pensacola, Florida), and respondents reported their sleep duration. Isotemporal substitution modeling indicated that, independent of potential confounders and time spent in other activities, beneficial associations (P < 0.05) with cardiovascular disease risk biomarkers were associated with the reallocation of 30 minutes/day of sedentary time with equal time of either sleep (2.2% lower insulin and 2.0% lower homeostasis model assessment of ß-cell function), light-intensity activity (1.9% lower triglycerides, 2.4% lower insulin, and 2.2% lower homeostasis model assessment of ß-cell function), or MVPA (2.4% smaller waist circumference, 4.4% higher high-density lipoprotein cholesterol, 8.5% lower triglycerides, 1.7% lower glucose, 10.7% lower insulin, and 9.7% higher homeostasis model assessment of insulin sensitivity. These findings provide evidence that MVPA may be the most potent health-enhancing, time-dependent behavior, with additional benefit conferred from light-intensity activities and sleep duration when reallocated from sedentary time.

Exploring the relationship between changes in weight and utterances in an online weight loss forum: a content and correlational analysis study.

BACKGROUND: There is increasing interest in the use of online forums as a component of eHealth weight loss interventions. Although the research is mixed on the utility of online forums in general, results suggest that there is promise to this, particularly if the systems can be designed well to support healthful interactions that foster weight loss and continued engagement. OBJECTIVE: The purpose of this study was to examine the relationship between the styles of utterances individuals make on an online weight loss forum and week-to-week fluctuations in weight. This analysis was conducted to generate hypotheses on possible strategies that could be used to improve the overall design of online support groups to facilitate more healthful interactions. METHODS: A convenience sample of individuals using an online weight loss forum (N=4132) included data both on online forum use and weight check-in data. All interactions were coded utilizing the Linguistic Inquiry and Word Count (LIWC) system. Mixed model analyses were conducted to examine the relationship between these LIWC variables and weight over time. RESULTS: Results suggested that increased use of past-tense verbs (P=.05) and motion (P=.02) were associated with lower weekly weights whereas increased use of conjunctions (eg, and, but, whereas; P=.001) and exclusion words (eg, but, without, exclude; P=.07) were both associated with higher weight during the weeks when these utterances were used more. CONCLUSIONS: These results provide some insights on the styles of interactions that appear to be associated with weight fluctuations. Future work should explore the stability of these findings and also explore possibilities for fostering these types of interactions more explicitly within online weight loss forums.

Impact of San Francisco's toy ordinance on restaurants and children's food purchases, 2011-2012.

INTRODUCTION: In 2011, San Francisco passed the first citywide ordinance to improve the nutritional standards of children's meals sold at restaurants by preventing the giving away of free toys or other incentives with meals unless nutritional criteria were met. This study examined the impact of the Healthy Food Incentives Ordinance at ordinance-affected restaurants on restaurant response (eg, toy-distribution practices, change in children's menus), and the energy and nutrient content of all orders and children's-meal-only orders purchased for children aged 0 through 12 years. METHODS: Restaurant responses were examined from January 2010 through March 2012. Parent-caregiver/child dyads (n = 762) who were restaurant customers were surveyed at 2 points before and 1 seasonally matched point after ordinance enactment at Chain A and B restaurants (n = 30) in 2011 and 2012. RESULTS: Both restaurant chains responded to the ordinance by selling toys separately from children's meals, but neither changed their menus to meet ordinance-specified nutrition criteria. Among children for whom children's meals were purchased, significant decreases in kilocalories, sodium, and fat per order were likely due to changes in children's side dishes and beverages at Chain A. CONCLUSION: Although the changes at Chain A did not appear to be directly in response to the ordinance, the transition to a more healthful beverage and default side dish was consistent with the intent of the ordinance. Study results underscore the importance of policy wording, support the concept that more healthful defaults may be a powerful approach for improving dietary intake, and suggest that public policies may contribute to positive restaurant changes.

Behavioral impacts of sequentially versus simultaneously delivered dietary plus physical activity interventions: the CALM trial.

BACKGROUND: Few studies have evaluated how to combine dietary and physical activity (PA) interventions to enhance adherence. PURPOSE: We tested how sequential versus simultaneous diet plus PA interventions affected behavior changes. METHODS: Two hundred participants over age 44 years not meeting national PA and dietary recommendations (daily fruit and vegetable servings and percent of calories from saturated fat) were randomized to one of four 12-month telephone interventions: sequential (exercise first or diet first), simultaneous, or attention control. At 4 months, the other health behavior was added in the sequential arms. RESULTS: Ninety-three percent of participants were retained through 12 months. At 4 months, only exercise first improved PA, and only the simultaneous and diet-first interventions improved dietary variables. At 12 months, mean levels of all behaviors in the simultaneous arm met recommendations, though not in the exercise- and diet-first arms. CONCLUSIONS: We observed a possible behavioral suppression effect of early dietary intervention on PA that merits investigation.

Determining who responds better to a computer- vs. human-delivered physical activity intervention: results from the community health advice by telephone (CHAT) trial.

BACKGROUND: Little research has explored who responds better to an automated vs. human advisor for health behaviors in general, and for physical activity (PA) promotion in particular. The purpose of this study was to explore baseline factors (i.e., demographics, motivation, interpersonal style, and external resources) that moderate intervention efficacy delivered by either a human or automated advisor. METHODS: Data were from the CHAT Trial, a 12-month randomized controlled trial to increase PA among underactive older adults (full trial N = 218) via a human advisor or automated interactive voice response advisor. Trial results indicated significant increases in PA in both interventions by 12 months that were maintained at 18-months. Regression was used to explore moderation of the two interventions. RESULTS: Results indicated amotivation (i.e., lack of intent in PA) moderated 12-month PA (d = 0.55, p < 0.01) and private self-consciousness (i.e., tendency to attune to one's own inner thoughts and emotions) moderated 18-month PA (d = 0.34, p < 0.05) but a variety of other factors (e.g., demographics) did not (p > 0.12). CONCLUSIONS: Results provide preliminary evidence for generating hypotheses about pathways for supporting later clinical decision-making with regard to the use of either human- vs. computer-delivered interventions for PA promotion.

Evaluating the Mental Health of Physician-Trainees Using an SMS Text Message-Based Assessment Tool: Longitudinal Pilot Study.

BACKGROUND: Physician burnout is a multibillion-dollar issue in the United States. Despite its prevalence, burnout is difficult to accurately measure. Institutions generally rely on periodic surveys that are subject to recall bias. SMS text message-based surveys or assessments have been used in health care and have the advantage of easy accessibility and high response rates. OBJECTIVE: In this pilot project, we evaluated the utility of and participant engagement with a simple, longitudinal, and SMS text message-based mental health assessment system for physician-trainees at the study institution. The goal of the SMS text message-based assessment system was to track stress, burnout, empathy, engagement, and work satisfaction levels faced by users in their normal working conditions. METHODS: Three SMS text message-based questions per week for 5 weeks were sent to each participant. All data received were deidentified. Additionally, each participant had a deidentified personal web page to follow their scores as well as the aggregated scores of all participants over time. A 13-question optional survey was sent at the conclusion of the study to evaluate the usability of the platform. Descriptive statistics were performed. RESULTS: In all, 81 participants were recruited and answered at least six (mean 14; median 14; range 6-16) questions for a total of 1113 responses. Overall, 10 (17%) out of 59 participants responded "Yes" to having experienced a traumatic experience during the study period. Only 3 participants ever answered being "Not at all satisfied" with their job. The highest number of responses indicating that participants were stressed or burnt out came on day 25 in the 34-day study period. There were mixed levels of concern for the privacy of responses. No substantial correlations were noted between responses and having experienced a traumatic experience during the study period. Furthermore, 12 participants responded to the optional feedback survey, and all either agreed or strongly agreed that the SMS text message-based assessment system was easy to use and the number of texts received was reasonable. None of the 12 respondents indicated that using the SMS text message-based assessment system caused stress. CONCLUSIONS: Responses demonstrated that SMS text message-based mental health assessments are potentially useful for recording physician-trainee mental health levels in real time with minimal burden, but further study of SMS text message-based mental health assessments should address limitations such as improving response rates and clarifying participants' sense of privacy when using the SMS text message-based assessment system. The findings of this pilot study can inform the development of institution-wide tools for assessing physician burnout and protecting physicians from occupational stress.

Technology-mediated just-in-time adaptive interventions (JITAIs) to reduce harmful substance use: a systematic review.

BACKGROUND AND AIMS: Lapse risk when trying to stop or reduce harmful substance use is idiosyncratic, dynamic and multi-factorial. Just-in-time adaptive interventions (JITAIs) aim to deliver tailored support at moments of need or opportunity. We aimed to synthesize evidence on decision points, tailoring variables, intervention options, decision rules, study designs, user engagement and effectiveness of technology-mediated JITAIs for reducing harmful substance use. METHODS: Systematic review of empirical studies of any design with a narrative synthesis. We searched Ovid MEDLINE, Embase, PsycINFO, Web of Science, the ACM Digital Library, the IEEE Digital Library, ClinicalTrials.gov, the ISRCTN register and dblp using terms related to substance use/mHealth/JITAIs. Outcomes were user engagement and intervention effectiveness. Study quality was assessed with the mHealth Evidence Reporting and Assessment checklist. FINDINGS: We included 17 reports of 14 unique studies, including two randomized controlled trials. JITAIs targeted alcohol (S = 7, n = 120 520), tobacco (S = 4, n = 187), cannabis (S = 2, n = 97) and a combination of alcohol and illicit substance use (S = 1, n = 63), and primarily relied on active measurement and static (i.e. time-invariant) decision rules to deliver support tailored to micro-scale changes in mood or urges. Two studies used data from prior participants and four drew upon theory to devise decision rules. Engagement with available JITAIs was moderate-to-high and evidence of effectiveness was mixed. Due to substantial heterogeneity in study designs and outcome variables assessed, no meta-analysis was performed. Many studies reported insufficient detail on JITAI infrastructure, content, development costs and data security. CONCLUSIONS: Current implementations of just-in-time adaptive interventions (JITAIs) for reducing harmful substance use rely on active measurement and static decision rules to deliver support tailored to micro-scale changes in mood or urges. Studies on JITAI effectiveness are lacking.

Accuracy and Precision of Energy Expenditure, Heart Rate, and Steps Measured by Combined-Sensing Fitbits Against Reference Measures: Systematic Review and Meta-analysis.

BACKGROUND: Although it is widely recognized that physical activity is an important determinant of health, assessing this complex behavior is a considerable challenge. OBJECTIVE: The purpose of this systematic review and meta-analysis is to examine, quantify, and report the current state of evidence for the validity of energy expenditure, heart rate, and steps measured by recent combined-sensing Fitbits. METHODS: We conducted a systematic review and Bland-Altman meta-analysis of validation studies of combined-sensing Fitbits against reference measures of energy expenditure, heart rate, and steps. RESULTS: A total of 52 studies were included in the systematic review. Among the 52 studies, 41 (79%) were included in the meta-analysis, representing 203 individual comparisons between Fitbit devices and a criterion measure (ie, n=117, 57.6% for heart rate; n=49, 24.1% for energy expenditure; and n=37, 18.2% for steps). Overall, most authors of the included studies concluded that recent Fitbit models underestimate heart rate, energy expenditure, and steps compared with criterion measures. These independent conclusions aligned with the results of the pooled meta-analyses showing an average underestimation of -2.99 beats per minute (k comparison=74), -2.77 kcal per minute (k comparison=29), and -3.11 steps per minute (k comparison=19), respectively, of the Fitbit compared with the criterion measure (results obtained after removing the high risk of bias studies; population limit of agreements for heart rate, energy expenditure, and steps: -23.99 to 18.01, -12.75 to 7.41, and -13.07 to 6.86, respectively). CONCLUSIONS: Fitbit devices are likely to underestimate heart rate, energy expenditure, and steps. The estimation of these measurements varied by the quality of the study, age of the participants, type of activities, and the model of Fitbit. The qualitative conclusions of most studies aligned with the results of the meta-analysis. Although the expected level of accuracy might vary from one context to another, this underestimation can be acceptable, on average, for steps and heart rate. However, the measurement of energy expenditure may be inaccurate for some research purposes.