Evaluating the Mental Health of Physician-Trainees Using an SMS Text Message-Based Assessment Tool: Longitudinal Pilot Study.

BACKGROUND: Physician burnout is a multibillion-dollar issue in the United States. Despite its prevalence, burnout is difficult to accurately measure. Institutions generally rely on periodic surveys that are subject to recall bias. SMS text message-based surveys or assessments have been used in health care and have the advantage of easy accessibility and high response rates. OBJECTIVE: In this pilot project, we evaluated the utility of and participant engagement with a simple, longitudinal, and SMS text message-based mental health assessment system for physician-trainees at the study institution. The goal of the SMS text message-based assessment system was to track stress, burnout, empathy, engagement, and work satisfaction levels faced by users in their normal working conditions. METHODS: Three SMS text message-based questions per week for 5 weeks were sent to each participant. All data received were deidentified. Additionally, each participant had a deidentified personal web page to follow their scores as well as the aggregated scores of all participants over time. A 13-question optional survey was sent at the conclusion of the study to evaluate the usability of the platform. Descriptive statistics were performed. RESULTS: In all, 81 participants were recruited and answered at least six (mean 14; median 14; range 6-16) questions for a total of 1113 responses. Overall, 10 (17%) out of 59 participants responded "Yes" to having experienced a traumatic experience during the study period. Only 3 participants ever answered being "Not at all satisfied" with their job. The highest number of responses indicating that participants were stressed or burnt out came on day 25 in the 34-day study period. There were mixed levels of concern for the privacy of responses. No substantial correlations were noted between responses and having experienced a traumatic experience during the study period. Furthermore, 12 participants responded to the optional feedback survey, and all either agreed or strongly agreed that the SMS text message-based assessment system was easy to use and the number of texts received was reasonable. None of the 12 respondents indicated that using the SMS text message-based assessment system caused stress. CONCLUSIONS: Responses demonstrated that SMS text message-based mental health assessments are potentially useful for recording physician-trainee mental health levels in real time with minimal burden, but further study of SMS text message-based mental health assessments should address limitations such as improving response rates and clarifying participants' sense of privacy when using the SMS text message-based assessment system. The findings of this pilot study can inform the development of institution-wide tools for assessing physician burnout and protecting physicians from occupational stress.

Accuracy and Precision of Energy Expenditure, Heart Rate, and Steps Measured by Combined-Sensing Fitbits Against Reference Measures: Systematic Review and Meta-analysis.

BACKGROUND: Although it is widely recognized that physical activity is an important determinant of health, assessing this complex behavior is a considerable challenge. OBJECTIVE: The purpose of this systematic review and meta-analysis is to examine, quantify, and report the current state of evidence for the validity of energy expenditure, heart rate, and steps measured by recent combined-sensing Fitbits. METHODS: We conducted a systematic review and Bland-Altman meta-analysis of validation studies of combined-sensing Fitbits against reference measures of energy expenditure, heart rate, and steps. RESULTS: A total of 52 studies were included in the systematic review. Among the 52 studies, 41 (79%) were included in the meta-analysis, representing 203 individual comparisons between Fitbit devices and a criterion measure (ie, n=117, 57.6% for heart rate; n=49, 24.1% for energy expenditure; and n=37, 18.2% for steps). Overall, most authors of the included studies concluded that recent Fitbit models underestimate heart rate, energy expenditure, and steps compared with criterion measures. These independent conclusions aligned with the results of the pooled meta-analyses showing an average underestimation of -2.99 beats per minute (k comparison=74), -2.77 kcal per minute (k comparison=29), and -3.11 steps per minute (k comparison=19), respectively, of the Fitbit compared with the criterion measure (results obtained after removing the high risk of bias studies; population limit of agreements for heart rate, energy expenditure, and steps: -23.99 to 18.01, -12.75 to 7.41, and -13.07 to 6.86, respectively). CONCLUSIONS: Fitbit devices are likely to underestimate heart rate, energy expenditure, and steps. The estimation of these measurements varied by the quality of the study, age of the participants, type of activities, and the model of Fitbit. The qualitative conclusions of most studies aligned with the results of the meta-analysis. Although the expected level of accuracy might vary from one context to another, this underestimation can be acceptable, on average, for steps and heart rate. However, the measurement of energy expenditure may be inaccurate for some research purposes.

Technology-mediated just-in-time adaptive interventions (JITAIs) to reduce harmful substance use: a systematic review.

BACKGROUND AND AIMS: Lapse risk when trying to stop or reduce harmful substance use is idiosyncratic, dynamic and multi-factorial. Just-in-time adaptive interventions (JITAIs) aim to deliver tailored support at moments of need or opportunity. We aimed to synthesize evidence on decision points, tailoring variables, intervention options, decision rules, study designs, user engagement and effectiveness of technology-mediated JITAIs for reducing harmful substance use. METHODS: Systematic review of empirical studies of any design with a narrative synthesis. We searched Ovid MEDLINE, Embase, PsycINFO, Web of Science, the ACM Digital Library, the IEEE Digital Library, ClinicalTrials.gov, the ISRCTN register and dblp using terms related to substance use/mHealth/JITAIs. Outcomes were user engagement and intervention effectiveness. Study quality was assessed with the mHealth Evidence Reporting and Assessment checklist. FINDINGS: We included 17 reports of 14 unique studies, including two randomized controlled trials. JITAIs targeted alcohol (S = 7, n = 120 520), tobacco (S = 4, n = 187), cannabis (S = 2, n = 97) and a combination of alcohol and illicit substance use (S = 1, n = 63), and primarily relied on active measurement and static (i.e. time-invariant) decision rules to deliver support tailored to micro-scale changes in mood or urges. Two studies used data from prior participants and four drew upon theory to devise decision rules. Engagement with available JITAIs was moderate-to-high and evidence of effectiveness was mixed. Due to substantial heterogeneity in study designs and outcome variables assessed, no meta-analysis was performed. Many studies reported insufficient detail on JITAI infrastructure, content, development costs and data security. CONCLUSIONS: Current implementations of just-in-time adaptive interventions (JITAIs) for reducing harmful substance use rely on active measurement and static decision rules to deliver support tailored to micro-scale changes in mood or urges. Studies on JITAI effectiveness are lacking.

Lessons Learned: Beta-Testing the Digital Health Checklist for Researchers Prompts a Call to Action by Behavioral Scientists.

Digital technologies offer unique opportunities for health research. For example, Twitter posts can support public health surveillance to identify outbreaks (eg, influenza and COVID-19), and a wearable fitness tracker can provide real-time data collection to assess the effectiveness of a behavior change intervention. With these opportunities, it is necessary to consider the potential risks and benefits to research participants when using digital tools or strategies. Researchers need to be involved in the risk assessment process, as many tools in the marketplace (eg, wellness apps, fitness sensors) are underregulated. However, there is little guidance to assist researchers and institutional review boards in their evaluation of digital tools for research purposes. To address this gap, the Digital Health Checklist for Researchers (DHC-R) was developed as a decision support tool. A participatory research approach involving a group of behavioral scientists was used to inform DHC-R development. Scientists beta-tested the checklist by retrospectively evaluating the technologies they had chosen for use in their research. This paper describes the lessons learned because of their involvement in the beta-testing process and concludes with recommendations for how the DHC-R could be useful for a variety of digital health stakeholders. Recommendations focus on future research and policy development to support research ethics, including the development of best practices to advance safe and responsible digital health research.

Innovative methods for observing and changing complex health behaviors: four propositions.

Precision health initiatives aim to progressively move from traditional, group-level approaches to health diagnostics and treatments toward ones that are individualized, contextualized, and timely. This article aims to provide an overview of key methods and approaches that can help facilitate this transition in the health behavior change domain. This article is a narrative review of the methods used to observe and change complex health behaviors. On the basis of the available literature, we argue that health behavior change researchers should progressively transition from (i) low- to high-resolution behavioral assessments, (ii) group-only to group- and individual-level statistical inference, (iii) narrative theoretical models to dynamic computational models, and (iv) static to adaptive and continuous tuning interventions. Rather than providing an exhaustive and technical presentation of each method and approach, this article articulates why and how researchers interested in health behavior change can apply these innovative methods. Practical examples contributing to these efforts are presented. If successfully adopted and implemented, the four propositions in this article have the potential to greatly improve our public health and behavior change practices in the near future.

Behavior science in the evolving world of digital health: considerations on anticipated opportunities and challenges.

Digital health promises to increase intervention reach and effectiveness for a range of behavioral health outcomes. Behavioral scientists have a unique opportunity to infuse their expertise in all phases of a digital health intervention, from design to implementation. The aim of this study was to assess behavioral scientists' interests and needs with respect to digital health endeavors, as well as gather expert insight into the role of behavioral science in the evolution of digital health. The study used a two-phased approach: (a) a survey of behavioral scientists' current needs and interests with respect to digital health endeavors (n = 346); (b) a series of interviews with digital health stakeholders for their expert insight on the evolution of the health field (n = 15). In terms of current needs and interests, the large majority of surveyed behavioral scientists (77%) already participate in digital health projects, and from those who have not done so yet, the majority (65%) reported intending to do so in the future. In terms of the expected evolution of the digital health field, interviewed stakeholders anticipated a number of changes, from overall landscape changes through evolving models of reimbursement to more significant oversight and regulations. These findings provide a timely insight into behavioral scientists' current needs, barriers, and attitudes toward the use of technology in health care and public health. Results might also highlight the areas where behavioral scientists can leverage their expertise to both enhance digital health's potential to improve health, as well as to prevent the potential unintended consequences that can emerge from scaling the use of technology in health care.

Evaluation of intervention components to maximize outcomes of behavioral obesity treatment delivered online: A factorial experiment following the multiphase optimization strategy framework.

BACKGROUND: Behavioral lifestyle intervention (BLI) is recommended as a first-line treatment for obesity. While BLI has been adapted for online delivery to improve potential for dissemination while reducing costs and barriers to access, weight losses are typically inferior to gold standard treatment delivered in-person. It is therefore important to refine and optimize online BLI in order to improve the proportion of individuals who achieve a minimum clinically significant weight loss and mean weight loss. STUDY DESIGN: Five experimental intervention components will be tested as adjuncts to an established 12-month online BLI: virtual reality for BLI skills training, interactive video feedback, tailored intervention to promote physical activity, skills for dysregulated eating, and social support combined with friendly competition. Following the Multiphase Optimization Strategy (MOST) framework, the components will first be refined and finalized during Preparation Phase pilot testing and then evaluated in a factorial experiment with 384 adults with overweight or obesity. A priori optimization criteria that balance efficacy and efficiency will be used to create a finalized treatment package that produces the best weight loss outcomes with the fewest intervention components. Mediation analysis will be conducted to test hypothesized mechanisms of action and a moderator analysis will be conducted to understand for whom and under what circumstances the interventions are effective. CONCLUSION: This study will provide important information about intervention strategies that are useful for improving outcomes of online BLI. The finalized treatment package will be suitable for testing in a future randomized trial in the MOST Evaluation Phase.

Citizen science to further precision medicine: from vision to implementation.

The active involvement of citizen scientists in setting research agendas, partnering with academic investigators to conduct research, analyzing and disseminating results, and implementing learnings from research can improve both processes and outcomes. Adopting a citizen science approach to the practice of precision medicine in clinical care and research will require healthcare providers, researchers, and institutions to address a number of technical, organizational, and citizen scientist collaboration issues. Some changes can be made with relative ease, while others will necessitate cultural shifts, redistribution of power, recommitment to shared goals, and improved communication. This perspective, based on a workshop held at the 2018 AMIA Annual Symposium, identifies current barriers and needed changes to facilitate broad adoption of a citizen science-based approach in healthcare.

Modelling multiple health behavior change with network analyses: results from a one-year study conducted among overweight and obese adults.

This study examined the between-person associations of seven health behaviors in adults with obesity participating in a weight loss intervention, as well as the covariations between these behaviors within-individuals across the intervention. The present study included data from a 12-month weight loss trial (N = 278). Seven health behaviors (physical activity, sedentary behavior, sleep duration, and consumption of fruits, vegetables, total fat and added sugar) were measured at baseline, 6- and 12-months. Between- and within-participants network analyses were conducted to examine how these behaviors were associated through the 12-month intervention and covaried across months. At the between-participants level, associations were found within the different diet behaviors and between total fat and sedentary behaviors. At the within-participants level, covariations were found between sedentary and diet behaviors, and within diet behaviors. Findings suggest that successful multiple health behaviors change interventions among adults with obesity will need to (1) simultaneously target sedentary and diet behaviors; and (2) prevent potential compensatory behaviors in the diet domain.

Development of a Control-Oriented Model of Social Cognitive Theory for Optimized mHealth Behavioral Interventions.

Mobile health (mHealth) technologies are contributing to the increasing relevance of control engineering principles in understanding and improving health behaviors, such as physical activity. Social Cognitive Theory (SCT), one of the most influential theories of health behavior, has been used as the conceptual basis for behavioral interventions for smoking cessation, weight management, and other health-related outcomes. This paper presents a control-oriented dynamical systems model of SCT based on fluid analogies that can be used in system identification and control design problems relevant to the design and analysis of intensively adaptive interventions. Following model development, a series of simulation scenarios illustrating the basic workings of the model are presented. The model's usefulness is demonstrated in the solution of two important practical problems: 1) semiphysical model estimation from data gathered in a physical activity intervention (the MILES study) and 2) as a means for discerning the range of "ambitious but doable" daily step goals in a closed-loop behavioral intervention aimed at sedentary adults. The model is the basis for ongoing experimental validation efforts, and should encourage additional research in applying control engineering technologies to the social and behavioral sciences.

In search of a daily physical activity "sweet spot": Piloting a digital tracking intervention for people with multiple sclerosis.

OBJECTIVE: This pilot study tested a course-based intervention to help people with multiple sclerosis (MS) match their daily activity to symptom severity ("sweet spot") using wearable activity trackers. METHODS: This two-phase study recruited online research network members reporting MS and who were utilizing Fitbit One™ activity trackers. In the first phase, participant interviews assessed demand based on physical activity and the use of behavior-change techniques. The second phase assessed the demand, limited efficacy, acceptability, and practicality of a "Wearables 101" course that integrated behavior change and self-experimentation principles. Tracker data were used to determine the percent of matches between daily symptom-based step goals and step counts. RESULTS: Participants expressed demand in the form of interest in gaining insights about a possible "sweet spot" behavioral target, if a system could be produced to support that. Limited efficacy results were mixed, with approximately one-third of participants dropping out and only half matching their daily target goals for at least 50% of days. In terms of practicality, participants commented on the burden of daily measurement and the need for a longer baseline period. Participants noted that tracking helped support an understanding of the link between activities and symptom severity, suggesting acceptability. CONCLUSIONS: Results suggested that the intervention demand and acceptability criteria were demonstrated more strongly than limited efficacy and practicality. The matching intervention tested in this study will require refinement in baseline measurement, goal definition, and reduced data-gathering burden. Such changes may improve efficacy and practicality requirements and, by extension, later impact of the intervention on MS outcomes. Overall, these results provide justification for additional work on refining the intervention to increase practicality and efficacy.

Why we need a small data paradigm.

BACKGROUND: There is great interest in and excitement about the concept of personalized or precision medicine and, in particular, advancing this vision via various 'big data' efforts. While these methods are necessary, they are insufficient to achieve the full personalized medicine promise. A rigorous, complementary 'small data' paradigm that can function both autonomously from and in collaboration with big data is also needed. By 'small data' we build on Estrin's formulation and refer to the rigorous use of data by and for a specific N-of-1 unit (i.e., a single person, clinic, hospital, healthcare system, community, city, etc.) to facilitate improved individual-level description, prediction and, ultimately, control for that specific unit. MAIN BODY: The purpose of this piece is to articulate why a small data paradigm is needed and is valuable in itself, and to provide initial directions for future work that can advance study designs and data analytic techniques for a small data approach to precision health. Scientifically, the central value of a small data approach is that it can uniquely manage complex, dynamic, multi-causal, idiosyncratically manifesting phenomena, such as chronic diseases, in comparison to big data. Beyond this, a small data approach better aligns the goals of science and practice, which can result in more rapid agile learning with less data. There is also, feasibly, a unique pathway towards transportable knowledge from a small data approach, which is complementary to a big data approach. Future work should (1) further refine appropriate methods for a small data approach; (2) advance strategies for better integrating a small data approach into real-world practices; and (3) advance ways of actively integrating the strengths and limitations from both small and big data approaches into a unified scientific knowledge base that is linked via a robust science of causality. CONCLUSION: Small data is valuable in its own right. That said, small and big data paradigms can and should be combined via a foundational science of causality. With these approaches combined, the vision of precision health can be achieved.

The history and future of digital health in the field of behavioral medicine.

Since its earliest days, the field of behavioral medicine has leveraged technology to increase the reach and effectiveness of its interventions. Here, we highlight key areas of opportunity and recommend next steps to further advance intervention development, evaluation, and commercialization with a focus on three technologies: mobile applications (apps), social media, and wearable devices. Ultimately, we argue that future of digital health behavioral science research lies in finding ways to advance more robust academic-industry partnerships. These include academics consciously working towards preparing and training the work force of the twenty first century for digital health, actively working towards advancing methods that can balance the needs for efficiency in industry with the desire for rigor and reproducibility in academia, and the need to advance common practices and procedures that support more ethical practices for promoting healthy behavior.

Efficacy of Contextually Tailored Suggestions for Physical Activity: A Micro-randomized Optimization Trial of HeartSteps.

BACKGROUND: HeartSteps is an mHealth intervention that encourages regular walking via activity suggestions tailored to the individuals' current context. PURPOSE: We conducted a micro-randomized trial (MRT) to evaluate the efficacy of HeartSteps' activity suggestions to optimize the intervention. METHODS: We conducted a 6-week MRT with 44 adults. Contextually tailored suggestions could be delivered up to five times per day at user-selected times. At each of these five times, for each participant on each day of the study, HeartSteps randomized whether to provide an activity suggestion, and, if so, whether to provide a walking or an antisedentary suggestion. We used a centered and weighted least squares method to analyze the effect of suggestions on the 30-min step count following suggestion randomization. RESULTS: Averaging over study days and types of activity suggestions, delivering a suggestion versus no suggestion increased the 30-min step count by 14% (p = .06), 35 additional steps over the 253-step average. The effect was not evenly distributed in time. Providing any type of suggestion versus no suggestion initially increased the step count by 66% (167 steps; p < .01), but this effect diminished over time. Averaging over study days, delivering a walking suggestion versus no suggestion increased the average step count by 24% (59 steps; p = .02). This increase was greater at the start of study (107% or 271 additional steps; p < .01), but decreased over time. Antisedentary suggestions had no detectable effect on the 30-min step count. CONCLUSION: Contextually tailored walking suggestions are a promising way of initiating bouts of walking throughout the day. CLINICAL TRIAL INFORMATION: This study was registered on ClinicalTrials.gov number NCT03225521.

Tutorial for Using Control Systems Engineering to Optimize Adaptive Mobile Health Interventions.

BACKGROUND: Adaptive behavioral interventions are individualized interventions that vary support based on a person's evolving needs. Digital technologies enable these adaptive interventions to function at scale. Adaptive interventions show great promise for producing better results compared with static interventions related to health outcomes. Our central thesis is that adaptive interventions are more likely to succeed at helping individuals meet and maintain behavioral targets if its elements can be iteratively improved via data-driven testing (ie, optimization). Control systems engineering is a discipline focused on decision making in systems that change over time and has a wealth of methods that could be useful for optimizing adaptive interventions. OBJECTIVE: The purpose of this paper was to provide an introductory tutorial on when and what to do when using control systems engineering for designing and optimizing adaptive mobile health (mHealth) behavioral interventions. OVERVIEW: We start with a review of the need for optimization, building on the multiphase optimization strategy (MOST). We then provide an overview of control systems engineering, followed by attributes of problems that are well matched to control engineering. Key steps in the development and optimization of an adaptive intervention from a control engineering perspective are then summarized, with a focus on why, what, and when to do subtasks in each step. IMPLICATIONS: Control engineering offers exciting opportunities for optimizing individualization and adaptation elements of adaptive interventions. Arguably, the time is now for control systems engineers and behavioral and health scientists to partner to advance interventions that can be individualized, adaptive, and scalable. This tutorial should aid in creating the bridge between these communities.

Modeling individual differences: A case study of the application of system identification for personalizing a physical activity intervention.

BACKGROUND: Control systems engineering methods, particularly, system identification (system ID), offer an idiographic (i.e., person-specific) approach to develop dynamic models of physical activity (PA) that can be used to personalize interventions in a systematic, scalable way. The purpose of this work is to: (1) apply system ID to develop individual dynamical models of PA (steps/day measured using Fitbit Zip) in the context of a goal setting and positive reinforcement intervention informed by Social Cognitive Theory; and (2) compare insights on potential tailoring variables (i.e., predictors expected to influence steps and thus moderate the suggested step goal and points for goal achievement) selected using the idiographic models to those selected via a nomothetic (i.e., aggregated across individuals) approach. METHOD: A personalized goal setting and positive reinforcement intervention was deployed for 14 weeks. Baseline PA measured in weeks 1-2 was used to inform personalized daily step goals delivered in weeks 3-14. Goals and expected reward points (granted upon goal achievement) were pseudo-randomly assigned using techniques from system ID, with goals ranging from their baseline median steps/day up to 2.5× baseline median steps/day, and points ranging from 100 to 500 (i.e., $0.20-$1.00). Participants completed a series of daily self-report measures. Auto Regressive with eXogenous Input (ARX) modeling and multilevel modeling (MLM) were used as the idiographic and nomothetic approaches, respectively. RESULTS: Participants (N = 20, mean age = 47.25 ±â€¯6.16 years, 90% female) were insufficiently active, overweight (mean BMI = 33.79 ±â€¯6.82 kg/m2) adults. Results from ARX modeling suggest that individuals differ in the factors (e.g., perceived stress, weekday/weekend) that influence their observed steps/day. In contrast, the nomothetic model from MLM suggested that goals and weekday/weekend were the key variables that were predictive of steps. Assuming the ARX models are more personalized, the obtained nomothetic model would have led to the identification of the same predictors for 5 of the 20 participants, suggesting a mismatch of plausible tailoring variables to use for 75% of the sample. CONCLUSION: The idiographic approach revealed person-specific predictors beyond traditional MLM analyses and unpacked the inherent complexity of PA; namely that people are different and context matters. System ID provides a feasible approach to develop personalized dynamical models of PA and inform person-specific tailoring variable selection for use in adaptive behavioral interventions.

Fresh Fruit and Vegetable Program and Requests for Fruits and Vegetables Outside School Settings.

BACKGROUND: Consumption of fruits and vegetables (F/V) among elementary school-aged children remains inadequate, especially among low-income children. The US Department of Agriculture's Fresh Fruit and Vegetable Program (FFVP) provides F/V as snacks to children during the school day, outside of school meals. School-based initiatives are successful in changing behaviors in school settings; however, their influence on behaviors outside of schools needs investigation. OBJECTIVE: To examine whether FFVP participation is associated with F/V requests at stores, self-efficacy to ask for and choose F/V at home, and F/V consumption. DESIGN: Cross-sectional study. PARTICIPANT/SETTING: Fourth graders in six classrooms (n=296) from three urban, low-income school districts in Phoenix, AZ, were surveyed during 2015; one FFVP and one non-FFVP school from each district that were similar in school size, percent free/reduced-price meal eligibility, and race/ethnicity of enrolled students were selected. MAIN OUTCOME MEASURES: Children's self-reported F/V requests during shopping, their self-efficacy to ask for and choose F/V at home, and F/V consumption on the previous day (non-FFVP school day) were measured using questions adapted from validated surveys. STATISTICAL ANALYSIS: Multivariable mixed-effect regression models, adjusting for clustering of students within classes and classes within schools were explored. RESULTS: In models adjusting for individual-level factors (ie, age and sex) only, several significant positive associations were observed between school FFVP participation and healthier F/V outcomes. After additionally adjusting for school-level factors (ie, total enrollment and % Hispanic/Latino students) significant associations were observed between school FFVP participation and more requests for vegetables during shopping (P<0.001), higher scores on self-efficacy to choose vegetables at home (P=0.004), stronger preferences for vegetables (P<0.001), and more frequent consumption of fruit (P=0.006). CONCLUSIONS: School FFVP participation was associated with more requests for vegetables during shopping and higher self-efficacy to make healthy choices at home, suggesting the influence of the FFVP may extend beyond the school day.