MigraineTracker: Examining Patient Experiences with Goal-Directed Self-Tracking for a Chronic Health Condition.

Self-tracking and personal informatics offer important potential in chronic condition management, but such potential is often undermined by difficulty in aligning self-tracking tools to an individual's goals. Informed by prior proposals of goal-directed tracking, we designed and developed MigraineTracker, a prototype app that emphasizes explicit expression of goals for migraine-related self-tracking. We then examined migraine patient experiences in a deployment study for an average of 12+ months, including a total of 50 interview sessions with 10 patients working with 3 different clinicians. Patients were able to express multiple types of goals, evolve their goals over time, align tracking to their goals, personalize their tracking, reflect in the context of their goals, and gain insights that enabled understanding, communication, and action. We discuss how these results highlight the importance of accounting for distinct and concurrent goals in personal informatics together with implications for the design of future goal-directed personal informatics tools.

HCI Contributions in Mental Health: A Modular Framework to Guide Psychosocial Intervention Design.

Many people prefer psychosocial interventions for mental health care or other concerns, but these interventions are often complex and unavailable in settings where people seek care. Intervention designers use technology to improve user experience or reach of interventions, and HCI researchers have made many contributions toward this goal. Both HCI and mental health researchers must navigate tensions between innovating on and adhering to the theories of change that guide intervention design. In this paper, we propose a framework that describes design briefs and evaluation approaches for HCI contributions at the scopes of capabilities, components, intervention systems, and intervention implementations. We show how theories of change (from mental health) can be translated into design briefs (in HCI), and that these translations can bridge and coordinate efforts across fields. It is our hope that this framework can support researchers in motivating, planning, conducting, and communicating work that advances psychosocial intervention design.

Relationship of Blood Pressure, Health Behaviors, and New Diagnosis and Control of Hypertension in the BP-CHECK Study.

BACKGROUND: Undiagnosed hypertension and uncontrolled blood pressure (BP) are common and contribute to excess cardiovascular morbidity and mortality. We examined whether BP control, changes in BP, and patient behaviors and attitudes were associated with a new hypertension diagnosis. METHODS: We performed a post hoc analysis of 323 participants from BP-CHECK (Blood Pressure Checks for Diagnosing Hypertension), a randomized diagnostic study of BP measuring methods in adults without diagnosed hypertension with elevated BP recruited from 12 primary care clinics of an integrated health care system in Washington State during 2017 to 2019. All 323 participants returned a positive diagnostic test for hypertension based on 24-hour ambulatory BP monitoring and were followed for 6 months. We used linear regression to examine the relationships between a new hypertension diagnosis (primary independent variable) and differences in the change in study outcomes from baseline to 6-month. RESULTS: Mean age of study participants was 58.3 years (SD, 13.1), 147 (45%) were women, and 253 (80%) were of non-Hispanic White race. At 6 months, 154 of 323 (48%) participants had a new hypertension diagnosis of whom 88 achieved target BP control. Participants with a new hypertension diagnosis experienced significantly larger declines from baseline in BP (adjusted mean difference: systolic BP, -7.6 mm Hg [95% CI, -10.3 to -4.8]; diastolic BP, -3.8 mm Hg [95% CI, -5.6 to -2.0]) compared with undiagnosed peers. They were also significantly more likely to achieve BP control by 6 months compared with undiagnosed participants (adjusted relative risk, 1.5 [95% CI, 1.1 to 2.0]). At 6 months, 101 of 323 participants (31%) with a positive ambulatory BP monitoring diagnostic test remained with undiagnosed hypertension, uncontrolled BP, and no antihypertensive medications. CONCLUSIONS: Approximately one-third of participants with high BP on screening and ambulatory BP monitoring diagnostic testing remained with undiagnosed hypertension, uncontrolled BP, and no antihypertensive medications after 6 months. New strategies are needed to enhance integration of BP diagnostic testing into clinical practice. REGISTRATION: URL: https://www.clinicaltrials.gov; Unique identifier: NCT03130257.

An Integrative Engagement Model of Digital Psychotherapy: Exploratory Focus Group Findings.

BACKGROUND: Digital mental health interventions, such as 2-way and asynchronous messaging therapy, are a growing part of the mental health care treatment ecosystem, yet little is known about how users engage with these interventions over the course of their treatment journeys. User engagement, or client behaviors and therapeutic relationships that facilitate positive treatment outcomes, is a necessary condition for the effectiveness of any digital treatment. Developing a better understanding of the factors that impact user engagement can impact the overall effectiveness of digital psychotherapy. Mapping the user experience in digital therapy may be facilitated by integrating theories from several fields. Specifically, health science's Health Action Process Approach and human-computer interaction's Lived Informatics Model may be usefully synthesized with relational constructs from psychotherapy process-outcome research to identify the determinants of engagement in digital messaging therapy. OBJECTIVE: This study aims to capture insights into digital therapy users' engagement patterns through a qualitative analysis of focus group sessions. We aimed to synthesize emergent intrapersonal and relational determinants of engagement into an integrative framework of engagement in digital therapy. METHODS: A total of 24 focus group participants were recruited to participate in 1 of 5 synchronous focus group sessions held between October and November 2021. Participant responses were coded by 2 researchers using thematic analysis. RESULTS: Coders identified 10 relevant constructs and 24 subconstructs that can collectively account for users' engagement and experience trajectories in the context of digital therapy. Although users' engagement trajectories in digital therapy varied widely, they were principally informed by intrapsychic factors (eg, self-efficacy and outcome expectancy), interpersonal factors (eg, the therapeutic alliance and its rupture), and external factors (eg, treatment costs and social support). These constructs were organized into a proposed Integrative Engagement Model of Digital Psychotherapy. Notably, every participant in the focus groups indicated that their ability to connect with their therapist was among the most important factors that were considered in continuing or terminating treatment. CONCLUSIONS: Engagement in messaging therapy may be usefully approached through an interdisciplinary lens, linking constructs from health science, human-computer interaction studies, and clinical science in an integrative engagement framework. Taken together, our results suggest that users may not view the digital psychotherapy platform itself as a treatment so much as a means of gaining access to a helping provider, that is, users did not see themselves as engaging with a platform but instead viewed their experience as a healing relationship. The findings of this study suggest that a better understanding of user engagement is crucial for enhancing the effectiveness of digital mental health interventions, and future research should continue to explore the underlying factors that contribute to engagement in digital mental health interventions. TRIAL REGISTRATION: ClinicalTrials.gov NCT04507360; https://clinicaltrials.gov/ct2/show/NCT04507360.

Evaluating a Novel, Portable, Self-Administrable Device ("Beacon") That Measures Critical Flicker Frequency as a Test for Hepatic Encephalopathy.

INTRODUCTION: We compared critical flicker frequency (CFF) thresholds obtained using a novel portable device "Beacon" with thresholds from the commercially available Lafayette Flicker Fusion System (Lafayette-FFS) in patients with cirrhosis. METHODS: One hundred fifty-three participants with chronic liver disease underwent CFF testing using Beacon and Lafayette-FFS with a method-of-limits and/or forced-choice protocol. RESULTS: Beacon demonstrated excellent test-retest reliability (intraclass correlation 0.91-0.97) and good correlation with the Lafayette-FFS values (intraclass correlation 0.77-0.84). Forced-choice CFF were on average 4.1 Hz higher than method-of-limits descending CFFs. DISCUSSION: Beacon can be self-administered by patients with chronic liver disease and cirrhosis to measure CFF, a validated screening test for minimal hepatic encephalopathy.

Acceptability and Adherence to Home, Kiosk, and Clinic Blood Pressure Measurement Compared to 24-H Ambulatory Monitoring.

BACKGROUND: The US Preventive Services Task Force recommends measuring blood pressure (BP) outside of clinic/office settings. While various options are available, including home devices, BP kiosks, and 24-h ambulatory BP monitoring (ABPM), understanding patient acceptability and adherence is a critical factor for implementation. OBJECTIVE: To compare the acceptability and adherence of clinic, home, kiosk, and ABPM measurement. DESIGN: Comparative diagnostic accuracy study which randomized adults to one of three BP measurement arms: clinic, home, and kiosk. ABPM was conducted on all participants. PARTICIPANTS: Adults (18-85 years) receiving care at 12 Kaiser Permanente Washington primary care clinics (Washington State, USA) with a high BP (≥ 138 mmHg systolic or ≥ 88 mmHg diastolic) in the electronic health record with no hypertension diagnosis and on no hypertensive medications and with high BP at a research screening visit. MEASURES: Patient acceptability was measured using a validated survey which was used to calculate an overall acceptability score (range 1-7) at baseline, after completing their assigned BP measurement intervention, and after completing ABPM. Adherence was defined based on the pre-specified number of BP measurements completed. KEY RESULTS: Five hundred ten participants were randomized (mean age 59 years), with mean BP of 150/88. Overall acceptability score was highest (i.e. most acceptable) for Home BP (mean 6.2, SD 0.7) and lowest (least acceptable) for ABPM (mean 5.0, SD 1.0); scores were intermediate for Clinic (5.5, SD 1.1) and Kiosk (5.4, SD 1.0). Adherence was higher for Home (154/170, 90.6%) and Clinic (150/172, 87.2%) than for Kiosk (114/168, 67.9%)). The majority of participants (467/510, 91.6%) were adherent to ABPM. CONCLUSIONS: Participants found home BP measurement most acceptable followed by clinic, BP kiosks, and ABPM. Our findings, coupled with recent evidence regarding the accuracy of home BP measurement, further support the routine use of home-based BP measurement in primary care practice in the US. TRIAL REGISTRATION: ClinicalTrials.gov NCT03130257 https://clinicaltrials.gov/ct2/show/NCT03130257.

Symptom management needs of patients with irritable bowel syndrome and concurrent anxiety and/or depression: A qualitative study.

AIMS: To understand the experiences and needs of symptom management among individuals with irritable bowel syndrome and concurrent symptoms of anxiety and/or depression. DESIGN: This study used a qualitative descriptive research design. METHODS: Individuals with a diagnosis of irritable bowel syndrome and concurrent symptoms of anxiety and/or depression participated were recruited through an online ResearchMatch and a listserv. Semi-structured interviews focused on symptoms and experiences with symptom management interventions conducted from June to August 2020. Interviews were transcribed and data were analysed based on thematic analysis. RESULTS: Twelve individuals participated in this study; all reported current irritable bowel syndrome and anxiety/depression symptoms. The data analysis cumulated with three themes related to symptom management: (a) irritable bowel syndrome negatively impacts physical and mental well-being; (b) a trial and error approach to symptom management; and (c) challenges with healthcare professionals supporting symptom management including negative interactions with healthcare professionals and lack of nutritional expertize and support. CONCLUSION: There is a need for individualized approaches which consider patients' current symptoms of anxiety and depression, previous experiences with the trial-and-error process and consideration for intervention delivery methods. IMPACT: There is a limited qualitative research focusing on the experiences of individuals with irritable bowel syndrome and concurrent symptoms of anxiety and/or depression. This research highlights the need for individualized approaches to enhance symptom management that acknowledges patients' psychological state and past negative experiences with providers and prior dietary regimens.

Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact.

Human computer interaction (HCI) and implementation science (IS) each have been applied to improve the adoption and delivery of innovative health interventions, and the two fields have complementary goals, foci, and methods. While the IS community increasingly draws on methods from HCI, there are many unrealized opportunities for HCI to draw from IS and to catalyze bidirectional collaborations. This workshop will explore similarities and differences between fields, with a goal of articulating a research agenda at their intersection.

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis.

BACKGROUND: People often prefer evidence-based psychosocial interventions (EBPIs) for mental health care; however, these interventions frequently remain unavailable to people in nonspecialty or integrated settings, such as primary care and schools. Previous research has suggested that usability, a concept from human-centered design, could support an understanding of the barriers to and facilitators of the successful adoption of EBPIs and support the redesign of EBPIs and implementation strategies. OBJECTIVE: This study aimed to identify and categorize usability issues in EBPIs and their implementation strategies. METHODS: We adapted a usability issue analysis and reporting format from a human-centered design. A total of 13 projects supported by the National Institute of Mental Health-funded Accelerating the Reach and Impact of Treatments for Youth and Adults with Mental Illness Center at the University of Washington used this format to describe usability issues for EBPIs and implementation strategies with which they were working. Center researchers used iterative affinity diagramming and coding processes to identify usability issue categories. On the basis of these categories and the underlying issues, we propose heuristics for the design or redesign of EBPIs and implementation strategies. RESULTS: The 13 projects reported a total of 90 usability issues, which we categorized into 12 categories, including complex and/or cognitively overwhelming, required time exceeding available time, incompatibility with interventionist preference or practice, incompatibility with existing workflow, insufficient customization to clients/recipients, intervention buy-in (value), interventionist buy-in (trust), overreliance on technology, requires unavailable infrastructure, inadequate scaffolding for client/recipient, inadequate training and scaffolding for interventionists, and lack of support for necessary communication. These issues range from minor inconveniences that affect a few interventionists or recipients to severe issues that prevent all interventionists or recipients in a setting from completing part or all of the intervention. We propose 12 corresponding heuristics to guide EBPIs and implementation strategy designers in preventing and addressing these usability issues. CONCLUSIONS: Usability issues were prevalent in the studied EBPIs and implementation strategies. We recommend using the lens of usability evaluation to understand and address barriers to the effective use and reach of EBPIs and implementation strategies. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): RR2-10.2196/14990.

Blood Pressure Checks for Diagnosing Hypertension: Health Professionals' Knowledge, Beliefs, and Practices.

INTRODUCTION: The US Preventive Services Task Force recommends out-of-office blood pressure (BP) measurement before making a new hypertension diagnosis and initiating treatment, using 24-hour ambulatory (ABPM) or home BP monitoring. However, this approach is not common. METHODS: e-mail-linked surveys were sent to primary care team members (n = 421) from 10 clinics. The sample included medical assistants, licensed practical nurses, registered nurses, and advanced practice registered nurses (LPN/RN/APRNs), physician assistants (PAs), and physicians. Those licensed to diagnosis hypertension (physician/PA/APRNs) received additional questions. Data were collected from November 2017 to July 2019. RESULTS: 2-thirds of invitees responded (163 MA/LPN/RNs, 86 physicians, and 33 PA/APRNs). When making a new hypertension diagnosis, most respondents believed that BP measured manually with a stethoscope (78.6%) or ABPM (84.2%) were very or highly accurate. In contrast, most did not believe that automated clinic BPs, home BP, or kiosk BP measurements were very or highly accurate. Almost all reported always or almost always relying on clinic BP measurements in making a diagnosis (95.7%), but most physician/PA/APRNs (60.5%) would prefer ABPM if it was readily available. Very few physician/PA/APRNs used the guideline-concordant diagnostic threshold (135/85 mmHg) with home monitoring (14.0%) or ABPM (8.4%), with 140/90 mmHg the most commonly reported threshold for home (59.4%) and ABPM (49.6%). DISCUSSION: Our study found health care professional knowledge, beliefs, and practices gaps in diagnosing hypertension. These gaps could lead to clinical care that is not aligned with guidelines. CONCLUSION: System changes and interventions to increase use of evidence-based practices could improve hypertension diagnosis and outcomes.

Understanding self-monitoring to inform a mobile intervention for binge eating and weight management: A proof-of-concept randomized trial.

OBJECTIVE: This study explored consumers' perspectives on self-monitoring, a common feature in behavioral interventions that helps inform consumers' progress and answer their questions, to learn what outcome metrics matter to consumers and whether self-selection of these metrics leads to greater engagement (i.e., compliance, satisfaction) in self-monitoring than monitoring only default options. METHODS: In a proof-of-concept randomized trial, 48 adult participants were randomly assigned to "clinician-determined monitoring" or "clinician + self-determined monitoring" conditions. Before starting monitoring, all participants shared outcomes that would matter to them in a mobile intervention for binge eating and weight management. Then, for 3 weeks, participants in the "clinician-determined" condition monitored their weight and binge-eating episodes, and participants in the "clinician + self-determined" condition monitored these and another metric of their choosing. After, satisfaction and compliance were assessed. RESULTS: Participants identified 116 metrics, grouped into 12 themes, that mattered to them. During monitoring, participants in the "clinician + self-determined" condition monitored 41 metrics. Surprisingly, participants in the "clinician-determined" condition also monitored metrics besides weight and binge eating. This resulted in a failure of our experimental manipulation, which represents a significant limitation of this research. No significant differences emerged in satisfaction or compliance between conditions. DISCUSSION: Although our proof-of-concept trial yielded null quantitative results, findings also suggested binge eating and weight management interventions may benefit from including an individually customizable monitoring option in addition to default metrics, warranting testing in future research. PUBLIC SIGNIFICANCE: Examining consumers' self-monitoring preferences for a mobile intervention for binge eating and weight management revealed a variety of metrics that matter to consumers, although binge eating and weight were still most valued. Findings from our proof-of-concept trial suggest design implications of encouraging an individually customizable monitoring option, in addition to default metrics, which needs to be tested in future research over a longer period and during actual mobile intervention delivery.

Lessons learned from designing an asynchronous remote community approach for behavioral activation intervention for teens.

Adolescent depression is common; however, over 60% of depressed adolescents do not receive mental health care. Digitally-delivered evidence-based psychosocial interventions (EBPIs) may provide an opportunity to improve access and engagement in mental health care. We present a case study that reviews lessons learned from using the Discover - Design - Build - Test (DDBT) model to create, develop, and evaluate a high-fidelity prototype of an app to deliver an EBPI for depression, behavioral activation (BA), on an Asynchronous Remote Communities (ARC) platform (referred to as ActivaTeen). We review work at each stage of the DDBT framework, including initial formative work, iterative design and development work, and an initial feasibility study. We engaged teens with depression, mental health clinicians, and expert evaluators through the process. We found that the DDBT model supported the research team in understanding the requirements for our prototype system, ActivaTeen, and conceiving of and developing specific ideas for implementation. Our work contributes a case study of how the DDBT framework can be applied to adapting an EBPI to a new, scalable and digital format. We provide lessons learned from engaging teens and clinicians with an asynchronous approach to EBPIs and human centered design considerations for teen mental health.

Clinic, Home, and Kiosk Blood Pressure Measurements for Diagnosing Hypertension: a Randomized Diagnostic Study.

BACKGROUND: The US Preventive Services Task Force recommends blood pressure (BP) measurements using 24-h ambulatory monitoring (ABPM) or home BP monitoring before making a new hypertension diagnosis. OBJECTIVE: Compare clinic-, home-, and kiosk-based BP measurement to ABPM for diagnosing hypertension. DESIGN, SETTING, AND PARTICIPANTS: Diagnostic study in 12 Washington State primary care centers, with participants aged 18-85 years without diagnosed hypertension or prescribed antihypertensive medications, with elevated BP in clinic. INTERVENTIONS: Randomization into one of three diagnostic regimens: (1) clinic (usual care follow-up BPs); (2) home (duplicate BPs twice daily for 5 days); or (3) kiosk (triplicate BPs on 3 days). All participants completed ABPM at 3 weeks. MAIN MEASURES: Primary outcome was difference between ABPM daytime and clinic, home, and kiosk mean systolic BP. Differences in diastolic BP, sensitivity, and specificity were secondary outcomes. KEY RESULTS: Five hundred ten participants (mean age 58.7 years, 80.2% white) with 434 (85.1%) included in primary analyses. Compared to daytime ABPM, adjusted mean differences in systolic BP were clinic (-4.7mmHg [95% confidence interval -7.3, -2.2]; P<.001); home (-0.1mmHg [-1.6, 1.5];P=.92); and kiosk (9.5mmHg [7.5, 11.6];P<.001). Differences for diastolic BP were clinic (-7.2mmHg [-8.8, -5.5]; P<.001); home (-0.4mmHg [-1.4, 0.7];P=.52); and kiosk (5.0mmHg [3.8, 6.2]; P<.001). Sensitivities for clinic, home, and kiosk compared to ABPM were 31.1% (95% confidence interval, 22.9, 40.6), 82.2% (73.8, 88.4), and 96.0% (90.0, 98.5), and specificities 79.5% (64.0, 89.4), 53.3% (38.9, 67.2), and 28.2% (16.4, 44.1), respectively. LIMITATIONS: Single health care organization and limited race/ethnicity representation. CONCLUSIONS: Compared to ABPM, mean BP was significantly lower for clinic, significantly higher for kiosk, and without significant differences for home. Clinic BP measurements had low sensitivity for detecting hypertension. Findings support utility of home BP monitoring for making a new diagnosis of hypertension. TRIAL REGISTRATION: ClinicalTrials.gov NCT03130257 https://clinicaltrials.gov/ct2/show/NCT03130257.

Using Health Concept Surveying to Elicit Usable Evidence: Case Studies of a Novel Evaluation Methodology.

BACKGROUND: Developers, designers, and researchers use rapid prototyping methods to project the adoption and acceptability of their health intervention technology (HIT) before the technology becomes mature enough to be deployed. Although these methods are useful for gathering feedback that advances the development of HITs, they rarely provide usable evidence that can contribute to our broader understanding of HITs. OBJECTIVE: In this research, we aim to develop and demonstrate a variation of vignette testing that supports developers and designers in evaluating early-stage HIT designs while generating usable evidence for the broader research community. METHODS: We proposed a method called health concept surveying for untangling the causal relationships that people develop around conceptual HITs. In health concept surveying, investigators gather reactions to design concepts through a scenario-based survey instrument. As the investigator manipulates characteristics related to their HIT, the survey instrument also measures proximal cognitive factors according to a health behavior change model to project how HIT design decisions may affect the adoption and acceptability of an HIT. Responses to the survey instrument were analyzed using path analysis to untangle the causal effects of these factors on the outcome variables. RESULTS: We demonstrated health concept surveying in 3 case studies of sensor-based health-screening apps. Our first study (N=54) showed that a wait time incentive could influence more people to go see a dermatologist after a positive test for skin cancer. Our second study (N=54), evaluating a similar application design, showed that although visual explanations of algorithmic decisions could increase participant trust in negative test results, the trust would not have been enough to affect people's decision-making. Our third study (N=263) showed that people might prioritize test specificity or sensitivity depending on the nature of the medical condition. CONCLUSIONS: Beyond the findings from our 3 case studies, our research uses the framing of the Health Belief Model to elicit and understand the intrinsic and extrinsic factors that may affect the adoption and acceptability of an HIT without having to build a working prototype. We have made our survey instrument publicly available so that others can leverage it for their own investigations.

Impact of COVID-19 on Individuals With Irritable Bowel Syndrome and Comorbid Anxiety and/or Depression.

GOALS: The goal of this study was to describe the influence of the COVID-19 pandemic on ability to engage in activities and the influence on psychological distress and gastrointestinal symptoms among individuals with irritable bowel syndrome (IBS) and comorbid anxiety and/or depression. BACKGROUND: Individuals with IBS and comorbid anxiety and/or depression report increased symptoms and decreased quality of life compared with individuals with IBS alone. The current COVID-19 pandemic has the potential to further influence symptoms among individuals with IBS and comorbid anxiety and/or depression. STUDY: Individuals who met the Rome-IV IBS criteria and reported mild to severe anxiety and/or depression were included. Participants completed an online survey with questions about anxiety, depression, impact of COVID on activities and symptoms, and demographics. RESULTS: Fifty-five individuals participated in the study. The COVID-19 pandemic most commonly influenced their ability to spend time with friends and family, shop for certain types of food, and access health care. Participants also reported increased stress (92%), anxiety (81%), and depressive symptoms (67%). Finally, around half the sample reported increases in abdominal pain (48%), diarrhea (45%), or constipation (44%). CONCLUSIONS: The COVID-19 pandemic is related to self-reported increases in psychological distress and gastrointestinal symptoms among individuals with IBS and comorbid anxiety and/or depression. Additional research is needed to intervene on these symptoms.

Designing Asynchronous Remote Support for Behavioral Activation in Teenagers With Depression: Formative Study.

BACKGROUND: Many teenagers in the United States experience challenges with symptoms of depression, and they lack adequate resources for accessing in-person mental health care. Involving teens and clinicians in designing technologies that use evidence-based practices that reduce barriers to accessing mental health care is crucial. Interventions based on behavioral activation (BA) help teens understand the relationship between mood and activity, help them practice goal-directed behaviors to improve mood, and may be particularly well-suited to delivery via internet-based platforms. OBJECTIVE: This study aims to understand the needs and challenges that teens and mental health clinicians face in depression management and involve them in the design process of a remote intervention that uses asynchronous remote communities. Our goal is to understand the benefits and challenges of adapting BA to an internet-based platform that supports the asynchronous remote community approach as a delivery tool for teen depression management. METHODS: We enrolled mental health clinicians (n=10) and teens (n=8) in separate, private, internet-based groups on Slack (Slack Technologies Inc). They participated in 20-minute design activities for 10 weeks and were then invited to interviews about their experiences in the study. RESULTS: Both teen and clinician participants wanted internet-based support for BA as a supplement to in-person therapy. Although participants perceived the asynchronous format as conducive to supporting accessible care, teens and clinicians raised concerns about safety, privacy, and the moderating of the internet-based group. Design decisions that address these concerns need to be balanced with the potential benefits of learning coping skills, increasing access to mental health care, and promoting asynchronous human connection to support teens. CONCLUSIONS: We discuss considerations for balancing tensions in privacy and safety while designing and selecting internet-based platforms to support remote care and integrating evidence-based support when designing digital technologies for the treatment of teens with depression.

The Cognitive Walkthrough for Implementation Strategies (CWIS): a pragmatic method for assessing implementation strategy usability.

BACKGROUND: Implementation strategies have flourished in an effort to increase integration of research evidence into clinical practice. Most strategies are complex, socially mediated processes. Many are complicated, expensive, and ultimately impractical to deliver in real-world settings. The field lacks methods to assess the extent to which strategies are usable and aligned with the needs and constraints of the individuals and contexts who will deliver or receive them. Drawn from the field of human-centered design, cognitive walkthroughs are an efficient assessment method with potential to identify aspects of strategies that may inhibit their usability and, ultimately, effectiveness. This article presents a novel walkthrough methodology for evaluating strategy usability as well as an example application to a post-training consultation strategy to support school mental health clinicians to adopt measurement-based care. METHOD: The Cognitive Walkthrough for Implementation Strategies (CWIS) is a pragmatic, mixed-methods approach for evaluating complex, socially mediated implementation strategies. CWIS includes six steps: (1) determine preconditions; (2) hierarchical task analysis; (3) task prioritization; (4) convert tasks to scenarios; (5) pragmatic group testing; and (6) usability issue identification, classification, and prioritization. A facilitator conducted two group testing sessions with clinician users (N = 10), guiding participants through 6 scenarios and 11 associated subtasks. Clinicians reported their anticipated likelihood of completing each subtask and provided qualitative justifications during group discussion. Following the walkthrough sessions, users completed an adapted quantitative assessment of strategy usability. RESULTS: Average anticipated success ratings indicated substantial variability across participants and subtasks. Usability ratings (scale 0-100) of the consultation protocol averaged 71.3 (SD = 10.6). Twenty-one usability problems were identified via qualitative content analysis with consensus coding, and classified by severity and problem type. High-severity problems included potential misalignment between consultation and clinical service timelines as well as digressions during consultation processes. CONCLUSIONS: CWIS quantitative usability ratings indicated that the consultation protocol was at the low end of the "acceptable" range (based on norms from the unadapted scale). Collectively, the 21 resulting usability issues explained the quantitative usability data and provided specific direction for usability enhancements. The current study provides preliminary evidence for the utility of CWIS to assess strategy usability and generate a blueprint for redesign.

Integrating User-Centered Design and Behavioral Science to Design a Mobile Intervention for Obesity and Binge Eating: Mixed Methods Analysis.

BACKGROUND: Accounting for how end users engage with technologies is imperative for designing an efficacious mobile behavioral intervention. OBJECTIVE: This mixed methods analysis examined the translational potential of user-centered design and basic behavioral science to inform the design of a new mobile intervention for obesity and binge eating. METHODS: A total of 22 adults (7/22, 32% non-Hispanic White; 8/22, 36% male) with self-reported obesity and recurrent binge eating (≥12 episodes in 3 months) who were interested in losing weight and reducing binge eating completed a prototyping design activity over 1 week. Leveraging evidence from behavioral economics on choice architecture, participants chose treatment strategies from 20 options (aligned with treatment targets composing a theoretical model of the relation between binge eating and weight) to demonstrate which strategies and treatment targets are relevant to end users. The process by which participants selected and implemented strategies and their change in outcomes were analyzed. RESULTS: Although prompted to select one strategy, participants selected between 1 and 3 strategies, citing perceived achievability, helpfulness, or relevance as selection reasons. Over the week, all practiced a strategy at least once; 82% (18/22) struggled with implementation, and 23% (5/22) added a new strategy. Several themes emerged on successes and challenges with implementation, yielding design implications for supporting users in behavior change. In postexperiment reflections, 82% (18/22) indicated the strategy was helpful, and 86% (19/22) planned to continue use. One-week average within-subject changes in weight (-2.2 [SD -5.0] pounds) and binge eating (-1.6 [SD -1.8] episodes) indicated small clinical improvement. CONCLUSIONS: Applying user-centered design and basic behavioral science yielded design insights to incorporate personalization through user choice with guidance, which may enhance engagement with and potential efficacy of digital health interventions.

Assessing the Usability of Complex Psychosocial Interventions: The Intervention Usability Scale.

Background: Usability - the extent to which an intervention can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction - may be a key determinant of implementation success. However, few instruments have been developed to measure the design quality of complex health interventions (i.e., those with several interacting components). This study evaluated the structural validity of the Intervention Usability Scale (IUS), an adapted version of the well-established System Usability Scale (SUS) for digital technologies, to measure the usability of a leading complex psychosocial intervention, Motivational Interviewing (MI), for behavioral health service delivery in primary care. Prior SUS studies have found both one- and two-factor solutions, both of which were examined in the current study of the IUS. Method: A survey administered to 136 medical professionals from 11 primary care sites collected demographic information and IUS ratings for MI, the evidence-based psychosocial intervention that primary care providers reported using most often for behavioral health service delivery. Factor analyses replicated procedures used in prior research on the SUS. Results: Analyses indicated that a two-factor solution (with "usable" and "learnable" subscales) best fit the data, accounting for 54.1% of the variance. Inter-item reliabilities for the total score, usable subscale, and learnable subscale were α = .83, α = .84, and α = .67, respectively. Conclusions: This study provides evidence for a two-factor IUS structure consistent with some prior research, as well as acceptable reliability. Implications for implementation research evaluating the usability of complex health interventions are discussed, including the potential for future comparisons across multiple interventions and provider types, as well as the use of the IUS to evaluate the relationship between usability and implementation outcomes such as feasibility.

"They don't always think about that": Translational Needs in the Design of Personal Health Informatics Applications.

Personal health informatics continues to grow in both research and practice, revealing many challenges of designing applications that address people's needs in their health, everyday lives, and collaborations with clinicians. Research suggests strategies to address such challenges, but has struggled to translate these strategies into design practice. This study examines translation of insights from personal health informatics research into resources to support designers. Informed by a review of relevant literature, we present our development of a prototype set of design cards intended to support designers in re-thinking potential assumptions about personal health informatics. We examined our design cards in semi-structured interviews, first with 12 student designers and then with 12 health-focused professional designers and researchers. Our results and discussion reveal tensions and barriers designers encounter, the potential for translational resources to inform the design of health-related technologies, and a need to support designers in addressing challenges of knowledge, advocacy, and evidence in designing for health.