Satisfaction, Perceived Usefulness, and Therapeutic Alliance as Correlates of Participant Engagement in a Pediatric Digital Mental Health Intervention: Cross-Sectional Questionnaire Study.

BACKGROUND: Although evidence suggests that digital mental health interventions (DMHIs) are effective alternatives to traditional mental health care, participant engagement continues to be an issue, especially for pediatric DMHIs. Extant studies of DMHIs among adults suggest that participants' satisfaction, perceived usefulness, and therapeutic alliance are closely tied to engagement. However, these associations have not been investigated among children and adolescents involved in DMHIs. OBJECTIVE: To address these gaps in extant DMHI research, the purpose of this study was to (1) develop and implement a measure to assess satisfaction, perceived usefulness, and therapeutic alliance among children and adolescents participating in a DMHI and (2) investigate satisfaction, perceived usefulness, and therapeutic alliance as correlates of children's and adolescents' engagement in the DMHI. METHODS: Members (children and adolescents) of a pediatric DMHI who had completed at least one session with a care provider (eg, coach or therapist) were eligible for inclusion in the study. Adolescent members and caregivers of children completed a survey assessing satisfaction with service, perceived usefulness of care, and therapeutic alliance with care team members. RESULTS: This study provides evidence for the reliability and validity of an adolescent- and caregiver-reported user experience assessment in a pediatric DMHI. Moreover, our findings suggest that adolescents' and caregivers' satisfaction and perceived usefulness are salient correlates of youths' engagement with a DMHI. CONCLUSIONS: This study provides valuable preliminary evidence that caregivers' satisfaction and perceived usefulness are salient correlates of youths' engagement with a DMHI. Although further research is required, these findings offer preliminary evidence that caregivers play a critical role in effectively increasing engagement among children and adolescents involved in DMHIs.

Using Digital Measurement-Based Care to Address Symptoms of Inattention, Hyperactivity, and Opposition in Youth: Retrospective Analysis of Bend Health.

BACKGROUND: Attention-deficit/hyperactivity disorder (ADHD) and associated behavioral disorders are highly prevalent in children and adolescents, yet many of them do not receive the care they need. Digital mental health interventions (DMHIs) may address this need by providing accessible and high-quality care. Given the necessity for high levels of caregiver and primary care practitioner involvement in addressing ADHD symptoms and behavioral problems, collaborative care interventions that adopt a whole-family approach may be particularly well suited to reduce symptoms of inattention, hyperactivity, and opposition in children and adolescents. OBJECTIVE: The purpose of this study is to use member (ie, child and adolescent) data from Bend Health, Inc, a collaborative care DMHI that uses a whole-family approach to address child and adolescent mental health concerns, to (1) determine the effects of a collaborative care DMHI on inattention, hyperactivity, and oppositional symptoms in children and adolescents and (2) assess whether the effects of a collaborative care DMHI vary across ADHD subtypes and demographic factors. METHODS: Caregivers of children and adolescents with elevated symptoms of inattention, hyperactivity, or opposition assessed their children's symptom severity approximately every 30 days while participating in Bend Health, Inc. Data from 107 children and adolescents aged 6-17 years who exhibited clinically elevated symptoms at baseline were used to assess symptom severity across monthly assessments (inattention symptom group: n=91, 85.0%; hyperactivity symptom group: n=48, 44.9%; oppositional symptom group: n=70, 65.4%). The majority of the sample exhibited elevated symptoms of at least 2 symptom types at baseline (n=67, 62.6%). RESULTS: Members received care for up to 5.52 months and attended between 0 and 10 coaching, therapy, or psychiatry sessions through Bend Health, Inc. For those with at least 2 assessments, 71.0% (n=22) showed improvements in inattention symptoms, 60.0% (n=9) showed improvements in hyperactivity symptoms, and 60.0% (n=12) showed improvements in oppositional symptoms. When considering group-level change over time, symptom severity decreased over the course of treatment with Bend Health, Inc, for inattention (average decrease=3.51 points, P=.001) and hyperactivity (average decrease=3.07 points, P=.049) but not for oppositional symptoms (average decrease=0.70 points, P=.26). There was a main effect of the duration of care on symptom severity (P<.001) such that each additional month of care was associated with lower symptom scores. CONCLUSIONS: This study offers promising early evidence that collaborative care DHMIs may facilitate improvements in ADHD symptoms among children and adolescents, addressing the growing need for accessible and high-quality care for behavioral health problems in the United States. However, additional follow-up studies bolstered by larger samples and control groups are necessary to further establish the robustness of these findings.

Using Digital Measurement-Based Care for the Treatment of Anxiety and Depression in Children and Adolescents: Observational Retrospective Analysis of Bend Health Data.

BACKGROUND: A growing body of evidence supports the efficacy of measurement-based care (MBC) for children and adolescents experiencing mental health concerns, particularly anxiety and depression. In recent years, MBC has increasingly transitioned to web-based spaces in the form of digital mental health interventions (DMHIs), which render high-quality mental health care more accessible nationwide. Although extant research is promising, the emergence of MBC DMHIs means that much is unknown regarding their effectiveness as a treatment for anxiety and depression, particularly among children and adolescents. OBJECTIVE: This study uses preliminary data from children and adolescents participating in an MBC DMHI administered by Bend Health Inc, a mental health care provider that uses a collaborative care model to assess changes in anxiety and depressive symptoms during participation in the MBC DMHI. METHODS: Caregivers of children and adolescents participating in Bend Health Inc for anxiety or depressive symptoms reported measures of their children's symptoms every 30 days throughout the duration of participation in Bend Health Inc. Data from 114 children (age 6-12 years) and adolescents (age 13-17 years) were used for the analyses (anxiety symptom group: n=98, depressive symptom group: n=61). RESULTS: Among children and adolescents participating in care with Bend Health Inc, 73% (72/98) exhibited improvements in anxiety symptoms and 73% (44/61) exhibited improvement in depressive symptoms, as indicated by either a decrease in symptom severity or screening out of completing the complete assessment. Among those with complete assessment data, group-level anxiety symptom T-scores exhibited a moderate decrease of 4.69 points (P=.002) from the first to the last assessment. However, members' depressive symptom T-scores remained largely stable throughout their involvement. CONCLUSIONS: As increasing numbers of young people and families seek DMHIs over traditional mental health treatments due to their accessibility and affordability, this study offers promising early evidence that youth anxiety symptoms decrease during involvement in an MBC DMHI such as Bend Health Inc. However, further analyses with enhanced longitudinal symptom measures are necessary to determine whether depressive symptoms show similar improvements among those involved in Bend Health Inc.

The Groundskeeper Gaming Platform as a Diagnostic Tool for Attention-Deficit/Hyperactivity Disorder: Sensitivity, Specificity, and Relation to Other Measures.

OBJECTIVE: The purpose of this study was to assess the relative accuracies of the Conners' Brief Rating Scale, Parent Version, the Conners' Continuous Performance Test II (CPT II), and a novel interactive game called "Groundskeeper" to discriminate child psychiatric patients with and without attention-deficit/hyperactivity disorder (ADHD). METHODS: We administered the three assessments to 113 clinically referred ADHD and non-ADHD patients who had been diagnosed with the Kiddie-Schedule of Affective Disorders and Schizophrenia- Present and Lifetime (K-SADS-PL), Version 19. RESULTS: As measured by the area under the curve (AUC) statistic from receiver operating characteristic (ROC) analysis, the diagnostic accuracy of Groundskeeper (0.79) was as high as the accuracy of the Conners' parent rating of inattention (0.76) and better than the CPT II percent correct (0.62). Combining the three tests produced an AUC of 0.87. Correlations among the three measures were small and, mostly, not significant. CONCLUSIONS: Our finding of similar diagnostic accuracies between Groundskeeper and the Conners' inattention scale is especially remarkable given that the Conners' inattention scale shares method variance with the diagnostic process. Although our work is preliminary, it suggests that computer games may be useful in the diagnostic process. This provides an important direction for research, given the objectivity of such measures and the fact that computer games are well tolerated by youth.

A Machine Learning-Based Analysis of Game Data for Attention Deficit Hyperactivity Disorder Assessment.

OBJECTIVE: Attention deficit hyperactivity disorder (ADHD) is found in 9.5 percent of the U.S. population and poses lifelong challenges. Current diagnostic approaches rely on evaluation forms completed by teachers and/or parents, although they are not specifically trained to recognize cognitive disorders. The most accurate diagnosis is by a psychiatrist, often only available to children with severe symptoms. Development of a tool that is engaging and objective and aids medical providers is needed in the diagnosis of ADHD. The goal of this research is to work toward the development of such a tool. MATERIALS AND METHODS: The proposed approach takes advantage of two trends: The rapid adoption of tangible user interface devices and the popularity of interactive videogames. CogCubed Inc. (Minneapolis, MN) has created "Groundskeeper," a game on the Sifteo Cubes (Sifteo, Inc., San Francisco, CA) game system with elements that exercise skills affected by ADHD. "Groundskeeper" was evaluated for 52 patients, with and without ADHD. Gameplay data were mathematically transformed into ADHD-indicative feature variables and subjected to machine learning algorithms to develop diagnostic models to aid psychiatric clinical assessments of ADHD. The effectiveness of the developed model was evaluated against the diagnostic impressions of two licensed child/adolescent psychiatrists using semistructured interviews. RESULTS: Our predictive algorithms were highly accurate in correctly predicting diagnoses based on gameplay of "Groundskeeper." The F-measure, a measure of diagnosis accuracy, from the predictive models gave values as follows: ADHD, inattentive type, 78 percent (P>0.05); ADHD, combined type, 75 percent (P<0.05); anxiety disorders, 71%; and depressive disorders, 76%. CONCLUSIONS: This represents a promising new approach to screening tools for ADHD.