Validation of an ICD-Code-Based Case Definition for Psychotic Illness Across Three Health Systems.

BACKGROUND AND HYPOTHESIS: Psychosis-associated diagnostic codes are increasingly being utilized as case definitions for electronic health record (EHR)-based algorithms to predict and detect psychosis. However, data on the validity of psychosis-related diagnostic codes is limited. We evaluated the positive predictive value (PPV) of International Classification of Diseases (ICD) codes for psychosis. STUDY DESIGN: Using EHRs at 3 health systems, ICD codes comprising primary psychotic disorders and mood disorders with psychosis were grouped into 5 higher-order groups. 1133 records were sampled for chart review using the full EHR. PPVs (the probability of chart-confirmed psychosis given ICD psychosis codes) were calculated across multiple treatment settings. STUDY RESULTS: PPVs across all diagnostic groups and hospital systems exceeded 70%: Mass General Brigham 0.72 [95% CI 0.68-0.77], Boston Children's Hospital 0.80 [0.75-0.84], and Boston Medical Center 0.83 [0.79-0.86]. Schizoaffective disorder PPVs were consistently the highest across sites (0.80-0.92) and major depressive disorder with psychosis were the most variable (0.57-0.79). To determine if the first documented code captured first-episode psychosis (FEP), we excluded cases with prior chart evidence of a diagnosis of or treatment for a psychotic illness, yielding substantially lower PPVs (0.08-0.62). CONCLUSIONS: We found that the first documented psychosis diagnostic code accurately captured true episodes of psychosis but was a poor index of FEP. These data have important implications for the case definitions used in the development of risk prediction models designed to predict or detect undiagnosed psychosis.

Comparative effectiveness of remote digital gamified and group CBT skills training interventions for anxiety and depression among college students: Results of a three-arm randomised controlled trial.

Digital interventions can enhance access to healthcare in under-resourced settings. However, guided digital interventions may be costly for low- and middle-income countries, despite their effectiveness. In this randomised control trial, we evaluated the effectiveness of two digital interventions designed to address this issue: (1) a Cognitive Behavioral Therapy Skills Training (CST) intervention that increased scalability by using remote online group administration; and (2) the SuperBetter gamified self-guided CBT skills training app, which uses other participants rather than paid staff as guides. The study was implemented among anxious and/or depressed South African undergraduates (n = 371) randomised with equal allocation to Remote Group CST, SuperBetter, or a MoodFlow mood monitoring control. Symptoms were assessed with the Generalized Anxiety Disorder-7 (GAD-7) and the Patient Health Questionnaire-9 (PHQ-9). Intention-to-treat analysis found effect sizes at the high end of prior digital intervention trials, including significantly higher adjusted risk differences (ARD; primary outcome) in joint anxiety/depression remission at 3-months and 6-months for Remote Group CST (ARD = 23.3-18.9%, p = 0.001-0.035) and SuperBetter (ARD = 12.7-22.2%, p = 0.047-0.006) than MoodFlow and mean combined PHQ-9/GAD-7 scores (secondary outcome) significantly lower for Remote Group CST and SuperBetter than MoodFlow. These results illustrate how innovative delivery methods can increase the scalability of standard one-on-one guided digital interventions. PREREGISTRATION INTERNATIONAL STANDARD RANDOMISED CONTROLLED TRIAL NUMBER (ISRTCN) SUBMISSION #: 47,089,643.

Validation of an ICD-code-based case definition for psychotic illness across three health systems.

Background and Hypothesis: Early detection of psychosis is critical for improving outcomes. Algorithms to predict or detect psychosis using electronic health record (EHR) data depend on the validity of the case definitions used, typically based on diagnostic codes. Data on the validity of psychosis-related diagnostic codes is limited. We evaluated the positive predictive value (PPV) of International Classification of Diseases (ICD) codes for psychosis. Study Design: Using EHRs at three health systems, ICD codes comprising primary psychotic disorders and mood disorders with psychosis were grouped into five higher-order groups. 1,133 records were sampled for chart review using the full EHR. PPVs (the probability of chart-confirmed psychosis given ICD psychosis codes) were calculated across multiple treatment settings. Study Results: PPVs across all diagnostic groups and hospital systems exceeded 70%: Massachusetts General Brigham 0.72 [95% CI 0.68-0.77], Boston Children's Hospital 0.80 [0.75-0.84], and Boston Medical Center 0.83 [0.79-0.86]. Schizoaffective disorder PPVs were consistently the highest across sites (0.80-0.92) and major depressive disorder with psychosis were the most variable (0.57-0.79). To determine if the first documented code captured first-episode psychosis (FEP), we excluded cases with prior chart evidence of a diagnosis of or treatment for a psychotic illness, yielding substantially lower PPVs (0.08-0.62). Conclusions: We found that the first documented psychosis diagnostic code accurately captured true episodes of psychosis but was a poor index of FEP. These data have important implications for the development of risk prediction models designed to predict or detect undiagnosed psychosis.

Developing an individualized treatment rule for Veterans with major depressive disorder using electronic health records.

Efforts to develop an individualized treatment rule (ITR) to optimize major depressive disorder (MDD) treatment with antidepressant medication (ADM), psychotherapy, or combined ADM-psychotherapy have been hampered by small samples, small predictor sets, and suboptimal analysis methods. Analyses of large administrative databases designed to approximate experiments followed iteratively by pragmatic trials hold promise for resolving these problems. The current report presents a proof-of-concept study using electronic health records (EHR) of n = 43,470 outpatients beginning MDD treatment in Veterans Health Administration Primary Care Mental Health Integration (PC-MHI) clinics, which offer access not only to ADMs but also psychotherapy and combined ADM-psychotherapy. EHR and geospatial databases were used to generate an extensive baseline predictor set (5,865 variables). The outcome was a composite measure of at least one serious negative event (suicide attempt, psychiatric emergency department visit, psychiatric hospitalization, suicide death) over the next 12 months. Best-practices methods were used to adjust for nonrandom treatment assignment and to estimate a preliminary ITR in a 70% training sample and to evaluate the ITR in the 30% test sample. Statistically significant aggregate variation was found in overall probability of the outcome related to baseline predictors (AU-ROC = 0.68, S.E. = 0.01), with test sample outcome prevalence of 32.6% among the 5% of patients having highest predicted risk compared to 7.1% in the remainder of the test sample. The ITR found that psychotherapy-only was the optimal treatment for 56.0% of patients (roughly 20% lower risk of the outcome than if receiving one of the other treatments) and that treatment type was unrelated to outcome risk among other patients. Change in aggregate treatment costs of implementing this ITR would be negligible, as 16.1% fewer patients would be prescribed ADMs and 2.9% more would receive psychotherapy. A pragmatic trial would be needed to confirm the accuracy of the ITR.

Predicting Homelessness Among Transitioning U.S. Army Soldiers.

INTRODUCTION: This study develops a practical method to triage Army transitioning service members (TSMs) at highest risk of homelessness to target a preventive intervention. METHODS: The sample included 4,790 soldiers from the Study to Assess Risk and Resilience in Servicemembers-Longitudinal Study (STARRS-LS) who participated in 1 of 3 Army STARRS 2011-2014 baseline surveys followed by the third wave of the STARRS-LS online panel surveys (2020-2022). Two machine learning models were trained: a Stage-1 model that used administrative predictors and geospatial data available for all TSMs at discharge to identify high-risk TSMs for initial outreach; and a Stage-2 model estimated in the high-risk subsample that used self-reported survey data to help determine highest risk based on additional information collected from high-risk TSMs once they are contacted. The outcome in both models was homelessness within 12 months after leaving active service. RESULTS: Twelve-month prevalence of post-transition homelessness was 5.0% (SE=0.5). The Stage-1 model identified 30% of high-risk TSMs who accounted for 52% of homelessness. The Stage-2 model identified 10% of all TSMs (i.e., 33% of high-risk TSMs) who accounted for 35% of all homelessness (i.e., 63% of the homeless among high-risk TSMs). CONCLUSIONS: Machine learning can help target outreach and assessment of TSMs for homeless prevention interventions.

Toward personalized care for insomnia in the US Army: a machine learning model to predict response to cognitive behavioral therapy for insomnia.

STUDY OBJECTIVES: The standard of care for military personnel with insomnia is cognitive behavioral therapy for insomnia (CBT-I). However, only a minority seeking insomnia treatment receive CBT-I, and little reliable guidance exists to identify those most likely to respond. As a step toward personalized care, we present results of a machine learning (ML) model to predict CBT-I response. METHODS: Administrative data were examined for n=1,449 nondeployed US Army soldiers treated for insomnia with CBT-I who had moderate-severe baseline Insomnia Severity Index (ISI) scores and completed one or more follow-up ISIs 6-12 weeks after baseline. An ensemble ML model was developed in a 70% training sample to predict clinically significant ISI improvement (reduction of at least two standard deviations on the baseline ISI distribution). Predictors included a wide range of military administrative and baseline clinical variables. Model accuracy was evaluated in the remaining 30% test sample. RESULTS: 19.8% of patients had clinically significant ISI improvement. Model AU-ROC (SE) was 0.60 (0.03). The 20% of test sample patients with highest probabilities of improvement were twice as likely to have clinically significant improvement as the remaining 80% (36.5% versus 15.7%; χ21=9.2, p=.002). Nearly 85% of prediction accuracy was due to ten variables, the most important of which were baseline insomnia severity and baseline suicidal ideation. CONCLUSIONS: Pending replication, the model could be used as part of a patient-centered decision-making process for insomnia treatment. Parallel models will be needed for alternative treatments before such a system is of optimal value.

Estimated Average Treatment Effect of Psychiatric Hospitalization in Patients With Suicidal Behaviors: A Precision Treatment Analysis.

Importance: Psychiatric hospitalization is the standard of care for patients presenting to an emergency department (ED) or urgent care (UC) with high suicide risk. However, the effect of hospitalization in reducing subsequent suicidal behaviors is poorly understood and likely heterogeneous. Objectives: To estimate the association of psychiatric hospitalization with subsequent suicidal behaviors using observational data and develop a preliminary predictive analytics individualized treatment rule accounting for heterogeneity in this association across patients. Design, Setting, and Participants: A machine learning analysis of retrospective data was conducted. All veterans presenting with suicidal ideation (SI) or suicide attempt (SA) from January 1, 2010, to December 31, 2015, were included. Data were analyzed from September 1, 2022, to March 10, 2023. Subgroups were defined by primary psychiatric diagnosis (nonaffective psychosis, bipolar disorder, major depressive disorder, and other) and suicidality (SI only, SA in past 2-7 days, and SA in past day). Models were trained in 70.0% of the training samples and tested in the remaining 30.0%. Exposures: Psychiatric hospitalization vs nonhospitalization. Main Outcomes and Measures: Fatal and nonfatal SAs within 12 months of ED/UC visits were identified in administrative records and the National Death Index. Baseline covariates were drawn from electronic health records and geospatial databases. Results: Of 196 610 visits (90.3% men; median [IQR] age, 53 [41-59] years), 71.5% resulted in hospitalization. The 12-month SA risk was 11.9% with hospitalization and 12.0% with nonhospitalization (difference, -0.1%; 95% CI, -0.4% to 0.2%). In patients with SI only or SA in the past 2 to 7 days, most hospitalization was not associated with subsequent SAs. For patients with SA in the past day, hospitalization was associated with risk reductions ranging from -6.9% to -9.6% across diagnoses. Accounting for heterogeneity, hospitalization was associated with reduced risk of subsequent SAs in 28.1% of the patients and increased risk in 24.0%. An individualized treatment rule based on these associations may reduce SAs by 16.0% and hospitalizations by 13.0% compared with current rates. Conclusions and Relevance: The findings of this study suggest that psychiatric hospitalization is associated with reduced average SA risk in the immediate aftermath of an SA but not after other recent SAs or SI only. Substantial heterogeneity exists in these associations across patients. An individualized treatment rule accounting for this heterogeneity could both reduce SAs and avert hospitalizations.

Analyzing Surgical Technique in Diverse Open Surgical Videos With Multitask Machine Learning.

Objective: To overcome limitations of open surgery artificial intelligence (AI) models by curating the largest collection of annotated videos and to leverage this AI-ready data set to develop a generalizable multitask AI model capable of real-time understanding of clinically significant surgical behaviors in prospectively collected real-world surgical videos. Design, Setting, and Participants: The study team programmatically queried open surgery procedures on YouTube and manually annotated selected videos to create the AI-ready data set used to train a multitask AI model for 2 proof-of-concept studies, one generating surgical signatures that define the patterns of a given procedure and the other identifying kinematics of hand motion that correlate with surgeon skill level and experience. The Annotated Videos of Open Surgery (AVOS) data set includes 1997 videos from 23 open-surgical procedure types uploaded to YouTube from 50 countries over the last 15 years. Prospectively recorded surgical videos were collected from a single tertiary care academic medical center. Deidentified videos were recorded of surgeons performing open surgical procedures and analyzed for correlation with surgical training. Exposures: The multitask AI model was trained on the AI-ready video data set and then retrospectively applied to the prospectively collected video data set. Main Outcomes and Measures: Analysis of open surgical videos in near real-time, performance on AI-ready and prospectively collected videos, and quantification of surgeon skill. Results: Using the AI-ready data set, the study team developed a multitask AI model capable of real-time understanding of surgical behaviors-the building blocks of procedural flow and surgeon skill-across space and time. Through principal component analysis, a single compound skill feature was identified, composed of a linear combination of kinematic hand attributes. This feature was a significant discriminator between experienced surgeons and surgical trainees across 101 prospectively collected surgical videos of 14 operators. For each unit increase in the compound feature value, the odds of the operator being an experienced surgeon were 3.6 times higher (95% CI, 1.67-7.62; P = .001). Conclusions and Relevance: In this observational study, the AVOS-trained model was applied to analyze prospectively collected open surgical videos and identify kinematic descriptors of surgical skill related to efficiency of hand motion. The ability to provide AI-deduced insights into surgical structure and skill is valuable in optimizing surgical skill acquisition and ultimately improving surgical care.

The stories about racism and health: the development of a framework for racism narratives in medical literature using a computational grounded theory approach.

INTRODUCTION: The scientific study of racism as a root cause of health inequities has been hampered by the policies and practices of medical journals. Monitoring the discourse around racism and health inequities (i.e., racism narratives) in scientific publications is a critical aspect of understanding, confronting, and ultimately dismantling racism in medicine. A conceptual framework and multi-level construct is needed to evaluate the changes in the prevalence and composition of racism over time and across journals. OBJECTIVE: To develop a framework for classifying racism narratives in scientific medical journals. METHODS: We constructed an initial set of racism narratives based on an exploratory literature search. Using a computational grounded theory approach, we analyzed a targeted sample of 31 articles in four top medical journals which mentioned the word 'racism'. We compiled and evaluated 80 excerpts of text that illustrate racism narratives. Two coders grouped and ordered the excerpts, iteratively revising and refining racism narratives. RESULTS: We developed a qualitative framework of racism narratives, ordered on an anti-racism spectrum from impeding anti-racism to strong anti-racism, consisting of 4 broad categories and 12 granular modalities for classifying racism narratives. The broad narratives were "dismissal," "person-level," "societal," and "actionable." Granular modalities further specified how race-related health differences were related to racism (e.g., natural, aberrant, or structurally modifiable). We curated a "reference set" of example sentences to empirically ground each label. CONCLUSION: We demonstrated racism narratives of dismissal, person-level, societal, and actionable explanations within influential medical articles. Our framework can help clinicians, researchers, and educators gain insight into which narratives have been used to describe the causes of racial and ethnic health inequities, and to evaluate medical literature more critically. This work is a first step towards monitoring racism narratives over time, which can more clearly expose the limits of how the medical community has come to understand the root causes of health inequities. This is a fundamental aspect of medicine's long-term trajectory towards racial justice and health equity.

Scalable surveillance of e-cigarette products on Instagram and TikTok using computer vision.

INTRODUCTION: Instagram and TikTok, video-based social media platforms popular among adolescents, contain tobacco-related content despite the platforms' policies prohibiting substance-related posts. Prior research identified themes in e-cigarette-related social media posts using qualitative or text-based machine learning methods. We developed an image-based computer vision model to identify e-cigarette products in social media images and videos. METHODS: We created a dataset of 6,999 Instagram images labeled for 8 object classes: mod or pod devices, e-juice containers, packaging boxes, nicotine warning labels, e-juice flavors, e-cigarette brand names, and smoke clouds. We trained a DyHead object detection model using a Swin-Large backbone, evaluated the model's performance on 20 Instagram and TikTok videos, and applied the model to 14,072 e-cigarette-related promotional TikTok videos (2019-2022; 10,276,485 frames). RESULTS: The model achieved the following mean average precision scores on the image test set: e-juice container: 0.89; pod device: 0.67; mod device: 0.54; packaging box: 0.84; nicotine warning label: 0.86; e-cigarette brand name: 0.71; e-juice flavor name: 0.89; and smoke cloud: 0.46. The largest number of TikTok videos - 9,091 (65%) - contained smoke clouds, followed by mod and pod devices detected in 6,667 (47%) and 5,949 (42%) videos respectively. Prevalence of nicotine warning labels was the lowest, detected in 980 videos (7%). CONCLUSIONS: Deep learning-based object detection technology enables automated analysis of visual posts on social media. Our computer vision model can detect the presence of e-cigarettes products in images and videos, providing valuable surveillance data for tobacco regulatory science. IMPLICATIONS: Prior research identified themes in e-cigarette-related social media posts using qualitative or text-based machine learning methods. We developed an image-based computer vision model to identify e-cigarette products in social media images and videos.We trained a DyHead object detection model using a Swin-Large backbone, evaluated the model's performance on 20 Instagram and TikTok videos featuring at least two e-cigarette objects, and applied the model to 14,072 e-cigarette-related promotional TikTok videos (2019-2022; 10,276,485 frames).The deep learning model can be used for automated, scalable surveillance of image- and video-based e-cigarette-related promotional content on social media, providing valuable data for tobacco regulatory science. Social media platforms could use computer vision to identify tobacco-related imagery and remove it promptly, which could reduce adolescents' exposure to tobacco content online.

Internet-delivered cognitive behavior therapy versus treatment as usual for anxiety and depression among Latin American university students: A randomized clinical trial.

OBJECTIVE: Untreated mental disorders are important among low- and middle-income country (LMIC) university students in Latin America, where barriers to treatment are high. Scalable interventions are needed. This study compared transdiagnostic self-guided and guided internet-delivered cognitive behavioral therapy (i-CBT) with treatment as usual (TAU) for clinically significant anxiety and depression among undergraduates in Colombia and Mexico. METHOD: 1,319 anxious, as determined by the Generalized Anxiety Disorder-7 (GAD-7) = 10+ and/or depressed, as determined by the Patient Health Questionnaire-9 (PHQ-9) = 10+, undergraduates (mean [SD] age = 21.4 [3.2]); 78.7% female; 55.9% first-generation university student) from seven universities in Colombia and Mexico were randomized to culturally adapted versions of self-guided i-CBT (n = 439), guided i-CBT (n = 445), or treatment as usual (TAU; n = 435). All randomized participants were reassessed 3 months after randomization. The primary outcome was remission of both anxiety (GAD-7 = 0-4) and depression (PHQ-9 = 0-4). We hypothesized that remission would be higher with guided i-CBT than with the other interventions. RESULTS: Intent-to-treat analysis found significantly higher adjusted (for university and loss to follow-up) remission rates (ARD) among participants randomized to guided i-CBT than either self-guided i-CBT (ARD = 13.1%, χ12 = 10.4, p = .001) or TAU (ARD = 11.2%, χ12 = 8.4, p = .004), but no significant difference between self-guided i-CBT and TAU (ARD = -1.9%, χ12 = 0.2, p = .63). Per-protocol sensitivity analyses and analyses of dimensional outcomes yielded similar results. CONCLUSIONS: Significant reductions in anxiety and depression among LMIC university students could be achieved with guided i-CBT, although further research is needed to determine which students would most likely benefit from this intervention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

A practical risk calculator for suicidal behavior among transitioning U.S. Army soldiers: results from the Study to Assess Risk and Resilience in Servicemembers-Longitudinal Study (STARRS-LS).

BACKGROUND: Risk of suicide-related behaviors is elevated among military personnel transitioning to civilian life. An earlier report showed that high-risk U.S. Army soldiers could be identified shortly before this transition with a machine learning model that included predictors from administrative systems, self-report surveys, and geospatial data. Based on this result, a Veterans Affairs and Army initiative was launched to evaluate a suicide-prevention intervention for high-risk transitioning soldiers. To make targeting practical, though, a streamlined model and risk calculator were needed that used only a short series of self-report survey questions. METHODS: We revised the original model in a sample of n = 8335 observations from the Study to Assess Risk and Resilience in Servicemembers-Longitudinal Study (STARRS-LS) who participated in one of three Army STARRS 2011-2014 baseline surveys while in service and in one or more subsequent panel surveys (LS1: 2016-2018, LS2: 2018-2019) after leaving service. We trained ensemble machine learning models with constrained numbers of item-level survey predictors in a 70% training sample. The outcome was self-reported post-transition suicide attempts (SA). The models were validated in the 30% test sample. RESULTS: Twelve-month post-transition SA prevalence was 1.0% (s.e. = 0.1). The best constrained model, with only 17 predictors, had a test sample ROC-AUC of 0.85 (s.e. = 0.03). The 10-30% of respondents with the highest predicted risk included 44.9-92.5% of 12-month SAs. CONCLUSIONS: An accurate SA risk calculator based on a short self-report survey can target transitioning soldiers shortly before leaving service for intervention to prevent post-transition SA.

Negativity and Positivity in the ICU: Exploratory Development of Automated Sentiment Capture in the Electronic Health Record.

OBJECTIVES: To develop proof-of-concept algorithms using alternative approaches to capture provider sentiment in ICU notes. DESIGN: Retrospective observational cohort study. SETTING: The Multiparameter Intelligent Monitoring of Intensive Care III (MIMIC-III) and the University of California, San Francisco (UCSF) deidentified notes databases. PATIENTS: Adult (≥18 yr old) patients admitted to the ICU. MEASUREMENTS AND MAIN RESULTS: We developed two sentiment models: 1) a keywords-based approach using a consensus-based clinical sentiment lexicon comprised of 72 positive and 103 negative phrases, including negations and 2) a Decoding-enhanced Bidirectional Encoder Representations from Transformers with disentangled attention-v3-based deep learning model (keywords-independent) trained on clinical sentiment labels. We applied the models to 198,944 notes across 52,997 ICU admissions in the MIMIC-III database. Analyses were replicated on an external sample of patients admitted to a UCSF ICU from 2018 to 2019. We also labeled sentiment in 1,493 note fragments and compared the predictive accuracy of our tools to three popular sentiment classifiers. Clinical sentiment terms were found in 99% of patient visits across 88% of notes. Our two sentiment tools were substantially more predictive (Spearman correlations of 0.62-0.84, p values < 0.00001) of labeled sentiment compared with general language algorithms (0.28-0.46). CONCLUSION: Our exploratory healthcare-specific sentiment models can more accurately detect positivity and negativity in clinical notes compared with general sentiment tools not designed for clinical usage.

Comparing Rationale for Opioid Prescribing Decisions after Surgery with Subsequent Patient Consumption: A Survey of the Highest Quartile of Prescribers.

BACKGROUND: Opioid prescribing patterns, including those after surgery, have been implicated as a significant contributor to the US opioid crisis. A plethora of interventions-from nudges to reminders-have been deployed to improve prescribing behavior, but reasons for persistent outlier behavior are often unknown. STUDY DESIGN: Our institution employs multiple prescribing resources and a near real-time, feedback-based intervention to promote appropriate opioid prescribing. Since 2019, an automated system has emailed providers when a prescription exceeds the 75th percentile of typical opioid consumption for a given procedure-as defined by institutional data collection. Emails include population consumption metrics and an optional survey on rationale for prescribing. Responses were analyzed to understand why providers choose to prescribe atypically large discharge opioid prescriptions. We then compared provider prescriptions against patient consumption. RESULTS: During the study period, 10,672 eligible postsurgical patients were discharged; 2,013 prescriptions (29.4% of opioid prescriptions) exceeded our institutional guideline. Surveys were completed by outlier prescribers for 414 (20.6%) encounters. Among patients where both consumption data and prescribing rationale surveys were available, 35.2% did not consume any opioids after discharge and 21.5% consumed <50% of their prescription. Only 93 (39.9%) patients receiving outlier prescriptions were outlier consumers. Most common reasons for prescribing outlier amounts were attending preference (34%) and prescriber analysis of patient characteristics (34%). CONCLUSIONS: The top quartile of opioid prescriptions did not align with, and often far exceeded, patient postdischarge opioid consumption. Providers cite assessment of patient characteristics as a common driver of decision-making, but this did not align with patient usage for approximately 50% of patients.

Development of a model to predict antidepressant treatment response for depression among Veterans.

BACKGROUND: Only a limited number of patients with major depressive disorder (MDD) respond to a first course of antidepressant medication (ADM). We investigated the feasibility of creating a baseline model to determine which of these would be among patients beginning ADM treatment in the US Veterans Health Administration (VHA). METHODS: A 2018-2020 national sample of n = 660 VHA patients receiving ADM treatment for MDD completed an extensive baseline self-report assessment near the beginning of treatment and a 3-month self-report follow-up assessment. Using baseline self-report data along with administrative and geospatial data, an ensemble machine learning method was used to develop a model for 3-month treatment response defined by the Quick Inventory of Depression Symptomatology Self-Report and a modified Sheehan Disability Scale. The model was developed in a 70% training sample and tested in the remaining 30% test sample. RESULTS: In total, 35.7% of patients responded to treatment. The prediction model had an area under the ROC curve (s.e.) of 0.66 (0.04) in the test sample. A strong gradient in probability (s.e.) of treatment response was found across three subsamples of the test sample using training sample thresholds for high [45.6% (5.5)], intermediate [34.5% (7.6)], and low [11.1% (4.9)] probabilities of response. Baseline symptom severity, comorbidity, treatment characteristics (expectations, history, and aspects of current treatment), and protective/resilience factors were the most important predictors. CONCLUSIONS: Although these results are promising, parallel models to predict response to alternative treatments based on data collected before initiating treatment would be needed for such models to help guide treatment selection.

A Precision Treatment Model for Internet-Delivered Cognitive Behavioral Therapy for Anxiety and Depression Among University Students: A Secondary Analysis of a Randomized Clinical Trial.

Importance: Guided internet-delivered cognitive behavioral therapy (i-CBT) is a low-cost way to address high unmet need for anxiety and depression treatment. Scalability could be increased if some patients were helped as much by self-guided i-CBT as guided i-CBT. Objective: To develop an individualized treatment rule using machine learning methods for guided i-CBT vs self-guided i-CBT based on a rich set of baseline predictors. Design, Setting, and Participants: This prespecified secondary analysis of an assessor-blinded, multisite randomized clinical trial of guided i-CBT, self-guided i-CBT, and treatment as usual included students in Colombia and Mexico who were seeking treatment for anxiety (defined as a 7-item Generalized Anxiety Disorder [GAD-7] score of ≥10) and/or depression (defined as a 9-item Patient Health Questionnaire [PHQ-9] score of ≥10). Study recruitment was from March 1 to October 26, 2021. Initial data analysis was conducted from May 23 to October 26, 2022. Interventions: Participants were randomized to a culturally adapted transdiagnostic i-CBT that was guided (n = 445), self-guided (n = 439), or treatment as usual (n = 435). Main Outcomes and Measures: Remission of anxiety (GAD-7 scores of ≤4) and depression (PHQ-9 scores of ≤4) 3 months after baseline. Results: The study included 1319 participants (mean [SD] age, 21.4 [3.2] years; 1038 women [78.7%]; 725 participants [55.0%] came from Mexico). A total of 1210 participants (91.7%) had significantly higher mean (SE) probabilities of joint remission of anxiety and depression with guided i-CBT (51.8% [3.0%]) than with self-guided i-CBT (37.8% [3.0%]; P = .003) or treatment as usual (40.0% [2.7%]; P = .001). The remaining 109 participants (8.3%) had low mean (SE) probabilities of joint remission of anxiety and depression across all groups (guided i-CBT: 24.5% [9.1%]; P = .007; self-guided i-CBT: 25.4% [8.8%]; P = .004; treatment as usual: 31.0% [9.4%]; P = .001). All participants with baseline anxiety had nonsignificantly higher mean (SE) probabilities of anxiety remission with guided i-CBT (62.7% [5.9%]) than the other 2 groups (self-guided i-CBT: 50.2% [6.2%]; P = .14; treatment as usual: 53.0% [6.0%]; P = .25). A total of 841 of 1177 participants (71.5%) with baseline depression had significantly higher mean (SE) probabilities of depression remission with guided i-CBT (61.5% [3.6%]) than the other 2 groups (self-guided i-CBT: 44.3% [3.7%]; P = .001; treatment as usual: 41.8% [3.2%]; P < .001). The other 336 participants (28.5%) with baseline depression had nonsignificantly higher mean (SE) probabilities of depression remission with self-guided i-CBT (54.4% [6.0%]) than guided i-CBT (39.8% [5.4%]; P = .07). Conclusions and Relevance: Guided i-CBT yielded the highest probabilities of remission of anxiety and depression for most participants; however, these differences were nonsignificant for anxiety. Some participants had the highest probabilities of remission of depression with self-guided i-CBT. Information about this variation could be used to optimize allocation of guided and self-guided i-CBT in resource-constrained settings. Trial Registration: ClinicalTrials.gov Identifier: NCT04780542.

Toward personalized care for insomnia in the US Army: development of a machine-learning model to predict response to pharmacotherapy.

STUDY OBJECTIVES: Although many military personnel with insomnia are treated with prescription medication, little reliable guidance exists to identify patients most likely to respond. As a first step toward personalized care for insomnia, we present results of a machine-learning model to predict response to insomnia medication. METHODS: The sample comprised n = 4,738 nondeployed US Army soldiers treated with insomnia medication and followed 6-12 weeks after initiating treatment. All patients had moderate-severe baseline scores on the Insomnia Severity Index (ISI) and completed 1 or more follow-up ISIs 6-12 weeks after baseline. An ensemble machine-learning model was developed in a 70% training sample to predict clinically significant ISI improvement, defined as reduction of at least 2 standard deviations on the baseline ISI distribution. Predictors included a wide range of military administrative and baseline clinical variables. Model accuracy was evaluated in the remaining 30% test sample. RESULTS: 21.3% of patients had clinically significant ISI improvement. Model test sample area under the receiver operating characteristic curve (standard error) was 0.63 (0.02). Among the 30% of patients with the highest predicted probabilities of improvement, 32.5.% had clinically significant symptom improvement vs 16.6% in the 70% sample predicted to be least likely to improve (χ21 = 37.1, P < .001). More than 75% of prediction accuracy was due to 10 variables, the most important of which was baseline insomnia severity. CONCLUSIONS: Pending replication, the model could be used as part of a patient-centered decision-making process for insomnia treatment, but parallel models will be needed for alternative treatments before such a system is of optimal value. CITATION: Gabbay FH, Wynn GH, Georg MW, et al. Toward personalized care for insomnia in the US Army: development of a machine-learning model to predict response to pharmacotherapy. J Clin Sleep Med. 2023;19(8):1399-1410.

Solidarity and strife after the Atlanta spa shootings: A mixed methods study characterizing Twitter discussions by qualitative analysis and machine learning.

Background: On March 16, 2021, a white man shot and killed eight victims, six of whom were Asian women at Atlanta-area spa and massage parlors. The aims of the study were to: (1) qualitatively summarize themes of tweets related to race, ethnicity, and racism immediately following the Atlanta spa shootings, and (2) examine temporal trends in expressions hate speech and solidarity before and after the Atlanta spa shootings using a new methodology for hate speech analysis. Methods: A random 1% sample of publicly available tweets was collected from January to April 2021. The analytic sample included 708,933 tweets using race-related keywords. This sample was analyzed for hate speech using a newly developed method for combining faceted item response theory with deep learning to measure a continuum of hate speech, from solidarity race-related speech to use of violent, racist language. A qualitative content analysis was conducted on random samples of 1,000 tweets referencing Asians before the Atlanta spa shootings from January to March 15, 2021 and 2,000 tweets referencing Asians after the shooting from March 17 to 28 to capture the immediate reactions and discussions following the shootings. Results: Qualitative themes that emerged included solidarity (4% before the shootings vs. 17% after), condemnation of the shootings (9% after), racism (10% before vs. 18% after), role of racist language during the pandemic (2 vs. 6%), intersectional vulnerabilities (4 vs. 6%), relationship between Asian and Black struggles against racism (5 vs. 7%), and discussions not related (74 vs. 37%). The quantitative hate speech model showed a decrease in the proportion of tweets referencing Asians that expressed racism (from 1.4% 7 days prior to the event from to 1.0% in the 3 days after). The percent of tweets referencing Asians that expressed solidarity speech increased by 20% (from 22.7 to 27.2% during the same time period) (p < 0.001) and returned to its earlier rate within about 2 weeks. Discussion: Our analysis highlights some complexities of discrimination and the importance of nuanced evaluation of online speech. Findings suggest the importance of tracking hate and solidarity speech. By understanding the conversations emerging from social media, we may learn about possible ways to produce solidarity promoting messages and dampen hate messages.