Use of ICD-10-CM Codes for Adverse Social Determinants of Health Across Health Systems.

OBJECTIVE: This study investigated ICD-10-CM codes for adverse social determinants of health (SDoH) across 12 U.S. health systems by using data from multiple health care encounter types for diverse patients covered by multiple payers. METHODS: The authors described documentation of 11 SDoH ICD-10-CM code categories (e.g., educational problems or social environmental problems) between 2016 and 2021; assessed changes over time by using chi-square tests for trend in proportions; compared documentation in 2021 by gender, age, race-ethnicity, and site with chi-square tests; and compared all patients' mental health outcomes in 2021 with those of patients with documented SDoH ICD-10-CM codes by using exact binomial tests and one-proportion z tests. RESULTS: Documentation of any SDoH ICD-10-CM code significantly increased, from 1.7% of patients in 2016 to 2.7% in 2021, as did that for all SDoH categories except educational problems. Documentation was often more prevalent among female patients and those of other or unknown gender than among male patients and among American Indian or Alaska Native, Black or African American, and Hispanic individuals than among those belonging to other race-ethnicity categories. More educational problems were documented for younger patients, and more social environmental problems were documented for older patients. Psychiatric diagnoses and emergency department visits and hospitalizations related to mental health were more common among patients with documented SDoH codes. CONCLUSIONS: SDoH ICD-10-CM code documentation was infrequent and differed by population subgroup. Differences may reflect documentation practices or true SDoH prevalence variation. Standardized SDoH documentation methods are needed in health care settings.

Influenza and COVID-19 Vaccine Uptake Among Individuals With Versus Without Diagnosed Psychiatric Disorders.

OBJECTIVE: The authors sought to examine influenza and COVID-19 vaccine uptake among individuals diagnosed as having psychiatric disorders compared with those without such diagnoses and to examine variations in vaccine uptake by sociodemographic and clinical characteristics. METHODS: The study was conducted in the Kaiser Permanente Georgia, Washington, and Southern California health care systems. Individuals with psychiatric conditions had at least one diagnosis of any psychiatric disorder during a 12-month study period; individuals in the control group had no psychiatric disorder diagnoses during this period, and the two groups were matched on age and sex. Bivariate analyses were conducted with Pearson chi-square tests; multivariate analyses were used to calculate the odds of receiving an influenza vaccine (N=1,307,202 individuals) or COVID-19 vaccine (N=1,380,894 individuals) and were controlled for selected covariates. RESULTS: After controlling for relevant confounders, the authors found that having a diagnosis of any psychiatric illness was associated with significantly increased odds of receiving an influenza vaccine (OR=1.18; 95% CI=1.17-1.19, p<0.001), compared with no diagnosis of a psychiatric disorder. Having any psychiatric illness was associated with decreased odds of receiving a COVID-19 vaccine (OR=0.97; 95% CI=0.96-0.98, p<0.001), after the analysis was controlled for the same covariates. CONCLUSIONS: The findings provide evidence that people with mental health conditions were more likely to receive an influenza vaccine but were less likely to receive a COVID-19 vaccine, compared with individuals without such conditions. However, the vaccination rates observed for individuals with and without diagnosed psychiatric conditions were below national benchmarks, suggesting room for improving vaccine uptake in both patient populations.

Psychotherapy Engagement Before and After a Rapid Transition to Telehealth During COVID-19 for Older Adults With Dementia.

Objective: To understand the impact of the transition to telehealth during COVID-19 on psychotherapy visits for patients with dementia. Method: Retrospective study of older adults with dementia who had at least one psychotherapy visit in the 9 months before and after the onset of COVID-19 at 3 U.S. health systems. Care disruptions were gaps of 45+ days. Descriptive statistics and logistic mixed-effects models examined factors associated with care disruption. Results: 4953 patients with dementia made 19,902 psychotherapy visits. Gaps in psychotherapy were less frequent during COVID-19 (29.4%) than before (48.9%), with the odds of a patient experiencing a care disruption during COVID-19 0.54 times the odds prior to COVID-19 (95% CI: 0.50-0.59). Almost all patient subgroups had lower adjusted odds of care disruption during COVID-19. Discussion: There were fewer disruptions in psychotherapy care following the rapid shift to virtual care. Telehealth may be a viable option for patients with dementia.

Development and Validation of Electronic Health Record Measures of Safety Planning Practices as Part of Zero Suicide Implementation.

OBJECTIVE: Safety planning for suicide prevention is an important quality metric for Zero Suicide implementation. We describe the development, validation, and application of electronic health record (EHR) programs to measure uptake of safety planning practices across six integrated healthcare systems as part of a Zero Suicide evaluation study. METHODS: Safety planning was documented in narrative notes and structured EHR templates using the Stanley Brown Safety Planning Intervention (SBSPI) in response to a high-risk cutoff score on the Columbia Suicide Severity Rating Scale (CSSRS). Natural Language Processing (NLP) metrics were developed and validated using chart review to characterize practices documented in narrative notes. We applied NLP to measure frequency of documentation in the narrative text and standard programming methods to examine structured SBSPI templates from 2010-2022. RESULTS: Chart reviews found three safety planning practices documented in narrative notes that were delivered to at least half of patients at risk: professional contacts, lethal means counseling for firearms, and lethal means counseling for medication access/storage. NLP methods were developed to identify these practices in clinical text with high levels of accuracy (Sensitivity, Specificity, & PPV ≥ 82%). Among visits with a high-risk CSSRS, 40% (Range 2-73% by health system) had an SBSPI template within 1 year of implementation. CONCLUSIONS: This is one of the first reports describing development of measures that leverage electronic health records to track use of suicide prevention safety plans. There are opportunities to use the methods developed here in future evaluations of safety planning.

Measuring safety planning delivery in real-world systems to understand quality of suicide prevention care is challenging.Natural Language Processing (NLP) methods effectively identified some safety planning practices in electronic health records (EHR) from all notes ensuring a comprehensive measurement, but NLP will require updates/testing for local documentation practices.Structured safety planning templates in the EHR using the Stanley Brown Safety Planning Intervention improve ease and accuracy of measurement but may be less comprehensive than NLP for capturing all instances of safety planning documentation.

Management of Depression in Adults: A Review.

Importance: Approximately 9% of US adults experience major depression each year, with a lifetime prevalence of approximately 17% for men and 30% for women. Observations: Major depression is defined by depressed mood, loss of interest in activities, and associated psychological and somatic symptoms lasting at least 2 weeks. Evaluation should include structured assessment of severity as well as risk of self-harm, suspected bipolar disorder, psychotic symptoms, substance use, and co-occurring anxiety disorder. First-line treatments include specific psychotherapies and antidepressant medications. A network meta-analysis of randomized clinical trials reported cognitive therapy, behavioral activation, problem-solving therapy, interpersonal therapy, brief psychodynamic therapy, and mindfulness-based psychotherapy all had at least medium-sized effects in symptom improvement over usual care without psychotherapy (standardized mean difference [SMD] ranging from 0.50 [95% CI, 0.20-0.81] to 0.73 [95% CI, 0.52-0.95]). A network meta-analysis of randomized clinical trials reported 21 antidepressant medications all had small- to medium-sized effects in symptom improvement over placebo (SMD ranging from 0.23 [95% CI, 0.19-0.28] for fluoxetine to 0.48 [95% CI, 0.41-0.55] for amitriptyline). Psychotherapy combined with antidepressant medication may be preferred, especially for more severe or chronic depression. A network meta-analysis of randomized clinical trials reported greater symptom improvement with combined treatment than with psychotherapy alone (SMD, 0.30 [95% CI, 0.14-0.45]) or medication alone (SMD, 0.33 [95% CI, 0.20-0.47]). When initial antidepressant medication is not effective, second-line medication treatment includes changing antidepressant medication, adding a second antidepressant, or augmenting with a nonantidepressant medication, which have approximately equal likelihood of success based on a network meta-analysis. Collaborative care programs, including systematic follow-up and outcome assessment, improve treatment effectiveness, with 1 meta-analysis reporting significantly greater symptom improvement compared with usual care (SMD, 0.42 [95% CI, 0.23-0.61]). Conclusions and Relevance: Effective first-line depression treatments include specific forms of psychotherapy and more than 20 antidepressant medications. Close monitoring significantly improves the likelihood of treatment success.

Variation in completeness of coding external cause of injuries under ICD-10-CM.

INTRODUCTION: Information about causes of injury is key for injury prevention efforts. Historically, cause-of-injury coding in clinical practice has been incomplete due to the need for extra diagnosis codes in the International Classification of Diseases-Ninth Revision-Clinical Modification (ICD-9-CM) coding. The transition to ICD-10-CM and increased use of clinical support software for diagnosis coding is expected to improve completeness of cause-of-injury coding. This paper assesses the recording of external cause-of-injury codes specifically for those diagnoses where an additional code is still required. METHODS: We used electronic health record and claims data from 10 health systems from October 2015 to December 2021 to identify all inpatient and emergency encounters with a primary diagnosis of injury. The proportion of encounters that also included a valid external cause-of-injury code is presented. RESULTS: Most health systems had high rates of cause-of-injury coding: over 85% in emergency departments and over 75% in inpatient encounters with primary injury diagnoses. However, several sites had lower rates in both settings. State mandates were associated with consistently high external cause recording. CONCLUSIONS: Completeness of cause-of-injury coding improved since the adoption of ICD-10-CM coding and increased slightly over the study period at most sites. However, significant variation remained, and completeness of cause-of-injury coding in any diagnosis data used for injury prevention planning should be empirically determined.

Clozapine Use Among People With Psychotic Disorders Who Experience Specific Indications for Clozapine.

Objective: To examine rates of clozapine use among people with psychotic disorders who experience specific indications for clozapine.Methods: Records data from 11 integrated health systems identified patients aged 18 years or older with recorded International Classification of Diseases, Tenth Revision, Clinical Modification, diagnoses of schizophrenia, schizoaffective disorder, or other psychotic disorder who experienced any of the 3 events between January 1, 2019, and December 31, 2019, suggesting indications for clozapine: a diagnosis of self-harm injury or poisoning, suicidal ideation diagnosed or in response to standardized assessments, and hospitalization or emergency department (ED) care for psychotic disorder despite treatment with 2 or more antipsychotic medications. Prescription dispensing data identified all clozapine use prior to or in the 12 months following each indication event. Analyses were conducted with aggregate data from each health system; no individual data were shared.Results: A total of 7,648 patients with psychotic disorder diagnoses experienced at least 1 indication event. Among 1,097 experiencing a self-harm event, 32 (2.9%) had any prior clozapine use, and 10 (0.9%) initiated clozapine during the following 12 months. Among 6,396 with significant suicidal ideation, 238 (3.7%) had any prior clozapine use, and 70 (1.1%) initiated clozapine over 12 months. Among 881 with hospitalization or ED visit despite pharmacotherapy, 77 (8.7%) had any prior clozapine treatment, and 41 (4.7%) initiated clozapine over 12 months. Among those with significant suicidal ideation, rates of both prior clozapine treatment and subsequent initiation varied significantly by race and ethnicity, with rates among Hispanic and non-Hispanic Black patients lower than among non Hispanic White patients.Conclusions: Initiating clozapine treatment is uncommon among people with psychotic disorders who experience events suggesting clozapine is indicated, with even lower rates among Black and Hispanic patients.

Evaluation of GPT-4 ability to identify and generate patient instructions for actionable incidental radiology findings.

OBJECTIVES: To evaluate the proficiency of a HIPAA-compliant version of GPT-4 in identifying actionable, incidental findings from unstructured radiology reports of Emergency Department patients. To assess appropriateness of artificial intelligence (AI)-generated, patient-facing summaries of these findings. MATERIALS AND METHODS: Radiology reports extracted from the electronic health record of a large academic medical center were manually reviewed to identify non-emergent, incidental findings with high likelihood of requiring follow-up, further sub-stratified as "definitely actionable" (DA) or "possibly actionable-clinical correlation" (PA-CC). Instruction prompts to GPT-4 were developed and iteratively optimized using a validation set of 50 reports. The optimized prompt was then applied to a test set of 430 unseen reports. GPT-4 performance was primarily graded on accuracy identifying either DA or PA-CC findings, then secondarily for DA findings alone. Outputs were reviewed for hallucinations. AI-generated patient-facing summaries were assessed for appropriateness via Likert scale. RESULTS: For the primary outcome (DA or PA-CC), GPT-4 achieved 99.3% recall, 73.6% precision, and 84.5% F-1. For the secondary outcome (DA only), GPT-4 demonstrated 95.2% recall, 77.3% precision, and 85.3% F-1. No findings were "hallucinated" outright. However, 2.8% of cases included generated text about recommendations that were inferred without specific reference. The majority of True Positive AI-generated summaries required no or minor revision. CONCLUSION: GPT-4 demonstrates proficiency in detecting actionable, incidental findings after refined instruction prompting. AI-generated patient instructions were most often appropriate, but rarely included inferred recommendations. While this technology shows promise to augment diagnostics, active clinician oversight via "human-in-the-loop" workflows remains critical for clinical implementation.

Patient perspectives for improving treatment initiation for new episodes of depression in historically minoritized racial and ethnic groups.

OBJECTIVE: Depression is one of the costliest and most prevalent health conditions in the U.S. with 21 million adults having experienced at least one major depressive episode. Despite the availability of evidence-based treatments for depression, a large proportion of people with new diagnoses fail to initiate formal mental health treatment. Although individuals across all racial and ethnic groups fail to initiate treatment for depression, historically minoritized racial/ethnic groups are at even greater risk. METHOD: Thirty-four participants representing historically underserved racial and ethnic populations from two large health care systems in the U.S. participated in qualitative interviews or focus group to identify factors that impede and facilitate depression treatment initiation in primary care settings. RESULTS: Participants identified individual and systemic barriers and facilitators of treatment initiation for depression and suggested several ideas for increasing treatment engagement (i.e., increased communication and education from providers, community events, information on social media). CONCLUSION: Novel interventions are needed to improve treatment initiation following initial diagnosis of depression in primary care settings. Findings from this study offer suggestions for improving treatment initiation in traditionally underserved communities.

Sulcal pits of the superior temporal sulcus in schizophrenia patients with auditory verbal hallucinations.

Auditory verbal hallucinations (AVHs) are among the most common and disabling symptoms of schizophrenia. They involve the superior temporal sulcus (STS), which is associated with language processing; specific STS patterns may reflect vulnerability to auditory hallucinations in schizophrenia. STS sulcal pits are the deepest points of the folds in this region and were investigated here as an anatomical landmark of AVHs. This study included 53 patients diagnosed with schizophrenia and past or present AVHs, as well as 100 healthy control volunteers. All participants underwent a 3-T magnetic resonance imaging T1 brain scan, and sulcal pit differences were compared between the two groups. Compared with controls, patients with AVHs had a significantly different distributions for the number of sulcal pits in the left STS, indicating a less complex morphological pattern. The association of STS sulcal morphology with AVH suggests an early neurodevelopmental process in the pathophysiology of schizophrenia with AVHs.

Adolescents Who Do Not Endorse Risk via the Patient Health Questionnaire Before Self-Harm or Suicide.

Importance: Given that the Patient Health Questionnaire (PHQ) item 9 is commonly used to screen for risk of self-harm and suicide, it is important that clinicians recognize circumstances when at-risk adolescents may go undetected. Objective: To understand characteristics of adolescents with a history of depression who do not endorse the PHQ item 9 before a near-term intentional self-harm event or suicide. Design, Setting, and Participants: This was a retrospective cohort study design using electronic health record and claims data from January 2009 through September 2017. Settings included primary care and mental health specialty clinics across 7 integrated US health care systems. Included in the study were adolescents aged 13 to 17 years with history of depression who completed the PHQ item 9 within 30 or 90 days before self-harm or suicide. Study data were analyzed September 2022 to April 2023. Exposures: Demographic, diagnostic, treatment, and health care utilization characteristics. Main Outcome(s) and Measure(s): Responded "not at all" (score = 0) to PHQ item 9 regarding thoughts of death or self-harm within 30 or 90 days before self-harm or suicide. Results: The study included 691 adolescents (mean [SD] age, 15.3 [1.3] years; 541 female [78.3%]) in the 30-day cohort and 1024 adolescents (mean [SD] age, 15.3 [1.3] years; 791 female [77.2%]) in the 90-day cohort. A total of 197 of 691 adolescents (29%) and 330 of 1024 adolescents (32%), respectively, scored 0 before self-harm or suicide on the PHQ item 9 in the 30- and 90-day cohorts. Adolescents seen in primary care (odds ratio [OR], 1.5; 95% CI, 1.0-2.1; P = .03) and older adolescents (OR, 1.2; 95% CI, 1.0-1.3; P = .02) had increased odds of scoring 0 within 90 days of a self-harm event or suicide, and adolescents with a history of inpatient hospitalization and a mental health diagnosis had twice the odds (OR, 2.0; 95% CI, 1.3-3.0; P = .001) of scoring 0 within 30 days. Conversely, adolescents with diagnoses of eating disorders were significantly less likely to score 0 on item 9 (OR, 0.4; 95% CI, 0.2-0.8; P = .007) within 90 days. Conclusions and Relevance: Study results suggest that older age, history of an inpatient mental health encounter, or being screened in primary care were associated with at-risk adolescents being less likely to endorse having thoughts of death and self-harm on the PHQ item 9 before a self-harm event or suicide death. As use of the PHQ becomes more widespread in practice, additional research is needed for understanding reasons why many at-risk adolescents do not endorse thoughts of death and self-harm.

Suicide Screening, Risk Assessment, and Lethal Means Counseling During Zero Suicide Implementation.

OBJECTIVE: The authors measured implementation of Zero Suicide (ZS) clinical practices that support identification of suicide risk and risk mitigation, including screening, risk assessment, and lethal means counseling, across mental health specialty and primary care settings. METHODS: Six health care systems in California, Colorado, Michigan, Oregon, and Washington participated. The sample included members ages ≥13 years from 2010 to 2019 (N=7,820,524 patients). The proportions of patients with suicidal ideation screening, suicide risk assessment, and lethal means counseling were estimated. RESULTS: In 2019, patients were screened for suicidal ideation in 27.1% (range 5.0%-85.0%) of mental health visits and 2.5% (range 0.1%-35.0%) of primary care visits among a racially and ethnically diverse sample (44.9% White, 27.2% Hispanic, 13.4% Asian, and 7.7% Black). More patients screened positive for suicidal ideation in the mental health setting (10.2%) than in the primary care setting (3.8%). Of the patients screening positive for suicidal ideation in the mental health setting, 76.8% received a risk assessment, and 82.4% of those identified as being at high risk received lethal means counseling, compared with 43.2% and 82.4%, respectively, in primary care. CONCLUSIONS: Six health systems that implemented ZS showed a high level of variation in the proportions of patients receiving suicide screening and risk assessment and lethal means counseling. Two opportunities emerged for further study to increase frequency of these practices: expanding screening beyond patients with regular health care visits and implementing risk assessment with lethal means counseling in the primary care setting directly after a positive suicidal ideation screening.

Reducing Firearm Access for Suicide Prevention: Implementation Evaluation of the Web-Based "Lock to Live" Decision Aid in Routine Health Care Encounters.

Background: "Lock to Live" (L2L) is a novel web-based decision aid for helping people at risk of suicide reduce access to firearms. Researchers have demonstrated that L2L is feasible to use and acceptable to patients, but little is known about how to implement L2L during web-based mental health care and in-person contact with clinicians. Objective: The goal of this project was to support the implementation and evaluation of L2L during routine primary care and mental health specialty web-based and in-person encounters. Methods: The L2L implementation and evaluation took place at Kaiser Permanente Washington (KPWA)-a large, regional, nonprofit health care system. Three dimensions from the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) model-Reach, Adoption, and Implementation-were selected to inform and evaluate the implementation of L2L at KPWA (January 1, 2020, to December 31, 2021). Electronic health record (EHR) data were used to purposefully recruit adult patients, including firearm owners and patients reporting suicidality, to participate in semistructured interviews. Interview themes were used to facilitate L2L implementation and inform subsequent semistructured interviews with clinicians responsible for suicide risk mitigation. Audio-recorded interviews were conducted via the web, transcribed, and coded, using a rapid qualitative inquiry approach. A descriptive analysis of EHR data was performed to summarize L2L reach and adoption among patients identified at high risk of suicide. Results: The initial implementation consisted of updates for clinicians to add a URL and QR code referencing L2L to the safety planning EHR templates. Recommendations about introducing L2L were subsequently derived from the thematic analysis of semistructured interviews with patients (n=36), which included (1) "have an open conversation," (2) "validate their situation," (3) "share what to expect," (4) "make it accessible and memorable," and (5) "walk through the tool." Clinicians' interviews (n=30) showed a strong preference to have L2L included by default in the EHR-based safety planning template (in contrast to adding it manually). During the 2-year observation period, 2739 patients reported prior-month suicide attempt planning or intent and had a documented safety plan during the study period, including 745 (27.2%) who also received L2L. Over four 6-month subperiods of the observation period, L2L adoption rates increased substantially from 2% to 29% among primary care clinicians and from <1% to 48% among mental health clinicians. Conclusions: Understanding the value of L2L from users' perspectives was essential for facilitating implementation and increasing patient reach and clinician adoption. Incorporating L2L into the existing system-level, EHR-based safety plan template reduced the effort to use L2L and was likely the most impactful implementation strategy. As rising suicide rates galvanize the urgency of prevention, the findings from this project, including L2L implementation tools and strategies, will support efforts to promote safety for suicide prevention in health care nationwide.

Transitions in health insurance among continuously insured patients with schizophrenia.

Changes in health insurance coverage may disrupt access to and continuity of care, even for those who remain insured. Continuity of care is especially important in schizophrenia, which requires ongoing medical and pharmaceutical treatment. However, little is known about continuity of insurance coverage among those with schizophrenia. The objective was to examine the probability of insurance transitions for individuals with schizophrenia who were continuously insured and whether this varied across insurance types. The Massachusetts All-Payer Claims Database identified individuals with schizophrenia aged 18-64 who were continuously insured during a two-year period between 2014 and 2018. A logistic regression estimated the association of having an insurance transition - defined as having a change in insurance type - with insurance type at the start of the period, adjusting for age, sex, ZIP code in the lowest quartile of median income, and ZIP code with concentrated poverty. Overall, 15.1% had at least one insurance transition across a 24-month period. Insurance transitions were most frequent among those with plans from the Marketplace. In regression adjusted results, individuals covered by the traditional Medicaid program were 20.2 percentage points [pp] (95% confidence interval [CI]: 24.6 pp, 15.9 pp) less likely to have an insurance transition than those who were insured by a Marketplace plan. Insurance transitions among individuals with schizophrenia were common, with more than one in six people having at least one transition in insurance type during a two-year period. Given that even continuously insured individuals with schizophrenia commonly experience insurance transitions, attention to insurance transitions as a barrier to care access and continuity is warranted.

Predicting suicide death after emergency department visits with mental health or self-harm diagnoses.

OBJECTIVE: Use health records data to predict suicide death following emergency department visits. METHODS: Electronic health records and insurance claims from seven health systems were used to: identify emergency department visits with mental health or self-harm diagnoses by members aged 11 or older; extract approximately 2500 potential predictors including demographic, historical, and baseline clinical characteristics; and ascertain subsequent deaths by self-harm. Logistic regression with lasso and random forest models predicted self-harm death over 90 days after each visit. RESULTS: Records identified 2,069,170 eligible visits, 899 followed by suicide death within 90 days. The best-fitting logistic regression with lasso model yielded an area under the receiver operating curve of 0.823 (95% CI 0.810-0.836). Visits above the 95th percentile of predicted risk included 34.8% (95% CI 31.1-38.7) of subsequent suicide deaths and had a 0.303% (95% CI 0.261-0.346) suicide death rate over the following 90 days. Model performance was similar across subgroups defined by age, sex, race, and ethnicity. CONCLUSIONS: Machine learning models using coded data from health records have moderate performance in predicting suicide death following emergency department visits for mental health or self-harm diagnosis and could be used to identify patients needing more systematic follow-up.

Short report: Transition to International Classification of Diseases, 10th Revision and the prevalence of autism in a cohort of healthcare systems.

LAY ABSTRACT: Currently, the prevalence of autism spectrum disorder (henceforth "autism") is 1 in 36, an increasing trend from previous estimates. In 2015, the United States adopted a new version (International Classification of Diseases, 10th Revision) of the World Health Organization coding system, a standard for classifying medical conditions. Our goal was to examine how the transition to this new coding system impacted autism diagnoses in 10 healthcare systems. We obtained information from electronic medical records and insurance claims data from July 2014 through December 2016 for each healthcare system. We used member enrollment data for 30 consecutive months to observe changes 15 months before and after adoption of the new coding system. Overall, the rates of autism per 1000 enrolled members was increasing for 0- to 5-year-olds before transition to International Classification of Diseases, 10th Revision and did not substantively change after the new coding was in place. There was variation observed in autism diagnoses before and after transition to International Classification of Diseases, 10th Revision for other age groups. The change to the new coding system did not meaningfully affect autism rates at the participating healthcare systems. The increase observed among 0- to 5-year-olds is likely indicative of an ongoing trend related to increases in screening for autism rather than a shift associated with the new coding.

Stability of Suicide Risk Prediction Models During Changes in Health Care Delivery.

OBJECTIVE: The authors aimed to use health records data to examine how the accuracy of statistical models predicting self-harm or suicide changed between 2015 and 2019, as health systems implemented suicide prevention programs. METHODS: Data from four large health systems were used to identify specialty mental health visits by patients ages ≥11 years, assess 311 potential predictors of self-harm (including demographic characteristics, historical risk factors, and index visit characteristics), and ascertain fatal or nonfatal self-harm events over 90 days after each visit. New prediction models were developed with logistic regression with LASSO (least absolute shrinkage and selection operator) in random samples of visits (65%) from each calendar year and were validated in the remaining portion of the sample (35%). RESULTS: A model developed for visits from 2009 to mid-2015 showed similar classification performance and calibration accuracy in a new sample of about 13.1 million visits from late 2015 to 2019. Area under the receiver operating characteristic curve (AUC) ranged from 0.840 to 0.849 in the new sample, compared with 0.851 in the original sample. New models developed for each year for 2015-2019 had classification performance (AUC range 0.790-0.853), sensitivity, and positive predictive value similar to those of the previously developed model. Models selected similar predictors from 2015 to 2019, except for more frequent selection of depression questionnaire data in later years, when questionnaires were more frequently recorded. CONCLUSIONS: A self-harm prediction model developed with 2009-2015 visit data performed similarly when applied to 2015-2019 visits. New models did not yield superior performance or identify different predictors.

Racial-Ethnic Differences in Receipt of Past-Year Health Care Services Among Suicide Decedents: A Case-Control Study.

OBJECTIVE: Suicide remains an urgent public health crisis. Although some sociodemographic characteristics are associated with greater suicide risk in the general population, it is unclear whether individuals utilizing health care in the United States have similar suicide incidence patterns. The authors examined whether race-ethnicity is associated with suicide death among patients seeking health care and investigated health care utilization patterns. METHODS: Data were collected from electronic health records and government mortality records for patients seeking health care across nine health care systems in the United States. Patients who died by suicide (N=1,935) were matched with patients in a control group (N=19,350) within each health care system. RESULTS: Patients who died by suicide were significantly more likely to be White, older, male, living in low-education areas, living in rural areas, or diagnosed as having mental health conditions or were significantly less likely to have commercial insurance (p<0.05). Among most racial-ethnic groups, those who died by suicide had a higher number of past-year mental health, primary care, and total health care visits; for American Indian/Alaska Native patients, the number of health care visits tended to be lower among suicide decedents. CONCLUSIONS: These findings suggest that higher past-year health care utilization was associated with increased likelihood of suicide death across several racial-ethnic groups. This observation underscores the need for identifying and managing suicide risk in health care settings, including outside of mental health visits, among most racial-ethnic groups.

Psychotherapy Disruption Before and After the Transition to Virtual Mental Health Care Induced by the COVID-19 Pandemic.

OBJECTIVE: This study aimed to examine population-level disruption in psychotherapy before and after the rapid shift to virtual mental health care induced by the onset of the COVID-19 pandemic in the United States. METHODS: This retrospective study used electronic health record and insurance claims data from three U.S. health systems. The sample included 110,089 patients with mental health conditions who were members of the health systems' affiliated health plans and attended at least two psychotherapy visits from June 14, 2019, through December 15, 2020. Data were subdivided into two 9-month periods (before vs. after COVID-19 onset, defined in this study as March 14, 2020). Psychotherapy visits were measured via health records and categorized as in person or virtual. Disruption was defined as a gap of >45 days between visits. RESULTS: Visits in the preonset period were almost exclusively in person (97%), whereas over half of visits in the postonset period were virtual (52%). Approximately 35% of psychotherapy visits were followed by a disruption in the preonset period, compared with 18% in the postonset period. Disruption continued to be less common (adjusted OR=0.45) during the postonset period after adjustment for visit, mental health, and sociodemographic factors. The magnitude of the difference in disruption between periods was homogeneous across sociodemographic characteristics but heterogeneous across psychiatric diagnoses. CONCLUSIONS: This study found fewer population-level disruptions in psychotherapy receipt after rapid transition to virtual mental health care following COVID-19 onset. These data support the continued availability of virtual psychotherapy.