A Randomized Control Trial of a Digital Health Tool for Safer Firearm and Medication Storage for Patients with Suicide Risk.

Most patients with suicide risk do not receive recommendations to reduce access to lethal means due to a variety of barriers (e.g., lack of provider time, training). Determine if highly efficient population-based EHR messaging to visit the Lock to Live (L2L) decision aid impacts patient-reported storage behaviors. Randomized trial. Integrated health care system serving Denver, CO. Served by primary care or mental health specialty clinic in the 75-99.5th risk percentile on a suicide attempt or death prediction model. Lock to Live (L2L) is a web-based decision aid that incorporates patients' values into recommendations for safe storage of lethal means, including firearms and medications. Anonymous survey that determined readiness to change: pre-contemplative (do not believe in safe storage), contemplative (believe in safe storage but not doing it), preparation (planning storage changes) or action (safely storing). There were 21,131 patients randomized over a 6-month period with a 27% survey response rate. Many (44%) had access to a firearm, but most of these (81%) did not use any safe firearm storage behaviors. Intervention patients were more likely to be categorized as preparation or action compared to controls for firearm storage (OR = 1.30 (1.07-1.58)). When examining action alone, there were no group differences. There were no statistically significant differences for any medication storage behaviors. Selection bias in those who responded to survey. Efficiently sending an EHR invitation message to visit L2L encouraged patients with suicide risk to consider safer firearm storage practices, but a stronger intervention is needed to change storage behaviors. Future studies should evaluate whether combining EHR messaging with provider nudges (e.g., brief clinician counseling) changes storage behavior.ClinicalTrials.gov: NCT05288517.

Cost of Implementing an Evidence-Based Intervention to Support Safer Use of Antipsychotics in Youth.

To estimate the cost of implementing a clinical program designed to support safer use of antipsychotics in children and adolescents (youth) age 3-17 years at the time of initiating an antipsychotic medication. We calculate the costs of implementing a psychiatric consultation and navigation program for youth prescribed antipsychotic medications across 4 health systems, which included an electronic health record (EHR) decision support tool, consultation with a child and adolescent psychiatrist, and up to 6 months of behavioral health care navigation, as well as telemental health for patients (n = 348). Cost data were collected for both start-up and ongoing intervention phases and are estimated over a 1-year period. Data sources included study records and time-in-motion reports, analyzed from a health system perspective. Costs included both labor and nonlabor costs (2019 US dollars). The average total start-up and ongoing costs per health system were $34,007 and $185,174, respectively. The average total cost per patient was $2,128. The highest average ongoing labor cost components were telemental health ($901 per patient), followed by child and adolescent psychiatrist consultation ($659), and the lowest cost component was primary care/behavioral health provider time to review/respond to the EHR decision support tool and case consultation ($24). For health systems considering programs to promote safer and targeted use of antipsychotics among youth, this study provides estimates of the full start-up and ongoing costs of an EHR decision support tool, psychiatric consultation service, and psychotherapeutic services for patients and families.Trial registration: Clinicaltrials.gov, NCT03448575.

Clinical implementation of suicide risk prediction models in healthcare: a qualitative study.

BACKGROUND: Suicide risk prediction models derived from electronic health records (EHR) are a novel innovation in suicide prevention but there is little evidence to guide their implementation. METHODS: In this qualitative study, 30 clinicians and 10 health care administrators were interviewed from one health system anticipating implementation of an automated EHR-derived suicide risk prediction model and two health systems piloting different implementation approaches. Site-tailored interview guides focused on respondents' expectations for and experiences with suicide risk prediction models in clinical practice, and suggestions for improving implementation. Interview prompts and content analysis were guided by Consolidated Framework for Implementation Research (CFIR) constructs. RESULTS: Administrators and clinicians found use of the suicide risk prediction model and the two implementation approaches acceptable. Clinicians desired opportunities for early buy-in, implementation decision-making, and feedback. They wanted to better understand how this manner of risk identification enhanced existing suicide prevention efforts. They also wanted additional training to understand how the model determined risk, particularly after patients they expected to see identified by the model were not flagged at-risk and patients they did not expect to see identified were. Clinicians were concerned about having enough suicide prevention resources for potentially increased demand and about their personal liability; they wanted clear procedures for situations when they could not reach patients or when patients remained at-risk over a sustained period. Suggestions for making risk model workflows more efficient and less burdensome included consolidating suicide risk information in a dedicated module in the EHR and populating risk assessment scores and text in clinical notes. CONCLUSION: Health systems considering suicide risk model implementation should engage clinicians early in the process to ensure they understand how risk models estimate risk and add value to existing workflows, clarify clinician role expectations, and summarize risk information in a convenient place in the EHR to support high-quality patient care.

Patient expectations of and experiences with a suicide risk identification algorithm in clinical practice.

BACKGROUND: Suicide risk prediction models derived from electronic health records (EHR) and insurance claims are a novel innovation in suicide prevention but patient perspectives on their use have been understudied. METHODS: In this qualitative study, between March and November 2020, 62 patients were interviewed from three health systems: one anticipating implementation of an EHR-derived suicide risk prediction model and two others piloting different implementation approaches. Site-tailored interview guides focused on patients' perceptions of this technology, concerns, and preferences for and experiences with suicide risk prediction model implementation in clinical practice. A constant comparative analytic approach was used to derive themes. RESULTS: Interview participants were generally supportive of suicide risk prediction models derived from EHR data. Concerns included apprehension about inducing anxiety and suicidal thoughts, or triggering coercive treatment, particularly among those who reported prior negative experiences seeking mental health care. Participants who were engaged in mental health care or case management expected to be asked about their suicide risk and largely appreciated suicide risk conversations, particularly by clinicians comfortable discussing suicidality. CONCLUSION: Most patients approved of suicide risk models that use EHR data to identify patients at-risk for suicide. As health systems proceed to implement such models, patient-centered care would involve dialogue initiated by clinicians experienced with assessing suicide risk during virtual or in person care encounters. Health systems should proactively monitor for negative consequences that result from risk model implementation to protect patient trust.

Barriers and facilitators to changing drinking and receiving alcohol-related care: Interviews with Veterans Health Administration primary care patients who indicated interest but did not enroll in an alcohol care management intervention trial.

Background: Most people with alcohol use disorder do not receive treatment, and primary care (PC)-based management of alcohol use disorder is a key strategy to close this gap. Understanding PC patients' perspectives on changing drinking and receiving alcohol-related care is important for this goal, particularly among those who decline alcohol-related care. This study examined perspectives on barriers and facilitators to changing drinking and receiving alcohol-related care among Veterans Health Administration (VA) PC patients who indicated interest but did not enroll in the Choosing Healthier drinking Options In primary CarE trial (CHOICE), which tested a PC-based alcohol care management intervention. Methods: VA PC patients with frequent heavy drinking who indicated interest in CHOICE but did not enroll were invited to participate. Twenty-seven patients completed in-person, semi-structured interviews. Interview transcripts were analyzed using iterative deductive and inductive content analysis. Results: Participants were mostly men (96%) and White (59%), and the mean age was 48. Seventy-four percent met criteria for alcohol use disorder, and the median number of past-week standard drinks was 41.5. Participants reported fewer alcohol-related problems, lower importance of/readiness to change drinking, and higher confidence in their ability to change than patients who enrolled in the CHOICE trial. Barriers fell into 5 domains: drinking fulfills need(s); reducing drinking or treatment is not needed; treatment is not effective/not acceptable; alcohol-related stigma; and practical barriers. Facilitators fell into 4 domains: reasons to change drinking; social support; treatment is acceptable/meets patients' needs; and practical facilitators. Participants discussed how Veteran identity and military experiences impacted drinking and willingness to receive care, which amplified multiple barriers/facilitators. Conclusions: This study identified barriers and facilitators to changing drinking and receiving alcohol-related care among VA PC patients who indicated interest but did not enroll in an alcohol care management trial. Findings can inform patient-centered interventions and support clinicians in engaging patients in care.

Effect of Offering Care Management or Online Dialectical Behavior Therapy Skills Training vs Usual Care on Self-harm Among Adult Outpatients With Suicidal Ideation: A Randomized Clinical Trial.

Importance: People at risk of self-harm or suicidal behavior can be accurately identified, but effective prevention will require effective scalable interventions. Objective: To compare 2 low-intensity outreach programs with usual care for prevention of suicidal behavior among outpatients who report recent frequent suicidal thoughts. Design, Setting, and Participants: Pragmatic randomized clinical trial including outpatients reporting frequent suicidal thoughts identified using routine Patient Health Questionnaire depression screening at 4 US integrated health systems. A total of 18 882 patients were randomized between March 2015 and September 2018, and ascertainment of outcomes continued through March 2020. Interventions: Patients were randomized to a care management intervention (n = 6230) that included systematic outreach and care, a skills training intervention (n = 6227) that introduced 4 dialectical behavior therapy skills (mindfulness, mindfulness of current emotion, opposite action, and paced breathing), or usual care (n = 6187). Interventions, lasting up to 12 months, were delivered primarily through electronic health record online messaging and were intended to supplement ongoing mental health care. Main Outcomes and Measures: The primary outcome was time to first nonfatal or fatal self-harm. Nonfatal self-harm was ascertained from health system records, and fatal self-harm was ascertained from state mortality data. Secondary outcomes included more severe self-harm (leading to death or hospitalization) and a broader definition of self-harm (selected injuries and poisonings not originally coded as self-harm). Results: A total of 18 644 patients (9009 [48%] aged 45 years or older; 12 543 [67%] female; 9222 [50%] from mental health specialty clinics and the remainder from primary care) contributed at least 1 day of follow-up data and were included in analyses. Thirty-one percent of participants offered care management and 39% offered skills training actively engaged in intervention programs. A total of 540 participants had a self-harm event (including 45 deaths attributed to self-harm and 495 nonfatal self-harm events) over 18 months following randomization: 172 (3.27%) in care management, 206 (3.92%) in skills training, and 162 (3.27%) in usual care. Risk of fatal or nonfatal self-harm over 18 months did not differ significantly between the care management and usual care groups (hazard ratio [HR], 1.07; 97.5% CI, 0.84-1.37) but was significantly higher in the skills training group than in usual care (HR, 1.29; 97.5% CI, 1.02-1.64). For severe self-harm, care management vs usual care had an HR of 1.03 (97.5% CI, 0.71-1.51); skills training vs usual care had an HR of 1.34 (97.5% CI, 0.94-1.91). For the broader self-harm definition, care management vs usual care had an HR of 1.10 (97.5% CI, 0.92-1.33); skills training vs usual care had an HR of 1.17 (97.5% CI, 0.97-1.41). Conclusions and Relevance: Among adult outpatients with frequent suicidal ideation, offering care management did not significantly reduce risk of self-harm, and offering brief dialectical behavior therapy skills training significantly increased risk of self-harm, compared with usual care. These findings do not support implementation of the programs tested in this study. Trial Registration: ClinicalTrials.gov Identifier: NCT02326883.

Alcohol Use and Antiretroviral Adherence Among Patients Living with HIV: Is Change in Alcohol Use Associated with Change in Adherence?

Alcohol use increases non-adherence to antiretroviral therapy (ART) among persons living with HIV (PLWH). Dynamic longitudinal associations are understudied. Veterans Aging Cohort Study (VACS) data 2/1/2008-7/31/16 were used to fit linear regression models estimating changes in adherence (% days with ART medication fill) associated with changes in alcohol use based on annual clinically-ascertained AUDIT-C screening scores (range - 12 to + 12, 0 = no change) adjusting for demographics and initial adherence. Among 21,275 PLWH (67,330 observations), most reported no (48%) or low-level (39%) alcohol use initially, with no (55%) or small (39% ≤ 3 points) annual change. Mean initial adherence was 86% (SD 21%), mean annual change was - 3.1% (SD 21%). An inverted V-shaped association was observed: both increases and decreases in AUDIT-C were associated with greater adherence decreases relative to stable scores [p < 0.001, F (4, 21,274)]. PLWH with dynamic alcohol use (potentially indicative of alcohol use disorder) should be considered for adherence interventions.

RESUMEN: El consumo de alcohol aumenta el no-cumplimiento a la terapia antirretroviral (TARV) entre las personas que viven con VIH. No se han estudiado lo suficiente las dinámicas asociaciones longitudinales. Los datos del Estudio de la Envejecimiento de Cohorte de Veteranos (EECV) (1/2/2008­31/7/2016) fueron usados para encajar modelos de regresión lineal estimando los cambios en cumplimiento (% de días con medicaciones TARV surtidas) asociados con los cambios en el consumo de alcohol basado en los resultados anuales de las evaluaciones AUDIT-C, determinadas clínicamente, (una gama de -12 a + 12, 0 = cero cambio) adaptándose a las estadísticas demográficas y cumplimiento inicial. Entre 21,275 personas que viven con VIH (67,330 observaciones), la mayoría reportó ningún (48%) o bajos niveles del (39%) consumo de alcohol inicialmente, con ningún (55%) o muy pequeño (39% ≤ 3 puntos) cambio anual. la media inicial de cumplimiento fue 86% (DE 21%). La media de cambio anual fue -3.1% (DE 21%). Se observó una asociación de forma V invertida: tanto los aumentos como las disminuciones en AUDIT-C fueron asociados con mayor disminuciones de cumplimiento en comparación con resultados estables (p < 0.001, F (4, 21,274)). Personas que viven con VIH con el consumo dinámico de alcohol (potencialmente indicativo de un trastorno por consumo de alcohol) deben ser considerados por intervenciones de cumplimiento.

Effect of a Care Management Intervention on 12-Month Drinking Outcomes Among Patients With and Without DSM-IV Alcohol Dependence at Baseline.

BACKGROUND: The CHOICE care management intervention did not improve drinking relative to usual care (UC) for patients with frequent heavy drinking at high risk of alcohol use disorders. Patients with alcohol dependence were hypothesized to benefit most. We conducted preplanned secondary analyses to test whether the CHOICE intervention improved drinking relative to UC among patients with and without baseline DSM-IV alcohol dependence. METHODS: A total of 304 patients reporting frequent heavy drinking from 3 VA primary care clinics were randomized (stratified by DSM-IV alcohol dependence, sex, and site) to UC or the patient-centered, nurse-delivered, 12-month CHOICE care management intervention. Primary outcomes included percent heavy drinking days (%HDD) using 28-day timeline follow-back and a "good drinking outcome" (GDO)-abstaining or drinking below recommended limits and no alcohol-related symptoms on the Short Inventory of Problems at 12 months. Generalized estimating equation binomial regression models (clustered on provider) with interaction terms between dependence and intervention group were fit. RESULTS: At baseline, 59% of intervention and UC patients had DSM-IV alcohol dependence. Mean drinking outcomes improved for all subgroups. For participants with dependence, 12-month outcomes did not differ for intervention versus UC patients (%HDD 37% versus 38%, p = 0.76 and GDO 16% versus 16%, p = 0.77). For participants without dependence, %HDD did not differ between intervention (41%) and UC (31%) patients (p = 0.12), but the proportion with GDO was significantly higher among UC participants (26% versus 13%, p = 0.046). Neither outcome was significantly modified by dependence (interaction p values 0.19 for %HDD and 0.10 for GDO). CONCLUSIONS: Among participants with frequent heavy drinking, care management had no benefit relative to UC for patients with dependence, but UC may have had benefits for those without dependence. TRIAL REGISTRATION: ClinicalTrials.gov NCT01400581.

If You Listen, I Will Talk: the Experience of Being Asked About Suicidality During Routine Primary Care.

BACKGROUND: Routine population-based screening for depression is an essential part of evolving health care models integrating care for mental health in primary care. Depression instruments often include questions about suicidal thoughts, but how patients experience these questions in primary care is not known and may have implications for accurate identification of patients at risk. OBJECTIVES: To explore the patient experience of routine population-based depression screening/assessment followed, for some, by suicide risk assessment and discussions with providers. DESIGN: Qualitative, interview-based study. PARTICIPANTS: Thirty-seven patients from Kaiser Permanente Washington who had recently screened positive for depression on the 2-item Patient Health Questionnaire [PHQ] and completed the full PHQ-9. APPROACH: Criterion sampling identified patients who had recently completed the PHQ-9 ninth question which asks about the frequency of thoughts about self-harm. Patients completed semi-structured interviews by phone, which were recorded and transcribed. Directive and conventional content analyses were used to apply knowledge from prior research and elucidate new information from interviews; thematic analysis was used to organize key content overall and across groups based on endorsement of suicide ideation. KEY RESULTS: Four main organizing themes emerged from analyses: (1) Participants believed being asked about suicidality was contextually appropriate and valuable, (2) some participants described a mismatch between their lived experience and the PHQ-9 ninth question, (3) suicidality disclosures involved weighing hope for help against fears of negative consequences, and (4) provider relationships and acts of listening and caring facilitated discussions about suicidality. CONCLUSIONS: All participants believed being asked questions about suicidal thoughts was appropriate, though some who disclosed suicidal thoughts described experiencing stigma and sometimes distanced themselves from suicidality. Direct communication with trusted providers, who listened and expressed empathy, bolstered comfort with disclosure. Future research should consider strategies for reducing stigma and encouraging fearless disclosure among primary care patients experiencing suicidality.

Level of Alcohol Use Associated with HIV Care Continuum Targets in a National U.S. Sample of Persons Living with HIV Receiving Healthcare.

We evaluated associations between levels of alcohol use and HIV care continuum components using national Veterans Aging Cohort Study data for all patients with HIV and AUDIT-C screening (2/1/2008-9/30/2014). Poisson regression models evaluated associations between alcohol use levels (non-drinking, low-, medium-, high-, and very high-level drinking) and: (1) engagement with care (documented CD4 cells/µl or viral load copies/ml labs), (2) ART treatment (≥ 1 prescription), and (3) viral suppression (HIV RNA < 500 copies/ml) within one year. Among 33,224 patients, alcohol use level was inversely associated with all care continuum outcomes (all p < 0.001). Adjusted prevalence of care engagement ranged from 77.8% (95% CI 77.1-78.4%) for non-drinking to 69.1% (66.6-71.6%) for high-level drinking. The corresponding range for ART treatment was 74.0% (73.3-74.7%) to 60.1% (57.3-62.9%) and for viral suppression was 57.3% (56.5-58.1%) to 38.3% (35.6-41.1%). Greater alcohol use is associated with suboptimal HIV treatment across the HIV care continuum.

Development and Evaluation of a Web-Based Resource for Suicidal Thoughts: NowMattersNow.org.

BACKGROUND: Nearly half of people who die by suicide see a health care provider in the month before their death. With the release of new care guidelines, detection of suicidal patients will likely increase. Providers need access to suicide-specific resources that can be used as part of immediate, brief interventions with a suicidal patient. Web-based suicide prevention resources have the potential to address this need. OBJECTIVE: This study aimed to describe the development of the NowMattersNow.org website as a resource for individuals with suicidal thoughts and to evaluate the utility of the site via user experience surveys. METHODS: NowMattersNow.org is an online video-based free public resource that provides evidence-based teachings, examples, and resources for managing suicidal thoughts and intense emotions focused largely around skills from dialectical behavior therapy. Developed with assistance from mental health consumers, it is intended to address gaps in access to services for suicidal patients in health care systems. Visitors stay an average of a minute and a half on the website. From March 2015 to December 2017, a user experience survey measured self-reported changes on a 1 (not at all) to 5 (completely overwhelming) scale regarding intensity of suicidal thoughts and negative emotions while on the website. Longitudinal regression analyses using generalized estimating equations evaluated the magnitude and statistical significance of user-reported changes in suicidal ideation and negative emotion. In secondary analyses, user-reported changes specific to subgroups, including men aged 36 to 64 years, mental health care providers, and other health care providers were evaluated. RESULTS: During the period of analysis, there were 138,386 unique website visitors. We analyzed surveys (N=3670) collected during that time. Subsamples included men aged 36 to 64 years (n=512), mental health providers (n=460), and other health care providers (n=308). A total of 28% (1028/3670) of survey completers rated their suicidal thoughts as a 5 or "completely overwhelming" when they entered the website. We observed significant reductions in self-reported intensity of suicidal thoughts (-0.21, P<.001) and negative emotions (-0.32, P<.001), including decreases for users with the most severe suicidal thoughts (-6.4%, P<.001), most severe negative emotions (-10.9%, P<.001), and for middle-aged men (-0.13, P<001). Results remained significant after controlling for length of visit to website (before the survey) and technology type (mobile, desktop, and tablet). CONCLUSIONS: Survey respondents reported measurable reductions in intensity of suicidal thoughts and emotions, including those rating their suicidal thoughts as completely or almost completely overwhelming and among middle-aged men. Although results from this user-experience survey administered at one point in time to a convenience sample of users must be interpreted with caution, results provide preliminary support for the potential effectiveness of the NowMattersNow.org website as a tool for short-term management of suicidal thoughts and negative emotions.

Barriers to and Facilitators of Alcohol Use Disorder Pharmacotherapy in Primary Care: A Qualitative Study in Five VA Clinics.

BACKGROUND: Three medications are FDA-approved and recommended for treating alcohol use disorders (AUD) but they are not offered to most patients with AUD. Primary care (PC) may be an optimal setting in which to offer and prescribe AUD medications, but multiple barriers are likely. OBJECTIVE: This qualitative study used social marketing theory, a behavior change approach that employs business marketing techniques including "segmenting the market," to describe (1) barriers and facilitators to prescribing AUD medications in PC, and (2) beliefs of PC providers after they were segmented into groups more and less willing to prescribe AUD medications. DESIGN: Qualitative, interview-based study. PARTICIPANTS: Twenty-four providers from five VA PC clinics. APPROACH: Providers completed in-person semi-structured interviews, which were recorded, transcribed, and analyzed using social marketing theory and thematic analysis. Providers were divided into two groups based on consensus review. KEY RESULTS: Barriers included lack of knowledge and experience, beliefs that medications cannot replace specialty addiction treatment, and alcohol-related stigma. Facilitators included training, support for prescribing, and behavioral staff to support follow-up. Providers more willing to prescribe viewed prescribing for AUD as part of their role as a PC provider, framed medications as a potentially effective "tool" or "foot in the door" for treating AUD, and believed that providing AUD medications in PC might catalyze change while reducing stigma and addressing other barriers to specialty treatment. Those less willing believed that medications could not effectively treat AUD, and that treating AUD was the role of specialty addiction treatment providers, not PC providers, and would require time and expertise they do not have. CONCLUSIONS: We identified barriers to and facilitators of prescribing AUD medications in PC, which, if addressed and/or capitalized on, may increase provision of AUD medications. Providers more willing to prescribe may be the optimal target of a customized implementation intervention to promote changes in prescribing.

Physical and economic consequences of climate change in Europe.

Quantitative estimates of the economic damages of climate change usually are based on aggregate relationships linking average temperature change to loss in gross domestic product (GDP). However, there is a clear need for further detail in the regional and sectoral dimensions of impact assessments to design and prioritize adaptation strategies. New developments in regional climate modeling and physical-impact modeling in Europe allow a better exploration of those dimensions. This article quantifies the potential consequences of climate change in Europe in four market impact categories (agriculture, river floods, coastal areas, and tourism) and one nonmarket impact (human health). The methodology integrates a set of coherent, high-resolution climate change projections and physical models into an economic modeling framework. We find that if the climate of the 2080s were to occur today, the annual loss in household welfare in the European Union (EU) resulting from the four market impacts would range between 0.2-1%. If the welfare loss is assumed to be constant over time, climate change may halve the EU's annual welfare growth. Scenarios with warmer temperatures and a higher rise in sea level result in more severe economic damage. However, the results show that there are large variations across European regions. Southern Europe, the British Isles, and Central Europe North appear most sensitive to climate change. Northern Europe, on the other hand, is the only region with net economic benefits, driven mainly by the positive effects on agriculture. Coastal systems, agriculture, and river flooding are the most important of the four market impacts assessed.

Designing messaging to engage patients in an online suicide prevention intervention: survey results from patients with current suicidal ideation.

BACKGROUND: Computerized, Internet-delivered interventions can be efficacious; however, uptake and maintaining sustained client engagement are still big challenges. We see the development of effective engagement strategies as the next frontier in online health interventions, an area where much creative research has begun. We also argue that for engagement strategies to accomplish their purpose with novel targeted populations, they need to be tailored to such populations (ie, content is designed with the target population in mind). User-centered design frameworks provide a theoretical foundation for increasing user engagement and uptake by including users in development. However, deciding how to implement this approach to engage users in mental health intervention development is challenging. OBJECTIVE: The aim of this study was to get user input and feedback on acceptability of messaging content intended to engage suicidal individuals. METHODS: In March 2013, clinic intake staff distributed flyers announcing the study, "Your Feedback Counts" to potential participants (individuals waiting to be seen for a mental health appointment) together with the Patient Health Questionnaire. The flyer explained that a score of two or three ("more than half the days" or "nearly every day" respectively) on the suicide ideation question made them eligible to provide feedback on components of a suicide prevention intervention under development. The patient could access an anonymous online survey by following a link. After providing consent online, participants completed the anonymous survey. RESULTS: Thirty-four individuals provided data on past demographic information. Participants reported that they would be most drawn to an intervention where they knew that they were cared about, that was personalized, that others like them had found it helpful, and that included examples with real people. Participants preferred email invitations with subject lines expressing concern and availability of extra resources. Participants also provided feedback about a media prototype including a brand design and advertisement video for introducing the intervention. CONCLUSIONS: This paper provides one model (including development of an engagement survey, audience for an engagement survey, methods for presenting results of an engagement survey) for including target users in the development of uptake strategies for online mental health interventions.

Implementing Effective Care in a University Population Based on National Vaccination Recommendations.

Vaccines are among the most cost-effective and successful medical interventions, saving approximately 2.3 million lives annually. Unfortunately, vaccination coverage for adults remains low, leading to unnecessary and costly health consequences. An initial chart review revealed that 95% (N = 20) of students were not up to date with vaccines. In a patient survey, 100% of students (N = 21) did not recall receiving useful vaccine information, but 66.7% reported it would be helpful (≥4 of 5 on the Likert scale). Strategies supporting effective care, an Institute of Medicine quality domain, were used to address these gaps. The aim was to increase effective care in university adult students for vaccines by 30% over 90 days. The quality improvement method of Plan-Do-Study-Act cycles was used to evaluate iterative tests of change. Examining contextual elements, team and patient feedback, aggregate data, and run charts informed tests of change over 4 cycles. Core interventions included enhanced screening, vaccine shared decision-making, provider checklists, and a team engagement plan. Greater than 83% (N = 152) of students were not up to date with vaccines as per national guidelines. Over 8 weeks, the team effectively referred students for 265 of the 274 vaccines they were eligible for-an accuracy rate of 95.3%. The aim score, a mean composite score reflecting all 3 interventions, increased from 49% to 95%. Effective care for vaccine uptake increased by 83.8%-far exceeding the goal. Campus health centers and other primary care settings could benefit from adopting a similar strategy that provides clear benefits to patients and the broader community while decreasing health care costs.

Reducing Firearm Access for Suicide Prevention: Implementation Evaluation of the Web-Based "Lock to Live" Decision Aid in Routine Health Care Encounters.

Background: "Lock to Live" (L2L) is a novel web-based decision aid for helping people at risk of suicide reduce access to firearms. Researchers have demonstrated that L2L is feasible to use and acceptable to patients, but little is known about how to implement L2L during web-based mental health care and in-person contact with clinicians. Objective: The goal of this project was to support the implementation and evaluation of L2L during routine primary care and mental health specialty web-based and in-person encounters. Methods: The L2L implementation and evaluation took place at Kaiser Permanente Washington (KPWA)-a large, regional, nonprofit health care system. Three dimensions from the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) model-Reach, Adoption, and Implementation-were selected to inform and evaluate the implementation of L2L at KPWA (January 1, 2020, to December 31, 2021). Electronic health record (EHR) data were used to purposefully recruit adult patients, including firearm owners and patients reporting suicidality, to participate in semistructured interviews. Interview themes were used to facilitate L2L implementation and inform subsequent semistructured interviews with clinicians responsible for suicide risk mitigation. Audio-recorded interviews were conducted via the web, transcribed, and coded, using a rapid qualitative inquiry approach. A descriptive analysis of EHR data was performed to summarize L2L reach and adoption among patients identified at high risk of suicide. Results: The initial implementation consisted of updates for clinicians to add a URL and QR code referencing L2L to the safety planning EHR templates. Recommendations about introducing L2L were subsequently derived from the thematic analysis of semistructured interviews with patients (n=36), which included (1) "have an open conversation," (2) "validate their situation," (3) "share what to expect," (4) "make it accessible and memorable," and (5) "walk through the tool." Clinicians' interviews (n=30) showed a strong preference to have L2L included by default in the EHR-based safety planning template (in contrast to adding it manually). During the 2-year observation period, 2739 patients reported prior-month suicide attempt planning or intent and had a documented safety plan during the study period, including 745 (27.2%) who also received L2L. Over four 6-month subperiods of the observation period, L2L adoption rates increased substantially from 2% to 29% among primary care clinicians and from <1% to 48% among mental health clinicians. Conclusions: Understanding the value of L2L from users' perspectives was essential for facilitating implementation and increasing patient reach and clinician adoption. Incorporating L2L into the existing system-level, EHR-based safety plan template reduced the effort to use L2L and was likely the most impactful implementation strategy. As rising suicide rates galvanize the urgency of prevention, the findings from this project, including L2L implementation tools and strategies, will support efforts to promote safety for suicide prevention in health care nationwide.

Travel Health-Related Preparation Practices of Institutions of Higher Education and Occurrence of Health-Related Events among Undergraduate Students Studying Abroad, 2018-2021.

Background: Knowledge of specific health-related events encountered by students studying abroad and the availability and use of pre-travel healthcare for these students is lacking. Methods: Anonymous web-based questionnaires were sent to study abroad offices, student health centers, and undergraduate students after studying abroad at eight institutions of higher education in the United States and Ireland from 2018-2021. Analyses were descriptive; relative risks and 95% confidence intervals were calculated for health-related events. Results: One study abroad office required a pre-travel consultation. All student health centers had pre-travel counseling available. Among 686 students, there were 307 infectious and 1,588 non-infectious health-related issues; 12 students (2%) were hospitalized. Duration of travel and timing of a pre-travel consultation impacted the risk of health-related events. Certain mental health conditions were associated with increased risk of alcohol and drug use. Conclusion: Future studies should address the optimal timing and best practices to optimize health for students studying abroad.

Adolescents Who Do Not Endorse Risk via the Patient Health Questionnaire Before Self-Harm or Suicide.

Importance: Given that the Patient Health Questionnaire (PHQ) item 9 is commonly used to screen for risk of self-harm and suicide, it is important that clinicians recognize circumstances when at-risk adolescents may go undetected. Objective: To understand characteristics of adolescents with a history of depression who do not endorse the PHQ item 9 before a near-term intentional self-harm event or suicide. Design, Setting, and Participants: This was a retrospective cohort study design using electronic health record and claims data from January 2009 through September 2017. Settings included primary care and mental health specialty clinics across 7 integrated US health care systems. Included in the study were adolescents aged 13 to 17 years with history of depression who completed the PHQ item 9 within 30 or 90 days before self-harm or suicide. Study data were analyzed September 2022 to April 2023. Exposures: Demographic, diagnostic, treatment, and health care utilization characteristics. Main Outcome(s) and Measure(s): Responded "not at all" (score = 0) to PHQ item 9 regarding thoughts of death or self-harm within 30 or 90 days before self-harm or suicide. Results: The study included 691 adolescents (mean [SD] age, 15.3 [1.3] years; 541 female [78.3%]) in the 30-day cohort and 1024 adolescents (mean [SD] age, 15.3 [1.3] years; 791 female [77.2%]) in the 90-day cohort. A total of 197 of 691 adolescents (29%) and 330 of 1024 adolescents (32%), respectively, scored 0 before self-harm or suicide on the PHQ item 9 in the 30- and 90-day cohorts. Adolescents seen in primary care (odds ratio [OR], 1.5; 95% CI, 1.0-2.1; P = .03) and older adolescents (OR, 1.2; 95% CI, 1.0-1.3; P = .02) had increased odds of scoring 0 within 90 days of a self-harm event or suicide, and adolescents with a history of inpatient hospitalization and a mental health diagnosis had twice the odds (OR, 2.0; 95% CI, 1.3-3.0; P = .001) of scoring 0 within 30 days. Conversely, adolescents with diagnoses of eating disorders were significantly less likely to score 0 on item 9 (OR, 0.4; 95% CI, 0.2-0.8; P = .007) within 90 days. Conclusions and Relevance: Study results suggest that older age, history of an inpatient mental health encounter, or being screened in primary care were associated with at-risk adolescents being less likely to endorse having thoughts of death and self-harm on the PHQ item 9 before a self-harm event or suicide death. As use of the PHQ becomes more widespread in practice, additional research is needed for understanding reasons why many at-risk adolescents do not endorse thoughts of death and self-harm.