Evaluation of a Model to Target High-risk Psychiatric Inpatients for an Intensive Postdischarge Suicide Prevention Intervention.

Importance: The months after psychiatric hospital discharge are a time of high risk for suicide. Intensive postdischarge case management, although potentially effective in suicide prevention, is likely to be cost-effective only if targeted at high-risk patients. A previously developed machine learning (ML) model showed that postdischarge suicides can be predicted from electronic health records and geospatial data, but it is unknown if prediction could be improved by adding additional information. Objective: To determine whether model prediction could be improved by adding information extracted from clinical notes and public records. Design, Setting, and Participants: Models were trained to predict suicides in the 12 months after Veterans Health Administration (VHA) short-term (less than 365 days) psychiatric hospitalizations between the beginning of 2010 and September 1, 2012 (299 050 hospitalizations, with 916 hospitalizations followed within 12 months by suicides) and tested in the hospitalizations from September 2, 2012, to December 31, 2013 (149 738 hospitalizations, with 393 hospitalizations followed within 12 months by suicides). Validation focused on net benefit across a range of plausible decision thresholds. Predictor importance was assessed with Shapley additive explanations (SHAP) values. Data were analyzed from January to August 2022. Main Outcomes and Measures: Suicides were defined by the National Death Index. Base model predictors included VHA electronic health records and patient residential data. The expanded predictors came from natural language processing (NLP) of clinical notes and a social determinants of health (SDOH) public records database. Results: The model included 448 788 unique hospitalizations. Net benefit over risk horizons between 3 and 12 months was generally highest for the model that included both NLP and SDOH predictors (area under the receiver operating characteristic curve range, 0.747-0.780; area under the precision recall curve relative to the suicide rate range, 3.87-5.75). NLP and SDOH predictors also had the highest predictor class-level SHAP values (proportional SHAP = 64.0% and 49.3%, respectively), although the single highest positive variable-level SHAP value was for a count of medications classified by the US Food and Drug Administration as increasing suicide risk prescribed the year before hospitalization (proportional SHAP = 15.0%). Conclusions and Relevance: In this study, clinical notes and public records were found to improve ML model prediction of suicide after psychiatric hospitalization. The model had positive net benefit over 3-month to 12-month risk horizons for plausible decision thresholds. Although caution is needed in inferring causality based on predictor importance, several key predictors have potential intervention implications that should be investigated in future studies.

A prospective examination of health care costs associated with posttraumatic stress disorder diagnostic status and symptom severity among veterans.

Posttraumatic stress disorder (PTSD) is associated with increased health care costs; however, most studies exploring this association use PTSD diagnostic data in administrative records, which can contain inaccurate diagnostic information and be confounded by the quantity of service use. We used a diagnostic interview to determine PTSD diagnostic status and examined associations between PTSD symptom severity and health care costs and utilization, extracted from Veteran Health Administration (VHA) administrative databases. Using a nationwide longitudinal sample of U.S. veterans with and without PTSD (N = 1,377) enrolled in VHA health care, we determined the costs and utilization of mental health and non-mental health outpatient, pharmacy, and inpatient services for 1 year following cohort enrollment. Relative to veterans without PTSD, those with PTSD had higher total health care, B = 0.47; mental health clinic care, B = 0.72; non-mental health clinic care, B = 0.30; and pharmacy costs, B = 0.72, ps < .001. More severe PTSD symptoms were associated with mental health clinic care costs, B = 0.12; non-mental health clinic care costs, B = 0.27; and higher odds of inpatient, B = 0.63, and emergency service use, B = 0.39, p < .001-p = .012. These findings indicate that veterans' PTSD status, determined by a clinician-administered semistructured diagnostic interview, was associated with higher health care costs and increased use of mental health and non-mental health clinic services. The findings also suggest that more severe PTSD is associated with increased costs and utilization, including costly emergency and inpatient utilization.

Longitudinal assessment of PTSD and illicit drug use among male and female OEF-OIF veterans.

OBJECTIVES: Posttraumatic stress disorder (PTSD) and substance use share both directional ("self-medication") and mutually-reinforcing associations over time. Research on gender differences regarding the co-occurrence of PTSD and substance use over time remains limited and largely focused on alcohol use; less is known regarding the co-occurrence of PTSD and illicit drug use, especially among veteran men vs. women. As the proportion of women in the military expands, we believe a greater focus on gender differences is warranted. METHOD: We conducted a cross-lagged panel analysis of PTSD symptoms and drug use problems using two waves of data from a large, nationwide longitudinal registry of post-9/11 veterans. Participants included 608 men and 635 women (N = 1243; Mage = 42.3; 75.2% White) who completed self-report PTSD and drug use problem questionnaires at T1 and again at T2 15-37 months later. RESULTS: Veteran men reported more severe drug use and related problems overall, yet the cross-sectional correlation between PTSD and drug use problems was strongest among drug using veteran women. In our cross-lagged models, we found that PTSD symptoms predicted future drug use problems among veteran men, whereas drug use problems predicted future PTSD symptom severity among women. CONCLUSIONS: These results support the self-medication pathway among veteran men but not women, for whom drug use problems might prolong or exacerbate PTSD symptom severity over time. These results are consistent with some emerging evidence but also provide novel insight into functional associations governing the longitudinal course of PTSD and drug use problems for men vs. women.

Toward Reduced Burden in Evidence-Based Assessment of PTSD: A Machine Learning Study.

Structured diagnostic interviews involve significant respondent burden and clinician administration time. This study examined whether we can maintain diagnostic accuracy using fewer posttraumatic stress disorder (PTSD) assessment questions. Our study included 1,265 U.S. veterans of the Afghanistan and Iraq conflicts who were assessed for PTSD using the Structured Clinical Interview for the Diagnostic and Statistical Manual of Mental Disorders, fifth edition (SCID-5). We used random forests to assess the importance of each diagnostic item in predicting a SCID-5 PTSD diagnosis. We used variable importance to rank each item and removed the lowest ranking items while maintaining ≥90% accuracy (i.e., efficiency), sensitivity, and other metrics. We eliminated six diagnostic items among the overall sample, four items among male veterans, and six items among female veterans. Our findings demonstrate that we may shorten the SCID-5 PTSD module while maintaining excellent diagnostic performance. These findings have implications for potentially reducing patient and provider burden of PTSD diagnostic assessment.

Using the World Health Organization Disability Assessment Schedule 2.0 to assess disability in veterans with posttraumatic stress disorder.

The introduction of the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) was accompanied by the elimination of the Global Assessment of Functioning (GAF) scale, which was previously used to assess functioning. Although the World Health Organization Disability Assessment Schedule, Version 2.0 (WHODAS 2.0) was offered as a measure for further study, widespread adoption of the WHODAS 2.0 has yet to occur. The lack of a standardized instrument for assessing posttraumatic stress disorder (PTSD)-related disability has important implications for disability compensation. Accordingly, this study was designed to determine and codify the utility of the WHODAS 2.0 for assessing PTSD-related disability. Veterans from several VA medical centers (N = 1109) were included. We examined PTSD using several definitions and modalities and considered results by gender and age. Across definitions and modalities, veterans with PTSD reported significantly greater WHODAS 2.0 total (large effects; all ts > 6.00; all ps < .01; all Cohen's ds > 1.03) and subscale (medium-to-large effects; all ts > 2.29; all ps < .05; all Cohen's ds > .39) scores than those without PTSD. WHODAS 2.0 scores did not vary by gender; however, younger veterans reported less disability than older veterans (small effects; all Fs > 4.30; all ps < .05; all η2s < .05). We identified 32 as the optimally efficient cutoff score for discriminating veterans with and without PTSD-related disability, although this varied somewhat by age and gender. Findings support the utility of the WHODAS 2.0 in assessing PTSD-related disability.

The Impact of Assessment Modality and Demographic Characteristics on Endorsement of Military Sexual Trauma.

OBJECTIVES: Military sexual trauma (MST) is a pervasive problem among veterans, and is associated with a host of deleterious outcomes. It is, therefore, imperative to identify individuals who have experienced MST so that they can be offered appropriate treatment. To determine how to best identify MST survivors, the current study examined how different assessment modalities might affect MST endorsement, and whether endorsement varied as a product of demographic group membership. METHODS: Data from 697 male and female veterans participating in the Veterans' After-Discharge Longitudinal Registry (Project VALOR) were used to examine how three different MST assessment modalities-the Veterans Health Administration screen, a study interview, and a study questionnaire measure-might affect MST endorsement across five different demographic variables (gender, ethnicity, sexual orientation, race, and age). Each participant was evaluated for MST exposure using each of the three assessment modalities. RESULTS: Both assessment modality and demographic membership influenced MST endorsement. MST endorsement on the study measures was consistently twice as large as on the Veterans Health Administration screen, across demographic groups. For men, MST endorsement varied by a factor of 11 across measures, with endorsement being lowest on the Veterans Health Administration screen and highest on the study questionnaire. Although differences were also detected for sexual minority and Black participants, these findings may have been better explained by gender differences. CONCLUSIONS: Both assessment modality and demographic membership substantially influenced MST endorsement. Providing a clear rationale for screening and increasing privacy around screening results, particularly for male veterans, may help to facilitate MST disclosure.

Mental Health Service Utilization before and after Receipt of a Service-Connected Disability Award for PTSD: Findings from a National Sample.

OBJECTIVE: To determine patterns of mental health service use before and after VA disability compensation awards for posttraumatic stress disorder (PTSD). DATA SOURCES: A 10 percent random sample of VHA-enrolled Veterans with new or increased PTSD service connection between 2012 and 2014 (n = 22,249). STUDY DESIGN: We used latent trajectory analysis to identify utilization patterns and multinomial logistic regression to assess associations between Veteran characteristics and trajectory membership. DATA EXTRACTION METHODS: We assessed receipt of VHA mental health encounters in each of the 52 weeks prior to and following PTSD disability rating or rating increase. PRINCIPAL FINDINGS: The best fitting model had five groups: No Use (36.6 percent), Low Use (37.7 percent), Increasing Use (9.4 percent), Decreasing Use (11.2 percent), and High Use (5.1 percent). Adjusting for demographic characteristics and compared with the No Use group, Veterans in the other groups were more likely to reside closer to a VHA facility, receive a higher PTSD disability rating, and screen positive for military sexual trauma. CONCLUSIONS: Service use remained stable (80 percent) or increased (9 percent) for the vast majority of Veterans. Service utilization declined for only 11 percent. Data did not indicate substantial service discontinuation following rating. Low VHA service utilization suggests opportunities to enhance outreach for Veterans with PTSD-related disability benefits.

The Association Between Masculinity and Nonsuicidal Self-Injury.

Several known risk factors for nonsuicidal self-injury (NSSI), such as negative emotionality and deficits in emotion skills, are also associated with masculinity. Researchers and clinicians suggest that masculine norms around emotional control and self-reliance may make men more likely to engage in self-harm. Masculinity has also been implicated as a potential risk factor for suicide and other self-damaging behaviors. However, the association between masculinity and NSSI has yet to be explored. In the current study, a sample of 912 emerging adults from two universities in the Northeastern United States completed a web-based questionnaire assessing adherence to masculine norms, engagement in NSSI, and known risk factors for NSSI (demographics and number of self-injurers known). Stronger adherence to masculine norms predicted chronic NSSI (five or more episodes throughout the life span) above and beyond other known risk factors. Adherence to masculine norms was related to methods of NSSI. Clinical implications are discussed, including discussions of masculine norms in treatment settings. Future research should examine what specific masculine norms are most closely linked to NSSI and other self-damaging behaviors.

The Primary Care PTSD Screen for DSM-5 (PC-PTSD-5): Development and Evaluation Within a Veteran Primary Care Sample.

BACKGROUND: Posttraumatic Stress Disorder (PTSD) is associated with increased health care utilization, medical morbidity, and tobacco and alcohol use. Consequently, screening for PTSD has become increasingly common in primary care clinics, especially in Veteran healthcare settings where trauma exposure among patients is common. OBJECTIVE: The objective of this study was to revise the Primary Care PTSD screen (PC-PTSD) to reflect the new Diagnostic and Statistical Manual of Mental Disorders (DSM-5) criteria for PTSD (PC-PTSD-5) and to examine both the diagnostic accuracy and the patient acceptability of the revised measure. DESIGN: We compared the PC-PTSD-5 results with those from a brief psychiatric interview for PTSD. Participants also rated screening preferences and acceptability of the PC-PTSD-5. PARTICIPANTS: A convenience sample of 398 Veterans participated in the study (response rate = 41 %). Most of the participants were male, in their 60s, and the majority identified as non-Hispanic White. MEASURES: The PC-PTSD-5 was used as the screening measure, a modified version of the PTSD module of the MINI-International Neuropsychiatric Interview was used to diagnose DSM-5 PTSD, and five brief survey items were used to assess acceptability and preferences. KEY RESULTS: The PC-PTSD-5 demonstrated excellent diagnostic accuracy (AUC = 0.941; 95 % C.I.: 0.912- 0.969). Whereas a cut score of 3 maximized sensitivity (κ[1]) = 0.93; SE = .041; 95 % C.I.: 0.849-1.00), a cut score of 4 maximized efficiency (κ[0.5] = 0.63; SE = 0.052; 95 % C.I.: 0.527-0.731), and a cut score of 5 maximized specificity (κ[0] = 0.70; SE = 0.077; 95 % C.I.: 0.550-0.853). Patients found the screen acceptable and indicated a preference for administration by their primary care providers as opposed to by other providers or via self-report. CONCLUSIONS: The PC-PTSD-5 demonstrated strong preliminary results for diagnostic accuracy, and was broadly acceptable to patients.

Sexual Health in Male and Female Iraq and Afghanistan U. S. War Veterans With and Without PTSD: Findings From the VALOR Cohort.

We sought to determine whether posttraumatic stress disorder (PTSD) was associated with sexual health in returned warzone-deployed veterans from the recent Iraq and Afghanistan conflicts. We studied 1,581 males and females from the Veterans After-Discharge Longitudinal Registry, a gender-balanced U.S. Department of Veterans Affairs registry of health care-seeking veterans with and without PTSD. Approximately one quarter (25.1%) of males (n = 198) and 12.7% of females (n = 101) had a sexual dysfunction diagnosis and/or prescription treatment for sexual dysfunction. Both genders were more likely to have a sexual dysfunction diagnosis and/or prescription treatment if they had PTSD compared with those without PTSD (male: 27.3% vs. 21.1%, p = .054; female: 14.9% vs. 9.4%, p = .022). Among the 1,557 subjects analyzed here, males with PTSD had similar levels of sexual activity compared to those without PTSD (71.2% vs. 75.4%, p = .22), whereas females with PTSD were less likely to be sexually active compared to females without PTSD (58.7% vs. 72.1%, p < .001). Participants with PTSD were also less likely to report sex-life satisfaction (male: 27.6% vs. 46.0%, p < .001; female: 23.0% vs. 45.7%, p < .001) compared with those without PTSD. Although PTSD was not associated with sexual dysfunction after adjusting for confounding factors, it was significantly negatively associated with sex-life satisfaction in female veterans with a prevalence ratio of .71, 95% confidence interval [.57, .90].

Using the WHODAS 2.0 to Assess Functioning Among Veterans Seeking Compensation for Posttraumatic Stress Disorder.

OBJECTIVE: One of the major changes in DSM-5 was removal of the Global Assessment of Functioning (GAF). To determine whether the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) is a suitable replacement for the GAF, this study compared how well the WHODAS 2.0 and the GAF measured functional impairment and other phenomena related to posttraumatic stress disorder (PTSD) among veterans applying for financial compensation (service connection) for PTSD. METHODS: Clinicians evaluating veteran claimants administered the Clinician Administered PTSD Scale (CAPS) and the WHODAS 2.0 to 177 veterans during their evaluations. Veterans also completed the Inventory of Psychosocial Functioning (IPF), a self-report measure of functional impairment, and received a GAF rating from the examiner. Actual benefit determinations and ratings were obtained. RESULTS: Confirmatory factor analyses demonstrated that the WHODAS 2.0 and the IPF were stronger indicators of a latent variable reflecting functioning compared with the GAF. In receiver operating characteristic curve analyses, the WHODAS 2.0, IPF, and GAF all displayed similar ability to identify veterans with PTSD-related impairment assessed by the CAPS. Compared with the GAF, the WHODAS 2.0 and IPF were less strongly related to PTSD symptom severity and disability ratings by the U.S. Department of Veterans Affairs, but these variables are typically influenced by GAF scores. CONCLUSIONS: The WHODAS 2.0 and IPF are acceptable replacements for the GAF and can be used to assess functional impairment among veterans seeking compensation for PTSD.

Psychosocial Functioning and Health-Related Quality of Life Associated with Posttraumatic Stress Disorder in Male and Female Iraq and Afghanistan War Veterans: The VALOR Registry.

OBJECTIVES: Iraq and Afghanistan war veterans suffer from high rates of posttraumatic stress disorder (PTSD). Given the growing number of women in the military, there is a critical need to understand the nature and extent of potential gender differences in PTSD-associated psychosocial functioning and health-related quality of life (HRQOL) in Operation Enduring Freedom (OEF)/Operation Iraqi Freedom (OIF) veterans, which has not been studied to date. METHODS: We used data from a gender-balanced national patient registry of warzone-deployed OEF/OIF veterans (Project VALOR: Veterans After-Discharge Longitudinal Registry) to determine the impact of gender on PTSD-related psychosocial functioning and HRQOL in 1,530 United States Iraq and Afghanistan war veterans (50% female) with and without PTSD. Overall psychosocial functioning was assessed with the Inventory of Psychosocial Functioning (IPF) and mental and physical HRQOL with the Veterans RAND 12-item Health Survey (VR-12) Mental and Physical Component Summary scores, respectively. Stratified linear regression models estimated gender-specific associations, controlling for demographic, deployment, and postdeployment factors. Interaction models tested for significant effect moderation by gender. RESULTS: In gender-stratified models, PTSD was strongly associated with higher IPF scores (greater functional impairment), with similar associations by gender. PTSD was also associated with lower Mental Component Summary scores (lower mental HRQOL) in both men and women, with no evidence of effect moderation by gender. PTSD was associated with lower Physical Component Summery scores in women but not men in adjusted models; however, interactions were not significant. CONCLUSION: PTSD among warzone-deployed OEF/OIF veterans is associated with significant impairments in both overall psychosocial functioning and HRQOL, with associations that are largely similar by gender. Findings support the need for thorough and continuous assessment of functional impairment and HRQOL during treatment of PTSD for both male and female OEF/OIF veterans.

Validation of the use of video teleconferencing technology in the assessment of PTSD.

The Veterans Health Administration (VHA) has promoted the use of telehealth technologies to deliver mental health care to veterans with limited access to services on account of geographic and other barriers. The use of technology to deliver interventions to veterans with posttraumatic stress disorder (PTSD) has been a particular focus within VHA. Much less attention has been paid to the use of telehealth technologies to diagnose veterans with PTSD for both treatment and/or disability compensation purposes, in spite of the need for such services. The literature evaluating the use of video teleconferencing methods in the assessment of PTSD is limited; to our knowledge, only 1 previous study has been published. The current study evaluated the psychometric characteristics of the Clinician Administered PTSD Scale (CAPS) administered by video teleconferencing with a larger and more diverse sample of veterans. The CAPS raters had high interrater reliability and there were strong correlations between face-to-face CAPS assessments and video teleconferencing CAPS assessments for diagnosis and total severity. The results suggest that the CAPS can and should be used via video teleconferencing with veterans who have barriers to face-to-face evaluations.

Racial differences in veterans' satisfaction with examination of disability from posttraumatic stress disorder.

OBJECTIVE: The examination that determines if a veteran has service-connected posttraumatic stress disorder (PTSD) affects veterans' lives for years. This study examined factors potentially associated with veterans' perception of their examination's quality. METHODS: Veterans (N=384) being evaluated for an initial PTSD service-connection claim were randomly assigned to receive either a semistructured interview or the examiner's usual interview. Immediately after the interview, veterans completed confidential ratings of the examinations' quality and of their examiners' interpersonal qualities and competence. Extensive data characterizing the veterans, the 33 participating examiners, and the examinations themselves were collected. RESULTS: Forty-seven percent of Caucasian veterans and 34% of African-American veterans rated their examination quality as excellent. African Americans were less likely than Caucasians to assign a higher quality rating (odds ratio=.61, 95% confidence interval=.38-.99, p=.047). Compared with Caucasians, African Americans rated their examiners as having significantly worse interpersonal qualities but not lower competence. Ratings were not significantly related to the veterans' age, gender, marital status, eventual diagnosis of PTSD, Global Assessment of Functioning score, the examiner's perception of the prevalence of malingering, or the presence of a third party during the examination. CONCLUSIONS: Ratings of disability examinations were generally high, although ratings were less favorable among African-American veterans than among Caucasian veterans.

Assessment of posttraumatic stress disorder-related functional impairment: a review.

In 2010, the Department of Veterans Affairs (VA) and Department of Defense (DOD) jointly published the revised VA/DOD Clinical Practice Guideline for Management of Posttraumatic Stress. The Clinical Practice Guideline (CPG) provides evidence-based recommendations for diagnosing and treating a spectrum of stress-related disorders. Included in the CPG were recommendations for assessing posttraumatic stress disorder (PTSD) and other stress disorder-related functional impairment. This article complements those CPG recommendations by providing information that may further guide clinicians in the assessment of functional impairment related to PTSD and other stress-related disorders. We briefly review some of the empirical literature on the association between PTSD and functional impairment and some of the more frequently used methods and measures for assessing functional impairment and introduce a new measure currently being developed by our group. We suggest that information obtained via patient self-report and/or clinician rating be supplemented whenever possible with collateral data from friends, family members, coworkers, or supervisors to provide a complete picture of current and premorbid functional status. Finally, we explore several important issues that we encourage clinicians to keep in mind when assessing functional impairment among Veterans and Active Duty servicemembers.

Mental health assessment in rehabilitation research.

Assessment in mental health research has evolved from focusing on symptoms and diagnosis to addressing a broad range of change, including psychosocial functioning. This is consistent with developments in the areas of psychosocial rehabilitation and the increase in recovery-oriented intervention models for mental disorders. We reviewed the status of assessment in mental health research, providing an overview of symptom and diagnostic assessment that is the cornerstone of most mental health research assessment. We then focused on measurement that can be applied across diagnostic groups and on functioning as a key mental health outcome. We reviewed the International Classification of Functioning, Disability, and Health and its implications for improvements in assessment. We provided an example of a new assessment, the Inventory of Psychosocial Functioning, which highlights key issues in the measurement of functioning. We then addressed improving research assessment, including issues of assessment in diverse populations and the need to capitalize on new data sources and new assessment technologies to advance assessment in mental health research. Finally, we reviewed and discussed areas for research and quality improvement, drawing on examples from the Department of Veterans Affairs to illustrate potential opportunities.