Practical assessment of DSM-5 alcohol use disorder criteria in routine care: High test-retest reliability of an Alcohol Symptom Checklist.

BACKGROUND: Alcohol use disorder (AUD) is underdiagnosed and undertreated in medical settings, in part due to a lack of AUD assessment instruments that are reliable and practical for use in routine care. This study evaluates the test-retest reliability of a patient-report Alcohol Symptom Checklist questionnaire when it is used in routine care, including primary care and mental health specialty settings. METHODS: We performed a pragmatic test-retest reliability study using electronic health record (EHR) data from Kaiser Permanente Washington, an integrated health system in Washington state. The sample included 454 patients who reported high-risk drinking on a behavioral health screen and completed two Alcohol Symptom Checklists 1 to 21 days apart. Subgroups of these patients who completed both checklists in primary care (n = 271) or mental health settings (n = 79) were also examined. The primary measure was an Alcohol Symptom Checklist on which patients self-reported whether they experienced each of the 11 AUD criteria within the past year, as defined by the Diagnostic and Statistical Manual of Mental Disorders-5th edition (DSM-5). RESULTS: Alcohol Symptom Checklists completed in routine care and documented in EHRs had excellent test-retest reliability for measuring AUD criterion counts (ICC = 0.79, 95% CI: 0.76 to 0.82). Test-retest reliability estimates were also high and not significantly different for the subsamples of patients who completed both checklists in primary care (ICC = 0.82, 95% CI: 0.77 to 0.85) or mental health settings (ICC = 0.74, 95% CI: 0.62 to 0.83). Test-retest reliability was not moderated by having a past two-year AUD diagnosis, nor by the age or sex of the patient completing it. CONCLUSIONS: Alcohol Symptom Checklists can reliably and pragmatically assess AUD criteria in routine care among patients who screen positive for high-risk drinking. The Alcohol Symptom Checklist may be a valuable tool in supporting AUD-related care and monitoring AUD criteria longitudinally in routine primary care and mental health settings.

Practical Assessment of Alcohol Use Disorder in Routine Primary Care: Performance of an Alcohol Symptom Checklist.

BACKGROUND: Alcohol use disorder (AUD) is highly prevalent but underrecognized and undertreated in primary care settings. Alcohol Symptom Checklists can engage patients and providers in discussions of AUD-related care. However, the performance of Alcohol Symptom Checklists when they are used in routine care and documented in electronic health records (EHRs) remains unevaluated. OBJECTIVE: To evaluate the psychometric performance of an Alcohol Symptom Checklist in routine primary care. DESIGN: Cross-sectional study using item response theory (IRT) and differential item functioning analyses of measurement consistency across age, sex, race, and ethnicity. PATIENTS: Patients seen in primary care in the Kaiser Permanente Washington Healthcare System who reported high-risk drinking on the Alcohol Use Disorder Identification Test Consumption screening measure (AUDIT-C ≥ 7) and subsequently completed an Alcohol Symptom Checklist between October 2015 and February 2020. MAIN MEASURE: Alcohol Symptom Checklists with 11 items assessing AUD criteria defined in the Diagnostic and Statistical Manual for Mental Disorders, 5th edition (DSM-5), completed by patients during routine medical care and documented in EHRs. KEY RESULTS: Among 11,464 patients who screened positive for high-risk drinking and completed an Alcohol Symptom Checklist (mean age 43.6 years, 30.5% female), 54.1% reported ≥ 2 DSM-5 AUD criteria (threshold for AUD diagnosis). IRT analyses demonstrated that checklist items measured a unidimensional continuum of AUD severity. Differential item functioning was observed for some demographic subgroups but had minimal impact on accurate measurement of AUD severity, with differences between demographic subgroups attributable to differential item functioning never exceeding 0.42 points of the total symptom count (of a possible range of 0-11). CONCLUSIONS: Alcohol Symptom Checklists used in routine care discriminated AUD severity consistently with current definitions of AUD and performed equitably across age, sex, race, and ethnicity. Integrating symptom checklists into routine care may help inform clinical decision-making around diagnosing and managing AUD.

Mental health productivity monitoring in the Veterans Health Administration: Challenges and lessons learned.

Achieving quality outcomes and cost efficiency within mental health are overarching objectives of the Veterans Health Administration (VHA). The mental health care workforce has long been oriented toward the goal of high quality outcomes; however, cost efficiency has only recently been elevated into this important value equation. With increased demand for access to mental health services within the VHA, leadership sought to advance methods of determining and improving mental health provider productivity. Monitoring of productivity data may also provide data signaling the potential need for additional staffing to keep up with demand for services. This article outlines VHA's development and specification of mental health productivity policy, implementation strategies, and a discussion of challenges and lessons learned for other systems to consider in implementing productivity monitoring. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Health care cost trajectories in the year prior to and following intake into Veterans Health Administration outpatient substance use disorders treatment.

Veterans Health Administration (VHA) patients with substance use disorder (SUD) diagnoses incur significantly higher overall health care costs compared to the average annual costs of VHA patients. Because SUDs are relapsing/remitting chronic illnesses, it is important to understand how service costs shift over time in relation to active SUD treatment episodes in order to identify strategies which may enhance treatment outcomes and thereby reduce costs. The primary aim of the current study was to examine VHA health care costs derived from VHA administrative data for 330 Veterans during the years prior to and following patient entry into outpatient SUD treatment in two VHA facilities. Secondary aims were to examine the impact on treatment costs of patient diagnosis (alcohol dependence only vs. stimulant dependence) and participation in an abstinence incentive intervention. There was a significant effect of time on health care costs (p<0.001). Average total costs per patient per quarter were $2204 for quarters 1 through 3, increased significantly to $7507 in quarter 4 and $8030 in quarter 5, then decreased significantly to $3969 in quarters 6 through 8. Increases in quarter 4 and 5 were attributable to inpatient costs whereas increases in the quarters following treatment entry were attributable to outpatient costs (quarters 5-8). Overall costs for patients with alcohol dependence only were approximately 30% higher than overall costs for patients whose diagnoses included stimulant dependence, attributable to higher outpatient costs. There was no significant effect of the 8-week incentive intervention on post-treatment entry costs. Overall, entering SUD treatment corresponded to an increase in health care costs in the quarters both immediately preceding and immediately following treatment entry followed by a tapering down of costs through 12month follow-up; however, longer follow-up is needed to inform the stability of this pattern. Additional research will be needed to determine whether efforts to increase access to SUD treatment, identify patients with SUD earlier on in the course of their disorder and integrate SUD treatment services into primary care settings may assist in engaging patients in treatment prior to experiencing a mental or physical health crisis requiring inpatient treatment and thereby reduce health care costs associated with SUD diagnoses.

Perceptions of behavioral health care among veterans with substance use disorders: results from a national evaluation of mental health services in the Veterans Health Administration.

Understanding patients' perceptions of care is essential for health care systems. We examined predictors of perceptions of behavioral health care (satisfaction with care, helpfulness of care, and perceived improvement) among veterans with substance use disorders (SUD; n = 1,581) who participated in a phone survey as part of a national evaluation of mental health services in the U.S. Veterans Health Administration. In multivariate analyses, SUD specialty care utilization and higher mental health functioning were associated positively with all perceptions of care, and comorbid schizophrenia, bipolar, and PTSD were associated positively with multiple perceptions of care. Perceived helpfulness of care was associated with receipt of SUD specialty care in the prior 12 months (adjusted OR = 1.77, p<.001). Controlling for patient characteristics, satisfaction with care exhibited strong associations with perceptions of staff as supportive and empathic, whereas perceived improvement was strongly linked to the perception that staff helped patients develop goals beyond symptom management. Survey responses that account for variation in SUD patients' perceptions of care could inform and guide quality improvement efforts with this population.

Pharmacotherapy for alcohol dependence: perceived treatment barriers and action strategies among Veterans Health Administration service providers.

Although access to and consideration of pharmacological treatments for alcohol dependence are consensus standards of care, receipt of these medications by patients is generally rare and highly variable across treatment settings. The goal of the present project was to survey and interview the clinicians, managers, and pharmacists affiliated with addiction treatment programs within Veterans Health Administration (VHA) facilities to learn about their perceptions of barriers and facilitators regarding greater and more reliable consideration of pharmacological treatments for alcohol dependence. Fifty-nine participants from 19 high-adopting and 11 low-adopting facilities completed the survey (facility-level response rate = 50%) and 23 participated in a structured interview. The top 4 barriers to increased consideration and use of pharmacotherapy for alcohol dependence were consistent across high- and low-adopting facilities and included perceived low patient demand, pharmacy procedures or formulary restrictions, lack of provider skills or knowledge regarding pharmacotherapy for alcohol dependence, and lack of confidence in treatment effectiveness. Low patient demand was rated as the most important barrier for oral naltrexone and disulfiram, whereas pharmacy or formulary restrictions were rated as the most important barrier for acamprosate and extended-release naltrexone. The 4 strategies rated across low- and high-adopting facilities as most likely to facilitate consideration and use of pharmacotherapy for alcohol dependence were more education to patients about existing medications, more education to health care providers about medications, increased involvement of physicians in treatment for alcohol dependence, and more compelling research on existing medications. This knowledge provides a foundation for designing, deploying, and evaluating targeted implementation efforts.

Longer length of stay is not associated with better outcomes in VHA's substance abuse residential rehabilitation treatment programs.

Are longer stays in Veterans Health Administration (VHA) substance abuse residential rehabilitation treatment programs (SARRTPs) associated with better substance-related outcomes? To investigate, up to 50 new patients were randomly selected from each of 28 randomly selected programs (1,307 patients). The goal was to examine if patient and program average length of stay (ALOS) were associated with improvement on Addiction Severity Index (ASI) Alcohol and Drug composite scores in covariate-adjusted, multi-level regression models. Patients in programs with ALOS greater than 90 days tended to have more mental health treatment prior to the index episode and less severe substance-related symptoms, but more homelessness. At follow-up, programs longer than 90 days had the least improvement in the ASI Alcohol composite and significantly less improvement than programs with ALOSs of 15 to 30 and 31 to 45 days (both p < 0.05). Therefore, in VHA SARRTPs, ALOS greater than 90 days cannot be justified by the substance use disorder severity of the patients served or the magnitude of the clinical improvement observed.

Psychiatric correlates of medical care costs among veterans receiving mental health care.

Research on increased medical care costs associated with posttraumatic sequelae has focused on posttraumatic stress disorder (PTSD). However, the provisional diagnosis of Disorders of Extreme Stress Not Otherwise Specified (DESNOS) encompasses broader trauma-related difficulties and may be uniquely related to medical costs. We investigated whether DESNOS severity was associated with greater nonmental health medical care costs in veterans receiving mental health care. Participants were 106 men and 105 women receiving VA outpatient mental health treatment. A standardized interview assessed DESNOS severity. The dependent variables consisted of primary and specialty medical treatment costs. Sequential zero-inflated negative binomial regression was used to evaluate the variance in medical costs accounted for by DESNOS severity, controlling for PTSD severity and established predisposing, enabling, and need-based health care factors. Contrary to our hypothesis, in fully adjusted models, DESNOS severity independently added a significant amount of variance to lower specialty medical care costs, whereas PTSD did not consistently account for significant variance in medical care costs. Greater DESNOS severity appears to be associated with lower specialty medical care costs but not primary care costs. These findings may indicate that patients with DESNOS symptoms are at risk for being underreferred for specialty care.

Why health care process performance measures can have different relationships to outcomes for patients and hospitals: understanding the ecological fallacy.

Relationships between health care process performance measures (PPMs) and outcomes can differ in magnitude and even direction for patients versus higher level units (e.g., health care facilities). Such discrepancies can arise because facility-level relationships ignore PPM-outcome relationships for patients within facilities, may have different confounders than patient-level PPM-outcome relationships, and may reflect facility effect modification of patient PPM-outcome relationships. If a patient-level PPM is related to better patient outcomes, that care process should be encouraged. However, the finding in a multilevel analysis that the proportion of patients receiving PPM care across facilities nevertheless is linked to poor hospital outcomes would suggest that interventions targeting the health care facility also are needed.

Revisiting the cost-effectiveness of the COMBINE study for alcohol dependent patients: the patient perspective.

OBJECTIVE: Most cost and cost-effectiveness studies of substance abuse treatments focus on the costs to the provider/payer. Although this perspective is important, the costs incurred by patients should also be considered when evaluating treatment. This article presents estimates of patients' costs associated with the Combined Pharmacotherapies and Behavioral Interventions (COMBINE) alcohol treatments and evaluates the treatments' cost-effectiveness from the patient perspective. STUDY DESIGN: A prospective cost-effectiveness study of patients in COMBINE, a randomized controlled clinical trial of 9 alternative alcohol treatment regimens involving 1383 patients with diagnoses of primary alcohol dependence across 11 US clinic sites. We followed a microcosting approach that allowed estimation of patients' costs for specific COMBINE treatment activities. The primary clinical outcomes from COMBINE are used as indicators of treatment effectiveness. RESULTS: The average total patient time devoted to treatment ranged from about 30 hours to 46 hours. Time spent traveling to and from treatment sessions and participation in self-help meetings accounted for the largest portion of patient time costs. The cost-effectiveness results indicate that 6 of the 9 treatments were economically dominated and only 3 treatments are potentially cost-effective depending on patient's willingness to pay for the considered outcomes: medical management (MM) + placebo, MM + naltrexone, and MM + naltrexone + acamprosate. CONCLUSIONS: Few studies consider the patient's perspective in estimating costs and cost-effectiveness even though these costs may have a substantial impact on a patient's treatment choice, ability to access treatment, or treatment adherence. For this study, the choice of the most cost-effective treatment depends on the value placed on the outcomes by the patient, and the conclusions drawn by the patient may differ from that of the provider/payer.

Performance monitoring of substance use disorder interventions in the Veterans Health Administration.

BACKGROUND: Measuring and improving the quality of treatment for patients with substance use disorders are enduring challenges. METHODS: This article describes how the Veterans Affairs health care system is using incentivized performance measures to promote more effective delivery of interventions for nicotine, illegal drug, and alcohol disorders. RESULTS: The monitoring and incentive system has increased the delivery of evidence-based services, including screening for alcohol use disorders. CONCLUSIONS: Further work remains to be done to strengthen the connection between process-based measures and longer-term patient outcomes.

Evidence-based national initiatives to address tobacco use as a public health priority in the Veterans Health Administration.

Historically, the prevalence of smoking and smoking-related illnesses has been higher among veteran patients in the Veterans Health Administration (VHA) in comparison to that of the general population. Although rates of tobacco use have remained high, smoking cessation interventions continued to be greatly underutilized in VHA clinical settings just as they have been nationally. To address tobacco use as a public health priority, VHA has implemented a number of evidence-based national initiatives in recent years. This paper describes these initiatives, including: adoption of a population-health approach to smoking cessation; increased access to nicotine replacement therapy and/or smoking cessation medications; elimination of outpatient copayments for smoking cessation counseling; clinical practice guidelines; and collaboration with mental health and substance use disorder health care providers to promote integration of smoking cessation into routine treatment of psychiatric populations. The context of tobacco use among the newest veteran populations is also discussed, as well as recent efforts to evaluate the current state of smoking cessation care in VHA.

Smoking among veterans with multiple sclerosis: prevalence correlates, quit attempts, and unmet need for services.

OBJECTIVE: To describe the prevalence and correlates of smoking as well as quit attempts and unmet need for smoking cessation services in a national sample of veterans with multiple sclerosis (MS). DESIGN: Cross-sectional cohort study linking computerized medical record information to mailed survey data from 1999. SETTING: Veterans Health Administration (VHA). PARTICIPANTS: Sixty-four percent (2994/4685) of veterans with MS who received services in VHA and also returned survey questionnaires, as well as a 20% random subsample (n=569) who completed a more extensive assessment of smoking. INTERVENTIONS: Not applicable. MAIN OUTCOME MEASURES: Items assessing smoking, quit attempts, and unmet need for smoking services. RESULTS: Among all survey respondents with MS, 28.5% (95% confidence interval [CI], 26.9-30.2) endorsed current smoking. Of extended survey respondents, 54.5% (95% CI, 46.6-62.1) reported a quit attempt in the past year, and 59.0% (95% CI, 51.1-66.4) reported not getting needed services for smoking in the past year. In fully adjusted logistic regression, smoking was associated with younger age, lower levels of education, being unmarried, higher levels of physical pain, and poorer mental health. A quit attempt was associated with higher levels of education and greater pain intensity. CONCLUSIONS: Smoking among veterans with MS is common, with rates similar to those for other veterans. There is substantial need for cessation services. Cessation interventions should address correlates of smoking including pain, poorer mental health, and social isolation.

Measuring economic outcomes of alcohol treatment using the Economic Form 90.

OBJECTIVE: This article assesses the ability of the economic outcome measures in the Economic Form 90 to detect differences across levels of alcohol dependence as measured by the Alcohol Dependence Scale. METHOD: We used baseline data from the Combining Medications and Behavioral Interventions (COMBINE) Study, a large, multisite clinical trial, to assess the extent to which the economic items on the Economic Form 90 instrument can detect differences across levels of alcohol dependence. RESULTS: After adjusting for differences in demographic characteristics, the Economic Form 90 can detect significant differences across a range of dependence severity levels for the economic outcomes of inpatient medical care, emergency-department medical care, behavioral health care, being on parole or probation, and missed workdays, conditional on being employed. We did not detect significant differences across dependence severity for employment status, outpatient medical care, other criminal justice involvement, or motor vehicle accidents. CONCLUSIONS: The Economic Form 90 can identify differences in many economic outcomes associated with differing levels of alcohol dependence. This suggests that the Economic Form 90 may be useful in assessing changes in economic outcomes that result from changes in alcohol dependence.

Randomized trial of onsite versus referral primary medical care for veterans in addictions treatment.

BACKGROUND: Patients presenting for treatment of substance use disorders (SUDs) often exhibit medical comorbidities that affect functional health status and healthcare costs. Providing primary care within addictions clinics (onsite care) may improve medical and SUD treatment outcomes in this population. OBJECTIVE: The objective of this study was to compare outcomes among Veterans' Administration (VA) patients who receive medical care within the SUD clinic and those referred to a general medicine clinic at the same facility. METHODS: Veterans entering SUD treatment with a chronic medical condition and no current primary care were randomized to receive primary medical care: 1) onsite in the VA SUD clinic (n = 358), or 2) in the VA general internal medicine clinic (n = 362). Subjects were assessed at baseline and at 3, 6, and 12 months postrandomization. Intention-to-treat analyses used random-effects regression. MEASURES: Measures included SF-36 Physical and Mental Component Summaries (PCS, MCS), VA service utilization, SUD treatment retention, Addiction Severity Index (ASI) scores, 30-day abstinence, and total VA healthcare costs. RESULTS: Over the study year, patients assigned to onsite care were more likely to attend primary care (adjusted odds ratio [OR] = 2.20; 95% confidence interval [CI] = 1.53-3.15) and to remain engaged in SUD treatment at 3 months (adjusted OR = 1.36; 1.00-1.84). Overall, outcomes on the MCS (but not the PCS) and the ASI improved significantly over time but did not differ by treatment condition. Total VA healthcare costs did not differ reliably across conditions. CONCLUSIONS: Compared with referral care, providing primary care within a VA addiction clinic increased primary care access and initial SUD treatment retention but showed no effect on overall health status or costs.

Factorial designs in clinical trials: options for combination treatment studies.

OBJECTIVE: This study reviews the use of factorial designs in clinical trials investigating combinations of therapies. METHOD: Factorial designs may be used when (1) the factors are regarded as being independent or (2) the factors are thought to be complementary and a specific aim is to investigate these interactions. We describe what is meant by a factorial design and the issues that need to be addressed when using such a design. We discuss these issues in general and describe how they have been addressed in various prevention trials and in the COMBINE Study, which is a treatment trial of combinations of therapies for alcohol dependence. RESULTS: Trials of type (1) can provide substantial cost savings in conducting multiple unrelated prevention studies in the same group of participants. Such a factorial trial poses few design challenges beyond those of a standard parallel group trial. Trials of type (2) require consideration of aspects that are intrinsic to the factorial design. CONCLUSIONS: A factorial design is a useful way to examine the effects of combinations of therapies, but it poses challenges that need to be addressed in determining the appropriate sample size and in conducting interim and final statistical analyses.

Cost methodology of COMBINE.

OBJECTIVE: This article describes the methodology used in estimating the mean cost per patient of the interventions delivered in COMBINE, a randomized controlled trial (RCT) comparing pharmacotherapies and behavioral interventions for outpatient treatment of alcohol dependence. METHOD: Our methodology identifies a broad list of nonresearch activities necessary to implement the COMBINE interventions in standard clinical practice. For each activity, we include the time costs of clinical assessments and interventions by staff, the cost of space, laboratory charges and the cost of medical supplies. We also estimate the patients' time used for each of these activities. RESULTS: We present the estimated cost per activity for 15 intake assessments plus the Medical Management (MM) and Combined Behavioral Intervention (CBI) sessions for 9 of the 11 COMBINE sites. Labor costs represent the bulk of the total cost for all activities. The Form 90 AIR/ED is the most expensive intake activity both in terms of labor and space costs. The CBI session is more expensive than the MM session. CONCLUSIONS: Our methodology estimates the cost to treatment providers and to patients of implementing the COMBINE intervention in standard practice. Compared with previous methods, the prospective design of our methodology allows for higher quality data, and the detailed activity costing helps identify key cost drivers. Future analyses will present actual COMBINE intervention cost estimates based on trial data. Although this cost study is specific to the COMBINE interventions, the concepts, instruments and methods used here can be applied to any RCT.

Problems assessment for substance using psychiatric patients: development and initial psychometric evaluation.

BACKGROUND: Persons with co-occurring Axis I mental disorders and substance use disorders often experience multiple negative consequences as a result of their substance use. Because no existing measure adequately assesses these population-specific problems, we developed the Problems Assessment for Substance Using Psychiatric Patients (PASUPP). This paper describes the scale development and factor structure, and provides initial reliability and validity evidence for the PASUPP. METHODS: An initial pool of 54 items was assembled by reviewing existing measures for relevant items and generating new items. Then, 239 patients (90% male, 61% White) with documented Axis I psychiatric and current substance use disorders rated the lifetime and last 3-month occurrence of each problem, and completed additional measures of substance use and related functioning. RESULTS: Lifetime endorsements ranged from 31 to 95%, whereas 3-month endorsements ranged from 24 to 78%. Item analyses reduced the set to 50 items. The PASUPP is internally consistent (alpha = 0.97) and unidimensional. Scale validity was suggested by moderate correlation with other measures of substance problem severity. CONCLUSIONS: Promising psychometric properties are reported for a population-specific measure of substance use problems. Such a measure could be useful for initial assessments and outcome evaluations with substance using psychiatric patients.

Self-help organizations for alcohol and drug problems: toward evidence-based practice and policy.

This expert consensus statement reviews evidence on the effectiveness of drug and alcohol self-help groups and presents potential implications for clinicians, treatment program managers and policymakers. Because longitudinal studies associate self-help group involvement with reduced substance use, improved psychosocial functioning, and lessened health care costs, there are humane and practical reasons to develop self-help group supportive policies. Policies described here that could be implemented by clinicians and program managers include making greater use of empirically-validated self-help group referral methods in both specialty and non-specialty treatment settings and developing a menu of locally available self-help group options that are responsive to client's needs, preferences, and cultural background. The workgroup also offered possible self-help supportive policy options (e.g., supporting self-help clearinghouses) for state and federal decision makers. Implementing such policies could strengthen alcohol and drug self-help organizations, and thereby enhance the national response to the serious public health problem of substance abuse.