Reliability and Validity of a Two-Question Version of the World Health Organization's Alcohol, Smoking and Substance Involvement Screening Test: The ASSIST-FC.

OBJECTIVE: The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), developed for the World Health Organization (WHO), screens for risks associated with the use of tobacco, alcohol, and seven categories of drugs. Although the ASSIST has acceptable psychometric properties, it is relatively long for a screening test. This study was designed to identify a subset of questions from the full ASSIST instrument having comparable psychometric properties for the classification of low-, moderate-, and high-risk substance use. METHOD: The study used three data sets from prior studies using the WHO ASSIST. Samples 1 and 3 were obtained from WHO multisite studies conducted in seven countries. Sample 2 included patient data from a U.S.-based screening and brief intervention program that incorporated the ASSIST into its clinical protocol. Samples 1 and 2 were used to conduct psychometric analyses for combinations of ASSIST items. Sample 3 was used to estimate sensitivity, specificity, and positive and negative predictive value for a two-item ASSIST. RESULTS: Based on correlation statistics, reliability metrics, and validation analyses, a new, two-item version is proposed. The ASSIST-FC contains one question about the frequency (F) of current use and a second question about current or past concern (C) expressed by others. The ASSIST-FC demonstrates no substantial loss in reliability, validity, and predictive ability when statistically compared with the full-length ASSIST. CONCLUSIONS: The ASSIST-FC has advantages for clinical applications in settings where a brief, efficient, reliable screening test is needed to identify patients with hazardous and harmful substance use who would benefit from a brief intervention. It can also be used to identify patients who are manifesting symptoms of substance dependence that would require further diagnostic evaluation.

Development of the SBIRT checklist for observation in real-time (SCORe).

BACKGROUND AND AIMS: Screening, Brief Intervention and Referral to Treatment (SBIRT) programs have been implemented widely in medical settings, with little attention focused on how well providers adhere to evidence-based service delivery in everyday practice. The purposes of this paper were to: (1) introduce a flexible, relatively simple methodology, the SBIRT Checklist for Observation in Real-time (SCORe), to assess adherence to evidence-based practice and provide preliminary evidence supporting its criterion validity; and (2) illustrate the feasibility and potential utility of the SCORe by analyzing observations of providers within four large-scale SBIRT programs in the United States. METHODS: Eighteen potential adherence judges were trained to recognize SBIRT service elements presented in realistic taped portrayals constructed to serve as criterion coding standards. Across the four SBIRT programs, 76 providers were observed performing 388 services in three types of medical settings; emergency departments (n = 10), hospital out-patient/ambulatory clinics (n = 16) and hospital in-patient settings (n = 5). RESULTS: Across two exercises, trainees identified 81% of screening and 75% of brief intervention (BI) elements correctly; for the six FRAMES components (Feedback, Responsibility, Advice, Menu of options, Empathy, Self-efficacy), agreement ranged from 69% to 91%. Across programs, 56% of screening, 54% of brief intervention (BI) (81% of FRAMES) and 53% of referral to treatment elements were observed. Programs differed significantly in adherence [screening, P = 0.024; BI, P < 0.001; FRAMES, P < 0.001; referral to treatment (RT), P < 0.001]; medical setting differences were minimal. CONCLUSIONS: The Screening, Brief Intervention and Referral to Treatment Checklist for Observation in Real-time provides a flexible method for assessing adherence to evidence-based Screening, Brief Intervention and Referral to Treatment service protocols. Preliminary evidence supports the criterion validity, feasibility and potential utility of the Screening, Brief Intervention and Referral to Treatment Checklist for Observation in Real-time protocol.