Psychometric properties of the BASIS-24© (Behaviour and Symptom Identification Scale-Revised) Mental Health Outcome Measure.

Objective. Outcome measurement in mental health services is an area of considerable clinical interest and policy priority. This study sought to assess the Behaviour and Symptom Identification Scale-24 (BASIS-24©), a brief, patient self-reported measure of psychopathology and functioning, in a UK sample, including establishing population norms for comparative purposes. Methods. Participants were 588 adults recruited from psychiatric inpatient, outpatient and primary care settings; and 630 adults randomly sampled from primary care lists who completed the BASIS-24©, and the Brief Symptom Inventory (BSI) at two time points. Results. BASIS-24© demonstrated adequate reliability (coefficient α values for combined clinical sample across subscales ranged from 0.75 to 0.91), validity and responsiveness to change (effect size for change of the BASIS-24© was 0.56 compared with 0.48 for BSI Global Severity Index). Population norms were established for the general population and adult in-patients (at in-take). The scale proved straightforward to complete across clinical settings. Variable rates of questionnaire distribution across clinical settings highlighted the ongoing challenge of incorporating outcome measures in clinical settings. Conclusion. BASIS-24© is a brief, easily administered, self-complete measure of mental well-being and functioning that adequately meets the requirements of reliability, validity and responsiveness to change required of an outcome measure.

Toward a national consumer survey: evaluation of the CABHS and MHSIP instruments.

This article describes a study evaluating the Consumer Assessment of Behavioral Health Survey (CABHS) and the Mental Health Statistics Improvement Program (MHSIP) surveys. The purpose of the study was to provide data that could be used to develop recommendations for an improved instrument. Subjects were 3,443 adults in six behavioral health plans. The surveys did not differ significantly in response rate or consumer burden. Both surveys reliably assessed access to treatment and aspects of appropriateness and quality. The CABHS survey reliably assessed features of the insurance plan; the MHSIP survey reliably assessed treatment outcome. Analyses of comparable items suggested which survey items had greater validity. Results are discussed in terms of consistency with earlier research using these and other consumer surveys. Implications and recommendations for survey development, quality improvement, and national policy initiatives to evaluate health plan performance are presented.

Use of consumer ratings for quality improvement in behavioral health insurance plans.

BACKGROUND: The Consumer Assessment of Behavioral Healthcare Services (CABHS) survey collects consumers' reports about their health care plans and treatment. The use of the CABHS to identify opportunities for improvement, with specific attention to how organizations have used the survey information for quality improvement, is described. METHODS: In 1998 and 1999, data were collected from five groups of adult patients in commercial health plans and five groups of adult patients in public assistance health plans with services received through four organizations (one of three managed behavioral health care organizations or a health system). Patients who received behavioral health care services during the previous year were mailed the CABHS survey. Non-respondents were contacted by telephone to complete the survey. RESULTS: Response rates ranged from 49% to 65% for commercial patient groups and from 36% to 51% for public assistance patients. Promptly getting treatment from clinicians and aspects of care most influenced by health plan policies and operations, such as access to treatment and plan administrative services, received the least positive responses, whereas questions about communication received the most positive responses. In addition, questions about access- and plan-related aspects of quality showed the most interplan variability. Three of the organizations in this study focused quality improvement efforts on access to treatment. DISCUSSION: Surveys such as the CABHS can identify aspects of the plan and treatment that are improvement priorities. Use of these data is likely to extend beyond the behavioral health plan to consumers, purchasers, regulators, and policymakers, particularly because the National Committee for Quality Assurance is encouraging behavioral health plans to use a similar survey for accreditation purposes.

Factors affecting psychiatric nurses' intention to leave their current job.

Using the National Institute for Occupational Safety and Health job stress questionnaire, the authors examined psychiatric nurses' intention to leave their job in relation to their perceived risk of assault, their job satisfaction, and their supervisory support. Respondents were 1,494 nurses (response rate, 76.5 percent) employed in 27 psychiatric hospitals in Japan. Forty-four percent reported intention to leave their job, and 89 percent of those perceived a risk of assault. Younger age, fewer previous job changes, less supervisory support, lower job satisfaction, and more perceived risk of assault were significant predictors of intention to leave. Organizational efforts are necessary to retain frontline professional staff.

Clinical status. Charting for outcomes in behavioral health.

This article summarizes the criteria that clinical outcome data must meet to be useful in the quest for empirical effectiveness data about mental health services. Although demand is high for such data, its potential usefulness is just beginning to be tapped. The mental health field presents unique challenges for implementing outcome tracking systems, for analyzing and reporting results, and for using results to improve the processes of care. Measuring outcomes will not automatically improve care or ensure quality. It may, however, provide information that will be useful in guiding efforts to improve the quality of mental health services.

A self-report symptom and problem rating scale to increase inpatients' involvement in treatment.

OBJECTIVE: The study sought to determine whether psychiatric inpatients who completed a self-report symptom and problem rating scale on admission and reviewed the results with a clinician would perceive at discharge that they had been more involved in their treatment than patients who did not complete the scale. METHODS: In a quasiexperimental design, 109 inpatients were assigned to one of three groups. Patients in one group met individually with a psychiatric resident to review their responses to the Behavior and Symptom Identification Scale (BASIS-32), a self-report outcome assessment tool. Patients' views of their difficulties were then used by the treatment team to build a therapeutic alliance and to inform treatment planning. The remaining two groups received treatment as usual by either a psychiatric resident or an attending psychiatrist. Patients' perceived involvement in decisions about their treatment, perceptions of other aspects of care, and treatment outcome were compared. RESULTS: Patients in the intervention group rated their involvement in decisions about their treatment significantly higher than patients in either of the comparison groups. Patients in the intervention group more frequently reported that they were treated with respect and dignity by the staff than did patients in the comparison group treated by attending psychiatrists. Compared with patients treated by attending psychiatrists, patients treated by residents, whether they received the intervention or not, were more likely to say that they would recommend the hospital to others. Treatment outcome did not differ among the groups. CONCLUSIONS: The results suggest that an outcome assessment tool can be used to engage patients in the treatment process.

Development of a consumer survey for behavioral health services.

A consumer survey was designed to assess the quality of mental health and substance abuse services and evaluate insurance plans that provide such services. This paper describes the development of the Consumer Assessment of Behavioral Health Services instrument, which began with a review of existing consumer satisfaction surveys and input from several groups working toward development of nationally standardized satisfaction instruments. Consumer focus groups were used to ensure that all the important domains of quality were included, and group members were interviewed to ensure that all items on the instrument were understandable. Results of a pilot test conducted with 160 consumers, 82 enrolled in Medicaid plans and 78 in commercial plans, suggested that the survey was able to distinguish between the two groups in terms of evaluations of their care and insurance plans. Future efforts will focus on further testing of larger, more diverse samples and on developing scoring and reporting formats for the survey that will be useful to consumers and purchasers in choosing behavioral health services and plans.

Assessing behavioral health outcomes in outpatient programs: reliability and validity of the BASIS-32.

The Behavior and Symptom Identification Scale (BASIS-32) was developed to assess mental health outcomes among patients with severe illness treated on inpatient programs. However, its applicability and utility to those treated in outpatient programs has not been determined. The objective of this study was to assess reliability, validity, and sensitivity to change of the BASIS-32 among mental health consumers treated in outpatient programs. A total of 407 outpatients completed the BASIS-32 and the Short Form Health Status Profile (SF-36) at the beginning of a treatment episode and again 30 to 90 days later. Outpatients reported less difficulty at intake than did inpatients, and the BASIS-32 detected statistically significant changes 30 to 90 days after beginning outpatient treatment. Factor structure and construct validity were partially confirmed on this sample of outpatient consumers. Analyses of data from a wide range of facilities and samples would add to validation efforts and to further refinement of the BASIS-32.

Implementing outcome systems: lessons from a test of the BASIS-32 and the SF-36.

With increasing pressure from third-party payers to assess client outcomes, clinical programs want to know how to implement outcome systems. This article focuses on practical and logistic questions involved in implementing an outcome assessment system in ambulatory behavioral healthcare settings. Study questions addressed outcome systems in general and the use of the Behavior and Symptom Identification Scale (BASIS-32) and the Short Form Health Status Profile (SF-36) in particular. General questions focused on obtaining provider buy-in, client consent and confidentiality, data collection methods, sampling, time points, maximizing client participation, clinical utility of outcome data, and resources needed for outcome assessment. Measure-specific questions focused on client acceptability of the instruments and applicability of measures to diverse populations. The article suggests several strategies for enhancing outcome assessment efforts and concludes that there remains a need for further understanding of ways to maximize the utility and value of outcome measurement.

Assessing the quality of psychiatric care: research methods and application in clinical practice.

The drive to contain the costs of health care in the United States is focusing attention on how quality of care is affected. This article discusses research methods for assessing the quality of psychiatric care and reviews findings from some major studies evaluating care. These findings are mixed, highlighting areas in which quality of care is less than optimal, as well as the importance of continued research and the need to develop better research methods. Evidence-based criteria and more-sensitive risk-adjustment techniques must be employed if data on quality are to yield fair comparisons among health plans. The challenge is to refine the methods now in use at both the research and clinical levels, so that better-quality assessments can be made for policy formulation, physician education, and consumer choice.

Assessing outcomes in clinical practice.

We are witnessing a remarkable explosion in interest and activity in quantifying outcomes and using these measures to enhance the value of clinical care. Outcomes assessment has become an imperative for clinical practice. This paper first will offer criteria for an ideal system of outcomes assessment. The paper will then review the principal domains of assessment for psychiatric practice and provide examples of instruments available in each domain. We will then describe the use of two instruments, one for clinical outcome and one for interpersonal aspects of patient satisfaction, developed and used at McLean Hospital. The relation between outcomes assessment and outcomes management will then be discussed. Finally, we will discuss the fundamental questions a clinical group or facility might consider in choosing outcomes measurement instruments.

The impact of preadmission approval and continued stay review on hospital stay and outcome among children and adolescents.

Managed care has emerged as the centerpiece of the health care industry's efforts to control costs and ensure appropriate use of hospital services. This study assesses the impact of managed care by preadmission approval and/or continued stay review on length of psychiatric hospitalization and clinical outcome of children and adolescents. The sample included 277 cases hospitalized in nine psychiatric specialty hospitals in 1990. Demographic and clinical characteristics, hospital ownership type, and preadmission approval or continued stay review were used as independent variables in a multiple regression model to predict length of stay and clinical outcome. Results indicate that the model accounted for 27% of the variance in length of stay. Previous psychiatric hospitalization and for-profit hospital status predicted longer hospitalization. Clinical outcome was not significantly predicted by the model. Managed care did not predict either length of stay or clinical outcome. Implications for health care reform are discussed.

Assessment of subjective distress by patients' self-report versus structured interview.

Comparison was made of symptom and behavior scores obtained by structured interview versus self-report using the Behavior and Symptom Identification Scale. Psychiatric hospital admissions were randomly assigned to 1 of 3 assessment groups, structured interview, self-report, or choice of procedure. Analysis indicated that patients in the self-report group reported significantly greater difficulty on 1 of 5 dimensions assessed by the scale. The results suggest that a self-report questionnaire form of the measure is a viable alternative to the structured interview.

Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation.

OBJECTIVE: The authors describe the Behavior and Symptom Identification Scale (BASIS-32), a brief patient-report measure for psychiatric outcome assessment, and present the measure's factor structure and reliability and validity data. METHODS: Using the BASIS-32, interviews were conducted with a total of 387 patients shortly after their admission to the adult inpatient services of a private not-for-profit psychiatric hospital. Six months after admission, they received a follow-up questionnaire version of the instrument. RESULTS: Factor analysis of the instrument yielded five factors, on which subscales were based: relation to self and others, daily living and role functioning, depression and anxiety, impulsive and addictive behavior, and psychosis. Internal consistency of the subscales ranged from .63 to .80. Internal consistency of the full 32-item scale was .89. Test-retest reliability ranged from .65 to .81 for the five subscales. Concurrent and discriminant validity analyses indicated that the BASIS-32 ratings successfully discriminated patients hospitalized six months after admission from those living in the community, patients working at follow-up from those not working, and patients with particular diagnoses. Follow-up ratings indicated that the BASIS-32 is sensitive to changes in symptomatology and functioning. CONCLUSIONS: The BASIS-32 provides a brief, standardized assessment of symptoms and problems from the patient's perspective. The instrument can be used for outcome assessment with most psychiatric inpatients.

Case-based reimbursement for psychiatric hospital care.

A fixed-prepayment system (case-based reimbursement) for patients initially requiring hospital-level care was evaluated for one year through an arrangement between a private nonprofit psychiatric hospital and a self-insured company desiring to provide psychiatric services to its employees. This clinical and financial experiment offered a means of containing costs while monitoring quality of care. A two-group, case-control study was undertaken of treatment outcomes at discharge, patient satisfaction with hospital care, and service use and costs during the program's first year. Compared with costs for patients in the control group, costs for those in the program were lower per patient and per admission; cumulative costs for patients requiring rehospitalization were also lower. However, costs for outpatient services for patients in the program were not calculated. Treatment outcomes and patients' satisfaction with hospital care were comparable for the two groups.

Patient outcome after transfer within a psychiatric hospital.

Patients' satisfaction with the process and outcome of transfer between units of a private psychiatric hospital and the immediate impact of the transfer were examined through chart reviews (59 patients) and interviews (29 of the 59 patients). Results suggested that most patients were satisfied with the transfer and were not adversely affected by it. Satisfaction was positively correlated with briefer hospitalization, feeling better (less anxious or depressed) after transfer, and being informed ahead of time about the program on the new unit. The adversely affected patients had fewer previous hospitalizations at the current facility, were transferred sooner after admission, and had briefer current stays. No relationship was found between adverse effects and dissatisfaction. Patients suggested that better communication, more information about the new unit, and more advance notice would be helpful.

The reliability of abuse history reports: a comparison of two inquiry formats.

We compared patients' reports about histories of physical or sexual abuse in two independent formats: the standard psychiatric intake interview at admission for inpatient treatment, and a subsequent confidential self-report survey about various forms of early childhood trauma. For 92 consecutively admitted female patients, nearly all reports of abuse histories obtained in the intake interview were consistent with later reports obtained in the survey. However, findings of no abuse history obtained in the intake format were frequently inconsistent with reports obtained in the survey, which were twice as frequent as intake reports. Gender of the intake interviewer was not related to reporting. These data suggest caution in accepting at face value initial denials of abuse histories.

Most likely to succeed: correlates of good versus poor hospital outcome in young adult inpatients.

This paper presents the findings of a study comparing disparate hospital outcomes of a young adult population. Clinical ratings of much improved and unimproved status at the time of discharge were our outcome variables. Major differences in patient characteristics associated with improvement status related to age of onset of disorder and premorbid functioning. Hospital variables yielding significant differences between the cohorts included treatment alliance on the part of patients and families, reduction in symptomatology, and diagnostic classifications. A discriminant function analysis was carried out to identify the combination of variables contributing the most to the variance. Directions for further study are explored.