Use of risk-adjusted change in health status to assess the performance of integrated service networks in the Veterans Health Administration.

OBJECTIVE: Health outcome assessments have become an expectation of regulatory and accreditation agencies. We examined whether a clinically credible risk adjustment methodology for the outcome of change in health status can be developed for performance assessment of integrated service networks. STUDY DESIGN: Longitudinal study. SETTING: Outpatient. STUDY PARTICIPANTS: Thirty-one thousand eight hundred and twenty-three patients from 22 Veterans Health Administration (VHA) integrated service networks were followed for 18 months. MAIN MEASURE: The physical (PCS) and mental (MCS) component scales from the Veterans Rand 36-items Health Survey (VR-36) and mortality. The outcomes were decline in PCS (decline in PCS scores greater than -6.5 points or death) and MCS (decline in MCS scores greater than -7.9 points). RESULTS: Four thousand three hundred and twenty-eight (13.6%) patients showed a decline in PCS scores greater than -6.5 points, 4322 (13.5%) had a decline in MCS scores by more than -7.9 points, and 1737 died (5.5%). Multivariate logistic regression models were used to adjust for case-mix. The models performed reasonably well in cross-validated tests of discrimination (c-statistics = 0.72 and 0.68 for decline in PCS and MCS, respectively) and calibration. The resulting risk-adjusted rates of decline in PCS and MCS and ranks of the networks differed considerably from unadjusted ratings. CONCLUSION: It is feasible to develop clinically credible risk adjustment models for the outcomes of decline in PCS and MCS. Without adequate controls for case-mix, we could not determine whether poor patient outcomes reflect poor performance, sicker patients, or other factors. This methodology can help to measure and report the performance of health care systems.

Patient-reported measures of health: The Veterans Health Study.

The goal of the Veterans Health Study (VHS) was to extend the work of the Medical Outcomes Study (MOS) into the VA, by developing methodology for monitoring patient-based outcomes of care for use in ambulatory outpatient care. The principal objective of the VHS was developing valid and reliable measures to assess general health-related quality of life (HRQoL) and identifying the presence of selected health conditions, their severity, and their impact on HRQoL. In this article, we provide an overview of the historical context, framework, objectives, and applications of the VHS for the purpose of assessing the health outcomes of veteran patients. The VHS is a prospective observational study that has followed 2425 VA patients for up to 2 years. The patients were sampled from users of the Veterans Affairs (VA) ambulatory care system in the Boston area. The health conditions selected were hypertension, diabetes, chronic lung disease, osteoarthritis of the knee, chronic low-back pain, and alcohol-related problems. These conditions were chosen because they are both prevalent in the VA and have measurable impacts on HRQoL. One of the cornerstones of the VHS was the development of the Veterans SF-36, modified from the MOS SF-36 for use in veteran ambulatory populations. Other key accomplishments included the development of patient-based disease-specific measures of health and the establishment of methods and logistics for comprehensive health outcomes research in large health care systems such as the VA, using these patient-based measures. Selected measures developed in the VHS, eg, the Veterans SF-36, have been integrated into the VA outcomes measurement system. The scope of the VHS is unique; it resulted in the development of a broad range of patient-focused process and outcome measures, as well as methodologies for assessing large numbers of patients, that have been widely used in the VA outpatient health care system for monitoring health outcomes across the nation.