Validating risk-adjusted surgical outcomes: site visit assessment of process and structure. National VA Surgical Risk Study.

BACKGROUND: Risk-adjusted mortality and morbidity rates are often used as measures of the quality of surgical care. This study was conducted to determine the validity of risk-adjusted surgical morbidity and mortality rates as measures of quality of care by assessing the process and structure of care in surgical services with higher-than-expected and lower-than-expected risk-adjusted 30-day mortality and morbidity rates. STUDY DESIGN: A structural survey of 44 Veterans Affairs Medical Center surgical services and site visits to 20 surgical services with higher-than-expected and lower-than-expected risk-adjusted outcomes were conducted. Main outcome measures included assessment of technology and equipment, technical competence of staff, leadership, relationship with other services, monitoring of quality of care, coordination of work, relationship with affiliated institutions, and overall quality of care. RESULTS: Surgical services with lower-than-expected risk-adjusted surgical morbidity and mortality rates had significantly more equipment available in surgical intensive care units than did services with higher-than-expected outcomes (4.3 versus 2.9, p < 0.05). Site-visitor ratings of overall quality of care were significantly higher for surgical services with lower-than-expected morbidity and mortality rates (6.1 versus 4.5 for high outliers, p < 0.05); technology and equipment were rated significantly better among low-outlier services (7.1 versus 4.8 for high outliers, p < 0.001). Masked site-visit teams correctly predicted the outlier status (high versus low) of 17 of the 20 surgical services visited (p < 0.001). CONCLUSIONS: Significant differences in several dimensions of process and structure of the delivery of surgical care are associated with differences in risk-adjusted surgical morbidity and mortality rates among 44 Veterans Affairs Medical Centers.

Risk adjustment of the postoperative mortality rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study.

BACKGROUND: The National Veterans Affairs Surgical Risk Study was designed to collect reliable, valid data on patient risk and outcomes for major surgery in the Veterans Health Administration and to report comparative risk-adjusted postoperative mortality rates for surgical services in Veterans Health Administration. STUDY DESIGN: This cohort study was conducted in 44 Veterans Affairs Medical Centers. Included were 87,078 major noncardiac operations performed under general, spinal, or epidural anesthesia between October 1, 1991, and December 31, 1993. The main outcomes measure was all-cause mortality within 30 days after the index procedure. Multivariable logistic regression risk-adjustment models for all operations and for eight surgical subspecialties were developed. Risk-adjusted surgical mortality rates were expressed as observed-to-expected ratios and were compared with unadjusted 30-day postoperative mortality rates. RESULTS: Patient risk factors predictive of postoperative mortality included serum albumin level, American Society of Anesthesia class, emergency operation, and 31 additional preoperative variables. Considerable variability in unadjusted mortality rates for all operations was observed across the 44 hospitals (1.2-5.4%). After risk adjustment, observed-to-expected ratios ranged from 0.49 to 1.53. Rank order correlation of the hospitals by unadjusted and risk-adjusted mortality rates for all operations was 0.64. Ninety-three percent of the hospitals changed rank after risk adjustment, 50% by more than 5 and 25% by more than 10. CONCLUSIONS: The Department of Veterans Affairs has successfully implemented a system for the prospective collection and comparative reporting of risk-adjusted postoperative mortality rates after major noncardiac operations. Risk adjustment had an appreciable impact on the rank ordering of the hospitals and provided a means for monitoring and potentially improving the quality of surgical care.

Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care: results of the National Veterans Affairs Surgical Risk Study.

BACKGROUND: The National Veterans Affairs Surgical Risk Study was designed to collect reliable, valid data on patient risk and outcomes for major surgery in the Veterans Health Administration and to report comparative risk-adjusted postoperative mortality and morbidity rates for surgical services in the Veterans Health Administration. STUDY DESIGN: This was a cohort study conducted at 44 Veterans Affairs Medical Centers closely affiliated with university medical centers. Included were 87,078 major noncardiac operations performed under general, spinal, or epidural anesthesia between October 1, 1991, and December 31, 1993. The main outcomes measures in this report are 21 postoperative adverse events (morbidities) occurring within 30 days after the index procedure. Multivariable logistic regression risk-adjustment models for all operations and for eight surgical subspecialties were developed. RESULTS: Patient risk factors predictive of postoperative morbidity included serum albumin level, American Society of Anesthesia class, the complexity of the operation, and 17 other preoperative risk variables. Wide variation in the unadjusted rates of one or more postoperative morbidities for all operations was observed across the 44 hospitals (7.4-28.4%). Risk-adjusted observed-to-expected ratios ranged from 0.49 to 1.46. The Spearman rank order correlation between the ranking of the hospitals based on unadjusted morbidity rates and risk-adjusted observed-to-expected ratios for all operations was 0.87. There was little or no correlation between the rank order of the hospitals by risk-adjusted morbidity and risk-adjusted mortality. CONCLUSIONS: The Department of Veterans Affairs has successfully implemented a system for the prospective collection and comparative reporting of postoperative mortality and morbidity rates after major noncardiac operations. Risk adjustment had only a modest effect on the rank order of the hospitals.

Dependent children and suicide of married parents.

In an attempt to analyze the relatively neglected relationship between the presence of dependent children and suicide of married parents, the suicides of both married and single persons in the Chicago-Cook County region for 1970 and 1974 were examined. Single suicides and married suicides with dependent children were compared to similar groups in the general population. It was found that while marrieds with dependent children experienced the lowest average suicide rate, they also had a larger mean number of children than the population as a whole and exhibited a tendency for having children at a very young age or children at an older age in life. These findings contradict contemporary notions that an increasing number of children in a marriage tend to inhibit suicide potential. It appears that the relationship between marital suicide and dependent children is far more complex than previously indicated and requires further research for elaboration.

The Providence Plan: prepaid health care for a voluntarily enrolled population.

In July 1979, Oregon Physicians' Service and Providence Medical Center (PMC) entered into a contract that established the Providence Plan, a prepaid health care delivery system. The most innovative feature of the plan is the method of paying for hospital service: PMC is paid a prospectively fixed amount per enrolled person per month to cover the total costs of hospital inpatient and outpatient care. From this capitation-based fund, PMC pays other hospitals for services it cannot provide directly. The Providence Plan marks the first cooperative effort in Portland between a single hospital, its active medical staff, and an insuring organization for the organization and operation of a fully functioning health care delivery system in competition with existing formal and informal delivery systems.

Medical expenditures of terminal cancer patients during the last year of life.

To measure the patterns of medical expenditures under conventional modes of cancer care for the terminally ill, we examined Blue Cross and Blue Shield Plan claims records for care during the 12 months preceding the deaths of 1,054 nonelderly patients diagnosed as having breast, colon-rectal, or lung cancer. Expenditures averaged +21,219 for the terminal year and grew exponentially as death approached, with +6,161 (29%) being spent in the final month alone. We found very few significant differences in spending or utilization by diagnosis, age, or sex of the terminal patient, but sizable differences by state of residence and between nonmetropolitan and metropolitan area residents. Our findings represent a baseline against which experience under new hospital payment strategies and alternative delivery systems might be compared.

Effect of worksite health promotion programs on employee absenteeism. A comparative analysis.

Employee absenteeism is an important economic variable that needs to be examined by occupational health nurses when evaluating worksite health promotion programs. Two of the three Blue Cross and Blue Shield Plan studies suggested that their programs acted to contain absenteeism among program participants. The worksite programs that met with success tended to be comprehensive and to have strong management support. Strengths of the three studies included the use of comparison groups and pretest measures of absenteeism in the analyses. Limitations included selection bias, subject dropout over time, limited monitoring of the program process, and the use of an analysis method that did not consider the statistical characteristics of the absenteeism variable.

School return among pregnant adolescents.

School return by adolescent mothers has been problematic. Many of the barriers to continuing education have been created by school system practices and policies. Recent administrative and court decisions are forcing changes in these traditional practices. Participants in an adolescent pregnancy program were permitted to attend their usual high school during and after pregnancy. Staff members discussed this and other educational opportunities with each eligible student and her family. More members of the program than control group reported some school attendance during the quarter of the delivery. Compared with the control group, which was permitted but not systematically encouraged to return, more program participants returned to day school following the pregnancy. Unexpectedly high rates of return to other school programs (other than day school) were reported by members of the control group. It is argued that the program effects are primarily a function of elimination of school system barriers, both formal and informal, to school return so that the subjects' already high motivation to return could be realized.

Correlates of oral contraception continuation.

PIP: A sample of 139 predominantly black, young, low-income patients who had accepted oral contraception at a publicly supported family planning clinic has been analyzed for correlates of oral contraception continuation. Interviews were conducted 10-12 months after the clinic visit; at this time 38% of the patients continued taking oral contraceptives. It was found that patients with the highest continuation rates were 18-24 years old, in the 2-3 parity group, living with their husbands, had low-parity mothers, and were able to fill prescriptions in less time with more convenient methods of transportation. Discontinuers tended to have high-parity mothers, live with parents or head their own households, and to be in the 13-17 or 25-45 year old age groups. Fear of long-term use of oral contraceptives and perceived side effects appeared to be implicated in discontinuation. The rate of discontinuation may be associated with irregular coital experience and less consistent exposure to pregnancy.^ieng

Work-site health promotion. Five-year trend in employee health care costs.

Participants in work-site health promotion programs are compared with other employees at the same work-site in terms of health care utilization as measured by insurance claims. Participants tended to incur higher health care costs than nonparticipants for the six-month period after the program began. However, a cohort analysis of one of the groups shows that participants' costs declined in relation to nonparticipants' for subsequent periods. Overall, for 4.75 years after the program, participants averaged 24% lower health care costs than nonparticipants. The imputed savings in health care costs exceeds program costs for this cohort by a factor of 1.45. The findings substantially strengthen the conclusions of other controlled studies that work-site health promotion reduces health care costs.

Self-report measures for assessing treatment outcomes in cardiac surgery patients.

Patient self-report measures are increasingly valued as outcome variables in health services research studies. In this article, the authors describe the Functional Status, Health Related Quality of Life, Life Satisfaction, and Patient Satisfaction scales included in the Processes, Structures, and Outcomes of Cardiac Surgery (PSOCS) cooperative study underway within the Department of Veterans Affairs health care system. In addition to reporting on the baseline psychometric characteristics of these instruments, the authors compared preoperative Medical Outcomes Study SF-36 data from the study patients with survey data from a probability sample of the US population and with preoperative data on cardiac surgery patients from a high volume private sector surgical practice. Descriptive analyses indicate that the SF-36 profiles for all of the cardiac patients are highly similar. The Veterans Affairs and private sector patients report diminished physical functioning, physical role functioning, and emotional role functioning as well as reduced energy relative to an age-matched comparison sample. At the same time, however, the Veterans Affairs patients evidenced lower levels of capacity on most of the SF-36 dimensions relative to the private sector patients.

Relation of surgical volume to outcome in eight common operations: results from the VA National Surgical Quality Improvement Program.

OBJECTIVE: To examine, in the Veterans Health Administration (VHA), the relation between surgical volume and outcome in eight commonly performed operations of intermediate complexity. SUMMARY BACKGROUND DATA: In multihospital health care systems such as VHA, consideration is often given to closing low-volume surgical services, with the assumption that better surgical outcomes are achieved in hospitals with larger surgical volumes. Literature data to support this assumption in intermediate-complexity operations are either limited or controversial. METHODS: The VHA National Surgical Quality Improvement Program data on nonruptured abdominal aortic aneurysmectomy, vascular infrainguinal reconstruction, carotid endarterectomy (CEA), lung lobectomy/pneumonectomy, open and laparoscopic cholecystectomy, partial colectomy, and total hip arthroplasty were used. Pearson correlation, analysis of variance, mixed effects hierarchical logistic regression, and automatic interaction detection analysis were used to assess the association of annual procedure/specialty volume with risk-adjusted 30-day death (and stroke in CEA). RESULTS: Eight major surgical procedures (68,631 operations) were analyzed. No statistically significant associations between procedure or specialty volume and 30-day mortality rate (or 30-day stroke rate in CEA) were found. CONCLUSIONS: In VHA hospitals, the procedure and surgical specialty volume in eight prevalent operations of intermediate complexity are not associated with risk-adjusted 30-day mortality rate from these operations, or with the risk-adjusted 30-day stroke rate from CEA. Volume of surgery in these operations should not be used as a surrogate for quality of surgical care.

The Department of Veterans Affairs' NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program.

OBJECTIVE: To provide reliable risk-adjusted morbidity and mortality rates after major surgery to the 123 Veterans Affairs Medical Centers (VAMCs) performing major surgery, and to use risk-adjusted outcomes in the monitoring and improvement of the quality of surgical care to all veterans. SUMMARY BACKGROUND DATA: Outcome-based comparative measures of the quality of surgical care among surgical services and surgical subspecialties have been elusive. METHODS: This study included prospective assessment of presurgical risk factors, process of care during surgery, and outcomes 30 days after surgery on veterans undergoing major surgery in 123 medical centers; development of multivariable risk-adjustment models; identification of high and low outlier facilities by observed-to-expected outcome ratios; and generation of annual reports of comparative outcomes to all surgical services in the Veterans Health Administration (VHA). RESULTS: The National VA Surgical Quality Improvement Program (NSQIP) data base includes 417,944 major surgical procedures performed between October 1, 1991, and September 30, 1997. In FY97, 11 VAMCs were low outliers for risk-adjusted observed-to-expected mortality ratios; 13 VAMCs were high outliers for risk-adjusted observed-to-expected mortality ratios. Identification of high and low outliers by unadjusted mortality rates would have ascribed an outlier status incorrectly to 25 of 39 hospitals, an error rate of 64%. Since 1994, the 30-day mortality and morbidity rates for major surgery have fallen 9% and 30%, respectively. CONCLUSIONS: Reliable, valid information on patient presurgical risk factors, process of care during surgery, and 30-day morbidity and mortality rates is available for all major surgical procedures in the 123 VAMCs performing surgery in the VHA. With this information, the VHA has established the first prospective outcome-based program for comparative assessment and enhancement of the quality of surgical care among multiple institutions for several surgical subspecialties. Key features to the success of the NSQIP are the support of the surgeons who practice in the VHA, consistent clinical definitions and data collection by dedicated nurses, a uniform nationwide informatics system, and the support of VHA administration and managerial staff.