Quality of care for hospitalized depressed elderly patients before and after implementation of the Medicare Prospective Payment System.

OBJECTIVE: The authors evaluated the impact of Medicare's Prospective Payment System on aspects of quality of care and outcomes for depressed elderly inpatients in acute-care general medical hospitals. METHOD: The depressed elderly inpatients (N = 2,746) were hospitalized in 297 acute-care general medical hospitals. The authors used a retrospective before-and-after design, controlling for differences over time in sickness at admission. Quality of care and outcomes were assessed through clinical review of explicit and implicit information in the medical records; secondary data sources provided information on postdischarge outcomes. RESULTS: After implementation of the prospective payment system 1) a higher percentage of patients had clinically appropriate acute-care admissions; 2) the initial assessment of psychological status by the treating provider was more complete; 3) the quality of psychotropic medication management, as rated by the study psychiatrists, improved; 4) the rates of any inpatient medical or psychiatric complication, of discharge to another hospital or a nursing home, and of inpatient readmission declined; and 5) there was no marked change in the percentage of patients rated by study clinicians as having acceptable overall clinical status at discharge or the rate of mortality 1 year after admission. CONCLUSIONS: After the implementation of the Medicare Prospective Payment System, the quality of care for depressed elderly inpatients improved and there was no marked increase in adverse clinical outcomes. Despite these gains, after implementation the quality of care was moderate at best and over one-third of the patients had unacceptable clinical status at discharge.

The effect of comorbidity on appropriateness ratings for two gastrointestinal procedures.

We evaluated the effect of patients' comorbidity on the appropriateness of performing esophagogastroduodenoscopy or cholecystectomy. A nine-member national physician panel rated 1118 brief clinical scenarios for patients without comorbidity. Ratings were then repeated for patients with increasing degrees of comorbidity. As comorbidity changed from none to medium, 60% of those scenarios that were originally rated as appropriate for endoscopy and cholecystectomy remained appropriate. As high comorbidity was introduced, only 13% of such scenarios remained appropriate for endoscopy, while 33% remained appropriate for cholecystectomy. These findings suggest that, although clinical reasons for performing procedures are a powerful determinant of when they should be used, comorbidity is also important and needs to be included in any assessment of the appropriateness of procedure use.

Studies in geriatric education: I Developing educational objectives.

This study reports on the development of a comprehensive set of objectives for the education of undergraduates, graduates, and fellows in geriatric medicine. The objectives were derived from reviews of available educational materials and programs, and their significance was validated through consensus techniques that included over 100 workers with special expertise in geriatrics and gerontology from the United States. Canada, and the United Kingdom. A related and supplementary investigation, which also used consensus methods, uncovered ten general and disease-specific objectives considered to be essential outcomes of the education of geriatric fellows. Academic departments and specialty and subspecialty organizations should find the total set of objectives useful for planning and evaluating educational programs in geriatrics.

Studies in geriatric education: II. educational materials and programs.

There has recently been an increase in educational programs and materials in geriatrics, but their quality and content have not been adequately assessed. This study concerns important objectives and core contents in geriatric education, with a review of training programs, books, and audiovisual materials. Specific areas of need for printed and audiovisual materials are identified. Medical student and graduate level programs were found to address relatively few objectives. Geriatric fellowship programs, although having more extensive coverage, had some notable deficiencies. This information may be of use to those conducting training programs or preparing educational material in geriatrics.

The appropriateness of intention to treat decisions for invasive therapy in coronary artery disease in The Netherlands.

OBJECTIVE: To determine the appropriateness of intention to treat decisions concerning coronary artery bypass grafting (CABG) and percutaneous transluminal coronary angioplasty (PTCA) for patients with coronary artery disease in The Netherlands. DESIGN: Prospective study of intention to treat decisions using a computerised expert system. SETTING: "Presentation" sessions in 10 tertiary referral heart centres in 1992. PATIENTS: 3207 consecutive patients: 1618 CABG and 1589 PTCA candidates. MAIN OUTCOME MEASURE: Percentage of invasive treatment decisions rated appropriate, uncertain, or inappropriate by the expert system. RESULTS: PTCA decisions were common for patients with one-vessel disease and CABG decisions for patients with three-vessel and left main disease. PTCA decisions outnumbered CABG decisions in acute myocardial infarction. Of CABG decisions, 84% were rated appropriate, 12% uncertain, and 4% inappropriate. The proportions for PTCA decisions were 39% appropriate, 31% uncertain, and 29% inappropriate. Type C lesion was the main determinant of inappropriateness of PTCA decisions. If type C lesions were downgraded to type A/B lesions the rate of inappropriate PTCA decisions dropped to 6%. CONCLUSIONS: Clinicians in tertiary referral centres in The Netherlands favoured CABG if vessel disease was extensive or involved the left main artery, and PTCA for patients with less extensive disease and with acute myocardial infarction. Few CABG decisions were inappropriate. The main determinant of inappropriateness of PTCA decisions was its intended use in patients with type C lesions.

Changing practice patterns in the management of primary breast cancer: Consensus Development Program.

In the last decade, new knowledge has emerged concerning the efficacy of treatment for breast cancer. For that reason, the National Institutes of Health devoted a consensus conference to this topic. To determine whether the consensus conference had influenced practice patterns, and to evaluate the level of quality of care given to women with breast cancer, the medical records of 573 patients treated in ten hospitals throughout the state of Washington were abstracted and analyzed. Results showed no changes with respect to the consensus conference's recommendations for use of a total mastectomy with axillary dissection or the use of a two-step procedure in which the biopsy is performed first and therapeutic options are discussed before a definitive surgery is undertaken. Analyses of quality of care issues not addressed by the consensus conference revealed that 4 percent of the sample were explicitly staged preoperatively and 29 percent postoperatively and that little changed over time in the use of sentinel laboratory tests. These results also show that consensus recommendations will not necessarily change physicians' behavior even where change is possible, and that quality of care in diagnosis and treatment of breast cancer still needs to be addressed.

Appropriateness of indications for surgery of lumbar disc hernia and spinal stenosis.

STUDY DESIGN: This prospective study examines the appropriateness of indications for surgery of herniated intervertebral disc and spinal stenosis in patients undergoing surgery in a university hospital setting. OBJECTIVE: To evaluate the appropriateness of surgery using explicit criteria developed by an expert panel in the United States. SUMMARY OF BACKGROUND DATA: The use of surgery for herniated intervertebral disc and spinal stenosis varies widely within and among countries. It has been postulated that the main reason for treatment failure is poor selection of candidates for the procedure. METHODS: The authors prospectively evaluated appropriateness of surgical indications for herniated lumbar intervertebral disc or spinal stenosis in 328 consecutive patients undergoing the operation in two university neurosurgery departments. Outcome was measured 1 year after surgery by a standardized interview. RESULTS: Indications for surgery were considered to be appropriate or equivocal in 202 (62%) patients and inappropriate in 126 (38%). Among the 126 inappropriate procedures, 66 were so rated because of insufficient activity restriction before the procedure. One year after surgery, 74% of the patients perceived the results of the operation as good or very good. CONCLUSIONS: Appropriateness as measured by the criteria established by the American panel identified a large percentage of day-to-day practice in the two surgical units as inappropriate. However, use of criteria that include new findings about lack of efficacy of bed rest probably would lower this percentage. Criteria of appropriateness of medical and surgical procedures, developed through the panel process, need to be updated regularly.

Effects of Medicare's prospective payment system on service use by depressed elderly inpatients.

OBJECTIVE: To determine the effects of Medicare's prospective payment system (PPS) on hospital care, changes in length of stay and intensity of clinical services received by 2,746 depressed elderly patients in 297 acute care general medical hospitals were studied. METHODS: A pre-post design was used, and differences in sickness at admission were controlled for. Data on length of stay and use of specific clinical services were obtained from the medical record using a medical record abstraction form. Care provided on units exempt from PPS was compared with care provided in nonexempt units. RESULTS: After implementation of PPS, the average length of stay fell by up to three days within the different types of acute care settings studied, but this decline was partially offset by proportionately more admissions to psychiatric units, which had longer lengths of stay. Intensity of clinical services increased after PPS implementation, especially in nonexempt psychiatric units. CONCLUSION: Despite financial incentives for hospitals to reduce clinical services under PPS, its implementation was not associated with a marked decline in length of stay, when averaged across all treatment settings, and was associated with an increase in the intensity of many clinical services used by depressed elderly patients in general hospitals.

Setting standards of performance for program evaluations: the case of the teaching hospital general medicine group practice program.

Program evaluation is like research in its use of the scientific method. An important difference is that evaluations result in judgments of merit. What are the standards for making the judgments? Little attention has been paid to their selection and use. This article reports on how standards were set in an evaluation of the structure of fifteen of the nation's university hospitals who participated in the Teaching Hospital General Medicine Group Practice Program (sponsored by the Robert Wood Johnson Foundation). Many sources were used to select standards including a review of the literature, expert advice and actual data from two years of the programs's performance. Also, the standard-setting process was a participatory one in which all potentially competing views were provided with a forum for discussion. Finally, standards were set in advance of the collection of information, facilitating the selection of study designs and analysis techniques. Almost all project directors stated that the process helped them in program planning and gave them ideas for research and evaluation. Because standard-setting has mutual benefits, we recommend that it take place during program planning.

Results of a needs assessment strategy in developing a family practice program in an inner-city community.

The planners of an inner-city clinic and family practice residency program conducted a four-step needs assessment study to identify the importance, availability, and feasibility of local family practice services and objectives. Using mailout-mailback and supervised questionnaire data collection techniques, they contacted 1,020 consumers and providers. Those objectives rated most important and feasible and least available were given top priority for implementation, while the objectives rated important and unavailable but not currently feasible received research priorities.

Evaluating clinical programs: methodological guidelines.

Evaluations can be defined as investigations of the merits of clinical programs, and they provide information about program goals/objectives, processes, outcomes, impact, and costs. How can reliable and credible evaluations be conducted? In this article, criteria are given for posing evaluation questions; selecting samples and research designs; collecting, analyzing, interpreting, and reporting data.

Needs assessment: selecting goals for a clinical program.

The application of a needs assessment technique to create a family practice program and residency in a major teaching hospital is described. The technique relies on selecting program objectives by providing health services that are considered important by the community, feasible to obtain within its resources, and not currently available.

An evaluation of clinical services: a case study.

The success of evaluation research rests largely in its usefulness. If the sponsors of an evaluation find the data meaningful, then the limitations that the problems of evaluation invariably impose on a study's scientific origin should not be given undue emphasis. In the case of MHMC, the evaluation results were used for program planning in the hospital and for explicating the content of testimony to the California legislature about pharmacy practice in the state. Of course, it would be unthinkable to advocate weak studies and unreliable data. The evaluator must assume the responsibility of determining if and when the balance between what can be done well is tipped in favor of unsound methods. The evaluator is also responsible for judging just how important the data from the study are. How many people will be affected? Are other data available to illuminate or be used with the evaluation?. As clinical pharmacy becomes more concerned with program evaluation, it will need to address ethical and political questions like these at the same time that it answers methodological ones.

Evaluating the treatment of sexually transmitted diseases at an urban public hospital outpatient clinic.

Sexually transmitted diseases occur disproportionately among the poor, are often treated in public hospitals and clinics, and have not been subjected to quality-of-care evaluation. We designed a medical record abstraction system using well-established, specific process-of-care criteria drawn from the medical literature and experts and grouped into three levels of quality: excellent, adequate, and minimal. One hundred seventy-six consecutive patients were identified from the clinic logbook and their medical records abstracted. Deficiencies in history taking, physical examination, laboratory testing, treatment, and public health reporting were identified.

Format and conduct of consensus development conferences. Multi-nation comparison.

The consensus development conference method developed by the National Institutes of Health in the United States has been adopted and modified by a number of countries. Based on published articles and communication with representatives from each country, we examined whether the organization and conduct of these conferences in nine countries (United States, Canada, Denmark, Finland, the Netherlands, Norway, Sweden, Switzerland, and the United Kingdom) enhanced or detracted from achieving the stated conference goals and objectives. We conclude that improvements in the process by which consensus conferences are conducted may be warranted. More scientific methods for synthesizing literature, such as meta-analysis, should be used in developing inputs for the conference panel. Formalizing the decision-making processes through polling or other methods that allow for structured disagreement with parts of a consensus statement would potentially expand the range and type of issues that can be addressed in such conferences. Finally, countries should consider having the consensus statement written over a longer period of time than the traditional overnight session, which seems unlikely to promote clear thinking.

Consensus methods: characteristics and guidelines for use.

Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when properly employed, consensus strategies can create structured environments in which experts are given the best available information, allowing their solutions to problems to be more justifiable and credible than otherwise. This paper surveys the characteristics of several major methods (Delphi, Nominal Group, and models developed by the National Institutes of Health and Glaser) and provides guidelines for those who want to use the techniques. Among the concerns these guidelines address are selecting problems, choosing members for consensus panels, specifying acceptable levels of agreement, properly using empirical data, obtaining professional and political support, and disseminating results.

Validation of a centrally maintained computerized hospital database: comparison with operating room logbooks.

Substantial interest exists in variations in the use of surgical procedures by specific populations. Studies of this issue are often based on routinely collected data that are maintained in central computer systems. In this study a method is presented for examining the validity of such a database, which is maintained by Kupat Holim, in terms of sensitivity and positive predictive value by comparing its data to data from other information sources, such as operating room log books and in-patient medical records. The validation process was performed in Israel for three surgical procedures: cholecystectomy and prostatectomy each in four hospitals and hysterectomy in two hospitals. The sensitivity of the computerized database ranged from 90% to 98% and the positive predictive value from 96% to 99%. We conclude that the centrally maintained computerized database is a reliable source of information, however, when extremely accurate information is needed the use of complementary sources of information, e.g., operating room logbooks, is recommended.

The appropriateness of the use of cardiovascular procedures. British versus U.S. perspectives.

To determine whether patients are less likely to receive an inappropriate procedure in countries that devote fewer resources to health care than does the United States, we studied how appropriately coronary angiography and coronary artery bypass surgery were performed in the Trent region of the United Kingdom. The medical records of 320 patients who underwent coronary angiography and 319 who underwent coronary artery bypass surgery in 1987 and 1988 were randomly selected for review. Despite the United Kingdom's more limited use of coronary angiography and coronary artery bypass surgery, a substantial proportion were still performed for less than appropriate reasons, by both U.S. and U.K. criteria. Merely reducing the rate of use of these procedures will not be sufficient to eliminate such inappropriate use.