Performance of panel-based criteria to evaluate the appropriateness of colonoscopy: a prospective study.

BACKGROUND: Prospective data describing the appropriateness of use of colonoscopy based on detailed panel-based clinical criteria are not available. METHODS: In a cohort of 553 consecutive patients referred for colonoscopy to two university-based Swiss outpatient clinics, the percentage of patients who underwent colonoscopy for appropriate, equivocal, and inappropriate indications and the relationship between appropriateness of use and the presence of relevant endoscopic lesions was prospectively assessed. This assessment was based on criteria of the American Society for Gastrointestinal Endoscopy and explicit American and Swiss criteria developed in 1994 by a formal panel process using the RAND/UCLA appropriateness method. RESULTS: The procedures were rated appropriate or equivocal in 72.2% by criteria of the American Society for Gastrointestinal Endoscopy, in 68.5% by explicit American criteria, and in 74.4% by explicit Swiss criteria (not statistically significant, NS). Inappropriate use (overuse) of colonoscopy was found in 27.8%, 31.5%, and 25.6%, respectively (NS). The proportion of appropriate procedures was higher with increasing age. Almost all reasons for using colonoscopy could be assessed by the two explicit criteria sets, whereas 28.4% of reasons for using colonoscopy could not be evaluated by the criteria of the American Society for Gastrointestinal Endoscopy (p < 0.0001). The probability of finding a relevant endoscopic lesion was distinctly higher in the procedures rated appropriate or equivocal than in procedures judged inappropriate. CONCLUSIONS: The rate of inappropriate use of colonoscopy is substantial in Switzerland. Explicit criteria allow assessment of almost all indications encountered in clinical practice. In this study, all sets of appropriateness criteria significantly enhanced the probability of finding a relevant endoscopic lesion during colonoscopy.

Underutilization of upper gastrointestinal endoscopy.

BACKGROUND & AIMS: Efforts to reduce costs in health care may raise concerns about underuse of medical procedures. This study prospectively assessed underuse of upper gastrointestinal endoscopy in a cohort of patients in whom we have recently published data on overuse of endoscopy. METHODS: Underuse was identified by formal necessity criteria for endoscopy, obtained by an explicit panel process. Outpatients were consecutively included in two clinical settings. Setting A consisted of 20 primary care physicians and 7215 patient visits that occurred within 1 month. Setting B consisted of 920 visits that occurred during 3 weeks at an outpatient clinic. RESULTS: During these 8135 visits, 611 patients complained of upper digestive symptoms; 63 of them underwent endoscopy. Underuse was identified in 72 patients (11.8%). The two clinical situations mainly responsible for underuse of endoscopy were uninvestigated peptic symptoms resistant to treatment and dysphagia. At first follow-up, 29 of the patients with initial underuse still fulfilled criteria of necessity (underuse rate, 4.7%). One-year follow-up showed underuse of endoscopy in 5 patients. CONCLUSIONS: This prospective evidence shows that underuse of a medical procedure exists. The estimated overuse and underuse of endoscopy in this cohort were approximately equal (5%). Improving quality of care will require reductions of both overuse and underuse of medical procedures.

The appropriateness of intention to treat decisions for invasive therapy in coronary artery disease in The Netherlands.

OBJECTIVE: To determine the appropriateness of intention to treat decisions concerning coronary artery bypass grafting (CABG) and percutaneous transluminal coronary angioplasty (PTCA) for patients with coronary artery disease in The Netherlands. DESIGN: Prospective study of intention to treat decisions using a computerised expert system. SETTING: "Presentation" sessions in 10 tertiary referral heart centres in 1992. PATIENTS: 3207 consecutive patients: 1618 CABG and 1589 PTCA candidates. MAIN OUTCOME MEASURE: Percentage of invasive treatment decisions rated appropriate, uncertain, or inappropriate by the expert system. RESULTS: PTCA decisions were common for patients with one-vessel disease and CABG decisions for patients with three-vessel and left main disease. PTCA decisions outnumbered CABG decisions in acute myocardial infarction. Of CABG decisions, 84% were rated appropriate, 12% uncertain, and 4% inappropriate. The proportions for PTCA decisions were 39% appropriate, 31% uncertain, and 29% inappropriate. Type C lesion was the main determinant of inappropriateness of PTCA decisions. If type C lesions were downgraded to type A/B lesions the rate of inappropriate PTCA decisions dropped to 6%. CONCLUSIONS: Clinicians in tertiary referral centres in The Netherlands favoured CABG if vessel disease was extensive or involved the left main artery, and PTCA for patients with less extensive disease and with acute myocardial infarction. Few CABG decisions were inappropriate. The main determinant of inappropriateness of PTCA decisions was its intended use in patients with type C lesions.

Appropriateness of indications for surgery of lumbar disc hernia and spinal stenosis.

STUDY DESIGN: This prospective study examines the appropriateness of indications for surgery of herniated intervertebral disc and spinal stenosis in patients undergoing surgery in a university hospital setting. OBJECTIVE: To evaluate the appropriateness of surgery using explicit criteria developed by an expert panel in the United States. SUMMARY OF BACKGROUND DATA: The use of surgery for herniated intervertebral disc and spinal stenosis varies widely within and among countries. It has been postulated that the main reason for treatment failure is poor selection of candidates for the procedure. METHODS: The authors prospectively evaluated appropriateness of surgical indications for herniated lumbar intervertebral disc or spinal stenosis in 328 consecutive patients undergoing the operation in two university neurosurgery departments. Outcome was measured 1 year after surgery by a standardized interview. RESULTS: Indications for surgery were considered to be appropriate or equivocal in 202 (62%) patients and inappropriate in 126 (38%). Among the 126 inappropriate procedures, 66 were so rated because of insufficient activity restriction before the procedure. One year after surgery, 74% of the patients perceived the results of the operation as good or very good. CONCLUSIONS: Appropriateness as measured by the criteria established by the American panel identified a large percentage of day-to-day practice in the two surgical units as inappropriate. However, use of criteria that include new findings about lack of efficacy of bed rest probably would lower this percentage. Criteria of appropriateness of medical and surgical procedures, developed through the panel process, need to be updated regularly.

Overuse of upper gastrointestinal endoscopy in a country with open-access endoscopy: a prospective study in primary care.

BACKGROUND: This prospective observational study was aimed at evaluating the appropriateness of use of upper gastrointestinal endoscopy (UGE) in primary care in a country with open access to and high availability of the procedure. METHODS: Outpatients were consecutively included in two clinical settings: Setting A (20 primary care physicians during 4 weeks) and B (university-based outpatient clinic during 3 weeks). In patients undergoing UGE, appropriateness of referral was judged by explicit Swiss criteria developed by the RAND/UCLA panel method. RESULTS: Patient visits (8135) were assessed. Six hundred eleven patients complained of upper gastrointestinal symptoms. Physicians decided to perform UGE in 63 of these patients. Twenty-five (40%) of the endoscopies were rated appropriate, 7 (11%) equivocal, and 31 (49%) inappropriate. Overuse of UGE occurred in 5.1% (setting A: 4.7%; setting B:6.5%; p = 0.39) of the patients who presented with upper gastrointestinal symptoms. The decision to perform UGE in previously untreated dyspeptic patients was the most common clinical situation resulting in overuse. CONCLUSIONS: Inappropriate use of UGE is high in Switzerland. However, to better reflect primary care decision making, overuse should be related not only to patients referred for a medical test, but also to the number of patients who complain of the symptoms that would be investigated by the procedure.

Appropriateness and diagnostic yield of upper gastrointestinal endoscopy in an open-access endoscopy unit.

BACKGROUND AND STUDY AIMS: This prospective study tested the appropriateness of referrals for upper gastrointestinal endoscopy in an open-access endoscopy unit, using the criteria of the American Society for Gastrointestinal Endoscopy. It also examined whether there was any relationship between appropriateness of use and the presence of significant lesions detected by endoscopy. METHODS: Four hundred fifty consecutive upper gastrointestinal endoscopies were studied prospectively. The referral indication was recorded by the endoscopist before the procedure was performed, and was compared with the current criteria of the American Society for Gastrointestinal Endoscopy and with endoscopic findings. RESULTS: The appropriateness of referral was assessed in 442 consecutive endoscopies. Of these, 252 (57%) were judged to be appropriate. In 168 (88%) of the 190 endoscopies rated as inappropriate, the reason was that the patient had not undergone empirical anti-ulcer therapy before endoscopy. The probability of finding a significant lesion did not differ between the endoscopies judged to be appropriate (50%) and those judged to be inappropriate (46%) CONCLUSIONS: Upper gastrointestinal endoscopy was frequently used for inappropriate indications. The main reason for inappropriate use was insufficient treatment, or no treatment, of dyspeptic symptoms prior to endoscopy. In this study, the criteria for appropriateness did not predict the probability of finding a significant endoscopic lesion.

Effects of Medicare's prospective payment system on service use by depressed elderly inpatients.

OBJECTIVE: To determine the effects of Medicare's prospective payment system (PPS) on hospital care, changes in length of stay and intensity of clinical services received by 2,746 depressed elderly patients in 297 acute care general medical hospitals were studied. METHODS: A pre-post design was used, and differences in sickness at admission were controlled for. Data on length of stay and use of specific clinical services were obtained from the medical record using a medical record abstraction form. Care provided on units exempt from PPS was compared with care provided in nonexempt units. RESULTS: After implementation of PPS, the average length of stay fell by up to three days within the different types of acute care settings studied, but this decline was partially offset by proportionately more admissions to psychiatric units, which had longer lengths of stay. Intensity of clinical services increased after PPS implementation, especially in nonexempt psychiatric units. CONCLUSION: Despite financial incentives for hospitals to reduce clinical services under PPS, its implementation was not associated with a marked decline in length of stay, when averaged across all treatment settings, and was associated with an increase in the intensity of many clinical services used by depressed elderly patients in general hospitals.

Functional disability screening of ambulatory patients: a randomized controlled trial in a hospital-based group practice.

The authors conducted a randomized controlled trial of functional disability screening in a hospital-based internal medicine group practice. They assigned 60 physicians and 497 of their patients to either an experimental or a control group. Every four months the patients in both groups completed a self-administered questionnaire measuring physical, psychological, and social function. The experimental group physicians received reports summarizing their patients' responses; the control group physicians received no report. At the end of one year the authors found no significant difference between the patients of the experimental and control group physicians on any measure of functional status. Functional disability screening alone does not improve patient function.

Effect of panel composition on appropriateness ratings.

Cholecystectomy is performed frequently and for relatively few indications. An all surgical panel agreed on more indications and fewer contra-indications for cholecystectomy than a mixed specialty panel but did not approve indications for patients with higher comorbidity. In mixed panels subspecialists (gastroenterologists) were more conservative than generalists and surgeons. Similar findings have been shown for carotid endarterectomy. Comparing the results of British and Israeli panels showed variations in rating appropriateness that indicate differences in approach between countries. We conclude that the composition of panels will influence the assessment of appropriateness.

The medical appropriateness of tympanostomy tubes proposed for children younger than 16 years in the United States.

OBJECTIVE: To describe the clinical reasons tympanostomy tubes are proposed for children and to assess their appropriateness. DESIGN: Analysis of data previously collected prospectively by a national utilization review (UR) firm during a two-step UR process to assess the medical appropriateness of tympanostomy tube placement. Nurses interviewed otolaryngologists' and primary care physicians' office staff to collect clinical data. For a randomly selected subsample of cases found inappropriate, we reviewed subsequent interviews of the otolaryngologists by physician reviewers, who looked for possible extenuating clinical circumstances or additional clinical data that might have changed the appropriateness category. SETTING: Otolaryngologists' practices from 49 states and the District of Columbia. PATIENTS: All 6611 children younger than 16 years who were insured by three clients of the UR firm and whose proposal to receive tympanostomy tubes were reviewed by this system from January 1, 1990, through July 31, 1991. The insurance companies in the study insured 5.6 million Americans at the time of the study. MAIN OUTCOME MEASURE: The medical appropriateness of tympanostomy tube surgery according to explicit criteria developed by an expert panel using the RAND/University of California-Los Angeles modified Delphi method. RESULTS: A total of 6429 (97%) of the cases were proposed for recurrent acute otitis media, otitis media with effusion, or both. Making generous clinical assumptions, 41% of the proposals for these reasons had appropriate indications, 32% had equivocal indications, and 27% had inappropriate ones. Considering the additional information available from the subsample review, the proportion appropriate was 42%, equivocal 35%, and inappropriate 23%. CONCLUSION: About one quarter of tympanostomy tube insertions for children in this study were proposed for inappropriate indications and another third for equivocal ones.

Quality of care for hospitalized depressed elderly patients before and after implementation of the Medicare Prospective Payment System.

OBJECTIVE: The authors evaluated the impact of Medicare's Prospective Payment System on aspects of quality of care and outcomes for depressed elderly inpatients in acute-care general medical hospitals. METHOD: The depressed elderly inpatients (N = 2,746) were hospitalized in 297 acute-care general medical hospitals. The authors used a retrospective before-and-after design, controlling for differences over time in sickness at admission. Quality of care and outcomes were assessed through clinical review of explicit and implicit information in the medical records; secondary data sources provided information on postdischarge outcomes. RESULTS: After implementation of the prospective payment system 1) a higher percentage of patients had clinically appropriate acute-care admissions; 2) the initial assessment of psychological status by the treating provider was more complete; 3) the quality of psychotropic medication management, as rated by the study psychiatrists, improved; 4) the rates of any inpatient medical or psychiatric complication, of discharge to another hospital or a nursing home, and of inpatient readmission declined; and 5) there was no marked change in the percentage of patients rated by study clinicians as having acceptable overall clinical status at discharge or the rate of mortality 1 year after admission. CONCLUSIONS: After the implementation of the Medicare Prospective Payment System, the quality of care for depressed elderly inpatients improved and there was no marked increase in adverse clinical outcomes. Despite these gains, after implementation the quality of care was moderate at best and over one-third of the patients had unacceptable clinical status at discharge.

Validation of a centrally maintained computerized hospital database: comparison with operating room logbooks.

Substantial interest exists in variations in the use of surgical procedures by specific populations. Studies of this issue are often based on routinely collected data that are maintained in central computer systems. In this study a method is presented for examining the validity of such a database, which is maintained by Kupat Holim, in terms of sensitivity and positive predictive value by comparing its data to data from other information sources, such as operating room log books and in-patient medical records. The validation process was performed in Israel for three surgical procedures: cholecystectomy and prostatectomy each in four hospitals and hysterectomy in two hospitals. The sensitivity of the computerized database ranged from 90% to 98% and the positive predictive value from 96% to 99%. We conclude that the centrally maintained computerized database is a reliable source of information, however, when extremely accurate information is needed the use of complementary sources of information, e.g., operating room logbooks, is recommended.

The appropriateness of hysterectomy. A comparison of care in seven health plans. Health Maintenance Organization Quality of Care Consortium.

OBJECTIVE: To develop and test a method for comparing the appropriateness of hysterectomy use in different health plans. DESIGN: Retrospective cohort study. SETTING: Seven managed care organizations. PATIENTS: Random sample of all nonemergency, non-oncological hysterectomies performed in the seven managed care organizations over a 1-year period. Patients who were not continuously enrolled in a plan for 2 years prior to their hysterectomy were excluded. MAIN OUTCOME MEASURES: Proportion of women undergoing hysterectomy in each plan for inappropriate clinical reasons according to ratings derived from a panel of managed care physicians. RESULTS: Overall, about 16% of women underwent hysterectomy for reasons judged to be clinically inappropriate. Only one plan had significantly more hysterectomies rated inappropriate compared with the group mean (27%, unadjusted). Adjusting for age and race did not affect the rankings of the plans and had little effect on the numeric results. CONCLUSION: The rates of inappropriate use of hysterectomies are similar to those for other procedures and vary to a small degree among health plans. This information may be useful to purchasers when they consider which health plans to offer their employees.

The agreed indications and contra-indications for cholecystectomy.

Indications as to which patients should undergo cholecystectomy remain, at least in part, a matter of controversy. In 1987, a panel of nine Israeli physicians from different specialties established a list of indications for the performance of cholecystectomy based on the literature available at the time. The panel agreed that cholecystectomy was appropriate for 59 indications and that it was inappropriate for 58. The major indications for surgery were biliary colic and acute cholecystitis. Patients who were asymptomatic or had vague symptoms were not recommended to undergo surgery unless they had stones in the common bile duct and were less than 71 years of age. Patients with pancreatitis were recommended for surgery if they had stones in the common bile duct and did not have a history of alcohol abuse. Performing a cholecystectomy at the same time as abdominal surgery was being performed for other reasons was indicated only if the patient was symptomatic from his gall-stones.

Indications for cholecystectomy: the results of a consensus panel approach.

A consensus panel approach was used in Israel to develop a list of clinical indications for which there was agreement that cholecystectomy should be performed. Nine physicians from different disciplines were asked to score a list of 266 clinical indications for cholecystectomy. Each indication was scored on a scale of 1 (inappropriate, i.e. health risks exceed health benefits) to 9 (appropriate, i.e. benefits exceed risks). Each indication also included one of four comorbidity levels (none to high). Agreement and disagreement were defined and panelists met to discuss, modify and rescore the list. The composition of the panel and definitions of agreement had a considerable impact on the preparation of a list of agreed, appropriate indications for cholecystectomy. Gastroenterologists in the panel were less likely to recommend surgery than either surgeons or general internists both before and after the panel discussion. Following the discussion the level of agreement (defined as after discarding the highest and lowest score all of the remaining seven panelists were in a 3-point range) increased from 39% to 46% (p < 0.08) and disagreement decreased from 27% to 18% (p < 0.01). Fifty-nine of the 266 indications were considered appropriate with agreement.

The appropriateness of the use of cardiovascular procedures. British versus U.S. perspectives.

To determine whether patients are less likely to receive an inappropriate procedure in countries that devote fewer resources to health care than does the United States, we studied how appropriately coronary angiography and coronary artery bypass surgery were performed in the Trent region of the United Kingdom. The medical records of 320 patients who underwent coronary angiography and 319 who underwent coronary artery bypass surgery in 1987 and 1988 were randomly selected for review. Despite the United Kingdom's more limited use of coronary angiography and coronary artery bypass surgery, a substantial proportion were still performed for less than appropriate reasons, by both U.S. and U.K. criteria. Merely reducing the rate of use of these procedures will not be sufficient to eliminate such inappropriate use.

Evaluating the treatment of sexually transmitted diseases at an urban public hospital outpatient clinic.

Sexually transmitted diseases occur disproportionately among the poor, are often treated in public hospitals and clinics, and have not been subjected to quality-of-care evaluation. We designed a medical record abstraction system using well-established, specific process-of-care criteria drawn from the medical literature and experts and grouped into three levels of quality: excellent, adequate, and minimal. One hundred seventy-six consecutive patients were identified from the clinic logbook and their medical records abstracted. Deficiencies in history taking, physical examination, laboratory testing, treatment, and public health reporting were identified.

Regional differences in appropriateness of cholecystectomy in a prepaid health insurance system.

BACKGROUND: Previous studies have reported variation in the population-based use rate of diagnostic and therapeutic procedures. Cholecystectomy is one of the most common surgical procedures, and we conducted this study to assess whether in Israel the use of this procedure varied by region and whether differences in use can be related to differences in appropriateness of use. In Israel, there is a pre-paid health insurance system and all surgeons are salaried. METHODS: Age-adjusted rates of cholecystectomy in four hospitals, each serving a defined population in Israel, were calculated. Two hundred and sixty-six potential clinical indications for performing cholecystectomy were rated as to their appropriateness by a panel of 9 expert physicians. A trained team abstracted the medical records of all patients who underwent the operation in the four Israeli hospitals in 1986 (n = 702) and recorded the clinical indication for the surgery. RESULTS: The population-based age-adjusted rates of cholecystectomy varied over threefold among the four hospitals. 29% of the cholecystectomies were performed for less than appropriate reasons, and this figure varied by hospital from 36% to 17% (p = 0.002). However, appropriateness did not vary systematically with the population-based use rate. CONCLUSION: Cholecystectomy was performed frequently for inappropriate or equivocal reasons, even in a country in which resources are limited, and physicians are salaried. Efforts to improve surgical decision making should be undertaken.

Failure of physicians to recognize functional disability in ambulatory patients.

OBJECTIVE: To assess the ability of internists to identify functional disabilities reported by their patients. DESIGN: Comparison of responses by physicians and a random sample of their patients to a 12-item questionnaire about physical and social function. SETTING: A hospital-based internal medicine group practice in Boston, Massachusetts, and selected office-based internal medicine practices in Los Angeles, California. SUBJECTS: Five staff physicians, three general internal medicine fellows, and 34 internal medicine residents in the hospital-based practice and 178 of their patients. Seventy-six physicians in the office-based practices and 230 of their patients. MEASUREMENTS AND MAIN RESULTS: Physicians underestimated or failed to recognize 66% of disabilities reported by patients. Patient-reported disabilities were underestimated or unrecognized more often in the hospital-based practice than in the office-based practices (75% compared with 60%, P less than 0.05). Physicians overstated functional impairment in 21% of paired responses in which patients reported no disability. CONCLUSIONS: Physicians often underestimate or fail to recognize functional disabilities that are reported by their patients. They overstate functional impairment to a lesser degree. Because these discrepancies may adversely affect patient care and well-being, medical educators and clinicians should pay more attention to the assessment of patient function.