Surgeon-Specific Reports in General Surgery: Establishing Benchmarks for Peer Comparison Within a Single Hospital.

BACKGROUND: Methods to assess a surgeon's individual performance based on clinically meaningful outcomes have not been fully developed, due to small numbers of adverse outcomes and wide variation in case volumes. The Achievable Benchmark of Care (ABC) method addresses these issues by identifying benchmark-setting surgeons with high levels of performance and greater case volumes. This method was used to help surgeons compare their surgical practice to that of their peers by using merged National Surgical Quality Improvement Program (NSQIP) and Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program (MBSAQIP) data to generate surgeon-specific reports. STUDY DESIGN: A retrospective cohort study at a single institution's department of surgery was conducted involving 107 surgeons (8,660 cases) over 5.5 years. Stratification of more than 32,000 CPT codes into 16 CPT clusters served as the risk adjustment. Thirty-day outcomes of interest included surgical site infection (SSI), acute kidney injury (AKI), and mortality. Performance characteristics of the ABC method were explored by examining how many surgeons were identified as benchmark-setters in view of volume and outcome rates within CPT clusters. RESULTS: For the data captured, most surgeons performed cases spanning a median of 5 CPT clusters (range 1 to 15 clusters), with a median of 26 cases (range 1 to 776 cases) and a median of 2.8 years (range 0 to 5.5 years). The highest volume surgeon for that CPT cluster set the benchmark for 6 of 16 CPT clusters for SSIs, 8 of 16 CPT clusters for AKIs, and 9 of 16 CPT clusters for mortality. CONCLUSIONS: The ABC method appears to be a sound and useful approach to identifying benchmark-setting surgeons within a single institution. Such surgeons may be able to help their peers improve their performance.

Systematic review of observational studies reveals no association between low back pain and lumbar spondylolysis with or without isthmic spondylolisthesis.

PURPOSE: The hypothesis that spondylolysis (SL) and/or isthmic spondylolisthesis (IS) cause low back pain (LBP) is widely accepted representing surgical indication in symptomatic cases. If SL/IS cause LBP, individuals with these conditions should be more prone to LBP than those without SL/IS. Therefore, the goal of the study was to assess whether the published primary data demonstrate an association between SL/IS and LBP in the general adult population. METHODS: Systematic review of published observational studies to identify any association between SL/IS and LBP in adults. The methodological quality of the cohort and case-control studies was evaluated using the Newcastle-Ottawa scale. RESULTS: Fifteen studies met inclusion criteria (one cohort, seven case-control, seven cross-sectional). Neither the cohort study nor the two highest-quality case-control studies detected an association between SL/IS and LBP; the same is true for the remaining studies. CONCLUSIONS: There is no strong or consistent association between SL/IS and LBP in epidemiological studies of the general adult population that would support a hypothesis of causation. It is possible that SL/IS coexist with LBP, and observed effects of surgery and other treatment modalities are primarily due to benign natural history and nonspecific treatment effects. We conclude that traditional surgical practice for the adult general population, in which SL/IS is assumed to be the cause of non-radicular LBP whenever the two coexist, should be reconsidered in light of epidemiological data accumulated in recent decades.

Surgeon-specific performance reports in general surgery: an observational study of initial implementation and adoption.

BACKGROUND: As national quality initiatives are increasing requirements for individual physician data, our department of surgery initiated a surgeon-specific reporting (SSR) program to assess the value of personal knowledge on individual performance quality. We sought to evaluate the use of SSR as a tool to enable surgeons to assess and improve their clinical performance, and to identify barriers to use of their reports. STUDY DESIGN: Qualitative research design involving semistructured interviews of surgeons who received performance reports derived from National Surgical Quality Improvement Program (NSQIP), Surgical Care Improvement Project (SCIP), and the Centers for Medicare and Medicaid Services (CMS) core measures and hospital administrative data. Transcripts were analyzed by the constant comparative method. RESULTS: Twenty-four of 39 surgeons (61.5%) who received their SSRs agreed to be interviewed and 23 were interviewed. About half (11 of 23) demonstrated comprehension of the data validity, accuracy, or complexity. Of these, 6 took steps to validate data or improve performance. Most respondents believed SSR would lead to performance improvement through knowledge of personal outcomes and peer comparison; however, they perceived SSR had limitations, such as small sample size and potential coding errors, and could lead to unintended consequences, such as inaccurate interpretation by others and surgeons' aversion to selecting high-risk patients. Respondents also suggested logistical improvements to reporting methods, such as report format and definitions of metrics. CONCLUSIONS: Surgeon-specific reporting has the potential to empower surgeons to improve their practice; however, more surgeons need efficient guidelines to understand the metrics. Our findings can be used to guide development of more SSR programs. Whether SSR programs lead to improvements in surgical outcomes is a matter for future research.

Are surgical trials with negative results being interpreted correctly?

BACKGROUND: Many published accounts of clinical trials report no differences between the treatment arms, while being underpowered to find differences. This study determined how the authors of these reports interpreted their findings. STUDY DESIGN: We examined 54 reports of surgical trials chosen randomly from a database of 110 influential trials conducted in 2008. Seven that reported having adequate statistical power (ß ≥ 0.9) were excluded from further analysis, as were the 32 that reported significant differences between the treatment arms. We examined the remaining 15 to see whether the authors interpreted their negative findings appropriately. Appropriate interpretations discussed the lack of power and/or called for larger studies. RESULTS: Three of the 7 trials that did not report an a priori power calculation offered inappropriate interpretations, as did 3 of the 8 trials that reported an a priori power < 0.90. However, we examined only a modest number of trial reports from 1 year. CONCLUSIONS: Negative findings in underpowered trials were often interpreted as showing the equivalence of the treatment arms with no discussion of the issue of being underpowered. This may lead clinicians to accept new treatments that have not been validated.

Trials and tribulations: the professional development of surgical trialists.

BACKGROUND: Regulatory and professional bodies issue an ever-increasing number of guidance documents on the ethics and methods of clinical trials, but the quality of clinical trials of invasive therapeutic procedures continues to be a concern. We interviewed aspiring and accomplished surgical trialists to understand how they use guidance documents and other resources in their work. METHODS: We performed a qualitative research study involving semistructured interviews of a diverse sample of 15 surgical trialists. RESULTS: Professional development as a surgical trialist was haphazard, inefficient, and marked by avoidable mistakes. Four types of resources played constructive roles: formal education; written materials on clinical trials; experience with actual trials; and interpersonal interactions with peers, experts, collaborators, and mentors. Recommendations for improvement centered on education, mentoring, networking, participating in trials, and facilitation by department chairs. CONCLUSIONS: The haphazard and unstructured nature of the current system is adding unnecessarily to the numerous challenges faced by surgical trialists.

Overcoming limits to tobacco control: using the Internet to bridge clinical and public health interventions.

Links between clinical and public health interventions are limited. Using the Internet as a delivery method provides the potential to link multiple intervention components, but this potential has not yet been realized. In this poster, we present results of a formative assessment to identify approaches to improving clinical-public health linkages.

Process of care and outcomes in patients with peripheral arterial disease.

BACKGROUND: We investigated the association of process of care measures with adverse limb and systemic events in patients with peripheral arterial disease (PAD). METHODS: We conducted a retrospective cohort study of patients with PAD, as defined by an ankle-brachial index (ABI) <0.9. The index date was defined as the date, during 1995 to 1998, when the patient was seen in the Michael E. DeBakey VA Medical Center noninvasive vascular laboratory and found to have PAD. We conducted a chart review for process of care variables starting 3 years before the index date and ending at the time of the first event or the final visit (December 31, 2001), whichever occurred first. We examined the association between PAD process of care measures, including risk factor control, and prescribing of medication, with time of the patient's first major limb event or death. RESULTS: Of the 796 patients (mean age, 65 +/- 9.9 years), 230 (28.9% experienced an adverse limb event (136 lower-extremity bypass, 94 lower-extremity amputation), and 354 (44.5%) died. Of the patients who died, 247 died without a preceding limb event. Glucose control was protective against death or a limb event with a hazard ratio (HR) of 0.74 (95% confidence limits [CL] 0.60, 0.91, P = 0.004). African Americans were at 2.8 (95% CL 1.7, 4.5) times the risk of Whites or Hispanics for an adverse limb event. However, this risk was no longer significant if their glucose was controlled. For process measures, the dispensing of PAD specific medication (HR 1.4, 95% CL 1.1, 1.7) was associated an increased risk for an adverse outcome. CONCLUSIONS: Our data suggest that glucose control is key to reducing the risk for adverse outcomes, particularly limb events in African Americans. Certain process of care measures, as markers of disease severity and disease management, are associated with poor outcomes in patients with PAD. Further work is needed to determine the role of early disease intervention to reduce poor outcomes in patients with PAD.

Open versus endovascular abdominal aortic aneurysm repair in VA hospitals.

BACKGROUND: Endovascular abdominal aortic aneurysm repair (EVAR), when compared with conventional open surgical repair, has been shown to reduce perioperative morbidity and mortality. We performed a retrospective cohort study with prospectively collected data from the Department of Veterans Affairs to examine outcomes after elective aneurysm repair. STUDY DESIGN: We studied 30-day mortality, 1-year survival, and postoperative complications in 1,904 patients who underwent elective abdominal aortic aneurysm repair (EVAR n=717 [37.7%]; open n=1,187 [62.3%]) at 123 Department of Veterans Affairs hospitals between May 1, 2001 and September 30, 2003. We investigated the influence of patient, operative, and hospital variables on outcomes. RESULTS: Patients undergoing EVAR had significantly lower 30-day (3.1% versus 5.6%, p=0.01) and 1- year mortality rates (8.7% versus 12.1%, p=0.018) than patients having open repair. EVAR was associated with a decrease in 30-day postoperative mortality (adjusted odds ratio[OR]=0.59; 95% CI=0.36, 0.99; p=0.04). The risk of perioperative complications was much less after EVAR (15.5% versus 27.7%; p<0.001; unadjusted OR 0.48; 95% CI=0.38, 0.61; p<0.001). Patients operated on at low volume hospitals (25% of entire cohort) were more likely to have had open repair (31.3% compared with 15.9% EVAR; p<0.001) and a nearly two-fold increase in adjusted 30-day mortality risk (OR=1.9; 95% CI=1.19, 2.98; p=0.006). CONCLUSIONS: In routine daily practice, veterans who undergo elective EVAR have substantially lower perioperative mortality and morbidity rates compared with patients having open repair. The benefits of a minimally invasive approach were readily apparent in this cohort, but we recommend using caution in choosing EVAR for all elective abdominal aortic aneurysm repairs until longer-term data on device durability are available.

Ethnicity and peripheral arterial disease.

OBJECTIVE: To determine whether race/ethnicity is an independent risk factor for peripheral arterial disease (PAD). PATIENTS AND METHODS: From September 2000 through August 2001, we screened patients (age > or = 55 years) for PAD within 4 primary care clinics located in the Houston, Tex, area. Variables that were bivariately associated with PAD (P< or = .05) were selected for entry into a multivariate logistic regression model to determine the independent risk factors for PAD. RESULTS: Among 403 patients (136 white, 136 African American, and 131 Latino patients, 81 of whom were Spanish speaking), the prevalence of PAD was 22.8% among African American patients, 13.7% among Latino patients, and 13.2% among white patients (P = .06). Within the multivariate model, adjusting for age, smoking status (odds ratio [OR], 2.58; 95% confidence interval [CI], 1.27-5.25), diabetes mellitus (OR, 2.98; 95% CI, 1.58-5.63), hypertension (OR, 2.58; 95% CI, 1.12-5.95), and education, African American and Latino patients were not more likely than white patients to have a diagnosis of PAD (OR 1.89, 95% CI 0.89-3.99 and OR 1.54, 95% CI 0.59-4.06, respectively). CONCLUSION: After adjusting for atherosclerotic risk factors and level of education, ethnicity was not an independent risk factor for PAD. When determining ethnic variation in outcomes among patients with PAD, efforts are needed to better understand the role of the primary care setting to reduce the burden of social inequality on health.

Familial aggregation of prostate cancer in African-Americans and white Americans.

BACKGROUND: We compared the incidence of prostate cancer in first-degree family members of African-Americans with that in white Americans. METHODS: A historical cohort design was used to enroll 330 incident cases <80 years of age that were diagnosed at the Houston VA Medical Center between June 9, 1993 and June 8, 1996. We compared incidence rates in the probands' families with the incidence rates found in contemporaneous data from the national and regional Surveillance, Epidemiology, and End-Results (SEER) program. RESULTS: Three-hundred five probands (41% African-American) had evaluable first-degree relatives (394 African-American, 527 non-African-American). The standardized incidence ratio was 1.61 overall (95% confidence interval (CI): 1.22-2.13) and did not differ between African-American and non-African-American families: 1.58 (1.05-2.29) and 1.65 (1.06-2.45) in African-Americans and non-African-Americans, respectively. CONCLUSIONS: The similar level of familial aggregation is evidence that the higher incidence of prostate cancer in African-Americans is not attributable to a higher prevalence of germline mutations predisposing to the disease.

Short-term, intermediate-term, and long-term mortality in patients hospitalized for stroke.

Cerebrovascular disease is the third leading cause of death and the primary cause of long-term disability in the United States. Although the risk factors for stroke have been well defined, less is known about stroke mortality over varying time periods within the same cohort of patients. The purpose of this study is to define rates of short-term, intermediate-term, and long-term stroke mortality among patients experiencing a first-ever hemorrhagic or ischemic stroke between 1994 and 1998. Patients were identified from the Patient Treatment Files of the Department of Veterans Affairs (VA). We included all patients who were discharged from a VA inpatient facility with a diagnosis of acute stroke. Patients were excluded from the study if they had an admission within the previous 5 years for stroke or hemiplegia. We obtained information on the patient's age, gender, and coexisting illnesses. Unadjusted and adjusted 30-day mortality rates were computed using Kaplan-Meier analyses and Cox proportional hazards regression models. The survival-dependent Cox proportional hazards regression models were run for 31-90 days and 91-365 days from the index admission date, for patients who had survived to the start of each of these time periods. Separate models were run for ischemic (n = 34,866 patients) and hemorrhagic (n = 5,442 patients) strokes. Unadjusted 30-day mortality was 8.2 and 20.5% for ischemic and hemorrhagic strokes, respectively. The adjusted 30-day mortality rate was 7.4 and 18.8% for ischemic and hemorrhagic strokes, respectively. For ischemic stroke, age 65 years and older was associated with an increased risk for short-term, intermediate-term, and long-term mortality, while chronic heart failure was associated with an increased risk for short-term and long-term mortality. For hemorrhagic stroke, age 75 years and older, malignancy, and chronic heart failure were associated with increased mortality during all three time periods. Thirty-day mortality is over two times greater following hemorrhagic stroke vs. ischemic stroke. For patients who survive 30 days after an ischemic stroke, the risk factor that remains significantly associated with long-term mortality, which may be improved with appropriate process of care, is chronic heart failure. For patients with a hemorrhagic stroke, variables that remain significantly associated with increased short-term and long-term mortality include malignant neoplasm and chronic heart failure. Information on stroke mortality is important for patients, physicians, and researchers. In addition to stroke treatment, clinicians must be able to provide families of stroke victims with appropriate prognostic information. Further work is needed to assess the impact of actual care patterns, for the above identified risk factors, on stroke prognosis over varying time periods.

A controlled trial of arthroscopic surgery for osteoarthritis of the knee.

BACKGROUND: Many patients report symptomatic relief after undergoing arthroscopy of the knee for osteoarthritis, but it is unclear how the procedure achieves this result. We conducted a randomized, placebo-controlled trial to evaluate the efficacy of arthroscopy for osteoarthritis of the knee. METHODS: A total of 180 patients with osteoarthritis of the knee were randomly assigned to receive arthroscopic débridement, arthroscopic lavage, or placebo surgery. Patients in the placebo group received skin incisions and underwent a simulated débridement without insertion of the arthroscope. Patients and assessors of outcome were blinded to the treatment-group assignment. Outcomes were assessed at multiple points over a 24-month period with the use of five self-reported scores--three on scales for pain and two on scales for function--and one objective test of walking and stair climbing. A total of 165 patients completed the trial. RESULTS: At no point did either of the intervention groups report less pain or better function than the placebo group. For example, mean (+/-SD) scores on the Knee-Specific Pain Scale (range, 0 to 100, with higher scores indicating more severe pain) were similar in the placebo, lavage, and débridement groups: 48.9+/-21.9, 54.8+/-19.8, and 51.7+/-22.4, respectively, at one year (P=0.14 for the comparison between placebo and lavage; P=0.51 for the comparison between placebo and débridement) and 51.6+/-23.7, 53.7+/-23.7, and 51.4+/-23.2, respectively, at two years (P=0.64 and P=0.96, respectively). Furthermore, the 95 percent confidence intervals for the differences between the placebo group and the intervention groups exclude any clinically meaningful difference. CONCLUSIONS: In this controlled trial involving patients with osteoarthritis of the knee, the outcomes after arthroscopic lavage or arthroscopic débridement were no better than those after a placebo procedure.