Development and Validation of the Agency for Healthcare Research and Quality Measures of Potentially Preventable Emergency Department (ED) Visits: The ED Prevention Quality Indicators for General Health Conditions.

OBJECTIVE: To develop and validate rates of potentially preventable emergency department (ED) visits as indicators of community health. DATA SOURCES: Agency for Healthcare Research and Quality, Healthcare Cost and Utilization Project 2008-2010 State Inpatient Databases and State Emergency Department Databases. STUDY DESIGN: Empirical analyses and structured panel reviews. METHODS: Panels of 14-17 clinicians and end users evaluated a set of ED Prevention Quality Indicators (PQIs) using a Modified Delphi process. Empirical analyses included assessing variation in ED PQI rates across counties and sensitivity of those rates to county-level poverty, uninsurance, and density of primary care physicians (PCPs). PRINCIPAL FINDINGS: ED PQI rates varied widely across U.S. communities. Indicator rates were significantly associated with county-level poverty, median income, Medicaid insurance, and levels of uninsurance. A few indicators were significantly associated with PCP density, with higher rates in areas with greater density. A clinical and an end-user panel separately rated the indicators as having strong face validity for most uses evaluated. CONCLUSIONS: The ED PQIs have undergone initial validation as indicators of community health with potential for use in public reporting, population health improvement, and research.

Hospital-Level Factors Related to 30-Day Readmission Rates.

This study investigates the relationship between inpatient quality of care as measured by the Agency for Healthcare Research and Quality (AHRQ) patient safety indicator (PSI) composite and all-cause, hospital-wide, 30-day readmission rates. Discharge data from 4 statewide databases were analyzed. Linear, repeated-measures regressions were performed to predict hospital-level 30-day readmission rates. The mean readmission rate was 12.9%, and the mean PSI composite ratio was 0.95 among 524 hospitals with 2592 observations. In the hospital-level analysis, the risk-adjusted AHRQ PSI composite was not significantly associated with hospital 30-day readmission rate after controlling for hospital-level characteristics, patient case mix, and sociodemographics. Inpatient quality of care appears to have less influence on hospital readmission rates than do clinical and socioeconomic factors. However, these results suggest that a patient safety composite measure that includes postdischarge complications would provide more information to assist hospitals and communities in understanding the association between quality of care and readmission rates.

Performance Measures in Neurosurgical Patient Care: Differing Applications of Patient Safety Indicators.

BACKGROUND: Patient Safety Indicators (PSIs) are administratively coded identifiers of potentially preventable adverse events. These indicators are used for multiple purposes, including benchmarking and quality improvement efforts. Baseline PSI evaluation in high-risk surgeries is fundamental to both purposes. OBJECTIVE: Determine PSI rates and their impact on other outcomes in patients undergoing cranial neurosurgery compared with other surgeries. RESEARCH DESIGN: The Agency for Healthcare Research and Quality (AHRQ) PSI software was used to flag adverse events and determine risk-adjusted rates (RAR). Regression models were built to assess the association between PSIs and important patient outcomes. SUBJECTS: We identified cranial neurosurgeries based on International Classification of Diseases, Ninth Revision, Clinical Modification codes in California, Florida, New York, Arkansas, and Mississippi State Inpatient Databases, AHRQ, 2010-2011. MEASURES: PSI development, 30-day all-cause readmission, length of stay, hospital costs, and inpatient mortality. RESULTS: A total of 48,424 neurosurgical patients were identified. Procedure indication was strongly associated with PSI development. The neurosurgical population had significantly higher RAR of most PSIs evaluated compared with other surgical patients. Development of a PSI was strongly associated with increased length of stay and hospital cost and, in certain PSIs, increased inpatient mortality and 30-day readmission. CONCLUSIONS: In this population-based study, certain accountability measures proposed for use as value-based payment modifiers show higher RAR in neurosurgery patients compared with other surgical patients and were subsequently associated with poor outcomes. Our results indicate that for quality improvement efforts, the current AHRQ risk-adjustment models should be viewed in clinically meaningful stratified subgroups: for profiling and pay-for-performance applications, additional factors should be included in the risk-adjustment models. Further evaluation of PSIs in additional high-risk surgeries is needed to better inform the use of these metrics.

Comparison of the Agency for Healthcare Research and Quality Patient Safety Indicator Rates Among Veteran Dual Users.

This study compares rates of 11 Agency for Healthcare Research and Quality Patient Safety Indicators (PSIs) among 266 203 veteran dual users (ie, those with hospitalizations in both the Veterans Health Administration [VA] and the private sector through Medicare fee-for-service coverage) during 2002 to 2007. PSI risk-adjusted rates were calculated using the PSI software (version 3.1a). Rates of pressure ulcer, central venous catheter-related bloodstream infections, and postoperative sepsis, areas in which the VA has focused quality improvement efforts, were found to be significantly lower in the VA than in the private sector. VA had significantly higher rates for 7 of the remaining 8 PSIs, although the rates of only 2 PSIs (postoperative hemorrhage/hematoma and accidental puncture or laceration) remained higher in the VA after sensitivity analyses were conducted. A better understanding of system-level differences in coding practices and patient severity, poorly documented in administrative data, is needed before conclusions about differences in quality can be drawn.

Consideration of ICD-9 code-derived disease-specific safety indicators in CKD.

BACKGROUND AND OBJECTIVES: The Agency for Healthcare and Research Quality patient safety indicators track adverse safety events in hospitalized patients but overlook safety incidents specific to CKD. This study considers candidate CKD-pertinent patient safety indicators and compares them with the Agency for Healthcare and Research Quality patient safety indicators. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS: Using a national Veterans Health Administration database of hospitalized veterans from fiscal year 2005, 247,160 hospitalized veterans with prehospitalization measures of renal function were retrospectively examined for proposed CKD patient safety indicators versus Agency for Healthcare and Research Quality patient safety indicators using International Classification of Diseases, Ninth Revision diagnosis codes. Candidate CKD-pertinent patient safety indicators included in-hospital acute kidney failure; in-hospital congestive heart failure (and related diagnostic codes); electrolyte disturbances; and medication errors, poisoning, and intoxication. Patients with a prehospital estimated GFR<60 ml/min per 1.73 m(2) (CKD group) were compared with a non-CKD group. For CKD patient safety indicators, hospitalizations were excluded if the admitting condition was a potential cause of the secondary condition. Regression methods were used to present adjusted rates in study groups of interest. RESULTS: The CKD patient safety indicators were generally more common than the Agency for Healthcare and Research Quality patient safety indicators in all groups, tended to occur in different patients than those patients who experienced Agency for Healthcare and Research Quality patient safety indicators, and were more common in the CKD group than the non-CKD group, except for hypoglycemia, hypokalemia, and hyponatremia. The adjusted composite CKD patient safety indicators rate (per 1000 patient-hospitalizations) was 398.0 (95% confidence interval, 391.2 to 405.0) for patients in the CKD group and 250.0 (95% confidence interval, 247.4 to 252.7) for patients in the non-CKD group. The prevalence ratio of CKD patient safety indicators to Agency for Healthcare and Research Quality patient safety indicators was 23.4 (95% confidence interval, 21.9 to 25.0). CONCLUSION: The candidate CKD patient safety indicators that occur in hospitalized patients are distinct from the Agency for Healthcare and Research Quality patient safety indicators and tend to be more common in CKD than non-CKD patients. These measures have the potential to serve as sentinel tools for identifying patients with CKD who warrant examination for disease-pertinent safety events.

Using present-on-admission coding to improve exclusion rules for quality metrics: the case of failure-to-rescue.

BACKGROUND: The Agency for Healthcare Research and Quality (AHRQ) patient safety indicator "death among surgical inpatients with serious treatable complications" (failure-to-rescue) uses rules to exclude complications presumed to be present-on-admission (POA). Like other administrative data-based quality measures, exclusion rules were developed with limited information on whether complications were POA. We examine whether the accuracy of failure-to-rescue exclusion rules can be improved with data with good POA indicators. METHODS: POA-coded data from 243,825 discharges from a large academic medical center were used to develop 3 failure-to-rescue exclusion rules. Data from 82,871 discharges from California hospitals screened for good POA coding practices was used as a validation sample. The AHRQ failure-to-rescue measure and 3 new measures based on alternative exclusion rules were compared on sensitivity, specificity, and C-statistics for prediction of POA status. Using data from the AHRQ HCUP National Inpatient Sample, the alternative specifications were tested for sensitivity to nurse staffing. RESULTS: The AHRQ exclusion rules had sensitivity of 18.5%, specificity 92.1%, and a C-statistic of 0.553. All POA-informed specifications of exclusion rules improved the C-statistic of the failure-to-rescue measure and its sensitivity, with modest losses of specificity. For all tested specifications, higher licensed hours and proportions of registered nurse were statistically significant and associated with lower risk of death. CONCLUSIONS: Failure-to-rescue is a robust quality measure, sensitive to nursing across alternative exclusion rule specifications. Despite expanded POA coding, exclusion-based rules are needed to analyze datasets not coded for POA, legacy datasets, and datasets with poor POA coding. POA-informed construction of exclusions significantly improves rules identifying POA complications.

Duration of patients' visits to the hospital emergency department.

BACKGROUND: Length of stay is an important indicator of quality of care in Emergency Departments (ED). This study explores the duration of patients' visits to the ED for which they are treated and released (T&R). METHODS: Retrospective data analysis and multivariate regression analysis were conducted to investigate the duration of T&R ED visits. Duration for each visit was computed by taking the difference between admission and discharge times. The Healthcare Cost and Utilization Project (HCUP) State Emergency Department Databases (SEDD) for 2008 were used in the analysis. RESULTS: The mean duration of T&R ED visit was 195.7 minutes. The average duration of ED visits increased from 8 a.m. until noon, then decreased until midnight at which we observed an approximately 70-minute spike in average duration. We found a substantial difference in mean duration of ED visits (over 90 minutes) between Mondays and other weekdays during the transition time from the evening of the day before to the early morning hours. Black / African American patients had a 21.4-minute longer mean duration of visits compared to white patients. The mean duration of visits at teaching hospitals was substantially longer than at non-teaching hospitals (243.8 versus 175.6 minutes). Hospitals with large bed size were associated with longer duration of visits (222.2 minutes) when compared to hospitals with small bed size (172.4 minutes) or those with medium bed size (166.5 minutes). The risk-adjusted results show that mean duration of visits on Mondays are longer by about 4 and 9 percents when compared to mean duration of visits on non-Monday workdays and weekends, respectively. CONCLUSIONS: The duration of T&R ED visits varied significantly by admission hour, day of the week, patient volume, patient characteristics, hospital characteristics and area characteristics.

Financial incentives to promote health care quality: the hospital acquired conditions nonpayment policy.

Over a decade ago it was estimated that in the United States 98,000 patients die each year from hospital acquired conditions (HAC). Recently it has been reported that this many patients now die annually from hospital acquired infections (HAI) alone. Currently, HAI affects 1.7 million U.S. citizens each year. Although these conditions are often called "preventable errors," some are associated with particular hospital and physician cultures, and many of these conditions, such as pressure ulcer formation and infections, may be a sign of low facility staffing levels. Protocols have been developed that have been shown to lower the incidence of many HAC, but these have been slow to be adopted. Voluntary reporting mechanisms to ensure health care quality are reported as having reduced effectiveness by the Joint Commission and U.S. Department of Health and Human Services, Office of Inspector General reports. Transparency and public education have also met with resistance, but in the case of infections now have the support of major national medical organizations. As a further initiative to promote quality, financial incentives have been implemented by the Centers for Medicare and Medicaid Services. Surgeons have lived under stringent financial incentives since the mid-1980s when they were placed under global surgical fees. Medicare currently must make expenditure reductions because it is at risk of becoming insolvent within the decade. Implementation of financial incentives should depend upon a balance between the nonpayment of providers for nonpreventable HAC verses the promotion of health care quality and patient safety, the reduction in patient morbidity and mortality, the spurring of mechanisms to further reduce HAC, and the recouping of taxpayer dollars for HAC that could have been prevented.

Use of psychotherapy for depression in older adults.

OBJECTIVE: The authors examine national patterns in psychotherapy for older adults with a diagnosis of depression and analyze correlates of psychotherapy use that is consistent with Agency for Health Care Policy and Research guidelines for duration of treatment. METHOD: Linked Medicare claims and survey data from the 1992-1999 Medicare Current Beneficiary Survey were used. The data were merged with the Area Resource File to assess the effect of provider-supply influences on psychotherapy treatment. An episode-of-care framework approach was used to analyze psychotherapy use and treatment duration. Multiple logistic regression analysis was used to predict psychotherapy use and its consistency. RESULTS: The authors identified 2,025 episodes of depression treatment between 1992 and 1999. Overall, psychotherapy was used in 25% (N=474) of the episodes, with 68% of episodes with psychotherapy involving services received only from psychiatrists. (Percentages were weighted for the complex design of the Medicare Current Beneficiary Survey.) Use of psychotherapy was correlated with younger patient age, higher patient educational attainment, and availability of local psychotherapy providers. Among episodes in which psychotherapy was used, only a minority (33%, N=141) involved patients who remained in consistent treatment, defined as extending for at least two-thirds of the episode of depression. Availability of local providers was positively correlated with consistent psychotherapy use. In analyses with adjustment for provider-related factors, patients' socioeconomic and demographic characteristics did not affect the odds of receiving consistent psychotherapy. CONCLUSIONS: Use of psychotherapy remains uncommon among depressed older adults despite its widely acknowledged efficacy. Some of the disparities in psychotherapy utilization suggest supply-side barriers. Increasing the geographic availability of mental health care providers may be one way of increasing access to psychotherapy for depressed older adults.

Emergency medicine education and health care disparities.

Education is the means by which learning occurs and, thereby, behavior is changed. One means of improving health care disparities is changing the behavior and understanding of key personnel in academic health centers. These individuals influence policy and procedure, design and evaluate health systems, and define curricular standards for graduate and undergraduate medical education. Emergency medicine provides many opportunities to educate at all levels, including faculty, residents, and students. In addition to our responsibilities in educating emergency medicine residents, the emergency department also provides an ideal learning environment for medical students and other health care providers. The broad issue of disparities in emergency health care may be approached from a variety of directions. The Consensus Group on Education chose to focus on cultural competency education at several levels as a means of tangibly changing its status for both the immediate and long terms.

Comparison of classification-based physical therapy with therapy based on clinical practice guidelines for patients with acute low back pain: a randomized clinical trial.

STUDY DESIGN: A randomized clinical trial was conducted. OBJECTIVE: To compare the effectiveness of classification-based physical therapy with that of therapy based on clinical practice guidelines for patients with acute, work-related low back pain. SUMMARY OF BACKGROUND DATA: Clinical practice guidelines recommend minimal intervention during the first few weeks after acute low back injury. However, studies supporting this recommendation have not attempted to identify which patients are likely to respond to particular interventions. METHODS: For this study, 78 subjects with work-related low back pain of less than 3 weeks duration were randomized to receive therapy based on a classification system that attempts to match patients to specific interventions or therapy based on the Agency for Health Care Policy and Research guidelines. The subjects were followed for 1 year. Outcomes included the impairment index, Oswestry scale, SF-36 component scores, satisfaction, medical costs, and return to work status. RESULTS: After adjustment for baseline factors, subjects receiving classification-based therapy showed greater change on the Oswestry (P = 0.023) and the SF-36 physical component (P = 0.029) after 4 weeks. Patient satisfaction was greater (P = 0.006) and return to full-duty work status more likely (P = 0.017) after 4 weeks in the classification-based group. After 1 year, there was a trend toward reduced Oswestry scores in the classification-based group (P = 0.063). Median total medical costs for 1 year after injury were 1003.68 dollars for the guideline-based group and 774.00 dollars for the classification-based group (P = 0.13). CONCLUSIONS: For patients with acute, work-related low back pain, the use of a classification-based approach resulted in improved disability and return to work status after 4 weeks, as compared with therapy based on clinical practice guidelines. Further research is needed on the optimal timing and methods of intervention for patients with acute low back pain.