Exploring Different Approaches in Measuring EHR-based Adherence to Best Practice - A Case Study with Order Sets and Associated Outcomes.

In connection with a recent enterprise-wide rollout of a new electronic health record, Intermountain Healthcare is investing significant effort in building a central library of best-practice order sets. These order sets represent best practice guidelines for specific clinical scenarios and are deployed with the intent of standardizing care, reducing variation, and consistently delivering good clinical outcomes to the populations we serve. The importance of measuring their use and the level to which caregivers adhere to these standards becomes an important factor in understanding and characterizing the impact that they deliver. Notwithstanding the importance of these metrics, well- defined methods for measuring adherence to a given clinical guideline as delivered through an order set are not fully characterized in the medical literature. In this paper, we describe initial efforts at measuring compliance to a defined 'best practice' standard by means of content utilization analysis, a calculated adherence model, and relevant clinical key performance indicators. The degree to which specified clinical outcomes vary across these measurement models are compared for a group of order sets tied to treating coronary artery bypass graft patients and heart failure patients. While the patterns derived from this analysis show some uncertainty, more granular methods that look at line-item, or 'order level' detail reveal more significant differences in the corresponding set of outcomes than higher-level adherence surrogates.

It takes a village: Exploring the impact of social determinants on delivery system outcomes for heart failure patients.

BACKGROUND: Local social determinants may act as effect modifiers for the impact of neighborhood material deprivation on patient-level healthcare outcomes. The objective of this study was to understand the mediating effect of local social determinants on neighborhood material deprivation and delivery outcomes in heart failure (HF) patients. MATERIAL AND METHODS: A retrospective cohort study was conducted using 4737 HF patients receiving inpatient care (n=6065 encounters) from an integrated healthcare delivery system from 2010 to 2014. Outcomes included post-discharge mortality, readmission risk and length of stay. Deprivation was measured using an area deprivation index by address of residence. Effect modifications measured included urban-rural residency and faith identification using generalized linear regression models. Patient-level data was drawn from the delivery system data warehouse. RESULTS: Faith identification had a significant protective effect on HF patients from deprived areas, lowering 30-day mortality odds by one-third over patients who did not identify with a faith (OR 0.35 95%CI:0.12-0.98;p=0.05). Significant effects persisted at the 90 and 180-day timeframes. In rural areas, lack of faith identification had a multiplicative effect on 30-day mortality for deprived patients (OR 14.0 95%CI:1.47-132.7;p=0.02). No significant effects were noted for other healthcare outcomes. CONCLUSIONS: The lack of expected association between area deprivation and healthcare outcomes in some communities may be explained by the presence of effect modifiers. IMPLICATIONS: Understanding existing effect modifiers for area deprivation in local communities that delivery systems serve can inform targeted quality improvement. These factors should also be considered when comparing delivery system performance for reimbursement and in population health management.