Development of the Initial Surveys for the All of Us Research Program.

BACKGROUND: The All of Us Research Program is building a national longitudinal cohort and collecting data from multiple information sources (e.g., biospecimens, electronic health records, and mobile/wearable technologies) to advance precision medicine. Participant-provided information, collected via surveys, will complement and augment these information sources. We report the process used to develop and refine the initial three surveys for this program. METHODS: The All of Us survey development process included: (1) prioritization of domains for scientific needs, (2) examination of existing validated instruments, (3) content creation, (4) evaluation and refinement via cognitive interviews and online testing, (5) content review by key stakeholders, and (6) launch in the All of Us electronic participant portal. All content was translated into Spanish. RESULTS: We conducted cognitive interviews in English and Spanish with 169 participants, and 573 individuals completed online testing. Feedback led to over 40 item content changes. Lessons learned included: (1) validated survey instruments performed well in diverse populations reflective of All of Us; (2) parallel evaluation of multiple languages can ensure optimal survey deployment; (3) recruitment challenges in diverse populations required multiple strategies; and (4) key stakeholders improved integration of surveys into larger Program context. CONCLUSIONS: This efficient, iterative process led to successful testing, refinement, and launch of three All of Us surveys. Reuse of All of Us surveys, available at http://researchallofus.org, may facilitate large consortia targeting diverse populations in English and Spanish to capture participant-provided information to supplement other data, such as genetic, physical measurements, or data from electronic health records.

Association of Health Literacy and Numeracy with Interest in Research Participation.

BACKGROUND: There is much attention to recruitment of diverse populations in research, but little is known about the influence of health literacy and numeracy skills. OBJECTIVE: To determine if health literacy and numeracy affect individuals' interest to participate in research studies. DESIGN: Cross-sectional survey data were pooled from 3 large studies conducted in the Mid-South Clinical Data Research Network. PARTICIPANTS: Adult patients enrolled in 1 of 3 Mid-South Clinical Data Research Network studies. MAIN MEASURES: The survey domains included demographic items, the 3-item Brief Health Literacy Screen (range 3-15), and the 3-item Subjective Numeracy Scale (range 3-18). The outcome was a sum index measure of a 7-item instrument (range 7-21) assessing individuals' interest in participating in different types of research, including research that involves taking surveys, giving a blood sample, participating via phone or internet, taking an investigational medication, meeting at a local community center or school, including family, or staying overnight at a hospital. KEY RESULTS: Respondents (N = 15,973) were predominately women (65.5%), White (81.4%), and middle aged (M = 52.8 years, SD = 16.5); 32.4% previously participated in research. Self-reported health literacy was relatively high (M = 13.5 out of 15, SD = 2.1), and subjective numeracy skills were somewhat lower (M = 14.3 out of 18, SD = 3.6). After adjustment for age, gender, race, income, education, and other characteristics, lower health literacy and numeracy skills were each independently associated with less interest in research participation (p < 0.001 for each). Prior research participation was associated with greater interest in future research participation (p < 0.001). CONCLUSIONS: After adjustment for factors known to be predictive of interest, individuals with lower health literacy or numeracy scores were less interested in participating in research. Additional work is needed to elucidate reasons for this finding and to determine strategies to engage these populations.

Enhancing organizational health literacy in a rural Missouri clinic: a qualitative case study.

PURPOSE: The purpose of this paper is to evaluate a collaborative effort between a health care organization and academic institution to strengthen organizational health literacy. DESIGN/METHODOLOGY/APPROACH: The intervention took place at a rural, federally qualified health clinic in Missouri between May 2009 and April 2011. Qualitative interviews of key informants were conducted before (n=35) and after (n=23) the intervention to examine program implementation and success in effecting organizational change. FINDINGS: Intervention activities helped establish a comprehensive understanding of health literacy. The project achieved moderate, fundamental and sustainable organizational change. The program successfully integrated health literacy practices into clinic systems and garnered leadership and organizational commitment, helped the workforce improve interpersonal communication and embedded practices making health education materials more accessible. ORIGINALITY/VALUE: The study points to programmatic, conceptual and methodological challenges that must be addressed for organizations to improve health literacy practices, and suggests change management strategies to advance organizational health literacy.

Health Literacy and Demographic Disparities in HIV Care Continuum Outcomes.

Studies evaluating the association between human immunodeficiency virus (HIV) infection continuum of care outcomes [antiretroviral (ART) adherence, retention in care, viral suppression] and health literacy have yielded conflicting results. Moreover, studies from the southern United States, a region of the country disproportionately affected by the HIV epidemic and low health literacy, are lacking. We conducted an observational cohort study among 575 people living with HIV (PLWH) at the Vanderbilt Comprehensive Care Clinic (Nashville, Tennessee). Health literacy was measured using the brief health literacy screen, a short tool which can be administered verbally by trained clinical personnel. Low health literacy was associated with a lack of viral suppression, but not with poor ART adherence or poor retention. Age and racial disparities in continuum of care outcomes persisted after accounting for health literacy, suggesting that factors in addition to health literacy must be addressed in order to improve outcomes for PLWH.

Health literacy, cognition, and urinary incontinence among geriatric inpatients discharged to skilled nursing facilities.

AIMS: To investigate the association between health literacy and cognition and nursing and patient-reported incontinence in a geriatric inpatient population transitioning to skilled nursing facilities (SNF). METHODS: Health literacy, depression, and cognition were assessed via the Brief Health Literacy Screen (BHLS), Geriatric Depression Scale 5-item (GDS) and Brief Interview for Mental Status (BIMS), respectively. Multivariable logistic regression assessed the association between BHLS score and incontinence by: (1) nursing-reported urinary incontinence during hospitalization; and (2) patient self-reported "bladder accidents" in the post-enrollment study interview. RESULTS: A total of 1556 hospitalized patients aged 65 and older met inclusion criteria, of whom 922 (59.3%) were women and 1480 had available BHLS scores. A total of 464 (29.8%) and 515 (33.1%) patients had nursing-reported and self-reported urinary incontinence, respectively. Nursing-reported incontinence was significantly associated with lower BHLS (ie, poorer health literacy) (aOR 0.93, 95%CI 0.89-0.99) and BIMS (ie, poorer cognition) (aOR 0.90, 95%CI 0.83-0.97) scores and need for assistance with toileting (aOR 7.08, 95%CI 2.16-23.21). Patient-reported incontinence was significantly associated with female sex (aOR 1.62, 95%CI 1.19-2.21), increased GDS score (ie, greater likelihood of depression) (aOR 1.22, 95%CI 1.10-1.36) and need for assistance with toileting (aOR 2.46, 95%CI 1.26-4.79). CONCLUSIONS: Poorer health literacy and cognition are independently associated with an increased likelihood of nursing-reported urinary incontinence among geriatric inpatients transitioning to SNF. Practitioners should consider assessment of health literacy and cognition in frail patients at risk for urinary incontinence and that patient and nursing assessment may be required to capture the diagnosis.

The Impact of Health Literacy and Clinicodemographic Factors on Use of Discharge Services after Radical Cystectomy.

PURPOSE: There are few data on the relationship between health literacy and discharge disposition. We hypothesized that patient discharge needs after radical cystectomy are affected by health literacy. MATERIALS AND METHODS: We identified 504 patients who underwent radical cystectomy and completed the validated BHLS (Brief Health Literacy Screen) after November 2010. Bivariate and logistic regression analyses were performed to determine whether health literacy is associated with the use of discharge resources after radical cystectomy. RESULTS: Of patients treated with radical cystectomy 50.6% required discharge services and had lower health literacy (BHLS 11.9 vs 12.5, p = 0.016) than patients discharged home without services. On multivariable analysis older age (OR 1.1, 95% CI 1.0-1.1, p = 0.002), female gender (OR 2.3, 95% CI 1.2-4.4, p = 0.019), body mass index (OR 1.1, 95% CI 1.0-1.1, p = 0.034), Charlson comorbidity index score (OR 1.1, 95% CI 1.0-1.2, p = 0.037) and length of stay (OR 1.1, 95% CI 1.0-1.2, p = 0.019) were significantly associated with the use of discharge resources. Patients with continent vs incontinent urinary diversion were less likely to require discharge services (OR 0.4, 95% CI 0.2-0.8, p = 0.013). CONCLUSIONS: Older age, female gender, body mass index, comorbidities, length of stay and incontinent diversion are associated with increased use of discharge resources after radical cystectomy. Low health literacy may affect patient discharge disposition but it was not significant on multivariable analysis. Factors that influence the complex self-care required of patients after cystectomy should be considered during discharge planning.

Effect of Pharmacist Counseling Intervention on Health Care Utilization Following Hospital Discharge: A Randomized Control Trial.

BACKGROUND: Reduction in 30-day readmission rates following hospitalization for acute coronary syndrome (ACS) and acute decompensated heart failure (ADHF) is a national goal. OBJECTIVE: The aim of this study was to determine the effect of a tailored, pharmacist-delivered, health literacy intervention on unplanned health care utilization, including hospital readmission or emergency room (ER) visit, following discharge. DESIGN: Randomized, controlled trial with concealed allocation and blinded outcome assessors SETTING: Two tertiary care academic medical centers PARTICIPANTS: Adults hospitalized with a diagnosis of ACS and/or ADHF. INTERVENTION: Pharmacist-assisted medication reconciliation, inpatient pharmacist counseling, low-literacy adherence aids, and individualized telephone follow-up after discharge MAIN MEASURES: The primary outcome was time to first unplanned health care event, defined as hospital readmission or an ER visit within 30 days of discharge. Pre-specified analyses were conducted to evaluate the effects of the intervention by academic site, health literacy status (inadequate versus adequate), and cognition (impaired versus not impaired). Adjusted hazard ratios (aHR) and 95% confidence intervals (CI) are reported. KEY RESULTS: A total of 851 participants enrolled in the study at Vanderbilt University Hospital (VUH) and Brigham and Women's Hospital (BWH). The primary analysis showed no statistically significant effect on time to first unplanned hospital readmission or ER visit among patients who received interventions compared to controls (aHR = 1.04, 95% CI 0.78-1.39). There was an interaction of treatment effect by site (p = 0.04 for interaction); VUH aHR = 0.77, 95% CI 0.51-1.15; BWH aHR = 1.44 (95% CI 0.95-2.12). The intervention reduced early unplanned health care utilization among patients with inadequate health literacy (aHR 0.41, 95% CI 0.17-1.00). There was no difference in treatment effect by patient cognition. CONCLUSION: A tailored, pharmacist-delivered health literacy-sensitive intervention did not reduce post-discharge unplanned health care utilization overall. The intervention was effective among patients with inadequate health literacy, suggesting that targeted practice of pharmacist intervention in this population may be advantageous.

Effects of stress, health competence, and social support on depressive symptoms after cardiac hospitalization.

Little is known about the role of stress on the psychological well-being of patients after cardiac hospitalization or about factors that protect against or exacerbate the effects of stress. We use prospective data from 1542 patients to investigate the relationship between post-discharge stress and changes in depressive symptoms, and whether the level of prior depressive symptoms, health competence, and perceived social support moderate this relationship. Net of depressive symptoms in the 2 weeks prior to hospitalization, higher levels of post-discharge stress significantly increase depressive symptoms 30 days after discharge. The level of prior depressive symptoms moderates the effect of stress. On the other hand, perceived health competence and social support buffer the negative effects of post-discharge stress. Knowing which patients are particularly vulnerable to experiencing stress and a subsequent increase in depressive symptoms can help trigger interventions prior to discharge and possibly ameliorate the prevalence of depression.

What Patient Characteristics Influence Nurses' Assessment of Health Literacy?

Overestimation of patients' health literacy skills is common among nurses and physicians. At Vanderbilt University Hospital, nurses routinely ask patients the 3 Brief Health Literacy Screen (BHLS) questions. Data from 2 studies that recruited patients at Vanderbilt University Hospital-the Health Literacy Screening (HEALS) study and the Vanderbilt Inpatient Cohort Study (VICS)-were analyzed to compare the BHLS score recorded by nurses during clinical care with the score recorded by trained research assistants during the same hospitalization. Logistic regression models determined which patient characteristics were associated with nurses documenting higher health literacy scores than research assistants. Overall, the majority (60%) of health literacy scores were accurate, though nurses recorded meaningfully higher health literacy scores in 28.4% of HEALS patients and 35.6% of VICS patients. In the HEALS cohort, patients who were male and had less education were more likely to have higher health literacy scores recorded by nurses (odds ratio [OR] = 1.93, 95% confidence interval [CI] [1.24, 3.00]; and OR = 0.80, 95% CI [0.74, 0.88], respectively). In the VICS cohort, patients who were older, were male, and had less education were more likely to have higher health literacy scores recorded by nurses (OR = 1.01, 95% CI [1.003, 1.02]; OR = 1.49, 95% CI [1.20, 1.84]; and OR = 0.87, 95% CI [0.83, 0.90], respectively). These findings suggest that health literacy scores recorded by nurses for male patients and patients with less education could be overestimated. Thus, health care professionals should be aware of this tendency and should verify the results of routine health literacy screening tests, especially in certain patient groups.

The Impact of Health Literacy on Surgical Outcomes Following Radical Cystectomy.

Health literacy is the ability to obtain, comprehend, and act on medical information and is an independent predictor of health outcomes in patients with chronic health conditions. However, little has been reported regarding the potential association of health literacy and surgical outcomes. We hypothesized that patient complications after radical cystectomy would be associated with health literacy. In a sample of 368 patients, we found that higher health literacy scores (as determined by the Brief Health Literacy Screen) were associated with decreased odds of developing minor complications (odds ratio = 0.90, 95% confidence interval [0.83, 0.97]). Health literacy should be considered when caring for patients undergoing radical cystectomy and should serve as a potential indicator of the need for additional resources to improve postoperative outcomes.

Medication Nonadherence Before Hospitalization for Acute Cardiac Events.

Medication nonadherence increases the risk of hospitalization and poor outcomes, particularly among patients with cardiovascular disease. The purpose of this study was to examine characteristics associated with medication nonadherence among adults hospitalized for cardiovascular disease. Patients in the Vanderbilt Inpatient Cohort Study who were admitted for acute coronary syndrome or heart failure completed validated assessments of self-reported medication adherence (the Adherence to Refills and Medications Scale), demographic characteristics, health literacy, numeracy, social support, depressive symptoms, and health competence. We modeled the independent predictors of nonadherence before hospitalization, standardizing estimated effects by each predictor's interquartile range. Among 1,967 patients studied, 70.7% indicated at least some degree of medication nonadherence leading up to their hospitalization. Adherence was significantly lower among patients with lower health literacy (0.18-point change in adherence score per interquartile range change in health literacy), lower numeracy (0.28), lower health competence (0.30), and more depressive symptoms (0.52) and those of younger age, of non-White race, of male gender, or with less social support. Medication nonadherence in the period before hospitalization is more prevalent among patients with lower health literacy, numeracy, or other intervenable psychosocial factors. Addressing these factors in a coordinated care model may reduce hospitalization rates.

Effect of Health Literacy on Research Follow-Up.

Previous research has not examined the effect of health literacy on research subjects' completion of scheduled research follow-up. This article evaluates patient factors associated with incomplete research follow-up at three time points after enrollment in a large, hospital-based prospective cohort study. Predictor variables included health literacy, age, race, gender, education, employment status, difficulty paying bills, hospital diagnosis, length of stay, self-reported global health status, depression, perceived health competence, medication adherence, and health care system distrust. In a sample of 2,042 patients, multivariable models demonstrated that lower health literacy and younger age were significantly associated with a lower likelihood of completing research follow-up interviews at 2-3 days, 30 days, and 90 days after hospital discharge. In addition, patients who had less education, were currently employed, and had moderate financial stress were less likely to complete 90-day follow-up. This study is the first to demonstrate that lower health literacy is a significant predictor of incomplete research follow-up.

Determinants of health after hospital discharge: rationale and design of the Vanderbilt Inpatient Cohort Study (VICS).

BACKGROUND: The period following hospital discharge is a vulnerable time for patients when errors and poorly coordinated care are common. Suboptimal care transitions for patients admitted with cardiovascular conditions can contribute to readmission and other adverse health outcomes. Little research has examined the role of health literacy and other social determinants of health in predicting post-discharge outcomes. METHODS: The Vanderbilt Inpatient Cohort Study (VICS), funded by the National Institutes of Health, is a prospective longitudinal study of 3,000 patients hospitalized with acute coronary syndromes or acute decompensated heart failure. Enrollment began in October 2011 and is planned through October 2015. During hospitalization, a set of validated demographic, cognitive, psychological, social, behavioral, and functional measures are administered, and health status and comorbidities are assessed. Patients are interviewed by phone during the first week after discharge to assess the quality of hospital discharge, communication, and initial medication management. At approximately 30 and 90 days post-discharge, interviewers collect additional data on medication adherence, social support, functional status, quality of life, and health care utilization. Mortality will be determined with up to 3.5 years follow-up. Statistical models will examine hypothesized relationships of health literacy and other social determinants on medication management, functional status, quality of life, utilization, and mortality. In this paper, we describe recruitment, eligibility, follow-up, data collection, and analysis plans for VICS, as well as characteristics of the accruing patient cohort. DISCUSSION: This research will enhance understanding of how health literacy and other patient factors affect the quality of care transitions and outcomes after hospitalization. Findings will help inform the design of interventions to improve care transitions and post-discharge outcomes.

Health literacy, numeracy, and other characteristics associated with hospitalized patients' preferences for involvement in decision making.

Little research has examined the association of health literacy and numeracy with patients' preferred involvement in the problem-solving and decision-making process in the hospital. Using a sample of 1,249 patients hospitalized with cardiovascular disease from the Vanderbilt Inpatient Cohort Study (VICS), we assessed patients' preferred level of involvement using responses to two scenarios of differing symptom severity from the Problem-Solving Decision-Making Scale. Using multivariable modeling, we determined the relationship of health literacy, subjective numeracy, and other patient characteristics with preferences for involvement in decisions, and how this differed by scenario. The authors found that patients with higher levels of health literacy desired more participation in the problem-solving and decision-making process, as did patients with higher subjective numeracy skills, greater educational attainment, female gender, less perceived social support, or greater health care system distrust (p<.05 for each predictor in multivariable models). Patients also preferred to participate more in the decision-making process when the hypothetical symptom they were experiencing was less severe (i.e., they deferred more to their physician when the hypothetical symptom was more severe). These findings underscore the role that patient characteristics, especially health literacy and numeracy, play in decisional preferences among hospitalized patients.

Predictors of health care system and physician distrust in hospitalized cardiac patients.

Trusting relationships among patients, physicians, and the health care system is important in encouraging self-care behaviors in cardiovascular patients. This study aimed to assess the prevalence of health care system and physician distrust in this population, compare the 2 forms of distrust, and describe the demographic, socioeconomic, and psychosocial predictors of high distrust. A total of 1,232 hospitalized adults with acute coronary syndrome or heart failure were enrolled in a prospective, observational study assessing health care system distrust and physician distrust. High health care system distrust (35%) was observed across the population, with lower levels of interpersonal physician distrust (16%). In a multivariate analysis, poor social support and coping skills were strong predictors of both health care system (p=.026, p=.003) and physician distrust (p<.001, p=.006). Individuals with low or marginal health literacy had a higher likelihood of physician distrust (p<.001), but no relation was found between health literacy and health care system distrust. In conclusion, distrust is common among acutely ill cardiac patients. Those with low social support and low coping skills are more distrusting of physicians and the health care system.

Patient-reported predictors of postdischarge mortality after cardiac hospitalization.

BACKGROUND: Adults hospitalized for cardiovascular events are at high risk for postdischarge mortality. Screening of psychosocial risk is prioritized by the Joint Commission. We tested whether key patient-reported psychosocial and behavioral measures could predict posthospitalization mortality in a cohort of adults hospitalized for a cardiovascular event. METHODS: We conducted a prospective cohort study to test the prognostic utility of validated patient-reported measures, including health literacy, social support, health behaviors and disease management, and socioeconomic status. Cox survival analyses of mortality were conducted over a median of 3.5 years. RESULTS: Among 2977 adults hospitalized for either acute coronary syndrome or acute decompensated heart failure, the mean age was 53 years, and 60% were male. After adjusting for demographic, clinical, and other psychosocial factors, mortality risk was greatest among patients who reported being unemployed (hazard ratio [HR]: 1.99, 95% confidence interval [CI]): 1.30-3.06), retired (HR: 2.14, 95% CI: 1.60-2.87), or unable to work due to disability (HR: 2.36, 95% CI: 1.73-3.21), as compared to those who were employed. Patient-reported perceived health competence (PHCS-2) and exercise frequency were also associated with mortality risk after adjusting for all other variables (HR: 0.86, 95% CI: 0.73-1.00 per four-point increase in PHCS-2; HR: 0.86, 95% CI: 0.77-0.96 per 3-day increase in exercise frequency, respectively). CONCLUSIONS: Patient-reported measures of employment status, perceived health competence, and exercise frequency independently predict mortality after a cardiac hospitalization. Incorporating these brief, valid measures into hospital-based screening may help with prognostication and targeting patients for resources during post-discharge transitions of care.

Patient-reported predictors of post-discharge mortality after cardiac hospitalization.

Background: Adults hospitalized for cardiovascular events are at high risk for post-discharge mortality. Hospital-based screening of health-related psychosocial risk factors is now prioritized by the Joint Commission and the National Quality Forum to achieve equitable, high-quality care. We tested our hypothesis that key patient-reported psychosocial and behavioral measures could predict post-hospitalization mortality in a cohort of adults hospitalized for a cardiovascular event. Methods: This was a prospective cohort of adults hospitalized at Vanderbilt University Medical Center. Validated patient-reported measures of health literacy, social support, disease self-management, and socioeconomic status were used as predictors of interest. Cox survival analyses of mortality were conducted over a median 3.5-year follow-up (range: 1.25 - 5.5 years). Results: Among 2,977 adults, 1,874 (63%) were hospitalized for acute coronary syndrome and 1,103 (37%) were hospitalized for acute decompensated heart failure; 60% were male; and the mean age was 53 years. After adjusting for demographic, clinical, and other psychosocial factors, mortality risk was greatest among patients who reported being unable to work due to disability (Hazard Ratio (HR) 2.36, 95% Confidence Interval (CI): 1.73-3.21), who were retired (HR 2.14, 95% CI 1.60-2.87), and who reported unemployment (HR 1.99, 95% CI 1.30-3.06) as compared to those who were employed. Patient-reported measures of disease self-management, perceived health competence and exercise frequency, were also associated with mortality risk after full covariate adjustment (HR 0.86, 95% CI 0.73-1.00 per four-point increase), (HR 0.86, 95% CI 0.77-0.96 per three-day change), respectively. Conclusions: Patient-reported measures of employment status independently predict post-discharge mortality after a cardiac hospitalization. Measure of disease self-management also have prognostic modest utility. Hospital-based screening of psychosocial risk is increasingly prioritized in legislative policy. Incorporating brief, valid measures of employment status and disease self-management factors may help target patients for psychosocial, financial, and rehabilitative resources during post-discharge transitions of care.

Disparities in Research Participation by Level of Health Literacy.

OBJECTIVE: To determine at which phase in the recruitment process for participation in clinical research studies do health literacy and other patient characteristics influence recruitment outcomes. PATIENTS AND METHODS: Using a sample of 5872 patients hospitalized with cardiovascular disease approached for participation in the Vanderbilt Inpatient Cohort Study from October 2011 through December 2015, we examined the independent association of patients' health literacy with two steps in their research participation decision-making process: (1) research interest - willingness to hear more about a research study; and (2) research participation - the decision to enroll after an informed consent discussion. Best practices for effective health communication were implemented in recruitment approaches and informed consent processes. Using logistic regression models, we determined patient characteristics independently associated with patients' willingness to hear about and participate in the study. RESULTS: In unadjusted analyses, participants with higher health literacy, and those who were younger, female, or had more education had higher levels of both research interest and research participation. Health literacy remained independently associated with both outcomes in multivariable models, after adjustment for sociodemographic factors. CONCLUSION: Because identical variables predicted both research interest and eventual consent, efforts to recruit broad populations must include acceptable methods of approaching potential participants as well as explaining study materials.

Lessons Learned from Efforts to Reduce Overuse of Cardiac Telemetry Monitoring.

BACKGROUND: Inappropriate use of telemetry monitoring is common, increasing costs, false alarms, and length of stay. The Society of Hospital Medicine and Choosing Wisely encourage the use of discontinuation protocols. METHODS: This quality improvement initiative measured the impact of an educational intervention and distribution of performance reports for physicians and residents on the general medicine service. The intervention group received a 15-minute didactic session on appropriate indications for telemetry followed by weekly performance reports for 78 weeks. A segmented linear regression model and Student's t-test were used to determine intervention effects on percentage of patients on telemetry and telemetry orders lasting more than 48 hours. RESULTS: Prior to the intervention, 4.8% of patients received telemetry monitoring; 13.4% of telemetry orders exceeded 48 hours. The control service had a baseline telemetry utilization of 2.4%; 1.2% of telemetry orders exceeded 48 hours. After the intervention, 3.9% of patients received telemetry monitoring; 10.6% of telemetry orders exceeded 48 hours. The control service had a postintervention telemetry utilization of 2.1%; 1.1% of telemetry orders exceeded 48 hours. The Student's t-test showed a statistically significant (p = 0.002) decrease in telemetry ordering rate on the intervention service and no significant change in the control group. However, when using segmented linear regression analysis, these changes could not be attributed to the intervention nor were there any significant changes in balancing metrics. CONCLUSION: Education and weekly performance feedback did not significantly impact telemetry according to segmented linear regression results. Segmented linear regression analysis of an interrupted time series yielded significantly different results from a pre-post comparison using Student's t-test. Rigorous evaluation is vital to decreasing unnecessary care and successful reduction in unnecessary care may require interventions that capitalize on systems-level change.