Disease Heritability Inferred from Familial Relationships Reported in Medical Records.

Heritability is essential for understanding the biological causes of disease but requires laborious patient recruitment and phenotype ascertainment. Electronic health records (EHRs) passively capture a wide range of clinically relevant data and provide a resource for studying the heritability of traits that are not typically accessible. EHRs contain next-of-kin information collected via patient emergency contact forms, but until now, these data have gone unused in research. We mined emergency contact data at three academic medical centers and identified 7.4 million familial relationships while maintaining patient privacy. Identified relationships were consistent with genetically derived relatedness. We used EHR data to compute heritability estimates for 500 disease phenotypes. Overall, estimates were consistent with the literature and between sites. Inconsistencies were indicative of limitations and opportunities unique to EHR research. These analyses provide a validation of the use of EHRs for genetics and disease research.

New Coding Guidelines Reduce Emergency Department Note Bloat But More Work Is Needed.

STUDY OBJECTIVE: The length and redundancy of notes authored by clinicians has significantly increased, giving rise to the term "note bloat." We analyzed the impact of new coding guidelines and documentation best practices on the length of emergency department (ED) notes and the amount of time clinicians spent documenting. METHODS: In a large, multisite health care delivery organization, we retrospectively evaluated the length of all ED provider notes and the amount of time clinicians spent documenting between February 2018 and June 2023. In January 2023, we implemented changes to the standardized note template to align with the new coding guidelines from the American Medical Association and the Centers for Medicare & Medicaid Services. The primary outcomes were the length of provider notes and the amount of time spent documenting. RESULTS: Our study sample consisted of 1,679,762 ED provider notes. Six months after the intervention, the average note length decreased by 872 words (95% confidence interval 867 to 877 words), whereas the amount of time clinicians spent documenting did not change. CONCLUSIONS: Embracing new guidelines and practices, we reduced the length of ED provider notes by 872 words. Despite this, the time clinicians spent documenting did not change significantly. We provide an early report of success in reducing note bloat in the ED to help guide future efforts to reduce overall documentation burden.

Low Rates of Screening for Celiac Disease Among Family Members.

BACKGROUND & AIMS: Given the increased morbidity and potential mortality of celiac disease, guidelines recommend screening high-risk individuals, including first-degree relatives of patients. We assessed how commonly celiac disease testing occurs in these individuals and identified factors that influence testing. METHODS: Relatives of 2081 patients with biopsy-diagnosed celiac disease and followed up at Columbia University Medical Center were identified using relationship inference from the electronic health record-a validated method that uses emergency contact information to identify familial relationships. We manually abstracted data from each record and performed univariate and multivariate analyses to identify factors associated with testing relatives for celiac disease. RESULTS: Of 539 relatives identified, 212 (39.3%) were tested for celiac disease, including 50.4% (193 of 383) of first-degree relatives and 71.5% (118 of 165) of symptomatic first-degree relatives. Of the 383 first-degree relatives, only 116 (30.3%) had a documented family history of celiac disease. On multivariate analysis, testing was more likely in adults (odds ratio [OR], for 18-39 y vs younger than 18 y, 2.27; 95% CI, 1.12-4.58); relatives being seen by a gastroenterologist (OR, 15.16; 95% CI, 7.72-29.80); relatives with symptoms (OR, 3.69; 95% CI, 2.11-6.47); first-degree relatives of a patient with celiac disease (OR, 4.90, 95% CI, 2.34-10.25); and relatives with a documented family history of celiac disease (OR, 11.9, 95% CI, 5.56-25.48). CONCLUSIONS: By using an algorithm to identify relatives of patients with celiac disease, we found that nearly 30% of symptomatic first-degree relatives of patients with celiac disease have not received the tests recommended by guidelines. Health care providers should implement strategies to identify and screen patients at increased risk for celiac disease, including methods to ensure adequate documentation of family medical history.

Effect of Restriction of the Number of Concurrently Open Records in an Electronic Health Record on Wrong-Patient Order Errors: A Randomized Clinical Trial.

Importance: Recommendations in the United States suggest limiting the number of patient records displayed in an electronic health record (EHR) to 1 at a time, although little evidence supports this recommendation. Objective: To assess the risk of wrong-patient orders in an EHR configuration limiting clinicians to 1 record vs allowing up to 4 records opened concurrently. Design, Setting, and Participants: This randomized clinical trial included 3356 clinicians at a large health system in New York and was conducted from October 2015 to April 2017 in emergency department, inpatient, and outpatient settings. Interventions: Clinicians were randomly assigned in a 1:1 ratio to an EHR configuration limiting to 1 patient record open at a time (restricted; n = 1669) or allowing up to 4 records open concurrently (unrestricted; n = 1687). Main Outcomes and Measures: The unit of analysis was the order session, a series of orders placed by a clinician for a single patient. The primary outcome was order sessions that included 1 or more wrong-patient orders identified by the Wrong-Patient Retract-and-Reorder measure (an electronic query that identifies orders placed for a patient, retracted, and then reordered shortly thereafter by the same clinician for a different patient). Results: Among the 3356 clinicians who were randomized (mean [SD] age, 43.1 [12.5] years; mean [SD] experience at study site, 6.5 [6.0] years; 1894 females [56.4%]), all provided order data and were included in the analysis. The study included 12 140 298 orders, in 4 486 631 order sessions, placed for 543 490 patients. There was no significant difference in wrong-patient order sessions per 100 000 in the restricted vs unrestricted group, respectively, overall (90.7 vs 88.0; odds ratio [OR], 1.03 [95% CI, 0.90-1.20]; P = .60) or in any setting (ED: 157.8 vs 161.3, OR, 1.00 [95% CI, 0.83-1.20], P = .96; inpatient: 185.6 vs 185.1, OR, 0.99 [95% CI, 0.89-1.11]; P = .86; or outpatient: 7.9 vs 8.2, OR, 0.94 [95% CI, 0.70-1.28], P = .71). The effect did not differ among settings (P for interaction = .99). In the unrestricted group overall, 66.2% of the order sessions were completed with 1 record open, including 34.5% of ED, 53.7% of inpatient, and 83.4% of outpatient order sessions. Conclusions and Relevance: A strategy that limited clinicians to 1 EHR patient record open compared with a strategy that allowed up to 4 records open concurrently did not reduce the proportion of wrong-patient order errors. However, clinicians in the unrestricted group placed most orders with a single record open, limiting the power of the study to determine whether reducing the number of records open when placing orders reduces the risk of wrong-patient order errors. Trial Registration: clinicaltrials.gov Identifier: NCT02876588.

A method for harmonization of clinical abbreviation and acronym sense inventories.

BACKGROUND: Previous research has developed methods to construct acronym sense inventories from a single institutional corpus. Although beneficial, a sense inventory constructed from a single institutional corpus is not generalizable, because acronyms from different geographic regions and medical specialties vary greatly. OBJECTIVE: Develop an automated method to harmonize sense inventories from different regions and specialties towards the development of a comprehensive inventory. METHODS: The method involves integrating multiple source sense inventories into one centralized inventory and cross-mapping redundant entries to establish synonymy. To evaluate our method, we integrated 8 well-known source inventories into one comprehensive inventory (or metathesaurus). For both the metathesaurus and its sources, we evaluated the coverage of acronyms and their senses on a corpus of 1 million clinical notes. The corpus came from a different institution, region, and specialty than the source inventories. RESULTS: In the evaluation using clinical notes, the metathesaurus demonstrated an acronym (short form) micro-coverage of 94.3%, representing a substantial increase over the two next largest source inventories, the UMLS LRABR (74.8%) and ADAM (68.0%). The metathesaurus demonstrated a sense (long form) micro-coverage of 99.6%, again a substantial increase compared to the UMLS LRABR (82.5%) and ADAM (55.4%). CONCLUSIONS: Given the high coverage, harmonizing acronym sense inventories is a promising methodology to improve their comprehensiveness. Our method is automated, leverages the extensive resources already devoted to developing institution-specific inventories in the United States, and may help generalize sense inventories to institutions who lack the resources to develop them. Future work should address quality issues in source inventories and explore additional approaches to establishing synonymy.

Intercepting wrong-patient orders in a computerized provider order entry system.

STUDY OBJECTIVE: We evaluate the short- and long-term effect of a computerized provider order entry-based patient verification intervention to reduce wrong-patient orders in 5 emergency departments. METHODS: A patient verification dialog appeared at the beginning of each ordering session, requiring providers to confirm the patient's identity after a mandatory 2.5-second delay. Using the retract-and-reorder technique, we estimated the rate of wrong-patient orders before and after the implementation of the intervention to intercept these errors. We conducted a short- and long-term quasi-experimental study with both historical and parallel controls. We also measured the amount of time providers spent addressing the verification system, and reasons for discontinuing ordering sessions as a result of the intervention. RESULTS: Wrong-patient orders were reduced by 30% immediately after implementation of the intervention. This reduction persisted when inpatients were used as a parallel control. After 2 years, the rate of wrong-patient orders remained 24.8% less than before intervention. The mean viewing time of the patient verification dialog was 4.2 seconds (SD=4.0 seconds) and was longer when providers indicated they placed the order for the wrong patient (4.9 versus 4.1 seconds). Although the display of each dialog took only seconds, the large number of display episodes triggered meant that the physician time to prevent each retract-and-reorder event was 1.5 hours. CONCLUSION: A computerized provider order entry-based patient verification system led to a moderate reduction in wrong-patient orders that was sustained over time. Interception of wrong-patient orders at data entry is an important step in reducing these errors.

Challenges Associated With Using Large Data Sets for Quality Assessment and Research in Clinical Settings.

The rapidly expanding use of electronic records in health-care settings is generating unprecedented quantities of data available for clinical, epidemiological, and cost-effectiveness research. Several challenges are associated with using these data for clinical research, including issues surrounding access and information security, poor data quality, inconsistency of data within and across institutions, and a paucity of staff with expertise to manage and manipulate large clinical data sets. In this article, we describe our experience with assembling a data-mart and conducting clinical research using electronic data from four facilities within a single hospital network in New York City. We culled data from several electronic sources, including the institution's admission-discharge-transfer system, cost accounting system, electronic health record, clinical data warehouse, and departmental records. The final data-mart contained information for more than 760,000 discharges occurring from 2006 through 2012. Using categories identified by the National Institutes of Health Big Data to Knowledge initiative as a framework, we outlined challenges encountered during the development and use of a domain-specific data-mart and recommend approaches to overcome these challenges.

Influenza vaccine text message reminders for urban, low-income pregnant women: a randomized controlled trial.

OBJECTIVES: We evaluated the impact of influenza vaccine text message reminders in a low-income obstetric population. METHODS: We conducted a randomized controlled trial that enrolled 1187 obstetric patients from 5 community-based clinics in New York City. The intervention group received 5 weekly text messages regarding influenza vaccination starting mid-September 2011 and 2 text message appointment reminders. Both groups received standard automated telephone appointment reminders. The prespecified endpoints were receipt of either pre- or postpartum influenza vaccination calculated cumulatively at the end of each month (September-December 2011). RESULTS: After adjusting for gestational age and number of clinic visits, women who received the intervention were 30% more likely to be vaccinated as of December 2011 (adjusted odds ratio [AOR] = 1.30; 95% confidence interval [CI] = 1.003, 1.69 end of September: AOR = 1.34; 95% CI = 0.98, 1.85; October: AOR = 1.35; 95% CI = 1.05, 1.75; November: AOR = 1.27; 95% CI = 0.98, 1.65). The subgroup of women early in the third trimester at randomization showed the greatest intervention effect (December 31: 61.9% intervention vs 49.0% control; AOR = 1.88; 95% CI = 1.12, 3.15). CONCLUSIONS: In this low-income obstetric population, text messaging was associated with increased influenza vaccination, especially in those who received messages early in their third trimester.

Influenza vaccination coverage and timeliness among children requiring two doses, 2004-2009.

OBJECTIVE: To assess influenza vaccination coverage and timeliness among children requiring two doses in a season. METHODS: This study examined seasonal influenza vaccination of 17,800 children from five academically-affiliated clinics in New York City using hospital and city immunization registries. Eligible children were 6 months-8 years and needed two influenza vaccine doses in a given season between 2004-05 and 2009-10. Any (≥ 1 dose) and full (2 doses) vaccination coverage by December 15 and March 31 as well as interval between doses were calculated. Vaccination trends over time, determinants, and missed opportunities were assessed. RESULTS: Children were primarily Latino and publicly insured. Full coverage by March 31 increased between the 2004-05 and 2009-10 seasons (9% vs. 29%, p<0.001). Few children received both doses by December 15 (2-13%). The interval between doses was almost twice as long as recommended and increased over time (2004-05: 52 days; 2009-10: 64 days; p<0.001). Older age and Latino ethnicity were negative predictors of full vaccination by March 31. Missed opportunities for the second dose were common. CONCLUSION: Despite improvements, low-income, minority children requiring two influenza vaccine doses remain at risk of incomplete and delayed vaccination. Barriers to and strategies for timely full vaccination should be explored.

Publication bias in clinical trials of electronic health records.

OBJECTIVE: To measure the rate of non-publication and assess possible publication bias in clinical trials of electronic health records. METHODS: We searched ClinicalTrials.gov to identify registered clinical trials of electronic health records and searched the biomedical literature and contacted trial investigators to determine whether the results of the trials were published. Publications were judged as positive, negative, or neutral according to the primary outcome. RESULTS: Seventy-six percent of trials had publications describing trial results; of these, 74% were positive, 21% were neutral, and 4% were negative (harmful). Of unpublished studies for which the investigator responded, 43% were positive, 57% were neutral, and none were negative; the lower rate of positive results was significant (p<0.001). CONCLUSION: The rate of non-publication in electronic health record studies is similar to that in other biomedical studies. There appears to be a bias toward publication of positive trials in this domain.

Analyzing Patient-Provided Responses to Improve Collection of Health Equity Data Elements.

Self-report is purported to be the gold standard for collecting demographic information. Many entry forms include a free-text "write-in" option in addition to structured responses. Balancing the flexibility of free-text with the value of collecting data in a structured format is a challenge if the data are to be useful for measuring and mitigating health disparities. While much work has been done to improve collection of race and ethnicity information, how to best collect data related to sexual and gender minority status and military veteran status has been less commonly studied. We analyzed 3,381 patient-provided free-text responses collected via a patient portal for gender identity, sexual orientation, pronouns, and veteran experiences. We identified common responses to better understand our patient population and help improve future iterations of data collection tools.

How Are Leading Research Institutions Engaging with Data Sharing Tools and Programs?

With widespread electronic health record (EHR) adoption and improvements in health information interoperability in the United States, troves of data are available for knowledge discovery. Several data sharing programs and tools have been developed to support research activities, including efforts funded by the National Institutes of Health (NIH), EHR vendors, and other public- and private-sector entities. We surveyed 65 leading research institutions (77% response rate) about their use of and value derived from ten programs/tools, including NIH's Accrual to Clinical Trials, Epic Corporation's Cosmos, and the Observational Health Data Sciences and Informatics consortium. Most institutions participated in multiple programs/tools but reported relatively low usage (even when they participated, they frequently indicated that fewer than one individual/month benefitted from the platform to support research activities). Our findings suggest that investments in research data sharing have not yet achieved desired results.

Variation in pediatric and adolescent electronic health data sharing practices under the 21st Century Cures Act.

OBJECTIVE: To describe real-world practices and variation in implementation of the Information Blocking provisions amongst healthcare organizations caring for pediatric patients. MATERIALS AND METHODS: An online survey regarding implementation practices was distributed to representatives from 10 participating US healthcare organizations located in 6 different states. The survey was followed by structured interviews conducted through video conference. Information was gathered about implementation practices at each organization, with a focus on patient and proxy portal access to, and segmentation capabilities of, certain data classes listed in the United States Core Data for Interoperability Version 1. RESULTS: All organizations had implemented the information blocking provisions at their institution. All organizations utilized different portal account types for proxies and users. All organizations reported the capability of sharing labs, medications, problem lists, imaging, and notes with the parent/guardian of the non-adolescent minor user with differences in how sensitive elements within the data classes were protected. Variability existed in how data was shared with the remaining user types. DISCUSSION: Significant variability exists in how organizations have implemented the information blocking rules. Variation in data sharing and data access between institutions can result in privacy breaches and create confusion about completeness of data for patients and families. CONCLUSION: Healthcare organizations have utilized varying strategies to comply with the information blocking provisions of the 21st Century Cures Act. Increased clarity from the Office of the National Coordinator for Health Information Technology on minor, adolescent, and caregiver privacy and improved segmentation capabilities from Electronic Health Record vendors is needed.

Understanding the perceived role of electronic health records and workflow fragmentation on clinician documentation burden in emergency departments.

OBJECTIVE: Understand the perceived role of electronic health records (EHR) and workflow fragmentation on clinician documentation burden in the emergency department (ED). METHODS: From February to June 2022, we conducted semistructured interviews among a national sample of US prescribing providers and registered nurses who actively practice in the adult ED setting and use Epic Systems' EHR. We recruited participants through professional listservs, social media, and email invitations sent to healthcare professionals. We analyzed interview transcripts using inductive thematic analysis and interviewed participants until we achieved thematic saturation. We finalized themes through a consensus-building process. RESULTS: We conducted interviews with 12 prescribing providers and 12 registered nurses. Six themes were identified related to EHR factors perceived to contribute to documentation burden including lack of advanced EHR capabilities, absence of EHR optimization for clinicians, poor user interface design, hindered communication, increased manual work, and added workflow blockages, and five themes associated with cognitive load. Two themes emerged in the relationship between workflow fragmentation and EHR documentation burden: underlying sources and adverse consequences. DISCUSSION: Obtaining further stakeholder input and consensus is essential to determine whether these perceived burdensome EHR factors could be extended to broader contexts and addressed through optimizing existing EHR systems alone or through a broad overhaul of the EHR's architecture and primary purpose. CONCLUSION: While most clinicians perceived that the EHR added value to patient care and care quality, our findings underscore the importance of designing EHRs that are in harmony with ED clinical workflows to alleviate the clinician documentation burden.

Health literacy screening instruments for eHealth applications: a systematic review.

OBJECTIVE: To systematically review current health literacy (HL) instruments for use in consumer-facing and mobile health information technology screening and evaluation tools. DESIGN: The databases, PubMed, OVID, Google Scholar, Cochrane Library and Science Citation Index, were searched for health literacy assessment instruments using the terms "health", "literacy", "computer-based," and "psychometrics". All instruments identified by this method were critically appraised according to their reported psychometric properties and clinical feasibility. RESULTS: Eleven different health literacy instruments were found. Screening questions, such as asking a patient about his/her need for assistance in navigating health information, were evaluated in seven different studies and are promising for use as a valid, reliable, and feasible computer-based approach to identify patients that struggle with low health literacy. However, there was a lack of consistency in the types of screening questions proposed. There is also a lack of information regarding the psychometric properties of computer-based health literacy instruments. LIMITATIONS: Only English language health literacy assessment instruments were reviewed and analyzed. CONCLUSIONS: Current health literacy screening tools demonstrate varying benefits depending on the context of their use. In many cases, it seems that a single screening question may be a reliable, valid, and feasible means for establishing health literacy. A combination of screening questions that assess health literacy and technological literacy may enable tailoring eHealth applications to user needs. Further research should determine the best screening question(s) and the best synthesis of various instruments' content and methodologies for computer-based health literacy screening and assessment.

Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial.

CONTEXT: Influenza infection results in substantial costs, morbidity, and mortality. Vaccination against influenza is particularly important in children and adolescents who are a significant source of transmission to other high-risk populations, yet pediatric and adolescent vaccine coverage remains low. Traditional vaccine reminders have had a limited effect on low-income populations; however, text messaging is a novel, scalable approach to promote influenza vaccination. OBJECTIVE: To evaluate targeted text message reminders for low-income, urban parents to promote receipt of influenza vaccination among children and adolescents. DESIGN, SETTING, AND PARTICIPANTS: Randomized controlled trial of 9213 children and adolescents aged 6 months to 18 years receiving care at 4 community-based clinics in the United States during the 2010-2011 influenza season. Of the 9213 children and adolescents, 7574 had not received influenza vaccine prior to the intervention start date and were included in the primary analysis. INTERVENTION: Parents of children assigned to the intervention received up to 5 weekly immunization registry-linked text messages providing educational information and instructions regarding Saturday clinics. Both the intervention and usual care groups received the usual care, an automated telephone reminder, and access to informational flyers posted at the study sites. MAIN OUTCOME MEASURES: Receipt of an influenza vaccine dose recorded in the immunization registry via an electronic health record by March 31, 2011. Receipt was secondarily assessed at an earlier fall review date prior to typical widespread influenza activity. RESULTS: Study children and adolescents were primarily minority, 88% were publicly insured, and 58% were from Spanish-speaking families. As of March 31, 2011, a higher proportion of children and adolescents in the intervention group (43.6%; n = 1653) compared with the usual care group (39.9%; n = 1509) had received influenza vaccine (difference, 3.7% [95% CI, 1.5%-5.9%]; relative rate ratio [RRR], 1.09 [95% CI, 1.04-1.15]; P = .001). At the fall review date, 27.1% (n = 1026) of the intervention group compared with 22.8% (n = 864) of the usual care group had received influenza vaccine (difference, 4.3% [95% CI, 2.3%-6.3%]; RRR, 1.19 [95% CI, 1.10-1.28]; P < .001). CONCLUSIONS: Among children and adolescents in a low-income, urban population, a text messaging intervention compared with usual care was associated with an increased rate of influenza vaccination. However, the overall influenza vaccination rate remained low. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01146912.

Comparison of Ordering Tools on Adherence to Treatment Protocols in the Emergency Department.

OBJECTIVE: To assess adherence to clinical protocols in the emergency department after the implementation of embedded order panels in the electronic health record. MATERIALS AND METHODS: Due to infrequent use, a subset of order sets were redesigned as embedded order panels in a menu-style quick list. Usage was measured before and after implementation at seven departments. RESULTS: There were 2,247 applicable encounters during the pre-intervention period and 1,723 post-intervention. The use of order sets increased significantly after implementation (14% vs. 33% or encounters, p < 0.001). Traditional order sets required at least seven keystrokes or mouse clicks, while embedded order panels required only two. DISCUSSION AND CONCLUSION: Use of order sets increased after implementation of embedded order panels; however, they were still only used for about one-third of applicable encounters suggesting that more work is needed to increase treatment protocol adherence and electronic health record efficiency.

Pandemic Telemedicine Adoption Trends in a Predominantly Rural Integrated Health System.

Between March 2020 and February 2022, use of telemedicine services in the U.S. shifted dramatically in response to the evolving SARS-CoV2 pandemic. The initial wave caused many non-emergent clinical services to be postponed, including specialty care clinic visits, which were rapidly converted to telemedicine encounters. Telemedicine use ebbed and flowed with subsequent pandemic waves. This paper describes trends in telemedicine use from March 2020-February 2022 at Geisinger, a predominantly rural integrated health system. It highlights characteristics of 5,390 virtual vs. 15,740 in-person clinic visits to neurosurgery and gastroenterology specialists in December 2021 and January 2022. Differences in ordering of diagnostic testing and prescription medications, as well as post-clinic-visit utilization, varied by specialty. Virtual visits in these specialties saved patients from traveling over 174,700 miles/month to attend appointments. Analyzing telemedicine use patterns can inform future resource allocation and determine when virtual encounters can complement or replace in-person specialty care visits.

Overcoming technical and cultural challenges to delivering equitable care for LGBTQ+ individuals in a rural, underserved area.

The lesbian, gay, bisexual, transgender, queer, or questioning (LGBTQ+) community is vulnerable to health-care disparities. Many health-care organizations are working to collect sexual orientation and gender identity in their electronic health records (EHRs), with the goal of providing more inclusive care to their LGBTQ+ patients. There are significant human and technical barriers to making these efforts successful. Based on our 5-year experience at Geisinger (an integrated health system located in a rural, generally conservative area), this case report provides insights to overcome challenges in 4 critical areas: (1) enabling the EHR to collect and use information to support the health-care needs of LGBTQ+ patients, (2) building a culture of awareness and caring, empowering members of the health-care team to break down barriers of misunderstanding and mistrust, (3) developing services to support the needs of LGBTQ+ patients, and (4) partnering with local communities to become a trusted health-care provider.

Providers Electing to Receive Electronic Result Notifications: Demographics and Motivation.

BACKGROUND: Automated electronic result notifications can alert health care providers of important clinical results. In contrast to historical notification systems, which were predominantly focused on critical laboratory abnormalities and often not very customizable, modern electronic health records provide capabilities for subscription-based electronic notification. This capability has not been well studied. OBJECTIVES: The purpose of this study was to develop an understanding of when and how a provider decides to use a subscription-based electronic notification. Better appreciation for the factors that contribute to selecting such notifications could aid in improving the functionality of these tools. METHODS: We performed an 8-month quantitative assessment of 3,291 notifications and a qualitative survey assessment of 73 providers who utilized an elective notification tool in our electronic health record. RESULTS: We found that most notifications were requested by attending physicians (∼60%) and from internal medicine specialty (∼25%). Most providers requested only a few notifications while a small minority (nearly 5%) requested 10 or more in the study period. The majority (nearly 30%) of requests were for chemistry laboratories. Survey respondents reported using the tool predominantly for important or time-sensitive laboratories. Overall opinions of the tool were positive (median = 7 out of 10, 95% confidence interval: 6-9), with 40% of eligible respondents reporting the tool improved quality of care. Reported examples included time to result review, monitoring of heparin drips, and reviewing pathology results. CONCLUSION: Developing an understanding for when and how providers decide to be notified of clinical results can help aid in the design and improvement of clinical tools, such as improved elective notifications. These tools may lead to reduced time to result review which could in turn improve clinical care quality.