Telemedicine and In-Person Visit Modality Mix and Electronic Health Record Use in Primary Care.

This cross-sectional study investigates the association between day-to-day changes in telemedicine share and clinician time spent on electronic health record (EHR) use.

Interoperability in the Wild: Comparison of Real-World Electronic C-CDA Documents from Two Sources.

Although health information exchange (HIE) networks exist in multiple nations, providers still require access multiple sources to obtain medical records. We sought to measure and compare differences in data presence and concordance across regional HIE and EHR vendor-based networks. Using 1,054 randomly selected patients from a large health system in the US, we generated consolidated clinical document architecture (C-CDA) documents from each network. 778 (74%) patients had at least one C-CDA document present from either source. Among these patients, two-thirds had information in only one source. All documents contained demographics, but less than half of patients had data in clinical data domains. Moreover, data across HIE networks were not concordant. Results suggest that HIE networks have different, likely complementary, data available for the same patient, suggesting the need for better integration and deduplication for national HIE efforts.

The role of organizations in shaping physician use of electronic health records.

OBJECTIVE: The aim of the study was to (1) characterize organizational differences in primary care physicians' electronic health record (EHR) behavior; (2) assess within-organization consistency in EHR behaviors; and (3) identify whether organizational consistency is associated with physician-level efficiency. DATA SOURCES: EHR metadata capturing averaged weekly measures of EHR time and documentation composition from 75,124 US primary care physicians across 299 organizations between September 2020 and May 2021 were taken. EHR time measures include active time in orders, chart review, notes, messaging, time spent outside of scheduled hours, and total EHR time. Documentation composition measures include note length and percentage use of templated text or copy/paste. Efficiency is measured as the percent of visits with same-day note completion. STUDY DESIGN: All analyses are cross-sectional. Across-organization differences in EHR use and documentation composition are presented via 90th-to-10th percentile ratios of means and SDs. Multilevel modeling with post-estimation variance partitioning assesses the extent of an organizational signature-the proportion of variation in our measures attributable to organizations (versus specialty and individual behaviors). We measured organizational internal consistency for each measure via organization-level SD, which we grouped into quartiles for regression. Association between internally consistent (i.e., low SD) organizational EHR use and physician-level efficiency was assessed with multi-variable OLS models. DATA COLLECTION: Extraction from Epic's Signal platform used for measuring provider EHR efficiency. PRINCIPAL FINDINGS: EHR time per visit for physicians at a 90th percentile organization is 1.94 times the average EHR time at a 10th percentile organization. There is little evidence, on average, of an organizational signature. However, physicians in organizations with high internal consistency in EHR use demonstrate increased efficiency. Physicians in organizations with the highest internal consistency (top quartile) have a 3.77 percentage point higher same-day visit closure rates compared with peers in bottom quartile organizations (95% confidence interval: 0.0142-0.0612). CONCLUSIONS: Results suggest unrealized opportunities for organizations and policymakers to support consistency in how physicians engage in EHR-supported work.

Guidance for reporting analyses of metadata on electronic health record use.

INTRODUCTION: Research on how people interact with electronic health records (EHRs) increasingly involves the analysis of metadata on EHR use. These metadata can be recorded unobtrusively and capture EHR use at a scale unattainable through direct observation or self-reports. However, there is substantial variation in how metadata on EHR use are recorded, analyzed and described, limiting understanding, replication, and synthesis across studies. RECOMMENDATIONS: In this perspective, we provide guidance to those working with EHR use metadata by describing 4 common types, how they are recorded, and how they can be aggregated into higher-level measures of EHR use. We also describe guidelines for reporting analyses of EHR use metadata-or measures of EHR use derived from them-to foster clarity, standardization, and reproducibility in this emerging and critical area of research.

The health effects of nursing home specialization in post-acute care.

Nursing homes serve both long-term care and post-acute care (PAC) patients, two groups with distinct financing mechanisms and requirements for care. We examine empirically the effect of nursing home specialization in PAC using 2011-2018 data for Medicare patients admitted to nursing homes following a hospital stay. To address patient selection into specialized nursing homes, we use an instrumental variables approach that exploits variation over time in the distance from the patient's residential ZIP code to the closest nursing home with different levels of PAC specialization. We find that patients admitted to nursing homes more specialized in PAC have lower hospital readmissions and mortality, longer nursing home stays, and higher Medicare spending for the episode of care, suggesting that specialization improves patient outcomes but at higher costs.

Examining primary care provider experiences with using a clinical decision support tool for pain management.

Objective: To evaluate primary care provider (PCP) experiences using a clinical decision support (CDS) tool over 16 months following a user-centered design process and implementation. Materials and Methods: We conducted a qualitative evaluation of the Chronic Pain OneSheet (OneSheet), a chronic pain CDS tool. OneSheet provides pain- and opioid-related risks, benefits, and treatment information for patients with chronic pain to PCPs. Using the 5 Rights of CDS framework, we conducted and analyzed semi-structured interviews with 19 PCPs across 2 academic health systems. Results: PCPs stated that OneSheet mostly contained the right information required to treat patients with chronic pain and was correctly located in the electronic health record. PCPs used OneSheet for distinct subgroups of patients with chronic pain, including patients prescribed opioids, with poorly controlled pain, or new to a provider or clinic. PCPs reported variable workflow integration and selective use of certain OneSheet features driven by their preferences and patient population. PCPs recommended broadening OneSheet access to clinical staff and patients for data entry to address clinician time constraints. Discussion: Differences in patient subpopulations and workflow preferences had an outsized effect on CDS tool use even when the CDS contained the right information identified in a user-centered design process. Conclusions: To increase adoption and use, CDS design and implementation processes may benefit from increased tailoring that accommodates variation and dynamics among patients, visits, and providers.

Variations in Physician Telemedicine Provision.

This cross-sectional study assesses variation in the provision of telemedicine services among primary care physicians and quantifies the extent to which this variation may be explained by the individual physician vs temporal, patient, or visit factors.

I had not time to make it shorter: an exploratory analysis of how physicians reduce note length and time in notes.

OBJECTIVE: We analyze observed reductions in physician note length and documentation time, 2 contributors to electronic health record (EHR) burden and burnout. MATERIALS AND METHODS: We used EHR metadata from January to May, 2021 for 130 079 ambulatory physician Epic users. We identified cohorts of physicians who decreased note length and/or documentation time and analyzed changes in their note composition. RESULTS: 37 857 physicians decreased either note length (n = 15 647), time in notes (n = 15 417), or both (n = 6793). Note length decreases were primarily attributable to reductions in copy/paste text (average relative change of -18.9%) and templated text (-17.2%). Note time decreases were primarily attributable to reductions in manual text (-27.3%) and increases in note content from other care team members (+21.1%). DISCUSSION: Organizations must consider priorities and tradeoffs in the distinct approaches needed to address different contributors to EHR burden. CONCLUSION: Future research should explore scalable burden-reduction initiatives responsive to both note bloat and documentation time.

Documentation dynamics: Note composition, burden, and physician efficiency.

OBJECTIVE: To analyze how physician clinical note length and composition relate to electronic health record (EHR)-based measures of burden and efficiency that have been tied to burnout. DATA SOURCES AND STUDY SETTING: Secondary EHR use metadata capturing physician-level measures from 203,728 US-based ambulatory physicians using the Epic Systems EHR between September 2020 and May 2021. STUDY DESIGN: In this cross-sectional study, we analyzed physician clinical note length and note composition (e.g., content from manual or templated text). Our primary outcomes were three time-based measures of EHR burden (time writing EHR notes, time in the EHR after-hours, and EHR time on unscheduled days), and one measure of efficiency (percent of visits closed in the same day). We used multivariate regression to estimate the relationship between our outcomes and note length and composition. DATA EXTRACTION: Physician-week measures of EHR usage were extracted from Epic's Signal platform used for measuring provider EHR efficiency. We calculated physician-level averages for our measures of interest and assigned physicians to overall note length deciles and note composition deciles from six sources, including templated text, manual text, and copy/paste text. PRINCIPAL FINDINGS: Physicians in the top decile of note length demonstrated greater burden and lower efficiency than the median physician, spending 39% more time in the EHR after hours (p < 0.001) and closing 5.6 percentage points fewer visits on the same day (p < 0.001). Copy/paste demonstrated a similar dose/response relationship, with top-decile copy/paste users closing 6.8 percentage points fewer visits on the same day (p < 0.001) and spending more time in the EHR after hours and on days off (both p < 0.001). Templated text (e.g., Epic's SmartTools) demonstrated a non-linear relationship with burden and efficiency, with very low and very high levels of use associated with increased EHR burden and decreased efficiency. CONCLUSIONS: "Efficiency tools" like copy/paste and templated text meant to reduce documentation burden and increase provider efficiency may have limited efficacy.

Electronic Health Record Legal Settlements in the US Since the 2009 Health Information Technology for Economic and Clinical Health Act.

This cross-sectional study describes allegations of misconduct by electronic health record vendors.

Assessing the use of a clinical decision support tool for pain management in primary care.

Objective: Given time constraints, poorly organized information, and complex patients, primary care providers (PCPs) can benefit from clinical decision support (CDS) tools that aggregate and synthesize problem-specific patient information. First, this article describes the design and functionality of a CDS tool for chronic noncancer pain in primary care. Second, we report on the retrospective analysis of real-world usage of the tool in the context of a pragmatic trial. Materials and methods: The tool known as OneSheet was developed using user-centered principles and built in the Epic electronic health record (EHR) of 2 health systems. For each relevant patient, OneSheet presents pertinent information in a single EHR view to assist PCPs in completing guideline-recommended opioid risk mitigation tasks, review previous and current patient treatments, view patient-reported pain, physical function, and pain-related goals. Results: Overall, 69 PCPs accessed OneSheet 2411 times (since November 2020). PCP use of OneSheet varied significantly by provider and was highly skewed (site 1: median accesses per provider: 17 [interquartile range (IQR) 9-32]; site 2: median: 8 [IQR 5-16]). Seven "power users" accounted for 70% of the overall access instances across both sites. OneSheet has been accessed an average of 20 times weekly between the 2 sites. Discussion: Modest OneSheet use was observed relative to the number of eligible patients seen with chronic pain. Conclusions: Organizations implementing CDS tools are likely to see considerable provider-level variation in usage, suggesting that CDS tools may vary in their utility across PCPs, even for the same condition, because of differences in provider and care team workflows.

Variation in Support for Documentation Among Primary Care Physicians by Gender.

BACKGROUND: There are known gender differences in both time spent on the electronic health record (EHR) and burnout. Previous studies have described potential benefits of staff support for documentation for physician experience and EHR time. It is not known, however, to what extent availability of staff support for documentation differs by gender in the context of primary care. METHODS: This was a cross-sectional study of primary care physicians (PCPs) using data from the 2018 and 2019 National Electronic Health Records Survey administrations. After descriptively analyzing the prevalence of staff support for documentation, we used multivariable logistic regression to identify the adjusted relationship of staff support for documentation with gender. RESULTS: Among the 813 physicians who endorsed having an EHR (92.5% of sample, representing 296,854 physicians), female PCPs were significantly less likely than male PCPs (25.1% vs 37.3%; P = .04) to report having staff support for documentation. This difference was most pronounced in practices with a single physician and practices with more than 50% of patients insured by Medicaid. Gender differences persisted in analyses adjusted for practice ownership and percent of patients insured by Medicaid. CONCLUSIONS: Given positive effects of documentation support and known gender differences in burnout and EHR use times, the differences identified have important implications for the physician workforce. Future research should focus on identifying underlying reasons and potential solutions for the gender differences described.

Using event logs to observe interactions with electronic health records: an updated scoping review shows increasing use of vendor-derived measures.

OBJECTIVE: The aim of this article is to compare the aims, measures, methods, limitations, and scope of studies that employ vendor-derived and investigator-derived measures of electronic health record (EHR) use, and to assess measure consistency across studies. MATERIALS AND METHODS: We searched PubMed for articles published between July 2019 and December 2021 that employed measures of EHR use derived from EHR event logs. We coded the aims, measures, methods, limitations, and scope of each article and compared articles employing vendor-derived and investigator-derived measures. RESULTS: One hundred and two articles met inclusion criteria; 40 employed vendor-derived measures, 61 employed investigator-derived measures, and 1 employed both. Studies employing vendor-derived measures were more likely than those employing investigator-derived measures to observe EHR use only in ambulatory settings (83% vs 48%, P = .002) and only by physicians or advanced practice providers (100% vs 54% of studies, P < .001). Studies employing vendor-derived measures were also more likely to measure durations of EHR use (P < .001 for 6 different activities), but definitions of measures such as time outside scheduled hours varied widely. Eight articles reported measure validation. The reported limitations of vendor-derived measures included measure transparency and availability for certain clinical settings and roles. DISCUSSION: Vendor-derived measures are increasingly used to study EHR use, but only by certain clinical roles. Although poorly validated and variously defined, both vendor- and investigator-derived measures of EHR time are widely reported. CONCLUSION: The number of studies using event logs to observe EHR use continues to grow, but with inconsistent measure definitions and significant differences between studies that employ vendor-derived and investigator-derived measures.

Assessing the impact of patient access to clinical notes on clinician EHR documentation.

Recent policy changes have required health care delivery organizations provide patients electronic access to their clinical notes free of charge. There is concern that this could have an unintended consequence of increased electronic health record (EHR) work as clinicians may feel the need to adapt their documentation practices in light of their notes being accessible to patients, potentially exacerbating EHR-induced clinician burnout. Using a national, longitudinal data set consisting of all ambulatory care physicians and advance practice providers using an Epic Systems EHR, we used an interrupted time-series analysis to evaluate the immediate impact of the policy change on clinician note length and time spent documenting in the EHR. We found no evidence of a change in note length or time spent writing notes following the implementation of the policy, suggesting patient access to clinical notes did not increase documentation workload for clinicians.

Evaluation of electronic recruitment efforts of primary care providers as research subjects during the COVID-19 pandemic.

BACKGROUND: Recruiting healthcare providers as research subjects often rely on in-person recruitment strategies. Little is known about recruiting provider participants via electronic recruitment methods. In this study, conducted during the COVID-19 pandemic, we describe and evaluate a primarily electronic approach to recruiting primary care providers (PCPs) as subjects in a pragmatic randomized controlled trial (RCT) of a decision support intervention. METHODS: We adapted an existing framework for healthcare provider research recruitment, employing an electronic consent form and a mix of brief synchronous video presentations, email, and phone calls to recruit PCPs into the RCT. To evaluate the success of each electronic strategy, we estimated the number of consented PCPs associated with each strategy, the number of days to recruit each PCP and recruitment costs. RESULTS: We recruited 45 of 63 eligible PCPs practicing at ten primary care clinic locations over 55 days. On average, it took 17 business days to recruit a PCP (range 0-48) and required three attempts (range 1-7). Email communication from the clinic leaders led to the most successful recruitments, followed by brief synchronous video presentations at regularly scheduled clinic meetings. We spent approximately $89 per recruited PCP. We faced challenges of low email responsiveness and limited opportunities to forge relationships. CONCLUSION: PCPs can be efficiently recruited at low costs as research subjects using primarily electronic communications, even during a time of high workload and stress. Electronic peer leader outreach and synchronous video presentations may be particularly useful recruitment strategies. TRIAL REGISTRATION: ClinicalTrials.gov , NCT04295135 . Registered 04 March 2020.

Early Changes in Billing and Notes After Evaluation and Management Guideline Change.

BACKGROUND: The American Medical Association updated guidance in 2021 for frequently used billing codes for outpatient evaluation and management (E/M) visits. The intent was to account for provider time outside of face-to-face encounters and to reduce onerous documentation requirements. OBJECTIVE: To analyze E/M visit use, documentation length, and time spent in the electronic health record (EHR) before and after the guideline change. DESIGN: Observational, retrospective, pre-post study. SETTING: U.S.-based ambulatory practices using the Epic Systems EHR. PARTICIPANTS: 303 547 advanced practice providers and physicians across 389 organizations. MEASUREMENTS: Data from September 2020 through April 2021 containing weekly provider-level E/M code and EHR use metadata were extracted from the Epic Signal database. We descriptively analyzed overall and specialty-specific changes in E/M visit use, note length, and time spent in the EHR before and after the new guidelines using provider-level paired t tests. RESULTS: Following the new guidelines, level 3 visits decreased by 2.41 percentage points (95% CI, -2.48 to -2.34 percentage points) to 38.5% of all E/M visits, a 5.9% relative decrease from fall 2020. Level 4 visits increased by 0.89 percentage points (CI, 0.82 to 0.96 percentage points) to 40.9% of E/M visits, a 2.2% relative increase. Level 5 visits (the highest acuity level) increased by 1.85 percentage points (CI, 1.81 to 1.89 percentage points) to 10.1% of E/M visits, a 22.6% relative increase. These changes varied by specialty. We found no meaningful changes in measures of note length or time spent in the EHR. LIMITATION: The Epic ambulatory client base may underrepresent smaller and independent practices. CONCLUSION: Immediate changes in E/M coding contrast with null findings for changes in both note length and EHR time. Provider organizations are positioned to respond more rapidly to billing process changes than to changes in care delivery and associated EHR use behaviors. Fully realizing the intended benefits of this guideline change will require more time, facilitation, and scaling of best practices that more directly address EHR documentation practices and associated burden. PRIMARY FUNDING SOURCE: None.

Growth in health information exchange with ACO market penetration.

OBJECTIVES: First, to assess whether hospitals expand the network breadth of their health information exchange (HIE) partners after joining an accountable care organization (ACO). Second, to analyze whether this HIE network expansion effect varies across markets with differing levels of ACO penetration. STUDY DESIGN: Difference-in-differences analyses of US nonfederal acute care hospitals, 2014-2017. METHODS: We used data from the American Hospital Association Annual Survey and Information Technology Supplement to measure hospital ACO participation, HIE network breadth (defined as number of different partner types), and ACO market penetration at the hospital referral region level. We implemented a difference-in-differences model to estimate changes in hospitals' HIE network breadth with ACO participation in different years. We estimate these effects combined across all markets and stratified by markets with high and low ACO market penetration. RESULTS: In combined analyses, HIE breadth increased by 0.35 partner types with ACO participation, a 30.7% increase (P < .001). In stratified analyses, this effect was larger for hospitals in high-ACO penetration markets (0.41 partner types, a 32.0% increase; P < .001) and smaller for hospitals in low-ACO penetration markets (0.25 partner types, a 24.8% increase; P < .05). We found dynamic effects of ACO adoption illustrating an immediate effect in high-ACO penetration markets and a 2-year delayed effect in low-ACO penetration markets. CONCLUSIONS: Hospitals that joined ACOs increased their HIE breadth, but this effect was heterogenous across markets and across time. Our findings illustrate a "network effect," with large, immediate effects in HIE breadth following ACO participation in high-ACO penetration markets and smaller, delayed effects in low-ACO penetration markets.

Primary care physicians' electronic health record proficiency and efficiency behaviors and time interacting with electronic health records: a quantile regression analysis.

OBJECTIVE: This study aimed to understand the association between primary care physician (PCP) proficiency with the electronic health record (EHR) system and time spent interacting with the EHR. MATERIALS AND METHODS: We examined the use of EHR proficiency tools among PCPs at one large academic health system using EHR-derived measures of clinician EHR proficiency and efficiency. Our main predictors were the use of EHR proficiency tools and our outcomes focused on 4 measures assessing time spent in the EHR: (1) total time spent interacting with the EHR, (2) time spent outside scheduled clinical hours, (3) time spent documenting, and (4) time spent on inbox management. We conducted multivariable quantile regression models with fixed effects for physician-level factors and time in order to identify factors that were independently associated with time spent in the EHR. RESULTS: Across 441 primary care physicians, we found mixed associations between certain EHR proficiency behaviors and time spent in the EHR. Across EHR activities studied, QuickActions, SmartPhrases, and documentation length were positively associated with increased time spent in the EHR. Models also showed a greater amount of help from team members in note writing was associated with less time spent in the EHR and documenting. DISCUSSION: Examining the prevalence of EHR proficiency behaviors may suggest targeted areas for initial and ongoing EHR training. Although documentation behaviors are key areas for training, team-based models for documentation and inbox management require further study. CONCLUSIONS: A nuanced association exists between physician EHR proficiency and time spent in the EHR.