Measuring Electronic Health Record Use in the Pediatric ICU Using Audit-Logs and Screen Recordings.

BACKGROUND: Time spent in the electronic health record (EHR) has been identified as an important unit of measure for health care provider clinical activity. The lack of validation of audit-log based inpatient EHR time may have resulted in underuse of this data in studies focusing on inpatient patient outcomes, provider efficiency, provider satisfaction, etc. This has also led to a dearth of clinically relevant EHR usage metrics consistent with inpatient provider clinical activity. OBJECTIVE: The aim of our study was to validate audit-log based EHR times using observed EHR-times extracted from screen recordings of EHR usage in the inpatient setting. METHODS: This study was conducted in a 36-bed pediatric intensive care unit (PICU) at Lucile Packard Children's Hospital Stanford between June 11 and July 14, 2020. Attending physicians, fellow physicians, hospitalists, and advanced practice providers with ≥0.5 full-time equivalent (FTE) for the prior four consecutive weeks and at least one EHR session recording were included in the study. Citrix session recording player was used to retrospectively review EHR session recordings that were captured as the provider interacted with the EHR. RESULTS: EHR use patterns varied by provider type. Audit-log based total EHR time correlated strongly with both observed total EHR time (r = 0.98, p < 0.001) and observed active EHR time (r = 0.95, p < 0.001). Each minute of audit-log based total EHR time corresponded to 0.95 (0.87-1.02) minutes of observed total EHR time and 0.75 (0.67-0.83) minutes of observed active EHR time. Results were similar when stratified by provider role. CONCLUSION: Our study found inpatient audit-log based EHR time to correlate strongly with observed EHR time among pediatric critical care providers. These findings support the use of audit-log based EHR-time as a surrogate measure for inpatient provider EHR use, providing an opportunity for researchers and other stakeholders to leverage EHR audit-log data in measuring clinical activity and tracking outcomes of workflow improvement efforts longitudinally and across provider groups.

Improved Medical Student Engagement with EHR Documentation following the 2018 Centers for Medicare and Medicaid Billing Changes.

BACKGROUND: Medical student note writing is an important part of the training process but has suffered in the electronic health record (EHR) era as a result of student notes being excluded from the billable encounter. The 2018 CMS billing changes allow for medical student notes to be used for billable services provided that physical presence requirements are met, and attending physicians satisfy performance requirements and verify documentation. This has the potential to improve medical student engagement and decrease physician documentation burden. METHODS: Our institution implemented medical student notes as part of the billable encounter in August 2018 with support of our compliance department. Note characteristics including number, type, length, and time in note were analyzed before and after implementation. Rotating medical students were surveyed regarding their experience following implementation. RESULTS: There was a statistically significant increase in the number of student-authored notes following implementation. Attending physicians' interactions with student notes greatly increased following the change (4% of student notes reviewed vs. 84% of student notes). Surveyed students reported that having their notes as part of the billable record made their notes more meaningful and enhanced their learning. The majority of surveyed students also agreed that they received more feedback following the change. CONCLUSION: Medical students are interested in writing notes for education and feedback. Inclusion of their notes as part of the billable record can facilitate their learning and increase their participation in the note writing process.

Pediatric Subspecialty Adoption of Telemedicine Amidst the COVID-19 Pandemic: An Early Descriptive Analysis.

Telemedicine has rapidly expanded in many aspects of pediatric care as a result of the COVID-19 pandemic. However, little is known about what factors may make pediatric subspeciality care more apt to long-term adoption of telemedicine. To better delineate the potential patient, provider, and subspecialty factors which may influence subspecialty adoption of telemedicine, we reviewed our institutional experience. The top 36 pediatric subspecialties at Stanford Children's Health were classified into high telemedicine adopters, low telemedicine adopters, and telemedicine reverters. Distance from the patient's home, primary language, insurance type, institutional factors such as wait times, and subspecialty-specific clinical differences correlated with differing patterns of telemedicine adoption. With greater awareness of these factors, institutions and providers can better guide patients in determining which care may be best suited for telemedicine and develop sustainable long-term telemedicine programming.

Measuring success: perspectives from three optimization programs on assessing impact in the age of burnout.

Electronic health record (EHR) optimization has been identified as a best practice to reduce burnout and improve user satisfaction; however, measuring success can be challenging. The goal of this manuscript is to describe the limitations of measuring optimizations and opportunities to combine assessments for a more comprehensive evaluation of optimization outcomes. The authors review lessons from 3 U.S. healthcare institutions that presented their experiences and recommendations at the American Medical Informatics Association 2020 Clinical Informatics conference, describing uses and limitations of vendor time-based reports and surveys utilized in optimization programs. Compiling optimization outcomes supports a multi-faceted approach that can produce assessments even as time-based reports and technology change. The authors recommend that objective measures of optimization must be combined with provider and clinician-defined value to provide long term improvements in user satisfaction and reduce EHR-related burnout.

Electronic health record (EHR) training program identifies a new tool to quantify the EHR time burden and improves providers' perceived control over their workload in the EHR.

OBJECTIVE: To understand if providers who had additional electronic health record (EHR) training improved their satisfaction, decreased personal EHR-use time, and decreased turnaround time on tasks. MATERIALS AND METHODS: This pre-post study with no controls evaluated the impact of a supplemental EHR training program on a group of academic and community practice clinicians that previously had go-live group EHR training and 20 months experience using this EHR on self-reported data, calculated EHR time, and vendor-reported metrics. RESULTS: Providers self-reported significant improvements in their knowledge of efficiency tools in the EHR after training and doubled (significant) their preference list entries (mean pre = 38.1 [65.88], post = 63.5 [90.47], P < .01). Of the 7 EHR satisfaction variables, only 1 self-reported variable significantly improved after training: Control over my workload in the EHR (mean pre = 2.7 [0.96], post = 3.0 [1.04], P < .01). There was no significant decrease in their calculated EHR usage outside of clinic (mean pre = 0.39 [0.77] to post = 0.37 [0.48], P = .73). No significant difference was seen in turnaround time for patient calls (mean pre = 2.3 [2.06] days, post = 1.9 [1.76] days, P = .08) and results (mean before = 4.0 [2.79] days, after = 3.2 [2.33] days, P = .03). DISCUSSION: Multiple sources of data provide a holistic view of the provider experience in the EHR. This study suggests that individualized EHR training can improve the knowledge of EHR tools and satisfaction with their perceived control of EHR workload, however this did not translate into less Clinician Logged-In Outside Clinic (CLOC) time, a calculated metric, nor quicker turnaround on in box tasks. CLOC time emerged as a potential less-costly surrogate metric for provider satisfaction in EHR work than surveying clinicians. Further study is required to understand the cost-benefit of various interventions to decrease CLOC time. CONCLUSIONS: This supplemental EHR training session, 20 months post go-live, where most participants elected to receive 2 or fewer sessions did significantly improve provider satisfaction with perceived control over their workload in the EHR, but it was not effective in decreasing EHR-use time outside of clinic. CLOC time, a calculated metric, could be a practical trackable surrogate for provider satisfaction (inverse correlation) with after-hours time spent in the EHR. Further study into interventions that decrease CLOC time and improve turnaround time to respond to inbox tasks are suggested next steps.

Designing An Individualized EHR Learning Plan For Providers.

Electronic Health Records (EHRs) have been quickly implemented for meaningful use incentives; however these implementations have been associated with provider dissatisfaction and burnout. There are no previously reported instances of a comprehensive EHR educational program designed to engage providers and assist in improving efficiency and understanding of the EHR. Utilizing adult learning theory as a framework, Stanford Children's Health designed a tailored provider efficiency program with various inputs from: (1) provider specific EHR data; (2) provider survey data; and (3) structured observation sessions. This case report outlines the design of this individualized training program including team structure, resource requirements, and early provider response. CITATION: Stevens LA, DiAngi YT, Schremp JD, Martorana MJ, Miller RE, Lee TC, Pageler NM. Designing An Individualized EHR Learning Plan. Appl Clin Inform 2017; 8:924-935 https://doi.org/10.4338/040054.

Immunization registries in the EMR Era.

BACKGROUND: The CDC established a national objective to create population-based tracking of immunizations through regional and statewide registries nearly 2 decades ago, and these registries have increased coverage rates and reduced duplicate immunizations. With increased adoption of commercial electronic medical records (EMR), some institutions have used unidirectional links to send immunization data to designated registries. However, access to these registries within a vendor EMR has not been previously reported. PURPOSE: To develop a visually integrated interface between an EMR and a statewide immunization registry at a previously non-reporting hospital, and to assess subsequent changes in provider use and satisfaction. METHODS: A group of healthcare providers were surveyed before and after implementation of the new interface. The surveys addressed access of the California Immunization Registry (CAIR), and satisfaction with the availability of immunization information. Information Technology (IT) teams developed a "smart-link" within the electronic patient chart that provides a single-click interface for visual integration of data within the CAIR database. RESULTS: Use of the tool has increased in the months since its initiation, and over 20,000 new immunizations have been exported successfully to CAIR since the hospital began sharing data with the registry. Survey data suggest that providers find this tool improves workflow and overall satisfaction with availability of immunization data. (p=0.009). CONCLUSIONS: Visual integration of external registries into a vendor EMR system is feasible and improves provider satisfaction and registry reporting.