Effect of an Electronic Health Record-Based Intervention on Documentation Practices.

BACKGROUND: Documentation burden is one of the largest contributors to physician burnout. Evaluation and Management (E&M) coding changes were implemented in 2021 to alleviate documentation burden. OBJECTIVES: We used this opportunity to develop documentation best practices, implement new electronic health record (EHR) tools, and study the potential impact on provider experiences with documentation related to these 2021 E&M changes, documentation length, and time spent documenting at an academic medical center. METHODS: Five actionable best practices, developed through a consensus-driven, multidisciplinary approach in November 2020, led to the creation of two new ambulatory note templates, one for E&M visits (implemented in January 2021) and another for preventative visits (implemented in May 2021). As part of a quality-improvement initiative at nine faculty primary care clinics, surveys were developed utilizing a 5-point Likert scale to assess provider perceptions and deidentified EHR metadata (Signal, Epic Systems) were analyzed to measure changes in EHR use metrics between a pre-E&M changes timeframe (August 2020-December 2020) and a post-E&M change timeframe (August 2021-December 2021). A subgroup analysis was conducted comparing EHR use metrics among note template utilizers versus nonutilizers. Any provider who used one of the note templates at least once was categorized as a utilizer. RESULTS: Between January 2021 and December 2021, the adoption of the E&M visit template was 31,480 instances among 120 unique ambulatory providers, and adoption of the preventative visit template was 1,464 instances among 22 unique ambulatory providers. Survey response rate among faculty primary care providers was 82% (88/107): 55% (48/88) believed the 2021 E&M changes provided an opportunity to reduce documentation burden, and 28% reported favorable satisfaction with time spent documenting. Among providers who reported using one or both of the new note templates, 81% (35/43) of survey respondents reported favorable satisfaction with new note templates. EHR use metric analyses revealed a small, yet significant reduction in time in notes per appointment (p = 0.004) with no significant change in documentation length of notes (p = 0.45). Note template utilization was associated with a statistically significant reduction in documentation length (p = 0.034). CONCLUSION: This study shows modest progress in improving EHR use measures of documentation length and time spent documenting following the 2021 E&M changes, but without great improvement in perceived documentation burden. Additional tools are needed to reduce documentation burden and further research is needed to understand the impact of these interventions.

Evaluation of a Large Language Model to Identify Confidential Content in Adolescent Encounter Notes.

This cross-sectional study assesses the ability of a language learning model to classify whether a progress note contains confidential information and to identify the specific confidential content in the note.

Variation in pediatric and adolescent electronic health data sharing practices under the 21st Century Cures Act.

OBJECTIVE: To describe real-world practices and variation in implementation of the Information Blocking provisions amongst healthcare organizations caring for pediatric patients. MATERIALS AND METHODS: An online survey regarding implementation practices was distributed to representatives from 10 participating US healthcare organizations located in 6 different states. The survey was followed by structured interviews conducted through video conference. Information was gathered about implementation practices at each organization, with a focus on patient and proxy portal access to, and segmentation capabilities of, certain data classes listed in the United States Core Data for Interoperability Version 1. RESULTS: All organizations had implemented the information blocking provisions at their institution. All organizations utilized different portal account types for proxies and users. All organizations reported the capability of sharing labs, medications, problem lists, imaging, and notes with the parent/guardian of the non-adolescent minor user with differences in how sensitive elements within the data classes were protected. Variability existed in how data was shared with the remaining user types. DISCUSSION: Significant variability exists in how organizations have implemented the information blocking rules. Variation in data sharing and data access between institutions can result in privacy breaches and create confusion about completeness of data for patients and families. CONCLUSION: Healthcare organizations have utilized varying strategies to comply with the information blocking provisions of the 21st Century Cures Act. Increased clarity from the Office of the National Coordinator for Health Information Technology on minor, adolescent, and caregiver privacy and improved segmentation capabilities from Electronic Health Record vendors is needed.

The Prevalence of Confidential Content in Adolescent Progress Notes Prior to the 21st Century Cures Act Information Blocking Mandate.

BACKGROUND: The 21st Century Cures Act information blocking final rule mandated the immediate and electronic release of health care data in 2020. There is anecdotal concern that a significant amount of information is documented in notes that would breach adolescent confidentiality if released electronically to a guardian. OBJECTIVES: The purpose of this study was to quantify the prevalence of confidential information, based on California laws, within progress notes for adolescent patients that would be released electronically and assess differences in prevalence across patient demographics. METHODS: This is a single-center retrospective chart review of outpatient progress notes written between January 1, 2016, and December 31, 2019, at a large suburban academic pediatric network. Notes were labeled into one of three confidential domains by five expert reviewers trained on a rubric defining confidential information for adolescents derived from California state law. Participants included a random sampling of eligible patients aged 12 to 17 years old at the time of note creation. Secondary analysis included prevalence of confidentiality across age, gender, language spoken, and patient race. RESULTS: Of 1,200 manually reviewed notes, 255 notes (21.3%) (95% confidence interval: 19-24%) contained confidential information. There was a similar distribution among gender and age and a majority of English speaking (83.9%) and white or Caucasian patients (41.2%) in the cohort. Confidential information was more likely to be found in notes for females (p < 0.05) as well as for English-speaking patients (p < 0.05). Older patients had a higher probability of notes containing confidential information (p < 0.05). CONCLUSION: This study demonstrates that there is a significant risk to breach adolescent confidentiality if historical progress notes are released electronically to proxies without further review or redaction. With increased sharing of health care data, there is a need to protect the privacy of the adolescents and prevent potential breaches of confidentiality.

A Natural Language Processing Model to Identify Confidential Content in Adolescent Clinical Notes.

BACKGROUND: The 21st Century Cures Act mandates the immediate, electronic release of health information to patients. However, in the case of adolescents, special consideration is required to ensure that confidentiality is maintained. The detection of confidential content in clinical notes may support operational efforts to preserve adolescent confidentiality while implementing information sharing. OBJECTIVES: This study aimed to determine if a natural language processing (NLP) algorithm can identify confidential content in adolescent clinical progress notes. METHODS: A total of 1,200 outpatient adolescent progress notes written between 2016 and 2019 were manually annotated to identify confidential content. Labeled sentences from this corpus were featurized and used to train a two-part logistic regression model, which provides both sentence-level and note-level probability estimates that a given text contains confidential content. This model was prospectively validated on a set of 240 progress notes written in May 2022. It was subsequently deployed in a pilot intervention to augment an ongoing operational effort to identify confidential content in progress notes. Note-level probability estimates were used to triage notes for review and sentence-level probability estimates were used to highlight high-risk portions of those notes to aid the manual reviewer. RESULTS: The prevalence of notes containing confidential content was 21% (255/1,200) and 22% (53/240) in the train/test and validation cohorts, respectively. The ensemble logistic regression model achieved an area under the receiver operating characteristic of 90 and 88% in the test and validation cohorts, respectively. Its use in a pilot intervention identified outlier documentation practices and demonstrated efficiency gains over completely manual note review. CONCLUSION: An NLP algorithm can identify confidential content in progress notes with high accuracy. Its human-in-the-loop deployment in clinical operations augmented an ongoing operational effort to identify confidential content in adolescent progress notes. These findings suggest NLP may be used to support efforts to preserve adolescent confidentiality in the wake of the information blocking mandate.