Automated Identification of Fall-related Injuries in Unstructured Clinical Notes.

Fall-related injuries (FRIs) are a major cause of hospitalizations among older patients, but identifying them in unstructured clinical notes poses challenges for large-scale research. In this study, we developed and evaluated Natural Language Processing (NLP) models to address this issue. We utilized all available clinical notes from the Mass General Brigham for 2,100 older adults, identifying 154,949 paragraphs of interest through automatic scanning for FRI-related keywords. Two clinical experts directly labeled 5,000 paragraphs to generate benchmark-standard labels, while 3,689 validated patterns were annotated, indirectly labeling 93,157 paragraphs as validated-standard labels. Five NLP models, including vanilla BERT, RoBERTa, Clinical-BERT, Distil-BERT, and SVM, were trained using 2,000 benchmark paragraphs and all validated paragraphs. BERT-based models were trained in three stages: Masked Language Modeling, General Boolean Question Answering (QA), and QA for FRI. For validation, 500 benchmark paragraphs were used, and the remaining 2,500 for testing. Performance metrics (precision, recall, F1 scores, Area Under ROC [AUROC] or Precision-Recall [AUPR] curves) were employed by comparison, with RoBERTa showing the best performance. Precision was 0.90 [0.88-0.91], recall [0.90-0.93], F1 score 0.90 [0.89-0.92], AUROC and AUPR curves of 0.96 [0.95-0.97]. These NLP models accurately identify FRIs from unstructured clinical notes, potentially enhancing clinical notes-based research efficiency.

Comparative Effectiveness and Safety of Seizure Prophylaxis Among Adults After Acute Ischemic Stroke.

BACKGROUND: Older adults occasionally receive seizure prophylaxis in an acute ischemic stroke (AIS) setting, despite safety concerns. There are no trial data available about the net impact of early seizure prophylaxis on post-AIS survival. METHODS: Using a stroke registry (American Heart Association's Get With The Guidelines) individually linked to electronic health records, we examined the effect of initiating seizure prophylaxis (ie, epilepsy-specific antiseizure drugs) within 7 days of an AIS admission versus not initiating in patients ≥65 years admitted for a new, nonsevere AIS (National Institutes of Health Stroke Severity score ≤20) between 2014 and 2021 with no recorded use of epilepsy-specific antiseizure drugs in the previous 3 months. We addressed confounding by using inverse-probability weights. We performed standardization accounting for pertinent clinical and health care factors (eg, National Institutes of Health Stroke Severity scale, prescription counts, seizure-like events). RESULTS: The study sample included 151 patients who received antiseizure drugs and 3020 who did not. The crude 30-day mortality risks were 219 deaths per 1000 patients among epilepsy-specific antiseizure drugs initiators and 120 deaths per 1000 among noninitiators. After standardization, the estimated mortality was 251 (95% CI, 190-307) deaths per 1000 among initiators and 120 (95% CI, 86-144) deaths per 1000 among noninitiators, corresponding to a risk difference of 131 (95% CI, 65-200) excess deaths per 1000 patients. In the prespecified subgroup analyses, the risk difference was 52 (95% CI, 11-72) among patients with minor AIS and 138 (95% CI, 52-222) among moderate-to-severe AIS patients. Similarly, the risk differences were 86 (95% CI, 18-118) and 157 (95% CI, 57-219) among patients aged 65 to 74 years and ≥75 years, respectively. CONCLUSIONS: There was a higher risk of 30-day mortality associated with initiating versus not initiating seizure prophylaxis within 7 days post-AIS. This study does not support the role of seizure prophylaxis in reducing 30-day poststroke mortality.

Identifying Medicare Beneficiaries With Delirium.

BACKGROUND: Each year, thousands of older adults develop delirium, a serious, preventable condition. At present, there is no well-validated method to identify patients with delirium when using Medicare claims data or other large datasets. We developed and assessed the performance of classification algorithms based on longitudinal Medicare administrative data that included International Classification of Diseases, 10th Edition diagnostic codes. METHODS: Using a linked electronic health record (EHR)-Medicare claims dataset, 2 neurologists and 2 psychiatrists performed a standardized review of EHR records between 2016 and 2018 for a stratified random sample of 1002 patients among 40,690 eligible subjects. Reviewers adjudicated delirium status (reference standard) during this 3-year window using a structured protocol. We calculated the probability that each patient had delirium as a function of classification algorithms based on longitudinal Medicare claims data. We compared the performance of various algorithms against the reference standard, computing calibration-in-the-large, calibration slope, and the area-under-receiver-operating-curve using 10-fold cross-validation (CV). RESULTS: Beneficiaries had a mean age of 75 years, were predominately female (59%), and non-Hispanic Whites (93%); a review of the EHR indicated that 6% of patients had delirium during the 3 years. Although several classification algorithms performed well, a relatively simple model containing counts of delirium-related diagnoses combined with patient age, dementia status, and receipt of antipsychotic medications had the best overall performance [CV- calibration-in-the-large <0.001, CV-slope 0.94, and CV-area under the receiver operating characteristic curve (0.88 95% confidence interval: 0.84-0.91)]. CONCLUSIONS: A delirium classification model using Medicare administrative data and International Classification of Diseases, 10th Edition diagnosis codes can identify beneficiaries with delirium in large datasets.

Establishing a learning healthcare system to improve health outcomes for people with epilepsy.

OBJECTIVE: To describe the organization of the Epilepsy Learning Healthcare System (ELHS), a network that aims to improve care outcomes for people with epilepsy (PWE). MATERIALS AND METHODS: Patients and family partners, providers, researchers, epidemiologists, and other leaders collaborated to recruit epilepsy centers and community services organizations into a novel learning network. A multidisciplinary Coordinating Committee developed ELHS governance and organizational structure, including four key planning Cores (Community, Clinical, Quality Improvement, and Data). Through Quality Improvement (QI) methodology grounded in the Institute for Healthcare Improvement (IHI) model, including iterative Plan-Do-Study-Act (PDSA) rapid learning cycles and other learning and sharing sessions, ELHS equipped epilepsy centers and community organizations with tools to standardize, measure, share, and improve key aspects of epilepsy care. The initial learning cycles addressed provider documentation of seizure frequency and type, and also screening for medication adherence barriers. Rapid learning cycles have been carried out on these initial measures in both clinical centers and community-based settings. Additional key measures have been defined for quality of life, screening, and treatment for mental health and behavioral comorbidities, transition from pediatric to adult care, counseling for women and girls living with epilepsy, referral for specialty care, and prevention and treatment of seizure clusters and status epilepticus. RESULTS: It is feasible to adopt a learning healthcare system framework in epilepsy centers and community services organizations. Through structured collaboration between epilepsy care providers, community support organizations, PWE, and their families/caregivers we have identified new opportunities to improve outcomes that are not available in traditional care models.

Benzodiazepine Initiation Effect on Mortality Among Medicare Beneficiaries Post Acute Ischemic Stroke.

Rationale: Despite guideline warnings, older acute ischemic stroke (AIS) survivors still receive benzodiazepines (BZD) for agitation, insomnia, and anxiety despite being linked to severe adverse effects, such as excessive somnolence and respiratory depression. Due to polypharmacy, drug metabolism, comorbidities, and complications during the sub-acute post-stroke period, older adults are more susceptible to these adverse effects. We examined the impact of receiving BZDs within 30 days post-discharge on survival among older Medicare beneficiaries after an AIS. Methods: Using the Medicare Provider Analysis and Review (MedPAR) dataset, Traditional fee-for-service Medicare (TM) claims, and Part D Prescription Drug Event data, we analyzed a random 20% sample of TM beneficiaries aged 66 years or older who were hospitalized for AIS between July 1, 2016, and December 31, 2019. Eligible beneficiaries were enrolled in Traditional Medicare Parts A, B, and D for at least 12 months before admission. We excluded beneficiaries who were prescribed a BZD within 90 days before hospitalization, passed away during their hospital stay, left against medical advice, or were discharged to institutional post-acute care. Our primary exposure was BZD initiation within 30 days post-discharge, and the primary outcome was 90-day mortality risk differences (RD) from discharge. We followed a trial emulation process involving cloning, weighting, and censoring, plus we used inverse-probability-of-censoring weighting to address confounding. Results: In a sample of 47,421 beneficiaries, 826 (1.74%) initiated BZD within 30 days after discharge from stroke admission or before readmission, whichever occurred first, and 6,392 (13.48%) died within 90 days. Our study sample had a median age of 79, with an inter-quartile range (IQR) of 12, 55.3% female, 82.9% White, 10.1% Black, 1.7% Hispanic, 2.2% Asian, 0.4% American Native, 1.5% Other and 1.1% Unknown. After standardization based on age, sex, race/ethnicity, length of stay in inpatient, and baseline dementia, the estimated 90-day mortality risk was 159 events per 1,000 (95% CI: 155, 166) for the BZD initiation strategy and 133 events per 1,000 (95% CI: 132, 135) for the non-initiation strategy, with an RD of 26 events per 1,000 (95% CI: 22, 33). Subgroup analyses showed RDs of 0 events per 1,000 (95% CI: -4, 11) for patients aged 66-70, 3 events per 1,000 (95% CI: -1, 13) for patients aged 71-75, 10 events per 1,000 (95% CI: 3, 23) for patients aged 76-80, 27 events per 1,000 (95% CI: 21, 46) for patients aged 81-85, and 84 events per 1,000 (95% CI: 73, 106) for patients aged 86 years or older. RDs were 34 events per 1,000 (95% CI: 26, 48) and 20 events per 1,000 (95% CI: 11, 33) for males and females, respectively. RDs were 87 events per 1,000 (95% CI: 63, 112) for patients with baseline dementia and 18 events per 1,000 (95% CI: 13, 21) for patients without baseline dementia. Conclusion: Initiating BZDs within 30 days post-AIS discharge significantly increased the 90-day mortality risk among Medicare beneficiaries aged 76 and older and for those with baseline dementia. These findings underscore the heightened vulnerability of older adults, especially those with cognitive impairment, to the adverse effects of BZDs.

Improving Seizure Frequency Documentation and Classification.

Background and Objectives: Accurate and reliable seizure data are essential for evaluating treatment strategies and tracking the quality of care in epilepsy clinics. This quality improvement project aimed to increase seizure documentation (i.e., documentation of seizure frequency from 80% to 100%, date of last seizure from 35% to 50%, and International League Against Epilepsy (ILAE) seizure classification from 35% to at least 50%) over 6 months. Methods: We surveyed 7 epileptologists to determine their perceived seizure frequency, ILAE classification, and date of last seizure documentation habits. Baseline data were collected weekly from September to December 2021. Subsequently, we implemented a newly created flowsheet in our Electronic Health Record (EHR) based on the Epilepsy Learning Healthcare System (ELHS) Case Report Forms to increase seizure documentation in a standardized way. Two epileptologists tested this flowsheet tool in their epilepsy clinics between February 2022 and July 2022. Data were collected weekly and compared with documentation from other epileptologists within the same group. Results: Epileptologists at our center believed they documented seizure frequency for 84%-87% of clinic visits, which aligned with baseline data collection, showing they recorded seizure frequency for 83% of clinic visits. Epileptologists believed they documented ILAE classification for 47%-52% of clinic visits, and baseline data showed this was documented in 33% of clinic visits. They also reported documenting the date of the last seizure for 52%-63% of clinic visits, but this occurred in only 35% of clinic visits. After implementing the new flowsheet, documentation increased to nearly 100% for all fields being completed by the providers who tested the flowsheet. Discussion: We demonstrated that by implementing an easy-to-use standardized EHR documentation tool, our documentation of critical metrics, as defined by the ELHS, improved dramatically. This shows that simple and practical interventions can substantially improve clinically meaningful documentation.

No short-term mortality from benzodiazepine use post-acute ischemic stroke after accounting for bias.

BACKGROUND AND OBJECTIVES: Older adults receive benzodiazepines for agitation, anxiety, and insomnia after acute ischemic stroke (AIS). No trials have been conducted to determine if benzodiazepine use affects poststroke mortality in the elderly. METHODS: We examined the association between initiating benzodiazepines within 1 week after AIS and 30-day mortality. We included patients ≥65 years, admitted for new nonsevere AIS (NIH-Stroke-Severity[NIHSS]≤ 20), 2014-2020, with no recorded benzodiazepine use in the previous 3 months and no contraindication for use. We linked a stroke registry to electronic health records, used inverse-probability weighting to address confounding, and estimated the risk difference (RD). A process of cloning, weighting, and censoring was used to avoid immortal time bias. RESULTS: Among 2,584 patients, 389 received benzodiazepines. The crude 30-day mortality risk from treatment initiation was 212/1,000 among patients who received benzodiazepines, while the 30-day mortality was 34/1,000 among those who did not. When follow-up was aligned on day of AIS admission and immortal time was assigned to the two groups, the estimated risks were 27/1,000 and 22/1,000, respectively. Upon further adjustment for confounders, the RD was 5 (-12 to 19) deaths/1,000 patients. CONCLUSION: The observed higher 30-day mortality associated with benzodiazepine initiation within 7 days was largely due to bias.

A replicable, open-source, data integration method to support national practice-based research & quality improvement systems.

OBJECTIVES: The Epilepsy Learning Healthcare System (ELHS) was created in 2018 to address measurable improvements in outcomes for people with epilepsy. However, fragmentation of data systems has been a major barrier for reporting and participation. In this study, we aimed to test the feasibility of an open-source Data Integration (DI) method that connects real-life clinical data to national research and quality improvement (QI) systems. METHODS: The ELHS case report forms were programmed as EPIC SmartPhrases at Mass General Brigham (MGB) in December 2018 and subsequently as EPIC SmartForms in June 2021 to collect actionable, standardized, structured epilepsy data in the electronic health record (EHR) for subsequent pull into the external national registry of the ELHS. Following the QI methodology in the Chronic Care Model, 39 providers, epileptologists and neurologists, incorporated the ELHS SmartPhrase into their clinical workflow, focusing on collecting diagnosis of epilepsy, seizure type according to the International League Against Epilepsy, seizure frequency, date of last seizure, medication adherence and side effects. The collected data was stored in the Enterprise Data Warehouse (EDW) without integration with external systems. We developed and validated a DI method that extracted the data from EDW using structured query language and later preprocessed using text mining. We used the ELHS data dictionary to match fields in the preprocessed notes to obtain the final structured dataset with seizure control information. For illustration, we described the data curated from the care period of 12/2018-12/2021. RESULTS: The cohort comprised a total of 1806 patients with a mean age of 43 years old (SD: 17.0), where 57% were female, 80% were white, and 84% were non-Hispanic/Latino. Using our DI method, we automated the data mining, preprocessing, and exporting of the structured dataset into a local database, to be weekly accessible to clinicians and quality improvers. During the period of SmartPhrase implementation, there were 5168 clinic visits logged by providers documenting each patient's seizure type and frequency. During this period, providers documented 59% patients having focal seizures, 35% having generalized seizures and 6% patients having another type. Of the cohort, 45% patients had private insurance. The resulting structured dataset was bulk uploaded via web interface into the external national registry of the ELHS. CONCLUSIONS: Structured data can be feasibly extracted from text notes of epilepsy patients for weekly reporting to a national learning healthcare system.

Telemedicine Can Support Measurable and High-Quality Epilepsy Care During the COVID-19 Pandemic.

Routine outpatient epilepsy care has shifted from in-person to telemedicine visits in response to safety concerns posed by the coronavirus disease 2019 (COVID-19) pandemic. But whether telemedicine can support and maintain standardized documentation of high-quality epilepsy care remains unknown. In response, the authors conducted a quality improvement study at a level 4 epilepsy center between January 20, 2019, and May 31, 2020. Weekly average completion proportion of standardized documentation used by a team of neurologists for adult patients for the diagnosis of epilepsy, seizure classification, and frequency were analyzed. By December 15, 2019, a 94% average weekly completion proportion of standardized epilepsy care documentation was achieved that was maintained through May 31, 2020. Moreover, during the period of predominately telemedicine encounters in response to the pandemic, the completion proportion was 90%. This study indicates that high completion of standardized documentation of seizure-related information can be sustained during telemedicine appointments for routine outpatient epilepsy care at a level 4 epilepsy center.