Extracting seizure frequency from epilepsy clinic notes: a machine reading approach to natural language processing.

OBJECTIVE: Seizure frequency and seizure freedom are among the most important outcome measures for patients with epilepsy. In this study, we aimed to automatically extract this clinical information from unstructured text in clinical notes. If successful, this could improve clinical decision-making in epilepsy patients and allow for rapid, large-scale retrospective research. MATERIALS AND METHODS: We developed a finetuning pipeline for pretrained neural models to classify patients as being seizure-free and to extract text containing their seizure frequency and date of last seizure from clinical notes. We annotated 1000 notes for use as training and testing data and determined how well 3 pretrained neural models, BERT, RoBERTa, and Bio_ClinicalBERT, could identify and extract the desired information after finetuning. RESULTS: The finetuned models (BERTFT, Bio_ClinicalBERTFT, and RoBERTaFT) achieved near-human performance when classifying patients as seizure free, with BERTFT and Bio_ClinicalBERTFT achieving accuracy scores over 80%. All 3 models also achieved human performance when extracting seizure frequency and date of last seizure, with overall F1 scores over 0.80. The best combination of models was Bio_ClinicalBERTFT for classification, and RoBERTaFT for text extraction. Most of the gains in performance due to finetuning required roughly 70 annotated notes. DISCUSSION AND CONCLUSION: Our novel machine reading approach to extracting important clinical outcomes performed at or near human performance on several tasks. This approach opens new possibilities to support clinical practice and conduct large-scale retrospective clinical research. Future studies can use our finetuning pipeline with minimal training annotations to answer new clinical questions.

A Full-Stack Application for Detecting Seizures and Reducing Data During Continuous Electroencephalogram Monitoring.

Continuous electroencephalogram monitoring is associated with lower mortality in critically ill patients; however, it is underused due to the resource-intensive nature of manually interpreting prolonged streams of continuous electroencephalogram data. Here, we present a novel real-time, machine learning-based alerting and monitoring system for epilepsy and seizures that dramatically reduces the amount of manual electroencephalogram review. METHODS: We developed a custom data reduction algorithm using a random forest and deployed it within an online cloud-based platform, which streams data and communicates interactively with caregivers via a web interface to display algorithm results. We developed real-time, machine learning-based alerting and monitoring system for epilepsy and seizures on continuous electroencephalogram recordings from 77 patients undergoing routine scalp ICU electroencephalogram monitoring and tested it on an additional 20 patients. RESULTS: We achieved a mean seizure sensitivity of 84% in cross-validation and 85% in testing, as well as a mean specificity of 83% in cross-validation and 86% in testing, corresponding to a high level of data reduction. This study validates a platform for machine learning-assisted continuous electroencephalogram analysis and represents a meaningful step toward improving utility and decreasing cost of continuous electroencephalogram monitoring. We also make our high-quality annotated dataset of 97 ICU continuous electroencephalogram recordings public for others to validate and improve upon our methods.