Improving Methods of Identifying Anaphylaxis for Medical Product Safety Surveillance Using Natural Language Processing and Machine Learning.

We sought to determine whether machine learning and natural language processing (NLP) applied to electronic medical records could improve performance of automated health-care claims-based algorithms to identify anaphylaxis events using data on 516 patients with outpatient, emergency department, or inpatient anaphylaxis diagnosis codes during 2015-2019 in 2 integrated health-care institutions in the Northwest United States. We used one site's manually reviewed gold-standard outcomes data for model development and the other's for external validation based on cross-validated area under the receiver operating characteristic curve (AUC), positive predictive value (PPV), and sensitivity. In the development site 154 (64%) of 239 potential events met adjudication criteria for anaphylaxis compared with 180 (65%) of 277 in the validation site. Logistic regression models using only structured claims data achieved a cross-validated AUC of 0.58 (95% CI: 0.54, 0.63). Machine learning improved cross-validated AUC to 0.62 (0.58, 0.66); incorporating NLP-derived covariates further increased cross-validated AUCs to 0.70 (0.66, 0.75) in development and 0.67 (0.63, 0.71) in external validation data. A classification threshold with cross-validated PPV of 79% and cross-validated sensitivity of 66% in development data had cross-validated PPV of 78% and cross-validated sensitivity of 56% in external data. Machine learning and NLP-derived data improved identification of validated anaphylaxis events.

Complementary Use of U.S. FDA's Adverse Event Reporting System and Sentinel System to Characterize Direct Oral Anticoagulants-Associated Cutaneous Small Vessel Vasculitis.

BACKGROUND: Cutaneous small vessel vasculitis (CSVV) has been reported after exposure to direct oral anticoagulants (DOACs), such as dabigatran, rivaroxaban, apixaban, and edoxaban. OBJECTIVE: We used the U.S. Food and Drug Administration Adverse Event Reporting System (FAERS) to describe clinical characteristics associated with CSVV among DOAC-exposed patients. Furthermore, we characterized this signal in the Sentinel System to relate the clinical data from the individual FAERS cases to population-based electronic healthcare data. METHODS: We queried FAERS for all cases of CSVV associated with DOACs from U.S. approval date of each DOAC through March 16, 2018. Within the Sentinel System, we identified incident CSVV cases using ICD-9 and ICD-10 diagnosis codes among adults aged ≥ 30 years who received a DOAC in the prior 90 days between January 1, 2010, and June 30, 2018. We excluded patients with evidence of select autoimmune diagnoses in the 183 days prior to their CSVV diagnoses and reported patient characteristics in the 183-day period prior to CSVV diagnoses. RESULTS: In FAERS, we identified 50 cases of CSVV reported with rivaroxaban (n=26), apixaban (n=14), dabigatran (n=9), and edoxaban (n=1). Approximately 50% of the cases reported time to onset within 10 days after DOAC exposure. When specified, the predominant type of CSVV reported was leukocytoclastic vasculitis (n=31), followed by Henoch-Schonlein purpura (n=4). Hospitalization occurred in most of the cases (n=37). Switching of the offending agent after the development of CSVV was reported (n=26). Three rivaroxaban (n=3) cases and one dabigatran case (n=1) reported positive rechallenge. In the Sentinel system, we identified 3659 CSVV cases with prior DOAC exposure, with 85% of events occurring within 10 days. CONCLUSIONS: The assessment of FAERS cases, combined with the temporal clustering of the Sentinel System cases suggest a possible causal relationship of DOACs and CSVV. Future efforts should characterize the risk of CSVV among the various DOAC users.