BERT-based language model for accurate drug adverse event extraction from social media: implementation, evaluation, and contributions to pharmacovigilance practices.

Introduction: Social media platforms serve as a valuable resource for users to share health-related information, aiding in the monitoring of adverse events linked to medications and treatments in drug safety surveillance. However, extracting drug-related adverse events accurately and efficiently from social media poses challenges in both natural language processing research and the pharmacovigilance domain. Method: Recognizing the lack of detailed implementation and evaluation of Bidirectional Encoder Representations from Transformers (BERT)-based models for drug adverse event extraction on social media, we developed a BERT-based language model tailored to identifying drug adverse events in this context. Our model utilized publicly available labeled adverse event data from the ADE-Corpus-V2. Constructing the BERT-based model involved optimizing key hyperparameters, such as the number of training epochs, batch size, and learning rate. Through ten hold-out evaluations on ADE-Corpus-V2 data and external social media datasets, our model consistently demonstrated high accuracy in drug adverse event detection. Result: The hold-out evaluations resulted in average F1 scores of 0.8575, 0.9049, and 0.9813 for detecting words of adverse events, words in adverse events, and words not in adverse events, respectively. External validation using human-labeled adverse event tweets data from SMM4H further substantiated the effectiveness of our model, yielding F1 scores 0.8127, 0.8068, and 0.9790 for detecting words of adverse events, words in adverse events, and words not in adverse events, respectively. Discussion: This study not only showcases the effectiveness of BERT-based language models in accurately identifying drug-related adverse events in the dynamic landscape of social media data, but also addresses the need for the implementation of a comprehensive study design and evaluation. By doing so, we contribute to the advancement of pharmacovigilance practices and methodologies in the context of emerging information sources like social media.

Fingerprinting Interactions between Proteins and Ligands for Facilitating Machine Learning in Drug Discovery.

Molecular recognition is fundamental in biology, underpinning intricate processes through specific protein-ligand interactions. This understanding is pivotal in drug discovery, yet traditional experimental methods face limitations in exploring the vast chemical space. Computational approaches, notably quantitative structure-activity/property relationship analysis, have gained prominence. Molecular fingerprints encode molecular structures and serve as property profiles, which are essential in drug discovery. While two-dimensional (2D) fingerprints are commonly used, three-dimensional (3D) structural interaction fingerprints offer enhanced structural features specific to target proteins. Machine learning models trained on interaction fingerprints enable precise binding prediction. Recent focus has shifted to structure-based predictive modeling, with machine-learning scoring functions excelling due to feature engineering guided by key interactions. Notably, 3D interaction fingerprints are gaining ground due to their robustness. Various structural interaction fingerprints have been developed and used in drug discovery, each with unique capabilities. This review recapitulates the developed structural interaction fingerprints and provides two case studies to illustrate the power of interaction fingerprint-driven machine learning. The first elucidates structure-activity relationships in ß2 adrenoceptor ligands, demonstrating the ability to differentiate agonists and antagonists. The second employs a retrosynthesis-based pre-trained molecular representation to predict protein-ligand dissociation rates, offering insights into binding kinetics. Despite remarkable progress, challenges persist in interpreting complex machine learning models built on 3D fingerprints, emphasizing the need for strategies to make predictions interpretable. Binding site plasticity and induced fit effects pose additional complexities. Interaction fingerprints are promising but require continued research to harness their full potential.

Computational Nanotoxicology Models for Environmental Risk Assessment of Engineered Nanomaterials.

Although engineered nanomaterials (ENMs) have tremendous potential to generate technological benefits in numerous sectors, uncertainty on the risks of ENMs for human health and the environment may impede the advancement of novel materials. Traditionally, the risks of ENMs can be evaluated by experimental methods such as environmental field monitoring and animal-based toxicity testing. However, it is time-consuming, expensive, and impractical to evaluate the risk of the increasingly large number of ENMs with the experimental methods. On the contrary, with the advancement of artificial intelligence and machine learning, in silico methods have recently received more attention in the risk assessment of ENMs. This review discusses the key progress of computational nanotoxicology models for assessing the risks of ENMs, including material flow analysis models, multimedia environmental models, physiologically based toxicokinetics models, quantitative nanostructure-activity relationships, and meta-analysis. Several challenges are identified and a perspective is provided regarding how the challenges can be addressed.

Towards a Light-mediated Gene Therapy for the Eye using Caged Ethinylestradiol and the Inducible Cre/lox System.

Increasingly, retinal pathologies are being treated with virus-mediated gene therapies. To be able to target viral transgene expression specifically to the pathological regions of the retina with light, we established an in vivo photoactivated gene expression paradigm for retinal tissue. Based on the inducible Cre/lox system, we discovered that ethinylestradiol is a suitable alternative to Tamoxifen as ethinylestradiol is more amenable to modification with photosensitive protecting compounds, i.e., "caging." Identification of ethinylestradiol as a ligand for the mutated human estradiol receptor was supported by in silico binding studies showing the reduced binding of caged ethinylestradiol. Caged ethinylestradiol was injected into the eyes of double transgenic GFAP-CreERT2 mice with a Cre-dependent tdTomato reporter transgene followed by irradiation with light of 450 nm. Photoactivation significantly increased retinal tdTomato expression compared to controls. We thus demonstrated a first step towards the development of a targeted, light-mediated gene therapy for the eyes.

Assessments of tumor mutational burden estimation by targeted panel sequencing: A comprehensive simulation analysis.

Tumor mutational burden (TMB), when at a high level, is an emerging indicative factor of sensitivity to immune checkpoint inhibitors. Previous studies have shown that the more affordable and accurate targeted panels can be used to measure TMB as a substitute for whole exome sequencing (WES). However, additional processes, such as hotspot mutations exclusion and TMB adjustment, are usually required to deal with the effect of the limited panel sizes. A comprehensive investigation of the effective factors is needed for accurate TMB estimation by targeted panels. In this study, we quantitatively evaluated the variances of TMB values calculated by WES and targeted panels using 10,000 simulated targeted panels with panel sizes ranging from 0.2 to 3.1 million bases. With The Cancer Genome Atlas (TCGA) cancer samples and mutation profiles, we fixed regressions on WES-TMBs and panel-TMBs to assess the performance of a given targeted panel. Panel size was found as one of the major effective factors of TMB estimation. Meanwhile, by investigating the well-performing small panels that reported TMB values similar to those of WES, we demonstrated the evidence of the cancer type-specific impacts of genes on TMB estimation and identified high-impact gene sets for different cancer types based on the TCGA data. This study revealed the quantitative correlations between TMB variance and panel size, and the potential impacts of individual genes on TMB estimation. Our results suggested that for cancer patients diagnosed using targeted panels, it would be highly beneficial to have the capability to directly measure TMB from the targeted sequencing data. This would greatly assist in making decisions regarding the use of immunotherapies.

Review of machine learning and deep learning models for toxicity prediction.

The ever-increasing number of chemicals has raised public concerns due to their adverse effects on human health and the environment. To protect public health and the environment, it is critical to assess the toxicity of these chemicals. Traditional in vitro and in vivo toxicity assays are complicated, costly, and time-consuming and may face ethical issues. These constraints raise the need for alternative methods for assessing the toxicity of chemicals. Recently, due to the advancement of machine learning algorithms and the increase in computational power, many toxicity prediction models have been developed using various machine learning and deep learning algorithms such as support vector machine, random forest, k-nearest neighbors, ensemble learning, and deep neural network. This review summarizes the machine learning- and deep learning-based toxicity prediction models developed in recent years. Support vector machine and random forest are the most popular machine learning algorithms, and hepatotoxicity, cardiotoxicity, and carcinogenicity are the frequently modeled toxicity endpoints in predictive toxicology. It is known that datasets impact model performance. The quality of datasets used in the development of toxicity prediction models using machine learning and deep learning is vital to the performance of the developed models. The different toxicity assignments for the same chemicals among different datasets of the same type of toxicity have been observed, indicating benchmarking datasets is needed for developing reliable toxicity prediction models using machine learning and deep learning algorithms. This review provides insights into current machine learning models in predictive toxicology, which are expected to promote the development and application of toxicity prediction models in the future.

Machine learning and deep learning for brain tumor MRI image segmentation.

Brain tumors are often fatal. Therefore, accurate brain tumor image segmentation is critical for the diagnosis, treatment, and monitoring of patients with these tumors. Magnetic resonance imaging (MRI) is a commonly used imaging technique for capturing brain images. Both machine learning and deep learning techniques are popular in analyzing MRI images. This article reviews some commonly used machine learning and deep learning techniques for brain tumor MRI image segmentation. The limitations and advantages of the reviewed machine learning and deep learning methods are discussed. Even though each of these methods has a well-established status in their individual domains, the combination of two or more techniques is currently an emerging trend.

A systematic analysis and data mining of opioid-related adverse events submitted to the FAERS database.

The opioid epidemic has become a serious national crisis in the United States. An indepth systematic analysis of opioid-related adverse events (AEs) can clarify the risks presented by opioid exposure, as well as the individual risk profiles of specific opioid drugs and the potential relationships among the opioids. In this study, 92 opioids were identified from the list of all Food and Drug Administration (FDA)-approved drugs, annotated by RxNorm and were classified into 13 opioid groups: buprenorphine, codeine, dihydrocodeine, fentanyl, hydrocodone, hydromorphone, meperidine, methadone, morphine, oxycodone, oxymorphone, tapentadol, and tramadol. A total of 14,970,399 AE reports were retrieved and downloaded from the FDA Adverse Events Reporting System (FAERS) from 2004, Quarter 1 to 2020, Quarter 3. After data processing, Empirical Bayes Geometric Mean (EBGM) was then applied which identified 3317 pairs of potential risk signals within the 13 opioid groups. Based on these potential safety signals, a comparative analysis was pursued to provide a global overview of opioid-related AEs for all 13 groups of FDA-approved prescription opioids. The top 10 most reported AEs for each opioid class were then presented. Both network analysis and hierarchical clustering analysis were conducted to further explore the relationship between opioids. Results from the network analysis revealed a close association among fentanyl, oxycodone, hydrocodone, and hydromorphone, which shared more than 22 AEs. In addition, much less commonly reported AEs were shared among dihydrocodeine, meperidine, oxymorphone, and tapentadol. On the contrary, the hierarchical clustering analysis further categorized the 13 opioid classes into two groups by comparing the full profiles of presence/absence of AEs. The results of network analysis and hierarchical clustering analysis were not only consistent and cross-validated each other but also provided a better and deeper understanding of the associations and relationships between the 13 opioid groups with respect to their adverse effect profiles.

Developing a SARS-CoV-2 main protease binding prediction random forest model for drug repurposing for COVID-19 treatment.

The coronavirus disease 2019 (COVID-19) global pandemic resulted in millions of people becoming infected with the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus and close to seven million deaths worldwide. It is essential to further explore and design effective COVID-19 treatment drugs that target the main protease of SARS-CoV-2, a major target for COVID-19 drugs. In this study, machine learning was applied for predicting the SARS-CoV-2 main protease binding of Food and Drug Administration (FDA)-approved drugs to assist in the identification of potential repurposing candidates for COVID-19 treatment. Ligands bound to the SARS-CoV-2 main protease in the Protein Data Bank and compounds experimentally tested in SARS-CoV-2 main protease binding assays in the literature were curated. These chemicals were divided into training (516 chemicals) and testing (360 chemicals) data sets. To identify SARS-CoV-2 main protease binders as potential candidates for repurposing to treat COVID-19, 1188 FDA-approved drugs from the Liver Toxicity Knowledge Base were obtained. A random forest algorithm was used for constructing predictive models based on molecular descriptors calculated using Mold2 software. Model performance was evaluated using 100 iterations of fivefold cross-validations which resulted in 78.8% balanced accuracy. The random forest model that was constructed from the whole training dataset was used to predict SARS-CoV-2 main protease binding on the testing set and the FDA-approved drugs. Model applicability domain and prediction confidence on drugs predicted as the main protease binders discovered 10 FDA-approved drugs as potential candidates for repurposing to treat COVID-19. Our results demonstrate that machine learning is an efficient method for drug repurposing and, thus, may accelerate drug development targeting SARS-CoV-2.

Quartet DNA reference materials and datasets for comprehensively evaluating germline variant calling performance.

BACKGROUND: Genomic DNA reference materials are widely recognized as essential for ensuring data quality in omics research. However, relying solely on reference datasets to evaluate the accuracy of variant calling results is incomplete, as they are limited to benchmark regions. Therefore, it is important to develop DNA reference materials that enable the assessment of variant detection performance across the entire genome. RESULTS: We established a DNA reference material suite from four immortalized cell lines derived from a family of parents and monozygotic twins. Comprehensive reference datasets of 4.2 million small variants and 15,000 structural variants were integrated and certified for evaluating the reliability of germline variant calls inside the benchmark regions. Importantly, the genetic built-in-truth of the Quartet family design enables estimation of the precision of variant calls outside the benchmark regions. Using the Quartet reference materials along with study samples, batch effects are objectively monitored and alleviated by training a machine learning model with the Quartet reference datasets to remove potential artifact calls. Moreover, the matched RNA and protein reference materials and datasets from the Quartet project enables cross-omics validation of variant calls from multiomics data. CONCLUSIONS: The Quartet DNA reference materials and reference datasets provide a unique resource for objectively assessing the quality of germline variant calls throughout the whole-genome regions and improving the reliability of large-scale genomic profiling.

The Quartet Data Portal: integration of community-wide resources for multiomics quality control.

The Quartet Data Portal facilitates community access to well-characterized reference materials, reference datasets, and related resources established based on a family of four individuals with identical twins from the Quartet Project. Users can request DNA, RNA, protein, and metabolite reference materials, as well as datasets generated across omics, platforms, labs, protocols, and batches. Reproducible analysis tools allow for objective performance assessment of user-submitted data, while interactive visualization tools support rapid exploration of reference datasets. A closed-loop "distribution-collection-evaluation-integration" workflow enables updates and integration of community-contributed multiomics data. Ultimately, this portal helps promote the advancement of reference datasets and multiomics quality control.

Deep Learning Methods for Omics Data Imputation.

One common problem in omics data analysis is missing values, which can arise due to various reasons, such as poor tissue quality and insufficient sample volumes. Instead of discarding missing values and related data, imputation approaches offer an alternative means of handling missing data. However, the imputation of missing omics data is a non-trivial task. Difficulties mainly come from high dimensionality, non-linear or non-monotonic relationships within features, technical variations introduced by sampling methods, sample heterogeneity, and the non-random missingness mechanism. Several advanced imputation methods, including deep learning-based methods, have been proposed to address these challenges. Due to its capability of modeling complex patterns and relationships in large and high-dimensional datasets, many researchers have adopted deep learning models to impute missing omics data. This review provides a comprehensive overview of the currently available deep learning-based methods for omics imputation from the perspective of deep generative model architectures such as autoencoder, variational autoencoder, generative adversarial networks, and Transformer, with an emphasis on multi-omics data imputation. In addition, this review also discusses the opportunities that deep learning brings and the challenges that it might face in this field.

Quartet RNA reference materials improve the quality of transcriptomic data through ratio-based profiling.

Certified RNA reference materials are indispensable for assessing the reliability of RNA sequencing to detect intrinsically small biological differences in clinical settings, such as molecular subtyping of diseases. As part of the Quartet Project for quality control and data integration of multi-omics profiling, we established four RNA reference materials derived from immortalized B-lymphoblastoid cell lines from four members of a monozygotic twin family. Additionally, we constructed ratio-based transcriptome-wide reference datasets between two samples, providing cross-platform and cross-laboratory 'ground truth'. Investigation of the intrinsically subtle biological differences among the Quartet samples enables sensitive assessment of cross-batch integration of transcriptomic measurements at the ratio level. The Quartet RNA reference materials, combined with the ratio-based reference datasets, can serve as unique resources for assessing and improving the quality of transcriptomic data in clinical and biological settings.

Correcting batch effects in large-scale multiomics studies using a reference-material-based ratio method.

BACKGROUND: Batch effects are notoriously common technical variations in multiomics data and may result in misleading outcomes if uncorrected or over-corrected. A plethora of batch-effect correction algorithms are proposed to facilitate data integration. However, their respective advantages and limitations are not adequately assessed in terms of omics types, the performance metrics, and the application scenarios. RESULTS: As part of the Quartet Project for quality control and data integration of multiomics profiling, we comprehensively assess the performance of seven batch effect correction algorithms based on different performance metrics of clinical relevance, i.e., the accuracy of identifying differentially expressed features, the robustness of predictive models, and the ability of accurately clustering cross-batch samples into their own donors. The ratio-based method, i.e., by scaling absolute feature values of study samples relative to those of concurrently profiled reference material(s), is found to be much more effective and broadly applicable than others, especially when batch effects are completely confounded with biological factors of study interests. We further provide practical guidelines for implementing the ratio based approach in increasingly large-scale multiomics studies. CONCLUSIONS: Multiomics measurements are prone to batch effects, which can be effectively corrected using ratio-based scaling of the multiomics data. Our study lays the foundation for eliminating batch effects at a ratio scale.

Analyzing 3D structures of the SARS-CoV-2 main protease reveals structural features of ligand binding for COVID-19 drug discovery.

The severe acute respiratory syndrome-coronavirus 2 (SARS-CoV-2) main protease has an essential role in viral replication and has become a major target for coronavirus 2019 (COVID-19) drug development. Various inhibitors have been discovered or designed to bind to the main protease. The availability of more than 550 3D structures of the main protease provides a wealth of structural details on the main protease in both ligand-free and ligand-bound states. Therefore, we examined these structures to ascertain the structural features for the role of the main protease in the cleavage of polyproteins, the alternative conformations during main protease maturation, and ligand interactions in the main protease. The structural features unearthed could promote the development of COVID-19 drugs targeting the SARS-CoV-2 main protease.

Three-Dimensional Structural Insights Have Revealed the Distinct Binding Interactions of Agonists, Partial Agonists, and Antagonists with the µ Opioid Receptor.

The United States is experiencing the most profound and devastating opioid crisis in history, with the number of deaths involving opioids, including prescription and illegal opioids, continuing to climb over the past two decades. This severe public health issue is difficult to combat as opioids remain a crucial treatment for pain, and at the same time, they are also highly addictive. Opioids act on the opioid receptor, which in turn activates its downstream signaling pathway that eventually leads to an analgesic effect. Among the four types of opioid receptors, the µ subtype is primarily responsible for the analgesic cascade. This review describes available 3D structures of the µ opioid receptor in the protein data bank and provides structural insights for the binding of agonists and antagonists to the receptor. Comparative analysis on the atomic details of the binding site in these structures was conducted and distinct binding interactions for agonists, partial agonists, and antagonists were observed. The findings in this article deepen our understanding of the ligand binding activity and shed some light on the development of novel opioid analgesics which may improve the risk benefit balance of existing opioids.

Distinct Conformations of SARS-CoV-2 Omicron Spike Protein and Its Interaction with ACE2 and Antibody.

Since November 2021, Omicron has been the dominant severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variant that causes the coronavirus disease 2019 (COVID-19) and has continuously impacted human health. Omicron sublineages are still increasing and cause increased transmission and infection rates. The additional 15 mutations on the receptor binding domain (RBD) of Omicron spike proteins change the protein conformation, enabling the Omicron variant to evade neutralizing antibodies. For this reason, many efforts have been made to design new antigenic variants to induce effective antibodies in SARS-CoV-2 vaccine development. However, understanding the different states of Omicron spike proteins with and without external molecules has not yet been addressed. In this review, we analyze the structures of the spike protein in the presence and absence of angiotensin-converting enzyme 2 (ACE2) and antibodies. Compared to previously determined structures for the wildtype spike protein and other variants such as alpha, beta, delta, and gamma, the Omicron spike protein adopts a partially open form. The open-form spike protein with one RBD up is dominant, followed by the open-form spike protein with two RBD up, and the closed-form spike protein with the RBD down. It is suggested that the competition between antibodies and ACE2 induces interactions between adjacent RBDs of the spike protein, which lead to a partially open form of the Omicron spike protein. The comprehensive structural information of Omicron spike proteins could be helpful for the efficient design of vaccines against the Omicron variant.

RxNorm for drug name normalization: a case study of prescription opioids in the FDA adverse events reporting system.

Numerous studies have been conducted on the US Food and Drug Administration (FDA) Adverse Events Reporting System (FAERS) database to assess post-marketing reporting rates for drug safety review and risk assessment. However, the drug names in the adverse event (AE) reports from FAERS were heterogeneous due to a lack of uniformity of information submitted mandatorily by pharmaceutical companies and voluntarily by patients, healthcare professionals, and the public. Studies using FAERS and other spontaneous reporting AEs database without drug name normalization may encounter incomplete collection of AE reports from non-standard drug names and the accuracies of the results might be impacted. In this study, we demonstrated applicability of RxNorm, developed by the National Library of Medicine, for drug name normalization in FAERS. Using prescription opioids as a case study, we used RxNorm application program interface (API) to map all FDA-approved prescription opioids described in FAERS AE reports to their equivalent RxNorm Concept Unique Identifiers (RxCUIs) and RxNorm names. The different names of the opioids were then extracted, and their usage frequencies were calculated in collection of more than 14.9 million AE reports for 13 FDA-approved prescription opioid classes, reported over 17 years. The results showed that a significant number of different names were consistently used for opioids in FAERS reports, with 2,086 different names (out of 7,892) used at least three times and 842 different names used at least ten times for each of the 92 RxNorm names of FDA-approved opioids. Our method of using RxNorm API mapping was confirmed to be efficient and accurate and capable of reducing the heterogeneity of prescription opioid names significantly in the AE reports in FAERS; meanwhile, it is expected to have a broad application to different sets of drug names from any database where drug names are diverse and unnormalized. It is expected to be able to automatically standardize and link different representations of the same drugs to build an intact and high-quality database for diverse research, particularly postmarketing data analysis in pharmacovigilance initiatives.