The VERA software: Implementation of the acute fish toxicity endpoint and its application to pharmaceutical compounds.

The Virtual Extensive Read-Across software (VERA) is a new tool for read-across using a global similarity score, molecular groups, and structural alerts to find clusters of similar substances; these clusters are then used to identify suitable similar substances and make an assessment for the target substance. A beta version of VERA GUI is free and available at vegahub.eu; the source code of the VERA algorithm is available on GitHub. In the past we described its use to assess carcinogenicity, a classification endpoint. The aim here is to extend the automated read-across approach to assess continuous endpoints as well. We addressed acute fish toxicity. VERA evaluation on the acute fish toxicity endpoint was done on a dataset containing general substances (pesticides, industrial products, biocides, etc.), obtaining an overall R2 of 0.68. We employed the VERA algorithm also on active pharmaceutical ingredients (APIs). We included a portion of the APIs in the training dataset to predict APIs, successfully achieving an overall R2 of 0.63. VERA evaluates the assessment's reliability, and we reached an R2 of 0.78 and Root Mean Square Error (RMSE) of 0.44 for predictions with high reliability.

New approach methodologies to facilitate and improve the hazard assessment of non-genotoxic carcinogens-a PARC project.

Carcinogenic chemicals, or their metabolites, can be classified as genotoxic or non-genotoxic carcinogens (NGTxCs). Genotoxic compounds induce DNA damage, which can be detected by an established in vitro and in vivo battery of genotoxicity assays. For NGTxCs, DNA is not the primary target, and the possible modes of action (MoA) of NGTxCs are much more diverse than those of genotoxic compounds, and there is no specific in vitro assay for detecting NGTxCs. Therefore, the evaluation of the carcinogenic potential is still dependent on long-term studies in rodents. This 2-year bioassay, mainly applied for testing agrochemicals and pharmaceuticals, is time-consuming, costly and requires very high numbers of animals. More importantly, its relevance for human risk assessment is questionable due to the limited predictivity for human cancer risk, especially with regard to NGTxCs. Thus, there is an urgent need for a transition to new approach methodologies (NAMs), integrating human-relevant in vitro assays and in silico tools that better exploit the current knowledge of the multiple processes involved in carcinogenesis into a modern safety assessment toolbox. Here, we describe an integrative project that aims to use a variety of novel approaches to detect the carcinogenic potential of NGTxCs based on different mechanisms and pathways involved in carcinogenesis. The aim of this project is to contribute suitable assays for the safety assessment toolbox for an efficient and improved, internationally recognized hazard assessment of NGTxCs, and ultimately to contribute to reliable mechanism-based next-generation risk assessment for chemical carcinogens.

The VEGA Tool to Check the Applicability Domain Gives Greater Confidence in the Prediction of In Silico Models.

A sound assessment of in silico models and their applicability domain can support the use of new approach methodologies (NAMs) in chemical risk assessment and requires increasing the users' confidence in this approach. Several approaches have been proposed to evaluate the applicability domain of such models, but their prediction power still needs a thorough assessment. In this context, the VEGA tool capable of assessing the applicability domain of in silico models is examined for a range of toxicological endpoints. The VEGA tool evaluates chemical structures and other features related to the predicted endpoints and is efficient in measuring applicability domain, enabling the user to identify less accurate predictions. This is demonstrated with many models addressing different endpoints, towards toxicity of relevance to human health, ecotoxicological endpoints, environmental fate, physicochemical and toxicokinetic properties, for both regression models and classifiers.

Virtual Extensive Read-Across: A New Open-Access Software for Chemical Read-Across and Its Application to the Carcinogenicity Assessment of Botanicals.

Read-across applies the principle of similarity to identify the most similar substances to represent a given target substance in data-poor situations. However, differences between the target and the source substances exist. The present study aims to screen and assess the effect of the key components in a molecule which may escape the evaluation for read-across based only on the most similar substance(s) using a new open-access software: Virtual Extensive Read-Across (VERA). VERA provides a means to assess similarity between chemicals using structural alerts specific to the property, pre-defined molecular groups and structural similarity. The software finds the most similar compounds with a certain feature, e.g., structural alerts and molecular groups, and provides clusters of similar substances while comparing these similar substances within different clusters. Carcinogenicity is a complex endpoint with several mechanisms, requiring resource intensive experimental bioassays and a large number of animals; as such, the use of read-across as part of new approach methodologies would support carcinogenicity assessment. To test the VERA software, carcinogenicity was selected as the endpoint of interest for a range of botanicals. VERA correctly labelled 70% of the botanicals, indicating the most similar substances and the main features associated with carcinogenicity.

In Silico Prediction of Chemically Induced Mutagenicity: A Weight of Evidence Approach Integrating Information from QSAR Models and Read-Across Predictions.

Information on genotoxicity is an essential piece of information in the framework of several regulations aimed at evaluating chemical toxicity. In this context, QSAR models that can predict Ames genotoxicity can conveniently provide relevant information. Indeed, they can be straightforwardly and rapidly used for predicting the presence or absence of genotoxic hazards associated with the interactions of chemicals with DNA. Nevertheless, and despite their ease of use, the main interpretative challenge is related to a critical assessment of the information that can be gathered, thanks to these tools. This chapter provides guidance on how to use freely available QSAR and read-across tools provided by VEGA HUB and on how to interpret their predictions according to a weight-of-evidence approach.

New QSAR models to predict chromosome damaging potential based on the in vivo micronucleus test.

A large number of computer-based prediction methods to determine the potential of chemicals to induce mutations at the gene level has been developed over the last decades. Conversely, only few such methods are currently available to predict potential structural and numerical chromosome aberrations. Even fewer of these are based on the preferred testing method for this endpoint, i.e. the micronucleus test. For the present work, in vivo micronucleus test results of 718 structurally diverse compounds were collected and applied for the construction of new models by means of the freely available SARpy in silico model building software. Multiple QSAR models were created using parameter variation and manual verification of (non-) alerting structures. To this extent, the original set of 718 compounds was split into a training (80 %) and a test (20 %) set. SARpy was applied on the training set to automatically extract sets of rules by generating and selecting substructures based on their prediction performance whereas the test set was used to evaluate model performance. Five different splits were made randomly, each of which had a similar balance between positive and negative substances compared to the full dataset. All generated models were characterised by an overall better performance than existing free and commercial models for the same endpoint, while demonstrating high coverage.

QSAR Models for Human Carcinogenicity: An Assessment Based on Oral and Inhalation Slope Factors.

Carcinogenicity is a crucial endpoint for the safety assessment of chemicals and products. During the last few decades, the development of quantitative structure-activity relationship ((Q)SAR) models has gained importance for regulatory use, in combination with in vitro testing or expert-based reasoning. Several classification models can now predict both human and rat carcinogenicity, but there are few models to quantitatively assess carcinogenicity in humans. To our knowledge, slope factor (SF), a parameter describing carcinogenicity potential used especially for human risk assessment of contaminated sites, has never been modeled for both inhalation and oral exposures. In this study, we developed classification and regression models for inhalation and oral SFs using data from the Risk Assessment Information System (RAIS) and different machine learning approaches. The models performed well in classification, with accuracies for the external set of 0.76 and 0.74 for oral and inhalation exposure, respectively, and r2 values of 0.57 and 0.65 in the regression models for oral and inhalation SFs in external validation. These models might therefore support regulators in (de)prioritizing substances for regulatory action and in weighing evidence in the context of chemical safety assessments. Moreover, these models are implemented on the VEGA platform and are now freely downloadable online.

New in silico models to predict in vitro micronucleus induction as marker of genotoxicity.

The evaluation of genotoxicity is a fundamental part of the safety assessment of chemicals due to the relevance of the potential health effects of genotoxicants. Among the testing methods available, the in vitro micronucleus assay with mammalian cells is one of the most used and required by regulations targeting several industrial sectors such as the cosmetic industry and food-related sectors. As an alternative to the testing methods, in recent years, lots in silico methods were developed to predict the genotoxicity of chemicals, including models for the Ames mutagenicity test, the in vitro chromosomal aberrations and the in vivo micronucleus assay. We developed several in silico models for the prediction of genotoxicity as reflected by the in vitro micronucleus assay. The resulting models include both statistical and knowledge-based models. The most promising model is the one based on fragments extracted with the SARpy platform. More than 100 structural alerts were extracted, including also fragments associated with the non-genotoxic activity. The model is characterized by high accuracy and the lowest false negative rate, making this tool suitable for chemical screening according to the regulators' needs. The SARpy model will be implemented on the VEGA platform (https://www.vegahub.eu) and will be freely available.

CORAL: Building up QSAR models for the chromosome aberration test.

A high level of chromosomal aberrations in peripheral blood lymphocytes may be an early marker of cancer risk, but data on risk of specific cancers and types of chromosomal aberrations are limited. Consequently, the development of predictive models for chromosomal aberrations test is important task. Majority of models for chromosomal aberrations test are so-called knowledge-based rules system. The CORAL software (http://www.insilico.eu/coral, abbreviation of "CORrelation And Logic") is an alternative for knowledge-based rules system. In contrast to knowledge-based rules system, the CORAL software gives possibility to estimate the influence upon the predictive potential of a model of different molecular alerts as well as different splits into the training set and validation set. This possibility is not available for the approaches based on the knowledge-based rules system. Quantitative Structure-Activity Relationships (QSAR) for chromosome aberration test are established for five random splits into the training, calibration, and validation sets. The QSAR approach is based on representation of the molecular structure by simplified molecular input-line entry system (SMILES) without data on physicochemical and/or biochemical parameters. In spite of this limitation, the statistical quality of these models is quite good.

In silico model for mutagenicity (Ames test), taking into account metabolism.

Bacterial reverse mutation test is one of the most common methods used to address genotoxicity. The experimental test is designed to include a step to simulate mammalian metabolism. The most common metabolic activation system is the incubation with S9 fraction prepared from the livers of rodents. Usually, in silico models addressing this endpoint are developed on the basis of an overall call disregarding the fact that the toxic effect was observed before or after metabolic activation. Here, we present a new in silico model to predict mutagenicity as measured by activity in the bacterial reverse mutation test, bearing in mind the role of S9 activation to stimulate metabolism. We applied the software SARpy, which identifies structural alerts associated with the effect. Different rules codified by these structural alerts were found in case of positive or negative mutagenicity, observed in the presence or absence of the S9 fraction. These rules can be used to understand the role of metabolism in mutagenicity better. We also identified a possible association of the results from these models with carcinogenicity.

Improvement of quantitative structure-activity relationship (QSAR) tools for predicting Ames mutagenicity: outcomes of the Ames/QSAR International Challenge Project.

The International Conference on Harmonization (ICH) M7 guideline allows the use of in silico approaches for predicting Ames mutagenicity for the initial assessment of impurities in pharmaceuticals. This is the first international guideline that addresses the use of quantitative structure-activity relationship (QSAR) models in lieu of actual toxicological studies for human health assessment. Therefore, QSAR models for Ames mutagenicity now require higher predictive power for identifying mutagenic chemicals. To increase the predictive power of QSAR models, larger experimental datasets from reliable sources are required. The Division of Genetics and Mutagenesis, National Institute of Health Sciences (DGM/NIHS) of Japan recently established a unique proprietary Ames mutagenicity database containing 12140 new chemicals that have not been previously used for developing QSAR models. The DGM/NIHS provided this Ames database to QSAR vendors to validate and improve their QSAR tools. The Ames/QSAR International Challenge Project was initiated in 2014 with 12 QSAR vendors testing 17 QSAR tools against these compounds in three phases. We now present the final results. All tools were considerably improved by participation in this project. Most tools achieved >50% sensitivity (positive prediction among all Ames positives) and predictive power (accuracy) was as high as 80%, almost equivalent to the inter-laboratory reproducibility of Ames tests. To further increase the predictive power of QSAR tools, accumulation of additional Ames test data is required as well as re-evaluation of some previous Ames test results. Indeed, some Ames-positive or Ames-negative chemicals may have previously been incorrectly classified because of methodological weakness, resulting in false-positive or false-negative predictions by QSAR tools. These incorrect data hamper prediction and are a source of noise in the development of QSAR models. It is thus essential to establish a large benchmark database consisting only of well-validated Ames test results to build more accurate QSAR models.

(Eco)toxicological maps: A new risk assessment method integrating traditional and in silico tools and its application in the Ledra River (Italy).

Contaminants giving rise to emerging concern like pharmaceuticals, personal care products, pesticides and Endocrine Disrupting Chemicals (EDCs) have been detected in wastewaters, as reported in the literature, but little is known about their (eco)toxicological effects and consequent human health impact. The present study aimed at overcoming this lack of information through the use of in silico methods integrated with traditional toxicological risk analysis. This is part of a pilot project involving the management of wastewater treatment plants in the Ledra River basin (Italy). We obtained data to work up a global risk assessment method combining the evaluations of health risks to humans and ecological receptors from chemical contaminants found in this specific area. The (eco)toxicological risk is expressed by a single numerical value, permitting the comparison of different sampling sites and the evaluation of future environmental and technical interventions.

Criteria and Application on the Use of Nontesting Methods within a Weight of Evidence Strategy.

Nontesting methods (NTM) proved to be a valuable resource for risk assessment of chemical substances. Indeed, they can be particularly useful when the information provided by different sources was integrated to increase the confidence in the final result. This integration can be sometimes difficult because different methods can lead to conflicting results, and because a clear guideline for integrating information from different sources was not available in the recent past. In this chapter, we present and discuss the recently published guideline from EFSA for integrating and weighting evidence for scientific assessment. Moreover, a practical example on the application of these integration principles on evidence from different in silico models was shown for the assessment of bioconcentration factor (BCF). This example represents a demonstration of the suitability and effectiveness of in silico methods for risk assessment, as well as a practical guide to end-users to perform similar analyses on likely hazardous chemicals.

Performance of In Silico Models for Mutagenicity Prediction of Food Contact Materials.

In silico methodologies, such as (quantitative) structure-activity relationships ([Q]SARs), are available to predict a wide variety of toxicological properties and biological activities for structurally diverse substances. To obtain insights in the scientific value of these predictions, the capacity of the prediction models to generate (sufficiently) reliable results for a particular type of compounds needs to be evaluated. In the current study, performance parameters to predict the endpoint "bacterial mutagenicity" were calculated for a battery of common (Q)SAR tools, namely Toxtree, Derek Nexus, VEGA Consensus, and Sarah Nexus. Printed paper and board food contact material (FCM) constituents were chosen as study substances because many of these lack experimental data, making them an interesting group for in silico screening. Accuracy, sensitivity, specificity, positive predictivity, negative predictivity, and Matthews correlation coefficient for the individual models and for the combination of VEGA Consensus and Sarah Nexus were determined and compared. Our results demonstrate that performance varies among the four models, but can be increased by applying a combination strategy. Furthermore, the importance of the applicability domain is illustrated. Limited performance to predict the mutagenic potential of substances that are new to the model (ie, not included in the training set) is reported. In this context, the generally poor sensitivity for these new substances is also addressed.

(Q)SAR tools for priority setting: A case study with printed paper and board food contact material substances.

Over the last years, more stringent safety requirements for an increasing number of chemicals across many regulatory fields (e.g. industrial chemicals, pharmaceuticals, food, cosmetics, …) have triggered the need for an efficient screening strategy to prioritize the substances of highest concern. In this context, alternative methods such as in silico (i.e. computational) techniques gain more and more importance. In the current study, a new prioritization strategy for identifying potentially mutagenic substances was developed based on the combination of multiple (quantitative) structure-activity relationship ((Q)SAR) tools. Non-evaluated substances used in printed paper and board food contact materials (FCM) were selected for a case study. By applying our strategy, 106 out of the 1723 substances were assigned 'high priority' as they were predicted mutagenic by 4 different (Q)SAR models. Information provided within the models allowed to identify 53 substances for which Ames mutagenicity prediction already has in vitro Ames test results. For further prioritization, additional support could be obtained by applying local i.e. specific models, as demonstrated here for aromatic azo compounds, typically found in printed paper and board FCM. The strategy developed here can easily be applied to other groups of chemicals facing the same need for priority ranking.

Fragment Prioritization on a Large Mutagenicity Dataset.

The identification of structural alerts is one of the simplest tools used for the identification of potentially toxic chemical compounds. Structural alerts have served as an aid to quickly identify chemicals that should be either prioritized for testing or for elimination from further consideration and use. In the recent years, the availability of larger datasets, often growing in the context of collaborative efforts and competitions, created the raw material needed to identify new and more accurate structural alerts. This work applied a method to efficiently mine large toxicological dataset for structural alert showing a strong statistical association with mutagenicity. In details, we processed a large Ames mutagenicity dataset comprising 14,015 unique molecules obtained by joining different data sources. After correction for multiple testing, we were able to assign a probability value to each fragment. A total of 51 rules were identified, with p-value < 0.05. Using the same method, we also confirmed the statistical significance of several mutagenicity rules already present and largely recognized in the literature. In addition, we have extended the application of our method by predicting the mutagenicity of an external data set.

In Silico Prediction of Chemically Induced Mutagenicity: How to Use QSAR Models and Interpret Their Results.

Information on genotoxicity is an essential piece of information gathering for a comprehensive toxicological characterization of chemicals. Several QSAR models that can predict Ames genotoxicity are freely available for download from the Internet and they can provide relevant information for the toxicological profiling of chemicals. Indeed, they can be straightforwardly used for predicting the presence or absence of genotoxic hazards associated with the interactions of chemicals with DNA.Nevertheless, and despite the ease of use of these models, the scientific challenge is to assess the reliability of information that can be obtained from these tools. This chapter provides instructions on how to use freely available QSAR models and on how to interpret their predictions.

In silico tools and transcriptomics analyses in the mutagenicity assessment of cosmetic ingredients: a proof-of-principle on how to add weight to the evidence.

Prior to the downstream development of chemical substances, including pharmaceuticals and cosmetics, their influence on the genetic apparatus has to be tested. Several in vitro and in vivo assays have been developed to test for genotoxicity. In a first tier, a battery of two to three in vitro tests is recommended to cover mutagenicity, clastogenicity and aneugenicity as main endpoints. This regulatory in vitro test battery is known to have a high sensitivity, which is at the expense of the specificity. The high number of false positive in vitro results leads to excessive in vivo follow-up studies. In the case of cosmetics it may even induce the ban of the particular compound since in Europe the use of experimental animals is no longer allowed for cosmetics. In this article, an alternative approach to derisk a misleading positive Ames test is explored. Hereto we first tested the performance of five existing computational tools to predict the potential mutagenicity of a data set of 132 cosmetic compounds with a known genotoxicity profile. Furthermore, we present, as a proof-of-principle, a strategy in which a combination of computational tools and mechanistic information derived from in vitro transcriptomics analyses is used to derisk a misleading positive Ames test result. Our data shows that this strategy may represent a valuable tool in a weight-of-evidence approach to further evaluate a positive outcome in an Ames test.

Hierarchical Rules for Read-Across and In Silico Models of Mutagenicity.

A broad set of rules has been implemented within the ToxRead software for read-across of chemicals for bacterial mutagenicity. These rules were obtained by manually analyzing more than 6000 chemicals and the associated chemical classes. A hierarchy of rules was established to identify those most specifically relating to the target compounds, linked in sequence to the other, more generic ones, which may match with the target compound. Rules related to both mutagenicity and lack of mutagenicity were found. Some of the latter are exceptions to the mutagenicity rules, while others are modulators of activity. These rules can also be used to predict mutagenicity, offering good performance.

Evaluation of QSAR models for the prediction of ames genotoxicity: a retrospective exercise on the chemical substances registered under the EU REACH regulation.

We evaluated the performance of seven freely available quantitative structure-activity relationship models predicting Ames genotoxicity thanks to a dataset of chemicals that were registered under the EU Registration, Evaluation, Authorization and Restriction of Chemicals (REACH) regulation. The performance of the models was estimated according to Cooper's statistics and Matthew's Correlation Coefficients (MCC). The Benigni/Bossa rule base originally implemented in Toxtree and re-implemented within the Virtual models for property Evaluation of chemicals within a Global Architecture (VEGA) platform displayed the best performance (accuracy = 92%, sensitivity = 83%, specificity = 93%, MCC = 0.68) indicating that this rule base provides a reliable tool for the identification of genotoxic chemicals. Finally, we elaborated a consensus model that outperformed the accuracy of the individual models.