Evaluating structure-based activity in a high-throughput assay for steroid biosynthesis.

Data from a high-throughput human adrenocortical carcinoma assay (HT-H295R) for steroid hormone biosynthesis are available for >2000 chemicals in single concentration and 654 chemicals in multi-concentration (mc). Previously, a metric describing the effect size of a chemical on the biosynthesis of 11 hormones was derived using mc data referred to as the maximum mean Mahalanobis distance (maxmMd). However, mc HT-H295R assay data remain unavailable for many chemicals. This work leverages existing HT-H295R assay data by constructing structure-activity relationships to make predictions for data-poor chemicals, including: (1) identification of individual structural descriptors, known as ToxPrint chemotypes, associated with increased odds of affecting estrogen or androgen synthesis; (2) a random forest (RF) classifier using physicochemical property descriptors to predict HT-H295R maxmMd binary (positive or negative) outcomes; and, (3) a local approach to predict maxmMd binary outcomes using nearest neighbors (NNs) based on two types of chemical fingerprints (chemotype or Morgan). Individual chemotypes demonstrated high specificity (85-98%) for modulators of estrogen and androgen synthesis but with low sensitivity. The best RF model for maxmMd classification included 13 predicted physicochemical descriptors, yielding a balanced accuracy (BA) of 71% with only modest improvement when hundreds of structural features were added. The best two NN models for binary maxmMd prediction demonstrated BAs of 85 and 81% using chemotype and Morgan fingerprints, respectively. Using an external test set of 6302 chemicals (lacking HT-H295R data), 1241 were identified as putative estrogen and androgen modulators. Combined results across the three classification models (global RF model and two local NN models) predict that 1033 of the 6302 chemicals would be more likely to affect HT-H295R bioactivity. Together, these in silico approaches can efficiently prioritize thousands of untested chemicals for screening to further evaluate their effects on steroid biosynthesis.

Quantitative prediction of repeat dose toxicity values using GenRA.

Computational approaches have recently gained popularity in the field of read-across to automatically fill data-gaps for untested chemicals. Previously, we developed the generalized read-across (GenRA) tool, which utilizes in vitro bioactivity data in conjunction with chemical descriptor information to derive local validity domains to predict hazards observed in in vivo toxicity studies. Here, we modified GenRA to quantitatively predict point of departure (POD) values obtained from US EPA's Toxicity Reference Database (ToxRefDB) version 2.0. To evaluate GenRA predictions, we first aggregated oral Lowest Observed Adverse Effect Levels (LOAEL) for 1,014 chemicals by systemic, developmental, reproductive, and cholinesterase effects. The mean LOAEL values for each chemical were converted to log molar equivalents. Applying GenRA to all chemicals with a minimum Jaccard similarity threshold of 0.05 for Morgan fingerprints and a maximum of 10 nearest neighbors predicted systemic, developmental, reproductive, and cholinesterase inhibition min aggregated LOAEL values with R2 values of 0.23, 0.22, 0.14, and 0.43, respectively. However, when evaluating GenRA locally to clusters of structurally-similar chemicals (containing 2 to 362 chemicals), average R2 values for systemic, developmental, reproductive, and cholinesterase LOAEL predictions improved to 0.73, 0.66, 0.60 and 0.79, respectively. Our findings highlight the complexity of the chemical-toxicity landscape and the importance of identifying local domains where GenRA can be used most effectively for predicting PODs.

An evaluation of selected (Q)SARs/expert systems for predicting skin sensitisation potential.

Predictive testing to characterise substances for their skin sensitisation potential has historically been based on animal models such as the Local Lymph Node Assay (LLNA) and the Guinea Pig Maximisation Test (GPMT). In recent years, EU regulations, have provided a strong incentive to develop non-animal alternatives, such as expert systems software. Here we selected three different types of expert systems: VEGA (statistical), Derek Nexus (knowledge-based) and TIMES-SS (hybrid), and evaluated their performance using two large sets of animal data: one set of 1249 substances from eChemportal and a second set of 515 substances from NICEATM. A model was considered successful at predicting skin sensitisation potential if it had at least the same balanced accuracy as the LLNA and the GPMT had in predicting the other outcomes, which ranged from 79% to 86%. We found that the highest balanced accuracy of any of the expert systems evaluated was 65% when making global predictions. For substances within the domain of TIMES-SS, however, balanced accuracies for the two datasets were found to be 79% and 82%. In those cases where a chemical was within the TIMES-SS domain, the TIMES-SS skin sensitisation hazard prediction had the same confidence as the result from LLNA or GPMT.

Application of IATA - A case study in evaluating the global and local performance of a Bayesian network model for skin sensitization.

The information characterizing key events in an Adverse Outcome Pathway (AOP) can be generated from in silico, in chemico, in vitro and in vivo approaches. Integration of this information and interpretation for decision making are known as integrated approaches to testing and assessment (IATA). One such IATA was published by Jaworska et al., which describes a Bayesian network model known as ITS-2. The current work evaluated the performance of ITS-2 using a stratified cross-validation approach. We also characterized the impact of replacing the most significant component of the network, output from the expert system TIMES-SS, with structural alert information from the OECD Toolbox and Toxtree. Lack of structural alerts or TIMES-SS predictions yielded a sensitization potential prediction of 79%. If the TIMES-SS prediction was replaced by a structural alert indicator, the network predictivity increased up to 87%. The original network's predictivity was 89%. The local applicability domain of the original ITS-2 network was also evaluated using reaction mechanistic domains to understand what types of chemicals ITS-2 was able to make the best predictions for. We found that the original network was successful at predicting which chemicals would be sensitizers, but not at predicting their potency.

Building scientific confidence in the development and evaluation of read-across.

Read-across is an alternative approach exploited to address information requirements for risk assessment and for regulatory programmes such as the European Union's REACH regulation. Whilst read-across approaches are accepted in principle, difficulties still remain in applying them consistently in practice. Recent work within Cefic LRI and ECETOC attempted to summarize the state-of-the-art and identify some of the barriers to broader acceptance of read-across approaches to overcome these. Acceptance is undoubtedly thwarted partly by the lack of a systematic framework to characterize the read-across justification and identify the uncertainties particularly for complex regulatory endpoints such as repeated-dose toxicity or prenatal developmental toxicity. Efforts are underway by the European Chemical's Agency (ECHA) to develop a Read-Across Assessment Framework (RAAF) and private sector experts have also considered the development of a similar framework. At the same time, mechanistic chemical categories are being proposed which are underpinned by Adverse Outcome Pathways (AOPs). Currently such frameworks are only focusing on discrete organic substances, though the AOP approach could conceivably be applied to evaluate more complex substances such as mixtures. Here we summarize the deliberations of the Cefic LRI read-across team in characterizing scientific confidence in the development and evaluation of read-across.

TIMES-SS--recent refinements resulting from an industrial skin sensitisation consortium.

The TImes MEtabolism Simulator platform for predicting Skin Sensitisation (TIMES-SS) is a hybrid expert system, first developed at Bourgas University using funding and data from a consortium of industry and regulators. TIMES-SS encodes structure-toxicity and structure-skin metabolism relationships through a number of transformations, some of which are underpinned by mechanistic 3D QSARs. The model estimates semi-quantitative skin sensitisation potency classes and has been developed with the aim of minimising animal testing, and also to be scientifically valid in accordance with the OECD principles for (Q)SAR validation. In 2007 an external validation exercise was undertaken to fully address these principles. In 2010, a new industry consortium was established to coordinate research efforts in three specific areas: refinement of abiotic reactions in the skin (namely autoxidation) in the skin, refinement of the manner in which chemical reactivity was captured in terms of structure-toxicity rules (inclusion of alert reliability parameters) and defining the domain based on the underlying experimental data (study of discrepancies between local lymph node assay Local Lymph Node Assay (LLNA) and Guinea Pig Maximisation Test (GPMT)). The present paper summarises the progress of these activities and explains how the insights derived have been translated into refinements, resulting in increased confidence and transparency in the robustness of the TIMES-SS predictions.

Chemistry-based risk assessment for skin sensitization: quantitative mechanistic modeling for the S(N)Ar domain.

There is a strong impetus to develop nonanimal based methods to predict skin sensitization potency. An approach based on physical organic chemistry, whereby chemicals are classified into reaction mechanistic domains and quantitative models or read-across methods are derived for each domain, has been the basis of several recent publications. This article is concerned with the S(N)Ar reaction mechanistic domain. Electrophiles able to react by the S(N)Ar mechanism have long been recognized as skin sensitizers and have been used extensively in research studies on the biology of skin sensitization. Although qualitative discriminant analysis approaches have been developed for estimating the sensitization potential for S(N)Ar electrophiles on a yes/no qualitative basis, no quantitative mechanistic model (QMM) has so far been developed for this domain. Here, we derive a QMM that correlates skin sensitization potency, quantified by murine local lymph node assay (LLNA) EC3 data on a range of S(N)Ar electrophiles. It is based on the Hammett σ(-) values for the activating groups and the Taft σ* value for the leaving group. The model takes the form pEC3=2.48 Σσ(-) + 0.60 σ* - 4.51. This QMM, generated from mouse LLNA data, provides a reactivity parameter 2.48 Σσ(-) + 0.60 σ*, which was applied to a set of 20 compounds for which guinea pig test results were available in the literature and was found to successfully discriminate the sensitizers from the nonsensitizers. The reactivity parameter correctly predicted a known human sensitizer 2,4-dichloropyrimidine. New LLNA data on two further S(N)Ar electrophiles are consistent with the QMM.

Non-testing approaches under REACH--help or hindrance? Perspectives from a practitioner within industry.

Legislation such as REACH strongly advocates the use of alternative approaches including in vitro, (Q)SARs, and chemical categories as a means to satisfy the information requirements for risk assessment. One of the most promising alternative approaches is that of chemical categories, where the underlying hypothesis is that the compounds within the category are similar and therefore should have similar biological activities. The challenge lies in characterizing the chemicals, understanding the mode/mechanism of action for the activity of interest and deriving a way of relating these together to form inferences about the likely activity outcomes. (Q)SARs are underpinned by the same hypothesis but are packaged in a more formalized manner. Since the publication of the White Paper for REACH, there have been a number of efforts aimed at developing tools, approaches and techniques for (Q)SARs and read-across for regulatory purposes. While technical guidance is available, there still remains little practical guidance about how these approaches can or should be applied in either the evaluation of existing (Q)SARs or in the formation of robust categories. Here we provide a perspective of how some of these approaches have been utilized to address our in-house REACH requirements.

Can mutagenicity information be useful in an Integrated Testing Strategy (ITS) for skin sensitization?

Our previous work has investigated the utility of mutagenicity data in the development and application of Integrated Testing Strategies (ITS) for skin sensitization by focusing on the chemical mechanisms at play and substantiating these with experimental data where available. The hybrid expert system TIMES (Tissue Metabolism Simulator) was applied in the identification of the chemical mechanisms since it encodes a comprehensive set of established structure-activity relationships for both skin sensitization and mutagenicity. Based on the evaluation, the experimental determination of mutagenicity was thought to be potentially helpful in the evaluation of skin sensitization potential. This study has evaluated the dataset reported by Wolfreys and Basketter (Cutan. Ocul. Toxicol. 23 (2004), pp. 197-205). Upon an update of the experimental data, the original reported concordance of 68% was found to increase to 88%. There were several compounds that were 'outliers' in the two experimental evaluations which are discussed from a mechanistic basis. The discrepancies were found to be mainly associated with the differences between skin and liver metabolism. Mutagenicity information can play a significant role in evaluating sensitization potential as part of an ITS though careful attention needs to be made to ensure that any information is interpreted in the appropriate context.

An evaluation of the implementation of the Cramer classification scheme in the Toxtree software.

Risk assessment for most human health effects is based on the threshold of a toxicological effect, usually derived from animal experiments. The Threshold of Toxicological Concern (TTC) is a concept that refers to the establishment of a level of exposure for all chemicals below which there would be no appreciable risk to human health. When carefully applied, the TTC concept can provide a means of waiving testing based on knowledge of exposure limits. Two main approaches exist; the first of these is a General Threshold of Toxicological Concern; the second approach is a TTC in relation to structural information and/or toxicological data of chemicals. The structural scheme most routinely used is that of Cramer and co-workers from 1978. Recently this scheme was encoded into a software program called Toxtree, specifically commissioned by the European Chemicals Bureau (ECB). Here we evaluate two published datasets using Toxtree to demonstrate its concordance and highlight potential software modifications. The results were promising with an overall good concordance between the reported classifications and those generated by Toxtree. Further evaluation of these results highlighted a number of inconsistencies which were examined in turn and rationalised as far as possible. Improvements for Toxtree were proposed where appropriate. Notable of these is a necessity to update the lists of common food components and normal body constituents as these accounted for the majority of false classifications observed. Overall Toxtree was found to be a useful tool in facilitating the systematic evaluation of compounds through the Cramer scheme.

Toxmatch-a new software tool to aid in the development and evaluation of chemically similar groups.

Chemical similarity is a widely used concept in toxicology, and is based on the hypothesis that similar compounds should have similar biological activities. This forms the underlying basis for performing read-across, forming chemical groups and developing (Quantitative) Structure-Activity Relationships ((Q)SARs). Chemical similarity is often perceived as structural similarity but in fact there are a number of other approaches that can be used to assess similarity. A systematic similarity analysis usually comprises two main steps. Firstly the chemical structures to be compared need to be characterised in terms of relevant descriptors which encode their physicochemical, topological, geometrical and/or surface properties. A second step involves a quantitative comparison of those descriptors using similarity (or dissimilarity) indices. This work outlines the use of chemical similarity principles in the formation of endpoint specific chemical groupings. Examples are provided to illustrate the development and evaluation of chemical groupings using a new software application called Toxmatch that was recently commissioned by the European Chemicals Bureau (ECB), of the European Commission's Joint Research Centre. Insights from using this software are highlighted with specific focus on the prospective application of chemical groupings under the new chemicals legislation, REACH.

An evaluation of selected global (Q)SARs/expert systems for the prediction of skin sensitisation potential.

Skin sensitisation potential is an endpoint that needs to be assessed within the framework of existing and forthcoming legislation. At present, skin sensitisation hazard is normally identified using in vivo test methods, the favoured approach being the local lymph node assay (LLNA). This method can also provide a measure of relative skin sensitising potency which is essential for assessing and managing human health risks. One potential alternative approach to skin sensitisation hazard identification is the use of (Quantitative) structure activity relationships ((Q)SARs) coupled with appropriate documentation and performance characteristics. This represents a major challenge. Current thinking is that (Q)SARs might best be employed as part of a battery of approaches that collectively provide information on skin sensitisation hazard. A number of (Q)SARs and expert systems have been developed and are described in the literature. Here we focus on three models (TOPKAT, Derek for Windows and TOPS-MODE), and evaluate their performance against a recently published dataset of 211 chemicals. The current strengths and limitations of one of these models is highlighted, together with modifications that could be made to improve its performance. Of the models/expert systems evaluated, none performed sufficiently well to act as a standalone tool for hazard identification.

Evaluation of SARs for the prediction of skin irritation/corrosion potential: structural inclusion rules in the BfR decision support system.

The German Federal Institute for Risk Assessment (BfR) has developed a Decision Support System (DSS) to assess certain hazardous properties of pure chemicals, including skin and eye irritation/corrosion. The BfR-DSS is a rule-based system that could be used for the regulatory classification of chemicals in the European Union. The system is based on the combined use of two predictive approaches: exclusion rules based on physicochemical cut-off values to identify chemicals that do not exhibit a certain hazard (e.g., skin irritation/corrosion), and inclusion rules based on structural alerts to identify chemicals that do show a particular toxic potential. The aim of the present study was to evaluate the structural inclusion rules implemented in the BfR-DSS for the prediction of skin irritation and corrosion. The following assessments were performed: (a) a confirmation of the structural rules by rederiving them from the original training set (1358 substances), and (b) an external validation by using a test set of 200 chemicals not used in the derivation of the rules. It was found as a result that the test data set did not match the training set relative to the inclusion of structural alerts associated with skin irritation/corrosion, albeit some skin irritants were in the test set.

Global (Q)SARs for skin sensitisation: assessment against OECD principles.

As part of a European Chemicals Bureau contract relating to the evaluation of (Q)SARs for toxicological endpoints of regulatory importance, we have reviewed and analysed (Q)SARs for skin sensitisation. Here we consider some recently published global (Q)SAR approaches against the OECD principles and present re-analysis of the data. Our analyses indicate that "statistical" (Q)SARs which aim to be global in their applicability tend to be insufficiently robust mechanistically, leading to an unacceptably high failure rate. Our conclusions are that, for skin sensitisation, the mechanistic chemistry is very important and consequently the best non-animal approach currently applicable to predict skin sensitisation potential is with the help of an expert system. This would assign compounds into mechanistic applicability domains and apply mechanism-based (Q)SARs specific for those domains and, very importantly, recognise when a compound is outside its range of competence. In such situations, it would call for human expert input supported by experimental chemistry studies as necessary.

The role of the European Chemicals Bureau in promoting the regulatory use of (Q)SAR methods.

Under the proposed REACH (Registration, Evaluation and Authorisation of CHemicals) legislation, (Q)SAR models and grouping methods (chemical categories and read across approaches) are expected to play a significant role in prioritising industrial chemicals for further assessment, and for filling information gaps for the purposes of classification and labelling, risk assessment and the assessment of persistent, bioaccumulative and toxic (PBT) chemicals. The European Chemicals Bureau (ECB), which is part of the European Commission's Joint Research Centre (JRC), has a well-established role in providing independent scientific and technical advice to European policy makers. The ECB also promotes consensus and capacity building on scientific and technical matters among stakeholders in the Member State authorities and industry. To promote the availability and use of (Q)SARs and related estimation methods, the ECB is carrying out a range of activities, including applied research in computational toxicology, the assessment of (Q)SAR models and methods, the development of technical guidance documents and computational tools, and the organisation of training courses. This article provides an overview of ECB activities on computational toxicology, which are intended to promote the development, validation, acceptance and use of (Q)SARs and related estimation methods, both at the European and international levels.

Validation of counter propagation neural network models for predictive toxicology according to the OECD principles: a case study.

The OECD has proposed five principles for validation of QSAR models used for regulatory purposes. Here we present a case study investigating how these principles can be applied to models based on Kohonen and counter propagation neural networks. The study is based on a counter propagation network model that has been built using toxicity data in fish fathead minnow for 541 compounds. The study demonstrates that most, if not all, of the OECD criteria may be met when modeling using this neural network approach.

Ranking of hair dye substances according to predicted sensitization potency: quantitative structure-activity relationships.

Allergic contact dermatitis following the use of hair dyes is well known. Many chemicals are used in hair dyes and it is unlikely that all cases of hair dye allergy can be diagnosed by means of patch testing with p-phenylenediamine (PPD). The objectives of this study are to identify all hair dye substances registered in Europe and to provide their tonnage data. The sensitization potential of each substance was then estimated by using a quantitative structure-activity relationship (QSAR) model and the substances were ranked according to their predicted potency. A cluster analysis was performed in order to help select a number of chemically diverse hair dye substances that could be used in subsequent clinical work. Various information sources, including the Inventory of Cosmetics Ingredients, new regulations on cosmetics, data on total use and ChemId (the Chemical Search Input website provided by the National Library of Medicine), were used in order to identify the names and structures of the hair dyes. A QSAR model, developed with the help of experimental local lymph node assay data and topological sub-structural molecular descriptors (TOPS-MODE), was used in order to predict the likely sensitization potential. Predictions for sensitization potential were made for the 229 substances that could be identified by means of a chemical structure, the majority of these hair dyes (75%) being predicted to be strong/moderate sensitizers. Only 22% were predicted to be weak sensitizers and 3% were predicted to be extremely weak or non-sensitizing. Eight of the most widely used hair dye substances were predicted to be strong/moderate sensitizers, including PPD - which is the most commonly used hair dye allergy marker in patch testing. A cluster analysis by using TOPS-MODE descriptors as inputs helped us group the hair dye substances according to their chemical similarity. This would facilitate the selection of potential substances for clinical patch testing. A patch-test series with potent, frequently used, substances representing various chemical clusters is suggested. This may prove useful in diagnosing PPD-negative patients with symptoms of hair dye allergy and would provide some clinical validation of the QSAR predictions.

Contact allergy: the role of skin chemistry and metabolism.

Chemical reactivity plays the driving role in the biological processes that result in the induction of allergic contact dermatitis. This paper presents an overview of the chemical basis of allergic contact dermatitis, including the physicochemical parameters governing skin penetration, chemical reaction mechanisms associated with haptenation of skin proteins, (quantitative) structure-activity relationships (Q)SARs for contact allergens and prohaptens/skin metabolism of contact allergens. Despite the complexities and poor understanding of some of the metabolic processes leading to skin sensitization, it is possible to describe some of the relationships between chemical structures and the ability to form covalent conjugates with proteins. This knowledge, which relates chemical structure to a specific endpoint, can be programmed into an expert system. The Deductive Estimation of Risk from Existing Knowledge (DEREK) is one such expert system which is described in further detail.

Contact allergy: the local lymph node assay for the prediction of hazard and risk.

The prospective identification of potential contact allergens and their subsequent safety assessment are pivotal in successful management of this risk to human health. Although much can be learned from the chemical and physical properties of a substance, the definitive information in respect of sensitizing hazard/risk derives from an assessment of the integrated response of the immune system. In recent years, the focus for such assessments has begun to switch from the guinea pig to the mouse, notably to the local lymph node assay (LLNA). In this paper, the current value of the LLNA for hazard identification is reviewed and its regulatory status defined. Once a potential contact allergen has been identified, however, the vital clue to accurate safety evaluation is the assessment of the potency of the allergen. How this can be achieved using the LLNA and employed in safety evaluation is discussed in detail, together with practical suggestions for the deployment of such processes in regulatory toxicology.