Unsupervised learning-enabled pulsed infrared thermographic microscopy of subsurface defects in stainless steel.

Metallic structures produced with laser powder bed fusion (LPBF) additive manufacturing method (AM) frequently contain microscopic porosity defects, with typical approximate size distribution from one to 100 microns. Presence of such defects could lead to premature failure of the structure. In principle, structural integrity assessment of LPBF metals can be accomplished with nondestructive evaluation (NDE). Pulsed infrared thermography (PIT) is a non-contact, one-sided NDE method that allows for imaging of internal defects in arbitrary size and shape metallic structures using heat transfer. PIT imaging is performed using compact instrumentation consisting of a flash lamp for deposition of a heat pulse, and a fast frame infrared (IR) camera for measuring surface temperature transients. However, limitations of imaging resolution with PIT include blurring due to heat diffusion, sensitivity limit of the IR camera. We demonstrate enhancement of PIT imaging capability with unsupervised learning (UL), which enables PIT microscopy of subsurface defects in high strength corrosion resistant stainless steel 316 alloy. PIT images were processed with UL spatial-temporal separation-based clustering segmentation (STSCS) algorithm, refined by morphology image processing methods to enhance visibility of defects. The STSCS algorithm starts with wavelet decomposition to spatially de-noise thermograms, followed by UL principal component analysis (PCA), fine-tuning optimization, and neural learning-based independent component analysis (ICA) algorithms to temporally compress de-noised thermograms. The compressed thermograms were further processed with UL-based graph thresholding K-means clustering algorithm for defects segmentation. The STSCS algorithm also includes online learning feature for efficient re-training of the model with new data. For this study, metallic specimens with calibrated microscopic flat bottom hole defects, with diameters in the range from 203 to 76 µm, were produced using electro discharge machining (EDM) drilling. While the raw thermograms do not show any material defects, using STSCS algorithm to process PIT images reveals defects as small as 101 µm in diameter. To the best of our knowledge, this is the smallest reported size of a sub-surface defect in a metal imaged with PIT, which demonstrates the PIT capability of detecting defects in the size range relevant to quality control requirements of LPBF-printed high-strength metals.

Physics-informed neural network with transfer learning (TL-PINN) based on domain similarity measure for prediction of nuclear reactor transients.

Nuclear reactor safety and efficiency can be enhanced through the development of accurate and fast methods for prediction of reactor transient (RT) states. Physics informed neural networks (PINNs) leverage deep learning methods to provide an alternative approach to RT modeling. Applications of PINNs in monitoring of RTs for operator support requires near real-time model performance. However, as with all machine learning models, development of a PINN involves time-consuming model training. Here, we show that a transfer learning (TL-PINN) approach achieves significant performance gain, as measured by reduction of the number of iterations for model training. Using point kinetic equations (PKEs) model with six neutron precursor groups, constructed with experimental parameters of the Purdue University Reactor One (PUR-1) research reactor, we generated different RTs with experimentally relevant range of variables. The RTs were characterized using Hausdorff and Fréchet distance. We have demonstrated that pre-training TL-PINN on one RT results in up to two orders of magnitude acceleration in prediction of a different RT. The mean error for conventional PINN and TL-PINN models prediction of neutron densities is smaller than 1%. We have developed a correlation between TL-PINN performance acceleration and similarity measure of RTs, which can be used as a guide for application of TL-PINNs.

Multi-Task Learning of Scanning Electron Microscopy and Synthetic Thermal Tomography Images for Detection of Defects in Additively Manufactured Metals.

One of the key challenges in laser powder bed fusion (LPBF) additive manufacturing of metals is the appearance of microscopic pores in 3D-printed metallic structures. Quality control in LPBF can be accomplished with non-destructive imaging of the actual 3D-printed structures. Thermal tomography (TT) is a promising non-contact, non-destructive imaging method, which allows for the visualization of subsurface defects in arbitrary-sized metallic structures. However, because imaging is based on heat diffusion, TT images suffer from blurring, which increases with depth. We have been investigating the enhancement of TT imaging capability using machine learning. In this work, we introduce a novel multi-task learning (MTL) approach, which simultaneously performs the classification of synthetic TT images, and segmentation of experimental scanning electron microscopy (SEM) images. Synthetic TT images are obtained from computer simulations of metallic structures with subsurface elliptical-shaped defects, while experimental SEM images are obtained from imaging of LPBF-printed stainless-steel coupons. MTL network is implemented as a shared U-net encoder between the classification and the segmentation tasks. Results of this study show that the MTL network performs better in both the classification of synthetic TT images and the segmentation of SEM images tasks, as compared to the conventional approach when the individual tasks are performed independently of each other.

Hotspot Identification and Drug Design of Protein-Protein Interaction Modulators Using the Fragment Molecular Orbital Method.

Protein-protein interactions (PPIs) are essential for the function of many proteins. Aberrant PPIs have the potential to lead to disease, making PPIs promising targets for drug discovery. There are over 64,000 PPIs in the human interactome reference database; however, to date, very few PPI modulators have been approved for clinical use. Further development of PPI-specific therapeutics is highly dependent on the availability of structural data and the existence of reliable computational tools to explore the interface between two interacting proteins. The fragment molecular orbital (FMO) quantum mechanics method offers comprehensive and computationally inexpensive means of identifying the strength (in kcal/mol) and the chemical nature (electrostatic or hydrophobic) of the molecular interactions taking place at the protein-protein interface. We have integrated FMO and PPI exploration (FMO-PPI) to identify the residues that are critical for protein-protein binding (hotspots). To validate this approach, we have applied FMO-PPI to a dataset of protein-protein complexes representing several different protein subfamilies and obtained FMO-PPI results that are in agreement with published mutagenesis data. We observed that critical PPIs can be divided into three major categories: interactions between residues of two proteins (intermolecular), interactions between residues within the same protein (intramolecular), and interactions between residues of two proteins that are mediated by water molecules (water bridges). We extended our findings by demonstrating how this information obtained by FMO-PPI can be utilized to support the structure-based drug design of PPI modulators (SBDD-PPI).

Fighting COVID-19 with Artificial Intelligence.

The development of vaccines for the treatment of COVID-19 is paving the way for new hope. Despite this, the risk of the virus mutating into a vaccine-resistant variant still persists. As a result, the demand of efficacious drugs to treat COVID-19 is still pertinent. To this end, scientists continue to identify and repurpose marketed drugs for this new disease. Many of these drugs are currently undergoing clinical trials and, so far, only one has been officially approved by FDA. Drug repurposing is a much faster route to the clinic than standard drug development of novel molecules, nevertheless in a pandemic this process is still not fast enough to halt the spread of the virus. Artificial intelligence has already played a large part in hastening the drug discovery process, not only by facilitating the selection of potential drug candidates but also in monitoring the pandemic and enabling faster diagnosis of patients. In this chapter, we focus on the impact and challenges that artificial intelligence has demonstrated thus far with respect to drug repurposing of therapeutics for the treatment of COVID-19.

Predicting Residence Time of GPCR Ligands with Machine Learning.

Drug-target residence time, the duration of binding at a given protein target, has been shown in some protein families to be more significant for conferring efficacy than binding affinity. To carry out efficient optimization of residence time in drug discovery, machine learning models that can predict that value need to be developed. One of the main challenges with predicting residence time is the paucity of data. This chapter outlines all of the currently available ligand kinetic data, providing a repository that contains the largest publicly available source of GPCR-ligand kinetic data to date. To help decipher the features of kinetic data that might be beneficial to include in computational models for the prediction of residence time, the experimental evidence for properties that influence residence time are summarized. Finally, two different workflows for predicting residence time with machine learning are outlined. The first is a single-target model trained on ligand features; the second is a multi-target model trained on features generated from molecular dynamics simulations.

Hit-to-lead and lead optimization binding free energy calculations for G protein-coupled receptors.

We apply the hit-to-lead ESMACS (enhanced sampling of molecular dynamics with approximation of continuum solvent) and lead-optimization TIES (thermodynamic integration with enhanced sampling) methods to compute the binding free energies of a series of ligands at the A1 and A2A adenosine receptors, members of a subclass of the GPCR (G protein-coupled receptor) superfamily. Our predicted binding free energies, calculated using ESMACS, show a good correlation with previously reported experimental values of the ligands studied. Relative binding free energies, calculated using TIES, accurately predict experimentally determined values within a mean absolute error of approximately 1 kcal mol-1. Our methodology may be applied widely within the GPCR superfamily and to other small molecule-receptor protein systems.

Characterizing Interhelical Interactions of G-Protein Coupled Receptors with the Fragment Molecular Orbital Method.

G-protein coupled receptors (GPCRs) are the largest superfamily of membrane proteins, regulating almost every aspect of cellular activity and serving as key targets for drug discovery. We have identified an accurate and reliable computational method to characterize the strength and chemical nature of the interhelical interactions between the residues of transmembrane (TM) domains during different receptor activation states, something that cannot be characterized solely by visual inspection of structural information. Using the fragment molecular orbital (FMO) quantum mechanics method to analyze 35 crystal structures representing different branches of the class A GPCR family, we have identified 69 topologically equivalent TM residues that form a consensus network of 51 inter-TM interactions, providing novel results that are consistent with and help to rationalize experimental data. This discovery establishes a comprehensive picture of how defined molecular forces govern specific interhelical interactions which, in turn, support the structural stability, ligand binding, and activation of GPCRs.

Guiding Medicinal Chemistry with Fragment Molecular Orbital (FMO) Method.

The understanding of binding interactions between a protein and a small molecule plays a key role in the rationalization of potency and selectivity and in design of new ideas. However, even when a target of interest is structurally enabled, visual inspection and force field-based molecular mechanics calculations cannot always explain the full complexity of the molecular interactions that are critical in drug design. Quantum mechanical methods have the potential to address this shortcoming, but traditionally, computational expense has made the application of these calculations impractical. The fragment molecular orbital (FMO) method offers a solution that combines accuracy, speed, and the ability to characterize important interactions (i.e. its strength in kcal/mol and chemical nature: hydrophobic, electrostatic, etc) that would otherwise be hard to detect. In this chapter, we describe the FMO method and illustrate its application in the discovery of the benzothiazole (BZT) series as novel tyrosine kinase ITK inhibitors for treatment of allergic asthma.

Accurate Scoring in Seconds with the Fragment Molecular Orbital and Density-Functional Tight-Binding Methods.

The accurate evaluation of receptor-ligand interactions is an essential part of rational drug design. While quantum mechanical (QM) methods have been a promising means by which to achieve this, traditional QM is not applicable for large biological systems due to its high computational cost. Here, the fragment molecular orbital (FMO) method has been combined with the density-functional tight-binding (DFTB) method to compute energy calculations of biological systems in seconds. FMO-DFTB outperformed GBVI/WSA in identifying a set of 10 binders versus a background of 500 decoys applied to human k-opioid receptor. The significant increase in the speed and the high accuracy achieved with FMO-DFTB calculations allows FMO to be applied in areas of drug discovery that were not previously accessible to traditional QM methodologies. For the first time, it is now possible to perform FMO calculations in a high-throughput manner.

Analyzing GPCR-Ligand Interactions with the Fragment Molecular Orbital (FMO) Method.

G-protein-coupled receptors (GPCRs) have enormous physiological and biomedical importance, and therefore it is not surprising that they are the targets of many prescribed drugs. Further progress in GPCR drug discovery is highly dependent on the availability of protein structural information. However, the ability of X-ray crystallography to guide the drug discovery process for GPCR targets is limited by the availability of accurate tools to explore receptor-ligand interactions. Visual inspection and molecular mechanics approaches cannot explain the full complexity of molecular interactions. Quantum mechanics (QM) approaches are often too computationally expensive to be of practical use in time-sensitive situations, but the fragment molecular orbital (FMO) method offers an excellent solution that combines accuracy, speed, and the ability to reveal key interactions that would otherwise be hard to detect. Integration of GPCR crystallography or homology modelling with FMO reveals atomistic details of the individual contributions of each residue and water molecule toward ligand binding, including an analysis of their chemical nature. Such information is essential for an efficient structure-based drug design (SBDD) process. In this chapter, we describe how to use FMO in the characterization of GPCR-ligand interactions.

Characterizing Rhodopsin-Arrestin Interactions with the Fragment Molecular Orbital (FMO) Method.

Arrestin binding to G protein-coupled receptors (GPCRs) plays a vital role in receptor signaling. Recently, the crystal structure of rhodopsin bound to activated visual arrestin was resolved using XFEL (X-ray free electron laser). However, even with the crystal structure in hand, our ability to understand GPCR-arrestin binding is limited by the availability of accurate tools to explore receptor-arrestin interactions. We applied fragment molecular orbital (FMO) method to explore the interactions formed between the residues of rhodopsin and arrestin. FMO enables ab initio approaches to be applied to systems that conventional quantum mechanical (QM) methods would be too compute-expensive. The FMO calculations detected 35 significant interactions involved in rhodopsin-arrestin binding formed by 25 residues of rhodopsin and 28 residues of arrestin. Two major regions of interaction were identified: at the C-terminal tail of rhodopsin (D330-S343) and where the "finger loop" (G69-T79) of arrestin directly inserts into rhodopsin active core. Out of these 35 interactions, 23 were mainly electrostatic and 12 hydrophobic in nature.

Characterizing Protein-Protein Interactions with the Fragment Molecular Orbital Method.

Proteins are vital components of living systems, serving as building blocks, molecular machines, enzymes, receptors, ion channels, sensors, and transporters. Protein-protein interactions (PPIs) are a key part of their function. There are more than 645,000 reported disease-relevant PPIs in the human interactome, but drugs have been developed for only 2% of these targets. The advances in PPI-focused drug discovery are highly dependent on the availability of structural data and accurate computational tools for analysis of this data. Quantum mechanical approaches are often too expensive computationally, but the fragment molecular orbital (FMO) method offers an excellent solution that combines accuracy, speed and the ability to reveal key interactions that would otherwise be hard to detect. FMO provides essential information for PPI drug discovery, namely, identification of key interactions formed between residues of two proteins, including their strength (in kcal/mol) and their chemical nature (electrostatic or hydrophobic). In this chapter, we have demonstrated how three different FMO-based approaches (pair interaction energy analysis (PIE analysis), subsystem analysis (SA) and analysis of protein residue networks (PRNs)) have been applied to study PPI in three protein-protein complexes.

Conformational Searching with Quantum Mechanics.

Estimating the range of three-dimensional structures (conformations) that are available to a molecule is a key component of computer-aided drug design. Quantum mechanical simulation offers improved accuracy over forcefield methods, but at a high computational cost. The question is whether this increased cost can be justified in a context in which high-throughput analysis of large numbers of molecules is often key. This chapter discusses the application of quantum mechanics to conformational searching, with a focus on three key challenges: (1) the generation of ensembles that include a good approximation to a molecule's bioactive conformation at as prominent a ranking as possible; (2) rational analysis and modification of a pre-established bioactive conformation in terms of its energetics; and (3) approximation of real solution-phase conformational ensembles in tandem with NMR data. The impact of QM on the high-throughput application (1) is debatable, meaning that for the moment its primary application is still lower-throughput applications such as (2) and (3). The optimal choice of QM method is also discussed. Rigorous benchmarking suggests that DFT methods are only acceptable when used with large basis sets, but a trickle of papers continue to obtain useful results with relatively low-cost methods, leading to a dilemma that the literature has yet to fully resolve.

Transmission of Images With Ultrasonic Elastic Shear Waves on a Metallic Pipe Using Amplitude Shift Keying Protocol.

Transmission of information using ultrasonic elastic waves on existing metallic pipes provides an alternative communication option across physical barriers in a highly partitioned industrial complex, such as a nuclear facility. This work investigates the feasibility of the transmission of digital images over metallic pipes. Ultrasonic communication systems for transmission of images on a nuclear-grade stainless steel pipe were assembled for bench-scale demonstration. Information carriers in this system are refracted shear waves transmitted and received with piezoelectric transducers (PZTs) operating at 2-MHz nominal frequency. The refraction and propagation of ultrasonic shear waves were modeled with COMSOL software. An amplitude shift keying (ASK) communication protocol for image transmission was developed and implemented in the GNURadio software-defined radio (SDR) environment. Digital information was converted to analog ultrasonic signals using Red Pitaya electronic boards. The performance of the ASK protocol is evaluated at the output of every block in the GNURadio program by monitoring the transmission of select characters. Using the ASK communication protocol, the transmission of the 32-KB image was demonstrated at 2-Kbps bitrate across 6-ft-long stainless steel pipe. Preliminary evaluation of ultrasonic communication on the piping of a nuclear facility, such as signal transmission on bent pipes, was performed with COMSOL computer simulations.

Computational prediction of GPCR oligomerization.

There has been a recent and prolific expansion in the number of GPCR crystal structures being solved: in both active and inactive forms and in complex with ligand, with G protein and with each other. Despite this, there is relatively little experimental information about the precise configuration of GPCR oligomers during these different biologically relevant states. While it may be possible to identify the experimental conditions necessary to crystallize a GPCR preferentially in a specific structural conformation, computational approaches afford a potentially more tractable means of describing the probability of formation of receptor dimers and higher order oligomers. Ensemble-based computational methods based on structurally determined dimers, coupled with a computational workflow that uses quantum mechanical methods to analyze the chemical nature of the molecular interactions at a GPCR dimer interface, will generate the reproducible and accurate predictions needed to predict previously unidentified GPCR dimers and to inform future advances in our ability to understand and begin to precisely manipulate GPCR oligomers in biological systems. It may also provide information needed to achieve an increase in the number of experimentally determined oligomeric GPCR structures.

Characterising GPCR-ligand interactions using a fragment molecular orbital-based approach.

There has been fantastic progress in solving GPCR crystal structures. However, the ability of X-ray crystallography to guide the drug discovery process for GPCR targets is limited by the availability of accurate tools to explore receptor-ligand interactions. Visual inspection and molecular mechanics approaches cannot explain the full complexity of molecular interactions. Quantum mechanical approaches (QM) are often too computationally expensive, but the fragment molecular orbital (FMO) method offers an excellent solution that combines accuracy, speed and the ability to reveal key interactions that would otherwise be hard to detect. Integration of GPCR crystallography or homology modelling with FMO reveals atomistic details of the individual contributions of each residue and water molecule towards ligand binding, including an analysis of their chemical nature.

Ensemble-Based Steered Molecular Dynamics Predicts Relative Residence Time of A2A Receptor Binders.

Drug-target residence time, the length of time for which a small molecule stays bound to its receptor target, has increasingly become a key property for optimization in drug discovery programs. However, its in silico prediction has proven difficult. Here we describe a method, using atomistic ensemble-based steered molecular dynamics (SMD), to observe the dissociation of ligands from their target G protein-coupled receptor in a time scale suitable for drug discovery. These dissociation simulations accurately, precisely, and reproducibly identify ligand-residue interactions and quantify the change in ligand energy values for both protein and water. The method has been applied to 17 ligands of the A2A adenosine receptor, all with published experimental kinetic binding data. The residues that interact with the ligand as it dissociates are known experimentally to have an effect on binding affinities and residence times. There is a good correlation ( R2 = 0.79) between the computationally calculated change in water-ligand interaction energy and experimentally determined residence time. Our results indicate that ensemble-based SMD is a rapid, novel, and accurate semi-empirical method for the determination of drug-target relative residence time.

In-silico guided discovery of novel CCR9 antagonists.

Antagonism of CCR9 is a promising mechanism for treatment of inflammatory bowel disease, including ulcerative colitis and Crohn's disease. There is limited experimental data on CCR9 and its ligands, complicating efforts to identify new small molecule antagonists. We present here results of a successful virtual screening and rational hit-to-lead campaign that led to the discovery and initial optimization of novel CCR9 antagonists. This work uses a novel data fusion strategy to integrate the output of multiple computational tools, such as 2D similarity search, shape similarity, pharmacophore searching, and molecular docking, as well as the identification and incorporation of privileged chemokine fragments. The application of various ranking strategies, which combined consensus and parallel selection methods to achieve a balance of enrichment and novelty, resulted in 198 virtual screening hits in total, with an overall hit rate of 18%. Several hits were developed into early leads through targeted synthesis and purchase of analogs.

Exploring GPCR-Ligand Interactions with the Fragment Molecular Orbital (FMO) Method.

The understanding of binding interactions between any protein and a small molecule plays a key role in the rationalization of affinity and selectivity. It is essential for an efficient structure-based drug design (SBDD) process. FMO enables ab initio approaches to be applied to systems that conventional quantum-mechanical (QM) methods would find challenging. The key advantage of the Fragment Molecular Orbital Method (FMO) is that it can reveal atomistic details about the individual contributions and chemical nature of each residue and water molecule toward ligand binding which would otherwise be difficult to detect without using QM methods. In this chapter, we demonstrate the typical use of FMO to analyze 19 crystal structures of ß1 and ß2 adrenergic receptors with their corresponding agonists and antagonists.