The Effective Fragment Molecular Orbital Method: Achieving High Scalability and Accuracy for Large Systems.

The effective fragment molecular orbital (EFMO) method has been developed to predict the total energy of a very large molecular system accurately (with respect to the underlying quantum mechanical method) and efficiently by taking advantage of the locality of strong chemical interactions and employing a two-level hierarchical parallelism. The accuracy of the EFMO method is partly attributed to the accurate and robust intermolecular interaction prediction between distant fragments, in particular, the many-body polarization and dispersion effects, which require the generation of static and dynamic polarizability tensors by solving the coupled perturbed Hartree-Fock (CPHF) and time-dependent HF (TDHF) equations, respectively. Solving the CPHF and TDHF equations is the main EFMO computational bottleneck due to the inefficient (serial) and I/O-intensive implementation of the CPHF and TDHF solvers. In this work, the efficiency and scalability of the EFMO method are significantly improved with a new CPU memory-based implementation for solving the CPHF and TDHF equations that are parallelized by either message passing interface (MPI) or hybrid MPI/OpenMP. The accuracy of the EFMO method is demonstrated for both covalently bonded systems and noncovalently bound molecular clusters by systematically examining the effects of basis sets and a key distance-related cutoff parameter, Rcut. Rcut determines whether a fragment pair (dimer) is treated by the chosen ab initio method or calculated using the effective fragment potential (EFP) method (separated dimers). Decreasing the value of Rcut increases the number of separated (EFP) dimers, thereby decreasing the computational effort. It is demonstrated that excellent accuracy (<1 kcal/mol error per fragment) can be achieved when using a sufficiently large basis set with diffuse functions coupled with a small Rcut value. With the new parallel implementation, the total EFMO wall time is substantially reduced, especially with a high number of MPI ranks. Given a sufficient workload, nearly ideal strong scaling is achieved for the CPHF and TDHF parts of the calculation. For the first time, EFMO calculations with the inclusion of long-range polarization and dispersion interactions on a hydrated mesoporous silica nanoparticle with explicit water solvent molecules (more than 15k atoms) are achieved on a massively parallel supercomputer using nearly 1000 physical nodes. In addition, EFMO calculations on the carbinolamine formation step of an amine-catalyzed aldol reaction at the nanoscale with explicit solvent effects are presented.

Prediction of stability constants of metal-ligand complexes by machine learning for the design of ligands with optimal metal ion selectivity.

The new LOGKPREDICT program integrates HostDesigner molecular design software with the machine learning (ML) program Chemprop. By supplying HostDesigner with predicted log K values, LOGKPREDICT enhances the computer-aided molecular design process by ranking ligands directly by metal-ligand binding strength. Harnessing reliable experimental data from a historic National Institute of Standards and Technology (NIST) database and data from the International Union of Pure and Applied Chemistry (IUPAC), we train message passing neural net algorithms. The multi-metal NIST-based ML model has a root mean square error (RMSE) of 0.629 ± 0.044 (R2 of 0.960 ± 0.006), while two versions of lanthanide-only IUPAC-based ML models have, respectively, RMSE of 0.764 ± 0.073 (R2 of 0.976 ± 0.005) and 0.757 ± 0.071 (R2 of 0.959 ± 0.007). For relative log K predictions on an out-of-sample set of six ligands, demonstrating metal ion selectivity, the RMSE value reaches a commendably low 0.25. We showcase the use of LOGKPREDICT in identifying ligands with high selectivity for lanthanides in aqueous solutions, a finding supported by recent experimental evidence. We also predict new ligands yet to be verified experimentally. Therefore, our ML models implemented through LOGKPREDICT and interfaced with the ligand design software HostDesigner pave the way for designing new ligands with predetermined selectivity for competing metal ions in an aqueous solution.

R-8 Dispersion Interaction: Derivation and Application to the Effective Fragment Potential Method.

The anisotropic and isotropic R-8 dispersion contributions (disp8) are derived and implemented within the framework of the effective fragment potential (EFP) method formulated with imaginary frequency-dependent Cartesian polarizability tensors distributed at the centroids of the localized molecular orbitals (LMOs). Two forms of damping functions, intermolecular overlap-based and Tang-Toennies, are extended for disp8. To obtain LMO polarizability tensors centered at LMO centroids, an origin-shifting transformation is derived and implemented for the dipole-octopole polarizability tensor and the quadrupole-quadrupole polarizability tensor. The analytic gradient is derived and implemented for the isotropic disp8 contribution. Relative to the previously implemented empirical EFP disp8 energy, the isotropic disp8 component of the interaction energy improves the overall agreement of the EFP dispersion energies with the symmetry-adapted perturbation theory (SAPT) benchmarks, reducing the mean absolute errors (MAEs) and mean absolute percentage errors for most of the databases examined in this work. While the anisotropic disp8 can further enhance the accuracy of the EFP dispersion energy and yield smaller MAEs, significantly overbound dispersion energies are predicted by the anisotropic disp8 when the maximum element in the intermolecular overlap matrix is greater than 0.1, possibly due to the breakdown of the approximations made in the EFP dispersion derivation at a short range. For potential energy scan databases, the newly developed EFP dispersion model with isotropic disp8 yields the overall correct curvature and good agreement with SAPT benchmarks around equilibrium and longer but overestimates the dispersion interactions at a short range. While the overlap-based dispersion-damping functions produce better MAEs than Tang-Toennies damping functions, further improvement is needed to better screen the large attractive dispersion energies at a short range (overlap >0.1).

Spin-orbit coupling of electrons on separate lanthanide atoms of Pr2O2 and its singly charged cation.

Although it plays a critical role in the photophysics and catalysis of lanthanides, spin-orbit coupling of electrons on individual lanthanide atoms in small clusters is not well understood. The major objective of this work is to probe such coupling of the praseodymium (Pr) 4f and 6s electrons in Pr2O2 and Pr2O2+. The approach combines mass-analyzed threshold ionization spectroscopy and spin-orbit multiconfiguration second-order quasi-degenerate perturbation theory. The energies of six ionization transitions are precisely measured; the adiabatic ionization energy of the neutral cluster is 38 045 (5) cm-1. Most of the electronic states involved in these transitions are identified as spin-orbit coupled states consisting of two or more electron spins. The electron configurations of these states are 4f46s2 for the neutral cluster and 4f46s for the singly charged cation, both in planar rhombus-type structures. The spin-orbit splitting due to the coupling of the electrons on the separate Pr atoms is on the order of hundreds of wavenumbers.

Intermolecular interactions in clusters of ethylammonium nitrate and 1-amino-1,2,3-triazole.

The intermolecular interaction energies, including hydrogen bonds (H-bonds), of clusters of the ionic liquid ethylammonium nitrate (EAN) and 1-amino-1,2,3-triazole (1-AT) based deep eutectic propellants (DeEP) are examined. 1-AT is introduced as a neutral hydrogen bond donor (HBD) to EAN in order to form a eutectic mixture. The effective fragment potential (EFP) is used to examine the bonding interactions in the DeEP clusters. The resolution of the Identity (RI) approximated second order Møller-Plesset perturbation theory (RI-MP2) and coupled cluster theory (RI-CCSD(T)) are used to validate the EFP results. The EFP method predicts that there are significant polarization and charge transfer effects in the EAN:1-AT complexes, along with Coulombic, dispersion and exchange repulsion interactions. The EFP interaction energies are in good agreement with the RI-MP2 and RI-CCSD(T) results. The quasi-atomic orbital (QUAO) bonding and kinetic bond order (KBO) analyses are additionally used to develop a conceptual and semi-quantitative understanding of the H-bonding interactions as a function of the size of the system. The QUAO and KBO analyses suggest that the H-bonds in the examined clusters follow the characteristic hydrogen bonding three-center four electron interactions. The strongest H-bonding interactions between the (EAN)1:(1-AT)n and (EAN)2:(1-AT)n (n = 1-5) complexes are observed internally within EAN; that is, between the ethylammonium cation [EA]+ and the nitrate anion ([NO3]-). The weakest H-bonding interactions occur between [NO3]- and 1-AT. Consequently, the average strengths of the H-bonds within a given (EAN)x:(1-AT)n complex decrease as more 1-AT molecules are introduced into the EAN monomer and EAN dimer. The QUAO bonding analysis suggests that 1-AT in (EAN)x:(1-AT)n can act as both a HBD and a hydrogen bond acceptor simultaneously. It is observed that two 1-AT molecules can form H-bonds to each other. Although the KBOs that correspond to H-bonding interactions in [EA]+:1-AT, [NO3]-:1-AT and between two 1-AT molecules are weaker than the H-bonds in EAN, those weak H-bond networks with 1-AT could be important to form a stable DeEP.

Accelerating Coupled-Cluster Calculations with GPUs: An Implementation of the Density-Fitted CCSD(T) Approach for Heterogeneous Computing Architectures Using OpenMP Directives.

An algorithm is presented for the coupled-cluster singles, doubles, and perturbative triples correction [CCSD(T)] method based on the density fitting or the resolution-of-the-identity (RI) approximation for performing calculations on heterogeneous computing platforms composed of multicore CPUs and graphics processing units (GPUs). The directive-based approach to GPU offloading offered by the OpenMP application programming interface has been employed to adapt the most compute-intensive terms in the RI-CCSD amplitude equations with computational costs scaling as O(NO2NV4), O(NO3NV3), and O(NO4NV2) (where NO and NV denote the numbers of correlated occupied and virtual orbitals, respectively) and the perturbative triples correction to execute on GPU architectures. The pertinent tensor contractions are performed using an accelerated math library such as cuBLAS or hipBLAS. Optimal strategies are discussed for splitting large data arrays into tiles to fit them into the relatively small memory space of the GPUs, while also minimizing the low-bandwidth CPU-GPU data transfers. The performance of the hybrid CPU-GPU RI-CCSD(T) code is demonstrated on pre-exascale supercomputers composed of heterogeneous nodes equipped with NVIDIA Tesla V100 and A100 GPUs and on the world's first exascale supercomputer named "Frontier", the nodes of which consist of AMD MI250X GPUs. Speedups within the range 4-8× relative to the recently reported CPU-only algorithm are obtained for the GPU-offloaded terms in the RI-CCSD amplitude equations. Applications to polycyclic aromatic hydrocarbons containing 16-66 carbon atoms demonstrate that the acceleration of the hybrid CPU-GPU code for the perturbative triples correction relative to the CPU-only code increases with the molecule size, attaining a speedup of 5.7× for the largest circumovalene molecule (C66H20). The GPU-offloaded code enables the computation of the perturbative triples correction for the C60 molecule using the cc-pVDZ/aug-cc-pVTZ-RI basis sets in 7 min on Frontier when using 12,288 AMD GPUs with a parallel efficiency of 83.1%.

Analysis of the bonding in tetrahedrane and phosphorus-substituted tetrahedranes.

The bonding structures of tetrahedrane, phosphatetrahedrane, diphosphatetrahedrane and triphosphatetrahedrane are studied by employing an intrinsic quasi-atomic orbital analysis. Ethane, cyclopropane and tetrahedral P4 are employed as reference systems. The orbital analysis is paired with the computation of strain energies via isodesmic reactions. The results show that the increase in geometric strain upon transition from ethane to cyclopropane to tetrahedrane weakens the CC bonds, despite leading to shorter C-C interatomic distances. With the increase in strain, the orbitals centered on C and involved in the bonding of the cage structure are observed to have elevated p-character, and the orbital structure of C deviates from sp3 hybridization. The systematic substitution of CH groups by P atoms in the cage structure of tetrahedrane leads to stronger CC bonds, larger angles in the cage structures of the resulting phosphatetrahedranes, lower p-character in the orbitals involved in the bonding of the cages, and lower strain energies. It is found that P is more amenable to strained molecular arrangements than is C, and that the propensity of a given atom to hybridize s and p functions, or the lack thereof, has implications in the stability of molecules with strained geometries. The combination of the calculations presented here with the existing literature provides insight into the apparent propensity of tetrahedrane and P4 to 'break' their tetrahedral structures. Trends in the bonding interactions, such as bond strengths, s- and p-orbital characters and charge transfer are identified and related to the strain energy observed in each of the analyzed systems.

The General Atomic and Molecular Electronic Structure System (GAMESS): Novel Methods on Novel Architectures.

The primary focus of GAMESS over the last 5 years has been the development of new high-performance codes that are able to take effective and efficient advantage of the most advanced computer architectures, both CPU and accelerators. These efforts include employing density fitting and fragmentation methods to reduce the high scaling of well-correlated (e.g., coupled-cluster) methods as well as developing novel codes that can take optimal advantage of graphical processing units and other modern accelerators. Because accurate wave functions can be very complex, an important new functionality in GAMESS is the quasi-atomic orbital analysis, an unbiased approach to the understanding of covalent bonds embedded in the wave function. Best practices for the maintenance and distribution of GAMESS are also discussed.

Toward an extreme-scale electronic structure system.

Electronic structure calculations have the potential to predict key matter transformations for applications of strategic technological importance, from drug discovery to material science and catalysis. However, a predictive physicochemical characterization of these processes often requires accurate quantum chemical modeling of complex molecular systems with hundreds to thousands of atoms. Due to the computationally demanding nature of electronic structure calculations and the complexity of modern high-performance computing hardware, quantum chemistry software has historically failed to operate at such large molecular scales with accuracy and speed that are useful in practice. In this paper, novel algorithms and software are presented that enable extreme-scale quantum chemistry capabilities with particular emphasis on exascale calculations. This includes the development and application of the multi-Graphics Processing Unit (GPU) library LibCChem 2.0 as part of the General Atomic and Molecular Electronic Structure System package and of the standalone Extreme-scale Electronic Structure System (EXESS), designed from the ground up for scaling on thousands of GPUs to perform high-performance accurate quantum chemistry calculations at unprecedented speed and molecular scales. Among various results, we report that the EXESS implementation enables Hartree-Fock/cc-pVDZ plus RI-MP2/cc-pVDZ/cc-pVDZ-RIFIT calculations on an ionic liquid system with 623 016 electrons and 146 592 atoms in less than 45 min using 27 600 GPUs on the Summit supercomputer with a 94.6% parallel efficiency.

Enabling Fortran Standard Parallelism in GAMESS for Accelerated Quantum Chemistry Calculations.

The performance of Fortran 2008 DO CONCURRENT (DC) relative to OpenACC and OpenMP target offloading (OTO) with different compilers is studied for the GAMESS quantum chemistry application. Specifically, DC and OTO are used to offload the Fock build, which is a computational bottleneck in most quantum chemistry codes, to GPUs. The DC Fock build performance is studied on NVIDIA A100 and V100 accelerators and compared with the OTO versions compiled by the NVIDIA HPC, IBM XL, and Cray Fortran compilers. The results show that DC can speed up the Fock build by 3.0× compared with that of the OTO model. With similar offloading efforts, DC is a compelling programming model for offloading Fortran applications to GPUs.

High-performance strategies for the recent MRSF-TDDFT in GAMESS.

Multiple ERI (Electron Repulsion Integral) tensor contractions (METC) with several matrices are ubiquitous in quantum chemistry. In response theories, the contraction operation, rather than ERI computations, can be the major bottleneck, as its computational demands are proportional to the multiplicatively combined contributions of the number of excited states and the kernel pre-factors. This paper presents several high-performance strategies for METC. Optimal approaches involve either the data layout reformations of interim density and Fock matrices, the introduction of intermediate ERI quartet buffer, and loop-reordering optimization for a higher cache hit rate. The combined strategies remarkably improve the performance of the MRSF (mixed reference spin flip)-TDDFT (time-dependent density functional theory) by nearly 300%. The results of this study are not limited to the MRSF-TDDFT method and can be applied to other METC scenarios.

Porting fragmentation methods to GPUs using an OpenMP API: Offloading the resolution-of-the-identity second-order Møller-Plesset perturbation method.

Using an OpenMP Application Programming Interface, the resolution-of-the-identity second-order Møller-Plesset perturbation (RI-MP2) method has been off-loaded onto graphical processing units (GPUs), both as a standalone method in the GAMESS electronic structure program and as an electron correlation energy component in the effective fragment molecular orbital (EFMO) framework. First, a new scheme has been proposed to maximize data digestion on GPUs that subsequently linearizes data transfer from central processing units (CPUs) to GPUs. Second, the GAMESS Fortran code has been interfaced with GPU numerical libraries (e.g., NVIDIA cuBLAS and cuSOLVER) for efficient matrix operations (e.g., matrix multiplication, matrix decomposition, and matrix inversion). The standalone GPU RI-MP2 code shows an increasing speedup of up to 7.5× using one NVIDIA V100 GPU with one IBM 42-core P9 CPU for calculations on fullerenes of increasing size from 40 to 260 carbon atoms using the 6-31G(d)/cc-pVDZ-RI basis sets. A single Summit node with six V100s can compute the RI-MP2 correlation energy of a cluster of 175 water molecules using the correlation consistent basis sets cc-pVDZ/cc-pVDZ-RI containing 4375 atomic orbitals and 14 700 auxiliary basis functions in ∼0.85 h. In the EFMO framework, the GPU RI-MP2 component shows near linear scaling for a large number of V100s when computing the energy of an 1800-atom mesoporous silica nanoparticle in a bath of 4000 water molecules. The parallel efficiencies of the GPU RI-MP2 component with 2304 and 4608 V100s are 98.0% and 96.1%, respectively.

Porting Fragmentation Methods to Graphical Processing Units Using an OpenMP Application Programming Interface: Offloading the Fock Build for Low Angular Momentum Functions.

A framework to offload four-index two-electron repulsion integrals to graphical processing units (GPUs) using OpenMP is discussed. The method has been applied to the Fock build for low angular momentum s and p functions in both the restricted Hartree-Fock (RHF) and in the effective fragment molecular orbital (EFMO) framework. Benchmark calculations for the GPU code for the pure RHF method show an increasing speedup relative to the existing OpenMP CPU code in GAMESS from 1.04 to 52× for clusters of 70-569 water molecules. The parallel efficiency on 24 NVIDIA V100 GPU boards also increases when increasing the system size: from 75 to 94% for water clusters that contain 303-1120 molecules. In the EFMO framework, the GPU Fock build shows a high linear scalability up to 4608 V100s with a parallel efficiency of 96% for calculations on a solvated mesoporous silica nanoparticle system with ∼67,000 basis functions.

Quantum Chemical Modeling of Propellant Degradation.

An ab initio quantum chemical approach for the modeling of propellant degradation is presented. Using state-of-the-art bonding analysis techniques and composite methods, a series of potential degradation reactions are devised for a sample hydroxyl-terminated-polybutadiene (HTPB) type solid fuel. By applying thermochemical procedures and isodesmic reactions, accurate thermochemical quantities are obtained using a modified G3 composite method based on the resolution of the identity. The calculated heats of formation for the different structures produced presents an ∼2 kcal/mol average error when compared against experimental values.

General, Rigorous Approach for the Treatment of Interfragment Covalent Bonds.

A generalized, projection-based transformation of the method-agnostic Fock operator in various ab initio fragment-based quantum chemistry methods has been developed for the treatment of interfragment covalent bonds. This transformation freezes the relevant localized molecular orbital associated with each interfragment bond, thereby restricting the variational subspace of the fragment wave functions, in order to maintain the proper physical characteristics of the involved covalent bonds. In addition, sets of orbitals that would lead to multiple occupancy of certain orbitals are explicitly removed from the variational space. The transformation is developed for the specific case of mutually orthonormal frozen and unfrozen orbitals within each fragment. The newly developed approach is then used to study model systems with two popular ab initio fragment-based methods, and the results of these calculations are compared to those obtained by existing methodologies. Analysis is focused on both quantitative and qualitative accuracy as well as computational scalability and stability. Other methods for which the developed formalisms are appropriate are outlined, and future extensions of the methods are discussed.

Electronic states and transitions of PrO and PrO+ probed by threshold ionization spectroscopy and spin-orbit multiconfiguration perturbation theory.

The precise ionization energy of praseodymium oxide (PrO) seeded in supersonic molecular beams is measured with mass-analyzed threshold ionization (MATI) spectroscopy. A total of 33 spin-orbit (SO) states of PrO and 23 SO states of PrO+ are predicted by second-order multiconfigurational quasi-degenerate perturbation (MCQDPT2) theory. Electronic transitions from four low-energy SO levels of the neutral molecule to the ground state of the singly charged cation are identified by combining the MATI spectroscopic measurements with the MCQDPT2 calculations. The precise ionization energy is used to reassess the ionization energies and the reaction enthalpies of the Pr + O → PrO+ + e- chemi-ionization reaction reported in the literature. An empirical formula that uses atomic electronic parameters is proposed to predict the ionization energies of lanthanide monoxides, and the empirical calculations match well with available precise experimental measurements.

Coarse-Grained Water Model Development for Accurate Dynamics and Structure Prediction.

Several coarse-graining (CG) methods have been combined to develop a CG model of water capable of the accurate prediction of structure and dynamics properties. The multiscale coarse-graining (MS-CG) method based on force matching and the PDF-based coarse-graining method were used for accurate dynamics prediction. The iterative Boltzmann inversion (IBI) method was added for accurate structure representation. The approach is applied to bulk water, and the results show close reproduction of the CG structure when compared with the reference atomistic data. The combination of MS-CG and IBI methods facilitates the development of CG force fields at different temperatures based on a single MS-CG coarse-graining procedure. The dynamic properties of the CG water model closely match those obtained from the reference atomistic system. The general application of this approach to any existing coarse-graining methods is discussed.

Intramolecular hydrogen bonding analysis.

The quasi-atomic orbital (QUAO) bonding analysis is used to study intramolecular hydrogen bonding (IMHB) in salicylic acid and an intermediate that is crucial to the synthesis of aspirin. The bonding analysis rigorously explores IMHB through directly accessing information that is intrinsic to the molecular wave function, thereby bypassing the need for intrinsically biased methods. The variables that affect the strength of IMHB are determined using kinetic bond orders, QUAO populations, and QUAO hybridizations. Important properties include both the interatomic distance between hydrogen and oxygen participating in the IMHB and the hybridization on the oxygen. The bonding analysis further shows that each intramolecular hydrogen bond is a four-electron three-center bond. The bonding analysis is used to understand how aromatic reactivity changes due to the effect of functional groups on the aromatic ring.

Molecular interactions in diffusion-controlled aldol condensation with mesoporous silica nanoparticles.

The aldol reaction of p-nitrobenzaldehyde in amino-catalyzed mesoporous silica nanoparticles (MSN) has revealed varying catalytic activity with the size of the pores of MSN. The pore size dependence related to the reactivity indicates that the diffusion process is important. A detailed molecular-level analysis for understanding diffusion requires assessment of the noncovalent interactions of the molecular species involved in the aldol reaction with each other, with the solvent, and with key functional groups on the pore surface. Such an analysis is presented here based upon the effective fragment potential (EFP). The EFP method can calculate the intermolecular interactions, decomposed into Coulomb, polarization, dispersion, exchange-repulsion, and charge-transfer interactions. In this study, the potential energy surfaces corresponding to each intermolecular interaction are analyzed for homo- and hetero-dimers with various configurations. The monomers that compose dimers are five molecules such as p-nitrobenzaldehyde, acetone, n-hexane, propylamine, and silanol. The results illustrate that the dispersion interaction is crucial in most dimers.