14 examples of how LLMs can transform materials science and chemistry: a reflection on a large language model hackathon.

Large-language models (LLMs) such as GPT-4 caught the interest of many scientists. Recent studies suggested that these models could be useful in chemistry and materials science. To explore these possibilities, we organized a hackathon. This article chronicles the projects built as part of this hackathon. Participants employed LLMs for various applications, including predicting properties of molecules and materials, designing novel interfaces for tools, extracting knowledge from unstructured data, and developing new educational applications. The diverse topics and the fact that working prototypes could be generated in less than two days highlight that LLMs will profoundly impact the future of our fields. The rich collection of ideas and projects also indicates that the applications of LLMs are not limited to materials science and chemistry but offer potential benefits to a wide range of scientific disciplines.

A Perspective on Sustainable Computational Chemistry Software Development and Integration.

The power of quantum chemistry to predict the ground and excited state properties of complex chemical systems has driven the development of computational quantum chemistry software, integrating advances in theory, applied mathematics, and computer science. The emergence of new computational paradigms associated with exascale technologies also poses significant challenges that require a flexible forward strategy to take full advantage of existing and forthcoming computational resources. In this context, the sustainability and interoperability of computational chemistry software development are among the most pressing issues. In this perspective, we discuss software infrastructure needs and investments with an eye to fully utilize exascale resources and provide unique computational tools for next-generation science problems and scientific discoveries.

A parallel, distributed memory implementation of the adaptive sampling configuration interaction method.

The many-body simulation of quantum systems is an active field of research that involves several different methods targeting various computing platforms. Many methods commonly employed, particularly coupled cluster methods, have been adapted to leverage the latest advances in modern high-performance computing. Selected configuration interaction (sCI) methods have seen extensive usage and development in recent years. However, the development of sCI methods targeting massively parallel resources has been explored only in a few research works. Here, we present a parallel, distributed memory implementation of the adaptive sampling configuration interaction approach (ASCI) for sCI. In particular, we will address the key concerns pertaining to the parallelization of the determinant search and selection, Hamiltonian formation, and the variational eigenvalue calculation for the ASCI method. Load balancing in the search step is achieved through the application of memory-efficient determinant constraints originally developed for the ASCI-PT2 method. The presented benchmarks demonstrate near optimal speedup for ASCI calculations of Cr2 (24e, 30o) with 106, 107, and 3 × 108 variational determinants on up to 16 384 CPUs. To the best of the authors' knowledge, this is the largest variational ASCI calculation to date.

Distributed memory, GPU accelerated Fock construction for hybrid, Gaussian basis density functional theory.

With the growing reliance of modern supercomputers on accelerator-based architecture such a graphics processing units (GPUs), the development and optimization of electronic structure methods to exploit these massively parallel resources has become a recent priority. While significant strides have been made in the development GPU accelerated, distributed memory algorithms for many modern electronic structure methods, the primary focus of GPU development for Gaussian basis atomic orbital methods has been for shared memory systems with only a handful of examples pursing massive parallelism. In the present work, we present a set of distributed memory algorithms for the evaluation of the Coulomb and exact exchange matrices for hybrid Kohn-Sham DFT with Gaussian basis sets via direct density-fitted (DF-J-Engine) and seminumerical (sn-K) methods, respectively. The absolute performance and strong scalability of the developed methods are demonstrated on systems ranging from a few hundred to over one thousand atoms using up to 128 NVIDIA A100 GPUs on the Perlmutter supercomputer.

PluginPlay: Enabling exascale scientific software one module at a time.

For many computational chemistry packages, being able to efficiently and effectively scale across an exascale cluster is a heroic feat. Collective experience from the Department of Energy's Exascale Computing Project suggests that achieving exascale performance requires far more planning, design, and optimization than scaling to petascale. In many cases, entire rewrites of software are necessary to address fundamental algorithmic bottlenecks. This in turn requires a tremendous amount of resources and development time, resources that cannot reasonably be afforded by every computational science project. It thus becomes imperative that computational science transition to a more sustainable paradigm. Key to such a paradigm is modular software. While the importance of modular software is widely recognized, what is perhaps not so widely appreciated is the effort still required to leverage modular software in a sustainable manner. The present manuscript introduces PluginPlay, https://github.com/NWChemEx-Project/PluginPlay, an inversion-of-control framework designed to facilitate developing, maintaining, and sustaining modular scientific software packages. This manuscript focuses on the design aspects of PluginPlay and how they specifically influence the performance of the resulting package. Although, PluginPlay serves as the framework for the NWChemEx package, PluginPlay is not tied to NWChemEx or even computational chemistry. We thus anticipate PluginPlay to prove to be a generally useful tool for a number of computational science packages looking to transition to the exascale.

Computing the Many-Body Green's Function with Adaptive Variational Quantum Dynamics.

We present a method to compute the many-body real-time Green's function using an adaptive variational quantum dynamics simulation approach. The real-time Green's function involves the time evolution of a quantum state with one additional electron with respect to the ground state wave function that is first expressed as a linear-linear combination of state vectors. The real-time evolution and the Green's function are obtained by combining the dynamics of the individual state vectors in a linear combination. The use of the adaptive protocol enables us to generate compact ansatzes on-the-fly while running the simulation. In order to improve the convergence of spectral features, Padé approximants are applied to obtain the Fourier transform of the Green's function. We demonstrate the evaluation of the Green's function on an IBM Q quantum computer. As a part of our error mitigation strategy, we develop a resolution-enhancing method that we successfully apply on the noisy data from the real-quantum hardware.

Tris(carbene)borates; alternatives to cyclopentadienyls in organolanthanide chemistry.

The chemistry of the tris-carbene anion phenyltris(3-alkyl-imidazoline-2-yliden-1-yl)borate, [C3Me]- ligand, is initiated for f-block metal cations. Neutral, molecular complexes of the form Ln(C3)2I are formed for cerium(III), while a separated ion pair [Ln(C3)2]I forms for ytterbium(III). DFT/QTAIM computational analyses of the complexes and related tridentate tris(pyrazolyl)borate (Tp) - supported analogs demonstrates the anticipated strength of the σ donation and confirms greater covalency in the metal-carbon bonds of the [C3Me]- complexes in comparison with those in the TpMe,Me complexes. The DFT calculations demonstrate the crucial role of THF solvent in accurately reproducing the contrasting molecular and ion-pair geometries observed experimentally for the Ce and Yb complexes.

Exploring finite temperature properties of materials with quantum computers.

Thermal properties of nanomaterials are crucial to not only improving our fundamental understanding of condensed matter systems, but also to developing novel materials for applications spanning research and industry. Since quantum effects arise at the nano-scale, these systems are difficult to simulate on classical computers. Quantum computers can efficiently simulate quantum many-body systems, yet current quantum algorithms for calculating thermal properties of these systems incur significant computational costs in that they either prepare the full thermal state on the quantum computer, or they must sample a number of pure states from a distribution that grows with system size. Canonical thermal pure quantum (TPQ) states provide a promising path to estimating thermal properties of quantum materials as they neither require preparation of the full thermal state nor require a growing number of samples with system size. Here, we present an algorithm for preparing canonical TPQ states on quantum computers. We compare three different circuit implementations for the algorithm and demonstrate their capabilities in estimating thermal properties of quantum materials. Due to its increasing accuracy with system size and flexibility in implementation, we anticipate that this method will enable finite temperature explorations of relevant quantum materials on near-term quantum computers.

Computing Free Energies with Fluctuation Relations on Quantum Computers.

As a central thermodynamic property, free energy enables the calculation of virtually any equilibrium property of a physical system, allowing for the construction of phase diagrams and predictions about transport, chemical reactions, and biological processes. Thus, methods for efficiently computing free energies, which in general is a difficult problem, are of great interest to broad areas of physics and the natural sciences. The majority of techniques for computing free energies target classical systems, leaving the computation of free energies in quantum systems less explored. Recently developed fluctuation relations enable the computation of free energy differences in quantum systems from an ensemble of dynamic simulations. While performing such simulations is exponentially hard on classical computers, quantum computers can efficiently simulate the dynamics of quantum systems. Here, we present an algorithm utilizing a fluctuation relation known as the Jarzynski equality to approximate free energy differences of quantum systems on a quantum computer. We discuss under which conditions our approximation becomes exact, and under which conditions it serves as a strict upper bound. Furthermore, we successfully demonstrate a proof of concept of our algorithm using the transverse field Ising model on a real quantum processor. As quantum hardware continues to improve, we anticipate that our algorithm will enable computation of free energy differences for a wide range of quantum systems useful across the natural sciences.

The Effect of Geometry, Spin, and Orbital Optimization in Achieving Accurate, Correlated Results for Iron-Sulfur Cubanes.

Iron-sulfur clusters comprise an important functional motif in the catalytic centers of biological systems, capable of enabling important chemical transformations at ambient conditions. This remarkable capability derives from a notoriously complex electronic structure that is characterized by a high density of states that is sensitive to geometric changes. The spectral sensitivity to subtle geometric changes has received little attention from correlated, large active space calculations, owing partly to the exceptional computational complexity for treating these large and correlated systems accurately. To provide insight into this aspect, we report the first Complete Active Space Self Consistent Field (CASSCF) calculations for different geometries of the [Fe(II/III)4S4(SMe)4]-2 clusters using two complementary, correlated solvers: spin-pure Adaptive Sampling Configuration Interaction (ASCI) and Density Matrix Renormalization Group (DMRG). We find that the previously established picture of a double-exchange driven magnetic structure, with minute energy gaps (<1 mHa) between consecutive spin states, has a weak dependence on the underlying geometry. However, the spin gap between the singlet and the spin state 2S + 1 = 19, corresponding to a maximal number of Fe-d electrons being unpaired and of parallel spin, is strongly geometry dependent, changing by a factor of 3 upon slight deformations that are still within biologically relevant parameters. The CASSCF orbital optimization procedure, using active spaces as large as 86 electrons in 52 orbitals, was found to reduce this gap compared to typical mean-field orbital approaches. Our results show the need for performing large active space calculations to unveil the challenging electronic structure of these complex catalytic centers and should serve as accurate starting points for fully correlated treatments upon inclusion of dynamical correlation outside the active space.

Reactions of U+ with H2, D2, and HD Studied by Guided Ion Beam Tandem Mass Spectrometry and Theory.

The kinetic energy-dependent reactions of the atomic actinide uranium cation (U+) with H2, D2, and HD were examined by guided ion beam tandem mass spectrometry. An average 0 K bond dissociation energy of D0(U+ - H) = 2.48 ± 0.06 eV is obtained by analysis of the endothermic product ion cross sections. Quantum chemistry calculations were performed for comparison with experimental thermochemistry, including high-level CASSCF-CASPT2-RASSI calculations of the spin-orbit corrections. CCSD(T) and the CASSCF levels show excellent agreement with experiment, whereas B3LYP and PBE0 slightly overestimate and the M06 approach badly underestimates the bond energy for UH+. Theory was also used to investigate the electronic structures of the reaction intermediates and potential energy surfaces. The experimental product branching ratio for the reaction of U+ with HD indicates that these reactions occur primarily via a direct reaction mechanism, despite the presence of a deep-well for UH2+ formation according to theory. The reactivity and hydride bond energy for U+ are compared with those for transition metal, lanthanide, and actinide cations, and periodic trends are discussed. These comparisons suggest that the 5f electrons on uranium are largely core and uninvolved in the reactive chemistry.

From NWChem to NWChemEx: Evolving with the Computational Chemistry Landscape.

Since the advent of the first computers, chemists have been at the forefront of using computers to understand and solve complex chemical problems. As the hardware and software have evolved, so have the theoretical and computational chemistry methods and algorithms. Parallel computers clearly changed the common computing paradigm in the late 1970s and 80s, and the field has again seen a paradigm shift with the advent of graphical processing units. This review explores the challenges and some of the solutions in transforming software from the terascale to the petascale and now to the upcoming exascale computers. While discussing the field in general, NWChem and its redesign, NWChemEx, will be highlighted as one of the early codesign projects to take advantage of massively parallel computers and emerging software standards to enable large scientific challenges to be tackled.

Quantum Algorithm for High Energy Physics Simulations.

Simulating quantum field theories is a flagship application of quantum computing. However, calculating experimentally relevant high energy scattering amplitudes entirely on a quantum computer is prohibitively difficult. It is well known that such high energy scattering processes can be factored into pieces that can be computed using well established perturbative techniques, and pieces which currently have to be simulated using classical Markov chain algorithms. These classical Markov chain simulation approaches work well to capture many of the salient features, but cannot capture all quantum effects. To exploit quantum resources in the most efficient way, we introduce a new paradigm for quantum algorithms in field theories. This approach uses quantum computers only for those parts of the problem which are not computable using existing techniques. In particular, we develop a polynomial time quantum final state shower that accurately models the effects of intermediate spin states similar to those present in high energy electroweak showers with a global evolution variable. The algorithm is explicitly demonstrated for a simplified quantum field theory on a quantum computer.

Mitigating Depolarizing Noise on Quantum Computers with Noise-Estimation Circuits.

A significant problem for current quantum computers is noise. While there are many distinct noise channels, the depolarizing noise model often appropriately describes average noise for large circuits involving many qubits and gates. We present a method to mitigate the depolarizing noise by first estimating its rate with a noise-estimation circuit and then correcting the output of the target circuit using the estimated rate. The method is experimentally validated on a simulation of the Heisenberg model. We find that our approach in combination with readout-error correction, randomized compiling, and zero-noise extrapolation produces close to exact results even for circuits containing hundreds of CNOT gates. We also show analytically that zero-noise extrapolation is improved when it is applied to the output of our method.

On the Efficient Evaluation of the Exchange Correlation Potential on Graphics Processing Unit Clusters.

The predominance of Kohn-Sham density functional theory (KS-DFT) for the theoretical treatment of large experimentally relevant systems in molecular chemistry and materials science relies primarily on the existence of efficient software implementations which are capable of leveraging the latest advances in modern high-performance computing (HPC). With recent trends in HPC leading toward increasing reliance on heterogeneous accelerator-based architectures such as graphics processing units (GPU), existing code bases must embrace these architectural advances to maintain the high levels of performance that have come to be expected for these methods. In this work, we purpose a three-level parallelism scheme for the distributed numerical integration of the exchange-correlation (XC) potential in the Gaussian basis set discretization of the Kohn-Sham equations on large computing clusters consisting of multiple GPUs per compute node. In addition, we purpose and demonstrate the efficacy of the use of batched kernels, including batched level-3 BLAS operations, in achieving high levels of performance on the GPU. We demonstrate the performance and scalability of the implementation of the purposed method in the NWChemEx software package by comparing to the existing scalable CPU XC integration in NWChem.

Resource-Efficient Chemistry on Quantum Computers with the Variational Quantum Eigensolver and the Double Unitary Coupled-Cluster Approach.

Applications of quantum simulation algorithms to obtain electronic energies of molecules on noisy intermediate-scale quantum (NISQ) devices require careful consideration of resources describing the complex electron correlation effects. In modeling second-quantized problems, the biggest challenge confronted is that the number of qubits scales linearly with the size of the molecular basis. This poses a significant limitation on the size of the basis sets and the number of correlated electrons included in quantum simulations of chemical processes. To address this issue and enable more realistic simulations on NISQ computers, we employ the double unitary coupled-cluster (DUCC) method to effectively downfold correlation effects into the reduced-size orbital space, commonly referred to as the active space. Using downfolding techniques, we demonstrate that properly constructed effective Hamiltonians can capture the effect of the whole orbital space in small-size active spaces. Combining the downfolding preprocessing technique with the variational quantum eigensolver, we solve for the ground-state energy of H2, Li2, and BeH2 in the cc-pVTZ basis using the DUCC-reduced active spaces. We compare these results to full configuration-interaction and high-level coupled-cluster reference calculations.

Chemistry on Quantum Computers with Virtual Quantum Subspace Expansion.

Simulating chemical systems on quantum computers has been limited to a few electrons in a minimal basis. We demonstrate experimentally that the virtual quantum subspace expansion (Takeshita, T.; Phys. Rev. X 2020, 10, 011004, 10.1103/PhysRevX.10.011004) can achieve full basis accuracy for hydrogen and lithium dimers, comparable to simulations requiring 20 or more qubits. We developed an approach to minimize the impact of experimental noise on the stability of the generalized eigenvalue problem, a crucial component of the quantum algorithm. In addition, we were able to obtain an accurate potential energy curve for the nitrogen dimer in a quantum simulation on a classical computer.

Stochastic resolution of identity second-order Matsubara Green's function theory.

We develop a stochastic resolution of identity representation to the second-order Matsubara Green's function (sRI-GF2) theory. Using a stochastic resolution of the Coulomb integrals, the second order Born self-energy in GF2 is decoupled and reduced to matrix products/contractions, which reduces the computational cost from O(N5) to O(N3) (with N being the number of atomic orbitals). The current approach can be viewed as an extension to our previous work on stochastic resolution of identity second order Møller-Plesset perturbation theory [T. Y. Takeshita et al., J. Chem. Theory Comput. 13, 4605 (2017)] and offers an alternative to previous stochastic GF2 formulations [D. Neuhauser et al., J. Chem. Theory Comput. 13, 5396 (2017)]. We show that sRI-GF2 recovers the deterministic GF2 results for small systems, is computationally faster than deterministic GF2 for N > 80, and is a practical approach to describe weak correlations in systems with 103 electrons and more.

Prediction of atomization energy using graph kernel and active learning.

Data-driven prediction of molecular properties presents unique challenges to the design of machine learning methods concerning data structure/dimensionality, symmetry adaption, and confidence management. In this paper, we present a kernel-based pipeline that can learn and predict the atomization energy of molecules with high accuracy. The framework employs Gaussian process regression to perform predictions based on the similarity between molecules, which is computed using the marginalized graph kernel. To apply the marginalized graph kernel, a spatial adjacency rule is first employed to convert molecules into graphs whose vertices and edges are labeled by elements and interatomic distances, respectively. We then derive formulas for the efficient evaluation of the kernel. Specific functional components for the marginalized graph kernel are proposed, while the effects of the associated hyperparameters on accuracy and predictive confidence are examined. We show that the graph kernel is particularly suitable for predicting extensive properties because its convolutional structure coincides with that of the covariance formula between sums of random variables. Using an active learning procedure, we demonstrate that the proposed method can achieve a mean absolute error of 0.62 ± 0.01 kcal/mol using as few as 2000 training samples on the QM7 dataset.

Reductive activation of neptunyl and plutonyl oxo species with a hydroxypyridinone chelating ligand.

Oxo group activation with reduction of neptunyl(vi) and plutonyl(vi) to tetravalent hydroxo species by the hydroxypyridinone siderophore derivative 3,4,3-LI-(1,2-HOPO) was investigated in the gas-phase via electrospray ionization mass spectrometry, in solution via Raman spectroscopy, and computationally via density functional theory. Dissociation of the gas-phase tetravalent complexes resulted in actinide-hydroxo bond cleavage.