How Does HF-DFT Achieve Chemical Accuracy for Water Clusters?

Bolstered by recent calculations of exact functional-driven errors (FEs) and density-driven errors (DEs) of semilocal density functionals in the water dimer binding energy [Kanungo, B. J. Phys. Chem. Lett. 2024, 15, 323-328], we investigate approximate FEs and DEs in neutral water clusters containing up to 20 monomers, charged water clusters, and alkali- and halide-water clusters. Our proxy for the exact density is r2SCAN 50, a 50% global hybrid of exact exchange with r2SCAN, which may be less correct than r2SCAN for the compact water monomer but importantly more correct for long-range electron transfers in the noncompact water clusters. We show that SCAN makes substantially larger FEs for neutral water clusters than r2SCAN, while both make essentially the same DEs. Unlike the case for barrier heights, these FEs are small in a relative sense and become large in an absolute sense only due to an increase in cluster size. SCAN@HF, short for SCAN evaluated on the Hartree-Fock (HF) density, produces a cancellation of errors that makes it chemically accurate for predicting the absolute binding energies of water clusters. Likewise, adding a long-range dispersion correction to r2SCAN@HF, as in the composite method HF-r2SCAN-DC4, makes its FE more negative than in r2SCAN@HF, permitting a near-perfect cancellation of FE and DE. r2SCAN by itself (and even more so, r2SCAN evaluated on the r2SCAN 50 density), is almost perfect for the energy differences between water hexamers, and thus probably also for liquid water away from the boiling point. Thus, the accuracy of composite methods like SCAN@HF and HF-r2SCAN-DC4 is not due to the HF density being closer to the exact density, but to a compensation of errors from its greater degree of localization. We also give an argument for the approximate reliability of this unconventional error cancellation for diverse molecular properties. Finally, we confirm this unconventional error cancellation for the SCAN description of the water trimer via Kohn-Sham inversion of the CCSD(T) density.

Symmetry breaking and self-interaction correction in the chromium atom and dimer.

Density functional approximations to the exchange-correlation energy can often identify strongly correlated systems and estimate their energetics through energy-minimizing symmetry-breaking. In particular, the binding energy curve of the strongly correlated chromium dimer is described qualitatively by the local spin density approximation (LSDA) and almost quantitatively by the Perdew-Burke-Ernzerhof generalized gradient approximation (PBE-GGA), where the symmetry breaking is antiferromagnetic for both. Here, we show that a full Perdew-Zunger self-interaction-correction (SIC) to LSDA seems to go too far by creating an unphysical symmetry-broken state, with effectively zero magnetic moment but non-zero spin density on each atom, which lies ∼4 eV below the antiferromagnetic solution. A similar symmetry-breaking, observed in the atom, better corresponds to the 3d↑↑4s↑3d↓↓4s↓ configuration than to the standard 3d↑↑↑↑↑4s↑. For this new solution, the total energy of the dimer at its observed bond length is higher than that of the separated atoms. These results can be regarded as qualitative evidence that the SIC needs to be scaled down in many-electron regions.

Challenges for density functional theory in simulating metal-metal singlet bonding: A case study of dimerized VO2.

VO2 is renowned for its electric transition from an insulating monoclinic (M1) phase, characterized by V-V dimerized structures, to a metallic rutile (R) phase above 340 K. This transition is accompanied by a magnetic change: the M1 phase exhibits a non-magnetic spin-singlet state, while the R phase exhibits a state with local magnetic moments. Simultaneous simulation of the structural, electric, and magnetic properties of this compound is of fundamental importance, but the M1 phase alone has posed a significant challenge to the density functional theory (DFT). In this study, we show none of the commonly used DFT functionals, including those combined with on-site Hubbard U to treat 3d electrons better, can accurately predict the V-V dimer length. The spin-restricted method tends to overestimate the strength of the V-V bonds, resulting in a small V-V bond length. Conversely, the spin-symmetry-breaking method exhibits the opposite trends. Each of these two bond-calculation methods underscores one of the two contentious mechanisms, i.e., Peierls lattice distortion or Mott localization due to electron-electron repulsion, involved in the metal-insulator transition in VO2. To elucidate the challenges encountered in DFT, we also employ an effective Hamiltonian that integrates one-dimensional magnetic sites, thereby revealing the inherent difficulties linked with the DFT computations.

Comparing first-principles density functionals plus corrections for the lattice dynamics of YBa2Cu3O6.

The enigmatic mechanism underlying unconventional high-temperature superconductivity, especially the role of lattice dynamics, has remained a subject of debate. Theoretical insights have long been hindered due to the lack of an accurate first-principles description of the lattice dynamics of cuprates. Recently, using the r2SCAN meta-generalized gradient approximation (meta-GGA) functional, we have been able to achieve accurate phonon spectra of an insulating cuprate YBa2Cu3O6 and discover significant magnetoelastic coupling in experimentally interesting Cu-O bond stretching optical modes [Ning et al., Phys. Rev. B 107, 045126 (2023)]. We extend this work by comparing Perdew-Burke-Ernzerhof and r2SCAN performances with corrections from the on-site Hubbard U and the D4 van der Waals (vdW) methods, aiming at further understanding on both the materials science side and the density functional side. We demonstrate the importance of vdW and self-interaction corrections for accurate first-principles YBa2Cu3O6 lattice dynamics. Since r2SCAN by itself partially accounts for these effects, the good performance of r2SCAN is now more fully explained. In addition, the performances of the Tao-Mo series of meta-GGAs, which are constructed in a different way from the strongly constrained and appropriately normed (SCAN) meta-GGA and its revised version r2SCAN, are also compared and discussed.

My life in science: Lessons for yours?

Because of an acquired obsession to understand as much as possible in a limited but important area of science and because of optimism, luck, and help from others, my life in science turned out to be much better than I or others could have expected or planned. This is the story of how that happened, and also the story of the groundstate density functional theory of electronic structure, told from a personal perspective.

Unconventional Error Cancellation Explains the Success of Hartree-Fock Density Functional Theory for Barrier Heights.

Energy barriers, which control the rates of chemical reactions, are seriously underestimated by computationally efficient semilocal approximations for the exchange-correlation energy. The accuracy of a semilocal density functional approximation is strongly boosted for reaction barrier heights by evaluating that approximation non-self-consistently on Hartree-Fock electron densities, which has been known for ∼30 years. The conventional explanation is that the Hartree-Fock theory yields the more accurate density. This work presents a benchmark Kohn-Sham inversion of accurate coupled-cluster densities for the reaction H2 + F → HHF → H + HF and finds a strong, understandable cancellation between positive (excessively overcorrected) density-driven and large negative functional-driven errors (expected from stretched radical bonds in the transition state) within this Hartree-Fock density functional theory. This confirms earlier conclusions (Kaplan, A. D., et al. J. Chem. Theory Comput. 2023, 19, 532-543) based on 76 barrier heights and three less reliable, but less expensive, fully nonlocal density functional proxies for the exact density.

Testing the r2SCAN Density Functional for the Thermodynamic Stability of Solids with and without a van der Waals Correction.

A central aim of materials discovery is an accurate and numerically reliable description of thermodynamic properties, such as the enthalpies of formation and decomposition. The r2SCAN revision of the strongly constrained and appropriately normed (SCAN) meta-generalized gradient approximation (meta-GGA) balances numerical stability with high general accuracy. To assess the r2SCAN description of solid-state thermodynamics, we evaluate the formation and decomposition enthalpies, equilibrium volumes, and fundamental band gaps of more than 1000 solids using r2SCAN, SCAN, and PBE, as well as two dispersion-corrected variants, SCAN+rVV10 and r2SCAN+rVV10. We show that r2SCAN achieves accuracy comparable to SCAN and often improves upon SCAN's already excellent accuracy. Although SCAN+rVV10 is often observed to worsen the formation enthalpies of SCAN and makes no substantial correction to SCAN's cell volume predictions, r2SCAN+rVV10 predicts marginally less accurate formation enthalpies than r2SCAN, and slightly more accurate cell volumes than r2SCAN. The average absolute errors in predicted formation enthalpies are found to decrease by a factor of 1.5 to 2.5 from the GGA level to the meta-GGA level. Smaller decreases in error are observed for decomposition enthalpies. For formation enthalpies r2SCAN improves over SCAN for intermetallic systems. For a few classes of systems-transition metals, intermetallics, weakly bound solids, and enthalpies of decomposition into compounds-GGAs are comparable to meta-GGAs. In total, r2SCAN and r2SCAN+rVV10 can be recommended as stable, general-purpose meta-GGAs for materials discovery.

Understanding Density-Driven Errors for Reaction Barrier Heights.

Delocalization errors, such as charge-transfer and some self-interaction errors, plague computationally efficient and otherwise accurate density functional approximations (DFAs). Evaluating a semilocal DFA non-self-consistently on the Hartree-Fock (HF) density is often recommended as a computationally inexpensive remedy for delocalization errors. For sophisticated meta-GGAs like SCAN, this approach can achieve remarkable accuracy. This HF-DFT (also known as DFA@HF) is often presumed to work, when it significantly improves over the DFA, because the HF density is more accurate than the self-consistent DFA density in those cases. By applying the metrics of density-corrected density functional theory (DFT), we show that HF-DFT works for barrier heights by making a localizing charge-transfer error or density overcorrection, thereby producing a somewhat reliable cancellation of density- and functional-driven errors for the energy. A quantitative analysis of the charge-transfer errors in a few randomly selected transition states confirms this trend. We do not have the exact functional and electron densities that would be needed to evaluate the exact density- and functional-driven errors for the large BH76 database of barrier heights. Instead, we have identified and employed three fully nonlocal proxy functionals (SCAN 50% global hybrid, range-separated hybrid LC-ωPBE, and SCAN-FLOSIC) and their self-consistent proxy densities. These functionals are chosen because they yield reasonably accurate self-consistent barrier heights and because their self-consistent total energies are nearly piecewise linear in fractional electron number─two important points of similarity to the exact functional. We argue that density-driven errors of the energy in a self-consistent density functional calculation are second order in the density error and that large density-driven errors arise primarily from incorrect electron transfers over length scales larger than the diameter of an atom.

The Predictive Power of Exact Constraints and Appropriate Norms in Density Functional Theory.

Ground-state Kohn-Sham density functional theory provides, in principle, the exact ground-state energy and electronic spin densities of real interacting electrons in a static external potential. In practice, the exact density functional for the exchange-correlation (xc) energy must be approximated in a computationally efficient way. About 20 mathematical properties of the exact xc functional are known. In this work, we review and discuss these known constraints on the xc energy and hole. By analyzing a sequence of increasingly sophisticated density functional approximations (DFAs), we argue that (a) the satisfaction of more exact constraints and appropriate norms makes a functional more predictive over the immense space of many-electron systems and (b) fitting to bonded systems yields an interpolative DFA that may not extrapolate well to systems unlike those in the fitting set. We discuss both how the class of well-described systems has grown along with constraint satisfaction and the possibilities for future functional development.

Symmetry Breaking with the SCAN Density Functional Describes Strong Correlation in the Singlet Carbon Dimer.

The SCAN (strongly constrained and appropriately normed) meta-generalized gradient approximation (meta-GGA), which satisfies all 17 exact constraints that a meta-GGA can satisfy, accurately describes equilibrium bonds that are normally correlated. With symmetry breaking, it also accurately describes some sd equilibrium bonds that are strongly correlated. While sp equilibrium bonds are nearly always normally correlated, the C2 singlet ground state is known from correlated wave function theory to be a rare case of strong correlation in an sp equilibrium bond. Earlier work that calculated atomization energies of the molecular sequence B2, C2, O2, and F2 in the local spin density approximation (LSDA), the Perdew-Burke-Ernzerhof (PBE) GGA, and the SCAN meta-GGA, without symmetry breaking in the molecule, found that only SCAN was accurate enough to reveal an anomalous under-binding for C2. This work shows that spin symmetry breaking in singlet C2, which involves the appearance of net up- and down-spin densities on opposite sides (not ends) of the bond, corrects that underbinding, with a small SCAN atomization-energy error more like that of the other three molecules, suggesting that symmetry breaking with an advanced density functional might reliably describe strong correlation. This article also discusses some general aspects of symmetry breaking and the insights into strong correlation that symmetry breaking can bring. The normally correlated low-lying triplet excited state has the right vertical excitation energy in SCAN but not in LSDA or PBE, where the triplet is a false ground state. Fractional occupation numbers are found only for the symmetry-unbroken singlet and only in LSDA and PBE GGA.

DFT exchange: sharing perspectives on the workhorse of quantum chemistry and materials science.

In this paper, the history, present status, and future of density-functional theory (DFT) is informally reviewed and discussed by 70 workers in the field, including molecular scientists, materials scientists, method developers and practitioners. The format of the paper is that of a roundtable discussion, in which the participants express and exchange views on DFT in the form of 302 individual contributions, formulated as responses to a preset list of 26 questions. Supported by a bibliography of 777 entries, the paper represents a broad snapshot of DFT, anno 2022.

How Good Is the Density-Corrected SCAN Functional for Neutral and Ionic Aqueous Systems, and What Is So Right about the Hartree-Fock Density?

Density functional theory (DFT) is the most widely used electronic structure method, due to its simplicity and cost effectiveness. The accuracy of a DFT calculation depends not only on the choice of the density functional approximation (DFA) adopted but also on the electron density produced by the DFA. SCAN is a modern functional that satisfies all known constraints for meta-GGA functionals. The density-driven errors, defined as energy errors arising from errors of the self-consistent DFA electron density, can hinder SCAN from achieving chemical accuracy in some systems, including water. Density-corrected DFT (DC-DFT) can alleviate this shortcoming by adopting a more accurate electron density which, in most applications, is the electron density obtained at the Hartree-Fock level of theory due to its relatively low computational cost. In this work, we present extensive calculations aimed at determining the accuracy of the DC-SCAN functional for various aqueous systems. DC-SCAN (SCAN@HF) shows remarkable consistency in reproducing reference data obtained at the coupled cluster level of theory, with minimal loss of accuracy. Density-driven errors in the description of ionic aqueous clusters are thoroughly investigated. By comparison with the orbital-optimized CCD density in the water dimer, we find that the self-consistent SCAN density transfers a spurious fraction of an electron across the hydrogen bond to the hydrogen atom (H*, covalently bound to the donor oxygen atom) from the acceptor (OA) and donor (OD) oxygen atoms, while HF makes a much smaller spurious transfer in the opposite direction, consistent with DC-SCAN (SCAN@HF) reduction of SCAN overbinding due to delocalization error. While LDA seems to be the conventional extreme of density delocalization error, and HF the conventional extreme of (usually much smaller) density localization error, these two densities do not quite yield the conventional range of density-driven error in energy differences. Finally, comparisons of the DC-SCAN results with those obtained with the Fermi-Löwdin orbital self-interaction correction (FLOSIC) method show that DC-SCAN represents a more accurate approach to reducing density-driven errors in SCAN calculations of ionic aqueous clusters. While the HF density is superior to that of SCAN for noncompact water clusters, the opposite is true for the compact water molecule with exactly 10 electrons.

Fermi-Löwdin orbital self-interaction correction of adsorption energies on transition metal ions.

Density functional theory (DFT)-based descriptions of the adsorption of small molecules on transition metal ions are prone to self-interaction errors. Here, we show that such errors lead to a large over-estimation of adsorption energies of small molecules on Cu+, Zn+, Zn2+, and Mn+ in local spin density approximation (LSDA) and Perdew, Burke, Ernzerhof (PBE) generalized gradient approximation calculations compared to reference values computed using the coupled-cluster with single, doubles, and perturbative triple excitations method. These errors are significantly reduced by removing self-interaction using the Perdew-Zunger self-interaction correction (PZ-SIC) in the Fermi-Löwdin Orbital (FLO) SIC framework. In the case of FLO-PBE, typical errors are reduced to less than 0.1 eV. Analysis of the results using DFT energies evaluated on self-interaction-corrected densities [DFT(@FLO)] indicates that the density-driven contributions to the FLO-DFT adsorption energy corrections are roughly the same size in DFT = LSDA and PBE, but the total corrections due to removing self-interaction are larger in LSDA.

Construction of meta-GGA functionals through restoration of exact constraint adherence to regularized SCAN functionals.

The strongly constrained and appropriately normed (SCAN) meta-GGA exchange-correlation functional [Sun et al., Phys. Rev. Lett. 115, 036402 (2015)] is constructed as a chemical environment-determined interpolation between two separate energy densities: one describes single-orbital electron densities accurately and another describes slowly varying densities accurately. To conserve constraints known for the exact exchange-correlation functional, the derivatives of this interpolation vanish in the slowly varying limit. While theoretically convenient, this choice introduces numerical challenges that degrade the functional's efficiency. We have recently reported a modification to the SCAN meta-GGA, termed restored-regularized-SCAN (r2SCAN) [Furness et al., J. Phys. Chem. Lett. 11, 8208 (2020)], that introduces two regularizations into SCAN, which improve its numerical performance at the expense of not recovering the fourth order term of the slowly varying density gradient expansion for exchange. Here, we show the derivation of a progression of density functional approximations [regularized SCAN (rSCAN), r++SCAN, r2SCAN, and r4SCAN] with increasing adherence to exact conditions while maintaining a smooth interpolation. The greater smoothness of r2SCAN seems to lead to better general accuracy than the additional exact constraint of SCAN or r4SCAN does.

Artificial intelligence "sees" split electrons.

Machine-learning creates a density functional that accounts for fractional charge and spin.

Spherical vs non-spherical and symmetry-preserving vs symmetry-breaking densities of open-shell atoms in density functional theory.

The atomization energies of molecules from first-principles density functional approximations improve from the local spin-density approximation to the Perdew-Burke-Ernzerhof (PBE) generalized gradient approximation (GGA) to the strongly constrained and appropriately normed (SCAN) meta-GGA, and their sensitivities to non-spherical components of the density increase in the same order. Thus, these functional advances increase density sensitivity and imitate the exact constrained search over correlated wavefunctions better than that over ensembles. The diatomic molecules studied here, singlet C2 and F2 plus triplet B2 and O2, have cylindrically symmetric densities. Because the densities of the corresponding atoms are non-spherical, the approximate Kohn-Sham potentials for the atoms have a lower symmetry than that of the external (nuclear) potential so that the non-interacting wavefunctions are not eigenstates of the square of total orbital angular momentum, breaking a symmetry that yields a feature of the exact ground-state density. That spatial symmetry can be preserved by a non-self-consistent approach in which a self-consistent equilibrium-ensemble calculation is followed by integer re-occupation of the Kohn-Sham orbitals as the first of several steps. The symmetry-preserving approach is different from symmetry restoration based on projection. First-step space- (and space-spin-) symmetry preservation in atoms is shown to have a small effect on the atomization energies of molecules, quantifying earlier observations by Fertig and Kohn. Thus, the standard Kohn-Sham way of calculating atomization energies, with self-consistent symmetry breaking to minimize the energy, is justified at least for the common cases where the molecules cannot break symmetry. Unless symmetry breaking is allowed in the molecule, SCAN strongly underestimates the atomization energy of strongly correlated singlet C2.

Elevating density functional theory to chemical accuracy for water simulations through a density-corrected many-body formalism.

Density functional theory (DFT) has been extensively used to model the properties of water. Albeit maintaining a good balance between accuracy and efficiency, no density functional has so far achieved the degree of accuracy necessary to correctly predict the properties of water across the entire phase diagram. Here, we present density-corrected SCAN (DC-SCAN) calculations for water which, minimizing density-driven errors, elevate the accuracy of the SCAN functional to that of "gold standard" coupled-cluster theory. Building upon the accuracy of DC-SCAN within a many-body formalism, we introduce a data-driven many-body potential energy function, MB-SCAN(DC), that quantitatively reproduces coupled cluster reference values for interaction, binding, and individual many-body energies of water clusters. Importantly, molecular dynamics simulations carried out with MB-SCAN(DC) also reproduce the properties of liquid water, which thus demonstrates that MB-SCAN(DC) is effectively the first DFT-based model that correctly describes water from the gas to the liquid phase.

Modeling Liquid Water by Climbing up Jacob's Ladder in Density Functional Theory Facilitated by Using Deep Neural Network Potentials.

Within the framework of Kohn-Sham density functional theory (DFT), the ability to provide good predictions of water properties by employing a strongly constrained and appropriately normed (SCAN) functional has been extensively demonstrated in recent years. Here, we further advance the modeling of water by building a more accurate model on the fourth rung of Jacob's ladder with the hybrid functional, SCAN0. In particular, we carry out both classical and Feynman path-integral molecular dynamics calculations of water with the SCAN0 functional and the isobaric-isothermal ensemble. To generate the equilibrated structure of water, a deep neural network potential is trained from the atomic potential energy surface based on ab initio data obtained from SCAN0 DFT calculations. For the electronic properties of water, a separate deep neural network potential is trained by using the Deep Wannier method based on the maximally localized Wannier functions of the equilibrated trajectory at the SCAN0 level. The structural, dynamic, and electric properties of water were analyzed. The hydrogen-bond structures, density, infrared spectra, diffusion coefficients, and dielectric constants of water, in the electronic ground state, are computed by using a large simulation box and long simulation time. For the properties involving electronic excitations, we apply the GW approximation within many-body perturbation theory to calculate the quasiparticle density of states and bandgap of water. Compared to the SCAN functional, mixing exact exchange mitigates the self-interaction error in the meta-generalized-gradient approximation and further softens liquid water toward the experimental direction. For most of the water properties, the SCAN0 functional shows a systematic improvement over the SCAN functional. However, some important discrepancies remain. The H-bond network predicted by the SCAN0 functional is still slightly overstructured compared to the experimental results.

Self-interaction correction in water-ion clusters.

We study the importance of self-interaction errors in density functional approximations for various water-ion clusters. We have employed the Fermi-Löwdin orbital self-interaction correction (FLOSIC) method in conjunction with the local spin-density approximation, Perdew-Burke-Ernzerhof (PBE) generalized gradient approximation (GGA), and strongly constrained and appropriately normed (SCAN) meta-GGA to describe binding energies of hydrogen-bonded water-ion clusters, i.e., water-hydronium, water-hydroxide, water-halide, and non-hydrogen-bonded water-alkali clusters. In the hydrogen-bonded water-ion clusters, the building blocks are linked by hydrogen atoms, although the links are much stronger and longer-ranged than the normal hydrogen bonds between water molecules because the monopole on the ion interacts with both permanent and induced dipoles on the water molecules. We find that self-interaction errors overbind the hydrogen-bonded water-ion clusters and that FLOSIC reduces the error and brings the binding energies into closer agreement with higher-level calculations. The non-hydrogen-bonded water-alkali clusters are not significantly affected by self-interaction errors. Self-interaction corrected PBE predicts the lowest mean unsigned error in binding energies (≤50 meV/H2O) for hydrogen-bonded water-ion clusters. Self-interaction errors are also largely dependent on the cluster size, and FLOSIC does not accurately capture the subtle variation in all clusters, indicating the need for further refinement.

Exploring and enhancing the accuracy of interior-scaled Perdew-Zunger self-interaction correction.

The Perdew-Zunger self-interaction correction (PZ-SIC) improves the performance of density functional approximations for the properties that involve significant self-interaction error (SIE), as in stretched bond situations, but overcorrects for equilibrium properties where SIE is insignificant. This overcorrection is often reduced by local scaling self-interaction correction (LSIC) of the PZ-SIC to the local spin density approximation (LSDA). Here, we propose a new scaling factor to use in an LSIC-like approach that satisfies an additional important constraint: the correct coefficient of the atomic number Z in the asymptotic expansion of the exchange-correlation (xc) energy for atoms. LSIC and LSIC+ are scaled by functions of the iso-orbital indicator zσ, which distinguishes one-electron regions from many-electron regions. LSIC+ applied to the LSDA works better for many equilibrium properties than LSDA-LSIC and the Perdew, Burke, and Ernzerhof generalized gradient approximation (GGA), and almost close to the strongly constrained and appropriately normed (SCAN) meta-GGA. LSDA-LSIC and LSDA-LSIC+, however, fail to predict interaction energies involving weaker bonds, in sharp contrast to their earlier successes. It is found that more than one set of localized SIC orbitals can yield a nearly degenerate energetic description of the same multiple covalent bond, suggesting that a consistent chemical interpretation of the localized orbitals requires a new way to choose their Fermi orbital descriptors. To make a locally scaled down SIC to functionals beyond the LSDA requires a gauge transformation of the functional's energy density. The resulting SCAN-sdSIC, evaluated on SCAN-SIC total and localized orbital densities, leads to an acceptable description of many equilibrium properties including the dissociation energies of weak bonds.