Aufbau Suppressed Coupled Cluster Theory for Electronically Excited States.

We introduce an approach to improve single-reference coupled cluster theory in settings where the Aufbau determinant is absent from or plays only a small role in the true wave function. Using a de-excitation operator that can be efficiently hidden within a similarity transform, we create a coupled cluster wave function in which de-excitations work to suppress the Aufbau determinant and produce wave functions dominated by other determinants. Thanks to an invertible and fully exponential form, the approach is systematically improvable, size consistent, size extensive, and, interestingly, size intensive in a granular way that should make the adoption of some ground state techniques, such as local correlation, relatively straightforward. In this initial study, we apply the general formalism to create a state-specific method for orbital-relaxed, singly excited states. We find that this approach matches the accuracy of similar-cost equation-of-motion methods in valence excitations while offering improved accuracy for charge transfer states. We also find the approach to be more accurate than excited-state-specific perturbation theory in both types of states.

Spin Coupling Effect on Geometry-Dependent X-Ray Absorption of Diradicals.

We theoretically investigate the influence of diradical electron spin coupling on the time-resolved X-ray absorption spectra of the photochemical ring opening of furanone. We predict geometry-dependent carbon K-edge signals involving transitions from core orbitals to both singly and unoccupied molecular orbitals. The most obvious features of the ring opening come from the carbon atom directly involved in the bond breaking through its transition to both the newly formed singly occupied and the available lowest unoccupied molecular orbitals (SOMO and LUMO, respectively). In addition to this primary feature, the singlet spin coupling of four unpaired electrons that arises in the core-to-LUMO states creates additional geometry dependence in some spectral features with both oscillator strengths and relative excitation energies varying observably as a function of the ring opening. We attribute this behavior to a spin-occupancy-induced selection rule, which occurs when singlet spin coupling is enforced in the diradical state. Notably, one of these geometry-sensitive core-to-LUMO transitions excites core electrons from a backbone carbon not involved in the bond breaking, providing a novel nonlocal X-ray probe of chemical dynamics arising from electron spin coupling.

Excited-State-Specific Pseudoprojected Coupled-Cluster Theory.

We present an excited-state-specific coupled-cluster approach in which both the molecular orbitals and cluster amplitudes are optimized for an individual excited state. The theory is formulated via a pseudoprojection of the traditional coupled-cluster wavefunction that allows correlation effects to be introduced atop an excited-state mean field starting point. The approach shares much in common with ground-state CCSD, including size extensivity and an N6 cost scaling. Preliminary numerical tests show that, when augmented with N5 cost perturbative corrections for key terms, the method can improve over excited-state-specific second-order perturbation theory in valence, charge transfer, and Rydberg states.

Exploring Ligand-to-Metal Charge-Transfer States in the Photo-Ferrioxalate System Using Excited-State Specific Optimization.

The photo-ferrioxalate system (PFS), [Fe(III)(C2O4)]3-, more than an exact chemical actinometer, has been extensively applied in wastewater and environment treatment. Despite many experimental efforts to improve clarity, important aspects of the mechanism of ferrioxalate photolysis are still under debate. In this paper, we employ the recently developed WΓ-CASSCF to investigate the ligand-to-metal charge-transfer states that are key to ferrioxalate photolysis. This investigation provides a qualitative picture of these states and key potential energy surface features related to the photolysis. Our theoretical results are consistent with the prompt charge-transfer picture seen in recent experiments and clarify some features that are not visible in experiments. Two ligand-to-metal charge-transfer states contribute to the photolysis of ferrioxalate, and the avoided crossing barrier between them is low compared with the initial photoexcitation energy. Our data also clarify that one Fe-O bond cleaves first, followed by the C-C bond and the other Fe-O bond.

Studying excited-state-specific perturbation theory on the Thiel set.

We explore the performance of a recently introduced N5-scaling excited-state-specific second order perturbation theory (ESMP2) on the singlet excitations of the Thiel benchmarking set. We find that, without regularization, ESMP2 is quite sensitive to π system size, performing well in molecules with small π systems but poorly in those with larger π systems. With regularization, ESMP2 is far less sensitive to π system size and shows a higher overall accuracy on the Thiel set than CC2, equation of motion-coupled cluster with singles and doubles, CC3, and a wide variety of time-dependent density functional approaches. Unsurprisingly, even regularized ESMP2 is less accurate than multi-reference perturbation theory on this test set, which can, in part, be explained by the set's inclusion of some doubly excited states but none of the strong charge transfer states that often pose challenges for state-averaging. Beyond energetics, we find that the ESMP2 doubles norm offers a relatively low-cost way to test for doubly excited character without the need to define an active space.

Optimization Stability in Excited-State-Specific Variational Monte Carlo.

We investigate the issue of optimization stability in variance-based state-specific variational Monte Carlo, discussing the roles of the objective function, the complexity of wave function ansatz, the amount of sampling effort, and the choice of minimization algorithm. Using a small cyanine dye molecule as a test case, we systematically perform minimizations using variants of the linear method as both a standalone algorithm and in a hybrid combination with accelerated descent. We demonstrate that adaptive step control is crucial for maintaining the linear method's stability when optimizing complicated wave functions and that the hybrid method enjoys both greater stability and minimization performance.

Applying Generalized Variational Principles to Excited-State-Specific Complete Active Space Self-consistent Field Theory.

We employ a generalized variational principle to improve the stability, reliability, and precision of fully excited-state-specific complete active space self-consistent field theory. Compared to previous approaches that similarly seek to tailor this ansatz's orbitals and configuration interaction expansion for an individual excited state, we find the present approach to be more resistant to root flipping and better at achieving tight convergence to an energy stationary point. Unlike state-averaging, this approach allows orbital shapes to be optimal for individual excited states, which is especially important for charge-transfer states and some doubly excited states. We demonstrate the convergence and state-targeting abilities of this method in LiH, ozone, and MgO, showing in the latter that it is capable of finding three excited-state energy stationary points that no previous method has been able to locate.

A hybrid approach to excited-state-specific variational Monte Carlo and doubly excited states.

We extend our hybrid linear-method/accelerated-descent variational Monte Carlo optimization approach to excited states and investigate its efficacy in double excitations. In addition to showing a superior statistical efficiency when compared to the linear method, our tests on small molecules show good energetic agreement with benchmark methods. We also demonstrate the ability to treat double excitations in systems that are too large for a full treatment by using selected configuration interaction methods via an application to 4-aminobenzonitrile. Finally, we investigate the stability of state-specific variance optimization against collapse to other states' variance minima and find that symmetry, Ansatz quality, and sample size all have roles to play in achieving stability.

A self-consistent field formulation of excited state mean field theory.

We show that, as in Hartree-Fock theory, the orbitals for excited state mean field theory can be optimized via a self-consistent one-electron equation in which electron-electron repulsion is accounted for through mean field operators. In addition to showing that this excited state ansatz is sufficiently close to a mean field product state to admit a one-electron formulation, this approach brings the orbital optimization speed to within roughly a factor of two of ground state mean field theory. The approach parallels Hartree Fock theory in multiple ways, including the presence of a commutator condition, a one-electron mean-field working equation, and acceleration via direct inversion in the iterative subspace. When combined with a configuration interaction singles Davidson solver for the excitation coefficients, the self-consistent field formulation dramatically reduces the cost of the theory compared to previous approaches based on quasi-Newton descent.

A variational Monte Carlo approach for core excitations.

We present a systematically improvable approach to core excitations in variational Monte Carlo. Building on recent work in excited-state-specific Monte Carlo, we show how a straightforward protocol, starting from a quantum chemistry guess, is able to capture core state's strong orbital relaxations, maintain accuracy in the near-nuclear region during these relaxations, and explicitly balance accuracy between ground and core excited states. In water, ammonia, and methane, which serve as prototypical representatives for oxygen, nitrogen, and carbon core states, respectively, this approach predicts core excitation energies within 0.3 eV of experiment and core excitation peak separations within 0.1 eV of experiment.

Core excitations with excited state mean field and perturbation theory.

We test the efficacy of excited state mean field theory and its excited-state-specific perturbation theory on the prediction of K-edge positions and x-ray peak separations. We find that the mean field theory is surprisingly accurate, even though it contains no accounting of differential electron correlation effects. In the perturbation theory, we test multiple core-valence separation schemes and find that, with the mean field theory already so accurate, electron-counting biases in one popular separation scheme become a dominant error when predicting K-edges. Happily, these appear to be relatively easy to correct for, leading to a perturbation theory for K-edge positions that is lower scaling and more accurate than coupled cluster theory and competitive in accuracy with recent high-accuracy results from restricted open-shell Kohn-Sham theory. For peak separations, our preliminary data show excited state mean field theory to be exceptionally accurate, but more extensive testing will be needed to see how it and its perturbation theory compare to coupled cluster peak separations more broadly.

Improving Excited-State Potential Energy Surfaces via Optimal Orbital Shapes.

We demonstrate that, rather than resorting to high-cost dynamic correlation methods, qualitative failures in excited-state potential energy surface predictions can often be remedied at no additional cost by ensuring that optimal molecular orbitals are used for each individual excited state. This approach also avoids the weighting choices required by state-averaging and dynamic weighting and obviates their need for expensive wave function response calculations when relaxing excited-state geometries. Although multistate approaches are of course preferred near conical intersections, other features of excited-state potential energy surfaces can benefit significantly from our single-state approach. In three different systems, including a double bond dissociation, a biologically relevant amino hydrogen dissociation, and an amino-to-ring intramolecular charge transfer, we show that state-specific orbitals offer qualitative improvements over the state-averaged status quo.

N5-Scaling Excited-State-Specific Perturbation Theory.

We show that by working in a basis similar to that of the natural transition orbitals and using a modified zeroth-order Hamiltonian, the cost of a recently introduced perturbative correction to excited-state mean field theory can be reduced from seventh to fifth order in the system size. The (occupied)2(virtual)3 asymptotic scaling matches that of ground-state second-order Møller-Plesset theory but with a significantly higher prefactor because the bottleneck is iterative: it appears in the Krylov-subspace-based solution of the linear equation that yields the first-order wave function. Here, we discuss the details of the modified zeroth-order Hamiltonian we use to reduce the cost and the automatic code generation process we used to derive and verify the cost scaling of the different terms. Overall, we find that our modifications have little impact on the method's accuracy, which remains competitive with singles and doubles equation-of-motion coupled cluster.

Excited state mean-field theory without automatic differentiation.

We present a formulation of excited state mean-field theory in which the derivatives with respect to the wave function parameters needed for wave function optimization (not to be confused with nuclear derivatives) are expressed analytically in terms of a collection of Fock-like matrices. By avoiding the use of automatic differentiation and grouping Fock builds together, we find that the number of times we must access the memory-intensive two-electron integrals can be greatly reduced. Furthermore, the new formulation allows the theory to exploit the existing strategies for efficient Fock matrix construction. We demonstrate this advantage explicitly via the shell-pair screening strategy with which we achieve a cubic overall cost scaling. Using this more efficient implementation, we also examine the theory's ability to predict charge redistribution during charge transfer excitations. Using the coupled cluster as a benchmark, we find that by capturing orbital relaxation effects and avoiding self-interaction errors, excited state mean field theory out-performs other low-cost methods when predicting the charge density changes of charge transfer excitations.

QMCPACK: Advances in the development, efficiency, and application of auxiliary field and real-space variational and diffusion quantum Monte Carlo.

We review recent advances in the capabilities of the open source ab initio Quantum Monte Carlo (QMC) package QMCPACK and the workflow tool Nexus used for greater efficiency and reproducibility. The auxiliary field QMC (AFQMC) implementation has been greatly expanded to include k-point symmetries, tensor-hypercontraction, and accelerated graphical processing unit (GPU) support. These scaling and memory reductions greatly increase the number of orbitals that can practically be included in AFQMC calculations, increasing the accuracy. Advances in real space methods include techniques for accurate computation of bandgaps and for systematically improving the nodal surface of ground state wavefunctions. Results of these calculations can be used to validate application of more approximate electronic structure methods, including GW and density functional based techniques. To provide an improved foundation for these calculations, we utilize a new set of correlation-consistent effective core potentials (pseudopotentials) that are more accurate than previous sets; these can also be applied in quantum-chemical and other many-body applications, not only QMC. These advances increase the efficiency, accuracy, and range of properties that can be studied in both molecules and materials with QMC and QMCPACK.

A Generalized Variational Principle with Applications to Excited State Mean Field Theory.

We present a generalization of the variational principle that is compatible with any Hamiltonian eigenstate that can be specified uniquely by a list of properties. This variational principle appears to be compatible with a wide range of electronic structure methods, including mean field theory, density functional theory, multireference theory, and quantum Monte Carlo. Like the standard variational principle, this generalized variational principle amounts to the optimization of a nonlinear function that, in the limit of an arbitrarily flexible wave function, has the desired Hamiltonian eigenstate as its global minimum. Unlike the standard variational principle, it can target excited states and select individual states in cases of degeneracy or near-degeneracy. As an initial demonstration of how this approach can be useful in practice, we employ it to improve the optimization efficiency of excited state mean field theory by an order of magnitude. With this improved optimization, we are able to demonstrate that the accuracy of the corresponding second-order perturbation theory rivals that of singles-and-doubles equation-of-motion coupled cluster in a substantially broader set of molecules than could be explored by our previous optimization methodology.

Density Functional Extension to Excited-State Mean-Field Theory.

We investigate an extension of excited-state mean-field theory in which the energy expression is augmented with density functional components in an effort to include the effects of weak electron correlations. The approach remains variational and entirely time independent, allowing it to avoid some of the difficulties associated with linear response and the adiabatic approximation. In particular, all of the electrons' orbitals are relaxed state specifically, and there is no reliance on Kohn-Sham orbital energy differences, both of which are important features in the context of charge transfer. Preliminary testing shows clear advantages for single-component charge transfer states, but the method, at least in its current form, is less reliable for states in which multiple particle-hole transitions contribute significantly.

Tracking Excited States in Wave Function Optimization Using Density Matrices and Variational Principles.

We present a method for finding individual excited states' energy stationary points in complete active space self-consistent field theory that is compatible with standard optimization methods and highly effective at overcoming difficulties due to root flipping and near-degeneracies. Inspired by both the maximum overlap method and recent progress in excited-state variational principles, our approach combines these ideas in order to track individual excited states throughout the orbital optimization process. In a series of tests involving root flipping, near-degeneracies, charge transfers, and double excitations, we show that this approach is more effective for state-specific optimization than either the naive selection of roots on the basis of energy ordering or a more direct generalization of the maximum overlap method. We provide evidence that this state-specific approach improves the performance of complete active space perturbation theory for vertical excitation energies. Furthermore, we find that the state-specific optimization can help avoid state-averaging-induced discontinuities on potential energy surfaces. With a simple implementation, a low cost, and compatibility with large active space methods, the approach is designed to be useful in a wide range of excited-state investigations.

Variational Excitations in Real Solids: Optical Gaps and Insights into Many-Body Perturbation Theory.

We present an approach to studying optical band gaps in real solids in which quantum Monte Carlo methods allow for the application of a rigorous variational principle to both ground and excited state wave functions. In tests that include small, medium, and large band gap materials, optical gaps are predicted with a mean absolute deviation of 3.5% against experiment, less than half the equivalent errors for typical many-body perturbation theories. The approach is designed to be insensitive to the choice of density functional, a property we exploit in order to provide insight into how far different functionals are from satisfying the assumptions of many-body perturbation theory. We explore this question most deeply in the challenging case of ZnO, where we show that, although many commonly used functionals have shortcomings, there does exist a one-particle basis in which perturbation theory's zeroth-order picture is sound. Insights of this nature should be useful in guiding the future application and improvement of these widely used techniques.

Complementary first and second derivative methods for ansatz optimization in variational Monte Carlo.

We present a comparison between a number of recently introduced low-memory wave function optimization methods for variational Monte Carlo in which we find that first and second derivative methods possess strongly complementary relative advantages. While we find that low-memory variants of the linear method are vastly more efficient at bringing wave functions with disparate types of nonlinear parameters to the vicinity of the energy minimum, accelerated descent approaches are then able to locate the precise minimum with less bias and lower statistical uncertainty. By constructing a simple hybrid approach that combines these methodologies, we show that all of these advantages can be had at once when simultaneously optimizing large determinant expansions, molecular orbital shapes, traditional Jastrow correlation factors, and more nonlinear many-electron Jastrow factors.