Ab initio structure determination from experimental fluctuation X-ray scattering data.

Fluctuation X-ray scattering (FXS) is an emerging experimental technique in which X-ray solution scattering data are collected from particles in solution using ultrashort X-ray exposures generated by a free-electron laser (FEL). FXS experiments overcome the low data-to-parameter ratios associated with traditional solution scattering measurements by providing several orders of magnitude more information in the final processed data. Here we demonstrate the practical feasibility of FEL-based FXS on a biological multiple-particle system and describe data-processing techniques required to extract robust FXS data and significantly reduce the required number of snapshots needed by introducing an iterative noise-filtering technique. We showcase a successful ab initio electron density reconstruction from such an experiment, studying the Paramecium bursaria Chlorella virus (PBCV-1).

Accurate macromolecular structures using minimal measurements from X-ray free-electron lasers.

X-ray free-electron laser (XFEL) sources enable the use of crystallography to solve three-dimensional macromolecular structures under native conditions and without radiation damage. Results to date, however, have been limited by the challenge of deriving accurate Bragg intensities from a heterogeneous population of microcrystals, while at the same time modeling the X-ray spectrum and detector geometry. Here we present a computational approach designed to extract meaningful high-resolution signals from fewer diffraction measurements.

Simultaneous detection of electronic structure changes from two elements of a bifunctional catalyst using wavelength-dispersive X-ray emission spectroscopy and in situ electrochemistry.

Multielectron catalytic reactions, such as water oxidation, nitrogen reduction, or hydrogen production in enzymes and inorganic catalysts often involve multimetallic clusters. In these systems, the reaction takes place between metals or metals and ligands to facilitate charge transfer, bond formation/breaking, substrate binding, and release of products. In this study, we present a method to detect X-ray emission signals from multiple elements simultaneously, which allows for the study of charge transfer and the sequential chemistry occurring between elements. Kß X-ray emission spectroscopy (XES) probes charge and spin states of metals as well as their ligand environment. A wavelength-dispersive spectrometer based on the von Hamos geometry was used to disperse Kß signals of multiple elements onto a position detector, enabling an XES spectrum to be measured in a single-shot mode. This overcomes the scanning needs of the scanning spectrometers, providing data free from temporal and normalization errors and therefore ideal to follow sequential chemistry at multiple sites. We have applied this method to study MnOx-based bifunctional electrocatalysts for the oxygen evolution reaction (OER) and the oxygen reduction reaction (ORR). In particular, we investigated the effects of adding a secondary element, Ni, to form MnNiOx and its impact on the chemical states and catalytic activity, by tracking the redox characteristics of each element upon sweeping the electrode potential. The detection scheme we describe here is general and can be applied to time-resolved studies of materials consisting of multiple elements, to follow the dynamics of catalytic and electron transfer reactions.

Energy-dispersive X-ray emission spectroscopy using an X-ray free-electron laser in a shot-by-shot mode.

The ultrabright femtosecond X-ray pulses provided by X-ray free-electron lasers open capabilities for studying the structure and dynamics of a wide variety of systems beyond what is possible with synchrotron sources. Recently, this "probe-before-destroy" approach has been demonstrated for atomic structure determination by serial X-ray diffraction of microcrystals. There has been the question whether a similar approach can be extended to probe the local electronic structure by X-ray spectroscopy. To address this, we have carried out femtosecond X-ray emission spectroscopy (XES) at the Linac Coherent Light Source using redox-active Mn complexes. XES probes the charge and spin states as well as the ligand environment, critical for understanding the functional role of redox-active metal sites. Kß(1,3) XES spectra of Mn(II) and Mn(2)(III,IV) complexes at room temperature were collected using a wavelength dispersive spectrometer and femtosecond X-ray pulses with an individual dose of up to >100 MGy. The spectra were found in agreement with undamaged spectra collected at low dose using synchrotron radiation. Our results demonstrate that the intact electronic structure of redox active transition metal compounds in different oxidation states can be characterized with this shot-by-shot method. This opens the door for studying the chemical dynamics of metal catalytic sites by following reactions under functional conditions. The technique can be combined with X-ray diffraction to simultaneously obtain the geometric structure of the overall protein and the local chemistry of active metal sites and is expected to prove valuable for understanding the mechanism of important metalloproteins, such as photosystem II.

Room temperature femtosecond X-ray diffraction of photosystem II microcrystals.

Most of the dioxygen on earth is generated by the oxidation of water by photosystem II (PS II) using light from the sun. This light-driven, four-photon reaction is catalyzed by the Mn(4)CaO(5) cluster located at the lumenal side of PS II. Various X-ray studies have been carried out at cryogenic temperatures to understand the intermediate steps involved in the water oxidation mechanism. However, the necessity for collecting data at room temperature, especially for studying the transient steps during the O-O bond formation, requires the development of new methodologies. In this paper we report room temperature X-ray diffraction data of PS II microcrystals obtained using ultrashort (< 50 fs) 9 keV X-ray pulses from a hard X-ray free electron laser, namely the Linac Coherent Light Source. The results presented here demonstrate that the "probe before destroy" approach using an X-ray free electron laser works even for the highly-sensitive Mn(4)CaO(5) cluster in PS II at room temperature. We show that these data are comparable to those obtained in synchrotron radiation studies as seen by the similarities in the overall structure of the helices, the protein subunits and the location of the various cofactors. This work is, therefore, an important step toward future studies for resolving the structure of the Mn(4)CaO(5) cluster without any damage at room temperature, and of the reaction intermediates of PS II during O-O bond formation.

Improved crystal orientation and physical properties from single-shot XFEL stills.

X-ray diffraction patterns from still crystals are inherently difficult to process because the crystal orientation is not uniquely determined by measuring the Bragg spot positions. Only one of the three rotational degrees of freedom is directly coupled to spot positions; the other two rotations move Bragg spots in and out of the reflecting condition but do not change the direction of the diffracted rays. This hinders the ability to recover accurate structure factors from experiments that are dependent on single-shot exposures, such as femtosecond diffract-and-destroy protocols at X-ray free-electron lasers (XFELs). Here, additional methods are introduced to optimally model the diffraction. The best orientation is obtained by requiring, for the brightest observed spots, that each reciprocal-lattice point be placed into the exact reflecting condition implied by Bragg's law with a minimal rotation. This approach reduces the experimental uncertainties in noisy XFEL data, improving the crystallographic R factors and sharpening anomalous differences that are near the level of the noise.

DLSIA: Deep Learning for Scientific Image Analysis.

DLSIA (Deep Learning for Scientific Image Analysis) is a Python-based machine learning library that empowers scientists and researchers across diverse scientific domains with a range of customizable convolutional neural network (CNN) architectures for a wide variety of tasks in image analysis to be used in downstream data processing. DLSIA features easy-to-use architectures, such as autoencoders, tunable U-Nets and parameter-lean mixed-scale dense networks (MSDNets). Additionally, this article introduces sparse mixed-scale networks (SMSNets), generated using random graphs, sparse connections and dilated convolutions connecting different length scales. For verification, several DLSIA-instantiated networks and training scripts are employed in multiple applications, including inpainting for X-ray scattering data using U-Nets and MSDNets, segmenting 3D fibers in X-ray tomographic reconstructions of concrete using an ensemble of SMSNets, and leveraging autoencoder latent spaces for data compression and clustering. As experimental data continue to grow in scale and complexity, DLSIA provides accessible CNN construction and abstracts CNN complexities, allowing scientists to tailor their machine learning approaches, accelerate discoveries, foster interdisciplinary collaboration and advance research in scientific image analysis.

Deploying Machine Learning Based Segmentation for Scientific Imaging Analysis at Synchrotron Facilities.

Scientific user facilities present a unique set of challenges for image processing due to the large volume of data generated from experiments and simulations. Furthermore, developing and implementing algorithms for real-time processing and analysis while correcting for any artifacts or distortions in images remains a complex task, given the computational requirements of the processing algorithms. In a collaborative effort across multiple Department of Energy national laboratories, the "MLExchange" project is focused on addressing these challenges. MLExchange is a Machine Learning framework deploying interactive web interfaces to enhance and accelerate data analysis. The platform allows users to easily upload, visualize, label, and train networks. The resulting models can be deployed on real data while both results and models could be shared with the scientists. The MLExchange web-based application for image segmentation allows for training, testing, and evaluating multiple machine learning models on hand-labeled tomography data. This environment provides users with an intuitive interface for segmenting images using a variety of machine learning algorithms and deep-learning neural networks. Additionally, these tools have the potential to overcome limitations in traditional image segmentation techniques, particularly for complex and low-contrast images.

Nanoflow electrospinning serial femtosecond crystallography.

An electrospun liquid microjet has been developed that delivers protein microcrystal suspensions at flow rates of 0.14-3.1 µl min(-1) to perform serial femtosecond crystallography (SFX) studies with X-ray lasers. Thermolysin microcrystals flowed at 0.17 µl min(-1) and diffracted to beyond 4 Å resolution, producing 14,000 indexable diffraction patterns, or four per second, from 140 µg of protein. Nanoflow electrospinning extends SFX to biological samples that necessitate minimal sample consumption.

A comparison of deep-learning-based inpainting techniques for experimental X-ray scattering.

The implementation is proposed of image inpainting techniques for the reconstruction of gaps in experimental X-ray scattering data. The proposed methods use deep learning neural network architectures, such as convolutional autoencoders, tunable U-Nets, partial convolution neural networks and mixed-scale dense networks, to reconstruct the missing information in experimental scattering images. In particular, the recovered pixel intensities are evaluated against their corresponding ground-truth values using the mean absolute error and the correlation coefficient metrics. The results demonstrate that the proposed methods achieve better performance than traditional inpainting algorithms such as biharmonic functions. Overall, tunable U-Net and mixed-scale dense network architectures achieved the best reconstruction performance among all the tested algorithms, with correlation coefficient scores greater than 0.9980.

MLExchange: A web-based platform enabling exchangeable machine learning workflows for scientific studies.

Machine learning (ML) algorithms are showing a growing trend in helping the scientific communities across different disciplines and institutions to address large and diverse data problems. However, many available ML tools are programmatically demanding and computationally costly. The MLExchange project aims to build a collaborative platform equipped with enabling tools that allow scientists and facility users who do not have a profound ML background to use ML and computational resources in scientific discovery. At the high level, we are targeting a full user experience where managing and exchanging ML algorithms, workflows, and data are readily available through web applications. Since each component is an independent container, the whole platform or its individual service(s) can be easily deployed at servers of different scales, ranging from a personal device (laptop, smart phone, etc.) to high performance clusters (HPC) accessed (simultaneously) by many users. Thus, MLExchange renders flexible using scenarios-users could either access the services and resources from a remote server or run the whole platform or its individual service(s) within their local network.

Structural determinants underlying photoprotection in the photoactive orange carotenoid protein of cyanobacteria.

The photoprotective processes of photosynthetic organisms involve the dissipation of excess absorbed light energy as heat. Photoprotection in cyanobacteria is mechanistically distinct from that in plants; it involves the orange carotenoid protein (OCP), a water-soluble protein containing a single carotenoid. The OCP is a new member of the family of blue light-photoactive proteins; blue-green light triggers the OCP-mediated photoprotective response. Here we report structural and functional characterization of the wild type and two mutant forms of the OCP, from the model organism Synechocystis PCC6803. The structural analysis provides high resolution detail of the carotenoid-protein interactions that underlie the optical properties of the OCP, unique among carotenoid-proteins in binding a single pigment per polypeptide chain. Collectively, these data implicate several key amino acids in the function of the OCP and reveal that the photoconversion and photoprotective responses of the OCP to blue-green light can be decoupled.

High-Performance Hybrid-Global-Deflated-Local Optimization with Applications to Active Learning.

Mathematical optimization lies at the core of many science and industry applications. One important issue with many current optimization strategies is a well-known trade-off between the number of function evaluations and the probability to find the global, or at least sufficiently high-quality local optima. In machine learning (ML), and by extension in active learning - for instance for autonomous experimentation - mathematical optimization is often used to find the underlying uncertain surrogate model from which subsequent decisions are made and therefore ML relies on high-quality optima to obtain the most accurate models. Active learning often has the added complexity of missing offline training data; therefore, the training has to be conducted during the data collection which can stall the acquisition if standard methods are used. In this work, we highlight recent efforts to create a high-performance hybrid optimization algorithm (HGDL), combining derivative-free global optimization strategies with local, derivative-based optimization, ultimately yielding an ordered list of unique local optima. Redundancies are avoided by deflating the objective function around earlier encountered optima. HGDL is designed to take full advantage of parallelism by having the most computationally expensive process, the local first and second-order-derivative-based optimizations, run in parallel on separate compute nodes in separate processes. In addition, the algorithm runs asynchronously; as soon as the first solution is found, it can be used while the algorithm continues to find more solutions. We apply the proposed optimization and training strategy to Gaussian-Process-driven stochastic function approximation and active learning.

GPU-accelerated multitiered iterative phasing algorithm for fluctuation X-ray scattering.

The multitiered iterative phasing (MTIP) algorithm is used to determine the biological structures of macromolecules from fluctuation scattering data. It is an iterative algorithm that reconstructs the electron density of the sample by matching the computed fluctuation X-ray scattering data to the external observations, and by simultaneously enforcing constraints in real and Fourier space. This paper presents the first ever MTIP algorithm acceleration efforts on contemporary graphics processing units (GPUs). The Compute Unified Device Architecture (CUDA) programming model is used to accelerate the MTIP algorithm on NVIDIA GPUs. The computational performance of the CUDA-based MTIP algorithm implementation outperforms the CPU-based version by an order of magnitude. Furthermore, the Heterogeneous-Compute Interface for Portability (HIP) runtime APIs are used to demonstrate portability by accelerating the MTIP algorithm across NVIDIA and AMD GPUs.

Challenges in solving structures from radiation-damaged tomograms of protein nanocrystals assessed by simulation.

Structure-determination methods are needed to resolve the atomic details that underlie protein function. X-ray crystallography has provided most of our knowledge of protein structure, but is constrained by the need for large, well ordered crystals and the loss of phase information. The rapidly developing methods of serial femtosecond crystallography, micro-electron diffraction and single-particle reconstruction circumvent the first of these limitations by enabling data collection from nanocrystals or purified proteins. However, the first two methods also suffer from the phase problem, while many proteins fall below the molecular-weight threshold required for single-particle reconstruction. Cryo-electron tomography of protein nanocrystals has the potential to overcome these obstacles of mainstream structure-determination methods. Here, a data-processing scheme is presented that combines routines from X-ray crystallography and new algorithms that have been developed to solve structures from tomograms of nanocrystals. This pipeline handles image-processing challenges specific to tomographic sampling of periodic specimens and is validated using simulated crystals. The tolerance of this workflow to the effects of radiation damage is also assessed. The simulations indicate a trade-off between a wider tilt range to facilitate merging data from multiple tomograms and a smaller tilt increment to improve phase accuracy. Since phase errors, but not merging errors, can be overcome with additional data sets, these results recommend distributing the dose over a wide angular range rather than using a finer sampling interval to solve the protein structure.

Evaluating crystallographic likelihood functions using numerical quadratures.

Intensity-based likelihood functions in crystallographic applications have the potential to enhance the quality of structures derived from marginal diffraction data. Their usage, however, is complicated by the ability to efficiently compute these target functions. Here, a numerical quadrature is developed that allows the rapid evaluation of intensity-based likelihood functions in crystallographic applications. By using a sequence of change-of-variable transformations, including a nonlinear domain-compression operation, an accurate, robust and efficient quadrature is constructed. The approach is flexible and can incorporate different noise models with relative ease.

SAD phasing of XFEL data depends critically on the error model.

A nonlinear least-squares method for refining a parametric expression describing the estimated errors of reflection intensities in serial crystallographic (SX) data is presented. This approach, which is similar to that used in the rotation method of crystallographic data collection at synchrotrons, propagates error estimates from photon-counting statistics to the merged data. Here, it is demonstrated that the application of this approach to SX data provides better SAD phasing ability, enabling the autobuilding of a protein structure that had previously failed to be built. Estimating the error in the merged reflection intensities requires the understanding and propagation of all of the sources of error arising from the measurements. One type of error, which is well understood, is the counting error introduced when the detector counts X-ray photons. Thus, if other types of random errors (such as readout noise) as well as uncertainties in systematic corrections (such as from X-ray attenuation) are completely understood, they can be propagated along with the counting error, as appropriate. In practice, most software packages propagate as much error as they know how to model and then include error-adjustment terms that scale the error estimates until they explain the variance among the measurements. If this is performed carefully, then during SAD phasing likelihood-based approaches can make optimal use of these error estimates, increasing the chance of a successful structure solution. In serial crystallography, SAD phasing has remained challenging, with the few examples of de novo protein structure solution each requiring many thousands of diffraction patterns. Here, the effects of different methods of treating the error estimates are estimated and it is shown that using a parametric approach that includes terms proportional to the known experimental uncertainty, the reflection intensity and the squared reflection intensity to improve the error estimates can allow SAD phasing even from weak zinc anomalous signal.

Free-electron laser data for multiple-particle fluctuation scattering analysis.

Fluctuation X-ray scattering (FXS) is an emerging experimental technique in which solution scattering data are collected using X-ray exposures below rotational diffusion times, resulting in angularly anisotropic X-ray snapshots that provide several orders of magnitude more information than traditional solution scattering data. Such experiments can be performed using the ultrashort X-ray pulses provided by a free-electron laser source, allowing one to collect a large number of diffraction patterns in a relatively short time. Here, we describe a test data set for FXS, obtained at the Linac Coherent Light Source, consisting of close to 100 000 multi-particle diffraction patterns originating from approximately 50 to 200 Paramecium Bursaria Chlorella virus particles per snapshot. In addition to the raw data, a selection of high-quality pre-processed diffraction patterns and a reference SAXS profile are provided.

Operational properties of fluctuation X-ray scattering data.

X-ray scattering images collected on timescales shorter than rotation diffusion times using a (partially) coherent beam result in a significant increase in information content in the scattered data. These measurements, named fluctuation X-ray scattering (FXS), are typically performed on an X-ray free-electron laser (XFEL) and can provide fundamental insights into the structure of biological molecules, engineered nanoparticles or energy-related mesoscopic materials beyond what can be obtained with standard X-ray scattering techniques. In order to understand, use and validate experimental FXS data, the availability of basic data characteristics and operational properties is essential, but has been absent up to this point. In this communication, an intuitive view of the nature of FXS data and their properties is provided, the effect of FXS data on the derived structural models is highlighted, and generalizations of the Guinier and Porod laws that can ultimately be used to plan experiments and assess the quality of experimental data are presented.