A MHz X-ray diffraction set-up for dynamic compression experiments in the diamond anvil cell.

An experimental platform for dynamic diamond anvil cell (dDAC) research has been developed at the High Energy Density (HED) Instrument at the European X-ray Free Electron Laser (European XFEL). Advantage was taken of the high repetition rate of the European XFEL (up to 4.5 MHz) to collect pulse-resolved MHz X-ray diffraction data from samples as they are dynamically compressed at intermediate strain rates (≤103 s-1), where up to 352 diffraction images can be collected from a single pulse train. The set-up employs piezo-driven dDACs capable of compressing samples in ≥340 µs, compatible with the maximum length of the pulse train (550 µs). Results from rapid compression experiments on a wide range of sample systems with different X-ray scattering powers are presented. A maximum compression rate of 87 TPa s-1 was observed during the fast compression of Au, while a strain rate of ∼1100 s-1 was achieved during the rapid compression of N2 at 23 TPa s-1.

Single and multi-pulse based X-ray photon correlation spectroscopy.

The ability of pulsed nature of synchrotron radiation opens up the possibility of studying microsecond dynamics in complex materials via speckle-based techniques. Here, we present the study of measuring the dynamics of a colloidal system by combining single and multiple X-ray pulses of a storage ring. In addition, we apply speckle correlation techniques at various pulse patterns to collect correlation functions from nanoseconds to milliseconds. The obtained sample dynamics from all correlation techniques at different pulse patterns are in very good agreement with the expected dynamics of Brownian motions of silica nanoparticles in water. Our study will pave the way for future pulsed X-ray investigations at various synchrotron X-ray sources using individual X-ray pulse patterns.

Characterization of the Percival detector with soft X-rays.

In this paper the back-side-illuminated Percival 2-Megapixel (P2M) detector is presented, along with its characterization by means of optical and X-ray photons. For the first time, the response of the system to soft X-rays (250 eV to 1 keV) is presented. The main performance parameters of the first detector are measured, assessing the capabilities in terms of noise, dynamic range and single-photon discrimination capability. Present limitations and coming improvements are discussed.

The Adaptive Gain Integrating Pixel Detector at the European XFEL.

The Adaptive Gain Integrating Pixel Detector (AGIPD) is an X-ray imager, custom designed for the European X-ray Free-Electron Laser (XFEL). It is a fast, low-noise integrating detector, with an adaptive gain amplifier per pixel. This has an equivalent noise of less than 1 keV when detecting single photons and, when switched into another gain state, a dynamic range of more than 104 photons of 12 keV. In burst mode the system is able to store 352 images while running at up to 6.5 MHz, which is compatible with the 4.5 MHz frame rate at the European XFEL. The AGIPD system was installed and commissioned in August 2017, and successfully used for the first experiments at the Single Particles, Clusters and Biomolecules (SPB) experimental station at the European XFEL since September 2017. This paper describes the principal components and performance parameters of the system.

CAMP@FLASH: an end-station for imaging, electron- and ion-spectroscopy, and pump-probe experiments at the FLASH free-electron laser.

The non-monochromatic beamline BL1 at the FLASH free-electron laser facility at DESY was upgraded with new transport and focusing optics, and a new permanent end-station, CAMP, was installed. This multi-purpose instrument is optimized for electron- and ion-spectroscopy, imaging and pump-probe experiments at free-electron lasers. It can be equipped with various electron- and ion-spectrometers, along with large-area single-photon-counting pnCCD X-ray detectors, thus enabling a wide range of experiments from atomic, molecular, and cluster physics to material and energy science, chemistry and biology. Here, an overview of the layout, the beam transport and focusing capabilities, and the experimental possibilities of this new end-station are presented, as well as results from its commissioning.

Connecting structure, dynamics and viscosity in sheared soft colloidal liquids: a medley of anisotropic fluctuations.

Structural distortion and relaxation are central to any liquid flow. Their full understanding requires simultaneous probing of the mechanical as well as structural and dynamical response. We provide the first full dynamical measurement of the transient structure using combined coherent X-ray scattering and rheology on electrostatically interacting colloidal fluids. We find a stress overshoot during the start-up of shear which is due to the strong anisotropic overstretching and compression of nearest-neighbor distances. The rheological response is reflected in uncorrelated entropy-driven intensity fluctuations. While the structural distortion under steady shear is well described by Smoluchowski theory, we find an increase of the particle dynamics beyond the trivial contribution of flow. After the cessation of shear, the full fluid microstructure and dynamics are restored, both on the structural relaxation timescale. We thus find unique structure-dynamics relations in liquid flow, responsible for the macroscopic rheological behavior of the system.

Lipidic phase membrane protein serial femtosecond crystallography.

X-ray free electron laser (X-FEL)-based serial femtosecond crystallography is an emerging method with potential to rapidly advance the challenging field of membrane protein structural biology. Here we recorded interpretable diffraction data from micrometer-sized lipidic sponge phase crystals of the Blastochloris viridis photosynthetic reaction center delivered into an X-FEL beam using a sponge phase micro-jet.

In vivo protein crystallization opens new routes in structural biology.

Protein crystallization in cells has been observed several times in nature. However, owing to their small size these crystals have not yet been used for X-ray crystallographic analysis. We prepared nano-sized in vivo-grown crystals of Trypanosoma brucei enzymes and applied the emerging method of free-electron laser-based serial femtosecond crystallography to record interpretable diffraction data. This combined approach will open new opportunities in structural systems biology.

Robust image descriptor for machine learning based data reduction in serial crystallography.

Serial crystallography experiments at synchrotron and X-ray free-electron laser (XFEL) sources are producing crystallographic data sets of ever-increasing volume. While these experiments have large data sets and high-frame-rate detectors (around 3520 frames per second), only a small percentage of the data are useful for downstream analysis. Thus, an efficient and real-time data classification pipeline is essential to differentiate reliably between useful and non-useful images, typically known as 'hit' and 'miss', respectively, and keep only hit images on disk for further analysis such as peak finding and indexing. While feature-point extraction is a key component of modern approaches to image classification, existing approaches require computationally expensive patch preprocessing to handle perspective distortion. This paper proposes a pipeline to categorize the data, consisting of a real-time feature extraction algorithm called modified and parallelized FAST (MP-FAST), an image descriptor and a machine learning classifier. For parallelizing the primary operations of the proposed pipeline, central processing units, graphics processing units and field-programmable gate arrays are implemented and their performances compared. Finally, MP-FAST-based image classification is evaluated using a multi-layer perceptron on various data sets, including both synthetic and experimental data. This approach demonstrates superior performance compared with other feature extractors and classifiers.

Sensing the wavefront of x-ray free-electron lasers using aerosol spheres.

Characterizing intense, focused x-ray free electron laser (FEL) pulses is crucial for their use in diffractive imaging. We describe how the distribution of average phase tilts and intensities on hard x-ray pulses with peak intensities of 10(21) W/m(2) can be retrieved from an ensemble of diffraction patterns produced by 70 nm-radius polystyrene spheres, in a manner that mimics wavefront sensors. Besides showing that an adaptive geometric correction may be necessary for diffraction data from randomly injected sample sources, our paper demonstrates the possibility of collecting statistics on structured pulses using only the diffraction patterns they generate and highlights the imperative to study its impact on single-particle diffractive imaging.

Toward unsupervised single-shot diffractive imaging of heterogeneous particles using X-ray free-electron lasers.

Single shot diffraction imaging experiments via X-ray free-electron lasers can generate as many as hundreds of thousands of diffraction patterns of scattering objects. Recovering the real space contrast of a scattering object from these patterns currently requires a reconstruction process with user guidance in a number of steps, introducing severe bottlenecks in data processing. We present a series of measures that replace user guidance with algorithms that reconstruct contrasts in an unsupervised fashion. We demonstrate the feasibility of automating the reconstruction process by generating hundreds of contrasts obtained from soot particle diffraction experiments.

Data reduction for X-ray serial crystallography using machine learning.

Serial crystallography experiments produce massive amounts of experimental data. Yet in spite of these large-scale data sets, only a small percentage of the data are useful for downstream analysis. Thus, it is essential to differentiate reliably between acceptable data (hits) and unacceptable data (misses). To this end, a novel pipeline is proposed to categorize the data, which extracts features from the images, summarizes these features with the 'bag of visual words' method and then classifies the images using machine learning. In addition, a novel study of various feature extractors and machine learning classifiers is presented, with the aim of finding the best feature extractor and machine learning classifier for serial crystallography data. The study reveals that the oriented FAST and rotated BRIEF (ORB) feature extractor with a multilayer perceptron classifier gives the best results. Finally, the ORB feature extractor with multilayer perceptron is evaluated on various data sets including both synthetic and experimental data, demonstrating superior performance compared with other feature extractors and classifiers.

Explainable machine learning for diffraction patterns.

Serial crystallography experiments at X-ray free-electron laser facilities produce massive amounts of data but only a fraction of these data are useful for downstream analysis. Thus, it is essential to differentiate between acceptable and unacceptable data, generally known as 'hit' and 'miss', respectively. Image classification methods from artificial intelligence, or more specifically convolutional neural networks (CNNs), classify the data into hit and miss categories in order to achieve data reduction. The quantitative performance established in previous work indicates that CNNs successfully classify serial crystallography data into desired categories [Ke, Brewster, Yu, Ushizima, Yang & Sauter (2018). J. Synchrotron Rad.25, 655-670], but no qualitative evidence on the internal workings of these networks has been provided. For example, there are no visualization methods that highlight the features contributing to a specific prediction while classifying data in serial crystallography experiments. Therefore, existing deep learning methods, including CNNs classifying serial crystallography data, are like a 'black box'. To this end, presented here is a qualitative study to unpack the internal workings of CNNs with the aim of visualizing information in the fundamental blocks of a standard network with serial crystallography data. The region(s) or part(s) of an image that mostly contribute to a hit or miss prediction are visualized.

Femtosecond free-electron laser x-ray diffraction data sets for algorithm development.

We describe femtosecond X-ray diffraction data sets of viruses and nanoparticles collected at the Linac Coherent Light Source. The data establish the first large benchmark data sets for coherent diffraction methods freely available to the public, to bolster the development of algorithms that are essential for developing this novel approach as a useful imaging technique. Applications are 2D reconstructions, orientation classification and finally 3D imaging by assembling 2D patterns into a 3D diffraction volume.

Time-resolved protein nanocrystallography using an X-ray free-electron laser.

We demonstrate the use of an X-ray free electron laser synchronized with an optical pump laser to obtain X-ray diffraction snapshots from the photoactivated states of large membrane protein complexes in the form of nanocrystals flowing in a liquid jet. Light-induced changes of Photosystem I-Ferredoxin co-crystals were observed at time delays of 5 to 10 µs after excitation. The result correlates with the microsecond kinetics of electron transfer from Photosystem I to ferredoxin. The undocking process that follows the electron transfer leads to large rearrangements in the crystals that will terminally lead to the disintegration of the crystals. We describe the experimental setup and obtain the first time-resolved femtosecond serial X-ray crystallography results from an irreversible photo-chemical reaction at the Linac Coherent Light Source. This technique opens the door to time-resolved structural studies of reaction dynamics in biological systems.

The synchrotron radiation source PETRA III and its future ultra-low-emittance upgrade PETRA IV.

PETRA III at DESY is one of the brightest synchrotron radiation sources worldwide. It serves a broad international multidisciplinary user community from academia to industry at currently 25 specialised beamlines. With a storage-ring energy of 6 GeV, it provides mainly hard to high-energy X-rays for versatile experiments in a very broad range of scientific fields. It is ideally suited for an upgrade to the ultra-low emittance source PETRA IV, owing to its large circumference of 2304 m. With a targeted storage ring emittance of 20 × 5 pm 2 rad 2 , PETRA IV will reach spectral brightnesses two to three orders of magnitude higher than today. The unique beam parameters will make PETRA IV the ultimate in situ 3D microscope for biological, chemical, and physical processes helping to address key questions in health, energy, mobility, information technology, and earth and environment.

Unsupervised classification of single-particle X-ray diffraction snapshots by spectral clustering.

Single-particle experiments using X-ray Free Electron Lasers produce more than 10(5) snapshots per hour, consisting of an admixture of blank shots (no particle intercepted), and exposures of one or more particles. Experimental data sets also often contain unintentional contamination with different species. We present an unsupervised method able to sort experimental snapshots without recourse to templates, specific noise models, or user-directed learning. The results show 90% agreement with manual classification.

Nanosecond X-ray photon correlation spectroscopy using pulse time structure of a storage-ring source.

X-ray photon correlation spectroscopy (XPCS) is a routine technique to study slow dynamics in complex systems at storage-ring sources. Achieving nanosecond time resolution with the conventional XPCS technique is, however, still an experimentally challenging task requiring fast detectors and sufficient photon flux. Here, the result of a nanosecond XPCS study of fast colloidal dynamics is shown by employing an adaptive gain integrating pixel detector (AGIPD) operated at frame rates of the intrinsic pulse structure of the storage ring. Correlation functions from single-pulse speckle patterns with the shortest correlation time of 192 ns have been calculated. These studies provide an important step towards routine fast XPCS studies at storage rings.

Segmented flow generator for serial crystallography at the European X-ray free electron laser.

Serial femtosecond crystallography (SFX) with X-ray free electron lasers (XFELs) allows structure determination of membrane proteins and time-resolved crystallography. Common liquid sample delivery continuously jets the protein crystal suspension into the path of the XFEL, wasting a vast amount of sample due to the pulsed nature of all current XFEL sources. The European XFEL (EuXFEL) delivers femtosecond (fs) X-ray pulses in trains spaced 100 ms apart whereas pulses within trains are currently separated by 889 ns. Therefore, continuous sample delivery via fast jets wastes >99% of sample. Here, we introduce a microfluidic device delivering crystal laden droplets segmented with an immiscible oil reducing sample waste and demonstrate droplet injection at the EuXFEL compatible with high pressure liquid delivery of an SFX experiment. While achieving ~60% reduction in sample waste, we determine the structure of the enzyme 3-deoxy-D-manno-octulosonate-8-phosphate synthase from microcrystals delivered in droplets revealing distinct structural features not previously reported.

Evaluation of serial crystallographic structure determination within megahertz pulse trains.

The new European X-ray Free-Electron Laser (European XFEL) is the first X-ray free-electron laser capable of delivering intense X-ray pulses with a megahertz interpulse spacing in a wavelength range suitable for atomic resolution structure determination. An outstanding but crucial question is whether the use of a pulse repetition rate nearly four orders of magnitude higher than previously possible results in unwanted structural changes due to either radiation damage or systematic effects on data quality. Here, separate structures from the first and subsequent pulses in the European XFEL pulse train were determined, showing that there is essentially no difference between structures determined from different pulses under currently available operating conditions at the European XFEL.