New opportunities for time-resolved imaging using diffraction-limited storage rings.

The advent of diffraction-limited storage rings (DLSRs) has boosted the brilliance or coherent flux by one to two orders of magnitude with respect to the previous generation. One consequence of this brilliance enhancement is an increase in the flux density or number of photons per unit of area and time, which opens new possibilities for the spatiotemporal resolution of X-ray imaging techniques. This paper studies the time-resolved microscopy capabilities of such facilities by benchmarking the ForMAX beamline at the MAX IV storage ring. It is demonstrated that this enhanced flux density using a single harmonic of the source allows micrometre-resolution time-resolved imaging at 2000 tomograms per second and 1.1 MHz 2D acquisition rates using the full dynamic range of the detector system.

Development of crystal optics for X-ray multi-projection imaging for synchrotron and XFEL sources.

X-ray multi-projection imaging (XMPI) is an emerging experimental technique for the acquisition of rotation-free, time-resolved, volumetric information on stochastic processes. The technique is developed for high-brilliance light-source facilities, aiming to address known limitations of state-of-the-art imaging methods in the acquisition of 4D sample information, linked to their need for sample rotation. XMPI relies on a beam-splitting scheme, that illuminates a sample from multiple, angularly spaced viewpoints, and employs fast, indirect, X-ray imaging detectors for the collection of the data. This approach enables studies of previously inaccessible phenomena of industrial and societal relevance such as fractures in solids, propagation of shock waves, laser-based 3D printing, or even fast processes in the biological domain. In this work, we discuss in detail the beam-splitting scheme of XMPI. More specifically, we explore the relevant properties of X-ray splitter optics for their use in XMPI schemes, both at synchrotron insertion devices and XFEL facilities. Furthermore, we describe two distinct XMPI schemes, designed to faciliate large samples and complex sample environments. Finally, we present experimental proof of the feasibility of MHz-rate XMPI at the European XFEL. This detailed overview aims to state the challenges and the potential of XMPI and act as a stepping stone for future development of the technique.

Development towards high-resolution kHz-speed rotation-free volumetric imaging.

X-ray multi-projection imaging (XMPI) has the potential to provide rotation-free 3D movies of optically opaque samples. The absence of rotation enables superior imaging speed and preserves fragile sample dynamics by avoiding the centrifugal forces introduced by conventional rotary tomography. Here, we present our XMPI observations at the ID19 beamline (ESRF, France) of 3D dynamics in melted aluminum with 1000 frames per second and 8 µm resolution per projection using the full dynamical range of our detectors. Since XMPI is a method under development, we also provide different tests for the instrumentation of up to 3000 frames per second. As the high-brilliance of 4th generation light-sources becomes more available, XMPI is a promising technique for current and future X-ray imaging instruments.

Online dynamic flat-field correction for MHz microscopy data at European XFEL.

The high pulse intensity and repetition rate of the European X-ray Free-Electron Laser (EuXFEL) provide superior temporal resolution compared with other X-ray sources. In combination with MHz X-ray microscopy techniques, it offers a unique opportunity to achieve superior contrast and spatial resolution in applications demanding high temporal resolution. In both live visualization and offline data analysis for microscopy experiments, baseline normalization is essential for further processing steps such as phase retrieval and modal decomposition. In addition, access to normalized projections during data acquisition can play an important role in decision-making and improve the quality of the data. However, the stochastic nature of X-ray free-electron laser sources hinders the use of standard flat-field normalization methods during MHz X-ray microscopy experiments. Here, an online (i.e. near real-time) dynamic flat-field correction method based on principal component analysis of dynamically evolving flat-field images is presented. The method is used for the normalization of individual X-ray projections and has been implemented as a near real-time analysis tool at the Single Particles, Clusters, and Biomolecules and Serial Femtosecond Crystallography (SPB/SFX) instrument of EuXFEL.

Hard X-ray stereographic microscopy for single-shot differential phase imaging.

The characterisation of fast phenomena at the microscopic scale is required for the understanding of catastrophic responses of materials to loads and shocks, the processing of materials by optical or mechanical means, the processes involved in many key technologies such as additive manufacturing and microfluidics, and the mixing of fuels in combustion. Such processes are usually stochastic in nature and occur within the opaque interior volumes of materials or samples, with complex dynamics that evolve in all three dimensions at speeds exceeding many meters per second. There is therefore a need for the ability to record three-dimensional X-ray movies of irreversible processes with resolutions of micrometers and frame rates of microseconds. Here we demonstrate a method to achieve this by recording a stereo phase-contrast image pair in a single exposure. The two images are combined computationally to reconstruct a 3D model of the object. The method is extendable to more than two simultaneous views. When combined with megahertz pulse trains of X-ray free-electron lasers (XFELs) it will be possible to create movies able to resolve 3D trajectories with velocities of kilometers per second.

X-ray in-line holography and holotomography at the NanoMAX beamline.

Coherent X-ray imaging techniques, such as in-line holography, exploit the high brilliance provided by diffraction-limited storage rings to perform imaging sensitive to the electron density through contrast due to the phase shift, rather than conventional attenuation contrast. Thus, coherent X-ray imaging techniques enable high-sensitivity and low-dose imaging, especially for low-atomic-number (Z) chemical elements and materials with similar attenuation contrast. Here, the first implementation of in-line holography at the NanoMAX beamline is presented, which benefits from the exceptional focusing capabilities and the high brilliance provided by MAX IV, the first operational diffraction-limited storage ring up to approximately 300 eV. It is demonstrated that in-line holography at NanoMAX can provide 2D diffraction-limited images, where the achievable resolution is only limited by the 70 nm focal spot at 13 keV X-ray energy. Also, the 3D capabilities of this instrument are demonstrated by performing holotomography on a chalk sample at a mesoscale resolution of around 155 nm. It is foreseen that in-line holography will broaden the spectra of capabilities of MAX IV by providing fast 2D and 3D electron density images from mesoscale down to nanoscale resolution.

Dose-efficient multimodal microscopy of human tissue at a hard X-ray nanoprobe beamline.

X-ray fluorescence microscopy performed at nanofocusing synchrotron beamlines produces quantitative elemental distribution maps at unprecedented resolution (down to a few tens of nanometres), at the expense of relatively long measuring times and high absorbed doses. In this work, a method was implemented in which fast low-dose in-line holography was used to produce quantitative electron density maps at the mesoscale prior to nanoscale X-ray fluorescence acquisition. These maps ensure more efficient fluorescence scans and the reduction of the total absorbed dose, often relevant for radiation-sensitive (e.g. biological) samples. This multimodal microscopy approach was demonstrated on human sural nerve tissue. The two imaging modes provide complementary information at a comparable resolution, ultimately limited by the focal spot size. The experimental setup presented allows the user to swap between them in a flexible and reproducible fashion, as well as to easily adapt the scanning parameters during an experiment to fine-tune resolution and field of view.

Shot-to-shot flat-field correction at X-ray free-electron lasers.

X-ray free-electron lasers (XFELs) provide high-brilliance pulses, which offer unique opportunities for coherent X-ray imaging techniques, such as in-line holography. One of the fundamental steps to process in-line holographic data is flat-field correction, which mitigates imaging artifacts and, in turn, enables phase reconstructions. However, conventional flat-field correction approaches cannot correct single XFEL pulses due to the stochastic nature of the self-amplified spontaneous emission (SASE), the mechanism responsible for the high brilliance of XFELs. Here, we demonstrate on simulated and megahertz imaging data, measured at the European XFEL, the possibility of overcoming such a limitation by using two different methods based on principal component analysis and deep learning. These methods retrieve flat-field corrected images from individual frames by separating the sample and flat-field signal contributions; thus, enabling advanced phase-retrieval reconstructions. We anticipate that the proposed methods can be implemented in a real-time processing pipeline, which will enable online data analysis and phase reconstructions of coherent full-field imaging techniques such as in-line holography at XFELs.

PyPhase - a Python package for X-ray phase imaging.

X-ray propagation-based imaging techniques are well established at synchrotron radiation and laboratory sources. However, most reconstruction algorithms for such image modalities, also known as phase-retrieval algorithms, have been developed specifically for one instrument by and for experts, making the development and diffusion of such techniques difficult. Here, PyPhase, a free and open-source package for propagation-based near-field phase reconstructions, which is distributed under the CeCILL license, is presented. PyPhase implements some of the most popular phase-retrieval algorithms in a highly modular framework supporting its deployment on large-scale computing facilities. This makes the integration, the development of new phase-retrieval algorithms, and the deployment on different computing infrastructures straightforward. Its capabilities and simplicity are presented by application to data acquired at the synchrotron source MAX IV (Lund, Sweden).

PhaseGAN: a deep-learning phase-retrieval approach for unpaired datasets.

Phase retrieval approaches based on deep learning (DL) provide a framework to obtain phase information from an intensity hologram or diffraction pattern in a robust manner and in real-time. However, current DL architectures applied to the phase problem rely on i) paired datasets, i. e., they are only applicable when a satisfactory solution of the phase problem has been found, and ii) the fact that most of them ignore the physics of the imaging process. Here, we present PhaseGAN, a new DL approach based on Generative Adversarial Networks, which allows the use of unpaired datasets and includes the physics of image formation. The performance of our approach is enhanced by including the image formation physics and a novel Fourier loss function, providing phase reconstructions when conventional phase retrieval algorithms fail, such as ultra-fast experiments. Thus, PhaseGAN offers the opportunity to address the phase problem in real-time when no phase reconstructions but good simulations or data from other experiments are available.

Singleshot polychromatic coherent diffractive imaging with a high-order harmonic source.

Singleshot polychromatic coherent diffractive imaging is performed with a high-intensity high-order harmonic generation source. The coherence properties are analyzed and several reconstructions show the shot-to-shot fluctuations of the incident beam wavefront. The method is based on a multi-step approach. First, the spectrum is extracted from double-slit diffraction data. The spectrum is used as input to extract the monochromatic sample diffraction pattern, then phase retrieval is performed on the quasi-monochromatic data to obtain the sample's exit surface wave. Reconstructions based on guided error reduction (ER) and alternating direction method of multipliers (ADMM) are compared. ADMM allows additional penalty terms to be included in the cost functional to promote sparsity within the reconstruction.

Sensitivity-based optimization for the design of a grating interferometer for clinical X-ray phase contrast mammography.

An X-ray grating interferometer (GI) suitable for clinical mammography must comply with quite strict dose, scanning time and geometry limitations, while being able to detect tumors, microcalcifications and other abnormalities. Such a design task is not straightforward, since obtaining optimal phase-contrast and dark-field signals with clinically compatible doses and geometrical constraints is remarkably challenging. In this work, we present a wave propagation based optimization that uses the phase and dark-field sensitivities as figures of merit. This method was used to calculate the optimal interferometer designs for a commercial mammography setup. Its accuracy was validated by measuring the visibility of polycarbonate samples of different thicknesses on a Talbot-Lau interferometer installed on this device and considering some of the most common grating imperfections to be able to reproduce the experimental values. The optimization method outcomes indicate that small grating pitches are required to boost sensitivity in such a constrained setup and that there is a different optimal scenario for each signal type.

Contrast-transfer-function phase retrieval based on compressed sensing.

We report on a new contrast-transfer-function (CTF) phase-retrieval method based on the alternating direction method of multipliers (ADMMs), which allows us to exploit any compressed sensing regularization scheme reflecting the sparsity of the investigated object. The proposed iterative algorithm retrieves accurate phase maps from highly noisy single-distance projection microscopy data and is characterized by a stable convergence, not bounded to the prior knowledge of the object support or to the initialization strategy. Experiments on simulated and real datasets show that ADMM-CTF yields reconstructions with a substantial lower amount of artifacts and enhanced signal-to-noise ratio compared to the standard analytical inversion.

Signal-to-noise criterion for free-propagation imaging techniques at free-electron lasers and synchrotrons.

We propose a signal-to-noise criterion which predicts whether a feature of a given size and scattering strength, placed inside a larger object, can be retrieved with two common X-ray imaging techniques: coherent diffraction imaging and projection microscopy. This criterion, based on how efficiently these techniques detect the scattered photons and validated through simulations, shows in general that projection microscopy can resolve smaller phase differences and features than coherent diffraction imaging. Our criterion can be used to design optimized imaging experiments and perform feasibility studies for sensitive biological materials in free-electron lasers, where the number of photons per pulse is limited, or in synchrotron experiments, for both techniques.

2D-Omnidirectional Hard-X-Ray Scattering Sensitivity in a Single Shot.

X-ray scattering imaging can provide complementary information to conventional absorption based radiographic imaging about the unresolved microstructures of a sample. The scattering signal can be accessed with various methods based on coherent illumination, which span from self-imaging to speckle scanning. The directional sensitivity of the existing real space imaging methods is limited to a few directions on the imaging plane and requires scanning of the optical components, or the rotation of either the sample or the imaging setup, in order to cover the full range of possible scattering directions. In this Letter the authors propose a new method that allows the simultaneous acquisition of scattering images in all possible directions in a single shot. This is achieved by a specialized phase grating and a detector with sufficient spatial resolution to record the generated interference fringe. The structural length scale sensitivity of the system can be tuned by varying its geometry for a fixed grating design. Taking into account ongoing developments in the field of compact x-ray sources that allow high brightness and sufficient spatial coherence, the applicability of omnidirectional scattering imaging in industrial and medical settings is boosted significantly.

X-Ray Multibeam Ptychography at up to 20 keV: Nano-Lithography Enhances X-Ray Nano-Imaging.

Hard X-rays are needed for non-destructive nano-imaging of solid matter. Synchrotron radiation facilities (SRF) provide the highest-quality images with single-digit nm resolution using advanced techniques such as X-ray ptychography. However, the resolution or field of view is ultimately constrained by the available coherent flux. To address this, the beam's incoherent fraction can be exploited using multiple parallel beams in an X-ray multibeam ptychography (MBP) approach. This expands the domain of X-ray ptychography to larger samples or more rapid measurements. Both qualities favor the study of complex composite or functional samples, such as catalysts, energy materials, or electronic devices. The challenge of performing ptychography at high energy and with many parallel beams must be overcome to extract the full advantages for extended samples while minimizing beam attenuation. Here, that challenge is overcome by creating a lens array using cutting-edge laser printing technology and applying it to perform scanning with MBP with up to 12 beams and at photon energies of 13 and 20 keV. This exceeds the measurement limits of conventional hard X-ray ptychography without compromising image quality for various samples: Siemens star test pattern, Ni/Al2O3 catalyst, microchip, and gold nano-crystal clusters.

Dose-efficient scanning Compton X-ray microscopy.

The highest resolution of images of soft matter and biological materials is ultimately limited by modification of the structure, induced by the necessarily high energy of short-wavelength radiation. Imaging the inelastically scattered X-rays at a photon energy of 60 keV (0.02 nm wavelength) offers greater signal per energy transferred to the sample than coherent-scattering techniques such as phase-contrast microscopy and projection holography. We present images of dried, unstained, and unfixed biological objects obtained by scanning Compton X-ray microscopy, at a resolution of about 70 nm. This microscope was realised using novel wedged multilayer Laue lenses that were fabricated to sub-ångström precision, a new wavefront measurement scheme for hard X rays, and efficient pixel-array detectors. The doses required to form these images were as little as 0.02% of the tolerable dose and 0.05% of that needed for phase-contrast imaging at similar resolution using 17 keV photon energy. The images obtained provide a quantitative map of the projected mass density in the sample, as confirmed by imaging a silicon wedge. Based on these results, we find that it should be possible to obtain radiation damage-free images of biological samples at a resolution below 10 nm.

Revealing the origins of vortex cavitation in a Venturi tube by high speed X-ray imaging.

Hydrodynamic cavitation is useful in many processing applications, for example, in chemical reactors, water treatment and biochemical engineering. An important type of hydrodynamic cavitation that occurs in a Venturi tube is vortex cavitation known to cause luminescence whose intensity is closely related to the size and number of cavitation events. However, the mechanistic origins of bubbles constituting vortex cavitation remains unclear, although it has been concluded that the pressure fields generated by the cavitation collapse strongly depends on the bubble geometry. The common view is that vortex cavitation consists of numerous small spherical bubbles. In the present paper, aspects of vortex cavitation arising in a Venturi tube were visualized using high-speed X-ray imaging at SPring-8 and European XFEL. It was discovered that vortex cavitation in a Venturi tube consisted of angulated rather than spherical bubbles. The tangential velocity of the surface of vortex cavitation was assessed considering the Rankine vortex model.

Low-dose in situ prelocation of protein microcrystals by 2D X-ray phase-contrast imaging for serial crystallography.

Serial protein crystallography has emerged as a powerful method of data collection on small crystals from challenging targets, such as membrane proteins. Multiple microcrystals need to be located on large and often flat mounts while exposing them to an X-ray dose that is as low as possible. A crystal-prelocation method is demonstrated here using low-dose 2D full-field propagation-based X-ray phase-contrast imaging at the X-ray imaging beamline TOMCAT at the Swiss Light Source (SLS). This imaging step provides microcrystal coordinates for automated serial data collection at a microfocus macromolecular crystallography beamline on samples with an essentially flat geometry. This prelocation method was applied to microcrystals of a soluble protein and a membrane protein, grown in a commonly used double-sandwich in situ crystallization plate. The inner sandwiches of thin plastic film enclosing the microcrystals in lipid cubic phase were flash cooled and imaged at TOMCAT. Based on the obtained crystal coordinates, both still and rotation wedge serial data were collected automatically at the SLS PXI beamline, yielding in both cases a high indexing rate. This workflow can be easily implemented at many synchrotron facilities using existing equipment, or potentially integrated as an online technique in the next-generation macromolecular crystallography beamline, and thus benefit a number of dose-sensitive challenging protein targets.

Ultracompact 3D microfluidics for time-resolved structural biology.

To advance microfluidic integration, we present the use of two-photon additive manufacturing to fold 2D channel layouts into compact free-form 3D fluidic circuits with nanometer precision. We demonstrate this technique by tailoring microfluidic nozzles and mixers for time-resolved structural biology at X-ray free-electron lasers (XFELs). We achieve submicron jets with speeds exceeding 160 m s-1, which allows for the use of megahertz XFEL repetition rates. By integrating an additional orifice, we implement a low consumption flow-focusing nozzle, which is validated by solving a hemoglobin structure. Also, aberration-free in operando X-ray microtomography is introduced to study efficient equivolumetric millisecond mixing in channels with 3D features integrated into the nozzle. Such devices can be printed in minutes by locally adjusting print resolution during fabrication. This technology has the potential to permit ultracompact devices and performance improvements through 3D flow optimization in all fields of microfluidic engineering.