Correction and integration of solid-angle data from the azimuthally resolving 2D detector at ID06-LVP, ESRF.

The unique diffraction geometry of ESRF beamline ID06-LVP offers continuous static 2D or azimuthally resolving data collections over all accessible solid angles available to the tooling geometry. The system is built around a rotating custom-built Pilatus3 CdTe 900k-W detector from Dectris, in a configuration equivalent to three butted 300k devices. As a non-standard geometry, here the method of alignment, correction and subsequent integration for any data collected over all solid angles accessible, or over any azimuthal range contained therein, are provided and illustrated by parameterizing and extending existing pyFAI routines. At 1° integrated intervals, and typical distances (2.0 m), the system covers an area of near 2.5 m2 (100 Mpx square equivalent), to 0.65 Šresolution, at 53 keV from a total dataset of some 312 Mpx. Standard FWHMs of SRM660a LaB6 vary from 0.005° to 0.01°, depending on beam size, energy and sample dimensions, and are sampled at an elevated rate. The azimuthal range per static frame ranges from <20° to ∼1° over the full range of the detector surface. A full 2θ-intensity data collection at static azimuth takes 1-3 s typically, and can be reduced to ms-1 rates for measurements requiring time-rate determination. A full solid-angle collection can be completed in a minute. Sample detector distances are accessible from 1.6 m to 4.0 m.

ID22 - the high-resolution powder-diffraction beamline at ESRF.

Following Phase 2 of the upgrade of the ESRF in which the storage ring was replaced by a new low-emittance ring along with many other facility upgrades, the status of ID22, the high-resolution powder-diffraction beamline, is described. The beamline has an in-vacuum undulator as source providing X-rays in the range 6-75 keV. ID22's principle characteristics include very high angular resolution as a result of the highly collimated and monochromatic beam, coupled with a 13-channel Si 111 multi-analyser stage between the sample and a Dectris Eiger2 X 2M-W CdTe pixel detector. The detector's axial resolution allows recorded 2θ values to be automatically corrected for the effects of axial divergence, resulting in narrower and more-symmetric peaks compared with the previous fixed-axial-slit arrangement. The axial acceptance can also be increased with increasing diffraction angle, thus simultaneously improving the statistical quality of high-angle data. A complementary Perkin Elmer XRD1611 medical-imaging detector is available for faster, lower-resolution data, often used at photon energies of 60-70 keV for pair-distribution function analysis, although this is also possible in high-resolution mode by scanning up to 120°â€…2θ at 35 keV. There are various sample environments, allowing sample temperatures from 4 K to 1600°C, a capillary cell for non-corrosive gas atmospheres in the range 0-100 bar, and a sample-changing robot that can accommodate 75 capillary samples compatible with the temperature range 80 K to 950°C.

BioSAXS at European Synchrotron Radiation Facility - Extremely Brilliant Source: BM29 with an upgraded source, detector, robot, sample environment, data collection and analysis software.

As part of its Extremely Brilliant Source (EBS) upgrade project, the ESRF's BM29 BioSAXS beamline was subject to a significant upgrade and refurbishment. In addition to the replacement of the beamline's original bending magnet source by a two-pole wiggler, leading to an increase in brilliance by a factor of 60, the sample environment of the beamline was almost completely refurbished: a vacuum-compatible Pilatus3 X 2M with a sensitive area of 253.7 mm × 288 mm and frame rates up to 250 Hz was installed, increasing the active area available and thus the q-scaling of scattering images taken; the sample changer was replaced with an upgraded version, allowing more space for customizable sample environments and the installation of two new sample exposure units; the software associated with the beamline was also renewed. In addition, the layout and functionality of the BSXCuBE3 (BioSAXS Customized Beamline Environment) data acquisition software was redesigned, providing an intuitive `user first' approach for inexperienced users, while at the same time maintaining more powerful options for experienced users and beamline staff. Additional features of BSXCuBE3 are queuing of samples; either consecutive sample changer and/or SEC-SAXS (size-exclusion chromatography small-angle X-ray scattering) experiments, including column equilibration were also implemented. Automatic data processing and analysis are now managed via Dahu, an online server with upstream data reduction, data scaling and azimuthal integration built around PyFAI (Python Fast Azimuthal Integration), and data analysis performed using the open source FreeSAS. The results of this automated data analysis pipeline are displayed in ISPyB/ExiSAXS. The upgraded BM29 has been in operation since the post-EBS restart in September 2020, and here a full description of its new hardware and software characteristics together with examples of data obtained are provided.

New data analysis for BioSAXS at the ESRF.

The second phase of the ESRF upgrade program did not only provide a new storage ring (Extremely Brilliant Source, EBS) but also allowed several beamlines to be refurbished. The BioSAXS beamline (located on port BM29) was upgraded with a new wiggler source and a larger detector. All analysis software has been rewritten to cope with the increased data flux and continues to provide beamline users with reduced and pre-processed data in real time. This article describes FreeSAS, an open-source collection of various small-angle scattering analysis algorithms needed to reduce and analyze BioSAXS data, and Dahu, the tool used to interface data analysis with beamline control. It further presents the data-processing pipelines for the different data acquisitions modes of the beamline, using either a sample changer for individual homogeneous samples or an inline size-exclusion chromatography setup.

Performance of the time-resolved ultra-small-angle X-ray scattering beamline with the Extremely Brilliant Source.

The new technical features and enhanced performance of the ID02 beamline with the Extremely Brilliant Source (EBS) at the ESRF are described. The beamline enables static and kinetic investigations of a broad range of systems from ångström to micrometre size scales and down to the sub-millisecond time range by combining different small-angle X-ray scattering techniques in a single instrument. In addition, a nearly coherent beam obtained in the high-resolution mode allows multispeckle X-ray photon correlation spectroscopy measurements down to the microsecond range over the ultra-small- and small-angle regions. While the scattering vector (of magnitude q) range covered is the same as before, 0.001 ≤ q ≤ 50 nm-1 for an X-ray wavelength of 1 Å, the EBS permits relaxation of the collimation conditions, thereby obtaining a higher flux throughput and lower background. In particular, a coherent photon flux in excess of 1012 photons s-1 can be routinely obtained, allowing dynamic studies of relatively dilute samples. The enhanced beam properties are complemented by advanced pixel-array detectors and high-throughput data reduction pipelines. All these developments together open new opportunities for structural, dynamic and kinetic investigations of out-of-equilibrium soft matter and biophysical systems.

RDMA data transfer and GPU acceleration methods for high-throughput online processing of serial crystallography images.

The continual evolution of photon sources and high-performance detectors drives cutting-edge experiments that can produce very high throughput data streams and generate large data volumes that are challenging to manage and store. In these cases, efficient data transfer and processing architectures that allow online image correction, data reduction or compression become fundamental. This work investigates different technical options and methods for data placement from the detector head to the processing computing infrastructure, taking into account the particularities of modern modular high-performance detectors. In order to compare realistic figures, the future ESRF beamline dedicated to macromolecular X-ray crystallography, EBSL8, is taken as an example, which will use a PSI JUNGFRAU 4M detector generating up to 16 GB of data per second, operating continuously during several minutes. Although such an experiment seems possible at the target speed with the 100 Gb s-1 network cards that are currently available, the simulations generated highlight some potential bottlenecks when using a traditional software stack. An evaluation of solutions is presented that implements remote direct memory access (RDMA) over converged ethernet techniques. A synchronization mechanism is proposed between a RDMA network interface card (RNIC) and a graphics processing unit (GPU) accelerator in charge of the online data processing. The placement of the detector images onto the GPU is made to overlap with the computation carried out, potentially hiding the transfer latencies. As a proof of concept, a detector simulator and a backend GPU receiver with a rejection and compression algorithm suitable for a synchrotron serial crystallography (SSX) experiment are developed. It is concluded that the available transfer throughput from the RNIC to the GPU accelerator is at present the major bottleneck in online processing for SSX experiments.

ID15A at the ESRF - a beamline for high speed operando X-ray diffraction, diffraction tomography and total scattering.

ID15A is a newly refurbished beamline at the ESRF devoted to operando and time-resolved diffraction and imaging, total scattering and diffraction computed tomography. The beamline is optimized for rapid alternation between the different techniques during a single operando experiment in order to collect complementary data on working systems. The high available energy (up to 120 keV) means that even bulky and highly absorbing systems may be studied. The beamline is equipped with optimized focusing optics and a photon-counting CdTe pixel detector, allowing for both unprecedented data quality at high energy and for very rapid triggered experiments. A large choice of imaging detectors and ancillary probes and sample environments is also available.

The fast azimuthal integration Python library: pyFAI.

pyFAI is an open-source software package designed to perform azimuthal integration and, correspondingly, two-dimensional regrouping on area-detector frames for small- and wide-angle X-ray scattering experiments. It is written in Python (with binary submodules for improved performance), a language widely accepted and used by the scientific community today, which enables users to easily incorporate the pyFAI library into their processing pipeline. This article focuses on recent work, especially the ease of calibration, its accuracy and the execution speed for integration.

ISPyB for BioSAXS, the gateway to user autonomy in solution scattering experiments.

Logging experiments with the laboratory-information management system ISPyB (Information System for Protein crystallography Beamlines) enhances the automation of small-angle X-ray scattering of biological macromolecules in solution (BioSAXS) experiments. The ISPyB interface provides immediate user-oriented online feedback and enables data cross-checking and downstream analysis. To optimize data quality and completeness, ISPyBB (ISPyB for BioSAXS) makes it simple for users to compare the results from new measurements with previous acquisitions from the same day or earlier experiments in order to maximize the ability to collect all data required in a single synchrotron visit. The graphical user interface (GUI) of ISPyBB has been designed to guide users in the preparation of an experiment. The input of sample information and the ability to outline the experimental aims in advance provides feedback on the number of measurements required, calculation of expected sample volumes and time needed to collect the data: all of this information aids the users to better prepare for their trip to the synchrotron. A prototype version of the ISPyBB database is now available at the European Synchrotron Radiation Facility (ESRF) beamline BM29 and is already greatly appreciated by academic users and industrial clients. It will soon be available at the PETRA III beamline P12 and the Diamond Light Source beamlines I22 and B21.

Image stack alignment in full-field X-ray absorption spectroscopy using SIFT_PyOCL.

Full-field X-ray absorption spectroscopy experiments allow the acquisition of millions of spectra within minutes. However, the construction of the hyperspectral image requires an image alignment procedure with sub-pixel precision. While the image correlation algorithm has originally been used for image re-alignment using translations, the Scale Invariant Feature Transform (SIFT) algorithm (which is by design robust versus rotation, illumination change, translation and scaling) presents an additional advantage: the alignment can be limited to a region of interest of any arbitrary shape. In this context, a Python module, named SIFT_PyOCL, has been developed. It implements a parallel version of the SIFT algorithm in OpenCL, providing high-speed image registration and alignment both on processors and graphics cards. The performance of the algorithm allows online processing of large datasets.

Upgraded ESRF BM29 beamline for SAXS on macromolecules in solution.

Small-angle X-ray scattering (SAXS) measurements of proteins in solution are becoming increasingly popular with biochemists and structural biologists owing to the presence of dedicated high-throughput beamlines at synchrotron sources. As part of the ESRF Upgrade program a dedicated instrument for performing SAXS from biological macromolecules in solution (BioSAXS) has been installed at the renovated BM29 location. The optics hutch has been equipped with new optical components of which the two principal elements are a fixed-exit double multilayer monochromator and a 1.1 m-long toroidal mirror. These new dedicated optics give improved beam characteristics (compared with the previous set-up on ID14-3) regarding the energy tunability, flux and focusing at the detector plane leading to reduced parasitic scattering and an extended s-range. User experiments on the beamline have been successfully carried out since June 2012. A description of the new BioSAXS beamline and the set-up characteristics are presented together with examples of obtained data.