New methods for indexing multi-lattice diffraction data.

A new indexing method is presented which is capable of indexing multiple crystal lattices from narrow wedges of diffraction data. The method takes advantage of a simplification of Fourier transform-based methods that is applicable when the unit-cell dimensions are known a priori. The efficacy of this method is demonstrated with both semi-synthetic multi-lattice data and real multi-lattice data recorded from crystals of ∼1 µm in size, where it is shown that up to six lattices can be successfully indexed and subsequently integrated from a 1° wedge of data. Analysis is presented which shows that improvements in data-quality indicators can be obtained through accurate identification and rejection of overlapping reflections prior to scaling.

Computational models of amorphous ice for accurate simulation of cryo-EM images of biological samples.

Simulations of cryo-electron microscopy (cryo-EM) images of biological samples can be used to produce test datasets to support the development of instrumentation, methods, and software, as well as to assess data acquisition and analysis strategies. To be useful, these simulations need to be based on physically realistic models which include large volumes of amorphous ice. The gold standard model for EM image simulation is a physical atom-based ice model produced using molecular dynamics simulations. Although practical for small sample volumes; for simulation of cryo-EM data from large sample volumes, this can be too computationally expensive. We have evaluated a Gaussian Random Field (GRF) ice model which is shown to be more computationally efficient for large sample volumes. The simulated EM images are compared with the gold standard atom-based ice model approach and shown to be directly comparable. Comparison with experimentally acquired data shows the Gaussian random field ice model produces realistic simulations. The software required has been implemented in the Parakeet software package and the underlying atomic models are available online for use by the wider community.

Pillar data-acquisition strategies for cryo-electron tomography of beam-sensitive biological samples.

For cryo-electron tomography (cryo-ET) of beam-sensitive biological specimens, a planar sample geometry is typically used. As the sample is tilted, the effective thickness of the sample along the direction of the electron beam increases and the signal-to-noise ratio concomitantly decreases, limiting the transfer of information at high tilt angles. In addition, the tilt range where data can be collected is limited by a combination of various sample-environment constraints, including the limited space in the objective lens pole piece and the possible use of fixed conductive braids to cool the specimen. Consequently, most tilt series are limited to a maximum of ±70°, leading to the presence of a missing wedge in Fourier space. The acquisition of cryo-ET data without a missing wedge, for example using a cylindrical sample geometry, is hence attractive for volumetric analysis of low-symmetry structures such as organelles or vesicles, lysis events, pore formation or filaments for which the missing information cannot be compensated by averaging techniques. Irrespective of the geometry, electron-beam damage to the specimen is an issue and the first images acquired will transfer more high-resolution information than those acquired last. There is also an inherent trade-off between higher sampling in Fourier space and avoiding beam damage to the sample. Finally, the necessity of using a sufficient electron fluence to align the tilt images means that this fluence needs to be fractionated across a small number of images; therefore, the order of data acquisition is also a factor to consider. Here, an n-helix tilt scheme is described and simulated which uses overlapping and interleaved tilt series to maximize the use of a pillar geometry, allowing the entire pillar volume to be reconstructed as a single unit. Three related tilt schemes are also evaluated that extend the continuous and classic dose-symmetric tilt schemes for cryo-ET to pillar samples to enable the collection of isotropic information across all spatial frequencies. A fourfold dose-symmetric scheme is proposed which provides a practical compromise between uniform information transfer and complexity of data acquisition.

Investigation of the milling characteristics of different focused-ion-beam sources assessed by three-dimensional electron diffraction from crystal lamellae.

Three-dimensional electron diffraction (3DED) from nanocrystals of biological macromolecules requires the use of very small crystals. These are typically less than 300 nm-thick in the direction of the electron beam due to the strong interaction between electrons and matter. In recent years, focused-ion-beam (FIB) milling has been used in the preparation of thin samples for 3DED. These instruments typically use a gallium liquid metal ion source. Inductively coupled plasma (ICP) sources in principle offer faster milling rates. Little work has been done to quantify the damage these sources cause to delicate biological samples at cryogenic temperatures. Here, an analysis of the effect that milling with plasma FIB (pFIB) instrumentation has on lysozyme crystals is presented. This work evaluates both argon and xenon plasmas and compares them with crystals milled with a gallium source. A milling protocol was employed that utilizes an overtilt to produce wedge-shaped lamellae with a shallow thickness gradient which yielded very thin crystalline samples. 3DED data were then acquired and standard data-processing statistics were employed to assess the quality of the diffraction data. An upper bound to the depth of the pFIB-milling damage layer of between 42.5 and 50 nm is reported, corresponding to half the thickness of the thinnest lamellae that resulted in usable diffraction data. A lower bound of between 32.5 and 40 nm is also reported, based on a literature survey of the minimum amount of diffracting material required for 3DED.

Single Cell Cryo-Soft X-ray Tomography Shows That Each Chlamydia Trachomatis Inclusion Is a Unique Community of Bacteria.

Chlamydiae are strict intracellular pathogens residing within a specialised membrane-bound compartment called the inclusion. Therefore, each infected cell can, be considered as a single entity where bacteria form a community within the inclusion. It remains unclear as to how the population of bacteria within the inclusion influences individual bacterium. The life cycle of Chlamydia involves transitioning between the invasive elementary bodies (EBs) and replicative reticulate bodies (RBs). We have used cryo-soft X-ray tomography to observe individual inclusions, an approach that combines 40 nm spatial resolution and large volume imaging (up to 16 µm). Using semi-automated segmentation pipeline, we considered each inclusion as an individual bacterial niche. Within each inclusion, we identifyed and classified different forms of the bacteria and confirmed the recent finding that RBs have a variety of volumes (small, large and abnormal). We demonstrate that the proportions of these different RB forms depend on the bacterial concentration in the inclusion. We conclude that each inclusion operates as an autonomous community that influences the characteristics of individual bacteria within the inclusion.

Parakeet: a digital twin software pipeline to assess the impact of experimental parameters on tomographic reconstructions for cryo-electron tomography.

In cryo-electron tomography (cryo-ET) of biological samples, the quality of tomographic reconstructions can vary depending on the transmission electron microscope (TEM) instrument and data acquisition parameters. In this paper, we present Parakeet, a 'digital twin' software pipeline for the assessment of the impact of various TEM experiment parameters on the quality of three-dimensional tomographic reconstructions. The Parakeet digital twin is a digital model that can be used to optimize the performance and utilization of a physical instrument to enable in silico optimization of sample geometries, data acquisition schemes and instrument parameters. The digital twin performs virtual sample generation, TEM image simulation, and tilt series reconstruction and analysis within a convenient software framework. As well as being able to produce physically realistic simulated cryo-ET datasets to aid the development of tomographic reconstruction and subtomogram averaging programs, Parakeet aims to enable convenient assessment of the effects of different microscope parameters and data acquisition parameters on reconstruction quality. To illustrate the use of the software, we present the example of a quantitative analysis of missing wedge artefacts on simulated planar and cylindrical biological samples and discuss how data collection parameters can be modified for cylindrical samples where a full 180° tilt range might be measured.

The predictive power of data-processing statistics.

This study describes a method to estimate the likelihood of success in determining a macromolecular structure by X-ray crystallography and experimental single-wavelength anomalous dispersion (SAD) or multiple-wavelength anomalous dispersion (MAD) phasing based on initial data-processing statistics and sample crystal properties. Such a predictive tool can rapidly assess the usefulness of data and guide the collection of an optimal data set. The increase in data rates from modern macromolecular crystallography beamlines, together with a demand from users for real-time feedback, has led to pressure on computational resources and a need for smarter data handling. Statistical and machine-learning methods have been applied to construct a classifier that displays 95% accuracy for training and testing data sets compiled from 440 solved structures. Applying this classifier to new data achieved 79% accuracy. These scores already provide clear guidance as to the effective use of computing resources and offer a starting point for a personalized data-collection assistant.

A Workflow for Protein Structure Determination From Thin Crystal Lamella by Micro-Electron Diffraction.

MicroED has recently emerged as a powerful method for the analysis of biological structures at atomic resolution. This technique has been largely limited to protein nanocrystals which grow either as needles or plates measuring only a few hundred nanometers in thickness. Furthermore, traditional microED data processing uses established X-ray crystallography software that is not optimized for handling compound effects that are unique to electron diffraction data. Here, we present an integrated workflow for microED, from sample preparation by cryo-focused ion beam milling, through data collection with a standard Ceta-D detector, to data processing using the DIALS software suite, thus enabling routine atomic structure determination of protein crystals of any size and shape using microED. We demonstrate the effectiveness of the workflow by determining the structure of proteinase K to 2.0 Å resolution and show the advantage of using protein crystal lamellae over nanocrystals.

Electron diffraction data processing with DIALS.

Electron diffraction is a relatively novel alternative to X-ray crystallography for the structure determination of macromolecules from three-dimensional nanometre-sized crystals. The continuous-rotation method of data collection has been adapted for the electron microscope. However, there are important differences in geometry that must be considered for successful data integration. The wavelength of electrons in a TEM is typically around 40 times shorter than that of X-rays, implying a nearly flat Ewald sphere, and consequently low diffraction angles and a high effective sample-to-detector distance. Nevertheless, the DIALS software package can, with specific adaptations, successfully process continuous-rotation electron diffraction data. Pathologies encountered specifically in electron diffraction make data integration more challenging. Errors can arise from instrumentation, such as beam drift or distorted diffraction patterns from lens imperfections. The diffraction geometry brings additional challenges such as strong correlation between lattice parameters and detector distance. These issues are compounded if calibration is incomplete, leading to uncertainty in experimental geometry, such as the effective detector distance and the rotation rate or direction. Dynamic scattering, absorption, radiation damage and incomplete wedges of data are additional factors that complicate data processing. Here, recent features of DIALS as adapted to electron diffraction processing are shown, including diagnostics for problematic diffraction geometry refinement, refinement of a smoothly varying beam model and corrections for distorted diffraction images. These novel features, combined with the existing tools in DIALS, make data integration and refinement feasible for electron crystallography, even in difficult cases.

Improving signal strength in serial crystallography with DIALS geometry refinement.

The DIALS diffraction-modeling software package has been applied to serial crystallography data. Diffraction modeling is an exercise in determining the experimental parameters, such as incident beam wavelength, crystal unit cell and orientation, and detector geometry, that are most consistent with the observed positions of Bragg spots. These parameters can be refined by nonlinear least-squares fitting. In previous work, it has been challenging to refine both the positions of the sensors (metrology) on multipanel imaging detectors such as the CSPAD and the orientations of all of the crystals studied. Since the optimal models for metrology and crystal orientation are interdependent, alternate cycles of panel refinement and crystal refinement have been required. To simplify the process, a sparse linear algebra technique for solving the normal equations was implemented, allowing the detector panels to be refined simultaneously against the diffraction from thousands of crystals with excellent computational performance. Separately, it is shown how to refine the metrology of a second CSPAD detector, positioned at a distance of 2.5 m from the crystal, used for recording low-angle reflections. With the ability to jointly refine the detector position against the ensemble of all crystals used for structure determination, it is shown that ensemble refinement greatly reduces the apparent nonisomorphism that is often observed in the unit-cell distributions from still-shot serial crystallography. In addition, it is shown that batching the images by timestamp and re-refining the detector position can realistically model small, time-dependent variations in detector position relative to the sample, and thereby improve the integrated structure-factor intensity signal and heavy-atom anomalous peak heights.

DIALS: implementation and evaluation of a new integration package.

The DIALS project is a collaboration between Diamond Light Source, Lawrence Berkeley National Laboratory and CCP4 to develop a new software suite for the analysis of crystallographic X-ray diffraction data, initially encompassing spot finding, indexing, refinement and integration. The design, core algorithms and structure of the software are introduced, alongside results from the analysis of data from biological and chemical crystallography experiments.

Background modelling of diffraction data in the presence of ice rings.

An algorithm for modelling the background for each Bragg reflection in a series of X-ray diffraction images containing Debye-Scherrer diffraction from ice in the sample is presented. The method involves the use of a global background model which is generated from the complete X-ray diffraction data set. Fitting of this model to the background pixels is then performed for each reflection independently. The algorithm uses a static background model that does not vary over the course of the scan. The greatest improvement can be expected for data where ice rings are present throughout the data set and the local background shape at the size of a spot on the detector does not exhibit large time-dependent variation. However, the algorithm has been applied to data sets whose background showed large pixel variations (variance/mean > 2) and has been shown to improve the results of processing for these data sets. It is shown that the use of a simple flat-background model as in traditional integration programs causes systematic bias in the background determination at ice-ring resolutions, resulting in an overestimation of reflection intensities at the peaks of the ice rings and an underestimation of reflection intensities either side of the ice ring. The new global background-model algorithm presented here corrects for this bias, resulting in a noticeable improvement in R factors following refinement.

Diffraction-geometry refinement in the DIALS framework.

Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.

Robust background modelling in DIALS.

A method for estimating the background under each reflection during integration that is robust in the presence of pixel outliers is presented. The method uses a generalized linear model approach that is more appropriate for use with Poisson distributed data than traditional approaches to pixel outlier handling in integration programs. The algorithm is most applicable to data with a very low background level where assumptions of a normal distribution are no longer valid as an approximation to the Poisson distribution. It is shown that traditional methods can result in the systematic underestimation of background values. This then results in the reflection intensities being overestimated and gives rise to a change in the overall distribution of reflection intensities in a dataset such that too few weak reflections appear to be recorded. Statistical tests performed during data reduction may mistakenly attribute this to merohedral twinning in the crystal. Application of the robust generalized linear model algorithm is shown to correct for this bias.

dxtbx: the diffraction experiment toolbox.

Data formats for recording X-ray diffraction data continue to evolve rapidly to accommodate new detector technologies developed in response to more intense light sources. Processing the data from single-crystal X-ray diffraction experiments therefore requires the ability to read, and correctly interpret, image data and metadata from a variety of instruments employing different experimental representations. Tools that have previously been developed to address this problem have been limited either by a lack of extensibility or by inconsistent treatment of image metadata. The dxtbx software package provides a consistent interface to both image data and experimental models, while supporting a completely generic user-extensible approach to reading the data files. The library is written in a mixture of C++ and Python and is distributed as part of the cctbx under an open-source licence at http://cctbx.sourceforge.net.

Self-management of patient body position, pose, and motion using wide-field, real-time optical measurement feedback: results of a volunteer study.

PURPOSE: We present the results of a clinical feasibility study, performed in 10 healthy volunteers undergoing a simulated treatment over 3 sessions, to investigate the use of a wide-field visual feedback technique intended to help patients control their pose while reducing motion during radiation therapy treatment. METHODS AND MATERIALS: An optical surface sensor is used to capture wide-area measurements of a subject's body surface with visualizations of these data displayed back to them in real time. In this study we hypothesize that this active feedback mechanism will enable patients to control their motion and help them maintain their setup pose and position. A capability hierarchy of 3 different level-of-detail abstractions of the measured surface data is systematically compared. RESULTS: Use of the device enabled volunteers to increase their conformance to a reference surface, as measured by decreased variability across their body surfaces. The use of visual feedback also enabled volunteers to reduce their respiratory motion amplitude to 1.7 ± 0.6 mm compared with 2.7 ± 1.4 mm without visual feedback. CONCLUSIONS: The use of live feedback of their optically measured body surfaces enabled a set of volunteers to better manage their pose and motion when compared with free breathing. The method is suitable to be taken forward to patient studies.

Next generation optical surface sensing for real-time measurement in radiotherapy.

With the introduction of intensive new treatments such as hypo-fractionation and proton beam therapy, localization of the tumor target volume and tracking of points across the skin entrance surface have become critically important. Optical metrology has been used to monitor the patient's bulk position and motion throughout treatment. However systems have not been capable of high temporal and spatial resolution whole-surface topology measurement. We describe the implementation of such a system based on Fourier profilometry. Its algorithm is split into four separate processing stages, including spatial phase determination: descriptions of each stage are given along with the modifications made to increase performance. The optimized system is capable of processing 23 frames per second (fps), with each frame providing 512 × 512 measured points. The data density, accuracy and performance of the system are an order of magnitude improvement on commercially available clinical systems. We show that this performance permits genuinely real-time measurement of a patient, live during both setup and radiation treatment delivery. It is also fast enough to provide smooth dynamic visualizations of motion at all points on the wrap-around body surface for radiotherapy staff and intuitive, direct feed-back to patients.