The slip-and-slide algorithm: a refinement protocol for detector geometry.

Geometry correction is traditionally plagued by mis-fitting of correlated parameters, leading to local minima which prevent further improvements. Segmented detectors pose an enhanced risk of mis-fitting: even a minor confusion of detector distance and panel separation can prevent improvement in data quality. The slip-and-slide algorithm breaks down effects of the correlated parameters and their associated target functions in a fundamental shift in the approach to the problem. Parameters are never refined against the components of the data to which they are insensitive, providing a dramatic boost in the exploitation of information from a very small number of diffraction patterns. This algorithm can be applied to exploit the adherence of the spot-finding results prior to indexing to a given lattice using unit-cell dimensions as a restraint. Alternatively, it can be applied to the predicted spot locations and the observed reflection positions after indexing from a smaller number of images. Thus, the indexing rate can be boosted by 5.8% using geometry refinement from only 125 indexed patterns or 500 unindexed patterns. In one example of cypovirus type 17 polyhedrin diffraction at the Linac Coherent Light Source, this geometry refinement reveals a detector tilt of 0.3° (resulting in a maximal Z-axis error of ∼0.5 mm from an average detector distance of ∼90 mm) whilst treating all panels independently. Re-indexing and integrating with updated detector geometry reduces systematic errors providing a boost in anomalous signal of sulfur atoms by 20%. Due to the refinement of decoupled parameters, this geometry method also reaches convergence.

Imperfection and radiation damage in protein crystals studied with coherent radiation.

Fringes and speckles occur within diffraction spots when a crystal is illuminated with coherent radiation during X-ray diffraction. The additional information in these features provides insight into the imperfections in the crystal at the sub-micrometre scale. In addition, these features can provide more accurate intensity measurements (e.g. by model-based profile fitting), detwinning (by distinguishing the various components), phasing (by exploiting sampling of the molecular transform) and refinement (by distinguishing regions with different unit-cell parameters). In order to exploit these potential benefits, the features due to coherent diffraction have to be recorded and any change due to radiation damage properly modelled. Initial results from recording coherent diffraction at cryotemperatures from polyhedrin crystals of approximately 2 µm in size are described. These measurements allowed information about the type of crystal imperfections to be obtained at the sub-micrometre level, together with the changes due to radiation damage.

A revised partiality model and post-refinement algorithm for X-ray free-electron laser data.

Research towards using X-ray free-electron laser (XFEL) data to solve structures using experimental phasing methods such as sulfur single-wavelength anomalous dispersion (SAD) has been hampered by shortcomings in the diffraction models for X-ray diffraction from FELs. Owing to errors in the orientation matrix and overly simple partiality models, researchers have required large numbers of images to converge to reliable estimates for the structure-factor amplitudes, which may not be feasible for all biological systems. Here, data for cytoplasmic polyhedrosis virus type 17 (CPV17) collected at 1.3 Å wavelength at the Linac Coherent Light Source (LCLS) are revisited. A previously published definition of a partiality model for reflections illuminated by self-amplified spontaneous emission (SASE) pulses is built upon, which defines a fraction between 0 and 1 based on the intersection of a reflection with a spread of Ewald spheres modelled by a super-Gaussian wavelength distribution in the X-ray beam. A method of post-refinement to refine the parameters of this model is suggested. This has generated a merged data set with an overall discrepancy (by calculating the R(split) value) of 3.15% to 1.46 Å resolution from a 7225-image data set. The atomic numbers of C, N and O atoms in the structure are distinguishable in the electron-density map. There are 13 S atoms within the 237 residues of CPV17, excluding the initial disordered methionine. These only possess 0.42 anomalous scattering electrons each at 1.3 Å wavelength, but the 12 that have single predominant positions are easily detectable in the anomalous difference Fourier map. It is hoped that these improvements will lead towards XFEL experimental phase determination and structure determination by sulfur SAD and will generally increase the utility of the method for difficult cases.

Recovery of data from perfectly twinned virus crystals revisited.

Perfect merohedral twinning of crystals is not uncommon and complicates structural analysis. An iterative method for the deconvolution of data from perfectly merohedrally twinned crystals in the presence of noncrystallographic symmetry (NCS) has been reimplemented. It is shown that the method recovers the data effectively using test data, and an independent metric of success, based on special classes of reflections that are unaffected by the twin operator, is now provided. The method was applied to a real problem with fivefold NCS and rather poor-quality diffraction data, and it was found that even in these circumstances the method appears to recover most of the information. The software has been made available in a form that can be applied to other crystal systems.

On the release of cppxfel for processing X-ray free-electron laser images.

As serial femtosecond crystallography expands towards a variety of delivery methods, including chip-based methods, and smaller collected data sets, the requirement to optimize the data analysis to produce maximum structure quality is becoming increasingly pressing. Here cppxfel, a software package primarily written in C++, which showcases several data analysis techniques, is released. This software package presently indexes images using DIALS (diffraction integration for advanced light sources) and performs an initial orientation matrix refinement, followed by post-refinement of individual images against a reference data set. Cppxfel is released with the hope that the unique and useful elements of this package can be repurposed for existing software packages. However, as released, it produces high-quality crystal structures and is therefore likely to be also useful to experienced users of X-ray free-electron laser (XFEL) software who wish to maximize the information extracted from a limited number of XFEL images.

TakeTwo: an indexing algorithm suited to still images with known crystal parameters.

The indexing methods currently used for serial femtosecond crystallography were originally developed for experiments in which crystals are rotated in the X-ray beam, providing significant three-dimensional information. On the other hand, shots from both X-ray free-electron lasers and serial synchrotron crystallography experiments are still images, in which the few three-dimensional data available arise only from the curvature of the Ewald sphere. Traditional synchrotron crystallography methods are thus less well suited to still image data processing. Here, a new indexing method is presented with the aim of maximizing information use from a still image given the known unit-cell dimensions and space group. Efficacy for cubic, hexagonal and orthorhombic space groups is shown, and for those showing some evidence of diffraction the indexing rate ranged from 90% (hexagonal space group) to 151% (cubic space group). Here, the indexing rate refers to the number of lattices indexed per image.

SynchLink: an iOS app for ISPyB.

The macromolecular crystallography (MX) user experience at synchrotron radiation facilities continues to evolve, with the impact of developments in X-ray detectors, computer hardware and automation methods making it possible for complete data sets to be collected on timescales of tens of seconds. Data can be reduced in a couple of minutes and in favourable cases structures solved and refined shortly after. The information-rich database ISPyB, automatically populated by data acquisition software, data processing and structure solution pipelines at the Diamond Light Source beamlines, allows users to automatically track MX experiments in real time. In order to improve the synchrotron users' experience, efficient access to the data contained in ISPyB is now provided via an iOS 6.0+ app for iPhones and iPads. This provides users, both local and remote, with a succinct summary of data collection, visualization of diffraction images and crystals, and key metrics for data quality in real time.