Ray-tracing analytical absorption correction for X-ray crystallography based on tomographic reconstructions.

Processing of single-crystal X-ray diffraction data from area detectors can be separated into two steps. First, raw intensities are obtained by integration of the diffraction images, and then data correction and reduction are performed to determine structure-factor amplitudes and their uncertainties. The second step considers the diffraction geometry, sample illumination, decay, absorption and other effects. While absorption is only a minor effect in standard macromolecular crystallography (MX), it can become the largest source of uncertainty for experiments performed at long wavelengths. Current software packages for MX typically employ empirical models to correct for the effects of absorption, with the corrections determined through the procedure of minimizing the differences in intensities between symmetry-equivalent reflections; these models are well suited to capturing smoothly varying experimental effects. However, for very long wavelengths, empirical methods become an unreliable approach to model strong absorption effects with high fidelity. This problem is particularly acute when data multiplicity is low. This paper presents an analytical absorption correction strategy (implemented in new software AnACor) based on a volumetric model of the sample derived from X-ray tomography. Individual path lengths through the different sample materials for all reflections are determined by a ray-tracing method. Several approaches for absorption corrections (spherical harmonics correction, analytical absorption correction and a combination of the two) are compared for two samples, the membrane protein OmpK36 GD, measured at a wavelength of λ = 3.54 Å, and chlorite dismutase, measured at λ = 4.13 Å. Data set statistics, the peak heights in the anomalous difference Fourier maps and the success of experimental phasing are used to compare the results from the different absorption correction approaches. The strategies using the new analytical absorption correction are shown to be superior to the standard spherical harmonics corrections. While the improvements are modest in the 3.54 Šdata, the analytical absorption correction outperforms spherical harmonics in the longer-wavelength data (λ = 4.13 Å), which is also reflected in the reduced amount of data being required for successful experimental phasing.

Experimental phasing opportunities for macromolecular crystallography at very long wavelengths.

Despite recent advances in cryo-electron microscopy and artificial intelligence-based model predictions, a significant fraction of structure determinations by macromolecular crystallography still requires experimental phasing, usually by means of single-wavelength anomalous diffraction (SAD) techniques. Most synchrotron beamlines provide highly brilliant beams of X-rays of between 0.7 and 2 Å wavelength. Use of longer wavelengths to access the absorption edges of biologically important lighter atoms such as calcium, potassium, chlorine, sulfur and phosphorus for native-SAD phasing is attractive but technically highly challenging. The long-wavelength beamline I23 at Diamond Light Source overcomes these limitations and extends the accessible wavelength range to λ = 5.9 Å. Here we report 22 macromolecular structures solved in this extended wavelength range, using anomalous scattering from a range of elements which demonstrate the routine feasibility of lighter atom phasing. We suggest that, in light of its advantages, long-wavelength crystallography is a compelling option for experimental phasing.

A standard data format for 3DED/MicroED.

Electron diffraction from three dimensional crystals, as a technique for solving molecular structures, is rapidly increasing in popularity. The development of methodology and software has borrowed, to great effect, from macromolecular X-ray crystallography. However, standardization lags behind the development of the technique, and practitioners are forced to work with inadequate data formats that are unable to capture a full description of their experiments. This creates obstacles that are increasingly difficult to overcome as experiments become ever faster and the need for data autoprocessing becomes more pressing. We present a data format standard based on best practice from macromolecular crystallography and demonstrate how the adoption of this standard enabled autoprocessing of datasets collected with a high-throughput detector system.

xia2.multiplex: a multi-crystal data-analysis pipeline.

In macromolecular crystallography, radiation damage limits the amount of data that can be collected from a single crystal. It is often necessary to merge data sets from multiple crystals; for example, small-wedge data collections from micro-crystals, in situ room-temperature data collections and data collection from membrane proteins in lipidic mesophases. Whilst the indexing and integration of individual data sets may be relatively straightforward with existing software, merging multiple data sets from small wedges presents new challenges. The identification of a consensus symmetry can be problematic, particularly in the presence of a potential indexing ambiguity. Furthermore, the presence of non-isomorphous or poor-quality data sets may reduce the overall quality of the final merged data set. To facilitate and help to optimize the scaling and merging of multiple data sets, a new program, xia2.multiplex, has been developed which takes data sets individually integrated with DIALS and performs symmetry analysis, scaling and merging of multi-crystal data sets. xia2.multiplex also performs analysis of various pathologies that typically affect multi-crystal data sets, including non-isomorphism, radiation damage and preferential orientation. After the description of a number of use cases, the benefit of xia2.multiplex is demonstrated within a wider autoprocessing framework in facilitating a multi-crystal experiment collected as part of in situ room-temperature fragment-screening experiments on the SARS-CoV-2 main protease.

DIALS as a toolkit.

The DIALS software for the processing of X-ray diffraction data is presented, with an emphasis on how the suite may be used as a toolkit for data processing. The description starts with an overview of the history and intent of the toolkit, usage as an automated system, command-line use, and ultimately how new tools can be written using the API to perform bespoke analysis. Consideration is also made to the application of DIALS to techniques outside of macromolecular X-ray crystallography.

Gold Standard for macromolecular crystallography diffraction data.

Macromolecular crystallography (MX) is the dominant means of determining the three-dimensional structures of biological macromolecules. Over the last few decades, most MX data have been collected at synchrotron beamlines using a large number of different detectors produced by various manufacturers and taking advantage of various protocols and goniometries. These data came in their own formats: sometimes proprietary, sometimes open. The associated metadata rarely reached the degree of completeness required for data management according to Findability, Accessibility, Interoperability and Reusability (FAIR) principles. Efforts to reuse old data by other investigators or even by the original investigators some time later were often frustrated. In the culmination of an effort dating back more than two decades, a large portion of the research community concerned with high data-rate macromolecular crystallography (HDRMX) has now agreed to an updated specification of data and metadata for diffraction images produced at synchrotron light sources and X-ray free-electron lasers (XFELs). This 'Gold Standard' will facilitate the processing of data sets independent of the facility at which they were collected and enable data archiving according to FAIR principles, with a particular focus on interoperability and reusability. This agreed standard builds on the NeXus/HDF5 NXmx application definition and the International Union of Crystallo-graphy (IUCr) imgCIF/CBF dictionary, and it is compatible with major data-processing programs and pipelines. Just as with the IUCr CBF/imgCIF standard from which it arose and to which it is tied, the NeXus/HDF5 NXmx Gold Standard application definition is intended to be applicable to all detectors used for crystallography, and all hardware and software developers in the field are encouraged to adopt and contribute to the standard.

Scaling diffraction data in the DIALS software package: algorithms and new approaches for multi-crystal scaling.

In processing X-ray diffraction data, the intensities obtained from integration of the diffraction images must be corrected for experimental effects in order to place all intensities on a common scale both within and between data collections. Scaling corrects for effects such as changes in sample illumination, absorption and, to some extent, global radiation damage that cause the measured intensities of symmetry-equivalent observations to differ throughout a data set. This necessarily requires a prior evaluation of the point-group symmetry of the crystal. This paper describes and evaluates the scaling algorithms implemented within the DIALS data-processing package and demonstrates the effectiveness and key features of the implementation on example macromolecular crystallographic rotation data. In particular, the scaling algorithms enable new workflows for the scaling of multi-crystal or multi-sweep data sets, providing the analysis required to support current trends towards collecting data from ever-smaller samples. In addition, the implementation of a free-set validation method is discussed, which allows the quantification of the suitability of scaling-model and algorithm choices.

How best to use photons.

Strategies for collecting X-ray diffraction data have evolved alongside beamline hardware and detector developments. The traditional approaches for diffraction data collection have emphasised collecting data from noisy integrating detectors (i.e. film, image plates and CCD detectors). With fast pixel array detectors on stable beamlines, the limiting factor becomes the sample lifetime, and the question becomes one of how to expend the photons that your sample can diffract, i.e. as a smaller number of stronger measurements or a larger number of weaker data. This parameter space is explored via experiment and synthetic data treatment and advice is derived on how best to use the equipment on a modern beamline. Suggestions are also made on how to acquire data in a conservative manner if very little is known about the sample lifetime.

Structural Studies Reveal Enantiospecific Recognition of a DNA G-Quadruplex by a Ruthenium Polypyridyl Complex.

By using X-ray crystallography, we show that the complexes Λ/Δ-[Ru(TAP)2 (11-CN-dppz)]2+ (TAP=1,4,5,8-tetraazaphenanthrene, dppz=dipyridophenazine) bind DNA G-quadruplex in an enantiospecific manner that parallels the specificity of these complexes with duplex DNA. The Λ complex crystallises with the normally parallel stranded d(TAGGGTTA) tetraplex to give the first such antiparallel strand assembly in which syn-guanosine is adjacent to the complex at the 5' end of the quadruplex core. SRCD measurements confirm that the same conformational switch occurs in solution. The Δ enantiomer, by contrast, is present in the structure but stacked at the ends of the assembly. In addition, we report the structure of Λ-[Ru(phen)2 (11-CN-dppz)]2+ bound to d(TCGGCGCCGA), a duplex-forming sequence, and use both structural models to provide insight into the motif-specific luminescence response of the isostructural phen analogue enantiomers.

Improving signal strength in serial crystallography with DIALS geometry refinement.

The DIALS diffraction-modeling software package has been applied to serial crystallography data. Diffraction modeling is an exercise in determining the experimental parameters, such as incident beam wavelength, crystal unit cell and orientation, and detector geometry, that are most consistent with the observed positions of Bragg spots. These parameters can be refined by nonlinear least-squares fitting. In previous work, it has been challenging to refine both the positions of the sensors (metrology) on multipanel imaging detectors such as the CSPAD and the orientations of all of the crystals studied. Since the optimal models for metrology and crystal orientation are interdependent, alternate cycles of panel refinement and crystal refinement have been required. To simplify the process, a sparse linear algebra technique for solving the normal equations was implemented, allowing the detector panels to be refined simultaneously against the diffraction from thousands of crystals with excellent computational performance. Separately, it is shown how to refine the metrology of a second CSPAD detector, positioned at a distance of 2.5 m from the crystal, used for recording low-angle reflections. With the ability to jointly refine the detector position against the ensemble of all crystals used for structure determination, it is shown that ensemble refinement greatly reduces the apparent nonisomorphism that is often observed in the unit-cell distributions from still-shot serial crystallography. In addition, it is shown that batching the images by timestamp and re-refining the detector position can realistically model small, time-dependent variations in detector position relative to the sample, and thereby improve the integrated structure-factor intensity signal and heavy-atom anomalous peak heights.

Determination of Patterson group symmetry from sparse multi-crystal data sets in the presence of an indexing ambiguity.

Combining X-ray diffraction data from multiple samples requires determination of the symmetry and resolution of any indexing ambiguity. For the partial data sets typical of in situ room-temperature experiments, determination of the correct symmetry is often not straightforward. The potential for indexing ambiguity in polar space groups is also an issue, although methods to resolve this are available if the true symmetry is known. Here, a method is presented to simultaneously resolve the determination of the Patterson symmetry and the indexing ambiguity for partial data sets.

DIALS: implementation and evaluation of a new integration package.

The DIALS project is a collaboration between Diamond Light Source, Lawrence Berkeley National Laboratory and CCP4 to develop a new software suite for the analysis of crystallographic X-ray diffraction data, initially encompassing spot finding, indexing, refinement and integration. The design, core algorithms and structure of the software are introduced, alongside results from the analysis of data from biological and chemical crystallography experiments.

Background modelling of diffraction data in the presence of ice rings.

An algorithm for modelling the background for each Bragg reflection in a series of X-ray diffraction images containing Debye-Scherrer diffraction from ice in the sample is presented. The method involves the use of a global background model which is generated from the complete X-ray diffraction data set. Fitting of this model to the background pixels is then performed for each reflection independently. The algorithm uses a static background model that does not vary over the course of the scan. The greatest improvement can be expected for data where ice rings are present throughout the data set and the local background shape at the size of a spot on the detector does not exhibit large time-dependent variation. However, the algorithm has been applied to data sets whose background showed large pixel variations (variance/mean > 2) and has been shown to improve the results of processing for these data sets. It is shown that the use of a simple flat-background model as in traditional integration programs causes systematic bias in the background determination at ice-ring resolutions, resulting in an overestimation of reflection intensities at the peaks of the ice rings and an underestimation of reflection intensities either side of the ice ring. The new global background-model algorithm presented here corrects for this bias, resulting in a noticeable improvement in R factors following refinement.

A nucleotide-controlled conformational switch modulates the activity of eukaryotic IMP dehydrogenases.

Inosine-5'-monophosphate dehydrogenase (IMPDH) is an essential enzyme for nucleotide metabolism and cell proliferation. Despite IMPDH is the target of drugs with antiviral, immunosuppressive and antitumor activities, its physiological mechanisms of regulation remain largely unknown. Using the enzyme from the industrial fungus Ashbya gossypii, we demonstrate that the binding of adenine and guanine nucleotides to the canonical nucleotide binding sites of the regulatory Bateman domain induces different enzyme conformations with significantly distinct catalytic activities. Thereby, the comparison of their high-resolution structures defines the mechanistic and structural details of a nucleotide-controlled conformational switch that allosterically modulates the catalytic activity of eukaryotic IMPDHs. Remarkably, retinopathy-associated mutations lie within the mechanical hinges of the conformational change, highlighting its physiological relevance. Our results expand the mechanistic repertoire of Bateman domains and pave the road to new approaches targeting IMPDHs.

Guanine Can Direct Binding Specificity of Ru-dipyridophenazine (dppz) Complexes to DNA through Steric Effects.

X-ray crystal structures of three Λ-[Ru(L)2 dppz]2+ complexes (dppz=dipyridophenazine; L=1,10-phenanthroline (phen), 2,2'-bipyridine (bpy)) bound to d((5BrC)GGC/GCCG) showed the compounds intercalated at a 5'-CG-3' step. The compounds bind through canted intercalation, with the binding angle determined by the guanine NH2 group, in contrast to symmetrical intercalation previously observed at 5'-TA-3' sites. This result suggests that canted intercalation is preferred at 5'-CG-3' sites even though the site itself is symmetrical, and we hypothesise that symmetrical intercalation in a 5'-CG-3' step could give rise to a longer luminescence lifetime than canted intercalation.

Robust background modelling in DIALS.

A method for estimating the background under each reflection during integration that is robust in the presence of pixel outliers is presented. The method uses a generalized linear model approach that is more appropriate for use with Poisson distributed data than traditional approaches to pixel outlier handling in integration programs. The algorithm is most applicable to data with a very low background level where assumptions of a normal distribution are no longer valid as an approximation to the Poisson distribution. It is shown that traditional methods can result in the systematic underestimation of background values. This then results in the reflection intensities being overestimated and gives rise to a change in the overall distribution of reflection intensities in a dataset such that too few weak reflections appear to be recorded. Statistical tests performed during data reduction may mistakenly attribute this to merohedral twinning in the crystal. Application of the robust generalized linear model algorithm is shown to correct for this bias.

Delta chirality ruthenium 'light-switch' complexes can bind in the minor groove of DNA with five different binding modes.

[Ru(phen)2(dppz)]2+ has been studied since the 1990s due to its 'light-switch' properties. It can be used as a luminescent DNA probe, with emission switched on through DNA binding. The luminescence observed is dependent on the solvent accessibility of the pyrazine nitrogen atoms, and therefore is sensitive to changes in both binding site of the cation and chromophore orientation. The compound is also chiral, and there are distinct differences between the enantiomers in terms of the emission behaviour when bound to a variety of DNA sequences. Whilst a number of binary DNA-complex X-ray crystal structures are available, most include the Λ enantiomer and there is very little structural information about binding of the Δ enantiomer. Here, we present the first X-ray crystal structure of a Δ enantiomer bound to well-matched DNA, in the absence of the other, Λ enantiomer. We show how the binding site observed here can be related to a more general pattern of motifs in the crystallographic literature and propose that the Δ enantiomer can bind with five different binding modes, offering a new hypothesis for the interpretation of solution data.

Diffraction-geometry refinement in the DIALS framework.

Rapid data collection and modern computing resources provide the opportunity to revisit the task of optimizing the model of diffraction geometry prior to integration. A comprehensive description is given of new software that builds upon established methods by performing a single global refinement procedure, utilizing a smoothly varying model of the crystal lattice where appropriate. This global refinement technique extends to multiple data sets, providing useful constraints to handle the problem of correlated parameters, particularly for small wedges of data. Examples of advanced uses of the software are given and the design is explained in detail, with particular emphasis on the flexibility and extensibility it entails.

Monitoring one-electron photo-oxidation of guanine in DNA crystals using ultrafast infrared spectroscopy.

To understand the molecular origins of diseases caused by ultraviolet and visible light, and also to develop photodynamic therapy, it is important to resolve the mechanism of photoinduced DNA damage. Damage to DNA bound to a photosensitizer molecule frequently proceeds by one-electron photo-oxidation of guanine, but the precise dynamics of this process are sensitive to the location and the orientation of the photosensitizer, which are very difficult to define in solution. To overcome this, ultrafast time-resolved infrared (TRIR) spectroscopy was performed on photoexcited ruthenium polypyridyl-DNA crystals, the atomic structure of which was determined by X-ray crystallography. By combining the X-ray and TRIR data we are able to define both the geometry of the reaction site and the rates of individual steps in a reversible photoinduced electron-transfer process. This allows us to propose an individual guanine as the reaction site and, intriguingly, reveals that the dynamics in the crystal state are quite similar to those observed in the solvent medium.

Structure of CPV17 polyhedrin determined by the improved analysis of serial femtosecond crystallographic data.

The X-ray free-electron laser (XFEL) allows the analysis of small weakly diffracting protein crystals, but has required very many crystals to obtain good data. Here we use an XFEL to determine the room temperature atomic structure for the smallest cytoplasmic polyhedrosis virus polyhedra yet characterized, which we failed to solve at a synchrotron. These protein microcrystals, roughly a micron across, accrue within infected cells. We use a new physical model for XFEL diffraction, which better estimates the experimental signal, delivering a high-resolution XFEL structure (1.75 Å), using fewer crystals than previously required for this resolution. The crystal lattice and protein core are conserved compared with a polyhedrin with less than 10% sequence identity. We explain how the conserved biological phenotype, the crystal lattice, is maintained in the face of extreme environmental challenge and massive evolutionary divergence. Our improved methods should open up more challenging biological samples to XFEL analysis.