On bias, variance, overfitting, gold standard and consensus in single-particle analysis by cryo-electron microscopy.

Cryo-electron microscopy (cryoEM) has become a well established technique to elucidate the 3D structures of biological macromolecules. Projection images from thousands of macromolecules that are assumed to be structurally identical are combined into a single 3D map representing the Coulomb potential of the macromolecule under study. This article discusses possible caveats along the image-processing path and how to avoid them to obtain a reliable 3D structure. Some of these problems are very well known in the community. These may be referred to as sample-related (such as specimen denaturation at interfaces or non-uniform projection geometry leading to underrepresented projection directions). The rest are related to the algorithms used. While some have been discussed in depth in the literature, such as the use of an incorrect initial volume, others have received much less attention. However, they are fundamental in any data-analysis approach. Chiefly among them, instabilities in estimating many of the key parameters that are required for a correct 3D reconstruction that occur all along the processing workflow are referred to, which may significantly affect the reliability of the whole process. In the field, the term overfitting has been coined to refer to some particular kinds of artifacts. It is argued that overfitting is a statistical bias in key parameter-estimation steps in the 3D reconstruction process, including intrinsic algorithmic bias. It is also shown that common tools (Fourier shell correlation) and strategies (gold standard) that are normally used to detect or prevent overfitting do not fully protect against it. Alternatively, it is proposed that detecting the bias that leads to overfitting is much easier when addressed at the level of parameter estimation, rather than detecting it once the particle images have been combined into a 3D map. Comparing the results from multiple algorithms (or at least, independent executions of the same algorithm) can detect parameter bias. These multiple executions could then be averaged to give a lower variance estimate of the underlying parameters.

Cryo-EM and Single-Particle Analysis with Scipion.

Cryo-electron microscopy has become one of the most important tools in biological research to reveal the structural information of macromolecules at near-atomic resolution. In single-particle analysis, the vitrified sample is imaged by an electron beam and the detectors at the end of the microscope column produce movies of that sample. These movies contain thousands of images of identical particles in random orientations. The data need to go through an image processing workflow with multiple steps to obtain the final 3D reconstructed volume. The goal of the image processing workflow is to identify the acquisition parameters to be able to reconstruct the specimen under study. Scipion provides all the tools to create this workflow using several image processing packages in an integrative framework, also allowing the traceability of the results. In this article the whole image processing workflow in Scipion is presented and discussed with data coming from a real test case, giving all the details necessary to go from the movies obtained by the microscope to a high resolution final 3D reconstruction. Also, the power of using consensus tools that allow combining methods, and confirming results along every step of the workflow, improving the accuracy of the obtained results, is discussed.

Algorithmic robustness to preferred orientations in single particle analysis by CryoEM.

The presence of preferred orientations in single particle analysis (SPA) by cryo-Electron Microscopy (cryoEM) is currently one of the hurdles preventing many structural analyses from yielding high-resolution structures. Although the existence of preferred orientations is mostly related to the grid preparation, in this technical note, we show that some image processing algorithms used for angular assignment and three-dimensional (3D) reconstruction are more robust than others to these detrimental conditions. We exemplify this argument with three different data sets in which the presence of preferred orientations hindered achieving a 3D reconstruction without artifacts or, even worse, a 3D reconstruction could never be achieved.

Integration of Cryo-EM Model Building Software in Scipion.

Advances in cryo-electron microscopy (cryo-EM) have made it possible to obtain structures of large biological macromolecules at near-atomic resolution. This "resolution revolution" has encouraged the use and development of modeling tools able to produce high-quality atomic models from cryo-EM density maps. Unfortunately, many practical problems appear when combining different packages in the same processing workflow, which make difficult the use of these tools by non-experts and, therefore, reduce their utility. We present here a major extension of the image processing framework Scipion that provides inter-package integration in the model building area and full tracking of the complete workflow, from image processing to structure validation.

Re-examining the spectra of macromolecules. Current practice of spectral quasi B-factor flattening.

The analysis of structure factors in 3D cryo-EM Coulomb potential maps and their "enhancement" at the end of the reconstruction process is a well-established practice, normally referred to as sharpening. The aim is to increase contrast and, in this way, to help tracing the atomic model. The most common way to accomplish this enhancement is by means of the so-called B-factor correction, which applies a global filter to boost high frequencies with some dampening considerations related to noise amplification. The results are maps with a better visual aspect and a quasiflat spectrum at medium and high frequencies. This practice is so widespread that most map depositions in the Electron Microscopy Data Base (EMDB) only contain sharpened maps. Here, the use in cryoEM of global B-factor corrections is theoretically and experimentally analyzed. Results clearly illustrate that protein spectra present a falloff. Thus, spectral quasi-flattening may produce protein spectra with distortions when compared with experimental ones, this fact, combined with the practice of reporting only sharpened maps, generates a sub-optimal situation in terms of data preservation, reuse and reproducibility. Now that the field is more advanced, we put forward two suggestions: (1) to use methods which keep more faithfully the original experimental signal properties of macromolecules when "enhancing" the map, and (2) to further stress the need to deposit the original experimental maps without any postprocessing or sharpening, not only the enhanced maps. In the absence of access to these original maps data is lost, preventing their future analysis with new methods.

Flexible workflows for on-the-fly electron-microscopy single-particle image processing using Scipion.

Electron microscopy of macromolecular structures is an approach that is in increasing demand in the field of structural biology. The automation of image acquisition has greatly increased the potential throughput of electron microscopy. Here, the focus is on the possibilities in Scipion to implement flexible and robust image-processing workflows that allow the electron-microscope operator and the user to monitor the quality of image acquisition, assessing very simple acquisition measures or obtaining a first estimate of the initial volume, or the data resolution and heterogeneity, without any need for programming skills. These workflows can implement intelligent automatic decisions and they can warn the user of possible acquisition failures. These concepts are illustrated by analysis of the well known 2.2 Šresolution ß-galactosidase data set.

Survey of the analysis of continuous conformational variability of biological macromolecules by electron microscopy.

Single-particle analysis by electron microscopy is a well established technique for analyzing the three-dimensional structures of biological macromolecules. Besides its ability to produce high-resolution structures, it also provides insights into the dynamic behavior of the structures by elucidating their conformational variability. Here, the different image-processing methods currently available to study continuous conformational changes are reviewed.

Advances in image processing for single-particle analysis by electron cryomicroscopy and challenges ahead.

Electron cryomicroscopy (cryoEM) is essential for the study and functional understanding of non-crystalline macromolecules such as proteins. These molecules cannot be imaged using X-ray crystallography or other popular methods. CryoEM has been successfully used to visualize macromolecular complexes such as ribosomes, viruses, and ion channels. Determination of structural models of these at various conformational states leads to insight on how these molecules function. Recent advances in imaging technology have given cryoEM a scientific rebirth. As a result of these technological advances image processing and analysis have yielded molecular structures at atomic resolution. Nevertheless there continue to be challenges in image processing, and in this article we will touch on the most essential in order to derive an accurate three-dimensional model from noisy projection images. Traditional approaches, such as k-means clustering for class averaging, will be provided as background. We will then highlight new approaches for each image processing subproblem, including a 3D reconstruction method for asymmetric molecules using just two projection images and deep learning algorithms for automated particle picking.

Using Scipion for stream image processing at Cryo-EM facilities.

Three dimensional electron microscopy is becoming a very data-intensive field in which vast amounts of experimental images are acquired at high speed. To manage such large-scale projects, we had previously developed a modular workflow system called Scipion (de la Rosa-Trevín et al., 2016). We present here a major extension of Scipion that allows processing of EM images while the data is being acquired. This approach helps to detect problems at early stages, saves computing time and provides users with a detailed evaluation of the data quality before the acquisition is finished. At present, Scipion has been deployed and is in production mode in seven Cryo-EM facilities throughout the world.

A new algorithm for high-resolution reconstruction of single particles by electron microscopy.

The Map Challenge organized by the Electron Microscopy Data Bank has prompted the development of an Xmipp high resolution reconstruction protocol (which we will refer to as highres) that is integrated in the software platform Scipion. In this work we describe the details of the image angular alignment and map reconstruction steps in our new method. This algorithm is similar to the standard projection matching approach with some important modifications, especially in the area of detecting significant features in the reconstructed volume. We show that the new method is able to produce higher resolution maps than the current de facto standard as measured by the Fourier Shell Correlation, the Monogenic Local Resolution and EMRinger.

Synthesis of circularly coherent sources.

An experiment is presented in which a partially coherent source endowed with circular coherence is generated. The source is synthesized through a time averaging procedure, so that the mutual intensity is used as the basic correlation function. The correlation between points at different radial distances from the source center is tested by means of a Young interferometer. To confirm the perfect coherence among points along a circle concentric with the source center, the Young mask is replaced by an array of equally spaced pinholes arranged along a circle. The observed pattern is identical to that produced by the same mask, illuminated by perfectly coherent light.

Partially coherent sources with circular coherence.

A new class of partially coherent light sources is introduced. At the source plane, they exhibit perfect coherence along any annulus that is concentric to the source center. Between two points at different distances from the center, coherence can be partial or even vanishing. Such sources can be synthesized by using a generalized form of van Cittert-Zernike theorem where axial sources are used. Beams radiated by this type of source are analyzed at the source plane and upon free propagation for some simple cases.