A new algorithm for particle weighted subtraction to decrease signals from unwanted components in single particle analysis.

Single particle analysis (SPA) in cryo-electron microscopy (cryo-EM) is highly used to obtain the near-atomic structure of biological macromolecules. The current methods allow users to produce high-resolution maps from many samples. However, there are still challenging cases that require extra processing to obtain high resolution. This is the case when the macromolecule of the sample is composed of different components and we want to focus just on one of them. For example, if the macromolecule is composed of several flexible subunits and we are interested in a specific one, if it is embedded in a viral capsid environment, or if it has additional components to stabilize it, such as nanodiscs. The signal from these components, which in principle we are not interested in, can be removed from the particles using a projection subtraction method. Currently, there are two projection subtraction methods used in practice and both have some limitations. In fact, after evaluating their results, we consider that the problem is still open to new solutions, as they do not fully remove the signal of the components that are not of interest. Our aim is to develop a new and more precise projection subtraction method, improving the performance of state-of-the-art methods. We tested our algorithm with data from public databases and an in-house data set. In this work, we show that the performance of our algorithm improves the results obtained by others, including the localization of small ligands, such as drugs, whose binding location is unknown a priori.

ScipionTomo: Towards cryo-electron tomography software integration, reproducibility, and validation.

Image processing in cryogenic electron tomography (cryoET) is currently at a similar state as Single Particle Analysis (SPA) in cryogenic electron microscopy (cryoEM) was a few years ago. Its data processing workflows are far from being well defined and the user experience is still not smooth. Moreover, file formats of different software packages and their associated metadata are not standardized, mainly since different packages are developed by different groups, focusing on different steps of the data processing pipeline. The Scipion framework, originally developed for SPA (de la Rosa-Trevín et al., 2016), has a generic python workflow engine that gives it the versatility to be extended to other fields, as demonstrated for model building (Martínez et al., 2020). In this article, we provide an extension of Scipion based on a set of tomography plugins (referred to as ScipionTomo hereafter), with a similar purpose: to allow users to be focused on the data processing and analysis instead of having to deal with multiple software installation issues and the inconvenience of switching from one to another, converting metadata files, managing possible incompatibilities, scripting (writing a simple program in a language that the computer must convert to machine language each time the program is run), etcetera. Additionally, having all the software available in an integrated platform allows comparing the results of different algorithms trying to solve the same problem. In this way, the commonalities and differences between estimated parameters shed light on which results can be more trusted than others. ScipionTomo is developed by a collaborative multidisciplinary team composed of Scipion team engineers, structural biologists, and in some cases, the developers whose software packages have been integrated. It is open to anyone in the field willing to contribute to this project. The result is a framework extension that combines the acquired knowledge of Scipion developers in close collaboration with third-party developers, and the on-demand design of functionalities requested by beta testers applying this solution to actual biological problems.

Image processing tools for the validation of CryoEM maps.

The number of maps deposited in public databases (Electron Microscopy Data Bank, EMDB) determined by cryo-electron microscopy has quickly grown in recent years. With this rapid growth, it is critical to guarantee their quality. So far, map validation has primarily focused on the agreement between maps and models. From the image processing perspective, the validation has been mostly restricted to using two half-maps and the measurement of their internal consistency. In this article, we suggest that map validation can be taken much further from the point of view of image processing if 2D classes, particles, angles, coordinates, defoci, and micrographs are also provided. We present a progressive validation scheme that qualifies a result validation status from 0 to 5 and offers three optional qualifiers (A, W, and O) that can be added. The simplest validation state is 0, while the most complete would be 5AWO. This scheme has been implemented in a website https://biocomp.cnb.csic.es/EMValidationService/ to which reconstructed maps and their ESI can be uploaded.

Cryo-EM density maps adjustment for subtraction, consensus and sharpening.

Electron cryomicroscopy (cryo-EM) has emerged as a powerful structural biology instrument to solve near-atomic three-dimensional structures. Despite the fast growth in the number of density maps generated from cryo-EM data, comparison tools among these reconstructions are still lacking. Current proposals to compare cryo-EM data derived volumes perform map subtraction based on adjustment of each volume grey level to the same scale. We present here a more sophisticated way of adjusting the volumes before comparing, which implies adjustment of grey level scale and spectrum energy, but keeping phases intact inside a mask and imposing the results to be strictly positive. The adjustment that we propose leaves the volumes in the same numeric frame, allowing to perform operations among the adjusted volumes in a more reliable way. This adjustment can be a preliminary step for several applications such as comparison through subtraction, map sharpening, or combination of volumes through a consensus that selects the best resolved parts of each input map. Our development might also be used as a sharpening method using an atomic model as a reference. We illustrate the applicability of this algorithm with the reconstructions derived of several experimental examples. This algorithm is implemented in Xmipp software package and its applications are user-friendly accessible through the cryo-EM image processing framework Scipion.

Algorithmic robustness to preferred orientations in single particle analysis by CryoEM.

The presence of preferred orientations in single particle analysis (SPA) by cryo-Electron Microscopy (cryoEM) is currently one of the hurdles preventing many structural analyses from yielding high-resolution structures. Although the existence of preferred orientations is mostly related to the grid preparation, in this technical note, we show that some image processing algorithms used for angular assignment and three-dimensional (3D) reconstruction are more robust than others to these detrimental conditions. We exemplify this argument with three different data sets in which the presence of preferred orientations hindered achieving a 3D reconstruction without artifacts or, even worse, a 3D reconstruction could never be achieved.

Re-examining the spectra of macromolecules. Current practice of spectral quasi B-factor flattening.

The analysis of structure factors in 3D cryo-EM Coulomb potential maps and their "enhancement" at the end of the reconstruction process is a well-established practice, normally referred to as sharpening. The aim is to increase contrast and, in this way, to help tracing the atomic model. The most common way to accomplish this enhancement is by means of the so-called B-factor correction, which applies a global filter to boost high frequencies with some dampening considerations related to noise amplification. The results are maps with a better visual aspect and a quasiflat spectrum at medium and high frequencies. This practice is so widespread that most map depositions in the Electron Microscopy Data Base (EMDB) only contain sharpened maps. Here, the use in cryoEM of global B-factor corrections is theoretically and experimentally analyzed. Results clearly illustrate that protein spectra present a falloff. Thus, spectral quasi-flattening may produce protein spectra with distortions when compared with experimental ones, this fact, combined with the practice of reporting only sharpened maps, generates a sub-optimal situation in terms of data preservation, reuse and reproducibility. Now that the field is more advanced, we put forward two suggestions: (1) to use methods which keep more faithfully the original experimental signal properties of macromolecules when "enhancing" the map, and (2) to further stress the need to deposit the original experimental maps without any postprocessing or sharpening, not only the enhanced maps. In the absence of access to these original maps data is lost, preventing their future analysis with new methods.

Integration of Cryo-EM Model Building Software in Scipion.

Advances in cryo-electron microscopy (cryo-EM) have made it possible to obtain structures of large biological macromolecules at near-atomic resolution. This "resolution revolution" has encouraged the use and development of modeling tools able to produce high-quality atomic models from cryo-EM density maps. Unfortunately, many practical problems appear when combining different packages in the same processing workflow, which make difficult the use of these tools by non-experts and, therefore, reduce their utility. We present here a major extension of the image processing framework Scipion that provides inter-package integration in the model building area and full tracking of the complete workflow, from image processing to structure validation.

Map challenge: Analysis using a pair comparison method based on Fourier shell correlation.

This document presents the analysis performed over the Map Challenge dataset using a new algorithm which we refer to as Pair Comparison Method. The new algorithm, which is described in detail in the text, is able to sort reconstructions based on a figure of merit and assigns a level of significance to the sorting. That is, it shows how likely the sorting is due to chance or if it reflects real differences.

Blind estimation of DED camera gain in Electron Microscopy.

The introduction of Direct Electron Detector (DED) videos in the Electron Microscope field has boosted Single Particle Analysis to a point in which it is currently considered to be a key technique in Structural Biology. In this article we introduce an approach to estimate the DED camera gain at each pixel from the movies themselves. This gain is needed to have the set of recorded frames into a coherent gray level range, homogeneous over the whole image. The algorithm does not need any other input than the DED movie itself, being capable of providing an estimate of the camera gain image, helping to identify dead pixels and cases of incorrectly calibrated cameras. We propose the algorithm to be used either to validate the experimentally acquired gain image (for instance, to follow its possible change over time) or to verify that there is no residual gain image after experimentally correcting for the camera gain. We show results for a number of DED camera models currently in use (DE, Falcon II, Falcon 3, and K2).

A new algorithm for high-resolution reconstruction of single particles by electron microscopy.

The Map Challenge organized by the Electron Microscopy Data Bank has prompted the development of an Xmipp high resolution reconstruction protocol (which we will refer to as highres) that is integrated in the software platform Scipion. In this work we describe the details of the image angular alignment and map reconstruction steps in our new method. This algorithm is similar to the standard projection matching approach with some important modifications, especially in the area of detecting significant features in the reconstructed volume. We show that the new method is able to produce higher resolution maps than the current de facto standard as measured by the Fourier Shell Correlation, the Monogenic Local Resolution and EMRinger.

Using Scipion for stream image processing at Cryo-EM facilities.

Three dimensional electron microscopy is becoming a very data-intensive field in which vast amounts of experimental images are acquired at high speed. To manage such large-scale projects, we had previously developed a modular workflow system called Scipion (de la Rosa-Trevín et al., 2016). We present here a major extension of Scipion that allows processing of EM images while the data is being acquired. This approach helps to detect problems at early stages, saves computing time and provides users with a detailed evaluation of the data quality before the acquisition is finished. At present, Scipion has been deployed and is in production mode in seven Cryo-EM facilities throughout the world.

Local analysis of strains and rotations for macromolecular electron microscopy maps.

Macromolecular complexes perform their physiological functions by local rearrangements of their constituents and biochemically interacting with their reaction partners. These rearrangements may involve local rotations and the induction of local strains causing different mechanical efforts and stretches at the different areas of the protein. The analysis of these local deformations may reveal important insight into the way proteins perform their tasks. In this paper we introduce a method to perform this kind of local analysis using Electron Microscopy volumes in a fully objective and automatic manner. For doing so, we exploit the continuous nature of the result of an elastic image registration using B-splines as its basis functions. We show that the results obtained by the new automatic method are consistent with previous observations on these macromolecules.

Fast and automatic identification of particle tilt pairs based on Delaunay triangulation.

Random conical tilt (RCT) and orthogonal tilt reconstruction (OTR) are two remarkable methods for reconstructing the three-dimensional structure of macromolecules at low resolution. These techniques use two images at two different sample tilts. One of the most demanding steps in these methods at the image processing level is to identify corresponding particles on both micrographs, and manual or semiautomatic matching methods are usually used. Here we present an approach to solve this bottleneck with a fully automatic method for assigning particle tilt pairs. This new algorithm behaves correctly with a variety of samples, covering the range from small to large macromolecules and from sparse to densely populated fields of view. It is also more rapid than previous approaches. The roots of the method lie in a Delaunay triangulation of the set of independently picked coordinates on both the untilted and tilted micrographs. These triangulations are then used to search an affine transformation between the untilted and tilted triangles. The affine transformation that maximizes the number of correspondences between the two micrographs defines the coordinate matching.

Scipion: A software framework toward integration, reproducibility and validation in 3D electron microscopy.

In the past few years, 3D electron microscopy (3DEM) has undergone a revolution in instrumentation and methodology. One of the central players in this wide-reaching change is the continuous development of image processing software. Here we present Scipion, a software framework for integrating several 3DEM software packages through a workflow-based approach. Scipion allows the execution of reusable, standardized, traceable and reproducible image-processing protocols. These protocols incorporate tools from different programs while providing full interoperability among them. Scipion is an open-source project that can be downloaded from http://scipion.cnb.csic.es.

A statistical approach to the initial volume problem in Single Particle Analysis by Electron Microscopy.

Cryo Electron Microscopy is a powerful Structural Biology technique, allowing the elucidation of the three-dimensional structure of biological macromolecules. In particular, the structural study of purified macromolecules -often referred as Single Particle Analysis(SPA)- is normally performed through an iterative process that needs a first estimation of the three-dimensional structure that is progressively refined using experimental data. It is well-known the local optimisation nature of this refinement, so that the initial choice of this first structure may substantially change the final result. Computational algorithms aiming to providing this first structure already exist. However, the question is far from settled and more robust algorithms are still needed so that the refinement process can be performed with sufficient guarantees. In this article we present a new algorithm that addresses the initial volume problem in SPA by setting it in a Weighted Least Squares framework and calculating the weights through a statistical approach based on the cumulative density function of different image similarity measures. We show that the new algorithm is significantly more robust than other state-of-the-art algorithms currently in use in the field. The algorithm is available as part of the software suite Xmipp (http://xmipp.cnb.csic.es) and Scipion (http://scipion.cnb.csic.es) under the name "Significant".

Three-dimensional reconstruction methods in Single Particle Analysis from transmission electron microscopy data.

The Transmission Electron Microscope provides two-dimensional (2D) images of the specimens under study. However, the architecture of these specimens is defined in a three-dimensional (3D) coordinate space, in volumetric terms, making the direct microscope output somehow "short" in terms of dimensionality. This situation has prompted the development of methods to quantitatively estimate 3D volumes from sets of 2D images, which are usually referred to as "three-dimensional reconstruction methods". These 3D reconstruction methods build on four considerations: (1) The relationship between the 2D images and the 3D volume must be of a particularly simple type, (2) many 2D images are needed to gain 3D volumetric information, (3) the 2D images and the 3D volume have to be in the same coordinate reference frame and (4), in practical terms, the reconstructed 3D volume will only be an approximation to the original 3D volume which gave raise to the 2D projections. In this work we will adopt a quite general view, trying to address a large community of interested readers, although some sections will be particularly devoted to the 3D analysis of isolated macromolecular complexes in the application area normally referred to as Single Particle Analysis (SPA).

A pattern matching approach to the automatic selection of particles from low-contrast electron micrographs.

MOTIVATION: Structural information of macromolecular complexes provides key insights into the way they carry out their biological functions. Achieving high-resolution structural details with electron microscopy requires the identification of a large number (up to hundreds of thousands) of single particles from electron micrographs, which is a laborious task if it has to be manually done and constitutes a hurdle towards high-throughput. Automatic particle selection in micrographs is far from being settled and new and more robust algorithms are required to reduce the number of false positives and false negatives. RESULTS: In this article, we introduce an automatic particle picker that learns from the user the kind of particles he is interested in. Particle candidates are quickly and robustly classified as particles or non-particles. A number of new discriminative shape-related features as well as some statistical description of the image grey intensities are used to train two support vector machine classifiers. Experimental results demonstrate that the proposed method: (i) has a considerably low computational complexity and (ii) provides results better or comparable with previously reported methods at a fraction of their computing time. AVAILABILITY: The algorithm is fully implemented in the open-source Xmipp package and downloadable from http://xmipp.cnb.csic.es.

FASTDEF: fast defocus and astigmatism estimation for high-throughput transmission electron microscopy.

In this work we present a fast and automated algorithm for estimating the contrast transfer function (CTF) of a transmission electron microscope. The approach is very suitable for High Throughput work because: (a) it does not require any initial defocus estimation, (b) it is almost an order of magnitude faster than existing approaches, (c) it opens the way to well-defined extensions to the estimation of higher order aberrations, at the same time that provides defocus and astigmatism estimations comparable in accuracy to well established methods, such as Xmipp and CTFFIND3 approaches. The new algorithm is based on obtaining the wrapped modulating phase of the power spectra density pattern by the use of a quadrature filter. This phase is further unwrapped in order to obtain the continuous and smooth absolute phase map; then a Zernike polynomial fitting is performed and the defocus and astigmatism parameters are determined. While the method does not require an initial estimation of the defocus parameters or any non-linear optimization procedure, these approaches can be used if further refinement is desired. Results of the CTF estimation method are presented for standard negative stained images, cryo-electron microscopy images in the absence of carbon support, as well as micrographs with only ice. Additionally, we have also tested the proposed method with micrographs acquired from tilted and untilted samples, obtaining good results. The algorithm is freely available as a part of the Xmipp package [http://xmipp.cnb.csic.es].

Xmipp 3.0: an improved software suite for image processing in electron microscopy.

Xmipp is a specialized software package for image processing in electron microscopy, and that is mainly focused on 3D reconstruction of macromolecules through single-particles analysis. In this article we present Xmipp 3.0, a major release which introduces several improvements and new developments over the previous version. A central improvement is the concept of a project that stores the entire processing workflow from data import to final results. It is now possible to monitor, reproduce and restart all computing tasks as well as graphically explore the complete set of interrelated tasks associated to a given project. Other graphical tools have also been improved such as data visualization, particle picking and parameter "wizards" that allow the visual selection of some key parameters. Many standard image formats are transparently supported for input/output from all programs. Additionally, results have been standardized, facilitating the interoperation between different Xmipp programs. Finally, as a result of a large code refactoring, the underlying C++ libraries are better suited for future developments and all code has been optimized. Xmipp is an open-source package that is freely available for download from: http://xmipp.cnb.csic.es.

Particle quality assessment and sorting for automatic and semiautomatic particle-picking techniques.

Three-dimensional reconstruction of biological specimens using electron microscopy by single particle methodologies requires the identification and extraction of the imaged particles from the acquired micrographs. Automatic and semiautomatic particle selection approaches can localize these particles, minimizing the user interaction, but at the cost of selecting a non-negligible number of incorrect particles, which can corrupt the final three-dimensional reconstruction. In this work, we present a novel particle quality assessment and sorting method that can separate most erroneously picked particles from correct ones. The proposed method is based on multivariate statistical analysis of a particle set that has been picked previously using any automatic or manual approach. The new method uses different sets of particle descriptors, which are morphology-based, histogram-based and signal to noise analysis based. We have tested our proposed algorithm with experimental data obtaining very satisfactory results. The algorithm is freely available as a part of the Xmipp 3.0 package [http://xmipp.cnb.csic.es].