Label-Free Tracking of Proteins through Plasmon-Enhanced Interference.

Single unmodified biomolecules in solution can be observed and characterized by interferometric imaging approaches; however, Rayleigh scattering limits this to larger proteins (typically >30 kDa). We observe real-time image tracking of unmodified proteins down to 14 kDa using interference imaging enhanced by surface plasmons launched at an aperture in a metal film. The larger proteins show slower diffusion, quantified by tracking. When the diffusing protein is finally trapped by the nanoaperture, we perform complementary power spectral density and noise amplitude analysis, which gives information about the protein. This approach allows for rapid protein characterization with minimal sample preparation and opens the door to characterizing protein interactions in real time.

ALFI: Cell cycle phenotype annotations of label-free time-lapse imaging data from cultured human cells.

Detecting and tracking multiple moving objects in a video is a challenging task. For living cells, the task becomes even more arduous as cells change their morphology over time, can partially overlap, and mitosis leads to new cells. Differently from fluorescence microscopy, label-free techniques can be easily applied to almost all cell lines, reducing sample preparation complexity and phototoxicity. In this study, we present ALFI, a dataset of images and annotations for label-free microscopy, made publicly available to the scientific community, that notably extends the current panorama of expertly labeled data for detection and tracking of cultured living nontransformed and cancer human cells. It consists of 29 time-lapse image sequences from HeLa, U2OS, and hTERT RPE-1 cells under different experimental conditions, acquired by differential interference contrast microscopy, for a total of 237.9 hours. It contains various annotations (pixel-wise segmentation masks, object-wise bounding boxes, tracking information). The dataset is useful for testing and comparing methods for identifying interphase and mitotic events and reconstructing their lineage, and for discriminating different cellular phenotypes.

MM-StackEns: A new deep multimodal stacked generalization approach for protein-protein interaction prediction.

Accurate in-silico identification of protein-protein interactions (PPIs) is a long-standing problem in biology, with important implications in protein function prediction and drug design. Current computational approaches predominantly use a single data modality for describing protein pairs, which may not fully capture the characteristics relevant for identifying PPIs. Another limitation of existing methods is their poor generalization to proteins outside the training graph. In this paper, we aim to address these shortcomings by proposing a new ensemble approach for PPI prediction, which learns information from two modalities, corresponding to pairs of sequences and to the graph formed by the training proteins and their interactions. Our approach uses a siamese neural network to process sequence information, while graph attention networks are employed for the network view. For capturing the relationships between the proteins in a pair, we design a new feature fusion module, based on computing the distance between the distributions corresponding to the two proteins. The prediction is made using a stacked generalization procedure, in which the final classifier is represented by a Logistic Regression model trained on the scores predicted by the sequence and graph models. Additionally, we show that protein sequence embeddings obtained using pretrained language models can significantly improve the generalization of PPI methods. The experimental results demonstrate the good performance of our approach, which surpasses all the related work on two Yeast data sets, while outperforming the majority of literature approaches on two Human data sets and on independent multi-species data sets.

AutoPPI: An Ensemble of Deep Autoencoders for Protein-Protein Interaction Prediction.

Proteins are essential molecules, that must correctly perform their roles for the good health of living organisms. The majority of proteins operate in complexes and the way they interact has pivotal influence on the proper functioning of such organisms. In this study we address the problem of protein-protein interaction and we propose and investigate a method based on the use of an ensemble of autoencoders. Our approach, entitled AutoPPI, adopts a strategy based on two autoencoders, one for each type of interactions (positive and negative) and we advance three types of neural network architectures for the autoencoders. Experiments were performed on several data sets comprising proteins from four different species. The results indicate good performances of our proposed model, with accuracy and AUC values of over 0.97 in all cases. The best performing model relies on a Siamese architecture in both the encoder and the decoder, which advantageously captures common features in protein pairs. Comparisons with other machine learning techniques applied for the same problem prove that AutoPPI outperforms most of its contenders, for the considered data sets.

Automatic segmentation and tracking of biological prosthetic heart valves.

Purpose: Prosthetic heart valve designs must be rigorously tested using cardiovascular equipment. The valve orifice area over time constitutes a key quality metric which is typically assessed manually, thus a tedious and error-prone task. From a computer vision viewpoint, a major unsolved issue lies in the orifice being partly occluded by the leaflets' inner side or inaccurately depicted due to its transparency. Here, we address this issue, which allows us to focus on the accurate and automatic computation of valve orifice areas. Approach: We propose a segmentation approach based on the detection of the leaflets' free edges. Using video frames recorded with a high-speed digital camera during in vitro simulations, an initial estimation of the orifice area is first obtained via active contouring and thresholding and then refined to capture the leaflet free edges via a curve transformation mechanism. Results: Experiments on video data from pulsatile flow testing demonstrate the effectiveness of our approach: a root-mean-square error (RMSE) on the temporal extracted orifice areas between 0.8% and 1.2%, an average Jaccard similarity coefficient between 0.933 and 0.956, and an average Hausdorff distance between 7.2 and 11.9 pixels. Conclusions: Our approach significantly outperformed a state-of-the-art algorithm in terms of evaluation metrics related to valve design (RMSE) and computer vision (accuracy of the orifice shape). It can also cope with lower quality videos and is better at processing frames showing an almost closed valve, a crucial quality for assessing valve design malfunctions related to their improper closing.

A Contrast-Guided Approach for the Enhancement of Low-Lighting Underwater Images.

Underwater images are often acquired in sub-optimal lighting conditions, in particular at profound depths where the absence of natural light demands the use of artificial lighting. Low-lighting images impose a challenge for both manual and automated analysis, since regions of interest can have low visibility. A new framework capable of significantly enhancing these images is proposed in this article. The framework is based on a novel dehazing mechanism that considers local contrast information in the input images, and offers a solution to three common disadvantages of current single image dehazing methods: oversaturation of radiance, lack of scale-invariance and creation of halos. A novel low-lighting underwater image dataset, OceanDark, is introduced to assist in the development and evaluation of the proposed framework. Experimental results and a comparison with other underwater-specific image enhancement methods show that the proposed framework can be used for significantly improving the visibility in low-lighting underwater images of different scales, without creating undesired dehazing artifacts.

Feature-based tracking of urethral motion in low-resolution trans-perineal ultrasound.

This paper describes a novel algorithm for tracking the motion of the urethra from trans-perineal ultrasound. Our work is based on the structure-from-motion paradigm and therefore handles well structures with ill-defined and partially missing boundaries. The proposed approach is particularly well-suited for video sequences of low resolution and variable levels of blurriness introduced by anatomical motion of variable speed. Our tracking method identifies feature points on a frame by frame basis using the SURF detector/descriptor. Inter-frame correspondence is achieved using nearest-neighbor matching in the feature space. The motion is estimated using a non-linear bi-quadratic model, which adequately describes the deformable motion of the urethra. Experimental results are promising and show that our algorithm performs well when compared to manual tracking.

Local image enhancement for fiducial marker detection in electronic portal images of prostate radiotherapy.

This paper proposes a new method for the automatic contrast enhancement of fiducial markers in low-radiation Electronic Portal Images. It is shown that the proposed approach significantly enhances the contrast of the fiducial markers and produces results where these markers are clearly visible. The main theoretical contribution consists in designing an algorithm that enhances the contrast of small structures in noisy images; the parameters of this algorithm are not empirically selected, but determined via a maximum search over a contrast metric. From a practical standpoint, the proposed method has direct applications in the current clinical workflow involving manual marker detection. It is also able to significantly improve the performances of automatic marker detection reported in literature.

A morphology-based approach for interslice interpolation of anatomical slices from volumetric images.

This paper proposes a new morphology-based approach for the interslice interpolation of current transformer (CT) and MRI datasets composed of parallel slices. Our approach is object based and accepts as input data binary slices belonging to the same anatomical structure. Such slices may contain one or more regions, since topological changes between two adjacent slices may occur. Our approach handles explicitly interslice topology changes by decomposing a many-to-many correspondence into three fundamental cases: one-to-one, one-to-many, and zero-to-one correspondences. The proposed interpolation process is iterative. One iteration of this process computes a transition sequence between a pair of corresponding input slices, and selects the element located at equal distance from the input slices. This algorithmic design yields a gradual, smooth change of shape between the input slices. Therefore, the main contribution of our approach is its ability to interpolate between two anatomic shapes by creating a smooth, gradual change of shape, and without generating over-smoothed interpolated shapes.

A web-based remote collaborative system for visualization and assessment of semi-automatic diagnosis of liver cancer from CT images.

We propose a web-based collaborative CAD system allowing for the remote communication and data exchange between radiologists and researchers in computer vision-based software engineering. The proposed web-based interface is implemented in the Java Advanced Imaging Application Programming Interface. The different modules of the interface allow for 3D and 2D data visualization, as well as for the parametric adjustment of 3D reconstruction process. The proposed web-based CAD system was tested in a pilot study involving a limited number of liver cancer cases. The successful system validation in the feasibility stage will lead to an extended clinical study on CT and MR image databases.