Spa-RQ: an Image Analysis Tool to Visualise and Quantify Spatial Phenotypes Applied to Non-Small Cell Lung Cancer.

To facilitate analysis of spatial tissue phenotypes, we created an open-source tool package named 'Spa-RQ' for 'Spatial tissue analysis: image Registration & Quantification'. Spa-RQ contains software for image registration (Spa-R) and quantitative analysis of DAB staining overlap (Spa-Q). It provides an easy-to-implement workflow for serial sectioning and staining as an alternative to multiplexed techniques. To demonstrate Spa-RQ's applicability, we analysed the spatial aspects of oncogenic KRAS-related signalling activities in non-small cell lung cancer (NSCLC). Using Spa-R in conjunction with ImageJ/Fiji, we first performed annotation-guided tumour-by-tumour phenotyping using multiple signalling markers. This analysis showed histopathology-selective activation of PI3K/AKT and MAPK signalling in Kras mutant murine tumours, as well as high p38MAPK stress signalling in p53 null murine NSCLC. Subsequently, Spa-RQ was applied to measure the co-activation of MAPK, AKT, and their mutual effector mTOR pathway in individual tumours. Both murine and clinical NSCLC samples could be stratified into 'MAPK/mTOR', 'AKT/mTOR', and 'Null' signature subclasses, suggesting mutually exclusive MAPK and AKT signalling activities. Spa-RQ thus provides a robust and easy to use tool that can be employed to identify spatially-distributed tissue phenotypes.

Deep learning based tissue analysis predicts outcome in colorectal cancer.

Image-based machine learning and deep learning in particular has recently shown expert-level accuracy in medical image classification. In this study, we combine convolutional and recurrent architectures to train a deep network to predict colorectal cancer outcome based on images of tumour tissue samples. The novelty of our approach is that we directly predict patient outcome, without any intermediate tissue classification. We evaluate a set of digitized haematoxylin-eosin-stained tumour tissue microarray (TMA) samples from 420 colorectal cancer patients with clinicopathological and outcome data available. The results show that deep learning-based outcome prediction with only small tissue areas as input outperforms (hazard ratio 2.3; CI 95% 1.79-3.03; AUC 0.69) visual histological assessment performed by human experts on both TMA spot (HR 1.67; CI 95% 1.28-2.19; AUC 0.58) and whole-slide level (HR 1.65; CI 95% 1.30-2.15; AUC 0.57) in the stratification into low- and high-risk patients. Our results suggest that state-of-the-art deep learning techniques can extract more prognostic information from the tissue morphology of colorectal cancer than an experienced human observer.

A malaria diagnostic tool based on computer vision screening and visualization of Plasmodium falciparum candidate areas in digitized blood smears.

INTRODUCTION: Microscopy is the gold standard for diagnosis of malaria, however, manual evaluation of blood films is highly dependent on skilled personnel in a time-consuming, error-prone and repetitive process. In this study we propose a method using computer vision detection and visualization of only the diagnostically most relevant sample regions in digitized blood smears. METHODS: Giemsa-stained thin blood films with P. falciparum ring-stage trophozoites (n = 27) and uninfected controls (n = 20) were digitally scanned with an oil immersion objective (0.1 µm/pixel) to capture approximately 50,000 erythrocytes per sample. Parasite candidate regions were identified based on color and object size, followed by extraction of image features (local binary patterns, local contrast and Scale-invariant feature transform descriptors) used as input to a support vector machine classifier. The classifier was trained on digital slides from ten patients and validated on six samples. RESULTS: The diagnostic accuracy was tested on 31 samples (19 infected and 12 controls). From each digitized area of a blood smear, a panel with the 128 most probable parasite candidate regions was generated. Two expert microscopists were asked to visually inspect the panel on a tablet computer and to judge whether the patient was infected with P. falciparum. The method achieved a diagnostic sensitivity and specificity of 95% and 100% as well as 90% and 100% for the two readers respectively using the diagnostic tool. Parasitemia was separately calculated by the automated system and the correlation coefficient between manual and automated parasitemia counts was 0.97. CONCLUSION: We developed a decision support system for detecting malaria parasites using a computer vision algorithm combined with visualization of sample areas with the highest probability of malaria infection. The system provides a novel method for blood smear screening with a significantly reduced need for visual examination and has a potential to increase the throughput in malaria diagnostics.