DeepHistoClass: A Novel Strategy for Confident Classification of Immunohistochemistry Images Using Deep Learning.

A multitude of efforts worldwide aim to create a single-cell reference map of the human body, for fundamental understanding of human health, molecular medicine, and targeted treatment. Antibody-based proteomics using immunohistochemistry (IHC) has proven to be an excellent technology for integration with large-scale single-cell transcriptomics datasets. The golden standard for evaluation of IHC staining patterns is manual annotation, which is expensive and may lead to subjective errors. Artificial intelligence holds much promise for efficient and accurate pattern recognition, but confidence in prediction needs to be addressed. Here, the aim was to present a reliable and comprehensive framework for automated annotation of IHC images. We developed a multilabel classification of 7848 complex IHC images of human testis corresponding to 2794 unique proteins, generated as part of the Human Protein Atlas (HPA) project. Manual annotation data for eight different cell types was generated as a basis for training and testing a proposed Hybrid Bayesian Neural Network. By combining the deep learning model with a novel uncertainty metric, DeepHistoClass (DHC) Confidence Score, the average diagnostic performance improved from 86.9% to 96.3%. This metric not only reveals which images are reliably classified by the model, but can also be utilized for identification of manual annotation errors. The proposed streamlined workflow can be developed further for other tissue types in health and disease and has important implications for digital pathology initiatives or large-scale protein mapping efforts such as the HPA project.

Quantification of Fundus Autofluorescence Features in a Molecularly Characterized Cohort of More Than 3000 Inherited Retinal Disease Patients from the United Kingdom.

Purpose: To quantify relevant fundus autofluorescence (FAF) image features cross-sectionally and longitudinally in a large cohort of inherited retinal diseases (IRDs) patients. Design: Retrospective study of imaging data (55-degree blue-FAF on Heidelberg Spectralis) from patients. Participants: Patients with a clinical and molecularly confirmed diagnosis of IRD who have undergone FAF 55-degree imaging at Moorfields Eye Hospital (MEH) and the Royal Liverpool Hospital (RLH) between 2004 and 2019. Methods: Five FAF features of interest were defined: vessels, optic disc, perimacular ring of increased signal (ring), relative hypo-autofluorescence (hypo-AF) and hyper-autofluorescence (hyper-AF). Features were manually annotated by six graders in a subset of patients based on a defined grading protocol to produce segmentation masks to train an AI model, AIRDetect, which was then applied to the entire imaging dataset. Main Outcome Measures: Quantitative FAF imaging features including area in mm 2 and vessel metrics, were analysed cross-sectionally by gene and age, and longitudinally to determine rate of progression. AIRDetect feature segmentation and detection were validated with Dice score and precision/recall, respectively. Results: A total of 45,749 FAF images from 3,606 IRD patients from MEH covering 170 genes were automatically segmented using AIRDetect. Model-grader Dice scores for disc, hypo-AF, hyper-AF, ring and vessels were respectively 0.86, 0.72, 0.69, 0.68 and 0.65. The five genes with the largest hypo-AF areas were CHM , ABCC6 , ABCA4 , RDH12 , and RPE65 , with mean per-patient areas of 41.5, 30.0, 21.9, 21.4, and 15.1 mm 2 . The five genes with the largest hyper-AF areas were BEST1 , CDH23 , RDH12 , MYO7A , and NR2E3 , with mean areas of 0.49, 0.45, 0.44, 0.39, and 0.34 mm 2 respectively. The five genes with largest ring areas were CDH23 , NR2E3 , CRX , EYS and MYO7A, with mean areas of 3.63, 3.32, 2.84, 2.39, and 2.16 mm 2 . Vessel density was found to be highest in EFEMP1 , BEST1 , TIMP3 , RS1 , and PRPH2 (10.6%, 10.3%, 9.8%, 9.7%, 8.9%) and was lower in Retinitis Pigmentosa (RP) and Leber Congenital Amaurosis genes. Longitudinal analysis of decreasing ring area in four RP genes ( RPGR, USH2A, RHO, EYS ) found EYS to be the fastest progressor at -0.18 mm 2 /year. Conclusions: We have conducted the first large-scale cross-sectional and longitudinal quantitative analysis of FAF features across a diverse range of IRDs using a novel AI approach.