Clinical validation of saliency maps for understanding deep neural networks in ophthalmology.

Deep neural networks (DNNs) have achieved physician-level accuracy on many imaging-based medical diagnostic tasks, for example classification of retinal images in ophthalmology. However, their decision mechanisms are often considered impenetrable leading to a lack of trust by clinicians and patients. To alleviate this issue, a range of explanation methods have been proposed to expose the inner workings of DNNs leading to their decisions. For imaging-based tasks, this is often achieved via saliency maps. The quality of these maps are typically evaluated via perturbation analysis without experts involved. To facilitate the adoption and success of such automated systems, however, it is crucial to validate saliency maps against clinicians. In this study, we used three different network architectures and developed ensembles of DNNs to detect diabetic retinopathy and neovascular age-related macular degeneration from retinal fundus images and optical coherence tomography scans, respectively. We used a variety of explanation methods and obtained a comprehensive set of saliency maps for explaining the ensemble-based diagnostic decisions. Then, we systematically validated saliency maps against clinicians through two main analyses - a direct comparison of saliency maps with the expert annotations of disease-specific pathologies and perturbation analyses using also expert annotations as saliency maps. We found the choice of DNN architecture and explanation method to significantly influence the quality of saliency maps. Guided Backprop showed consistently good performance across disease scenarios and DNN architectures, suggesting that it provides a suitable starting point for explaining the decisions of DNNs on retinal images.

The discovAIR project: a roadmap towards the Human Lung Cell Atlas.

The Human Cell Atlas (HCA) consortium aims to establish an atlas of all organs in the healthy human body at single-cell resolution to increase our understanding of basic biological processes that govern development, physiology and anatomy, and to accelerate diagnosis and treatment of disease. The Lung Biological Network of the HCA aims to generate the Human Lung Cell Atlas as a reference for the cellular repertoire, molecular cell states and phenotypes, and cell-cell interactions that characterise normal lung homeostasis in healthy lung tissue. Such a reference atlas of the healthy human lung will facilitate mapping the changes in the cellular landscape in disease. The discovAIR project is one of six pilot actions for the HCA funded by the European Commission in the context of the H2020 framework programme. discovAIR aims to establish the first draft of an integrated Human Lung Cell Atlas, combining single-cell transcriptional and epigenetic profiling with spatially resolving techniques on matched tissue samples, as well as including a number of chronic and infectious diseases of the lung. The integrated Human Lung Cell Atlas will be available as a resource for the wider respiratory community, including basic and translational scientists, clinical medicine, and the private sector, as well as for patients with lung disease and the interested lay public. We anticipate that the Human Lung Cell Atlas will be the founding stone for a more detailed understanding of the pathogenesis of lung diseases, guiding the design of novel diagnostics and preventive or curative interventions.

[Potential of methods of artificial intelligence for quality assurance]. / Potenzial von Methoden der künstlichen Intelligenz für die Qualitätssicherung.

BACKGROUND: Procedures with artificial intelligence (AI), such as deep neural networks, show promising results in automatic analysis of ophthalmological imaging data. OBJECTIVE: This article discusses to what extent the application of AI algorithms can contribute to quality assurance in the field of ophthalmology. METHODS: Relevant aspects from the literature are discussed. FINDINGS: Systems based on artificial deep neural networks achieve remarkable results in the diagnostics of eye diseases, such as diabetic retinopathy and are very helpful, for example by segmenting optical coherence tomographic (OCT) images and detecting lesion components with high fidelity. To train these algorithms large data sets are required. The quality and availability of such data sets determine the continuous improvement of the algorithms. The comparison between the AI algorithms and physicians for image interpretation has also enabled insights into the diagnostic concordance between physicians. Current challenges include the development of methods for modelling decision uncertainty and improved interpretability of automated diagnostic decisions. CONCLUSION: Systems based on AI can support decision making for physicians and thereby contribute to a more efficient quality assurance.