Multi-step validation of a deep learning-based system with visual explanations for optical diagnosis of polyps with advanced features.

Artificial intelligence (AI) has been found to assist in optical differentiation of hyperplastic and adenomatous colorectal polyps. We investigated whether AI can improve the accuracy of endoscopists' optical diagnosis of polyps with advanced features. We introduced our AI system distinguishing polyps with advanced features with more than 0.870 of accuracy in the internal and external validation datasets. All 19 endoscopists with different levels showed significantly lower diagnostic accuracy (0.410-0.580) than the AI. Prospective randomized controlled study involving 120 endoscopists into optical diagnosis of polyps with advanced features with or without AI demonstration identified that AI improved endoscopists' proportion of polyps with advanced features correctly sent for histological examination (0.960 versus 0.840, p < 0.001), and the proportion of polyps without advanced features resected and discarded (0.490 versus 0.380, p = 0.007). We thus developed an AI technique that significantly increases the accuracy of colorectal polyps with advanced features.

A Simple Normalization Technique Using Window Statistics to Improve the Out-of-Distribution Generalization on Medical Images.

Since data scarcity and data heterogeneity are prevailing for medical images, well-trained Convolutional Neural Networks (CNNs) using previous normalization methods may perform poorly when deployed to a new site. However, a reliable model for real-world clinical applications should generalize well both on in-distribution (IND) and out-of-distribution (OOD) data (e.g., the new site data). In this study, we present a novel normalization technique called window normalization (WIN) to improve the model generalization on heterogeneous medical images, which offers a simple yet effective alternative to existing normalization methods. Specifically, WIN perturbs the normalizing statistics with the local statistics computed within a window. This feature-level augmentation technique regularizes the models well and improves their OOD generalization significantly. Leveraging its advantage, we propose a novel self-distillation method called WIN-WIN. WIN-WIN can be easily implemented with two forward passes and a consistency constraint, serving as a simple extension to existing methods. Extensive experimental results on various tasks (6 tasks) and datasets (24 datasets) demonstrate the generality and effectiveness of our methods.

Deep learning-based PET/MR radiomics for the classification of annualized relapse rate in multiple sclerosis.

Background Annualized Relapse Rate (ARR) is one of the most important indicators of disease progression in patients with Multiple Sclerosis (MS). However, imaging markers that can effectively predict ARR are currently unavailable. In this study, we developed a deep learning-based method for the automated extraction of radiomics features from Positron Emission Computed Tomography (PET) and Magnetic Resonance (MR) images to predict ARR in patients with MS. Methods Twenty-five patients with a definite diagnosis of Relapsing-Remitting MS (RRMS) were enrolled in this study. We designed a multi-branch fully convolutional neural network to segment lesions from PET/MR images. After that, radiomics features were extracted from the obtained lesion volume of interest. Three feature selection methods were used to retain features highly correlated with ARR. We combined four classifiers with different feature selection methods to form twelve models for ARR classification. Finally, the model with the best performance was chosen. Results Our network achieved precise automatic lesion segmentation with a Dice Similarity Coefficient (DSC) of 0.81 and a precision of 0.86. Radiomics features from lesions filtered by Recursive Feature Elimination (RFE) achieved the best performance in the Support Vector Machines (SVM) classifier. The classification model performance was best when radiomics from both PET and MR were combined to predict ARR, with high accuracy at 0.88 and Area Under the ROC curves (AUC) at 0.96, which outperformed MR or PET-based model and clinical indicators-based model. Conclusion Our automatic segmentation masks can replace manual ones with excellent performance. Furthermore, the deep learning and PET/MR radiomics-based model in our research is an effective tool in assisting ARR classification of MS patients.