IVIM parameters mapping with artificial neural network based on mean deviation prior.

BACKGROUND: The diffusion and perfusion parameters derived from intravoxel incoherent motion (IVIM) imaging provide promising biomarkers for noninvasively quantifying and managing various diseases. Nevertheless, due to the distribution gap between simulated and real datasets, the out-of-distribution (OOD) problem occurred in supervised learning-based methods degrades their performance and hinders their real applications. PURPOSE: To address the OOD problem in supervised methods and to further improve the accuracy and stability of IVIM parameter estimation, this work proposes a novel learning framework called IterANN, based on mean deviation prior (MDP) between training and estimated IVIM parameters on the test set. METHODS: Specifically, MDP indicates that the mean of the estimated IVIM parameters always locates between the mean of IVIM parameters in the test and train sets. In IterANN, we adopt a very simple artificial neural network (ANN) architecture of two hidden layers with 12 neurons per hidden layer, an input layer containing the signals acquired at multiple b-values and an output layer composed of three IVIM parameters ( D $D$ , F $F$ and D S t a r $DStar$ ). Inspired by MDP, the distribution of IVIM parameters in the training set (simulated data) is iteratively updated so that their mean gradually approaches the predicted values of the real data. This aims to achieve a strong correlation between the simulated data and the real data. To validate the effectiveness of IterANN, we compare it with several methods on both simulation and real acquisition datasets, including 21 healthy and 3 tumor subjects, in terms of residual errors of IVIM parameters or DW signals, the coefficients of variation (CV) of IVIM parameters, and the parameter contrast-to-noise ratio (PCNR) between normal and tumor tissues. RESULTS: On two simulation datasets, the proposed IterANN achieves the lowest residual error in IVIM parameters, especially in the case of low signal-to-noise ratio (SNR = 10), the residual error of D $D$ , F $F$ and D S t a r $DStar$ is decreased by 15.82 % / 14.92 % , 81.19 % / 74.04 % , 50.77 % / 1.549 % $15.82\%/14.92\%, 81.19\%/74.04\%, 50.77\%/1.549\%$ (Gaussian distribution /realistic distribution) respectively comparing to the suboptimal method. On real dataset, the IterANN achieves the highest PCNR when comparing the normal and tumor regions. Additionally, the proposed IterANN demonstrated better stability, with its CV being significantly lower than that of other methods in the vast majority of cases ( p < 0.01 $p<0.01$ , paired-sample Student's t-test). CONCLUSIONS: The superior performance of IterANN demonstrates that updating the distribution of the train set based on MDP can effectively solve the OOD problem, which allows us not only to improve the accuracy and stability of the estimated IVIM parameters, but also to increase the potential of IVIM in disease diagnosis.

Understanding calibration of deep neural networks for medical image classification.

Background and Objective - In the field of medical image analysis, achieving high accuracy is not enough; ensuring well-calibrated predictions is also crucial. Confidence scores of a deep neural network play a pivotal role in explainability by providing insights into the model's certainty, identifying cases that require attention, and establishing trust in its predictions. Consequently, the significance of a well-calibrated model becomes paramount in the medical imaging domain, where accurate and reliable predictions are of utmost importance. While there has been a significant effort towards training modern deep neural networks to achieve high accuracy on medical imaging tasks, model calibration and factors that affect it remain under-explored. Methods - To address this, we conducted a comprehensive empirical study that explores model performance and calibration under different training regimes. We considered fully supervised training, which is the prevailing approach in the community, as well as rotation-based self-supervised method with and without transfer learning, across various datasets and architecture sizes. Multiple calibration metrics were employed to gain a holistic understanding of model calibration. Results - Our study reveals that factors such as weight distributions and the similarity of learned representations correlate with the calibration trends observed in the models. Notably, models trained using rotation-based self-supervised pretrained regime exhibit significantly better calibration while achieving comparable or even superior performance compared to fully supervised models across different medical imaging datasets. Conclusion - These findings shed light on the importance of model calibration in medical image analysis and highlight the benefits of incorporating self-supervised learning approach to improve both performance and calibration.

Inference of core needle biopsy whole slide images requiring definitive therapy for prostate cancer.

BACKGROUND: Prostate cancer is often a slowly progressive indolent disease. Unnecessary treatments from overdiagnosis are a significant concern, particularly low-grade disease. Active surveillance has being considered as a risk management strategy to avoid potential side effects by unnecessary radical treatment. In 2016, American Society of Clinical Oncology (ASCO) endorsed the Cancer Care Ontario (CCO) Clinical Practice Guideline on active surveillance for the management of localized prostate cancer. METHODS: Based on this guideline, we developed a deep learning model to classify prostate adenocarcinoma into indolent (applicable for active surveillance) and aggressive (necessary for definitive therapy) on core needle biopsy whole slide images (WSIs). In this study, we trained deep learning models using a combination of transfer, weakly supervised, and fully supervised learning approaches using a dataset of core needle biopsy WSIs (n=1300). In addition, we performed an inter-rater reliability evaluation on the WSI classification. RESULTS: We evaluated the models on a test set (n=645), achieving ROC-AUCs of 0.846 for indolent and 0.980 for aggressive. The inter-rater reliability evaluation showed s-scores in the range of 0.10 to 0.95, with the lowest being on the WSIs with both indolent and aggressive classification by the model, and the highest on benign WSIs. CONCLUSION: The results demonstrate the promising potential of deployment in a practical prostate adenocarcinoma histopathological diagnostic workflow system.

Local Integral Regression Network for Cell Nuclei Detection.

Nuclei detection is a fundamental task in the field of histopathology image analysis and remains challenging due to cellular heterogeneity. Recent studies explore convolutional neural networks to either isolate them with sophisticated boundaries (segmentation-based methods) or locate the centroids of the nuclei (counting-based approaches). Although these two methods have demonstrated superior success, their fully supervised training demands considerable and laborious pixel-wise annotations manually labeled by pathology experts. To alleviate such tedious effort and reduce the annotation cost, we propose a novel local integral regression network (LIRNet) that allows both fully and weakly supervised learning (FSL/WSL) frameworks for nuclei detection. Furthermore, the LIRNet can output an exquisite density map of nuclei, in which the localization of each nucleus is barely affected by the post-processing algorithms. The quantitative experimental results demonstrate that the FSL version of the LIRNet achieves a state-of-the-art performance compared to other counterparts. In addition, the WSL version has exhibited a competitive detection performance and an effortless data annotation that requires only 17.5% of the annotation effort.

[Review of research on detection and tracking of minimally invasive surgical tools based on deep learning].

The application of minimally invasive surgical tool detection and tracking technology based on deep learning in minimally invasive surgery is currently a research hotspot. This paper firstly expounds the relevant technical content of the minimally invasive surgery tool detection and tracking, which mainly introduces the advantages based on deep learning algorithm. Then, this paper summarizes the algorithm for detection and tracking surgical tools based on fully supervised deep neural network and the emerging algorithm for detection and tracking surgical tools based on weakly supervised deep neural network. Several typical algorithm frameworks and their flow charts based on deep convolutional and recurrent neural networks are summarized emphatically, so as to enable researchers in relevant fields to understand the current research progress more systematically and provide reference for minimally invasive surgeons to select navigation technology. In the end, this paper provides a general direction for the further research of minimally invasive surgical tool detection and tracking technology based on deep learning.

Review of research on detection and tracking of minimally invasive surgical tools based on deep learning / 生物医学工程学杂志

The application of minimally invasive surgical tool detection and tracking technology based on deep learning in minimally invasive surgery is currently a research hotspot. This paper firstly expounds the relevant technical content of the minimally invasive surgery tool detection and tracking, which mainly introduces the advantages based on deep learning algorithm. Then, this paper summarizes the algorithm for detection and tracking surgical tools based on fully supervised deep neural network and the emerging algorithm for detection and tracking surgical tools based on weakly supervised deep neural network. Several typical algorithm frameworks and their flow charts based on deep convolutional and recurrent neural networks are summarized emphatically, so as to enable researchers in relevant fields to understand the current research progress more systematically and provide reference for minimally invasive surgeons to select navigation technology. In the end, this paper provides a general direction for the further research of minimally invasive surgical tool detection and tracking technology based on deep learning.