The use of a real-time computer-aided detection system for visible lesions in the Barrett's esophagus during live endoscopic procedures, a pilot study.

BACKGROUND AND AIMS: In this pilot study we evaluated performance of a recently developed computer-aided detection (CADe) system for Barrett's neoplasia during live endoscopic procedures. METHODS: 15 patients with and 15 without a visible lesion were included in this study. A CAD assisted workflow was employed that included: a slow pullback video recording of the entire Barrett's segment with live CADe assistance, followed by CADe assisted level-based video recordings every 2cm of the Barrett's segment. Outcomes were per patient and per level diagnostic accuracy of the CAD assisted workflow, where the primary outcome was per patient in-vivo CADe sensitivity. RESULTS: In the per patient analyses, the CADe system detected all visible lesions (sensitivity 100%). Per patient CADe specificity was 53%. Per-level sensitivity and specificity of the CADe assisted workflow were 100% and 73%, respectively. CONCLUSION: In this pilot study, the CADe system detected all potentially neoplastic lesions in Barrett's esophagus comparable to an expert endoscopist. Continued refinement of the system may improve specificity. External validation in larger multicenter studies is planned.

Robustness evaluation of deep neural networks for endoscopic image analysis: Insights and strategies.

Computer-aided detection and diagnosis systems (CADe/CADx) in endoscopy are commonly trained using high-quality imagery, which is not representative for the heterogeneous input typically encountered in clinical practice. In endoscopy, the image quality heavily relies on both the skills and experience of the endoscopist and the specifications of the system used for screening. Factors such as poor illumination, motion blur, and specific post-processing settings can significantly alter the quality and general appearance of these images. This so-called domain gap between the data used for developing the system and the data it encounters after deployment, and the impact it has on the performance of deep neural networks (DNNs) supportive endoscopic CAD systems remains largely unexplored. As many of such systems, for e.g. polyp detection, are already being rolled out in clinical practice, this poses severe patient risks in particularly community hospitals, where both the imaging equipment and experience are subject to considerable variation. Therefore, this study aims to evaluate the impact of this domain gap on the clinical performance of CADe/CADx for various endoscopic applications. For this, we leverage two publicly available data sets (KVASIR-SEG and GIANA) and two in-house data sets. We investigate the performance of commonly-used DNN architectures under synthetic, clinically calibrated image degradations and on a prospectively collected dataset including 342 endoscopic images of lower subjective quality. Additionally, we assess the influence of DNN architecture and complexity, data augmentation, and pretraining techniques for improved robustness. The results reveal a considerable decline in performance of 11.6% (±1.5) as compared to the reference, within the clinically calibrated boundaries of image degradations. Nevertheless, employing more advanced DNN architectures and self-supervised in-domain pre-training effectively mitigate this drop to 7.7% (±2.03). Additionally, these enhancements yield the highest performance on the manually collected test set including images with lower subjective quality. By comprehensively assessing the robustness of popular DNN architectures and training strategies across multiple datasets, this study provides valuable insights into their performance and limitations for endoscopic applications. The findings highlight the importance of including robustness evaluation when developing DNNs for endoscopy applications and propose strategies to mitigate performance loss.

COMPUTER-AIDED DIAGNOSIS IMPROVES CHARACTERIZATION OF BARRETT'S NEOPLASIA BY GENERAL ENDOSCOPISTS.

BACKGROUND & AIMS: Characterization of visible abnormalities in Barrett esophagus (BE) patients can be challenging, especially for unexperienced endoscopists. This results in suboptimal diagnostic accuracy and poor inter-observer agreement. Computer-aided diagnosis (CADx) systems may assist endoscopists. We aimed to develop, validate and benchmark a CADx system for BE neoplasia. METHODS: The CADx system received pretraining with ImageNet with consecutive domain-specific pretraining with GastroNet which includes 5 million endoscopic images. It was subsequently trained and internally validated using 1,758 narrow-band imaging (NBI) images of early BE neoplasia (352 patients) and 1,838 NBI images of non-dysplastic BE (173 patients) from 8 international centers. CADx was tested prospectively on corresponding image and video test sets with 30 cases (20 patients) of BE neoplasia and 60 cases (31 patients) of non-dysplastic BE. The test set was benchmarked by 44 general endoscopists in two phases (phase 1: no CADx assistance; phase 2: with CADx assistance). Ten international BE experts provided additional benchmark performance. RESULTS: Stand-alone sensitivity and specificity of the CADx system were 100% and 98% for images and 93% and 96% for videos, respectively. CADx outperformed general endoscopists without CADx assistance in terms of sensitivity (p=0.04). Sensitivity and specificity of general endoscopist increased from 84% to 96% and 90 to 98% with CAD assistance (p<0.001), respectively. CADx assistance increased endoscopists' confidence in characterization (p<0.001). CADx performance was similar to Barrett experts. CONCLUSION: CADx assistance significantly increased characterization performance of BE neoplasia by general endoscopists to the level of expert endoscopists. The use of this CADx system may thereby improve daily Barrett surveillance.

An anthropomorphic thyroid phantom for ultrasound-guided radiofrequency ablation of nodules.

BACKGROUND: Needle-based procedures, such as fine needle aspiration and thermal ablation, are often applied for thyroid nodule diagnosis and therapeutic purposes, respectively. With blood vessels and nerves nearby, these procedures can pose risks in damaging surrounding critical structures. PURPOSE: The development and validation of innovative strategies to manage these risks require a test object with well-characterized physical properties. For this work, we focus on the application of ultrasound-guided thermal radiofrequency ablation. METHODS: We have developed a single-use anthropomorphic phantom mimicking the thyroid and surrounding anatomical and physiological structures that are relevant to ultrasound-guided thermal ablation. The phantom was composed of a mixture of polyacrylamide, water, and egg white extract and was cast using molds in multiple steps. The thermal, acoustical, and electrical characteristics were experimentally validated. The ablation zones were analyzed via non-destructive T2 -weighted magnetic resonance imaging scans utilizing the relaxometry changes of coagulated egg albumen, and the temperature distribution was monitored using an array of fiber Bragg grating sensors. RESULTS: The physical properties of the phantom were verified both on ultrasound as well as in terms of the phantom response to thermal ablation. The final temperature achieved (92°C), the median percentage of the nodule ablated (82.1%), the median volume ablated outside the nodule (0.8 mL), and the median number of critical structures affected (0) were quantified. CONCLUSION: An anthropomorphic phantom that can provide a realistic model for development and training in ultrasound-guided needle-based thermal interventions for thyroid nodules has been presented.

Computed Tomography-Based Radiomics Using Tumor and Vessel Features to Assess Resectability in Cancer of the Pancreatic Head.

The preoperative prediction of resectability pancreatic ductal adenocarcinoma (PDAC) is challenging. This retrospective single-center study examined tumor and vessel radiomics to predict the resectability of PDAC in chemo-naïve patients. The tumor and adjacent arteries and veins were segmented in the portal-venous phase of contrast-enhanced CT scans, and radiomic features were extracted. Features were selected via stability and collinearity testing, and least absolute shrinkage and selection operator application (LASSO). Three models, using tumor features, vessel features, and a combination of both, were trained with the training set (N = 86) to predict resectability. The results were validated with the test set (N = 15) and compared to the multidisciplinary team's (MDT) performance. The vessel-features-only model performed best, with an AUC of 0.92 and sensitivity and specificity of 97% and 73%, respectively. Test set validation showed a sensitivity and specificity of 100% and 88%, respectively. The combined model was as good as the vessel model (AUC = 0.91), whereas the tumor model showed poor performance (AUC = 0.76). The MDT's prediction reached a sensitivity and specificity of 97% and 84% for the training set and 88% and 100% for the test set, respectively. Our clinician-independent vessel-based radiomics model can aid in predicting resectability and shows performance comparable to that of the MDT. With these encouraging results, improved, automated, and generalizable models can be developed that reduce workload and can be applied in non-expert hospitals.

Towards a robust and compact deep learning system for primary detection of early Barrett's neoplasia: Initial image-based results of training on a multi-center retrospectively collected data set.

INTRODUCTION: Endoscopic detection of early neoplasia in Barrett's esophagus is difficult. Computer Aided Detection (CADe) systems may assist in neoplasia detection. The aim of this study was to report the first steps in the development of a CADe system for Barrett's neoplasia and to evaluate its performance when compared with endoscopists. METHODS: This CADe system was developed by a consortium, consisting of the Amsterdam University Medical Center, Eindhoven University of Technology, and 15 international hospitals. After pretraining, the system was trained and validated using 1.713 neoplastic (564 patients) and 2.707 non-dysplastic Barrett's esophagus (NDBE; 665 patients) images. Neoplastic lesions were delineated by 14 experts. The performance of the CADe system was tested on three independent test sets. Test set 1 (50 neoplastic and 150 NDBE images) contained subtle neoplastic lesions representing challenging cases and was benchmarked by 52 general endoscopists. Test set 2 (50 neoplastic and 50 NDBE images) contained a heterogeneous case-mix of neoplastic lesions, representing distribution in clinical practice. Test set 3 (50 neoplastic and 150 NDBE images) contained prospectively collected imagery. The main outcome was correct classification of the images in terms of sensitivity. RESULTS: The sensitivity of the CADe system on test set 1 was 84%. For general endoscopists, sensitivity was 63%, corresponding to a neoplasia miss-rate of one-third of neoplastic lesions and a potential relative increase in neoplasia detection of 33% for CADe-assisted detection. The sensitivity of the CADe system on test sets 2 and 3 was 100% and 88%, respectively. The specificity of the CADe system varied for the three test sets between 64% and 66%. CONCLUSION: This study describes the first steps towards the establishment of an unprecedented data infrastructure for using machine learning to improve the endoscopic detection of Barrett's neoplasia. The CADe system detected neoplasia reliably and outperformed a large group of endoscopists in terms of sensitivity.

Analysis of computer-aided diagnostics in the preoperative diagnosis of ovarian cancer: a systematic review.

OBJECTIVES: Different noninvasive imaging methods to predict the chance of malignancy of ovarian tumors are available. However, their predictive value is limited due to subjectivity of the reviewer. Therefore, more objective prediction models are needed. Computer-aided diagnostics (CAD) could be such a model, since it lacks bias that comes with currently used models. In this study, we evaluated the available data on CAD in predicting the chance of malignancy of ovarian tumors. METHODS: We searched for all published studies investigating diagnostic accuracy of CAD based on ultrasound, CT and MRI in pre-surgical patients with an ovarian tumor compared to reference standards. RESULTS: In thirty-one included studies, extracted features from three different imaging techniques were used in different mathematical models. All studies assessed CAD based on machine learning on ultrasound, CT scan and MRI scan images. Per imaging method, subsequently ultrasound, CT and MRI, sensitivities ranged from 40.3 to 100%; 84.6-100% and 66.7-100% and specificities ranged from 76.3-100%; 69-100% and 77.8-100%. Results could not be pooled, due to broad heterogeneity. Although the majority of studies report high performances, they are at considerable risk of overfitting due to the absence of an independent test set. CONCLUSION: Based on this literature review, different CAD for ultrasound, CT scans and MRI scans seem promising to aid physicians in assessing ovarian tumors through their objective and potentially cost-effective character. However, performance should be evaluated per imaging technique. Prospective and larger datasets with external validation are desired to make their results generalizable.

Ultrasound imaging in thyroid nodule diagnosis, therapy, and follow-up: Current status and future trends.

Ultrasound, the primary imaging modality in thyroid nodule management, suffers from drawbacks including: high inter- and intra-observer variability, limited field-of-view and limited functional imaging. Developments in ultrasound technologies are taking place to overcome these limitations, including three-dimensional-Doppler, -elastography, -nodule characteristics-extraction, and novel machine-learning algorithms. For thyroid ablative treatments and biopsies, perioperative use of three-dimensional ultrasound opens a new field of research. This review provides an overview of the current and future applications of ultrasound, and discusses the potential of new developments and trends that may improve the diagnosis, therapy, and follow-up of thyroid nodules.

Multi-stage domain-specific pretraining for improved detection and localization of Barrett's neoplasia: A comprehensive clinically validated study.

Patients suffering from Barrett's Esophagus (BE) are at an increased risk of developing esophageal adenocarcinoma and early detection is crucial for a good prognosis. To aid the endoscopists with the early detection for this preliminary stage of esophageal cancer, this work concentrates on the development and extensive evaluation of a state-of-the-art computer-aided classification and localization algorithm for dysplastic lesions in BE. To this end, we have employed a large-scale endoscopic data set, consisting of 494,355 images, in combination with a novel semi-supervised learning algorithm to pretrain several instances of the proposed neural network architecture. Next, several Barrett-specific data sets that are increasingly closer to the target domain with significantly more data compared to other related work, were used in a multi-stage transfer learning strategy. Additionally, the algorithm was evaluated on two prospectively gathered external test sets and compared against 53 medical professionals. Finally, the model was also evaluated in a live setting without interfering with the current biopsy protocol. Results from the performed experiments show that the proposed model improves on the state-of-the-art on all measured metrics. More specifically, compared to the best performing state-of-the-art model, the specificity is improved by more than 20% points while simultaneously preserving high sensitivity and reducing the false positive rate substantially. Our algorithm yields similar scores on the localization metrics, where the intersection of all experts is correctly indicated in approximately 92% of the cases. Furthermore, the live pilot study shows great performance in a clinical setting with a patient level accuracy, sensitivity, and specificity of 90%. Finally, the proposed algorithm outperforms each individual medical expert by at least 5% and the average assessor by more than 10% over all assessor groups with respect to accuracy.

Improving Temporal Stability and Accuracy for Endoscopic Video Tissue Classification Using Recurrent Neural Networks.

Early Barrett's neoplasia are often missed due to subtle visual features and inexperience of the non-expert endoscopist with such lesions. While promising results have been reported on the automated detection of this type of early cancer in still endoscopic images, video-based detection using the temporal domain is still open. The temporally stable nature of video data in endoscopic examinations enables to develop a framework that can diagnose the imaged tissue class over time, thereby yielding a more robust and improved model for spatial predictions. We show that the introduction of Recurrent Neural Network nodes offers a more stable and accurate model for tissue classification, compared to classification on individual images. We have developed a customized Resnet18 feature extractor with four types of classifiers: Fully Connected (FC), Fully Connected with an averaging filter (FC Avg(n = 5)), Long Short Term Memory (LSTM) and a Gated Recurrent Unit (GRU). Experimental results are based on 82 pullback videos of the esophagus with 46 high-grade dysplasia patients. Our results demonstrate that the LSTM classifier outperforms the FC, FC Avg(n = 5) and GRU classifier with an average accuracy of 85.9% compared to 82.2%, 83.0% and 85.6%, respectively. The benefit of our novel implementation for endoscopic tissue classification is the inclusion of spatio-temporal information for improved and robust decision making, and it is the first step towards full temporal learning of esophageal cancer detection in endoscopic video.

Machine learning in GI endoscopy: practical guidance in how to interpret a novel field.

There has been a vast increase in GI literature focused on the use of machine learning in endoscopy. The relative novelty of this field poses a challenge for reviewers and readers of GI journals. To appreciate scientific quality and novelty of machine learning studies, understanding of the technical basis and commonly used techniques is required. Clinicians often lack this technical background, while machine learning experts may be unfamiliar with clinical relevance and implications for daily practice. Therefore, there is an increasing need for a multidisciplinary, international evaluation on how to perform high-quality machine learning research in endoscopy. This review aims to provide guidance for readers and reviewers of peer-reviewed GI journals to allow critical appraisal of the most relevant quality requirements of machine learning studies. The paper provides an overview of common trends and their potential pitfalls and proposes comprehensive quality requirements in six overarching themes: terminology, data, algorithm description, experimental setup, interpretation of results and machine learning in clinical practice.

Liraglutide decreases energy expenditure and does not affect the fat fraction of supraclavicular brown adipose tissue in patients with type 2 diabetes.

BACKGROUND AND AIMS: Several studies have shown that glucagon-like peptide-1 (GLP-1) analogues can affect resting energy expenditure, and preclinical studies suggest that they may activate brown adipose tissue (BAT). The aim of the present study was to investigate the effect of treatment with liraglutide on energy metabolism and BAT fat fraction in patients with type 2 diabetes. METHODS AND RESULTS: In a 26-week double-blind, placebo-controlled trial, 50 patients with type 2 diabetes were randomized to treatment with liraglutide (1.8 mg/day) or placebo added to standard care. At baseline and after treatment for 4, 12 and 26 weeks, we assessed resting energy expenditure (REE) by indirect calorimetry. Furthermore, at baseline and after 26 weeks, we determined the fat fraction in the supraclavicular BAT depot using chemical-shift water-fat MRI at 3T. Liraglutide reduced REE after 4 weeks, which persisted after 12 weeks and tended to be present after 26 weeks (week 26 vs baseline: liraglutide -52 ± 128 kcal/day; P = 0.071, placebo +44 ± 144 kcal/day; P = 0.153, between group P = 0.057). Treatment with liraglutide for 26 weeks did not decrease the fat fraction in supraclavicular BAT (-0.4 ± 1.7%; P = 0.447) compared to placebo (-0.4 ± 1.4%; P = 0.420; between group P = 0.911). CONCLUSION: Treatment with liraglutide decreases REE in the first 12 weeks and tends to decrease this after 26 weeks without affecting the fat fraction in the supraclavicular BAT depot. These findings suggest reduction in energy intake rather than an increase in REE to contribute to the liraglutide-induced weight loss. TRIAL REGISTRY NUMBER: NCT01761318.

Deep learning algorithm detection of Barrett's neoplasia with high accuracy during live endoscopic procedures: a pilot study (with video).

BACKGROUND AND AIMS: We assessed the preliminary diagnostic accuracy of a recently developed computer-aided detection (CAD) system for detection of Barrett's neoplasia during live endoscopic procedures. METHODS: The CAD system was tested during endoscopic procedures in 10 patients with nondysplastic Barrett's esophagus (NDBE) and 10 patients with confirmed Barrett's neoplasia. White-light endoscopy images were obtained at every 2-cm level of the Barrett's segment and immediately analyzed by the CAD system, providing instant feedback to the endoscopist. At every level, 3 images were evaluated by the CAD system. Outcome measures were diagnostic performance of the CAD system per level and per patient, defined as accuracy, sensitivity, and specificity (ground truth was established by expert assessment and corresponding histopathology), and concordance of 3 sequential CAD predictions per level. RESULTS: Accuracy, sensitivity, and specificity of the CAD system in a per-level analyses were 90%, 91%, and 89%, respectively. Nine of 10 neoplastic patients were correctly diagnosed. The single lesion not detected by CAD showed NDBE in the endoscopic resection specimen. In only 1 NDBE patient, the CAD system produced false-positive predictions. In 75% of all levels, the CAD system produced 3 concordant predictions. CONCLUSIONS: This is one of the first studies to evaluate a CAD system for Barrett's neoplasia during live endoscopic procedures. The system detected neoplasia with high accuracy, with only a small number of false-positive predictions and with a high concordance rate between separate predictions. The CAD system is thereby ready for testing in larger, multicenter trials. (Clinical trial registration number: NL7544.).

Stationary Computed Tomography for Space and other Resource-constrained Environments.

Computed tomography (CT) is used to diagnose many emergent medical conditions, including stroke and traumatic brain injuries. Unfortunately, the size, weight, and expense of CT systems make them largely inaccessible for patients outside of major hospitals. We have designed a module containing multiple miniature x-ray sources that could allow for CT systems to be significantly lighter, smaller, and cheaper, and to operate without any moving parts. We have developed a novel photocathode-based x-ray source, created by depositing a thin film of magnesium on an electron multiplier. When illuminated by a UV LED, this photocathode emits a beam of electrons, with a beam current of up to 1 mA. The produced electrons are accelerated through a high voltage to a tungsten target. These sources are individually addressable and can be pulsed rapidly, through electronic control of the LEDs. Seven of these sources are housed together in a 17.5 degree arc within a custom vacuum manifold. A full ring of these modules could be used for CT imaging. By pulsing the sources in series, we are able to demonstrate x-ray tomosynthesis without any moving parts. With a clinical flat-panel detector, we demonstrate 3D acquisition and reconstructions of a cadaver swine lung.