Computer-Aided Bleeding Detection Algorithms for Capsule Endoscopy: A Systematic Review.

Capsule endoscopy (CE) is a widely used medical imaging tool for the diagnosis of gastrointestinal tract abnormalities like bleeding. However, CE captures a huge number of image frames, constituting a time-consuming and tedious task for medical experts to manually inspect. To address this issue, researchers have focused on computer-aided bleeding detection systems to automatically identify bleeding in real time. This paper presents a systematic review of the available state-of-the-art computer-aided bleeding detection algorithms for capsule endoscopy. The review was carried out by searching five different repositories (Scopus, PubMed, IEEE Xplore, ACM Digital Library, and ScienceDirect) for all original publications on computer-aided bleeding detection published between 2001 and 2023. The Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) methodology was used to perform the review, and 147 full texts of scientific papers were reviewed. The contributions of this paper are: (I) a taxonomy for computer-aided bleeding detection algorithms for capsule endoscopy is identified; (II) the available state-of-the-art computer-aided bleeding detection algorithms, including various color spaces (RGB, HSV, etc.), feature extraction techniques, and classifiers, are discussed; and (III) the most effective algorithms for practical use are identified. Finally, the paper is concluded by providing future direction for computer-aided bleeding detection research.

A convolutional neural network for bleeding detection in capsule endoscopy using real clinical data.

BACKGROUND: The goal of the present study was to develop a convolutional neural network for the detection of bleedings in capsule endoscopy videos using realistic clinical data from one single-centre. METHODS: Capsule endoscopy videos from all 133 patients (79 male, 54 female; meanage = 53.73 years, SDage = 26.13) who underwent capsule endoscopy at our institution between January 2014 and August 2018 were screened for pathology. All videos were screened for pathology by two independent capsule experts and confirmed findings were checked again by a third capsule expert. From these videos, 125 pathological findings (individual episodes of bleeding spanning a total of 5696 images) and 103 non-pathological findings (sections of normal mucosal tissue without pathologies spanning a total of 7420 images) were used to develop and validate a neural network (Inception V3) using transfer learning. RESULTS: The overall accuracy of the model for the detection of bleedings was 90.6% [95%CI: 89.4%-91.7%], with a sensitivity of 89.4% [95%CI: 87.6%-91.2%] and a specificity of 91.7% [95%CI: 90.1%-93.2%]. CONCLUSION: Our results show that neural networks can detect bleedings in capsule endoscopy videos under realistic, clinical conditions with an accuracy of 90.6%, potentially reducing reading time per capsule and helping to improve diagnostic accuracy.

A Multi-Task Convolutional Neural Network for Semantic Segmentation and Event Detection in Laparoscopic Surgery.

The current study presents a multi-task end-to-end deep learning model for real-time blood accumulation detection and tools semantic segmentation from a laparoscopic surgery video. Intraoperative bleeding is one of the most problematic aspects of laparoscopic surgery. It is challenging to control and limits the visibility of the surgical site. Consequently, prompt treatment is required to avoid undesirable outcomes. This system exploits a shared backbone based on the encoder of the U-Net architecture and two separate branches to classify the blood accumulation event and output the segmentation map, respectively. Our main contribution is an efficient multi-task approach that achieved satisfactory results during the test on surgical videos, although trained with only RGB images and no other additional information. The proposed multi-tasking convolutional neural network did not employ any pre- or postprocessing step. It achieved a Dice Score equal to 81.89% for the semantic segmentation task and an accuracy of 90.63% for the event detection task. The results demonstrated that the concurrent tasks were properly combined since the common backbone extracted features proved beneficial for tool segmentation and event detection. Indeed, active bleeding usually happens when one of the instruments closes or interacts with anatomical tissues, and it decreases when the aspirator begins to remove the accumulated blood. Even if different aspects of the presented methodology could be improved, this work represents a preliminary attempt toward an end-to-end multi-task deep learning model for real-time video understanding.

Automated bleeding detection in wireless capsule endoscopy images based on color feature extraction from Gaussian mixture model superpixels.

Wireless capsule endoscopy is the commonly employed modality in the treatment of gastrointestinal tract pathologies. However, the time taken for interpretation of these images is very high due to the large volume of images generated. Automated detection of disorders with these images can facilitate faster clinical interventions. In this paper, we propose an automated system based on Gaussian mixture model superpixels for bleeding detection and segmentation of candidate regions. The proposed system is realized with a classic binary support vector machine classifier trained with seven features including color and texture attributes extracted from the Gaussian mixture model superpixels of the WCE images. On detection of bleeding images, bleeding regions are segmented from them, by incrementally grouping the superpixels based on deltaE color differences. Tested with standard datasets, this system exhibits best performance compared to the state-of-the-art approaches with respect to classification accuracy, feature selection, computational time, and segmentation accuracy. The proposed system achieves 99.88% accuracy, 99.83% sensitivity, and 100% specificity signifying the effectiveness of the proposed system in bleeding detection with very few classification errors.

Deep Transfer Learning for Automated Intestinal Bleeding Detection in Capsule Endoscopy Imaging.

PURPOSE: The objective of this paper was to develop a computer-aided diagnostic (CAD) tools for automated analysis of capsule endoscopic (CE) images, more precisely, detect small intestinal abnormalities like bleeding. METHODS: In particular, we explore a convolutional neural network (CNN)-based deep learning framework to identify bleeding and non-bleeding CE images, where a pre-trained AlexNet neural network is used to train a transfer learning CNN that carries out the identification. Moreover, bleeding zones in a bleeding-identified image are also delineated using deep learning-based semantic segmentation that leverages a SegNet deep neural network. RESULTS: To evaluate the performance of the proposed framework, we carry out experiments on two publicly available clinical datasets and achieve a 98.49% and 88.39% F1 score, respectively, on the capsule endoscopy.org and KID datasets. For bleeding zone identification, 94.42% global accuracy and 90.69% weighted intersection over union (IoU) are achieved. CONCLUSION: Finally, our performance results are compared to other recently developed state-of-the-art methods, and consistent performance advances are demonstrated in terms of performance measures for bleeding image and bleeding zone detection. Relative to the present and established practice of manual inspection and annotation of CE images by a physician, our framework enables considerable annotation time and human labor savings in bleeding detection in CE images, while providing the additional benefits of bleeding zone delineation and increased detection accuracy. Moreover, the overall cost of CE enabled by our framework will also be much lower due to the reduction of manual labor, which can make CE affordable for a larger population.

Deep transfer learning approaches for bleeding detection in endoscopy images.

Wireless capsule endoscopy is a non-invasive, wireless imaging tool that has developed rapidly over the last several years. One of the main limiting factors using this technology is that it produces a huge number of images, whose analysis, to be done by a doctor, is an extremely time-consuming process. In this research area, the management of this problem has been addressed with the development of Computer-aided Diagnosis systems thanks to which the automatic inspection and analysis of images acquired by the capsule has clearly improved. Recently, a big advance in classification of endoscopic images is achieved with the emergence of deep learning methods. The proposed expert system employs three pre-trained deep convolutional neural networks for feature extraction. In order to construct efficient feature sets, the features from VGG19, InceptionV3 and ResNet50 models are then selected and fused using the minimum Redundancy Maximum Relevance method and different fusion rules. Finally, supervised machine learning algorithms are employed to classify the images using the extracted features into two categories: bleeding and nonbleeding images. For performance evaluation a series of experiments are performed on two standard benchmark datasets. It has been observed that the proposed architecture outclass the single deep learning architectures, with an average accuracy in detection bleeding regions of 97.65 % and 95.70 % on well-known state-of-the-art datasets considering three different fusion rules, with the best combination in terms of accuracy and training time obtained using mean value pooling as fusion rule and Support Vector Machine as classifier.

An entropy-based approach to detect and localize intraoperative bleeding during minimally invasive surgery.

BACKGROUND: During minimally invasive surgery (either robotic or traditional laparoscopic), vascular injuries may occur because of inadvertent surgical tool movements or actions. These vascular injuries can lead to arterial or venous bleeding with varying degrees of severity that may be life-threatening. MATERIALS AND METHODS: Given that a bloody spot is characterized by homogenous and uniform texture, our algorithm automatically scans the entire surgical video frame- by- frame using a local entropy filter to segment each image into different regions sequence. By comparing changes in entropy in the frames sequences, the algorithm detects the moment of bleeding occurrence and its pixel location. We preliminarily tested the algorithm using ten minimally invasive-surgery videos., each of which contains one surgical-tool-induced bleeding. RESULTS: Our results show that the algorithm can detect bleeding within 0.635 s, on average, after their occurrences and locate the bleeding sources within, on average, 2.5% of discrepancy in pixels from their origins. CONCLUSION: In this study, we present a novel and promising local-entropy-based image processing algorithm that detects spurts of blood and locate their source in real-time.

Colored Video Analysis in Wireless Capsule Endoscopy: A Survey of State-of-the-Art.

Wireless Capsule Endoscopy (WCE) is a highly promising technology for gastrointestinal (GI) tract abnormality diagnosis. However, low image resolution and low frame rates are challenging issues in WCE. In addition, the relevant frames containing the features of interest for accurate diagnosis only constitute 1% of the complete video information. For these reasons, analyzing the WCE videos is still a time consuming and laborious examination for the gastroenterologists, which reduces WCE system usability. This leads to the emergent need to speed-up and automates the WCE video process for GI tract examinations. Consequently, the present work introduced the concept of WCE technology, including the structure of WCE systems, with a focus on the medical endoscopy video capturing process using image sensors. It discussed also the significant characteristics of the different GI tract for effective feature extraction. Furthermore, video approaches for bleeding and lesion detection in the WCE video were reported with computer-aided diagnosis systems in different applications to support the gastroenterologist in the WCE video analysis. In image enhancement, WCE video review time reduction is also discussed, while reporting the challenges and future perspectives, including the new trend to employ the deep learning models for feature Learning, polyp recognition, and classification, as a new opportunity for researchers to develop future WCE video analysis techniques.

Pre-clinical study on a telemetric gastric sensor for recognition of acute upper gastrointestinal bleeding: the "HemoPill monitor".

BACKGROUND: Acute upper gastrointestinal bleeding is a life-threatening medical condition with a relevant risk of re-bleeding even after initial endoscopic hemostasis. The implantable HemoPill monitor contains a novel telemetric sensor to optically detect blood in the stomach allowing the surveillance of high-risk patients for re-bleedings. METHODS: In this pre-clinical porcine study, bleeding has been simulated by injecting porcine blood into the stomach of a pig through an implanted catheter using a syringe pump. The effect of the sensor position in the stomach, the gastric food content, and the bleeding intensity was investigated. RESULTS: Sensitivity and specificity of the sensor reached more than 87.5% when the sensor was positioned close to the source of bleeding. Solid food had a higher negative impact on sensitivity than liquid food but a positive impact on specificity. A heavy bleeding was more likely to be detected by the sensor but was also associated with a lower likelihood for true-negative results than weaker bleedings. CONCLUSIONS: The study clearly demonstrated the capability of the HemoPill sensor prototype to detect clinically relevant bleedings with high sensitivity and specificity (> 80%) when the sensor was positioned close to the bleeding site. The sensors proved to be robust against artefact effects from stomach content. These are favorable findings that underline the potential benefit for the use of the HemoPill sensor in monitoring patients with a risk of re-bleeding in the upper gastrointestinal tract.

Probability density function based modeling of spatial feature variation in capsule endoscopy data for automatic bleeding detection.

Wireless capsule endoscopy (WCE) is a video technology to inspect abnormalities, like bleeding in the gastrointestinal tract. In order to avoid a complex and long duration manual review process, automatic bleeding detection schemes are developed that mainly utilize features extracted from WCE images. In feature-based bleeding detection schemes, either global features are used which produce averaged characteristics ignoring the effect of smaller bleeding regions or local features are utilized that cause large feature dimension. In this paper, pixels of interest (POI) in a given WCE image are determined using a linear separation scheme, local spatial features are then extracted from the POI and finally, a suitable characteristic probability density function (PDF) is fitted over the resulting feature space. The proposed PDF model fitting based approach not only reduces the computational complexity but also offers more consistent representation of a class. Details analysis are carried out to find the best suitable PDF and it is found that fitting of Rayleigh PDF model to the local spatial features is best suited for bleeding detection. For the purpose of classification, the fitted PDF parameters are used as features in the supervised support vector machine classifier. Pixels residing in the close vicinity of the POI are further classified with the help of an unsupervised clustering-based scheme to extract more precise bleeding regions. A large number of WCE images obtained from 30 publicly available WCE videos are used for performance evaluation of the proposed scheme and the effects on classification performance due to the changes in PDF models, block statistics, color spaces, and classifiers are experimentally analyzed. The proposed scheme shows satisfactory performance in terms of sensitivity (97.55%), specificity (96.59%) and accuracy (96.77%) and the results obtained by the proposed method outperforms the results reported for some state-of-the-art methods.

Bleeding detection in wireless capsule endoscopy videos - Color versus texture features.

Wireless capsule endoscopy (WCE) is an effective technology that can be used to make a gastrointestinal (GI) tract diagnosis of various lesions and abnormalities. Due to a long time required to pass through the GI tract, the resulting WCE data stream contains a large number of frames which leads to a tedious job for clinical experts to perform a visual check of each and every frame of a complete patient's video footage. In this paper, an automated technique for bleeding detection based on color and texture features is proposed. The approach combines the color information which is an essential feature for initial detection of frame with bleeding. Additionally, it uses the texture which plays an important role to extract more information from the lesion captured in the frames and allows the system to distinguish finely between borderline cases. The detection algorithm utilizes machine-learning-based classification methods, and it can efficiently distinguish between bleeding and nonbleeding frames and perform pixel-level segmentation of bleeding areas in WCE frames. The performed experimental studies demonstrate the performance of the proposed bleeding detection method in terms of detection accuracy, where we are at least as good as the state-of-the-art approaches. In this research, we have conducted a broad comparison of a number of different state-of-the-art features and classification methods that allows building an efficient and flexible WCE video processing system.

CHOBS: Color Histogram of Block Statistics for Automatic Bleeding Detection in Wireless Capsule Endoscopy Video.

Wireless capsule endoscopy (WCE) is the most advanced technology to visualize whole gastrointestinal (GI) tract in a non-invasive way. But the major disadvantage here, it takes long reviewing time, which is very laborious as continuous manual intervention is necessary. In order to reduce the burden of the clinician, in this paper, an automatic bleeding detection method for WCE video is proposed based on the color histogram of block statistics, namely CHOBS. A single pixel in WCE image may be distorted due to the capsule motion in the GI tract. Instead of considering individual pixel values, a block surrounding to that individual pixel is chosen for extracting local statistical features. By combining local block features of three different color planes of RGB color space, an index value is defined. A color histogram, which is extracted from those index values, provides distinguishable color texture feature. A feature reduction technique utilizing color histogram pattern and principal component analysis is proposed, which can drastically reduce the feature dimension. For bleeding zone detection, blocks are classified using extracted local features that do not incorporate any computational burden for feature extraction. From extensive experimentation on several WCE videos and 2300 images, which are collected from a publicly available database, a very satisfactory bleeding frame and zone detection performance is achieved in comparison to that obtained by some of the existing methods. In the case of bleeding frame detection, the accuracy, sensitivity, and specificity obtained from proposed method are 97.85%, 99.47%, and 99.15%, respectively, and in the case of bleeding zone detection, 95.75% of precision is achieved. The proposed method offers not only low feature dimension but also highly satisfactory bleeding detection performance, which even can effectively detect bleeding frame and zone in a continuous WCE video data.

Cluster based statistical feature extraction method for automatic bleeding detection in wireless capsule endoscopy video.

Wireless capsule endoscopy (WCE) is capable of demonstrating the entire gastrointestinal tract at an expense of exhaustive reviewing process for detecting bleeding disorders. The main objective is to develop an automatic method for identifying the bleeding frames and zones from WCE video. Different statistical features are extracted from the overlapping spatial blocks of the preprocessed WCE image in a transformed color plane containing green to red pixel ratio. The unique idea of the proposed method is to first perform unsupervised clustering of different blocks for obtaining two clusters and then extract cluster based features (CBFs). Finally, a global feature consisting of the CBFs and differential CBF is used to detect bleeding frame via supervised classification. In order to handle continuous WCE video, a post-processing scheme is introduced utilizing the feature trends in neighboring frames. The CBF along with some morphological operations is employed to identify bleeding zones. Based on extensive experimentation on several WCE videos, it is found that the proposed method offers significantly better performance in comparison to some existing methods in terms of bleeding detection accuracy, sensitivity, specificity and precision in bleeding zone detection. It is found that the bleeding detection performance obtained by using the proposed CBF based global feature is better than the feature extracted from the non-clustered image. The proposed method can reduce the burden of physicians in investigating WCE video to detect bleeding frame and zone with a high level of accuracy.

Detection of small colon bleeding in wireless capsule endoscopy videos.

In the recent years, wireless capsule endoscopy (WCE) technology has played a very important role in diagnosing diseases within the gastro intestinal (GI) tract of human beings. The WCE device captures images of the GI tract of patient with a certain frame rate. Physicians examine these images in order to find abnormalities in the GI tract. This examination process is very time consuming and hectic for the physician as a WCE device captures around 60,000 images on the average. At present, there are no standards defined for the WCE image classification. Computer aided methods help reducing the burden on the physicians by automatically detecting the abnormalities in the GI tract such as small colon bleeding. In this paper, a pixel based approach to detect bleeding regions in the WCE videos by using a support vector classifier is proposed. Threshold analysis in HSV color space is performed to compute the features for training an optimal support vector machine. The HSV features of the WCE images are fed to the trained support vector classifier for classification. Also, our method includes image enhancement and edge removal in WCE images, which is done prior to classification, for robust results. The method offers high sensitivity, specificity and accuracy in terms of correctly classifying images that contain bleeding regions as compared to another contemporary method. A detailed experimental analysis is also provided for the purpose of method evaluation.

Computer-aided gastrointestinal hemorrhage detection in wireless capsule endoscopy videos.

BACKGROUND AND OBJECTIVE: Wireless Capsule Endoscopy (WCE) can image the portions of the human gastrointestinal tract that were previously unreachable for conventional endoscopy examinations. A major drawback of this technology is that a large volume of data are to be analyzed in order to detect a disease which can be time-consuming and burdensome for the clinicians. Consequently, there is a dire need of computer-aided disease detection schemes to assist the clinicians. In this paper, we propose a real-time, computationally efficient and effective computerized bleeding detection technique applicable for WCE technology. METHODS: The development of our proposed technique is based on the observation that characteristic patterns appear in the frequency spectrum of the WCE frames due to the presence of bleeding region. Discovering these discriminating patterns, we develop a texture-feature-descriptor-based-algorithm that operates on the Normalized Gray Level Co-occurrence Matrix (NGLCM) of the magnitude spectrum of the images. A new local texture descriptor called difference average that operates on NGLCM is also proposed. We also perform statistical validation of the proposed scheme. RESULTS: The proposed algorithm was evaluated using a publicly available WCE database. The training set consisted of 600 bleeding and 600 non-bleeding frames. This set was used to train the SVM classifier. On the other hand, 860 bleeding and 860 non-bleeding images were selected from the rest of the extracted images to form the test set. The accuracy, sensitivity and specificity obtained from our method are 99.19%, 99.41% and 98.95% respectively which are significantly higher than state-of-the-art methods. In addition, the low computational cost of our method makes it suitable for real-time implementation. CONCLUSION: This work proposes a bleeding detection algorithm that employs textural features from the magnitude spectrum of the WCE images. Experimental outcomes backed by statistical validations prove that the proposed algorithm is superior to the existing ones in terms of accuracy, sensitivity, specificity and computational cost.