Hyperspectral Imaging in Brain Tumor Surgery-Evidence of Machine Learning-Based Performance.

BACKGROUND: Hyperspectral imaging (HSI) has the potential to enhance surgical tissue detection and diagnostics. Definite utilization of intraoperative HSI guidance demands validated machine learning and public datasets that currently do not exist. Moreover, current imaging conventions are dispersed, and evidence-based paradigms for neurosurgical HSI have not been declared. METHODS: We presented the rationale and a detailed clinical paradigm for establishing microneurosurgical HSI guidance. In addition, a systematic literature review was conducted to summarize the current indications and performance of neurosurgical HSI systems, with an emphasis on machine learning-based methods. RESULTS: The published data comprised a few case series or case reports aiming to classify tissues during glioma operations. For a multitissue classification problem, the highest overall accuracy of 80% was obtained using deep learning. Our HSI system was capable of intraoperative data acquisition and visualization with minimal disturbance to glioma surgery. CONCLUSIONS: In a limited number of publications, neurosurgical HSI has demonstrated unique capabilities in contrast to the established imaging techniques. Multidisciplinary work is required to establish communicable HSI standards and clinical impact. Our HSI paradigm endorses systematic intraoperative HSI data collection, which aims to facilitate the related standards, medical device regulations, and value-based medical imaging systems.

The Optimization of the Light-Source Spectrum Utilizing Neural Networks for Detecting Oral Lesions.

Any change in the light-source spectrum modifies the color information of an object. The spectral distribution of the light source can be optimized to enhance specific details of the obtained images; thus, using information-enhanced images is expected to improve the image recognition performance via machine vision. However, no studies have applied light spectrum optimization to reduce the training loss in modern machine vision using deep learning. Therefore, we propose a method for optimizing the light-source spectrum to reduce the training loss using neural networks. A two-class classification of one-vs-rest among the classes, including enamel as a healthy condition and dental lesions, was performed to validate the proposed method. The proposed convolutional neural network-based model, which accepts a 5 × 5 small patch image, was compared with an alternating optimization scheme using a linear-support vector machine that optimizes classification weights and lighting weights separately. Furthermore, it was compared with the proposed neural network-based algorithm, which inputs a pixel and consists of fully connected layers. The results of the five-fold cross-validation revealed that, compared to the previous method, the proposed method improved the F1-score and was superior to the models that were using the immutable standard illuminant D65.

Transmission filters forming orthogonal basis for spectral imaging purposes.

Hyperspectral imaging has become a common technique in many different applications, enabling accurate identification of materials based on their optical properties; however, it requires complex and expensive technical implementation. A less expensive way to produce spectral data, spectral estimation, suffers from complex mathematics and limited accuracy. We introduce a novel, to the best of our knowledge, method where spectral reflectance curves can be reconstructed from the measured camera responses without complex mathematics. We have simulated the method with seven non-negative broadband transmission filters extracted from Munsell color data through principal component analysis and used sensitivity and noise levels characteristic of the Retiga 4000DC 12-bit monochrome camera. The method is sensitive to noise but produces sufficient reproduction accuracy even with six filters.

Optical implementation of partially negative filters using a spectrally tunable light source, and its application to contrast enhanced oral and dental imaging.

In optical imaging, optical filters can be used to enhance the visibility of features-of-interest and thus aid in visualization. Optical filter design based on hyperspectral imaging employs various statistical methods to find an optimal design. Some methods, like principal component analysis, produce vectors that can be interpreted as filters that have a partially negative transmission spectrum. These filters, however, are not directly implementable optically. Earlier implementations of partially negative filters have concentrated on spectral reconstruction. Here we show a novel method for implementing partially negative optical filters for contrast-enhancement purposes in imaging applications. We describe the method and its requirements, and show its feasibility with color chart and dental imaging examples. The results are promising: visual comparison of computational color chart render and optical measurement show matching images, and visual inspection of dental images show increased contrast.

Performance comparison of publicly available retinal blood vessel segmentation methods.

Retinal blood vessel structure is an important indicator of many retinal and systemic diseases, which has motivated the development of various image segmentation methods for the blood vessels. In this study, two supervised and three unsupervised segmentation methods with a publicly available implementation are reviewed and quantitatively compared with each other on five public databases with ground truth segmentation of the vessels. Each method is tested under consistent conditions with two types of preprocessing, and the parameters of the methods are optimized for each database. Additionally, possibility to predict the parameters of the methods by the linear regression model is tested for each database. Resolution of the input images and amount of the vessel pixels in the ground truth are used as predictors. The results show the positive influence of preprocessing on the performance of the unsupervised methods. The methods show similar performance for segmentation accuracy, with the best performance achieved by the method by Azzopardi et al. (Acc 94.0) on ARIADB, the method by Soares et al. (Acc 94.6, 94.7) on CHASEDB1 and DRIVE, and the method by Nguyen et al. (Acc 95.8, 95.5) on HRF and STARE. The method by Soares et al. performed better with regard to the area under the ROC curve. Qualitative differences between the methods are discussed. Finally, it was possible to predict the parameter settings that give performance close to the optimized performance of each method.

Objective identification of dental abnormalities with multispectral fluorescence imaging.

Sensitive methods that can enable early detection of dental diseases (caries and calculus) are desirable in clinical practice. Optical spectroscopic approaches have emerged as promising alternatives owing to their wealth of molecular information and lack of sample preparation requirements. In the present study, using multispectral fluorescence imaging, we have demonstrated that dental caries and calculus can be objectively identified on extracted tooth. Spectral differences among control, carious and calculus conditions were attributed to the porphyrin pigment content, which is a byproduct of bacterial metabolism. Spectral maps generated using different porphyrin bands offer important clues to the spread of bacterial infection. Statistically significant differences utilizing fluorescence intensity ratios were observed among three groups. In contrast to laser induced fluorescence, these methods can provide information about exact spread of the infection and may aid in long term dental monitoring. Successful adoption of this approach for routine clinical usage can assist dentists in implementing timely remedial measures.