Tongue Tumor Detection in Hyperspectral Images Using Deep Learning Semantic Segmentation.

OBJECTIVE: The utilization of hyperspectral imaging (HSI) in real-time tumor segmentation during a surgery have recently received much attention, but it remains a very challenging task. METHODS: In this work, we propose semantic segmentation methods, and compare them with other relevant deep learning algorithms for tongue tumor segmentation. To the best of our knowledge, this is the first work using deep learning semantic segmentation for tumor detection in HSI data using channel selection, and accounting for more spatial tissue context, and global comparison between the prediction map, and the annotation per sample. Results, and Conclusion: On a clinical data set with tongue squamous cell carcinoma, our best method obtains very strong results of average dice coefficient, and area under the ROC-curve of [Formula: see text], and [Formula: see text], respectively on the original spatial image size. The results show that a very good performance can be achieved even with a limited amount of data. We demonstrate that important information regarding tumor decision is encoded in various channels, but some channel selection, and filtering is beneficial over the full spectra. Moreover, we use both visual (VIS), and near-infrared (NIR) spectrum, rather than commonly used only VIS spectrum; although VIS spectrum is generally of higher significance, we demonstrate NIR spectrum is crucial for tumor capturing in some cases. SIGNIFICANCE: The HSI technology augmented with accurate deep learning algorithms has a huge potential to be a promising alternative to digital pathology or a doctors' supportive tool in real-time surgeries.

Toward assessment of resection margins using hyperspectral diffuse reflection imaging (400-1,700 nm) during tongue cancer surgery.

BACKGROUND AND OBJECTIVES: There is a clinical need to assess the resection margins of tongue cancer specimens, intraoperatively. In the current ex vivo study, we evaluated the feasibility of hyperspectral diffuse reflectance imaging (HSI) for distinguishing tumor from the healthy tongue tissue. STUDY DESIGN/MATERIALS AND METHODS: Fresh surgical specimens (n = 14) of squamous cell carcinoma of the tongue were scanned with two hyperspectral cameras that cover the visible and near-infrared spectrum (400-1,700 nm). Each pixel of the hyperspectral image represents a measure of the diffuse optical reflectance. A neural network was used for tissue-type prediction of the hyperspectral images of the visual and near-infrared data sets separately as well as both data sets combined. RESULTS: HSI was able to distinguish tumor from muscle with a good accuracy. The diagnostic performance of both wavelength ranges (sensitivity/specificity of visual and near-infrared were 84%/80% and 77%/77%, respectively) appears to be comparable and there is no additional benefit of combining the two wavelength ranges (sensitivity and specificity were 83%/76%). CONCLUSIONS: HSI has a strong potential for intra-operative assessment of tumor resection margins of squamous cell carcinoma of the tongue. This may optimize surgery, as the entire resection surface can be scanned in a single run and the results can be readily available. Lasers Surg. Med. © 2019 Wiley Periodicals, Inc.