Resection Ratios and Tumor Eccentricity in Breast-Conserving Surgery Specimens for Surgical Accuracy Assessment.

This study aims to evaluate several defined specimen parameters that would allow to determine the surgical accuracy of breast-conserving surgeries (BCS) in a representative population of patients. These specimen parameters could be used to compare surgical accuracy when using novel technologies for intra-operative BCS guidance in the future. Different specimen parameters were determined among 100 BCS patients, including the ratio of specimen volume to tumor volume (resection ratio) with different optimal margin widths (0 mm, 1 mm, 2 mm, and 10 mm). Furthermore, the tumor eccentricity [maximum tumor-margin distance - minimum tumor-margin distance] and the relative tumor eccentricity [tumor eccentricity ÷ pathological tumor diameter] were determined. Different patient subgroups were compared using Wilcoxon rank sum tests. When using a surgical margin width of 0 mm, 1 mm, 2 mm, and 10 mm, on average, 19.16 (IQR 44.36), 9.94 (IQR 18.09), 6.06 (IQR 9.69) and 1.35 (IQR 1.78) times the ideal resection volume was excised, respectively. The median tumor eccentricity among the entire patient population was 11.29 mm (SD = 3.99) and the median relative tumor eccentricity was 0.66 (SD = 2.22). Resection ratios based on different optimal margin widths (0 mm, 1 mm, 2 mm, and 10 mm) and the (relative) tumor eccentricity could be valuable outcome measures to evaluate the surgical accuracy of novel technologies for intra-operative BCS guidance.

Margin assessment during breast conserving surgery using diffuse reflectance spectroscopy.

Significance: During breast-conserving surgeries, it is essential to evaluate the resection margins (edges of breast specimen) to determine whether the tumor has been removed completely. In current surgical practice, there are no methods available to aid in accurate real-time margin evaluation. Aim: In this study, we investigated the diagnostic accuracy of diffuse reflectance spectroscopy (DRS) combined with tissue classification models in discriminating tumorous tissue from healthy tissue up to 2 mm in depth on the actual resection margin of in vivo breast tissue. Approach: We collected an extensive dataset of DRS measurements on ex vivo breast tissue and in vivo breast tissue, which we used to develop different classification models for tissue classification. Next, these models were used in vivo to evaluate the performance of DRS for tissue discrimination during breast conserving surgery. We investigated which training strategy yielded optimum results for the classification model with the highest performance. Results: We achieved a Matthews correlation coefficient of 0.76, a sensitivity of 96.7% (95% CI 95.6% to 98.2%), a specificity of 90.6% (95% CI 86.3% to 97.9%) and an area under the curve of 0.98 by training the optimum model on a combination of ex vivo and in vivo DRS data. Conclusions: DRS allows real-time margin assessment with a high sensitivity and specificity during breast-conserving surgeries.

Spatial and Spectral Reconstruction of Breast Lumpectomy Hyperspectral Images.

(1) Background: Hyperspectral imaging has emerged as a promising margin assessment technique for breast-conserving surgery. However, to be implicated intraoperatively, it should be both fast and capable of yielding high-quality images to provide accurate guidance and decision-making throughout the surgery. As there exists a trade-off between image quality and data acquisition time, higher resolution images come at the cost of longer acquisition times and vice versa. (2) Methods: Therefore, in this study, we introduce a deep learning spatial-spectral reconstruction framework to obtain a high-resolution hyperspectral image from a low-resolution hyperspectral image combined with a high-resolution RGB image as input. (3) Results: Using the framework, we demonstrate the ability to perform a fast data acquisition during surgery while maintaining a high image quality, even in complex scenarios where challenges arise, such as blur due to motion artifacts, dead pixels on the camera sensor, noise from the sensor's reduced sensitivity at spectral extremities, and specular reflections caused by smooth surface areas of the tissue. (4) Conclusion: This gives the opportunity to facilitate an accurate margin assessment through intraoperative hyperspectral imaging.

Point Projection Mapping System for Tracking, Registering, Labeling, and Validating Optical Tissue Measurements.

The validation of newly developed optical tissue-sensing techniques for tumor detection during cancer surgery requires an accurate correlation with the histological results. Additionally, such an accurate correlation facilitates precise data labeling for developing high-performance machine learning tissue-classification models. In this paper, a newly developed Point Projection Mapping system will be introduced, which allows non-destructive tracking of the measurement locations on tissue specimens. Additionally, a framework for accurate registration, validation, and labeling with the histopathology results is proposed and validated on a case study. The proposed framework provides a more-robust and accurate method for the tracking and validation of optical tissue-sensing techniques, which saves time and resources compared to the available conventional techniques.

Toward the use of diffuse reflection spectroscopy for intra-operative tissue discrimination during sarcoma surgery.

Significance: Accurately distinguishing tumor tissue from normal tissue is crucial to achieve complete resections during soft tissue sarcoma (STS) surgery while preserving critical structures. Incomplete tumor resections are associated with an increased risk of local recurrence and worse patient prognosis. Aim: We evaluate the performance of diffuse reflectance spectroscopy (DRS) to distinguish tumor tissue from healthy tissue in STSs. Approach: DRS spectra were acquired from different tissue types on multiple locations in 20 freshly excised sarcoma specimens. A k-nearest neighbors classification model was trained to predict the tissue types of the measured locations, using binary and multiclass approaches. Results: Tumor tissue could be distinguished from healthy tissue with a classification accuracy of 0.90, sensitivity of 0.88, and specificity of 0.93 when well-differentiated liposarcomas were included. Excluding this subtype, the classification performance increased to an accuracy of 0.93, sensitivity of 0.94, and specificity of 0.93. The developed model showed a consistent performance over different histological subtypes and tumor locations. Conclusions: Automatic tissue discrimination using DRS enables real-time intra-operative guidance, contributing to more accurate STS resections.

Tumor Segmentation in Colorectal Ultrasound Images Using an Ensemble Transfer Learning Model: Towards Intra-Operative Margin Assessment.

Tumor boundary identification during colorectal cancer surgery can be challenging, and incomplete tumor removal occurs in approximately 10% of the patients operated for advanced rectal cancer. In this paper, a deep learning framework for automatic tumor segmentation in colorectal ultrasound images was developed, to provide real-time guidance on resection margins using intra-operative ultrasound. A colorectal ultrasound dataset was acquired consisting of 179 images from 74 patients, with ground truth tumor annotations based on histopathology results. To address data scarcity, transfer learning techniques were used to optimize models pre-trained on breast ultrasound data for colorectal ultrasound data. A new custom gradient-based loss function (GWDice) was developed, which emphasizes the clinically relevant top margin of the tumor while training the networks. Lastly, ensemble learning methods were applied to combine tumor segmentation predictions of multiple individual models and further improve the overall tumor segmentation performance. Transfer learning outperformed training from scratch, with an average Dice coefficient over all individual networks of 0.78 compared to 0.68. The new GWDice loss function clearly decreased the average tumor margin prediction error from 1.08 mm to 0.92 mm, without compromising the segmentation of the overall tumor contour. Ensemble learning further improved the Dice coefficient to 0.84 and the tumor margin prediction error to 0.67 mm. Using transfer and ensemble learning strategies, good tumor segmentation performance was achieved despite the relatively small dataset. The developed US segmentation model may contribute to more accurate colorectal tumor resections by providing real-time intra-operative feedback on tumor margins.

Diffuse reflectance spectroscopy for accurate margin assessment in breast-conserving surgeries: importance of an optimal number of fibers.

During breast-conserving surgeries, it remains challenging to accomplish adequate surgical margins. We investigated different numbers of fibers for fiber-optic diffuse reflectance spectroscopy to differentiate tumorous breast tissue from healthy tissue ex vivo up to 2 mm from the margin. Using a machine-learning classification model, the optimal performance was obtained using at least three emitting fibers (Matthew's correlation coefficient (MCC) of 0.73), which was significantly higher compared to the performance of using a single-emitting fiber (MCC of 0.48). The percentage of correctly classified tumor locations varied from 75% to 100% depending on the tumor percentage, the tumor-margin distance and the number of fibers.

Tissue Classification of Breast Cancer by Hyperspectral Unmixing.

(1) Background: Assessing the resection margins during breast-conserving surgery is an important clinical need to minimize the risk of recurrent breast cancer. However, currently there is no technique that can provide real-time feedback to aid surgeons in the margin assessment. Hyperspectral imaging has the potential to overcome this problem. To classify resection margins with this technique, a tissue discrimination model should be developed, which requires a dataset with accurate ground-truth labels. However, establishing such a dataset for resection specimens is difficult. (2) Methods: In this study, we therefore propose a novel approach based on hyperspectral unmixing to determine which pixels within hyperspectral images should be assigned to the ground-truth labels from histopathology. Subsequently, we use this hyperspectral-unmixing-based approach to develop a tissue discrimination model on the presence of tumor tissue within the resection margins of ex vivo breast lumpectomy specimens. (3) Results: In total, 372 measured locations were included on the lumpectomy resection surface of 189 patients. We achieved a sensitivity of 0.94, specificity of 0.85, accuracy of 0.87, Matthew's correlation coefficient of 0.71, and area under the curve of 0.92. (4) Conclusion: Using this hyperspectral-unmixing-based approach, we demonstrated that the measured locations with hyperspectral imaging on the resection surface of lumpectomy specimens could be classified with excellent performance.

Toward Intraoperative Margin Assessment Using a Deep Learning-Based Approach for Automatic Tumor Segmentation in Breast Lumpectomy Ultrasound Images.

There is an unmet clinical need for an accurate, rapid and reliable tool for margin assessment during breast-conserving surgeries. Ultrasound offers the potential for a rapid, reproducible, and non-invasive method to assess margins. However, it is challenged by certain drawbacks, including a low signal-to-noise ratio, artifacts, and the need for experience with the acquirement and interpretation of images. A possible solution might be computer-aided ultrasound evaluation. In this study, we have developed new ensemble approaches for automated breast tumor segmentation. The ensemble approaches to predict positive and close margins (distance from tumor to margin ≤ 2.0 mm) in the ultrasound images were based on 8 pre-trained deep neural networks. The best optimum ensemble approach for segmentation attained a median Dice score of 0.88 on our data set. Furthermore, utilizing the segmentation results we were able to achieve a sensitivity of 96% and a specificity of 76% for predicting a close margin when compared to histology results. The promising results demonstrate the capability of AI-based ultrasound imaging as an intraoperative surgical margin assessment tool during breast-conserving surgery.

Diffuse reflection spectroscopy at the fingertip: design and performance of a compact side-firing probe for tissue discrimination during colorectal cancer surgery.

Optical technologies are widely used for tissue sensing purposes. However, maneuvering conventional probe designs with flat-tipped fibers in narrow spaces can be challenging, for instance during pelvic colorectal cancer surgery. In this study, a compact side-firing fiber probe was developed for tissue discrimination during colorectal cancer surgery using diffuse reflectance spectroscopy. The optical behavior was compared to flat-tipped fibers using both Monte Carlo simulations and experimental phantom measurements. The tissue classification performance was examined using freshly excised colorectal cancer specimens. Using the developed probe and classification algorithm, an accuracy of 0.92 was achieved for discriminating tumor tissue from healthy tissue.

Discriminating healthy from tumor tissue in breast lumpectomy specimens using deep learning-based hyperspectral imaging.

Achieving an adequate resection margin during breast-conserving surgery remains challenging due to the lack of intraoperative feedback. Here, we evaluated the use of hyperspectral imaging to discriminate healthy tissue from tumor tissue in lumpectomy specimens. We first used a dataset obtained on tissue slices to develop and evaluate three convolutional neural networks. Second, we fine-tuned the networks with lumpectomy data to predict the tissue percentages of the lumpectomy resection surface. A MCC of 0.92 was achieved on the tissue slices and an RMSE of 9% on the lumpectomy resection surface. This shows the potential of hyperspectral imaging to classify the resection margins of lumpectomy specimens.

Layer thickness prediction and tissue classification in two-layered tissue structures using diffuse reflectance spectroscopy.

During oncological surgery, it can be challenging to identify the tumor and establish adequate resection margins. This study proposes a new two-layer approach in which diffuse reflectance spectroscopy (DRS) is used to predict the top layer thickness and classify the layers in two-layered phantom and animal tissue. Using wavelet-based and peak-based DRS spectral features, the proposed method could predict the top layer thickness with an accuracy of up to 0.35 mm. In addition, the tissue types of the first and second layers were classified with an accuracy of 0.95 and 0.99. Distinguishing multiple tissue layers during spectral analyses results in a better understanding of more complex tissue structures encountered in surgical practice.

Nonlinear multispectral imaging for tumor delineation.

SIGNIFICANCE: In breast-preserving tumor surgery, the inspection of the excised tissue boundaries for tumor residue is too slow to provide feedback during the surgery. The discovery of positive margins requires a new surgery which is difficult and associated with low success. If the re-excision could be done immediately this is believed to improve the success rate considerably. AIM: Our aim is for a fast microscopic analysis that can be done directly on the excised tissue in or near the operating theatre. APPROACH: We demonstrate the combination of three nonlinear imaging techniques at selected wavelengths to delineate tumor boundaries. We use hyperspectral coherent anti-Stokes Raman scattering (CARS), second harmonic generation (SHG), and two-photon excited fluorescence (TPF) on excised patient tissue. RESULTS: We show the discriminatory power of each of the signals and demonstrate a sensitivity of 0.87 and a specificity of 0.95 using four CARS wavelengths in combination with SHG and TPF. We verify that the information is independent of sample treatment. CONCLUSIONS: Nonlinear multispectral imaging can be used to accurately determine tumor boundaries. This demonstration using microscopy in the epi-direction directly on thick tissue slices brings this technology one step closer to clinical implementation.

From Local to Global: A Graph Framework for Retinal Artery/Vein Classification.

Fundus photography has been widely used for inspecting eye disorders by ophthalmologists or computer algorithms. Biomarkers related to retinal vessels plays an essential role to detect early diabetes. To quantify vascular biomarkers or the corresponding changes, an accurate artery and vein classification is necessary. In this work, we propose a new framework to boost local vessel classification with a global vascular network model using graph convolution. We compare our proposed method with two traditional state-of-the-art methods on a testing dataset of 750 images from the Maastricht Study. After incorporating global information, our model achieves the best accuracy of 86.45% compared to 85.5% from convolutional neural networks (CNN) and 82.9% from handcrafted pixel feature classification (HPFC). Our model also obtains the best area under receiver operating characteristic curve (AUC) of 0.95, compared to 0.93 from CNN and 0.90 from HPFC. The new classification framework has the advantage of easy deployment on top of local classification features. It corrects the local classification error by minimizing global classification error and it brings free additional classification performance.

Type 2 diabetes and HbA1c are independently associated with wider retinal arterioles: the Maastricht study.

AIMS/HYPOTHESIS: Retinal microvascular diameters are biomarkers of cardio-metabolic risk. However, the association of (pre)diabetes with retinal microvascular diameters remains unclear. We aimed to investigate the association of prediabetes (impaired fasting glucose or impaired glucose tolerance) and type 2 diabetes with retinal microvascular diameters in a predominantly white population. METHODS: In a population-based cohort study with oversampling of type 2 diabetes (N = 2876; n = 1630 normal glucose metabolism [NGM], n = 433 prediabetes and n = 813 type 2 diabetes, 51.2% men, aged 59.8 ± 8.2 years; 98.6% white), we determined retinal microvascular diameters (measurement unit as measured by retinal health information and notification system [RHINO] software) and glucose metabolism status (using OGTT). Associations were assessed with multivariable regression analyses adjusted for age, sex, waist circumference, smoking, systolic blood pressure, lipid profile and the use of lipid-modifying and/or antihypertensive medication. RESULTS: Multivariable regression analyses showed a significant association for type 2 diabetes but not for prediabetes with arteriolar width (vs NGM; prediabetes: ß = 0.62 [95%CI -1.58, 2.83]; type 2 diabetes: 2.89 [0.69, 5.08]; measurement unit); however, there was a linear trend for the arteriolar width across glucose metabolism status (p for trend = 0.013). The association with wider venules was not statistically significant (prediabetes: 2.40 [-1.03, 5.84]; type 2 diabetes: 2.87 [-0.55, 6.29], p for trend = 0.083; measurement unit). Higher HbA1c levels were associated with wider retinal arterioles (standardised ß = 0.043 [95% CI 0.00002, 0.085]; p = 0.050) but the association with wider venules did not reach statistical significance (0.037 [-0.006, 0.080]; p = 0.092) after adjustment for potential confounders. CONCLUSIONS/INTERPRETATION: Type 2 diabetes, higher levels of HbA1c and, possibly, prediabetes, are independently associated with wider retinal arterioles in a predominantly white population. These findings indicate that microvascular dysfunction is an early phenomenon in impaired glucose metabolism.

Optimizing algorithm development for tissue classification in colorectal cancer based on diffuse reflectance spectra.

Diffuse reflectance spectroscopy can be used in colorectal cancer surgery for tissue classification. The main challenge in the classification task is to separate healthy colorectal wall from tumor tissue. In this study, four normalization techniques, four feature extraction methods and five classifiers are applied to nine datasets, to obtain the optimal method to separate spectra measured on healthy colorectal wall from spectra measured on tumor tissue. All results are compared to the use of the entire non-normalized spectra. It is found that the most optimal classification approach is to apply a feature extraction method on non-normalized spectra combined with support vector machine or neural network classifier.

Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information.

Complete tumor removal during breast-conserving surgery remains challenging due to the lack of optimal intraoperative margin assessment techniques. Here, we use hyperspectral imaging for tumor detection in fresh breast tissue. We evaluated different wavelength ranges and two classification algorithms; a pixel-wise classification algorithm and a convolutional neural network that combines spectral and spatial information. The highest classification performance was obtained using the full wavelength range (450-1650 nm). Adding spatial information mainly improved the differentiation of tissue classes within the malignant and healthy classes. High sensitivity and specificity were accomplished, which offers potential for hyperspectral imaging as a margin assessment technique to improve surgical outcome.

Toward complete oral cavity cancer resection using a handheld diffuse reflectance spectroscopy probe.

This ex-vivo study evaluates the feasibility of diffuse reflectance spectroscopy (DRS) for discriminating tumor from healthy tissue, with the aim to develop a technology that can assess resection margins for the presence of tumor cells during oral cavity cancer surgery. Diffuse reflectance spectra were acquired on fresh surgical specimens from 28 patients with oral cavity squamous cell carcinoma. The spectra (400 to 1600 nm) were detected after illuminating tissue with a source fiber at 0.3-, 0.7-, 1.0-, and 2.0-mm distances from a detection fiber, obtaining spectral information from different sampling depths. The spectra were correlated with histopathology. A total of 76 spectra were obtained from tumor tissue and 110 spectra from healthy muscle tissue. The first- and second-order derivatives of the spectra were calculated and a classification algorithm was developed using fivefold cross validation with a linear support vector machine. The best results were obtained by the reflectance measured with a 1-mm source-detector distance (sensitivity, specificity, and accuracy are 89%, 82%, and 86%, respectively). DRS can accurately discriminate tumor from healthy tissue in an ex-vivo setting using a 1-mm source-detector distance. Accurate validation methods are warranted for larger sampling depths to allow for guidance during oral cavity cancer excision.

Retinal artery/vein classification using genetic-search feature selection.

BACKGROUND AND OBJECTIVES: The automatic classification of retinal blood vessels into artery and vein (A/V) is still a challenging task in retinal image analysis. Recent works on A/V classification mainly focus on the graph analysis of the retinal vasculature, which exploits the connectivity of vessels to improve the classification performance. While they have overlooked the importance of pixel-wise classification to the final classification results. This paper shows that a complicated feature set is efficient for vessel centerline pixels classification. METHODS: We extract enormous amount of features for vessel centerline pixels, and apply a genetic-search based feature selection technique to obtain the optimal feature subset for A/V classification. RESULTS: The proposed method achieves an accuracy of 90.2%, the sensitivity of 89.6%, the specificity of 91.3% on the INSPIRE dataset. It shows that our method, using only the information of centerline pixels, gives a comparable performance as the techniques which use complicated graph analysis. In addition, the results on the images acquired by different fundus cameras show that our framework is capable for discriminating vessels independent of the imaging device characteristics, image resolution and image quality. CONCLUSION: The complicated feature set is essential for A/V classification, especially on the individual vessels where graph-based methods receive limitations. And it could provide a higher entry to the graph-analysis to achieve a better A/V labeling.

Retinal Microaneurysms Detection Using Local Convergence Index Features.

Retinal microaneurysms (MAs) are the earliest clinical sign of diabetic retinopathy disease. Detection of MAs is crucial for the early diagnosis of diabetic retinopathy and prevention of blindness. In this paper, a novel and reliable method for automatic detection of MAs in retinal images is proposed. In the first stage of the proposed method, several preliminary microaneurysm candidates are extracted using a gradient weighting technique and an iterative thresholding approach. In the next stage, in addition to intensity and shape descriptors, a new set of features based on local convergence index filters is extracted for each candidate. Finally, the collective set of features is fed to a hybrid sampling/boosting classifier to discriminate the MAs from non-MAs candidates. The method is evaluated on images with different resolutions and modalities (color and scanning laser ophthalmoscope) using six publicly available data sets including the retinopathy online challenges (ROC) data set. The proposed method achieves an average sensitivity score of 0.471 on the ROC data set outperforming state-of-the-art approaches in an extensive comparison. The experimental results on the other five data sets demonstrate the effectiveness and robustness of the proposed MAs detection method regardless of different image resolutions and modalities.