Optical tissue measurements of invasive carcinoma and ductal carcinoma in situ for surgical guidance.

BACKGROUND: Although the incidence of positive resection margins in breast-conserving surgery has decreased, both incomplete resection and unnecessary large resections still occur. This is especially the case in the surgical treatment of ductal carcinoma in situ (DCIS). Diffuse reflectance spectroscopy (DRS), an optical technology based on light tissue interactions, can potentially characterize tissue during surgery thereby guiding the surgeon intraoperatively. DRS has shown to be able to discriminate pure healthy breast tissue from pure invasive carcinoma (IC) but limited research has been done on (1) the actual optical characteristics of DCIS and (2) the ability of DRS to characterize measurements that are a mixture of tissue types. METHODS: In this study, DRS spectra were acquired from 107 breast specimens from 107 patients with proven IC and/or DCIS (1488 measurement locations). With a generalized estimating equation model, the differences between the DRS spectra of locations with DCIS and IC and only healthy tissue were compared to see if there were significant differences between these spectra. Subsequently, different classification models were developed to be able to predict if the DRS spectrum of a measurement location represented a measurement location with "healthy" or "malignant" tissue. In the development and testing of the models, different definitions for "healthy" and "malignant" were used. This allowed varying the level of homogeneity in the train and test data. RESULTS: It was found that the optical characteristics of IC and DCIS were similar. Regarding the classification of tissue with a mixture of tissue types, it was found that using mixed measurement locations in the development of the classification models did not tremendously improve the accuracy of the classification of other measurement locations with a mixture of tissue types. The evaluated classification models were able to classify measurement locations with > 5% malignant cells with a Matthews correlation coefficient of 0.41 or 0.40. Some models showed better sensitivity whereas others had better specificity. CONCLUSION: The results suggest that DRS has the potential to detect malignant tissue, including DCIS, in healthy breast tissue and could thus be helpful for surgical guidance.

Towards the use of diffuse reflectance spectroscopy for real-time in vivo detection of breast cancer during surgery.

BACKGROUND: Breast cancer surgeons struggle with differentiating healthy tissue from cancer at the resection margin during surgery. We report on the feasibility of using diffuse reflectance spectroscopy (DRS) for real-time in vivo tissue characterization. METHODS: Evaluating feasibility of the technology requires a setting in which measurements, imaging and pathology have the best possible correlation. For this purpose an optical biopsy needle was used that had integrated optical fibers at the tip of the needle. This approach enabled the best possible correlation between optical measurement volume and tissue histology. With this optical biopsy needle we acquired real-time DRS data of normal tissue and tumor tissue in 27 patients that underwent an ultrasound guided breast biopsy procedure. Five additional patients were measured in continuous mode in which we obtained DRS measurements along the entire biopsy needle trajectory. We developed and compared three different support vector machine based classification models to classify the DRS measurements. RESULTS: With DRS malignant tissue could be discriminated from healthy tissue. The classification model that was based on eight selected wavelengths had the highest accuracy and Matthews Correlation Coefficient (MCC) of 0.93 and 0.87, respectively. In three patients that were measured in continuous mode and had malignant tissue in their biopsy specimen, a clear transition was seen in the classified DRS measurements going from healthy tissue to tumor tissue. This transition was not seen in the other two continuously measured patients that had benign tissue in their biopsy specimen. CONCLUSIONS: It was concluded that DRS is feasible for integration in a surgical tool that could assist the breast surgeon in detecting positive resection margins during breast surgery. Trail registration NIH US National Library of Medicine-clinicaltrails.gov, NCT01730365. Registered: 10/04/2012 https://clinicaltrials.gov/ct2/show/study/NCT01730365.

Review: in vivo optical spectral tissue sensing-how to go from research to routine clinical application?

Innovations in optical spectroscopy have helped the technology reach a point where performance previously seen only in laboratory settings can be translated and tested in real-world applications. In the field of oncology, spectral tissue sensing (STS) by means of optical spectroscopy is considered to have major potential for improving diagnostics and optimizing treatment outcome. The concept has been investigated for more than two decades and yet spectral tissue sensing is not commonly employed in routine medical practice. It is therefore important to understand what is needed to translate technological advances and insights generated through basic scientific research in this field into clinical practice. The aim of the discussion presented here is not to provide a comprehensive review of all work published over the last decades but rather to highlight some of the challenges found in literature and encountered by our group in the quest to translate optical technologies into useful clinical tools. Furthermore, an outlook is proposed on how translational researchers could proceed to eventually have STS incorporated in the process of clinical decision-making.

Navigation forces during wrist arthroscopy: assessment of expert levels.

PURPOSE: To facilitate effective and efficient training in skills laboratory, objective metrics can be used. Forces exerted on the tissues can be a measure of safe tissue manipulation. To provide feedback during training, expert threshold levels need to be determined. The purpose of this study was to define the magnitude and the direction of navigation forces used during arthroscopic inspection of the wrist. METHODS: We developed a set-up to mount a cadaver wrist to a 3D force platform that allowed measurement of the forces exerted on the wrist. Six experts in wrist arthroscopy performed two tasks: (1) Introduction of the camera and visualization of the hook. (2) Navigation through the wrist with visualization of five anatomic structures. The magnitude (Fabs) and direction of force were recorded, with the direction defined as α being the angle in the vertical plane and ß being the angle in the horizontal plane. The 10th-90th percentile of the data were used to set threshold levels for training. RESULTS: The results show distinct force patterns for each of the anatomic landmarks. Median Fabs of the navigation task is 3.8 N (1.8-7.3), α is 3.60 (-54-44) and ß is 260 (0-72). CONCLUSION: Unique expert data on navigation forces during wrist arthroscopy were determined. The defined maximum allowable navigation force of 7.3 N (90th percentile) can be used in providing feedback on performance during skills training. The clinical value is that this study contributes to objective assessment of skills levels.

Framework for Deep Learning Based Multi-Modality Image Registration of Snapshot and Pathology Images.

Multi-modality image registration is an important task in medical imaging because it allows for information from different domains to be correlated. Histopathology plays a crucial role in oncologic surgery as it is the gold standard for investigating tissue composition from surgically excised specimens. Research studies are increasingly focused on registering medical imaging modalities such as white light cameras, magnetic resonance imaging, computed tomography, and ultrasound to pathology images. The main challenge in registration tasks involving pathology images comes from addressing the considerable amount of deformation present. This work provides a framework for deep learning-based multi-modality registration of microscopic pathology images to another imaging modality. The proposed framework is validated on the registration of prostate ex-vivo white light camera snapshot images to pathology hematoxylin-eosin images of the same specimen. A pipeline is presented detailing data acquisition, protocol considerations, image dissimilarity, training experiments, and validation. A comprehensive analysis is done on the impact of pre-processing, data augmentation, loss functions, and regularization. This analysis is supplemented by clinically motivated evaluation metrics to avoid the pitfalls of only using ubiquitous image comparison metrics. Consequently, a robust training configuration capable of performing the desired registration task is found. Utilizing the proposed approach, we achieved a dice similarity coefficient of 0.96, a mutual information score of 0.54, a target registration error of 2.4 mm, and a regional dice similarity coefficient of 0.70.

Feasibility of Diffuse Reflection Spectroscopy for Intraoperative Margin Assessment During Prostatectomy.

Background and objective: A positive surgical margin (PSM) occurs in up to 32% of patients undergoing robot-assisted radical prostatectomy (RARP). Diffuse reflectance spectroscopy (DRS), which measures tissue composition according to its optical properties, can potentially be used for real-time PSM detection during RARP. Our objective was to assess the feasibility of DRS in distinguishing prostate cancer from benign tissue in RARP specimens. Methods: In a single-center prospective study, DRS measurements were taken ex vivo for RARP specimens from 59 patients with biopsy-proven prostate carcinoma. Discriminating features from the DRS spectra were used to create a machine learning-based classification algorithm. The data were split patient-wise into training (70%) and testing (30%) sets, with ten iterations to ensure algorithm robustness. The average sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUC) from ten classification iterations were calculated. Key findings and limitations: We collected 542 DRS measurements, of which 53% were tumor and 47% were healthy-tissue measurements. Twenty discriminating features from the DRS spectra were used as the input for a support vector machine model. This model achieved average sensitivity of 89%, specificity of 82%, accuracy of 85%, and AUC of 0.91 for the test set. Limitations include the binary label input for classification. Conclusions and clinical implications: DRS can potentially discriminate prostate cancer from benign tissue. Before implementing the technique in clinical practice, further research is needed to assess its performance on heterogeneous tissue volumes and measurements from the prostate surface. Patient summary: We looked at the ability of a technique called diffuse reflectance spectroscopy to guide surgeons in discriminating prostate cancer tissue from benign prostate tissue in real time during prostate cancer surgery. Our study showed promising results in an experimental setting. Future research will focus on bringing this technique to clinical practice.

Margin assessment during breast conserving surgery using diffuse reflectance spectroscopy.

Significance: During breast-conserving surgeries, it is essential to evaluate the resection margins (edges of breast specimen) to determine whether the tumor has been removed completely. In current surgical practice, there are no methods available to aid in accurate real-time margin evaluation. Aim: In this study, we investigated the diagnostic accuracy of diffuse reflectance spectroscopy (DRS) combined with tissue classification models in discriminating tumorous tissue from healthy tissue up to 2 mm in depth on the actual resection margin of in vivo breast tissue. Approach: We collected an extensive dataset of DRS measurements on ex vivo breast tissue and in vivo breast tissue, which we used to develop different classification models for tissue classification. Next, these models were used in vivo to evaluate the performance of DRS for tissue discrimination during breast conserving surgery. We investigated which training strategy yielded optimum results for the classification model with the highest performance. Results: We achieved a Matthews correlation coefficient of 0.76, a sensitivity of 96.7% (95% CI 95.6% to 98.2%), a specificity of 90.6% (95% CI 86.3% to 97.9%) and an area under the curve of 0.98 by training the optimum model on a combination of ex vivo and in vivo DRS data. Conclusions: DRS allows real-time margin assessment with a high sensitivity and specificity during breast-conserving surgeries.

Toward Intraoperative Margin Assessment Using a Deep Learning-Based Approach for Automatic Tumor Segmentation in Breast Lumpectomy Ultrasound Images.

There is an unmet clinical need for an accurate, rapid and reliable tool for margin assessment during breast-conserving surgeries. Ultrasound offers the potential for a rapid, reproducible, and non-invasive method to assess margins. However, it is challenged by certain drawbacks, including a low signal-to-noise ratio, artifacts, and the need for experience with the acquirement and interpretation of images. A possible solution might be computer-aided ultrasound evaluation. In this study, we have developed new ensemble approaches for automated breast tumor segmentation. The ensemble approaches to predict positive and close margins (distance from tumor to margin ≤ 2.0 mm) in the ultrasound images were based on 8 pre-trained deep neural networks. The best optimum ensemble approach for segmentation attained a median Dice score of 0.88 on our data set. Furthermore, utilizing the segmentation results we were able to achieve a sensitivity of 96% and a specificity of 76% for predicting a close margin when compared to histology results. The promising results demonstrate the capability of AI-based ultrasound imaging as an intraoperative surgical margin assessment tool during breast-conserving surgery.

Diffuse reflectance spectroscopy for accurate margin assessment in breast-conserving surgeries: importance of an optimal number of fibers.

During breast-conserving surgeries, it remains challenging to accomplish adequate surgical margins. We investigated different numbers of fibers for fiber-optic diffuse reflectance spectroscopy to differentiate tumorous breast tissue from healthy tissue ex vivo up to 2 mm from the margin. Using a machine-learning classification model, the optimal performance was obtained using at least three emitting fibers (Matthew's correlation coefficient (MCC) of 0.73), which was significantly higher compared to the performance of using a single-emitting fiber (MCC of 0.48). The percentage of correctly classified tumor locations varied from 75% to 100% depending on the tumor percentage, the tumor-margin distance and the number of fibers.

Hyperspectral Imaging for Resection Margin Assessment during Cancer Surgery.

PURPOSE: Complete tumor removal during cancer surgery remains challenging due to the lack of accurate techniques for intraoperative margin assessment. This study evaluates the use of hyperspectral imaging for margin assessment by reporting its use in fresh human breast specimens. EXPERIMENTAL DESIGN: Hyperspectral data were first acquired on tissue slices from 18 patients after gross sectioning of the resected breast specimen. This dataset, which contained over 22,000 spectra, was well correlated with histopathology and was used to develop a support vector machine classification algorithm and test the classification performance. In addition, we evaluated hyperspectral imaging in clinical practice by imaging the resection surface of six lumpectomy specimens. With the developed classification algorithm, we determined if hyperspectral imaging could detect malignancies in the resection surface. RESULTS: The diagnostic performance of hyperspectral imaging on the tissue slices was high; invasive carcinoma, ductal carcinoma in situ, connective tissue, and adipose tissue were correctly classified as tumor or healthy tissue with accuracies of 93%, 84%, 70%, and 99%, respectively. These accuracies increased with the size of the area, consisting of one tissue type. The entire resection surface was imaged within 10 minutes, and data analysis was performed fast, without the need of an experienced operator. On the resection surface, hyperspectral imaging detected 19 of 20 malignancies that, according to the available histopathology information, were located within 2 mm of the resection surface. CONCLUSIONS: These findings show the potential of using hyperspectral imaging for margin assessment during breast-conserving surgery to improve surgical outcome.

Imaging depth variations in hyperspectral imaging: Development of a method to detect tumor up to the required tumor-free margin width.

Hyperspectral imaging is a promising technique for resection margin assessment during cancer surgery. Thereby, only a specific amount of the tissue below the resection surface, the clinically defined margin width, should be assessed. Since the imaging depth of hyperspectral imaging varies with wavelength and tissue composition, this can have consequences for the clinical use of hyperspectral imaging as margin assessment technique. In this study, a method was developed that allows for hyperspectral analysis of resection margins in breast cancer. This method uses the spectral slope of the diffuse reflectance spectrum at wavelength regions where the imaging depth in tumor and healthy tissue is equal. Thereby, tumor can be discriminated from healthy breast tissue while imaging up to a similar depth as the required tumor-free margin width of 2 mm. Applying this method to hyperspectral images acquired during surgery would allow for robust margin assessment of resected specimens. In this paper, we focused on breast cancer, but the same approach can be applied to develop a method for other types of cancer.

Broadband hyperspectral imaging for breast tumor detection using spectral and spatial information.

Complete tumor removal during breast-conserving surgery remains challenging due to the lack of optimal intraoperative margin assessment techniques. Here, we use hyperspectral imaging for tumor detection in fresh breast tissue. We evaluated different wavelength ranges and two classification algorithms; a pixel-wise classification algorithm and a convolutional neural network that combines spectral and spatial information. The highest classification performance was obtained using the full wavelength range (450-1650 nm). Adding spatial information mainly improved the differentiation of tissue classes within the malignant and healthy classes. High sensitivity and specificity were accomplished, which offers potential for hyperspectral imaging as a margin assessment technique to improve surgical outcome.

In vivo characterization of colorectal metastases in human liver using diffuse reflectance spectroscopy: toward guidance in oncological procedures.

There is a strong need to develop clinical instruments that can perform rapid tissue assessment at the tip of smart clinical instruments for a variety of oncological applications. This study presents the first in vivo real-time tissue characterization during 24 liver biopsy procedures using diffuse reflectance (DR) spectroscopy at the tip of a core biopsy needle with integrated optical fibers. DR measurements were performed along each needle path, followed by biopsy of the target lesion using the same needle. Interventional imaging was coregistered with the DR spectra. Pathology results were compared with the DR spectroscopy data at the final measurement position. Bile was the primary discriminator between normal liver tissue and tumor tissue. Relative differences in bile content matched with the tissue diagnosis based on histopathological analysis in all 24 clinical cases. Continuous DR measurements during needle insertion in three patients showed that the method can also be applied for biopsy guidance or tumor recognition during surgery. This study provides an important validation step for DR spectroscopy-based tissue characterization in the liver. Given the feasibility of the outlined approach, it is also conceivable to make integrated fiber-optic tools for other clinical procedures that rely on accurate instrument positioning.

Spectral sensing for tissue diagnosis during lung biopsy procedures: The importance of an adequate internal reference and real-time feedback.

OBJECTIVES: Difficulties in obtaining a representative tissue sample are a major obstacle in timely selecting the optimal treatment for patients with lung cancer or other malignancies. Having a modality to provide needle guidance and confirm the biopsy site selection could be of great clinical benefit, especially when small masses are targeted. The objective of this study was to evaluate whether diffuse reflectance spectroscopy (DRS) at the tip of a core biopsy needle can be used for biopsy site confirmation in real time, thereby enabling optimized biopsy acquisition and improving diagnostic capability. MATERIALS AND METHODS: We included a total of 23 patients undergoing a routine computed tomography (CT) guided transthoracic needle biopsy of a lesion suspected for lung cancer or metastatic disease. DRS measurements were acquired during needle insertion and clinically relevant parameters were extracted from the spectral data along the needle paths. Histopathology results were compared with the DRS data at the final measurement position. RESULTS: Analysis of the collective data acquired from all enrolled subjects showed significant differences (p<0.01) for blood content, stO2, water content, and scattering amplitude. The identified spectral contrast matched the final pathology in 20 out of 22 clinical cases that could be used for analysis, which corresponds with an overall diagnostic performance of 91%. Three cases underlined the importance of adequate reference measurements and the need for real time diagnostic feedback. Continuous real time DRS measurements performed during a biopsy procedure in one patient provided clear information with respect to the variation in tissue and allowed identification of the tumour boundary. CONCLUSIONS: The presented technology creates a basis for the design and clinical implementation of integrated fibre-optic tools for a variety of minimal invasive applications.

Using DRS during breast conserving surgery: identifying robust optical parameters and influence of inter-patient variation.

Successful breast conserving surgery consists of complete removal of the tumor while sparing healthy surrounding tissue. Despite currently available imaging and margin assessment tools, recognizing tumor tissue at a resection margin during surgery is challenging. Diffuse reflectance spectroscopy (DRS), which uses light for tissue characterization, can potentially guide surgeons to prevent tumor positive margins. However, inter-patient variation and changes in tissue physiology occurring during the resection might hamper this light-based technology. Here we investigate how inter-patient variation and tissue status (in vivo vs ex vivo) affect the performance of the DRS optical parameters. In vivo and ex vivo measurements of 45 breast cancer patients were obtained and quantified with an analytical model to acquire the optical parameters. The optical parameter representing the ratio between fat and water provided the best discrimination between normal and tumor tissue, with an area under the receiver operating characteristic curve of 0.94. There was no substantial influence of other patient factors such as menopausal status on optical measurements. Contrary to expectations, normalization of the optical parameters did not improve the discriminative power. Furthermore, measurements taken in vivo were not significantly different from the measurements taken ex vivo. These findings indicate that DRS is a robust technology for the detection of tumor tissue during breast conserving surgery.