Augmented reality for sentinel lymph node biopsy.

INTRODUCTION: Sentinel lymph node biopsy for oral and oropharyngeal squamous cell carcinoma is a well-established staging method. One variation is to inject a radioactive tracer near the primary tumor of the patient. After a few minutes, audio feedback from an external hand-held [Formula: see text]-detection probe can monitor the uptake into the lymphatic system. Such probes place a high cognitive load on the surgeon during the biopsy, as they require the simultaneous use of both hands and the skills necessary to correlate the audio signal with the location of tracer accumulation in the lymph nodes. Therefore, an augmented reality (AR) approach to directly visualize and thus discriminate nearby lymph nodes would greatly reduce the surgeons' cognitive load. MATERIALS AND METHODS: We present a proof of concept of an AR approach for sentinel lymph node biopsy by ex vivo experiments. The 3D position of the radioactive [Formula: see text]-sources is reconstructed from a single [Formula: see text]-image, acquired by a stationary table-attached multi-pinhole [Formula: see text]-detector. The position of the sources is then visualized using Microsoft's HoloLens. We further investigate the performance of our SLNF algorithm for a single source, two sources, and two sources with a hot background. RESULTS: In our ex vivo experiments, a single [Formula: see text]-source and its AR representation show good correlation with known locations, with a maximum error of 4.47 mm. The SLNF algorithm performs well when only one source is reconstructed, with a maximum error of 7.77 mm. For the more challenging case to reconstruct two sources, the errors vary between 2.23 mm and 75.92 mm. CONCLUSION: This proof of concept shows promising results in reconstructing and displaying one [Formula: see text]-source. Two simultaneously recorded sources are more challenging and require further algorithmic optimization.

Augmenting camera images with gamma detector data : A novel approach to support sentinel lymph node biopsy.

BACKGROUND: Squamous cell carcinoma in the head and neck region is one of the most widespread cancers with high morbidity. Classic treatment comprises the complete removal of the lymphatics together with the cancerous tissue. Recent studies have shown that such interventions are only required in 30% of the patients. Sentinel lymph node biopsy is an alternative method to stage the malignancy in a less invasive manner and to avoid overtreatment. In this paper, we present a novel approach that enables a future augmented reality device which improves the biopsy procedure by visual means. METHODS: We propose a co-calibration scheme for axis-aligned miniature cameras with pinholes of a gamma ray collimating and sensing device and show results gained by experiments, based on a calibration target visible for both modalities. RESULTS: Visual inspection and quantitative evaluation of the augmentation of optical camera images with gamma information are congruent with known gamma source landmarks. CONCLUSIONS: Combining a multi-pinhole collimator with axis-aligned miniature cameras to augment optical images using gamma detector data is promising. As such, our approach might be applicable for breast cancer and melanoma staging as well, which are also based on sentinel lymph node biopsy.

Sentinel lymph node fingerprinting.

BACKGROUND: When locating the sentinel lymph node (SLN), surgeons use state-of-the-art imaging devices, such as a 1D gamma probe or less widely spread a 2D gamma camera. These devices project the 3D subspace onto a 1D respectively 2D space, hence loosing accuracy and the depth of the SLN which is very important, especially in the head and neck area with many critical structures in close vicinity. Recent methods which use a multi-pinhole collimator and a single gamma detector image try to gain a depth estimation of the SLN. The low intensity of the sources together with the computational cost of the optimization process make the reconstruction in real-time, however, very challenging. RESULTS: In this paper, we use an optimal design approach to improve the classical pinhole design, resulting in a non-symmetric distribution of the pinholes of the collimator. This new design shows a great improvement of the accuracy when reconstructing the position and depth of the radioactive tracer. Then, we introduce our Sentinel lymph node fingerprinting (SLNF) algorithm, inspired by MR-fingerprinting, for fast and accurate reconstruction of the tracer distribution in 3D space using a single gamma detector image. As a further advantage, the method requires no pre-processing, i.e. filtering of the detector image. The method is very stable in its performance even for low exposure times. In our ex vivo experiments, we successfully located multiple Technetium 99m (Tc-99m) sources with an exposure time of only one second and still, with a very small L 2-error. CONCLUSION: These promising results under short exposure time are very encouraging for SLN biopsy. Although, this device has not been tested on patients yet, we believe: that this approach will give the surgeon accurate 3D positions of the SLN and hence, can potentially reduce the trauma for the patient.