An exploratory clinical trial of preoperative non-invasive localization before breast-conserving surgery using augmented reality technology.

PURPOSE: This single-center, randomized, prospective, exploratory clinical trial was conducted to assess the clinical efficacy of an augmented reality (AR)-based breast cancer localization imaging solution for patients with breast cancer. METHODS: This clinical trial enrolled 20 women who were diagnosed with invasive breast cancer between the ages of 19 and 80, had a single lesion with a diameter ≥ 5 mm but ≤ 30 mm, had no metastases to other organs, and had not received prior chemotherapy. All patients underwent mammography, ultrasound, computed tomography, and magnetic resonance imaging for preoperative assessment. Patients were randomly assigned to ultrasound-guided skin marking localization (USL) and AR-based localization (ARL) groups (n = 10 in each group). Statistical comparisons between USL and ARL groups were made based on demographics, radiologic features, pathological outcomes, and surgical outcomes using chi-square and Student t-tests. RESULTS: Two surgeons performed breast-conserving surgery on 20 patients. Histopathologic evaluation of all patients confirmed negative margins. Two independent pathologists evaluated the marginal distances, and there were no intergroup differences in the readers' estimates (R1, 6.20 ± 4.37 vs. 5.04 ± 3.47, P = 0.519; R2, 5.10 ± 4.31 vs. 4.10 ± 2.38, P = 0.970) or the readers' average values (5.65 ± 4.19 vs. 4.57 ± 2.84, P = 0.509). In comparing the tumor plane area ratio, there was no statistically significant difference between the two groups in terms of either reader's mean values (R1, 15.90 ± 9.52 vs. 19.38 ± 14.05, P = 0.525; R2, 15.32 ± 9.48 vs. 20.83 ± 12.85, P = 0.290) or the overall mean values of two readers combined (15.56 ± 9.11 vs. 20.09 ± 13.38, P = 0.388). Convenience, safety, satisfaction, and reusability were all superior in the AR localization group (P < 0.001) based on the two surgeons' responses. CONCLUSION: AR localization is an acceptable alternative to ultrasound-guided skin marking with no significant differences in surgical outcomes.

Breast cancer surgery with augmented reality.

INTRODUCTION: Innovations in 3D spatial technology and augmented reality imaging driven by digital high-tech industrial science have accelerated experimental advances in breast cancer imaging and the development of medical procedures aimed to reduce invasiveness. PRESENTATION OF CASE: A 57-year-old post-menopausal woman presented with screen-detected left-sided breast cancer. After undergoing all staging and pre-operative studies the patient was proposed for conservative breast surgery with tumor localization. During surgery, an experimental digital and non-invasive intra-operative localization method with augmented reality was compared with the standard pre-operative localization with carbon tattooing (institutional protocol). The breast surgeon wearing an augmented reality headset (Hololens) was able to visualize the tumor location projection inside the patient's left breast in the usual supine position. DISCUSSION: This work describes, to our knowledge, the first experimental test with a digital non-invasive method for intra-operative breast cancer localization using augmented reality to guide breast conservative surgery. In this case, a successful overlap of the previous standard pre-operative marks with carbon tattooing and tumor visualization inside the patient's breast with augmented reality was obtained. CONCLUSION: Breast cancer conservative guided surgery with augmented reality can pave the way for a digital non-invasive method for intra-operative tumor localization.

3D digital breast cancer models with multimodal fusion algorithms.

Breast cancer image fusion consists of registering and visualizing different sets of a patient synchronized torso and radiological images into a 3D model. Breast spatial interpretation and visualization by the treating physician can be augmented with a patient-specific digital breast model that integrates radiological images. But the absence of a ground truth for a good correlation between surface and radiological information has impaired the development of potential clinical applications. A new image acquisition protocol was designed to acquire breast Magnetic Resonance Imaging (MRI) and 3D surface scan data with surface markers on the patient's breasts and torso. A patient-specific digital breast model integrating the real breast torso and the tumor location was created and validated with a MRI/3D surface scan fusion algorithm in 16 breast cancer patients. This protocol was used to quantify breast shape differences between different modalities, and to measure the target registration error of several variants of the MRI/3D scan fusion algorithm. The fusion of single breasts without the biomechanical model of pose transformation had acceptable registration errors and accurate tumor locations. The performance of the fusion algorithm was not affected by breast volume. Further research and virtual clinical interfaces could lead to fast integration of this fusion technology into clinical practice.