In vivo evaluation of a hyperspectral imaging system for minimally invasive surgery (HSI-MIS).

BACKGROUND: Hyperspectral Imaging (HSI) is a reliable and safe imaging method for taking intraoperative perfusion measurements. This is the first study translating intraoperative HSI to an in vivo laparoscopic setting using a CE-certified HSI-system for minimally invasive surgery (HSI-MIS). We aim to compare it to an established HSI-system for open surgery (HSI-Open). METHODS: Intraoperative HSI was done using the HSI-MIS and HSI-Open at the Region of Interest (ROI). 19 patients undergoing gastrointestinal resections were analyzed in this study. The HSI-MIS-acquired images were aligned with those from the HSI-Open, and spectra and parameter images were compared pixel-wise. We calculated the Mean Absolute Error (MAE) for Tissue Oxygen Saturation (StO2), Near-Infrared Perfusion Index (NIR-PI), Tissue Water Index (TWI), and Organ Hemoglobin Index (OHI), as well as the Root Mean Squared Error (RMSE) over the whole spectrum. Our analysis of parameters was optimized using partial least squares (PLS) regression. Two experienced surgeons carried out an additional color-change analysis, comparing the ROI images and deciding whether they provided the same (acceptable) or different visual information (rejected). RESULTS: HSI and subsequent image registration was possible in 19 patients. MAE results for the original calculation were StO2 orig. 17.2% (± 7.7%), NIR-PIorig. 16.0 (± 9.5), TWIorig. 18.1 (± 7.9), OHIorig. 14.4 (± 4.5). For the PLS calculation, they were StO2 PLS 12.6% (± 5.2%), NIR-PIPLS 10.3 (± 6.0), TWIPLS 10.6 (± 5.1), and OHIPLS 11.6 (± 3.0). The RMSE between both systems was 0.14 (± 0.06). In the color-change analysis; both surgeons accepted more images generated using the PLS method. CONCLUSION: Intraoperative HSI-MIS is a new technology and holds great potential for future applications in surgery. Parameter deviations are attributable to technical differences and can be reduced by applying improved calculation methods. This study is an important step toward the clinical implementation of HSI for minimally invasive surgery.

The role of intraoperative hyperspectral imaging (HSI) in colon interposition after esophagectomy.

BACKGROUND: Colon conduit is an alternative approach to reconstructing the alimentary tract after esophagectomy. Hyperspectral imaging (HSI) has been demonstrated to be effective for evaluating the perfusion of gastric conduits, but not colon conduits. This is the first study to describe this new tool addressing image-guided surgery and supporting esophageal surgeons to select the optimal colon segment for the conduit and anastomotic site intraoperatively. PATIENTS AND METHODS: Of 10 patients, eight who underwent reconstruction with a long-segment colon conduit after esophagectomy between 01/05/2018 and 01/04/2022 were included in this study. HSI was recorded at the root and tip of the colon conduit after clamping the middle colic vessels, allowing us to evaluate the perfusion and appropriate part of the colon segment. RESULTS: Anastomotic leak (AL) was detected in only one (12.5%) of all the enrolled patients (n = 8). None of the patients developed conduit necrosis. Only one patient required re-anastomosis on postoperative day 4. No patient needed conduit removal, esophageal diversion, or stent placement. There was a change in the anastomosis site to proximal in two patients intraoperatively. There was no need to change the side of colon conduit intraoperatively in any patient. CONCLUSION: HSI is a promising and novel intraoperative imaging tool to objectively assess the perfusion of the colon conduit. It helps the surgeon to define the best perfused anastomosis site and the side of colon conduit in this type of operation.

Discrimination of human and animal bloodstains using hyperspectral imaging.

Blood is the most encountered type of biological evidence in violent crimes and contains pertinent information to a forensic investigation. The false presumption that blood encountered at a crime scene is human may not be realised until after costly and sample-consuming tests are performed. To address the question of blood origin, the novel application of visible-near infrared hyperspectral imaging (HSI) is used for the detection and discrimination of human and animal bloodstains. The HSI system used is a portable, non-contact, non-destructive method for the determination of blood origin. A support vector machine (SVM) binary classifier was trained for the discrimination of bloodstains of human (n = 20) and five animal species: pig (n = 20), mouse (n = 16), rat (n = 5), rabbit (n = 5), and cow (n = 20). On an independent test set, the SVM model achieved accuracy, precision, sensitivity, and specificity values of 96, 97, 95, and 96%, respectively. Segmented images of bloodstains aged over a period of two months were produced, allowing for the clear visualisation of the discrimination of human and animal bloodstains. The inclusion of such a system in a forensic investigation workflow not only removes ambiguity surrounding blood origin, but can potentially be used in tandem with HSI bloodstain age determination methods for rapid on-scene forensic analysis.

Alternative intraoperative optical imaging modalities for fluorescence angiography in gastrointestinal surgery: spectral imaging and imaging photoplethysmography.

INTRODUCTION: Intraoperative near-infrared fluorescence angiography with indocyanine green (ICG-FA) is a well-established modality in gastrointestinal surgery. Its main drawback is the application of a fluorescent agent with possible side effects for patients. The goal of this review paper is the presentation of alternative, non-invasive optical imaging methods and their comparison with ICG-FA. MATERIAL AND METHODS: The principles of ICG-FA, spectral imaging, imaging photoplethysmography (iPPG), and their applications in gastrointestinal surgery are described based on selected published works. RESULTS: The main applications of the three modalities are the evaluation of tissue perfusion, the identification of risk structures, and tissue segmentation or classification. While the ICG-FA images are mainly evaluated visually, leading to subjective interpretations, quantitative physiological parameters and tissue segmentation are provided in spectral imaging and iPPG. The combination of ICG-FA and spectral imaging is a promising method. CONCLUSIONS: Non-invasive spectral imaging and iPPG have shown promising results in gastrointestinal surgery. They can overcome the main drawbacks of ICG-FA, i.e. the use of contrast agents, the lack of quantitative analysis, repeatability, and a difficult standardization of the acquisition. Further technical improvements and clinical evaluations are necessary to establish them in daily clinical routine.

Video: Clinical evaluation of a laparoscopic hyperspectral imaging system.

BACKGROUND: Hyperspectral imaging (HSI) during surgical procedures is a new method for perfusion quantification and tissue discrimination. Its use has been limited to open surgery due to large camera sizes, missing color video, or long acquisition times. A hand-held, laparoscopic hyperspectral camera has been developed now to overcome those disadvantages and evaluated clinically for the first time. METHODS: In a clinical evaluation study, gastrointestinal resectates of ten cancer patients were investigated using the laparoscopic hyperspectral camera. Reference data from corresponding anatomical regions were acquired with a clinically approved HSI system. An image registration process was executed that allowed for pixel-wise comparisons of spectral data and parameter images (StO2: oxygen saturation of tissue, NIR PI: near-infrared perfusion index, OHI: organ hemoglobin index, TWI: tissue water index) provided by both camera systems. The mean absolute error (MAE) and root mean square error (RMSE) served for the quantitative evaluations. Spearman's rank correlation between factors related to the study design like the time of spectral white balancing and MAE, respectively RMSE, was calculated. RESULTS: The obtained mean MAEs between the TIVITA® Tissue and the laparoscopic hyperspectral system resulted in StO2: 11% ± 7%, NIR PI: 14±3, OHI: 14± 5, and TWI: 10 ± 2. The mean RMSE between both systems was 0.1±0.03 from 500 to 750 nm and 0.15 ±0.06 from 750 to 1000 nm. Spearman's rank correlation coefficients showed no significant correlation between MAE or RMSE and influencing factors related to the study design. CONCLUSION: Qualitatively, parameter images of the laparoscopic system corresponded to those of the system for open surgery. Quantitative deviations were attributed to technical differences rather than the study design. Limitations of the presented study are addressed in current large-scale in vivo trials.

Evaluation of Preprocessing Methods on Independent Medical Hyperspectral Databases to Improve Analysis.

Currently, one of the most common causes of death worldwide is cancer. The development of innovative methods to support the early and accurate detection of cancers is required to increase the recovery rate of patients. Several studies have shown that medical Hyperspectral Imaging (HSI) combined with artificial intelligence algorithms is a powerful tool for cancer detection. Various preprocessing methods are commonly applied to hyperspectral data to improve the performance of the algorithms. However, there is currently no standard for these methods, and no studies have compared them so far in the medical field. In this work, we evaluated different combinations of preprocessing steps, including spatial and spectral smoothing, Min-Max scaling, Standard Normal Variate normalization, and a median spatial smoothing technique, with the goal of improving tumor detection in three different HSI databases concerning colorectal, esophagogastric, and brain cancers. Two machine learning and deep learning models were used to perform the pixel-wise classification. The results showed that the choice of preprocessing method affects the performance of tumor identification. The method that showed slightly better results with respect to identifing colorectal tumors was Median Filter preprocessing (0.94 of area under the curve). On the other hand, esophagogastric and brain tumors were more accurately identified using Min-Max scaling preprocessing (0.93 and 0.92 of area under the curve, respectively). However, it is observed that the Median Filter method smooths sharp spectral features, resulting in high variability in the classification performance. Therefore, based on these results, obtained with different databases acquired by different HSI instrumentation, the most relevant preprocessing technique identified in this work is Min-Max scaling.

Comparison of hyperspectral imaging and fluorescence angiography for the determination of the transection margin in colorectal resections-a comparative study.

PURPOSE: One relevant aspect for anastomotic leakage in colorectal surgery is blood perfusion of both ends of the anastomosis. The clinical evaluation of this issue is limited, but new methods like fluorescence angiography with indocyanine green or non-invasive and contactless hyperspectral imaging have evolved as objective parameters for perfusion evaluation. METHODS: In this prospective, non-randomized, open-label and two-arm study, fluorescence angiography and hyperspectral imaging were compared in 32 consecutive patients with each other and with the clinical assessment by the surgeon. After preparation of the bowel and determination of the surgical resection line, the tissue was evaluated with hyperspectral imaging for 5 min before and after cutting the marginal artery and assessed by 6 hyperspectral pictures followed by fluorescence angiography with indocyanine green. RESULTS: In 30 of 32 patients, the image data could be evaluated and compared. Both methods provided a comparable borderline between well-perfused and poorly perfused tissue (p = 0.704). In 15 cases, the surgical resection line was shifted to the central position due to the imaging. The border zone was sharper in fluorescence angiography and best assessed 31 s after injection. With hyperspectral imaging, the border zone was visualized wider and with more differences between proximal and distal border. CONCLUSION: Hyperspectral imaging and fluorescence angiography provide similar results in determining the perfusion border. Both methods allow a good and safe visualization of the blood perfusion at the central resection margin to create a well-perfused anastomosis. TRIAL REGISTRATION: This study was registered at Clinicaltrials.gov ( NCT04226781 ) on January 13, 2020.

[New intraoperative fluorescence-based and spectroscopic imaging techniques in visceral medicine - precision surgery in the "high tech"-operating room]. / Neue intraoperative fluoreszenzbasierte und spektroskopische Bildgebungsverfahren in der Viszeralmedizin ­ Präzisionschirurgie im "Hightech"-OP.

INTRODUCTION: Fluorescence angiography (FA) with indocyanine green (ICG) and hyperspectral imaging (HSI) are novel intraoperative visualization techniques in abdominal, vascular and transplant surgery. With the purpose of precision surgery, and in order to increase patient's safety, these new tools aim at reducing postoperative morbidity and mortality. This review discusses and highlights recent developments and the future potential of real-time imaging modalities. METHODS: The underlying mechanisms of the novel imaging methods and their clinical impact are displayed in the context of avoiding anastomotic leaks, the most momentous complications in gastrointestinal surgery after oncologic resections. RESULTS: While FA is associated with the admission of a fluorescence agent, HSI is contact-free and non-invasive. Both methods are able to record physiological tissue properties in real-time. Additionally, FA also measures dynamic phenomena. The techniques take a few seconds only and do not hamper the operative workflow considerably. With regard to a potential change of the surgical strategy, FA and HSI have an equal significance. Our own advancements reflect, in particular, the topics of data visualization and automated data analyses together with the implementation of artificial intelligence (AI) and minimalization of the current devices to install them into endoscopes, minimal-invasive and robot-guided surgery. CONCLUSION: There are a limited number of studies in the field of intraoperative imaging techniques. Whether precision surgery in the "high-tech" OR together with FA, HSI and robotics will result in more secure operative procedures to minimize the postoperative morbidity and mortality will have to be evaluated in future multicenter trials.

Precision Surgery In Rectal Resection With Hyperspectral and Fluorescence Imaging And Pelvic Intraoperative Neuromonitoring (With Video).

Oncologic visceral surgery has recently been revolutionized by robotics, artificial intelligence (AI), sparing of functionally important structures and innovative intraoperative imaging tools. These techniques enable new dimensions of precision surgery and oncology. Currently, data-driven, cognitive operating rooms are standing at the forefront of the latest technical and didactic developments in abdominal surgery. Rectal low anterior resection with total mesorectal excision (TME) for lower- and middle-third rectal cancer is a challenging operation due to the narrow pelvis and the tender guiding structures. Thus, new approaches have been needed to simplify the procedure and to upgrade the results. The combination of robotics with pelvic intraoperative neuromonitoring (pIONM) and new possibilities of visualization, such as multi- and hyperspectral imaging (MSI / HSI) or fluorescence imaging (FI) with indocyanine green (ICG) is a forward-looking modality to enhance surgical precision and reduce postoperative complications while improving oncologic and functional outcomes with a better quality of life. The aim of our video-paper is to show how to achieve maximum precision by combining robotic surgery with pelvic intraoperative neuromonitoring and new imaging devices for rectal cancer.

Hyperspectral Imaging (HSI) in Acute Mesenteric Ischemia to Detect Intestinal Perfusion Deficits.

BACKGROUND: Acute mesenteric ischemia is a life-threatening acute condition, which requires an interdisciplinary approach, including vascular recanalization and surgical treatment. Visual evaluation of intestinal perfusion might be misleading, and therefore, additional tools are necessary to reliably be able to resect the ischemic intestine. Hyperspectral imaging (HSI) has been shown to be feasible and safe for real-time assessment of tissue perfusion in visceral surgery but has never been used in cases of acute mesenteric ischemia. Therefore, we applied HSI in acute mesenteric ischemia to evaluate it for potential aid in the objectively discriminating ischemic and well-perfused intestine during explorative laparotomy. METHODS: We recorded HSI measurements in 11 cases of acute mesenteric ischemia during explorative laparotomy. We evaluated the recorded images for macroscopic visual perfusion quality and divided it into three groups. Of those three groups, we calculated and compared the HSI indexes of tissue saturation, near-infrared perfusion index, organ hemoglobin index, and tissue water index, as well as the reflectance spectra. RESULTS: We found significant differences in tissue saturation (0.7% versus 0.45%; P = 0.002) and near-infrared perfusion index (0.58 versus 0.23; P < 0.001) in poorly perfused intestinal segments compared with the viable intestine. Furthermore, we could detect an increasing peak at 630 nm of the reflectance spectra in less viable tissues, indicating a maximum in necrotic tissues. We attributed this peak to an increase in met-hemoglobin content in necrotic tissues, which is supported by the increase in the HSI organ hemoglobin index. CONCLUSIONS: HSI is able to discriminate tissue perfusion in acute mesenteric ischemia reliably and therefore might be helpful for resection. In addition, HSI gives information on tissue viability via reflectance spectra.

Evaluation of hyperspectral imaging (HSI) for the measurement of ischemic conditioning effects of the gastric conduit during esophagectomy.

BACKGROUND: Hyperspectral imaging (HSI) is a relatively new method used in image-guided and precision surgery, which has shown promising results for characterization of tissues and assessment of physiologic tissue parameters. Previous methods used for analysis of preconditioning concepts in patients and animal models have shown several limitations of application. The aim of this study was to evaluate HSI for the measurement of ischemic conditioning effects during esophagectomy. METHODS: Intraoperative hyperspectral images of the gastric tube through the mini-thoracotomy were recorded from n = 22 patients, 14 of whom underwent laparoscopic gastrolysis and ischemic conditioning of the stomach with two-step transthoracic esophagectomy and gastric pull-up with intrathoracic anastomosis after 3-7 days. The tip of the gastric tube (later esophagogastric anastomosis) was measured with HSI. Analysis software provides a RGB image and 4 false color images representing physiologic parameters of the recorded tissue area intraoperatively. These parameters contain tissue oxygenation (StO2), perfusion-(NIR Perfusion Index), organ hemoglobin (OHI), and tissue water index (TWI). RESULTS: Intraoperative HSI of the gastric conduit was possible in all patients and did not prolong the regular operative procedure due to its quick applicability. In particular, the tissue oxygenation of the gastric conduit was significantly higher in patients who underwent ischemic conditioning ([Formula: see text] = 78%; [Formula: see text] = 66%; p = 0.03). CONCLUSIONS: HSI is suitable for contact-free, non-invasive, and intraoperative evaluation of physiological tissue parameters within gastric conduits. Therefore, HSI is a valuable method for evaluating ischemic conditioning effects and may contribute to reduce anastomotic complications. Additional studies are needed to establish normal values and thresholds of the presented parameters for the gastric conduit anastomotic site.

Intraoperative 3D contrast-enhanced ultrasound (CEUS): a prospective study of 50 patients with brain tumours.

BACKGROUND: Reliable intraoperative resection control during surgery of malignant brain tumours is associated with the longer overall survival of patients. B-mode ultrasound (BUS) is a familiar intraoperative imaging application in neurosurgical procedures and supplies excellent image quality. However, due to resection-induced artefacts, its ability to distinguish between tumour borders, oedema, surrounding tissue and tumour remnants is sometimes limited. In experienced hands, this "bright rim effect" could be reduced. However, it should be determined, if contrast-enhanced ultrasound can improve this situation by providing high-quality imaging during the resection. The aim of this clinical study was to examine contrast-enhanced and three-dimensional reconstructed ultrasound (3D CEUS) in brain tumour surgery regarding the uptake of contrast agent pre- and post-tumour resection, imaging quality and in comparison with postoperative magnetic resonance imaging in different tumour entities. METHODS: Fifty patients, suffering from various brain tumours intra-axial and extra-axial, who had all undergone surgery with the support of neuronavigation in our neurosurgical department, were included in the study. Their median age was 56 years (range, 28-79). Ultrasound imaging was performed before the Dura was opened and for resection control at the end of tumour resection as defined by the neurosurgeon. A high-end ultrasound (US) device (Toshiba Aplio XG®) with linear and sector probes for B-mode and CEUS was used. Navigation and 3D reconstruction were performed with a LOCALITE SonoNavigator® and the images were transferred digitally (DVI) to the navigation system. The contrast agent consists of echoic micro-bubbles showing tumour vascularisation. The ultrasound images were compared with the corresponding postoperative MR data in order to determine the accuracy and imaging quality of the tumours and tumour remnants after resection. RESULTS: Different types of tumours were investigated. High, dynamic contrast agent uptake was observed in 19 of 21 patients (90 %) suffering from glioblastoma, while in 2 patients uptake was low and insufficient. In 52.4 % of glioblastoma and grade III astrocytoma patients CEUS led to an improved delineation in comparison to BUS and showed a high-resolution imaging quality of the tumour margins and tumour boarders. Grade II and grade III astrocytoma (n = 6) as well as metastasis (n = 18) also showed high contrast agent uptake, which led in 50 % to an improved imaging quality. In 5 of these 17 patients, intraoperative CEUS for resection control showed tumour remnants, leading to further tumour resection. Patients treated with CEUS showed no increased neurological deficits after tumour resection. No pharmacological side-effects occurred. CONCLUSIONS: Three-dimensional CEUS is a reliable intraoperative imaging modality and could improve imaging quality. Ninety percent of the high-grade gliomas (HGG, glioblastoma and astrocytoma grade III) showed high contrast uptake with an improved imaging quality in more than 50 %. Gross total resection and incomplete resection of glioblastoma were adequately highlighted by 3D CEUS intraoperatively. The application of US contrast agent could be a helpful imaging tool, especially for resection control in glioblastoma surgery.

Monitoring of microvascular free flaps following oropharyngeal reconstruction using infrared thermography: first clinical experiences.

The aim of this study is to investigate static and dynamic infrared (IR) thermography for intra- and postoperative free-flap monitoring following oropharyngeal reconstruction. Sixteen patients with oropharyngeal reconstruction by free radial forearm flap were included in this prospective, clinical study (05/2013-08/2014). Prior ("intraop_pre") and following ("intraop_post") completion of the microvascular anastomoses, IR thermography was performed for intraoperative flap monitoring. Further IR images were acquired one day ("postop_1") and 10 days ("postop_10") after surgery for postoperative flap monitoring. Of the 16, 15 transferred free radial forearm flaps did not show any perfusion failure. A significant decreasing mean temperature difference (∆T: temperature difference between the flap surface and the surrounding tissue in Kelvin) was measured at all investigation points in comparison with the temperature difference at "intraop_pre" (mean values on all patients: ∆T intraop_pre = -2.64 K; ∆T intraop_post = -1.22 K, p < 0.0015; ∆T postop_1 = -0.54 K, p < 0.0001; ∆T postop_10 = -0.58 K, p < 0.0001). Intraoperative dynamic IR thermography showed typical pattern of non-pathological rewarming due to re-established flap perfusion after completion of the microvascular anastomoses. Static and dynamic IR thermography is a promising, objective method for intraoperative and postoperative monitoring of free-flap reconstructions in head and neck surgery and to detect perfusion failure, before macroscopic changes in the tissue surface are obvious. A lack of significant decrease of the temperature difference compared to surrounding tissue following completion of microvascular anastomoses and an atypical rewarming following a thermal challenge are suggestive of flap perfusion failure.

Vascular Structure Identification in Intraoperative 3D Contrast-Enhanced Ultrasound Data.

In this paper, a method of vascular structure identification in intraoperative 3D Contrast-Enhanced Ultrasound (CEUS) data is presented. Ultrasound imaging is commonly used in brain tumor surgery to investigate in real time the current status of cerebral structures. The use of an ultrasound contrast agent enables to highlight tumor tissue, but also surrounding blood vessels. However, these structures can be used as landmarks to estimate and correct the brain shift. This work proposes an alternative method for extracting small vascular segments close to the tumor as landmark. The patient image dataset involved in brain tumor operations includes preoperative contrast T1MR (cT1MR) data and 3D intraoperative contrast enhanced ultrasound data acquired before (3D-iCEUS(start) and after (3D-iCEUS(end) tumor resection. Based on rigid registration techniques, a preselected vascular segment in cT1MR is searched in 3D-iCEUS(start) and 3D-iCEUS(end) data. The method was validated by using three similarity measures (Normalized Gradient Field, Normalized Mutual Information and Normalized Cross Correlation). Tests were performed on data obtained from ten patients overcoming a brain tumor operation and it succeeded in nine cases. Despite the small size of the vascular structures, the artifacts in the ultrasound images and the brain tissue deformations, blood vessels were successfully identified.

A neurosurgical phantom-based training system with ultrasound simulation.

BACKGROUND: Brain tumor surgeries are associated with a high technical and personal effort. The required interactions between the surgeon and the technical components, such as neuronavigation, surgical instruments and intraoperative imaging, are complex and demand innovative training solutions and standardized evaluation methods. Phantom-based training systems could be useful in complementing the existing surgical education and training. METHODS: A prototype of a phantom-based training system was developed, intended for standardized training of important aspects of brain tumor surgery based on real patient data. The head phantom consists of a three-part construction that includes a reusable base and adapter, as well as a changeable module for single use. Training covers surgical planning of the optimal access path, the setup of the navigation system including the registration of the head phantom, as well as the navigated craniotomy with real instruments. Tracked instruments during the simulation and predefined access paths constitute the basis for the essential objective training feedback. RESULTS: The prototype was evaluated in a pilot study by assistant physicians at different education levels. They performed a complete simulation and a final assessment using an evaluation questionnaire. The analysis of the questionnaire showed the evaluation result as "good" for the phantom construction and the used materials. The learning effect concerning the navigated planning was evaluated as "very good", as well as having the effect of increasing safety for the surgeon before planning and conducting craniotomies independently on patients. CONCLUSIONS: The training system represents a promising approach for the future training of neurosurgeons. It aims to improve surgical skill training by creating a more realistic simulation in a non-risk environment. Hence, it could help to bridge the gap between theoretical and practical training with the potential to benefit both physicians and patients.

Design and evaluation of an AR-based thermal imaging system for planning reconstructive surgeries.

INTRODUCTION: Thermal imaging can be used for the non-invasive detection of blood vessels of the skin. However, mapping the results to the patient currently lacks user-friendliness. Augmented reality may provide a useful tool to superimpose thermal information on the patient. METHODS: A system to support planning in reconstructive surgery using a thermal camera was designed. The obtained information was superimposed on the physical object using a Microsoft HoloLens. An RGB, depth, and thermal camera were combined to capture a scene of different modalities and reconstruct a virtual scene in real time. To register the different cameras and the AR device, an active calibration target was developed and evaluated. A Vuforia marker was used to register the hologram in the virtual space. The accuracy of the projected hologram was evaluated in a laboratory setting with participants by measuring the error between the physical object and the hologram. RESULTS: The AR-based system was evaluated by 21 participants in a laboratory setting. The mean projection error is 10.3 ± 9.4 mm. The system is able to stream a three-dimensional scene with augmented thermal information in real time at 5 frames per second. The active calibration target can be used independently of the environment. CONCLUSION: The calibration target provides an easy-to-use method for the registration of cameras capturing the visible to long-infrared spectral range. The inside-out tracking of the HoloLens in combination with a Vuforia marker is not accurate enough for the intended clinical use.