In vivo evaluation of a hyperspectral imaging system for minimally invasive surgery (HSI-MIS).

BACKGROUND: Hyperspectral Imaging (HSI) is a reliable and safe imaging method for taking intraoperative perfusion measurements. This is the first study translating intraoperative HSI to an in vivo laparoscopic setting using a CE-certified HSI-system for minimally invasive surgery (HSI-MIS). We aim to compare it to an established HSI-system for open surgery (HSI-Open). METHODS: Intraoperative HSI was done using the HSI-MIS and HSI-Open at the Region of Interest (ROI). 19 patients undergoing gastrointestinal resections were analyzed in this study. The HSI-MIS-acquired images were aligned with those from the HSI-Open, and spectra and parameter images were compared pixel-wise. We calculated the Mean Absolute Error (MAE) for Tissue Oxygen Saturation (StO2), Near-Infrared Perfusion Index (NIR-PI), Tissue Water Index (TWI), and Organ Hemoglobin Index (OHI), as well as the Root Mean Squared Error (RMSE) over the whole spectrum. Our analysis of parameters was optimized using partial least squares (PLS) regression. Two experienced surgeons carried out an additional color-change analysis, comparing the ROI images and deciding whether they provided the same (acceptable) or different visual information (rejected). RESULTS: HSI and subsequent image registration was possible in 19 patients. MAE results for the original calculation were StO2 orig. 17.2% (± 7.7%), NIR-PIorig. 16.0 (± 9.5), TWIorig. 18.1 (± 7.9), OHIorig. 14.4 (± 4.5). For the PLS calculation, they were StO2 PLS 12.6% (± 5.2%), NIR-PIPLS 10.3 (± 6.0), TWIPLS 10.6 (± 5.1), and OHIPLS 11.6 (± 3.0). The RMSE between both systems was 0.14 (± 0.06). In the color-change analysis; both surgeons accepted more images generated using the PLS method. CONCLUSION: Intraoperative HSI-MIS is a new technology and holds great potential for future applications in surgery. Parameter deviations are attributable to technical differences and can be reduced by applying improved calculation methods. This study is an important step toward the clinical implementation of HSI for minimally invasive surgery.

The role of intraoperative hyperspectral imaging (HSI) in colon interposition after esophagectomy.

BACKGROUND: Colon conduit is an alternative approach to reconstructing the alimentary tract after esophagectomy. Hyperspectral imaging (HSI) has been demonstrated to be effective for evaluating the perfusion of gastric conduits, but not colon conduits. This is the first study to describe this new tool addressing image-guided surgery and supporting esophageal surgeons to select the optimal colon segment for the conduit and anastomotic site intraoperatively. PATIENTS AND METHODS: Of 10 patients, eight who underwent reconstruction with a long-segment colon conduit after esophagectomy between 01/05/2018 and 01/04/2022 were included in this study. HSI was recorded at the root and tip of the colon conduit after clamping the middle colic vessels, allowing us to evaluate the perfusion and appropriate part of the colon segment. RESULTS: Anastomotic leak (AL) was detected in only one (12.5%) of all the enrolled patients (n = 8). None of the patients developed conduit necrosis. Only one patient required re-anastomosis on postoperative day 4. No patient needed conduit removal, esophageal diversion, or stent placement. There was a change in the anastomosis site to proximal in two patients intraoperatively. There was no need to change the side of colon conduit intraoperatively in any patient. CONCLUSION: HSI is a promising and novel intraoperative imaging tool to objectively assess the perfusion of the colon conduit. It helps the surgeon to define the best perfused anastomosis site and the side of colon conduit in this type of operation.

Discrimination of human and animal bloodstains using hyperspectral imaging.

Blood is the most encountered type of biological evidence in violent crimes and contains pertinent information to a forensic investigation. The false presumption that blood encountered at a crime scene is human may not be realised until after costly and sample-consuming tests are performed. To address the question of blood origin, the novel application of visible-near infrared hyperspectral imaging (HSI) is used for the detection and discrimination of human and animal bloodstains. The HSI system used is a portable, non-contact, non-destructive method for the determination of blood origin. A support vector machine (SVM) binary classifier was trained for the discrimination of bloodstains of human (n = 20) and five animal species: pig (n = 20), mouse (n = 16), rat (n = 5), rabbit (n = 5), and cow (n = 20). On an independent test set, the SVM model achieved accuracy, precision, sensitivity, and specificity values of 96, 97, 95, and 96%, respectively. Segmented images of bloodstains aged over a period of two months were produced, allowing for the clear visualisation of the discrimination of human and animal bloodstains. The inclusion of such a system in a forensic investigation workflow not only removes ambiguity surrounding blood origin, but can potentially be used in tandem with HSI bloodstain age determination methods for rapid on-scene forensic analysis.

Alternative intraoperative optical imaging modalities for fluorescence angiography in gastrointestinal surgery: spectral imaging and imaging photoplethysmography.

INTRODUCTION: Intraoperative near-infrared fluorescence angiography with indocyanine green (ICG-FA) is a well-established modality in gastrointestinal surgery. Its main drawback is the application of a fluorescent agent with possible side effects for patients. The goal of this review paper is the presentation of alternative, non-invasive optical imaging methods and their comparison with ICG-FA. MATERIAL AND METHODS: The principles of ICG-FA, spectral imaging, imaging photoplethysmography (iPPG), and their applications in gastrointestinal surgery are described based on selected published works. RESULTS: The main applications of the three modalities are the evaluation of tissue perfusion, the identification of risk structures, and tissue segmentation or classification. While the ICG-FA images are mainly evaluated visually, leading to subjective interpretations, quantitative physiological parameters and tissue segmentation are provided in spectral imaging and iPPG. The combination of ICG-FA and spectral imaging is a promising method. CONCLUSIONS: Non-invasive spectral imaging and iPPG have shown promising results in gastrointestinal surgery. They can overcome the main drawbacks of ICG-FA, i.e. the use of contrast agents, the lack of quantitative analysis, repeatability, and a difficult standardization of the acquisition. Further technical improvements and clinical evaluations are necessary to establish them in daily clinical routine.

Hyperspectral Imaging (HSI) of Human Kidney Allografts.

OBJECTIVE: Aim of our study was to test a noninvasive HSI technique as an intraoperative real time assessment tool for deceased donor kidney quality and function in human kidney allotransplantation. SUMMARY OF BACKGROUND DATA: HSI is capable to deliver quantitative diagnostic information about tissue pathology, morphology, and composition, based on the spectral characteristics of the investigated tissue. Because tools for objective intraoperative graft viability and performance assessment are lacking, we applied this novel technique to human kidney transplantation. METHODS: Hyperspectral images of distinct components of kidney allografts (parenchyma, ureter) were acquired 15 and 45 minutes after reperfusion and subsequently analyzed using specialized HSI acquisition software capable to compute oxygen saturation levels (StO2), near infrared perfusion indices (NIR), organ hemoglobin indices, and tissue water indices of explored tissues. RESULTS: Seventeen kidney transplants were analyzed. Median recipient and donor age were 55 years. Cold ischemia time was 10.8 ±â€Š4.1 hours and anastomosis time was 35 ±â€Š7 minutes (mean ±â€Šstandard deviation). Two patients (11.8%) developed delayed graft function (DGF). cold ischemia time was significantly longer (18.6 ±â€Š1.6) in patients with DGF (P < 0.01). Kidneys with DGF furthermore displayed significant lower StO2 (P = 0.02) and NIR perfusion indices, 15 minutes after reperfusion (P < 0.01). Transplant ureters displayed a significant decrease of NIR perfusion with increased distance to the renal pelvis, identifying well and poor perfused segments. CONCLUSION: Intraoperative HSI is feasible and meaningful to predict DGF in renal allografts. Furthermore, it can be utilized for image guided surgery, providing information about tissue oxygenation, perfusion, hemoglobin concentration, and water concentration, hence allowing intraoperative viability assessment of the kidney parenchyma and the ureter.

Video: Clinical evaluation of a laparoscopic hyperspectral imaging system.

BACKGROUND: Hyperspectral imaging (HSI) during surgical procedures is a new method for perfusion quantification and tissue discrimination. Its use has been limited to open surgery due to large camera sizes, missing color video, or long acquisition times. A hand-held, laparoscopic hyperspectral camera has been developed now to overcome those disadvantages and evaluated clinically for the first time. METHODS: In a clinical evaluation study, gastrointestinal resectates of ten cancer patients were investigated using the laparoscopic hyperspectral camera. Reference data from corresponding anatomical regions were acquired with a clinically approved HSI system. An image registration process was executed that allowed for pixel-wise comparisons of spectral data and parameter images (StO2: oxygen saturation of tissue, NIR PI: near-infrared perfusion index, OHI: organ hemoglobin index, TWI: tissue water index) provided by both camera systems. The mean absolute error (MAE) and root mean square error (RMSE) served for the quantitative evaluations. Spearman's rank correlation between factors related to the study design like the time of spectral white balancing and MAE, respectively RMSE, was calculated. RESULTS: The obtained mean MAEs between the TIVITA® Tissue and the laparoscopic hyperspectral system resulted in StO2: 11% ± 7%, NIR PI: 14±3, OHI: 14± 5, and TWI: 10 ± 2. The mean RMSE between both systems was 0.1±0.03 from 500 to 750 nm and 0.15 ±0.06 from 750 to 1000 nm. Spearman's rank correlation coefficients showed no significant correlation between MAE or RMSE and influencing factors related to the study design. CONCLUSION: Qualitatively, parameter images of the laparoscopic system corresponded to those of the system for open surgery. Quantitative deviations were attributed to technical differences rather than the study design. Limitations of the presented study are addressed in current large-scale in vivo trials.

Comparison of hyperspectral imaging and fluorescence angiography for the determination of the transection margin in colorectal resections-a comparative study.

PURPOSE: One relevant aspect for anastomotic leakage in colorectal surgery is blood perfusion of both ends of the anastomosis. The clinical evaluation of this issue is limited, but new methods like fluorescence angiography with indocyanine green or non-invasive and contactless hyperspectral imaging have evolved as objective parameters for perfusion evaluation. METHODS: In this prospective, non-randomized, open-label and two-arm study, fluorescence angiography and hyperspectral imaging were compared in 32 consecutive patients with each other and with the clinical assessment by the surgeon. After preparation of the bowel and determination of the surgical resection line, the tissue was evaluated with hyperspectral imaging for 5 min before and after cutting the marginal artery and assessed by 6 hyperspectral pictures followed by fluorescence angiography with indocyanine green. RESULTS: In 30 of 32 patients, the image data could be evaluated and compared. Both methods provided a comparable borderline between well-perfused and poorly perfused tissue (p = 0.704). In 15 cases, the surgical resection line was shifted to the central position due to the imaging. The border zone was sharper in fluorescence angiography and best assessed 31 s after injection. With hyperspectral imaging, the border zone was visualized wider and with more differences between proximal and distal border. CONCLUSION: Hyperspectral imaging and fluorescence angiography provide similar results in determining the perfusion border. Both methods allow a good and safe visualization of the blood perfusion at the central resection margin to create a well-perfused anastomosis. TRIAL REGISTRATION: This study was registered at Clinicaltrials.gov ( NCT04226781 ) on January 13, 2020.

[New intraoperative fluorescence-based and spectroscopic imaging techniques in visceral medicine - precision surgery in the "high tech"-operating room]. / Neue intraoperative fluoreszenzbasierte und spektroskopische Bildgebungsverfahren in der Viszeralmedizin ­ Präzisionschirurgie im "Hightech"-OP.

INTRODUCTION: Fluorescence angiography (FA) with indocyanine green (ICG) and hyperspectral imaging (HSI) are novel intraoperative visualization techniques in abdominal, vascular and transplant surgery. With the purpose of precision surgery, and in order to increase patient's safety, these new tools aim at reducing postoperative morbidity and mortality. This review discusses and highlights recent developments and the future potential of real-time imaging modalities. METHODS: The underlying mechanisms of the novel imaging methods and their clinical impact are displayed in the context of avoiding anastomotic leaks, the most momentous complications in gastrointestinal surgery after oncologic resections. RESULTS: While FA is associated with the admission of a fluorescence agent, HSI is contact-free and non-invasive. Both methods are able to record physiological tissue properties in real-time. Additionally, FA also measures dynamic phenomena. The techniques take a few seconds only and do not hamper the operative workflow considerably. With regard to a potential change of the surgical strategy, FA and HSI have an equal significance. Our own advancements reflect, in particular, the topics of data visualization and automated data analyses together with the implementation of artificial intelligence (AI) and minimalization of the current devices to install them into endoscopes, minimal-invasive and robot-guided surgery. CONCLUSION: There are a limited number of studies in the field of intraoperative imaging techniques. Whether precision surgery in the "high-tech" OR together with FA, HSI and robotics will result in more secure operative procedures to minimize the postoperative morbidity and mortality will have to be evaluated in future multicenter trials.

Hyperspectral Imaging (HSI) as a new diagnostic tool in free flap monitoring for soft tissue reconstruction: a proof of concept study.

OBJECTIVES: Free flap surgery is an essential procedure in soft tissue reconstruction. Complications due to vascular compromise often require revision surgery or flap removal. We present hyperspectral imaging (HSI) as a new tool in flap monitoring to improve sensitivity compared to established monitoring tools. METHODS: We performed a prospective observational cohort study including 22 patients. Flap perfusion was assessed by standard clinical parameters, Doppler ultrasound, and HSI on t0 (0 h), t1 (16-28 h postoperatively), and t2 (39-77 h postoperatively). HSI records light spectra from 500 to 1000 nm and provides information on tissue morphology, composition, and physiology. These parameters contain tissue oxygenation (StO2), near-infrared perfusion- (NIR PI), tissue hemoglobin- (THI), and tissue water index (TWI). RESULTS: Total flap loss was seen in n = 4 and partial loss in n = 2 cases. Every patient with StO2 or NIR PI below 40 at t1 had to be revised. No single patient with StO2 or NIR PI above 40 at t1 had to be revised. Significant differences between feasable (StO2 = 49; NIR PI = 45; THI = 16; TWI = 56) and flaps with revision surgery [StO2 = 28 (p < 0.001); NIR PI = 26 (p = 0.002); THI = 56 (p = 0.002); TWI = 47 (p = 0.045)] were present in all HSI parameters at t1 and even more significant at t2 (p < 0.0001). CONCLUSION: HSI provides valuable data in free flap monitoring. The technique seems to be superior to the gold standard of flap monitoring. StO2 and NIR PI deliver the most valuable data and 40 could be used as a future threshold in surgical decision making. Clinical Trial Register This study is registered at the German Clinical Trials Register (DRKS) under the registration number DRKS00020926.

Precision Surgery In Rectal Resection With Hyperspectral and Fluorescence Imaging And Pelvic Intraoperative Neuromonitoring (With Video).

Oncologic visceral surgery has recently been revolutionized by robotics, artificial intelligence (AI), sparing of functionally important structures and innovative intraoperative imaging tools. These techniques enable new dimensions of precision surgery and oncology. Currently, data-driven, cognitive operating rooms are standing at the forefront of the latest technical and didactic developments in abdominal surgery. Rectal low anterior resection with total mesorectal excision (TME) for lower- and middle-third rectal cancer is a challenging operation due to the narrow pelvis and the tender guiding structures. Thus, new approaches have been needed to simplify the procedure and to upgrade the results. The combination of robotics with pelvic intraoperative neuromonitoring (pIONM) and new possibilities of visualization, such as multi- and hyperspectral imaging (MSI / HSI) or fluorescence imaging (FI) with indocyanine green (ICG) is a forward-looking modality to enhance surgical precision and reduce postoperative complications while improving oncologic and functional outcomes with a better quality of life. The aim of our video-paper is to show how to achieve maximum precision by combining robotic surgery with pelvic intraoperative neuromonitoring and new imaging devices for rectal cancer.

Hyperspectral Imaging (HSI) in Acute Mesenteric Ischemia to Detect Intestinal Perfusion Deficits.

BACKGROUND: Acute mesenteric ischemia is a life-threatening acute condition, which requires an interdisciplinary approach, including vascular recanalization and surgical treatment. Visual evaluation of intestinal perfusion might be misleading, and therefore, additional tools are necessary to reliably be able to resect the ischemic intestine. Hyperspectral imaging (HSI) has been shown to be feasible and safe for real-time assessment of tissue perfusion in visceral surgery but has never been used in cases of acute mesenteric ischemia. Therefore, we applied HSI in acute mesenteric ischemia to evaluate it for potential aid in the objectively discriminating ischemic and well-perfused intestine during explorative laparotomy. METHODS: We recorded HSI measurements in 11 cases of acute mesenteric ischemia during explorative laparotomy. We evaluated the recorded images for macroscopic visual perfusion quality and divided it into three groups. Of those three groups, we calculated and compared the HSI indexes of tissue saturation, near-infrared perfusion index, organ hemoglobin index, and tissue water index, as well as the reflectance spectra. RESULTS: We found significant differences in tissue saturation (0.7% versus 0.45%; P = 0.002) and near-infrared perfusion index (0.58 versus 0.23; P < 0.001) in poorly perfused intestinal segments compared with the viable intestine. Furthermore, we could detect an increasing peak at 630 nm of the reflectance spectra in less viable tissues, indicating a maximum in necrotic tissues. We attributed this peak to an increase in met-hemoglobin content in necrotic tissues, which is supported by the increase in the HSI organ hemoglobin index. CONCLUSIONS: HSI is able to discriminate tissue perfusion in acute mesenteric ischemia reliably and therefore might be helpful for resection. In addition, HSI gives information on tissue viability via reflectance spectra.

Evaluation of hyperspectral imaging (HSI) for the measurement of ischemic conditioning effects of the gastric conduit during esophagectomy.

BACKGROUND: Hyperspectral imaging (HSI) is a relatively new method used in image-guided and precision surgery, which has shown promising results for characterization of tissues and assessment of physiologic tissue parameters. Previous methods used for analysis of preconditioning concepts in patients and animal models have shown several limitations of application. The aim of this study was to evaluate HSI for the measurement of ischemic conditioning effects during esophagectomy. METHODS: Intraoperative hyperspectral images of the gastric tube through the mini-thoracotomy were recorded from n = 22 patients, 14 of whom underwent laparoscopic gastrolysis and ischemic conditioning of the stomach with two-step transthoracic esophagectomy and gastric pull-up with intrathoracic anastomosis after 3-7 days. The tip of the gastric tube (later esophagogastric anastomosis) was measured with HSI. Analysis software provides a RGB image and 4 false color images representing physiologic parameters of the recorded tissue area intraoperatively. These parameters contain tissue oxygenation (StO2), perfusion-(NIR Perfusion Index), organ hemoglobin (OHI), and tissue water index (TWI). RESULTS: Intraoperative HSI of the gastric conduit was possible in all patients and did not prolong the regular operative procedure due to its quick applicability. In particular, the tissue oxygenation of the gastric conduit was significantly higher in patients who underwent ischemic conditioning ([Formula: see text] = 78%; [Formula: see text] = 66%; p = 0.03). CONCLUSIONS: HSI is suitable for contact-free, non-invasive, and intraoperative evaluation of physiological tissue parameters within gastric conduits. Therefore, HSI is a valuable method for evaluating ischemic conditioning effects and may contribute to reduce anastomotic complications. Additional studies are needed to establish normal values and thresholds of the presented parameters for the gastric conduit anastomotic site.

Hyperspectral Imaging Detects Clitoral Vascular Issues in Gender-Affirming Surgery.

The aim of this study was to assess the efficacy of hyperspectral imaging (HSI) as an intraoperative perfusion imaging modality during gender affirmation surgery (GAS). The hypothesis posited that HSI could quantify perfusion to the clitoral complex, thereby enabling the prediction of either uneventful wound healing or the occurrence of necrosis. In this non-randomised prospective clinical study, we enrolled 30 patients who underwent GAS in the form of vaginoplasty with the preparation of a clitoral complex from 2020 to 2024 and compared patients' characteristics as well as HSI data regarding clitoris necrosis. Individuals demonstrating uneventful wound healing pertaining to the clitoral complex were designated as Group A. Patients with complete necrosis of the neo-clitoris were assigned to Group B. Patient characteristics were collected and subsequently a comparative analysis carried out. No significant difference in patient characteristics was observed between the two groups. Necrosis occurred when both StO2 and NIR PI parameters fell below 40%. For the simultaneous occurrence of StO2 and NIR PI of 40% or less, a sensitivity of 92% and specificity of 72% was calculated. Intraoperatively, the onset of necrosis in the clitoral complex can be reliably predicted with the assistance of HSI.

Intraoperative Laparoscopic Hyperspectral Imaging during Esophagectomy-A Pilot Study Evaluating Esophagogastric Perfusion at the Anastomotic Sites.

Hyperspectral imaging (HSI) is a non-invasive and contactless technique that enables the real-time acquisition of comprehensive information on tissue within the surgical field. In this pilot study, we investigated whether a new HSI system for minimally-invasive surgery, TIVITA® Mini (HSI-MIS), provides reliable insights into tissue perfusion of the proximal and distal esophagogastric anastomotic sites during 21 laparoscopic/thoracoscopic or robotic Ivor Lewis esophagectomies of patients with cancer to minimize the risk of dreaded anastomotic insufficiency. In this pioneering investigation, physiological tissue parameters were derived from HSI measurements of the proximal site of the anastomosis (esophageal stump) and the distal site of the anastomosis (tip of the gastric conduit) during the thoracic phase of the procedure. Tissue oxygenation (StO2), Near Infrared Perfusion Index (NIR-PI), and Tissue Water Index (TWI) showed similar median values at both anastomotic sites. Significant differences were observed only for NIR-PI (median: 76.5 vs. 63.9; p = 0.012) at the distal site (gastric conduit) compared to our previous study using an HSI system for open surgery. For all 21 patients, reliable and informative measurements were attainable, confirming the feasibility of HSI-MIS to assess anastomotic viability. Further studies on the added benefit of this new technique aiming to reduce anastomotic insufficiency are warranted.

Switchable LED-based laparoscopic multispectral system for rapid high-resolution perfusion imaging.

Significance: Multispectral imaging (MSI) is an approach for real-time, quantitative, and non-invasive tissue perfusion measurements. Current laparoscopic systems based on mosaic sensors or filter wheels lack high spatial resolution or acceptable frame rates. Aim: To develop a laparoscopic system for MSI-based color video and tissue perfusion imaging during gastrointestinal surgery without compromising spatial or temporal resolution. Approach: The system was built with 14 switchable light-emitting diodes in the visible and near-infrared spectral range, a 4K image sensor, and a 10 mm laparoscope. Illumination patterns were created for tissue oxygenation and hemoglobin content monitoring. The system was calibrated to a clinically approved laparoscopic hyperspectral system using linear regression models and evaluated in an occlusion study with 36 volunteers. Results: The root mean squared errors between the MSI and reference system were 0.073 for hemoglobin content, 0.039 for oxygenation in deeper tissue layers, and 0.093 for superficial oxygenation. The spatial resolution at a working distance of 45 mm was 156 µm. The effective frame rate was 20 fps. Conclusions: High-resolution perfusion monitoring was successfully achieved. Hardware optimizations will increase the frame rate. Parameter optimizations through alternative illumination patterns, regression, or assumed tissue models are planned. Intraoperative measurements must confirm the suitability during surgery.