Discrimination of human and animal bloodstains using hyperspectral imaging.

Blood is the most encountered type of biological evidence in violent crimes and contains pertinent information to a forensic investigation. The false presumption that blood encountered at a crime scene is human may not be realised until after costly and sample-consuming tests are performed. To address the question of blood origin, the novel application of visible-near infrared hyperspectral imaging (HSI) is used for the detection and discrimination of human and animal bloodstains. The HSI system used is a portable, non-contact, non-destructive method for the determination of blood origin. A support vector machine (SVM) binary classifier was trained for the discrimination of bloodstains of human (n = 20) and five animal species: pig (n = 20), mouse (n = 16), rat (n = 5), rabbit (n = 5), and cow (n = 20). On an independent test set, the SVM model achieved accuracy, precision, sensitivity, and specificity values of 96, 97, 95, and 96%, respectively. Segmented images of bloodstains aged over a period of two months were produced, allowing for the clear visualisation of the discrimination of human and animal bloodstains. The inclusion of such a system in a forensic investigation workflow not only removes ambiguity surrounding blood origin, but can potentially be used in tandem with HSI bloodstain age determination methods for rapid on-scene forensic analysis.

Comparison of hyperspectral imaging and fluorescence angiography for the determination of the transection margin in colorectal resections-a comparative study.

PURPOSE: One relevant aspect for anastomotic leakage in colorectal surgery is blood perfusion of both ends of the anastomosis. The clinical evaluation of this issue is limited, but new methods like fluorescence angiography with indocyanine green or non-invasive and contactless hyperspectral imaging have evolved as objective parameters for perfusion evaluation. METHODS: In this prospective, non-randomized, open-label and two-arm study, fluorescence angiography and hyperspectral imaging were compared in 32 consecutive patients with each other and with the clinical assessment by the surgeon. After preparation of the bowel and determination of the surgical resection line, the tissue was evaluated with hyperspectral imaging for 5 min before and after cutting the marginal artery and assessed by 6 hyperspectral pictures followed by fluorescence angiography with indocyanine green. RESULTS: In 30 of 32 patients, the image data could be evaluated and compared. Both methods provided a comparable borderline between well-perfused and poorly perfused tissue (p = 0.704). In 15 cases, the surgical resection line was shifted to the central position due to the imaging. The border zone was sharper in fluorescence angiography and best assessed 31 s after injection. With hyperspectral imaging, the border zone was visualized wider and with more differences between proximal and distal border. CONCLUSION: Hyperspectral imaging and fluorescence angiography provide similar results in determining the perfusion border. Both methods allow a good and safe visualization of the blood perfusion at the central resection margin to create a well-perfused anastomosis. TRIAL REGISTRATION: This study was registered at Clinicaltrials.gov ( NCT04226781 ) on January 13, 2020.

Determination of the transection margin during colorectal resection with hyperspectral imaging (HSI).

PURPOSE: This study evaluated the use of hyperspectral imaging for the determination of the resection margin during colorectal resections instead of clinical macroscopic assessment. METHODS: The used hyperspectral camera is able to record light spectra from 500 to 1000 nm and provides information about physiologic parameters of the recorded tissue area intraoperatively (e.g., tissue oxygenation and perfusion). We performed an open-label, single-arm, and non-randomized intervention clinical trial to compare clinical assessment and hyperspectral measurement to define the resection margin in 24 patients before and after separation of the marginal artery over 15 min; HSI was performed each minute to assess the parameters mentioned above. RESULTS: The false color images calculated from the hyperspectral data visualized the margin of perfusion in 20 out of 24 patients precisely. In the other four patients, the perfusion difference could be displayed with additional evaluation software. In all cases, there was a deviation between the transection line planed by the surgeon and the border line visualized by HSI (median 1 mm; range - 13 to 13 mm). Tissue perfusion dropped up to 12% within the first 10 mm distal to the border line. Therefore, the resection area was corrected proximally in five cases due to HSI record. The biggest drop in perfusion took place in less than 2 min after devascularization. CONCLUSION: Determination of the resection margin by HSI provides the surgeon with an objective decision aid for assessment of the best possible perfusion and ideal anastomotic area in colorectal surgery.

Bibliometric analysis of the current status and trends on medical hyperspectral imaging.

Hyperspectral imaging (HSI) is a promising technology that can provide valuable support for the advancement of the medical field. Bibliometrics can analyze a vast number of publications on both macroscopic and microscopic levels, providing scholars with essential foundations to shape future directions. The purpose of this study is to comprehensively review the existing literature on medical hyperspectral imaging (MHSI). Based on the Web of Science (WOS) database, this study systematically combs through literature using bibliometric methods and visualization software such as VOSviewer and CiteSpace to draw scientific conclusions. The analysis yielded 2,274 articles from 73 countries/regions, involving 7,401 authors, 2,037 institutions, 1,038 journals/conferences, and a total of 7,522 keywords. The field of MHSI is currently in a positive stage of development and has conducted extensive research worldwide. This research encompasses not only HSI technology but also its application to diverse medical research subjects, such as skin, cancer, tumors, etc., covering a wide range of hardware constructions and software algorithms. In addition to advancements in hardware, the future should focus on the development of algorithm standards for specific medical research targets and cultivate medical professionals of managing vast amounts of technical information.

Quantitative characterization of the diffusion behavior of sucrose in marinated beef by HSI and FEA.

The quality of marinated meat could be assessed by the uniformity of marinade distribution within it. In this study, the diffusion behavior of sucrose inside the marinated beef was quantitatively characterized from 2D plane and 3D space using hyperspectral imaging (HSI) and finite element analysis (FEA), respectively. Visualization of sucrose content based on HSI showed that the distribution state of sucrose on marinated beef was not uniform. Subsequently, the diffusion behavior of sucrose in the 3D beef geometric model was simulated using FEA. Results revealed that the diffusion rate of sucrose on muscle tissues is significantly higher than other tissues, and the difference in diffusion behavior is the main reason for the inhomogeneous distribution of sucrose. The quantitative characterization of marinade diffusion behavior makes it possible to predict the marinade's transient distribution state, thereby determining the optimal marinade conditions for the meat. Therefore, the method proposed has practical significance for evaluating and regulating the quality of marinated meat products.

Nondestructive discrimination of analogous density foreign matter inside soy protein meat semi-finished products based on transmission hyperspectral imaging.

Analogous density foreign matter (ADFM) embedded in soy protein meat semi-finished (SFSPM) is hidden by SFSPM and has similar acoustic impedance features to SFSPM, which makes non-destructive testing techniques such as computer vision (CV), reflectance spectroscopy and ultrasound imaging inappropriate for ADFM, which not only seriously affects the quality of soy protein meat (SPM) products but also increases the safety risk to consumers. In this study, to locate and separate ADFM by using transmission hyperspectral imaging (T-HSI) technique which is sensitive to chemical composition and highlight internal contours. The optimal discrimination model SVM + PCA + MSC + SPA was constructed using transmission spectral information with an accuracy of 95.00 %. The visualization results based on the optimal model showed clearer localization results than CV and ultrasound imaging. The study demonstrated that the advantages of T-HSI technology in detecting and locating ADFM inside SFSPM, which provides a basis for improving the production quality and safety of SPM.

Lightfield hyperspectral imaging in neuro-oncology surgery: an IDEAL 0 and 1 study.

Introduction: Hyperspectral imaging (HSI) has shown promise in the field of intra-operative imaging and tissue differentiation as it carries the capability to provide real-time information invisible to the naked eye whilst remaining label free. Previous iterations of intra-operative HSI systems have shown limitations, either due to carrying a large footprint limiting ease of use within the confines of a neurosurgical theater environment, having a slow image acquisition time, or by compromising spatial/spectral resolution in favor of improvements to the surgical workflow. Lightfield hyperspectral imaging is a novel technique that has the potential to facilitate video rate image acquisition whilst maintaining a high spectral resolution. Our pre-clinical and first-in-human studies (IDEAL 0 and 1, respectively) demonstrate the necessary steps leading to the first in-vivo use of a real-time lightfield hyperspectral system in neuro-oncology surgery. Methods: A lightfield hyperspectral camera (Cubert Ultris ×50) was integrated in a bespoke imaging system setup so that it could be safely adopted into the open neurosurgical workflow whilst maintaining sterility. Our system allowed the surgeon to capture in-vivo hyperspectral data (155 bands, 350-1,000 nm) at 1.5 Hz. Following successful implementation in a pre-clinical setup (IDEAL 0), our system was evaluated during brain tumor surgery in a single patient to remove a posterior fossa meningioma (IDEAL 1). Feedback from the theater team was analyzed and incorporated in a follow-up design aimed at implementing an IDEAL 2a study. Results: Focusing on our IDEAL 1 study results, hyperspectral information was acquired from the cerebellum and associated meningioma with minimal disruption to the neurosurgical workflow. To the best of our knowledge, this is the first demonstration of HSI acquisition with 100+ spectral bands at a frame rate over 1Hz in surgery. Discussion: This work demonstrated that a lightfield hyperspectral imaging system not only meets the design criteria and specifications outlined in an IDEAL-0 (pre-clinical) study, but also that it can translate into clinical practice as illustrated by a successful first in human study (IDEAL 1). This opens doors for further development and optimisation, given the increasing evidence that hyperspectral imaging can provide live, wide-field, and label-free intra-operative imaging and tissue differentiation.

Hyperspectral Imaging and Selected Biological Control Agents for the Management of Fusarium Head Blight in Spring Wheat.

Fusarium spp. are important pathogens on cereals, capable of causing considerable yield losses and significantly reducing the quality of harvested grains due to contamination with mycotoxins. The European Union intends to reduce the use of chemical-synthetic plant protection products (csPPP) by up to 50% by the year 2030. To realize this endeavor without significant economic losses for farmers, it is crucial to have both precise early detection of pathogens and effective alternatives for csPPP. To investigate both the early detection of Fusarium head blight (FHB) and the efficacy of selected biological control agents (BCAs), a pot experiment with spring wheat (cv. 'Servus') was conducted under semi-field conditions. Spikes were sprayed with different BCAs prior to inoculation with a mixture of F. graminearum and F. culmorum conidia. While early detection of FHB was investigated by hyperspectral imaging (HSI), the efficiency of the fungal (Trichoderma sp. T10, T. harzianum T16, T. asperellum T23 and Clonostachys rosea CRP1104) and bacterial (Bacillus subtilis HG77 and Pseudomonas fluorescens G308) BCAs was assessed by visual monitoring. Evaluation of the hyperspectral images using linear discriminant analysis (LDA) resulted in a pathogen detection nine days post inoculation (dpi) with the pathogen, and thus four days before the first symptoms could be visually detected. Furthermore, support vector machines (SVM) and a combination of LDA and distance classifier (DC) were also able to detect FHB symptoms earlier than manual rating. Scoring the spikes at 13 and 17 dpi with the pathogen showed no significant differences in the FHB incidence among the treatments. Nevertheless, there is a trend suggesting that all BCAs exhibit a diminishing effect against FHB, with fungal isolates demonstrating greater efficacy compared to bacterial ones.

Conditional Generative Adversarial Network (cGAN) for Synthesis of Digital Histologic Images from Hyperspectral Images.

Hyperspectral imaging (HSI) has been demonstrated in various digital pathology applications. However, the intrinsic high dimensionality of hyperspectral images makes it difficult for pathologists to visualize the information. The aim of this study is to develop a method to transform hyperspectral images of hemoxylin & eosin (H&E)-stained slides to natural-color RGB histologic images for easy visualization. Hyperspectral images were obtained at 40× magnification with an automated microscopic imaging system and downsampled by various factors to generate data equivalent to different magnifications. High-resolution digital histologic RGB images were cropped and registered to the corresponding hyperspectral images as the ground truth. A conditional generative adversarial network (cGAN) was trained to output natural color RGB images of the histological tissue samples. The generated synthetic RGBs have similar color and sharpness to real RGBs. Image classification was implemented using the real and synthetic RGBs, respectively, with a pretrained network. The classification of tumor and normal tissue using the HSI-synthesized RGBs yielded a comparable but slightly higher accuracy and AUC than the real RGBs. The proposed method can reduce the acquisition time of two imaging modalities while giving pathologists access to the high information density of HSI and the quality visualization of RGBs. This study demonstrated that HSI may provide a potentially better alternative to current RGB-based pathologic imaging and thus make HSI a viable tool for histopathological diagnosis.

Microcirculatory tissue oxygenation correlates with kidney function after transcatheter aortic valve implantation-Results from a prospective observational study.

Introduction: Kidney dysfunction is common in patients with aortic stenosis (AS) and correction of the aortic valve by transcatheter aortic valve implantation (TAVI) often affects kidney function. This may be due to microcirculatory changes. Methods: We evaluated skin microcirculation with a hyperspectral imaging (HSI) system, and compared tissue oxygenation (StO2), near-infrared perfusion index (NIR), tissue hemoglobin index (THI) and tissue water index (TWI) in 40 patients undergoing TAVI versus 20 control patients. HSI parameters were measured before TAVI (t1), directly after TAVI (t2), and on postinterventional day 3 (t3). The primary outcome was the correlation of tissue oxygenation (StO2) to the creatinine level after TAVI. Results: We performed 116 HSI image recordings in patients undergoing TAVI for the treatment of severe aortic stenosis and 20 HSI image recordings in control patients. Patients with AS had a lower THI at the palm (p = 0.034) and a higher TWI at the fingertips (p = 0.003) in comparison to control patients. TAVI led to an increase of TWI, but had no uniform enduring effect on StO2 and THI. Tissue oxygenation StO2 at both measurement sites correlated negatively with creatinine levels after TAVI at t2 (palm: ρ = -0.415; p = 0.009; fingertip: ρ = -0.519; p < 0.001) and t3 (palm: ρ = -0.427; p = 0.008; fingertip: ρ = -0.398; p = 0.013). Patients with higher THI at t3 reported higher physical capacity and general health scores 120 days after TAVI. Conclusion: HSI is a promising technique for periinterventional monitoring of tissue oxygenation and microcirculatory perfusion quality, which are related to kidney function, physical capacity, and clinical outcomes after TAVI. Clinical trial registration: https://drks.de/search/de/trial, identifier DRKS00024765.

Intraoperative reperfusion assessment of human pancreas allografts using hyperspectral imaging (HSI).

Background: The most common causes of early graft loss in pancreas transplantation are insufficient blood supply and leakage of the intestinal anastomosis. Therefore, it is critical to monitor graft perfusion and oxygenation during the early post-transplant period. The goal of our pilot study was to evaluate the utility of hyperspectral imaging (HSI) in monitoring the microcirculation of the graft and adequate perfusion of the intestinal anastomosis during pancreatic allotransplantation. Methods: We imaged pancreatic grafts and intestinal anastomosis in real-time in three consecutive, simultaneous pancreas-kidney transplantations using the TIVITA® HSI system. Further, the intraoperative oxygen saturation (StO2), tissue perfusion (near-infrared perfusion index, NIR), organ hemoglobin index (OHI), and tissue water index (TWI) were measured 15 minutes after reperfusion by HSI. Results: All pancreas grafts showed a high and homogeneous StO2 (92.6%±10.45%). Intraoperative HSI analysis of the intestinal anastomosis displayed significant differences of StO2 (graft duodenum 67.46%±5.60% vs. recipient jejunum: 75.93%±4.71%, P<0.001) and TWI {graft duodenum: 0.63±0.09 [I (Index)] vs. recipient jejunum: 0.72±0.09 [I], P<0.001}. NIR and OHI did not display remarkable differences {NIR duodenum: 0.68±0.06 [I] vs. NIR jejunum: 0.69±0.04 [I], P=0.747; OHI duodenum: 0.70±0.12 [I] vs. OHI jejunum: 0.68±0.13 [I], P=0.449}. All 3 patients had an uneventful postoperative course with one displaying a Banff 1a rejection which was responsive to steroid treatment. Conclusions: Our study shows that contact-free HSI has potential utility as a novel tool for real-time monitoring of human pancreatic grafts after reperfusion, which could improve the outcome of pancreas transplantation. Further investigations are required to determine the predictive value of intraoperative HSI imaging.

Evaluation of near-infrared hyperspectral imaging for the assessment of potato processing aptitude.

The potato (Solanum tuberosum L.) is the world's fifth most important staple food with high socioeconomic relevance. Several potato cultivars obtained by selection and crossbreeding are currently on the market. This diversity causes tubers to exhibit different behaviors depending on the processing to which they are subjected. Therefore, it is interesting to identify cultivars with specific characteristics that best suit consumer preferences. In this work, we present a method to classify potatoes according to their cooking or frying as crisps aptitude using NIR hyperspectral imaging (HIS) combined with a Partial Least Squares Discriminant Analysis (PLS-DA). Two classification approaches were used in this study. First, a classification model using the mean spectra of a dataset composed of 80 tubers belonging to 10 different cultivars. Then, a pixel-wise classification using all the pixels of each sample of a small subset of samples comprised of 30 tubers. Hyperspectral images were acquired using fresh-cut potato slices as sample material placed on a mobile platform of a hyperspectral system in the NIR range from 900 to 1,700 nm. After image processing, PLS-DA models were built using different pre-processing combinations. Excellent accuracy rates were obtained for the models developed using the mean spectra of all samples with 90% of tubers correctly classified in the external dataset. Pixel-wise classification models achieved lower accuracy rates between 66.62 and 71.97% in the external validation datasets. Moreover, a forward interval PLS (iPLS) method was used to build pixel-wise PLS-DA models reaching accuracies above 80 and 71% in cross-validation and external validation datasets, respectively. Best classification result was obtained using a subset of 100 wavelengths (20 intervals) with 71.86% of pixels correctly classified in the validation dataset. Classification maps were generated showing that false negative pixels were mainly located at the edges of the fresh-cut slices while false positive were principally distributed at the central pith, which has singular characteristics.

New Intraoperative Imaging Tools and Image-Guided Surgery in Gastric Cancer Surgery.

Innovations and new advancements in intraoperative real-time imaging have gained significant importance in the field of gastric cancer surgery in the recent past. Currently, the most promising procedures include indocyanine green fluorescence imaging (ICG-FI) and hyperspectral imaging or multispectral imaging (HSI, MSI). ICG-FI is utilized in a broad range of clinical applications, e.g., assessment of perfusion or lymphatic drainage, and additional implementations are currently investigated. HSI is still in the experimental phase and its value and clinical relevance require further evaluation, but initial studies have shown a successful application in perfusion assessment, and prospects concerning non-invasive tissue and tumor classification are promising. The application of machine learning and artificial intelligence technologies might enable an automatic evaluation of the acquired image data in the future. Both methods facilitate the accurate visualization of tissue characteristics that are initially indistinguishable for the human eye. By aiding surgeons in optimizing the surgical procedure, image-guided surgery can contribute to the oncologic safety and reduction of complications in gastric cancer surgery and recent advances hold promise for the application of HSI in intraoperative tissue diagnostics.

Border Line Definition Using Hyperspectral Imaging in Colorectal Resections.

BACKGROUND: A perfusion deficit is a well-defined and intraoperatively influenceable cause of anastomotic leak (AL). Current intraoperative perfusion assessment methods do not provide objective and quantitative results. In this study, the ability of hyperspectral imaging (HSI) to quantify tissue oxygenation intraoperatively was assessed. METHODS: 115 patients undergoing colorectal resections were included in the final analysis. Before anastomotic formation, the bowel was extracted and the resection line was outlined and imaged using a compact HSI camera, in order to provide instantaneously quantitative perfusion assessment. RESULTS: In 105 patients, a clear demarcation line was visible with HSI one minute after marginal artery transection, reaching a plateau after 3 min. In 58 (55.2%) patients, the clinically determined transection line matched with HSI. In 23 (21.9%) patients, the clinically established resection margin was entirely within the less perfused area. In 24 patients (22.8%), the HSI transection line had an irregular course and crossed the clinically established resection line. In four cases, HSI disclosed a clinically undetected lesion of the marginal artery. CONCLUSIONS: Intraoperative HSI is safe, well reproducible, and does not disrupt the surgical workflow. It also quantifies bowel surface perfusion. HSI might become an intraoperative guidance tool, potentially preventing postoperative complications.

Assessment of diabetic small-fiber neuropathy by using short-wave infrared hyperspectral imaging.

Among patients with type 2 diabetes mellitus (T2DM), the association between hyperspectral imaging (HSI) examination and diabetic neuropathy (DN) is ascertained using HSI of the feet using four types of spectral difference measurements. DN was evaluated by traditional Michigan Neuropathy Screening Instrument (MNSI), evaluation of painful neuropathy (ID-Pain, DN4) and sudomotor function by measuring electrochemical skin conductance (ESC). Of the 120 T2DM patients and 20 healthy adults enrolled, T2DM patients are categorized into normal sudomotor (ESC >60 µS) and sudomotor dysfunction (ESC ≤ 60 µS) groups. Spectral difference analyses reveal significant intergroup differences, whereas traditional examinations cannot distinguish between the two groups. HSI waveform reflectance gradually increases with disease severity, at 1400 to 1600 nm. The area under the curve (AUC) of receiver operating characteristic (ROC) analysis for abnormal ESC is ≥0.8 for all four HSI methods. HSI could be an objective, sensitive, rapid, noninvasive and remote approach to identify early small-fiber DN.

Dynamics and genetic regulation of leaf nutrient concentration in barley based on hyperspectral imaging and machine learning.

Biofortification, the enrichment of nutrients in crop plants, is of increasing importance to improve human health. The wild barley nested association mapping (NAM) population HEB-25 was developed to improve agronomic traits including nutrient concentration. Here, we evaluated the potential of high-throughput hyperspectral imaging in HEB-25 to predict leaf concentration of 15 mineral nutrients, sampled from two field experiments and four developmental stages. Particularly accurate predictions were obtained by partial least squares regression (PLS) modeling of leaf concentrations for N, P and K reaching coefficients of determination of 0.90, 0.75 and 0.89, respectively. We recognized nutrient-specific patterns of variation of leaf nutrient concentration between developmental stages. A number of quantitative trait loci (QTL) associated with the simultaneous expression of leaf nutrients were detected, indicating their potential co-regulation in barley. For example, the wild barley allele of QTL-4H-1 simultaneously increased leaf concentration of N, P, K and Cu. Similar effects of the same QTL were previously reported for nutrient concentrations in grains, supporting a potential parallel regulation of N, P, K and Cu in leaves and grains of HEB-25. Our study provides a new approach for nutrient assessment in large-scale field experiments to ultimately select genes and genotypes supporting plant biofortification.

Non-destructive age estimation of biological fluid stains: An integrated analytical strategy based on near-infrared hyperspectral imaging and multivariate regression.

From a criminalistic point of view, the accurate dating of biological traces found at the crime scene, together with its compatibility with the estimated crime perpetration timeframe, enables to limit the number of suspects by assessing their alibis and clarifying the sequence of events. The present study delineates, for the first time, the possibility of dating biological fluids such as semen and urine, as well as blood traces, by using a novel non-destructive analytical strategy based on hyperspectral imaging in the near infared region (HSI-NIR), coupled with multivariate regression methods. Investigated aspects of the present study include not only the progressive degradation of the biological trace itself, but also the effects of its interactions with the support on which it is absorbed, in particular the hydrophilic vs. hydrophobic character of fabric tissues. Results are critically discussed, highlighting potential and limitations of the proposed approach for a practical implementation.

Hyperspectral Imaging (HSI)-A New Tool to Estimate the Perfusion of Upper Abdominal Organs during Pancreatoduodenectomy.

Hyperspectral imaging (HSI) in abdominal surgery is a new non-invasive tool for the assessment of the perfusion and oxygenation of various tissues and organs. Its benefit in pancreatic surgery is still unknown. The aim of this study was to evaluate the key impact of using HSI during pancreatoduodenectomy (PD). In total, 20 consecutive patients were included. HSI was recorded during surgery as part of a pilot study approved by the local Ethics Committee. Data were collected prospectively with the TIVITA® Tissue System. Intraoperative HS images were recorded before and after gastroduodenal artery (GDA) clamping. We detected four patients with celiac artery stenosis (CAS) caused by a median arcuate ligament (MAL). In two of these patients, a reduction in liver oxygenation (StO2) was discovered 15 and 30 min after GDA clamping. The MAL was divided in these patients. HSI showed an improvement of liver StO2 after MAL division (from 61% to 73%) in one of these two patients. There was no obvious decrease in liver StO2 in the other two patients with CAS. HSI, as a non-invasive procedure, could be helpful in evaluating liver and gastric perfusion during PD, which might assist surgeons in choosing the best surgical approach and in improving patients' outcomes.

Feedforward Artificial Neural Network-Based Colorectal Cancer Detection Using Hyperspectral Imaging: A Step towards Automatic Optical Biopsy.

Currently, colorectal cancer (CRC) is mainly identified via a visual assessment during colonoscopy, increasingly used artificial intelligence algorithms, or surgery. Subsequently, CRC is confirmed through a histopathological examination by a pathologist. Hyperspectral imaging (HSI), a non-invasive optical imaging technology, has shown promising results in the medical field. In the current study, we combined HSI with several artificial intelligence algorithms to discriminate CRC. Between July 2019 and May 2020, 54 consecutive patients undergoing colorectal resections for CRC were included. The tumor was imaged from the mucosal side with a hyperspectral camera. The image annotations were classified into three groups (cancer, CA; adenomatous margin around the central tumor, AD; and healthy mucosa, HM). Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. Hyperspectral imaging combined with automatic classification can be used to differentiate between CRC and healthy mucosa. Additionally, the biological changes induced by chemotherapy to the tissue are detectable with HSI.

Development of a real-time spectral imaging system using in-site micro-LED-based illumination and high-speed micro-camera for endoscopic applications.

We designed a compact, real-time LED-based endoscopic imaging system for the detection of various diseases including cancer. In gastrointestinal applications, conventional endoscopy cannot reliably differentiate tumor from normal tissue. Current hyperspectral imaging systems are too slow to be used for real-time endoscopic applications. We are investigating real-time spectral imaging for different tissue types. Our objective is to develop a catheter for real-time hyperspectral gastrointestinal endoscopy. The endoscope uses multiple wavelengths within UV, visible, and IR light spectra generated by a micro-LED array. We capture images with a monochrome micro camera, which is cost-effective and smaller than the current hyperspectral imagers. A wireless transceiver sends the captured images to a workstation for further processing, such as tumor detection. The spatial resolution of the system is defined by camera resolution and the distance to the object, while the number of LEDs in the multi-wavelength light source determines the spectral resolution. To investigate the properties and the limitations of our high-speed spectral imaging approach, we designed a prototype system. We conducted two experiments to measure the optimal forward voltages and lighting duration of the LEDs. These factors affect the maximum feasible imaging rate and resolution. The lighting duration of each LED can be shorter than 10 ms while producing an image with a high signal-to-noise ratio and no illumination interference. These results support the idea of using a high-speed camera and an LED-array for real-time hyperspectral endoscopic imaging.