Hyperspectral imaging reveals small-scale water gradients in apple leaves due to minimal cuticle perforation by Venturia inaequalis conidiophores.

Effects of Venturia inaequalis on water relations of apple leaves were studied under controlled conditions without limitation of water supply to elucidate their impact on the non-haustorial biotrophy of this pathogen. Leaf water relations, namely leaf water content and transpiration, were spatially resolved by hyperspectral imaging and thermography; non-imaging techniques-gravimetry, a pressure chamber, and porometry-were used for calibration and validation. Reduced stomatal transpiration 3-4 d after inoculation coincided with a transient increase of water potential. Perforation of the plant cuticle by protruding conidiophores subsequently increased cuticular transpiration even before visible symptoms occurred. With sufficient water supply, cuticular transpiration remained at elevated levels for several weeks. Infections did not affect the leaf water content before scab lesions became visible. Only hyperspectral imaging was suitable to demonstrate that a decreased leaf water content was strictly limited to sites of emerging conidiophores and that cuticle porosity increased with sporulation. Microscopy confirmed marginal cuticle injury; although perforated, it tightly surrounded the base of conidiophores throughout sporulation and restricted water loss. The role of sustained redirection of water flow to the pathogen's hyphae in the subcuticular space above epidermal cells, to facilitate the acquisition and uptake of nutrients by V. inaequalis, is discussed.

In situ monitoring of the shikimate pathway: a combinatorial approach of Raman reverse stable isotope probing and hyperspectral imaging.

Sensing and visualization of metabolites and metabolic pathways in situ are significant requirements for tracking their spatiotemporal dynamics in a non-destructive manner. The shikimate pathway is an important cellular mechanism that leads to the de novo synthesis of many compounds containing aromatic rings of high importance such as phenylalanine, tyrosine, and tryptophan. In this work, we present a cost-effective and extraction-free method based on the principles of stable isotope-coupled Raman spectroscopy and hyperspectral Raman imaging to monitor and visualize the activity of the shikimate pathway. We also demonstrated the applicability of this approach for nascent aromatic amino acid localization and tracking turnover dynamics in both prokaryotic and eukaryotic model systems. This method can emerge as a promising tool for both qualitative and semi-quantitative in situ metabolomics, contributing to a better understanding of aromatic ring-containing metabolite dynamics across various organisms.

Hyperspectral Imaging Technique to Characterize Digestate and Visualize Physical Impurities in Anaerobically Digested Biowaste.

Methods used to monitor anaerobic digestion (AD) indicators are commonly based on wet chemical analyses, which consume time and materials. In addition, physical disturbances, such as floating granules (FGs), must be monitored manually. In this study, we present an eco-friendly, high-throughput methodology that uses near-infrared hyperspectral imaging (NIR-HSI) to build a machine-learning model for characterizing the chemical composition of the digestate and a target detection algorithm for identifying FGs. A total of 732 digestate samples were used to develop and validate a model for calculating total nitrogen (TN), total organic carbon (TOC), total ammonia nitrogen (TAN), and chemical oxygen demand (COD), which are the chemical indicators of responses to disturbances in the AD process. Among these parameters, good model performance was obtained using the dried digestates data set, where the coefficient of determination (R2test) and the root-mean-square error (RMSEtest) were 0.82 and 1090 mg/L for TOC, and 0.86 and 690 mg/L for TN, respectively. Furthermore, the unique spectral features of the FGs in reactors with a lipid-rich substrate meant that they could also be identified by the HSI system. Based on these findings, developing NIR-HSI solutions to monitor the digestate properties in AD plants has great potential for industrial application.

A proof of concept for microcirculation monitoring using machine learning based hyperspectral imaging in critically ill patients: a monocentric observational study.

BACKGROUND: Impaired microcirculation is a cornerstone of sepsis development and leads to reduced tissue oxygenation, influenced by fluid and catecholamine administration during treatment. Hyperspectral imaging (HSI) is a non-invasive bedside technology for visualizing physicochemical tissue characteristics. Machine learning (ML) for skin HSI might offer an automated approach for bedside microcirculation assessment, providing an individualized tissue fingerprint of critically ill patients in intensive care. The study aimed to determine if machine learning could be utilized to automatically identify regions of interest (ROIs) in the hand, thereby distinguishing between healthy individuals and critically ill patients with sepsis using HSI. METHODS: HSI raw data from 75 critically ill sepsis patients and from 30 healthy controls were recorded using TIVITA® Tissue System and analyzed using an automated ML approach. Additionally, patients were divided into two groups based on their SOFA scores for further subanalysis: less severely ill (SOFA ≤ 5) and severely ill (SOFA > 5). The analysis of the HSI raw data was fully-automated using MediaPipe for ROI detection (palm and fingertips) and feature extraction. HSI Features were statistically analyzed to highlight relevant wavelength combinations using Mann-Whitney-U test and Benjamini, Krieger, and Yekutieli (BKY) correction. In addition, Random Forest models were trained using bootstrapping, and feature importances were determined to gain insights regarding the wavelength importance for a model decision. RESULTS: An automated pipeline for generating ROIs and HSI feature extraction was successfully established. HSI raw data analysis accurately distinguished healthy controls from sepsis patients. Wavelengths at the fingertips differed in the ranges of 575-695 nm and 840-1000 nm. For the palm, significant differences were observed in the range of 925-1000 nm. Feature importance plots indicated relevant information in the same wavelength ranges. Combining palm and fingertip analysis provided the highest reliability, with an AUC of 0.92 to distinguish between sepsis patients and healthy controls. CONCLUSION: Based on this proof of concept, the integration of automated and standardized ROIs along with automated skin HSI analyzes, was able to differentiate between healthy individuals and patients with sepsis. This approach offers a reliable and objective assessment of skin microcirculation, facilitating the rapid identification of critically ill patients.

Quantifying pigment content in crustose coralline algae using hyperspectral imaging: A case study with Tethysphytum antarcticum (Ross Sea, Antarctica).

Crustose coralline algae (CCA) are a highly diverse group of habitat-forming, calcifying red macroalgae (Rhodophyta) with unique adaptations to diverse irradiance regimes. A distinctive CCA phenotype adaptation, which allows them to maximize photosynthetic performance in low light, is their content of a specific group of light-harvesting pigments called phycobilins. In this study, we assessed the potential of noninvasive hyperspectral imaging (HSI) in the visible spectrum (400-800 nm) to describe the phenotypic variability in phycobilin content of an Antarctic coralline, Tethysphytum antarcticum (Hapalidiales), from two distinct locations. We validated our measurements with pigment extractions and spectrophotometry analysis, in addition to DNA barcoding using the psbA marker. Targeted spectral indices were developed and correlated with phycobilin content using linear mixed models (R2 = 0.64-0.7). Once applied to the HSI, the models revealed the distinct phycoerythrin spatial distribution in the two site-specific CCA phenotypes, with thin and thick crusts, respectively. This study advances the capabilities of hyperspectral imaging as a tool to quantitatively study CCA pigmentation in relation to their phenotypic plasticity, which can be applied in laboratory studies and potentially in situ surveys using underwater hyperspectral imaging systems.

Research progress of inland river water quality monitoring technology based on unmanned aerial vehicle hyperspectral imaging technology.

In recent years, increasing demand for inland river water quality precision management has heightened the necessity for real-time, rapid, and continuous monitoring of water conditions. By analyzing the optical properties of water bodies remotely, unmanned aerial vehicle (UAV) hyperspectral imaging technology can assess water quality without direct contact, presenting a novel method for monitoring river conditions. However, there are currently some challenges to this technology that limit the promotion application of this technology, such as underdeveloped sensor calibration, atmospheric correction algorithms, and limitations in modeling non-water color parameters. This article evaluates the advantages and disadvantages of traditional sensor calibration methods and considers factors like sensor aging and adverse weather conditions that impact calibration accuracy. It suggests that future improvements should target hardware enhancements, refining models, and mitigating external interferences to ensure precise spectral data acquisition. Furthermore, the article summarizes the limitations of various traditional atmospheric correction methods, such as complex computational requirements and the need for multiple atmospheric parameters. It discusses the evolving trends in this technology and proposes streamlining atmospheric correction processes by simplifying input parameters and establishing adaptable correction algorithms. Simplifying these processes could significantly enhance the accuracy and feasibility of atmospheric correction. To address issues with the transferability of water quality inversion models regarding non-water color parameters and varying hydrological conditions, the article recommends exploring the physical relationships between spectral irradiance, solar zenith angle, and interactions with water constituents. By understanding these relationships, more accurate and transferable inversion models can be developed, improving the overall effectiveness of water quality assessment. By leveraging the sensitivity and versatility of hyperspectral sensors and integrating interdisciplinary approaches, a comprehensive database for water quality assessment can be established. This database enables rapid, real-time monitoring of non-water color parameters which offers valuable insights for the precision management of inland river water quality.

Surgical optomics: hyperspectral imaging and deep learning towards precision intraoperative automatic tissue recognition-results from the EX-MACHYNA trial.

BACKGROUND: Hyperspectral imaging (HSI), combined with machine learning, can help to identify characteristic tissue signatures enabling automatic tissue recognition during surgery. This study aims to develop the first HSI-based automatic abdominal tissue recognition with human data in a prospective bi-center setting. METHODS: Data were collected from patients undergoing elective open abdominal surgery at two international tertiary referral hospitals from September 2020 to June 2021. HS images were captured at various time points throughout the surgical procedure. Resulting RGB images were annotated with 13 distinct organ labels. Convolutional Neural Networks (CNNs) were employed for the analysis, with both external and internal validation settings utilized. RESULTS: A total of 169 patients were included, 73 (43.2%) from Strasbourg and 96 (56.8%) from Verona. The internal validation within centers combined patients from both centers into a single cohort, randomly allocated to the training (127 patients, 75.1%, 585 images) and test sets (42 patients, 24.9%, 181 images). This validation setting showed the best performance. The highest true positive rate was achieved for the skin (100%) and the liver (97%). Misclassifications included tissues with a similar embryological origin (omentum and mesentery: 32%) or with overlaying boundaries (liver and hepatic ligament: 22%). The median DICE score for ten tissue classes exceeded 80%. CONCLUSION: To improve automatic surgical scene segmentation and to drive clinical translation, multicenter accurate HSI datasets are essential, but further work is needed to quantify the clinical value of HSI. HSI might be included in a new omics science, namely surgical optomics, which uses light to extract quantifiable tissue features during surgery.

Investigation of the usefulness of a bile duct biopsy and bile cytology using a hyperspectral camera and machine learning.

To improve the efficiency of pathological diagnoses, the development of automatic pathological diagnostic systems using artificial intelligence (AI) is progressing; however, problems include the low interpretability of AI technology and the need for large amounts of data. We herein report the usefulness of a general-purpose method that combines a hyperspectral camera with machine learning. As a result of analyzing bile duct biopsy and bile cytology specimens, which are especially difficult to determine as benign or malignant, using multiple machine learning models, both were able to identify benign or malignant cells with an accuracy rate of more than 80% (93.3% for bile duct biopsy specimens and 83.2% for bile cytology specimens). This method has the potential to contribute to the diagnosis and treatment of bile duct cancer and is expected to be widely applied and utilized in general pathological diagnoses.

SUnSeT: spectral unmixing of hyperspectral images for phenotyping soybean seed traits.

KEY MESSAGE: Hyperspectral features enable accurate classification of soybean seeds using linear discriminant analysis and GWAS for novel seed trait genes. Evaluating crop seed traits such as size, shape, and color is crucial for assessing seed quality and improving agricultural productivity. The introduction of the SUnSet toolbox, which employs hyperspectral sensor-derived image analysis, addresses this necessity. In a validation test involving 420 seed accessions from the Korean Soybean Core Collections, the pixel purity index algorithm identified seed- specific hyperspectral endmembers to facilitate segmentation. Various metrics extracted from ventral and lateral side images facilitated the categorization of seeds into three size groups and four shape groups. Additionally, quantitative RGB triplets representing seven seed coat colors, averaged reflectance spectra, and pigment indices were acquired. Machine learning models, trained on a dataset comprising 420 accession seeds and 199 predictors encompassing seed size, shape, and reflectance spectra, achieved accuracy rates of 95.8% for linear discriminant analysis model. Furthermore, a genome-wide association study utilizing hyperspectral features uncovered associations between seed traits and genes governing seed pigmentation and shapes. This comprehensive approach underscores the effectiveness of SUnSet in advancing precision agriculture through meticulous seed trait analysis.

Monitoring of parasite Orobanche cumana using Vis-NIR hyperspectral imaging combining with physio-biochemical parameters on host crop Helianthus annuus.

KEY MESSAGE: This study provided a non-destructive detection method with Vis-NIR hyperspectral imaging combining with physio-biochemical parameters in Helianthus annuus in response to Orobanche cumana infection that took insights into the monitoring of sunflower weed. Sunflower broomrape (Orobanche cumana Wallr.) is an obligate weed that attaches to the host roots of sunflower (Helianthus annuus L.) leading to a significant reduction in yield worldwide. The emergence of O. cumana shoots after its underground life-cycle causes irreversible damage to the crop. In this study, a fast visual, non-invasive and precise method for monitoring changes in spectral characteristics using visible and near-infrared (Vis-NIR) hyperspectral imaging (HSI) was developed. By combining the bands sensitive to antioxidant enzymes (SOD, GR), non-antioxidant enzymes (GSH, GSH + GSSG), MDA, ROS (O2-, OH-), PAL, and PPO activities obtained from the host leaves, we sought to establish an accurate means of assessing these changes and conducted imaging acquisition using hyperspectral cameras from both infested and non-infested sunflower cultivars, followed by physio-biochemical parameters measurement as well as analyzed the expression of defense related genes. Extreme learning machine (ELM) and convolutional neural network (CNN) models using 3-band images were built to classify infected or non-infected plants in three sunflower cultivars, achieving accuracies of 95.83% and 95.83% for the discrimination of infestation as well as 97.92% and 95.83% of varieties, respectively, indicating the potential of multi-spectral imaging systems for early detection of O. cumana in weed management.

Rapid assessment of heavy metal accumulation capability of Sedum alfredii using hyperspectral imaging and deep learning.

Hyperaccumulators are the material basis and key to the phytoremediation of heavy metal contaminated soils. Conventional methods for screening hyperaccumulators are highly dependent on the time- and labor-consuming sampling and chemical analysis. In this study, a novel spectral approach assisted with multi-task deep learning was proposed to streamline accumulating ecotype screening, heavy metal stress discrimination, and heavy metals quantification in plants. The significant Cd/Zn co-hyperaccumulator Sedum alfredii and its non-accumulating ecotype were stressed by Cd, Zn, and Pb. Spectral images of leaves were rapidly acquired by hyperspectral imaging. The self-designed deep learning architecture was composed of a shallow network (ENet) for accumulating ecotype identification, and a multi-task network (HMNet) for heavy metal stress type and accumulation prediction simultaneously. To further assess the robustness of the networks, they were compared with conventional machine learning models (i.e., partial least squares (PLS) and support vector machine (SVM)) on a series of evaluation metrics of classification, multi-label classification, and regression. S. alfredii with heavy metals accumulation capability was identified by ENet with 100 % accuracy. HMNet reduced overfitting and outperformed machine learning models with the average exact match ratio (EMR) of heavy metal stress discrimination increased by 7.46 %, and residual prediction deviations (RPD) of heavy metal concentrations prediction increased by 53.59 %. The method succeeded in rapidly and accurately discriminating heavy metal stress with EMRs over 91 % and accuracies over 96 %, and in predicting heavy metals accumulation with an average RPD of 3.29 for Zn, 2.57 for Cd, and 2.53 for Pb, indicating the satisfactory practicability and potential for sensing heavy metals accumulation. This study provides a relatively novel spectral method to facilitate hyperaccumulator screening and heavy metals accumulation prediction in the phytoremediation process.

An intelligent process analysis method for rapidly evaluating the quality of Chinese medicine with near-infrared non-contact hyperspectral imaging: A case study of Weifuchun concentrate.

INTRODUCTION: The quality of Chinese medicine preparations can be greatly influenced by the quality of the intermediates such as extracts or concentrates. However, it is highly challenging to evaluate the quality in a rapid and non-contact manner during manufacturing. Here, we introduce an intelligent hyperspectral analysis method integrating a self-built abnormal region removal algorithm with machine learning and demonstrate its utility using the concentrate of Weifuchun (WFC), a traditional Chinese medicine preparation made from Ginseng Radix et Rhizoma Rubra, Rabdosia Amethystoides, and Aurantii Fructus. OBJECTIVE: To rapidly and non-destructively detect quality attributes of the intermediates in the manufacturing processes of Chinese medicine, an intelligent hyperspectral analysis method was developed for simultaneously quantifying the contents of naringin, neohesperidin, rosmarinic acid, and relative density of WFC concentrates. METHODOLOGY: Samples were evenly spread on solid white flat bottom containers, which were batch placed on a horizontal sample stage. Subsequent to the acquisition of near-infrared (NIR) hyperspectral images, abnormal pixels such as large/small bubbles and fine solids were first removed according to the differential pixel values in the binary grayscale map and the Mahalanobis distance metric. Then, partial least squares (PLS) and support vector machine (SVM) algorithms were used to construct hyperspectral quantitative calibration models for quality attributes. The hyperspectral images were reconstructed based on these models to visually evaluate the quality of the concentrates during manufacturing. RESULTS: As a case study, quality attributes of the WFC concentrates including contents of naringin, neohesperidin, rosmarinic acid, and relative density were determined simultaneously, and coefficients of determination of these quantitative correction models were 0.900, 0.891, 0.851, and 0.920, respectively. CONCLUSION: The method proposed in this study favors real-time determination of multiple attributes in viscous samples with industrial application prospects.

Pixel-Level Recognition of Trace Mycotoxins in Red Ginseng Based on Hyperspectral Imaging Combined with 1DCNN-Residual-BiLSTM-Attention Model.

Red ginseng is widely used in food and pharmaceuticals due to its significant nutritional value. However, during the processing and storage of red ginseng, it is susceptible to grow mold and produce mycotoxins, generating security issues. This study proposes a novel approach using hyperspectral imaging technology and a 1D-convolutional neural network-residual-bidirectional-long short-term memory attention mechanism (1DCNN-ResBiLSTM-Attention) for pixel-level mycotoxin recognition in red ginseng. The "Red Ginseng-Mycotoxin" (R-M) dataset is established, and optimal parameters for 1D-CNN, residual bidirectional long short-term memory (ResBiLSTM), and 1DCNN-ResBiLSTM-Attention models are determined. The models achieved testing accuracies of 98.75%, 99.03%, and 99.17%, respectively. To simulate real detection scenarios with potential interfering impurities during the sampling process, a "Red Ginseng-Mycotoxin-Interfering Impurities" (R-M-I) dataset was created. The testing accuracy of the 1DCNN-ResBiLSTM-Attention model reached 96.39%, and it successfully predicted pixel-wise classification for other unknown samples. This study introduces a novel method for real-time mycotoxin monitoring in traditional Chinese medicine, with important implications for the on-site quality control of herbal materials.

Presenting a Multispectral Image Sensor for Quantification of Total Polyphenols in Low-Temperature Stressed Tomato Seedlings Using Hyperspectral Imaging.

Hyperspectral imaging was used to predict the total polyphenol content in low-temperature stressed tomato seedlings for the development of a multispectral image sensor. The spectral data with a full width at half maximum (FWHM) of 5 nm were merged to obtain FWHMs of 10 nm, 25 nm, and 50 nm using a commercialized bandpass filter. Using the permutation importance method and regression coefficients, we developed the least absolute shrinkage and selection operator (Lasso) regression models by setting the band number to ≥11, ≤10, and ≤5 for each FWHM. The regression model using 56 bands with an FWHM of 5 nm resulted in an R2 of 0.71, an RMSE of 3.99 mg/g, and an RE of 9.04%, whereas the model developed using the spectral data of only 5 bands with a FWHM of 25 nm (at 519.5 nm, 620.1 nm, 660.3 nm, 719.8 nm, and 980.3 nm) provided an R2 of 0.62, an RMSE of 4.54 mg/g, and an RE of 10.3%. These results show that a multispectral image sensor can be developed to predict the total polyphenol content of tomato seedlings subjected to low-temperature stress, paving the way for energy saving and low-temperature stress damage prevention in vegetable seedling production.

Estimation Model for Maize Multi-Components Based on Hyperspectral Data.

Assessing the quality of corn seeds necessitates evaluating their water, fat, protein, and starch content. This study integrates hyperspectral imaging technology with chemometric analysis techniques to achieve non-invasive and rapid detection of multiple key components in corn seeds. Hyperspectral images of the embryo surface of maize seeds were collected within the wavelength range of 1100~2498 nm. Subsequently, image segmentation techniques were applied to extract the germ structure of the corn seeds as the region of interest. Seven spectral data preprocessing algorithms were employed, and the Detrending Transformation (DT) algorithm was identified as the optimal preprocessing method through comparative analysis using the Partial Least Squares Regression (PLSR) model. To reduce spectral redundancy and streamline the prediction model, three algorithms were employed for characteristic wavelength extraction: Successive Projections Algorithm (SPA), Competitive Adaptive Reweighted Sampling (CARS), and Uninformative Variable Elimination (UVE). Using the original spectra and extracted characteristic wavelengths, PLSR, BP, RBF, and LSSVM models were constructed to detect the content of four components. The analysis indicated that the CARS-LSSVM algorithm had the best prediction performance. The PSO algorithm was employed to further optimize the parameters of the LSSVM model, thereby improving the model's prediction performance. The R values for the four components in the test set were 0.9884, 0.9490, 0.9864, and 0.9687, respectively. This indicates that hyperspectral technology combined with the DT-CARS-PSO-LSSVM algorithm can effectively detect the main component content of corn seeds. This study not only provides a scientific basis for the evaluation of corn seed quality but also opens up new avenues for the development of non-destructive testing technology in related fields.

Varroa Mite Counting Based on Hyperspectral Imaging.

Varroa mite infestation poses a severe threat to honeybee colonies globally. This study investigates the feasibility of utilizing the HS-Cam and machine learning techniques for Varroa mite counting. The methodology involves image acquisition, dimensionality reduction through Principal Component Analysis (PCA), and machine learning-based segmentation and classification algorithms. Specifically, a k-Nearest Neighbors (kNNs) model distinguishes Varroa mites from other objects in the images, while a Support Vector Machine (SVM) classifier enhances shape detection. The final phase integrates a dedicated counting algorithm, leveraging outputs from the SVM classifier to quantify Varroa mite populations in hyperspectral images. The preliminary results demonstrate segmentation accuracy exceeding 99% and an average precision of 0.9983 and recall of 0.9947 across all the classes. The results obtained from our machine learning-based approach for Varroa mite counting were compared against ground-truth labels obtained through manual counting, demonstrating a high degree of agreement between the automated counting and manual ground truth. Despite working with a limited dataset, the HS-Cam showcases its potential for Varroa counting, delivering superior performance compared to traditional RGB images. Future research directions include validating the proposed hyperspectral imaging methodology with a more extensive and diverse dataset. Additionally, the effectiveness of using a near-infrared (NIR) excitation source for Varroa detection will be explored, along with assessing smartphone integration feasibility.

Classification of Benign-Malignant Thyroid Nodules Based on Hyperspectral Technology.

In recent years, the incidence of thyroid cancer has rapidly increased. To address the issue of the inefficient diagnosis of thyroid cancer during surgery, we propose a rapid method for the diagnosis of benign and malignant thyroid nodules based on hyperspectral technology. Firstly, using our self-developed thyroid nodule hyperspectral acquisition system, data for a large number of diverse thyroid nodule samples were obtained, providing a foundation for subsequent diagnosis. Secondly, to better meet clinical practical needs, we address the current situation of medical hyperspectral image classification research being mainly focused on pixel-based region segmentation, by proposing a method for nodule classification as benign or malignant based on thyroid nodule hyperspectral data blocks. Using 3D CNN and VGG16 networks as a basis, we designed a neural network algorithm (V3Dnet) for classification based on three-dimensional hyperspectral data blocks. In the case of a dataset with a block size of 50 × 50 × 196, the classification accuracy for benign and malignant samples reaches 84.63%. We also investigated the impact of data block size on the classification performance and constructed a classification model that includes thyroid nodule sample acquisition, hyperspectral data preprocessing, and an algorithm for thyroid nodule classification as benign and malignant based on hyperspectral data blocks. The proposed model for thyroid nodule classification is expected to be applied in thyroid surgery, thereby improving surgical accuracy and providing strong support for scientific research in related fields.

A Microscope Setup and Methodology for Capturing Hyperspectral and RGB Histopathological Imaging Databases.

The digitization of pathology departments in hospitals around the world is now a reality. The current commercial solutions applied to digitize histopathological samples consist of a robotic microscope with an RGB-type camera attached to it. This technology is very limited in terms of information captured, as it only works with three spectral bands of the visible electromagnetic spectrum. Therefore, we present an automated system that combines RGB and hyperspectral technology. Throughout this work, the hardware of the system and its components are described along with the developed software and a working methodology to ensure the correct capture of histopathological samples. The software is integrated by the controller of the microscope, which features an autofocus functionality, whole slide scanning with a stitching algorithm, and hyperspectral scanning functionality. As a reference, the time to capture and process a complete sample with 20 regions of high biological interest using the proposed method is estimated at a maximum of 79 min, reducing the time required by a manual operator by at least three times. Both hardware and software can be easily adapted to other systems that might benefit from the advantages of hyperspectral technology.

Study on an Automatic Classification Method for Determining the Malignancy Grade of Glioma Pathological Sections Based on Hyperspectral Multi-Scale Spatial-Spectral Fusion Features.

This study describes a novel method for grading pathological sections of gliomas. Our own integrated hyperspectral imaging system was employed to characterize 270 bands of cancerous tissue samples from microarray slides of gliomas. These samples were then classified according to the guidelines developed by the World Health Organization, which define the subtypes and grades of diffuse gliomas. We explored a hyperspectral feature extraction model called SMLMER-ResNet using microscopic hyperspectral images of brain gliomas of different malignancy grades. The model combines the channel attention mechanism and multi-scale image features to automatically learn the pathological organization of gliomas and obtain hierarchical feature representations, effectively removing the interference of redundant information. It also completes multi-modal, multi-scale spatial-spectral feature extraction to improve the automatic classification of glioma subtypes. The proposed classification method demonstrated high average classification accuracy (>97.3%) and a Kappa coefficient (0.954), indicating its effectiveness in improving the automatic classification of hyperspectral gliomas. The method is readily applicable in a wide range of clinical settings, offering valuable assistance in alleviating the workload of clinical pathologists. Furthermore, the study contributes to the development of more personalized and refined treatment plans, as well as subsequent follow-up and treatment adjustment, by providing physicians with insights into the underlying pathological organization of gliomas.

Hyperspectral Imaging Combined with Deep Transfer Learning to Evaluate Flavonoids Content in Ginkgo biloba Leaves.

Ginkgo biloba is a famous economic tree. Ginkgo leaves have been utilized as raw materials for medicines and health products due to their rich active ingredient composition, especially flavonoids. Since the routine measurement of total flavones is time-consuming and destructive, rapid, non-destructive detection of total flavones in ginkgo leaves is of significant importance to producers and consumers. Hyperspectral imaging technology is a rapid and non-destructive technique for determining the total flavonoid content. In this study, we discuss five modeling methods, and three spectral preprocessing methods are discussed. Bayesian Ridge (BR) and multiplicative scatter correction (MCS) were selected as the best model and the best pretreatment method, respectively. The spectral prediction results based on the BR + MCS treatment were very accurate (RTest2 = 0.87; RMSETest = 1.03 mg/g), showing a high correlation with the analytical measurements. In addition, we also found that the more and deeper the leaf cracks, the higher the flavonoid content, which helps to evaluate leaf quality more quickly and easily. In short, hyperspectral imaging is an effective technique for rapid and accurate determination of total flavonoids in ginkgo leaves and has great potential for developing an online quality detection system for ginkgo leaves.