Targeted multispectral filter array design for the optimization of endoscopic cancer detection in the gastrointestinal tract.

Significance: Color differences between healthy and diseased tissue in the gastrointestinal (GI) tract are detected visually by clinicians during white light endoscopy; however, the earliest signs of cancer are often just a slightly different shade of pink compared to healthy tissue making it hard to detect. Improving contrast in endoscopy is important for early detection of disease in the GI tract during routine screening and surveillance. Aim: We aim to target alternative colors for imaging to improve contrast using custom multispectral filter arrays (MSFAs) that could be deployed in an endoscopic "chip-on-tip" configuration. Approach: Using an open-source toolbox, Opti-MSFA, we examined the optimal design of MSFAs for early cancer detection in the GI tract. The toolbox was first extended to use additional classification models (k-nearest neighbor, support vector machine, and spectral angle mapper). Using input spectral data from published clinical trials examining the esophagus and colon, we optimized the design of MSFAs with three to nine different bands. Results: We examined the variation of the spectral and spatial classification accuracies as a function of the number of bands. The MSFA configurations tested showed good classification accuracies when compared to the full hyperspectral data available from the clinical spectra used in these studies. Conclusion: The ability to retain good classification accuracies with a reduced number of spectral bands could enable the future deployment of multispectral imaging in an endoscopic chip-on-tip configuration using simplified MSFA hardware. Further studies using an expanded clinical dataset are needed to confirm these findings.

Multispectral imaging of nailfold capillaries using light-emitting diode illumination.

Significance: The capillaries are the smallest blood vessels in the body, typically imaged using video capillaroscopy to aid diagnosis of connective tissue diseases, such as systemic sclerosis. Video capillaroscopy allows visualization of morphological changes in the nailfold capillaries but does not provide any physiological information about the blood contained within the capillary network. Extracting parameters such as hemoglobin oxygenation could increase sensitivity for diagnosis and measurement of microvascular disease progression. Aim: To design, construct, and test a low-cost multispectral imaging (MSI) system using light-emitting diode (LED) illumination to assess relative hemoglobin oxygenation in the nailfold capillaries. Approach: An LED ring light was first designed and modeled. The ring light was fabricated using four commercially available LED colors and a custom-designed printed circuit board. The experimental system was characterized and results compared with the illumination model. A blood phantom with variable oxygenation was used to determine the feasibility of using the illumination-based MSI system for oximetry. Nailfold capillaries were then imaged in a healthy subject. Results: The illumination modeling results were in close agreement with the constructed system. Imaging of the blood phantom demonstrated sensitivity to changing hemoglobin oxygenation, which was in line with the spectral modeling of reflection. The morphological properties of the volunteer capillaries were comparable to those measured in current gold standard systems. Conclusions: LED-based illumination could be used as a low-cost approach to enable MSI of the nailfold capillaries to provide insight into the oxygenation of the blood contained within the capillary network.

Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis.

SIGNIFICANCE: Measurement and imaging of hemoglobin oxygenation are used extensively in the detection and diagnosis of disease; however, the applied instruments vary widely in their depth of imaging, spatiotemporal resolution, sensitivity, accuracy, complexity, physical size, and cost. The wide variation in available instrumentation can make it challenging for end users to select the appropriate tools for their application and to understand the relative limitations of different methods. AIM: We aim to provide a systematic overview of the field of hemoglobin imaging and sensing. APPROACH: We reviewed the sensing and imaging methods used to analyze hemoglobin oxygenation, including pulse oximetry, spectral reflectance imaging, diffuse optical imaging, spectroscopic optical coherence tomography, photoacoustic imaging, and diffuse correlation spectroscopy. RESULTS: We compared and contrasted the ability of different methods to determine hemoglobin biomarkers such as oxygenation while considering factors that influence their practical application. CONCLUSIONS: We highlight key limitations in the current state-of-the-art and make suggestions for routes to advance the clinical use and interpretation of hemoglobin oxygenation information.

Opti-MSFA: a toolbox for generalized design and optimization of multispectral filter arrays.

Multispectral imaging captures spatial information across a set of discrete spectral channels and is widely utilized across diverse applications such as remote sensing, industrial inspection, and biomedical imaging. Multispectral filter arrays (MSFAs) are filter mosaics integrated atop image sensors that facilitate cost-effective, compact, snapshot multispectral imaging. MSFAs are pre-configured based on application-where filter channels are selected corresponding to targeted absorption spectra-making the design of optimal MSFAs vital for a given application. Despite the availability of many design and optimization approaches for spectral channel selection and spatial arrangement, major limitations remain. There are few robust approaches for joint spectral-spatial optimization, techniques are typically only applicable to limited datasets and most critically, are not available for general use and improvement by the wider community. Here, we reconcile current MSFA design techniques and present Opti-MSFA: a Python-based open-access toolbox for the centralized design and optimization of MSFAs. Opti-MSFA incorporates established spectral-spatial optimization algorithms, such as gradient descent and simulated annealing, multispectral-RGB image reconstruction, and is applicable to user-defined input of spatial-spectral datasets or imagery. We demonstrate the utility of the toolbox by comparing against other published MSFAs using the standard hyperspectral datasets Samson and Jasper Ridge, and further show application on experimentally acquired fluorescence imaging data. In conjunction with end-user input and collaboration, we foresee the continued development of Opti-MSFA for the benefit of the wider research community.