Multifaceted mirror array illuminator for fluorescence excitation-scanning spectral imaging microscopy.

Significance: Hyperspectral imaging (HSI) technologies offer great potential in fluorescence microscopy for multiplexed imaging, autofluorescence removal, and analysis of autofluorescent molecules. However, there are also associated trade-offs when implementing HSI in fluorescence microscopy systems, such as decreased acquisition speed, resolution, or field-of-view due to the need to acquire spectral information in addition to spatial information. The vast majority of HSI fluorescence microscopy systems provide spectral discrimination by filtering or dispersing the fluorescence emission, which may result in loss of emitted fluorescence signal due to optical filters, dispersive optics, or supporting optics, such as slits and collimators. Technologies that scan the fluorescence excitation spectrum may offer an approach to mitigate some of these trade-offs by decreasing the complexity of the emission light path. Aim: We describe the development of an optical technique for hyperspectral imaging fluorescence excitation-scanning (HIFEX) on a microscope system. Approach: The approach is based on the design of an array of wavelength-dependent light emitting diodes (LEDs) and a unique beam combining system that uses a multifurcated mirror. The system was modeled and optimized using optical ray trace simulations, and a prototype was built and coupled to an inverted microscope platform. The prototype system was calibrated, and initial feasibility testing was performed by imaging multilabel slide preparations. Results: We present results from optical ray trace simulations, prototyping, calibration, and feasibility testing of the system. Results indicate that the system can discriminate between at least six fluorescent labels and autofluorescence and that the approach can provide decreased wavelength switching times, in comparison with mechanically tuned filters. Conclusions: We anticipate that LED-based HIFEX microscopy may provide improved performance for time-dependent and photosensitive assays.

Endoscopy Lifetime Systems Architecture: Scoping Out the Past to Diagnose the Future Technology.

Systems engineering captures the desires and needs of the customer to conceptualize a system from the overall goal down to the small details prior to any physical development. While many systems projects tend to be large and complicated (i.e., cloud-based infrastructure, long-term space travel shuttles, missile defense systems), systems engineering can also be applied to smaller, complex systems. Here, the system of interest is the endoscope, a standard biomedical screening device used in laparoscopic surgery, screening of upper and lower gastrointestinal tracts, and inspection of the upper airway. Often, endoscopic inspection is used to identify pre-cancerous and cancerous tissues, and hence, a requirement for endoscopic systems is the ability to provide images with high contrast between areas of normal tissue and neoplasia (early-stage abnormal tissue growth). For this manuscript, the endoscope was reviewed for all the technological advancements thus far to theorize what the next version of the system could be in order to provide improved detection capabilities. Endoscopic technology was decomposed into categories, using systems architecture and systems thinking, to visualize the improvements throughout the system's lifetime from the original to current state-of-the-art. Results from this review were used to identify trends in subsystems and components to estimate the theoretical performance maxima for different subsystems as well as areas for further development. The subsystem analysis indicated that future endoscope systems will focus on more complex imaging and higher computational requirements that will provide improved contrast in order to have higher accuracy in optical diagnoses of early, abnormal tissue growth.

Microscopy is better in color: development of a streamlined spectral light path for real-time multiplex fluorescence microscopy.

Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca2+ and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

Validation of Excitation-Scan Hyperspectral Multi-faceted Mirror Array Prototype System Advancements to Hyperspectral Imaging Applications.

Hyperspectral imaging technologies (HSI) have undergone rapid development since their beginning stages. While original applications were in remote sensing, other uses include agriculture, food safety and medicine. HSI has shown great utility in fluorescence microscopy for detecting signatures from many fluorescent molecules; however, acquisitions speeds have been slow due to light losses associated with spectral filtering. Therefore, we designed a novel light emitting diode (LED)-based rapid excitation scanning hyperspectral imaging platform allowing users to obtain simultaneous measurements of fluorescent labels without compromising acquisition speeds. Previously, we reported our results of the optical ray trace simulations and the geometrical capability of designing a multifaceted mirror imaging system as an initial approach to combine light at many wavelengths. The design utilized LEDs and a multifaceted mirror array to combine light sources into a liquid light guide. The computational model was constructed using Monte Carlo optical ray software (TracePro, Lambda Research Corp.). Recent prototype validation results show that when compared to a commercial emission scanning spectral confocal microscope (Zeiss-LSM-980), the novel LED-based excitation scanning HSI prototype successfully detected and separated six fluorescent labels from a custom 6-label African green monkey kidney epithelial cells. We report on the prototype's ability to overcome limitations of acquisition speeds, sensitivity, and specificity present in conventional systems. Future work will evaluate prototype's light losses to determine latent design modifications needed to demonstrate the system's feasibility as a promising solution for overcoming HSI acquisition speeds. This work was supported by NSF award MRI1725937.

Excitation-scanning hyperspectral video endoscopy: enhancing the light at the end of the tunnel.

Colorectal cancer is the 3rd leading cancer for incidence and mortality rates. Positive treatment outcomes have been associated with early detection; however, early stage lesions have limited contrast to surrounding mucosa. A potential technology to enhance early stagise detection is hyperspectral imaging (HSI). While HSI technologies have been previously utilized to detect colorectal cancer ex vivo or post-operation, they have been difficult to employ in real-time endoscopy scenarios. Here, we describe an LED-based multifurcated light guide and spectral light source that can provide illumination for spectral imaging at frame rates necessary for video-rate endoscopy. We also present an updated light source optical ray-tracing model that resulted in further optimization and provided a ∼10X light transmission increase compared to the initial prototype. Future work will iterate simulation and benchtop testing of the hyperspectral endoscopic system to achieve the goal of video-rate spectral endoscopy.

Optical simulations for determining efficacy of new light source designs for excitation-scanning high-speed hyperspectral imaging systems.

Positive outcomes for colorectal cancer treatment have been linked to early detection. The difficulty in detecting early lesions is the limited contrast with surrounding mucosa and minimal definitive markers to distinguish between hyperplastic and carcinoma lesions. Colorectal cancer is the 3rd leading cancer for incidence and mortality rates which is potentially linked to missed early lesions which allow for increased growth and metastatic potential. One potential technology for early-stage lesion detection is hyperspectral imaging. Traditionally, hyperspectral imaging uses reflectance spectroscopic data to provide a component analysis, per pixel, of an image in fields such as remote sensing, agriculture, food processing and archaeology. This work aims to acquire higher signal-to-noise fluorescence spectroscopic data, harnessing the autofluorescence of tissue, adding a hyperspectral contrast to colorectal cancer detection while maintaining spatial resolution at video-rate speeds. We have previously designed a multi-furcated LED-based spectral light source to prove this concept. Our results demonstrated that the technique is feasible, but the initial prototype has a high light transmission loss (~98%) minimizing spatial resolution and slowing video acquisition. Here, we present updated results in developing an optical ray-tracing model of light source geometries to maximize irradiance throughput for excitation-scanning hyperspectral imaging. Results show combining solid light guide branches have a compounding light loss effect, however, there is potential to minimize light loss through the use of optical claddings. This simulation data will provide the necessary metrics to verify and validate future physical optical components within the hyperspectral endoscopic system for detecting colorectal cancer.

Excitation-scan Mirror Array System Advancements to Hyperspectral Imaging Applications.

Hyperspectral imaging (HSI) technology has been applied in a range of fields for target detection and mixture analysis. While its original applications were in remote sensing, modern uses include agriculture, historical document authentications and medicine. HSI has shown great utility in fluorescence microscopy; however, acquisition speeds have been slow due to light losses associated with spectral filtering. We are currently developing a rapid hyperspectral imaging platform for 5-dimensional imaging (RHIP-5D), a confocal imaging system that will allow users to obtain simultaneous measurements of many fluorescent labels. We have previously reported on optical modeling performance of the system. This previous model investigated geometrical capability of designing a multifaceted mirror imaging system as an initial approach to sample light at many wavelengths. The design utilized light-emitting diodes (LEDs) and a multifaceted mirror array to combine light sources into a liquid light guide (LLG). The computational model was constructed using Monte Carlo optical ray software (TracePro, Lambda Research Corp.). Recent results presented here show transmission has increased up to 9% through parametric optimization of each component. Future work will involve system validation using a prototype engineered based on our optimized model. System requirements will be evaluated to determine if potential design changes are needed to improve the system. We will report on spectral resolution to demonstrate feasibility of the RHIP-5D as a promising solution for overcoming current HSI acquisition speed and sensitivity limitations.

Optimization of Light Transmission through an Excitation-scan Hyperspectral Mirror Array System.

Hyperspectral imaging has numerous applications in a range of fields for target detection. While its original applications were in remote sensing, new uses include analyzing food quality, agriculture and medicine, Hyperspectral imaging has shown utility in fluorescence microscopy for detecting signatures from many fluorescent molecules, but acquisition speeds have been slow due to the need to acquire many spectral bands and the light losses associated with spectral filtering. Therefore, a novel confocal microscope, the 5-Dimensional Rapid Hyperspectral Imaging Platform (RHIP-5D) was designed and is undergoing testing to overcome acquisition speed and sensitivity limitations. The current design utilizes light-emitting diodes (LEDs) and a multifaceted mirror array to combine light sources into a liquid light guide. Initial tests demonstrated feasibility and we are now working on determining the ideal location of the liquid light guide, LEDs, lenses and mirror array to optimize optical transmission. A computational model was constructed using Monte Carlo optical ray tracing in TracePro software (Lambda Research Corp.). LED sources were simulated by importing irradiance properties from the manufacturers' specifications. Optical properties of lenses were modeled using lens files available from the manufacturer. Analysis of the model includes geometry and parametric optimization, assessing lens power, mirror angles and location of optical elements. Initial results show an increase of transmission is possible by up to 20%. Future work will involve evaluating the position of the liquid light guide as well as analyzing lens configurations to further increase optical transmission.

Sensitivity analysis of a multibranched light guide for real time hyperspectral imaging systems.

Hyperspectral imaging (HSI) is a spectroscopic technique which captures images at a high contrast over a wide range of wavelengths to show pixel specific composition. Traditional uses of HSI include: satellite imagery, food distribution quality control and digital archaeological reconstruction. Our lab has focused on developing applications of HSI fluorescence imaging systems to study molecule-specific detection for rapid cell signaling events or real-time endoscopic screening. Previously, we have developed a prototype spectral light source, using our modified imaging technique, excitation-scanning hyperspectral imaging (HIFEX), coupled to a commercial colonoscope for feasibility testing. The 16 wavelength LED array was combined, using a multi-branched solid light guide, to couple to the scope's optical input. The prototype acquired a spectral scan at near video-rate speeds (∼8 fps). The prototype could operate at very rapid wavelength switch speeds, limited to the on/off rates of the LEDs (∼10 µs), but imaging speed was limited due to optical transmission losses (∼98%) through the solid light guide. Here we present a continuation of our previous work in performing an in-depth analysis of the solid light guide to optimize the optical intensity throughput. The parameters evaluated include: LED intensity input, geometry (branch curvature and combination) and light propagation using outer claddings. Simulations were conducted using a Monte Carlo ray tracing software (TracePro). Results show that transmission within the branched light guide may be optimized through LED focusing lenses, bend radii and smooth tangential branch merges. Future work will test a new fabricated light guide from the optimized model framework.

Endoscopic hyperspectral imaging: light guide optimization for spectral light source.

Hyperspectral imaging (HSI) is a technology used in remote sensing, food processing and documentation recovery. Recently, this approach has been applied in the medical field to spectrally interrogate regions of interest within respective substrates. In spectral imaging, a two (spatial) dimensional image is collected, at many different (spectral) wavelengths, to sample spectral signatures from different regions and/or components within a sample. Here, we report on the use of hyperspectral imaging for endoscopic applications. Colorectal cancer is the 3rd leading cancer for incidences and deaths in the US. One factor of severity is the miss rate of precancerous/flat lesions (~65% accuracy). Integrating HSI into colonoscopy procedures could minimize misdiagnosis and unnecessary resections. We have previously reported a working prototype light source with 16 high-powered light emitting diodes (LEDs) capable of high speed cycling and imaging. In recent testing, we have found our current prototype is limited by transmission loss (~99%) through the multi-furcated solid light guide (lightpipe) and the desired framerate (20-30 fps) could not be achieved. Here, we report on a series of experimental and modeling studies to better optimize the lightpipe and the spectral endoscopy system as a whole. The lightpipe was experimentally evaluated using an integrating sphere and spectrometer (Ocean Optics). Modeling the lightpipe was performed using Monte Carlo optical ray tracing in TracePro (Lambda Research Corp.). Results of these optimization studies will aid in manufacturing a revised prototype with the newly designed light guide and increased sensitivity. Once the desired optical output (5-10 mW) is achieved then the HIS endoscope system will be able to be implemented without adding onto the procedure time.

Design of a modified endoscope illuminator for spectral imaging of colorectal tissues.

The gold standard for locating colonic polyps is a white light endoscope in a colonoscopy, however, polyps smaller than 5 mm can be easily missed. Modified procedures such as narrow band imaging have shown only marginal increases in detection rates. Spectral imaging is a potential solution to improve the sensitivity and specificity of colonoscopies by providing the ability to distinguish molecular fluorescence differences in tissues. The goal of this work is to implement a spectral endoscopic light source to acquire spectral image data of colorectal tissues. A beta-version endoscope light source was developed, by retrofitting a white light endoscope light source (Olympus, CLK-4) with 16 narrow band LEDs. This redesigned, beta-prototype uses high-power LEDs with a minimum output of 500 mW to provide sufficient spectral output (0.5 mW) through the endoscope. A mounting apparatus was designed to provide sufficient heat dissipation. Here, we report recent results of our tests to characterize the intensity output through the light source and endoscope to determine the flat spectral output for imaging and intensity losses through the endoscope. We also report preliminary spectral imaging data from transverse pig colon that demonstrates the ability to result in working practical spectral data. Preliminary results of this revised prototype spectral endoscope system demonstrate that there is sufficient power to allow the imaging process to continue and potentially determine spectral differences in cancerous and normal tissue from imaging ex vivo pairs. Future work will focus on building a spectral library for the colorectal region and refining the user interface the system for in vivo use.

LED-based endoscopic light source for spectral imaging.

Colorectal cancer is the United States 3rd leading cancer in death rates.1 The current screening for colorectal cancer is an endoscopic procedure using white light endoscopy (WLE). There are multiple new methods testing to replace WLE, for example narrow band imaging and autofluorescence imaging.2 However, these methods do not meet the need for a higher specificity or sensitivity. The goal for this project is to modify the presently used endoscope light source to house 16 narrow wavelength LEDs for spectral imaging in real time while increasing sensitivity and specificity. The process to do such was to take an Olympus CLK-4 light source, replace the light and electronics with 16 LEDs and new circuitry. This allows control of the power and intensity of the LEDs. This required a larger enclosure to house a bracket system for the solid light guide (lightpipe), three new circuit boards, a power source and National Instruments hardware/software for computer control. The results were a successfully designed retrofit with all the new features. The LED testing resulted in the ability to control each wavelength's intensity. The measured intensity over the voltage range will provide the information needed to couple the camera for imaging. Overall the project was successful; the modifications to the light source added the controllable LEDs. This brings the research one step closer to the main goal of spectral imaging for early detection of colorectal cancer. Future goals will be to connect the camera and test the imaging process.