Computational aberration correction of VIS-NIR multispectral imaging microscopy based on Fourier ptychography.

Due to the chromatic dispersion properties inherent in all optical materials, even the best-designed multispectral objective will exhibit residual chromatic aberration. Here, we demonstrate a multispectral microscope with a computational scheme based on the Fourier ptychographic microscopy (FPM) to correct these effects in order to render undistorted, in-focus images. The microscope consists of 4 spectral channels ranging from 405 nm to 1552 nm. After the computational aberration correction, it can achieve isotropic resolution enhancement as verified with the Siemens star sample. We image a flip-chip to show the promise of our system to conduct fault detection on silicon chips. This computational approach provides a cost-efficient strategy for high quality multispectral imaging over a broad spectral range.

Quantitative phase imaging and complex field reconstruction by pupil modulation differential phase contrast.

Differential phase contrast (DPC) is a non-interferometric quantitative phase imaging method achieved by using an asymmetric imaging procedure. We report a pupil modulation differential phase contrast (PMDPC) imaging method by filtering a sample's Fourier domain with half-circle pupils. A phase gradient image is captured with each half-circle pupil, and a quantitative high resolution phase image is obtained after a deconvolution process with a minimum of two phase gradient images. Here, we introduce PMDPC quantitative phase image reconstruction algorithm and realize it experimentally in a 4f system with an SLM placed at the pupil plane. In our current experimental setup with the numerical aperture of 0.36, we obtain a quantitative phase image with a resolution of 1.73µm after computationally removing system aberrations and refocusing. We also extend the depth of field digitally by 20 times to ±50µm with a resolution of 1.76µm.

Overlapped Fourier coding for optical aberration removal.

We present an imaging procedure that simultaneously optimizes a camera's resolution and retrieves a sample's phase over a sequence of snapshots. The technique, termed overlapped Fourier coding (OFC), first digitally pans a small aperture across a camera's pupil plane with a spatial light modulator. At each aperture location, a unique image is acquired. The OFC algorithm then fuses these low-resolution images into a full-resolution estimate of the complex optical field incident upon the detector. Simultaneously, the algorithm utilizes redundancies within the acquired dataset to computationally estimate and remove unknown optical aberrations and system misalignments via simulated annealing. The result is an imaging system that can computationally overcome its optical imperfections to offer enhanced resolution, at the expense of taking multiple snapshots over time.

Computational aberration compensation by coded-aperture-based correction of aberration obtained from optical Fourier coding and blur estimation.

We report a novel generalized optical measurement system and computational approach to determine and correct aberrations in optical systems. The system consists of a computational imaging method capable of reconstructing an optical system's pupil function by adapting overlapped Fourier coding to an incoherent imaging modality. It recovers the high-resolution image latent in an aberrated image via deconvolution. The deconvolution is made robust to noise by using coded apertures to capture images. We term this method coded-aperture-based correction of aberration obtained from overlapped Fourier coding and blur estimation (CACAO-FB). It is well-suited for various imaging scenarios where aberration is present and where providing a spatially coherent illumination is very challenging or impossible. We report the demonstration of CACAO-FB with a variety of samples including an in vivo imaging experiment on the eye of a rhesus macaque to correct for its inherent aberration in the rendered retinal images. CACAO-FB ultimately allows for an aberrated imaging system to achieve diffraction-limited performance over a wide field of view by casting optical design complexity to computational algorithms in post-processing.

Fourier Ptychographic Microscopy for Rapid, High-Resolution Imaging of Circulating Tumor Cells Enriched by Microfiltration.

Examining the hematogenous compartment for evidence of metastasis has increased significantly within the oncology research community in recent years, due to the development of technologies aimed at the enrichment of circulating tumor cells (CTCs), the subpopulation of primary tumor cells that gain access to the circulatory system and are responsible for colonization at distant sites. In contrast to other technologies, filtration-based CTC enrichment, which exploits differences in size between larger tumor cells and surrounding smaller, non-tumor blood cells, has the potential to improve CTC characterization through isolation of tumor cell populations with greater molecular heterogeneity. However, microscopic analysis of uneven filtration surfaces containing CTCs is laborious, time-consuming, and inconsistent, preventing widespread use of filtration-based enrichment technologies. Here, integrated with a microfiltration-based CTC and rare cell enrichment device we have previously described, we present a protocol for Fourier Ptychographic Microscopy (FPM), a method that, unlike many automated imaging platforms, produces high-speed, high-resolution images that can be digitally refocused, allowing users to observe objects of interest present on multiple focal planes within the same image frame. The development of a cost-effective and high-throughput CTC analysis system for filtration-based enrichment technologies could have profound clinical implications for improved CTC detection and analysis.

Aperture scanning Fourier ptychographic microscopy.

Fourier ptychographic microscopy (FPM) is implemented through aperture scanning by an LCOS spatial light modulator at the back focal plane of the objective lens. This FPM configuration enables the capturing of the complex scattered field for a 3D sample both in the transmissive mode and the reflective mode. We further show that by combining with the compressive sensing theory, the reconstructed 2D complex scattered field can be used to recover the 3D sample scattering density. This implementation expands the scope of application for FPM and can be beneficial for areas such as tissue imaging and wafer inspection.

Wide-field Fourier ptychographic microscopy using laser illumination source.

Fourier ptychographic (FP) microscopy is a coherent imaging method that can synthesize an image with a higher bandwidth using multiple low-bandwidth images captured at different spatial frequency regions. The method's demand for multiple images drives the need for a brighter illumination scheme and a high-frame-rate camera for a faster acquisition. We report the use of a guided laser beam as an illumination source for an FP microscope. It uses a mirror array and a 2-dimensional scanning Galvo mirror system to provide a sample with plane-wave illuminations at diverse incidence angles. The use of a laser presents speckles in the image capturing process due to reflections between glass surfaces in the system. They appear as slowly varying background fluctuations in the final reconstructed image. We are able to mitigate these artifacts by including a phase image obtained by differential phase contrast (DPC) deconvolution in the FP algorithm. We use a 1-Watt laser configured to provide a collimated beam with 150 mW of power and beam diameter of 1 cm to allow for the total capturing time of 0.96 seconds for 96 raw FPM input images in our system, with the camera sensor's frame rate being the bottleneck for speed. We demonstrate a factor of 4 resolution improvement using a 0.1 NA objective lens over the full camera field-of-view of 2.7 mm by 1.5 mm.

Diffraction tomography with Fourier ptychography.

This paper presents a technique to image the complex index of refraction of a sample across three dimensions. The only required hardware is a standard microscope and an array of LEDs. The method, termed Fourier ptychographic tomography (FPT), first captures a sequence of intensity-only images of a sample under angularly varying illumination. Then, using principles from ptychography and diffraction tomography, it computationally solves for the sample structure in three dimensions. The experimental microscope demonstrates a lateral spatial resolution of 0.39 µm and an axial resolution of 3.7 µm at the Nyquist-Shannon sampling limit (0.54 and 5.0 µm at the Sparrow limit, respectively) across a total imaging depth of 110 µm. Unlike competing methods, this technique quantitatively measures the volumetric refractive index of primarily transparent and contiguous sample features without the need for interferometry or any moving parts. Wide field-of-view reconstructions of thick biological specimens suggest potential applications in pathology and developmental biology.

Wide field-of-view fluorescence image deconvolution with aberration-estimation from Fourier ptychography.

This paper presents a method to simultaneously acquire an aberration-corrected, wide field-of-view fluorescence image and a high-resolution coherent bright-field image using a computational microscopy method. First, the procedure applies Fourier ptychographic microscopy (FPM) to retrieve the amplitude and phase of a sample, at a resolution that significantly exceeds the cutoff spatial frequency of the microscope objective lens. At the same time, redundancy within the set of acquired FPM bright-field images offers a means to estimate microscope aberrations. Second, the procedure acquires an aberrated fluorescence image, and computationally improves its resolution through deconvolution with the estimated aberration map. An experimental demonstration successfully improves the bright-field resolution of fixed, stained and fluorescently tagged HeLa cells by a factor of 4.9, and reduces the error caused by aberrations in a fluorescence image by up to 31%, over a field of view of 6.2 mm by 9.3 mm. For optimal deconvolution, we show the fluorescence image needs to have a signal-to-noise ratio of at least ~18.

Fourier ptychographic reconstruction using Poisson maximum likelihood and truncated Wirtinger gradient.

Fourier ptychographic microscopy (FPM) is a novel computational coherent imaging technique for high space-bandwidth product imaging. Mathematically, Fourier ptychographic (FP) reconstruction can be implemented as a phase retrieval optimization process, in which we only obtain low resolution intensity images corresponding to the sub-bands of the sample's high resolution (HR) spatial spectrum, and aim to retrieve the complex HR spectrum. In real setups, the measurements always suffer from various degenerations such as Gaussian noise, Poisson noise, speckle noise and pupil location error, which would largely degrade the reconstruction. To efficiently address these degenerations, we propose a novel FP reconstruction method under a gradient descent optimization framework in this paper. The technique utilizes Poisson maximum likelihood for better signal modeling, and truncated Wirtinger gradient for effective error removal. Results on both simulated data and real data captured using our laser-illuminated FPM setup show that the proposed method outperforms other state-of-the-art algorithms. Also, we have released our source code for non-commercial use.

Counting White Blood Cells from a Blood Smear Using Fourier Ptychographic Microscopy.

White blood cell (WBC) count is a valuable metric for assisting with diagnosis or prognosis of various diseases such as coronary heart disease, type 2 diabetes, or infection. Counting WBCs can be done either manually or automatically. Automatic methods are capable of counting a large number of cells to give a statistically more accurate reading of the WBC count of a sample, but the specialized equipment tends to be expensive. Manual methods are inexpensive since they only involve a conventional light microscope setup. However, it is more laborious and error-prone because the small field-of-view (FOV) of the microscope necessitates mechanical scanning of a specimen for counting an adequate number of WBCs. Here, we investigate the use of Fourier ptychographic microscopy (FPM) to bypass these issues of the manual methods. With a 2x objective, FPM can provide a FOV of 120 mm2 with enhanced resolution comparable to that of a 20x objective, which is adequate for non-differentially counting WBCs in just one FOV. A specialist was able to count the WBCs in FPM images with 100% accuracy compared to the count as determined from conventional microscope images. An automatic counting algorithm was also developed to identify WBCs from FPM's captured images with 95% accuracy, paving the way for a cost-effective WBC counting setup with the advantages of both the automatic and manual counting methods.

Fourier ptychographic microscopy for filtration-based circulating tumor cell enumeration and analysis.

Circulating tumor cells (CTCs) are recognized as a candidate biomarker with strong prognostic and predictive potential in metastatic disease. Filtration-based enrichment technologies have been used for CTC characterization, and our group has previously developed a membrane microfilter device that demonstrates efficacy in model systems and clinical blood samples. However, uneven filtration surfaces make the use of standard microscopic techniques a difficult task, limiting the performance of automated imaging using commercially available technologies. Here, we report the use of Fourier ptychographic microscopy (FPM) to tackle this challenge. Employing this method, we were able to obtain high-resolution color images, including amplitude and phase, of the microfilter samples over large areas. FPM's ability to perform digital refocusing on complex images is particularly useful in this setting as, in contrast to other imaging platforms, we can focus samples on multiple focal planes within the same frame despite surface unevenness. In model systems, FPM demonstrates high image quality, efficiency, and consistency in detection of tumor cells when comparing corresponding microfilter samples to standard microscopy with high correlation (R² = 0.99932). Based on these results, we believe that FPM will have important implications for improved, high throughput, filtration-based CTC analysis, and, more generally, image analysis of uneven surfaces.

Method for non-optical quantification of in situ local soft tissue biomechanics.

Soft tissues exhibit significant biomechanical changes as they grow, adapt, and remodel under a variety of normal and pathogenic stimuli. Biomechanical measurement of intact soft tissues is challenging because of its large strain and nonlinear behavior. Tissue distention through applied vacuum pressure is an attractive method for acquiring local biomechanical information minimally invasive and non-destructive, but the current requirement for optical strain measurement limits its use. In this study, we implemented a novel flexible micro-electrode array placed within a cylindrical probe tip. We hypothesized that upon tissue distention, contact with each electrode would result in a precipitous voltage drop (from the resistive connection formed between input and output electrodes) across the array. Hence, tissue distention (strain) can be derived directly from the electrode array geometry. In pilot studies, we compared the electrode array measurements directly against optical deformation measurements in-situ of agar tissue phantoms and freshly isolated porcine tissue. Our results demonstrate that the probe derived stress-strain profiles and modulus measurements were statistically indistinguishable from optical measurement. We further show that electrode geometry can be scaled down to 50µm in size (length and width) and spaced 50µm apart without impairing measurement accuracy. These results establish a promising new method for minimally invasive local soft tissue biomechanical measurement, which may be useful for applications such as disease diagnosis and health monitoring.