Light-field tomographic fluorescence lifetime imaging microscopy.

Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging technique that enables the visualization of biological samples at the molecular level by measuring the fluorescence decay rate of fluorescent probes. This provides critical information about molecular interactions, environmental changes, and localization within biological systems. However, creating high-resolution lifetime maps using conventional FLIM systems can be challenging, as it often requires extensive scanning that can significantly lengthen acquisition times. This issue is further compounded in three-dimensional (3D) imaging because it demands additional scanning along the depth axis. To tackle this challenge, we developed a computational imaging technique called light-field tomographic FLIM (LIFT-FLIM). Our approach allows for the acquisition of volumetric fluorescence lifetime images in a highly data-efficient manner, significantly reducing the number of scanning steps required compared to conventional point-scanning or line-scanning FLIM imagers. Moreover, LIFT-FLIM enables the measurement of high-dimensional data using low-dimensional detectors, which are typically low cost and feature a higher temporal bandwidth. We demonstrated LIFT-FLIM using a linear single-photon avalanche diode array on various biological systems, showcasing unparalleled single-photon detection sensitivity. Additionally, we expanded the functionality of our method to spectral FLIM and demonstrated its application in high-content multiplexed imaging of lung organoids. LIFT-FLIM has the potential to open up broad avenues in both basic and translational biomedical research.

LinoSPAD2: an FPGA-based, hardware-reconfigurable 512×1 single-photon camera system.

We report on LinoSPAD2, a single-photon camera system, comprising a 512×1 single-photon avalanche diode (SPAD) front-end and one or two FPGA-based back-ends. Digital signals generated by the SPADs are processed by the FPGA in real time, whereas the FPGA offers full reconfigurability at a very high level of granularity both in time and space domains. The LinoSPAD2 camera system can process 512 SPADs simultaneously through 256 channels, duplicated on each FPGA-based back-end, with a bank of 64 time-to-digital converters (TDCs) operating at 133 MSa/s, whereas each TDC has a time resolution of 20 ps (LSB). To the best of our knowledge, LinoSPAD2 is the first fully reconfigurable SPAD camera system of large format. The SPAD front-end features a pitch of 26.2 µm, a native fill factor of 25.1%, and a microlens array achieving 2.3× concentration factor. At room temperature, the median dark count rate (DCR) is 80 cps at 7 V excess bias, the peak photon detection probability (PDP) is 53% at 520 nm wavelength, and the single-photon timing resolution (SPTR) is 50 ps FWHM. The instrument response function (IRF) is around 100 ps FWHM at system level. The LinoSPAD2 camera system is suitable for numerous applications, including LiDAR imaging, heralded spectroscopy, compressive Raman sensing, and other computational imaging techniques.

Heralded Spectroscopy Reveals Exciton-Exciton Correlations in Single Colloidal Quantum Dots.

Multiply excited states in semiconductor quantum dots feature intriguing physics and play a crucial role in nanocrystal-based technologies. While photoluminescence provides a natural probe to investigate these states, room-temperature single-particle spectroscopy of their emission has proved elusive due to the temporal and spectral overlap with emission from the singly excited and charged states. Here, we introduce biexciton heralded spectroscopy enabled by a single-photon avalanche diode array based spectrometer. This allows us to directly observe biexciton-exciton emission cascades and measure the biexciton binding energy of single quantum dots at room temperature, even though it is well below the scale of thermal broadening and spectral diffusion. Furthermore, we uncover correlations hitherto masked in ensembles of the biexciton binding energy with both charge-carrier confinement and fluctuations of the local electrostatic potential. Heralded spectroscopy has the potential of greatly extending our understanding of charge-carrier dynamics in multielectron systems and of parallelization of quantum optics protocols.

Widefield High Frame Rate Single-Photon SPAD Imagers for SPIM-FCS.

Photon-counting sensors based on standard complementary metal-oxide-semiconductor single-photon avalanche diodes (SPADs) represent an emerging class of imagers that enable the counting and/or timing of single photons at zero readout noise (better than high-speed electron-multiplying charge-coupling devices) and over large arrays. They have seen substantial progress over the last 15 years, increasing their spatial resolution, timing accuracy, and sensitivity while reducing spurious signals such as afterpulsing and dark counts. They are increasingly being applied for time-resolved applications with the added advantage of enabling real-time options such as autocorrelation. We report in this study on the use of such a state-of-the-art 512 × 128 SPAD array, capable of a time resolution of 10-5-10-6 s for full frames while retaining acceptable photosensitivity thanks to the use of dedicated microlenses, in a selective plane illumination-fluorescence correlation spectroscopy setup. The latter allows us to perform thousands of fluorescence-correlation spectroscopy measurements simultaneously in a two-dimensional slice of the sample. This high-speed SPAD imager enables the measurement of molecular motion of small fluorescent particles such as single chemical dye molecules. Inhomogeneities in the molecular detection efficiency were compensated for by means of a global fit of the auto- and cross-correlation curves, which also made a calibration-free measurement of various samples possible. The afterpulsing effect could also be mitigated, making the measurement of the diffusion of Alexa-488 possible, and the overall result quality was further improved by spatial binning. The particle concentrations in the focus tend to be overestimated by a factor of 1.7 compared to a confocal setup; a calibration is thus required if absolute concentrations need to be measured. The first high-speed selective plane illumination-fluorescence correlation spectroscopy in vivo measurements to our knowledge were also recorded: although two-component fit models could not be employed because of noise, the diffusion of eGFP oligomers in HeLa cells could be measured. Sensitivity and noise will be further improved in the next generation of SPAD-based widefield sensors, which are currently under testing.

Photon-Counting Arrays for Time-Resolved Imaging.

The paper presents a camera comprising 512 × 128 pixels capable of single-photon detection and gating with a maximum frame rate of 156 kfps. The photon capture is performed through a gated single-photon avalanche diode that generates a digital pulse upon photon detection and through a digital one-bit counter. Gray levels are obtained through multiple counting and accumulation, while time-resolved imaging is achieved through a 4-ns gating window controlled with subnanosecond accuracy by a field-programmable gate array. The sensor, which is equipped with microlenses to enhance its effective fill factor, was electro-optically characterized in terms of sensitivity and uniformity. Several examples of capture of fast events are shown to demonstrate the suitability of the approach.

Architecture and applications of a high resolution gated SPAD image sensor.

We present the architecture and three applications of the largest resolution image sensor based on single-photon avalanche diodes (SPADs) published to date. The sensor, fabricated in a high-voltage CMOS process, has a resolution of 512 × 128 pixels and a pitch of 24 µm. The fill-factor of 5% can be increased to 30% with the use of microlenses. For precise control of the exposure and for time-resolved imaging, we use fast global gating signals to define exposure windows as small as 4 ns. The uniformity of the gate edges location is ∼140 ps (FWHM) over the whole array, while in-pixel digital counting enables frame rates as high as 156 kfps. Currently, our camera is used as a highly sensitive sensor with high temporal resolution, for applications ranging from fluorescence lifetime measurements to fluorescence correlation spectroscopy and generation of true random numbers.

Light-field tomographic fluorescence lifetime imaging microscopy.

Fluorescence lifetime imaging microscopy (FLIM) is a powerful imaging technique that enables the visualization of biological samples at the molecular level by measuring the fluorescence decay rate of fluorescent probes. This provides critical information about molecular interactions, environmental changes, and localization within biological systems. However, creating high-resolution lifetime maps using conventional FLIM systems can be challenging, as it often requires extensive scanning that can significantly lengthen acquisition times. This issue is further compounded in three-dimensional (3D) imaging because it demands additional scanning along the depth axis. To tackle this challenge, we developed a novel computational imaging technique called light field tomographic FLIM (LIFT-FLIM). Our approach allows for the acquisition of volumetric fluorescence lifetime images in a highly data-efficient manner, significantly reducing the number of scanning steps required compared to conventional point-scanning or line-scanning FLIM imagers. Moreover, LIFT-FLIM enables the measurement of high-dimensional data using low-dimensional detectors, which are typically low-cost and feature a higher temporal bandwidth. We demonstrated LIFT-FLIM using a linear single-photon avalanche diode array on various biological systems, showcasing unparalleled single-photon detection sensitivity. Additionally, we expanded the functionality of our method to spectral FLIM and demonstrated its application in high-content multiplexed imaging of lung organoids. LIFT-FLIM has the potential to open up new avenues in both basic and translational biomedical research.

Resolving the Controversy in Biexciton Binding Energy of Cesium Lead Halide Perovskite Nanocrystals through Heralded Single-Particle Spectroscopy.

Understanding exciton-exciton interaction in multiply excited nanocrystals is crucial to their utilization as functional materials. Yet, for lead halide perovskite nanocrystals, which are promising candidates for nanocrystal-based technologies, numerous contradicting values have been reported for the strength and sign of their exciton-exciton interaction. In this work, we unambiguously determine the biexciton binding energy in single cesium lead halide perovskite nanocrystals at room temperature. This is enabled by the recently introduced single-photon avalanche diode array spectrometer, capable of temporally isolating biexciton-exciton emission cascades while retaining spectral resolution. We demonstrate that CsPbBr3 nanocrystals feature an attractive exciton-exciton interaction, with a mean biexciton binding energy of 10 meV. For CsPbI3 nanocrystals, we observe a mean biexciton binding energy that is close to zero, and individual nanocrystals show either weakly attractive or weakly repulsive exciton-exciton interaction. We further show that, within ensembles of both materials, single-nanocrystal biexciton binding energies are correlated with the degree of charge-carrier confinement.

Erratum: Author Correction: Single-photon avalanche diode imagers in biophotonics: review and outlook.

[This corrects the article DOI: 10.1038/s41377-019-0191-5.].

Single-photon avalanche diode imagers in biophotonics: review and outlook.

Single-photon avalanche diode (SPAD) arrays are solid-state detectors that offer imaging capabilities at the level of individual photons, with unparalleled photon counting and time-resolved performance. This fascinating technology has progressed at a very fast pace in the past 15 years, since its inception in standard CMOS technology in 2003. A host of architectures have been investigated, ranging from simpler implementations, based solely on off-chip data processing, to progressively "smarter" sensors including on-chip, or even pixel level, time-stamping and processing capabilities. As the technology has matured, a range of biophotonics applications have been explored, including (endoscopic) FLIM, (multibeam multiphoton) FLIM-FRET, SPIM-FCS, super-resolution microscopy, time-resolved Raman spectroscopy, NIROT and PET. We will review some representative sensors and their corresponding applications, including the most relevant challenges faced by chip designers and end-users. Finally, we will provide an outlook on the future of this fascinating technology.

SPAD imagers for super resolution localization microscopy enable analysis of fast fluorophore blinking.

sCMOS imagers are currently utilized (replacing EMCCD imagers) to increase the acquisition speed in super resolution localization microscopy. Single-photon avalanche diode (SPAD) imagers feature frame rates per bit depth comparable to or higher than sCMOS imagers, while generating microsecond 1-bit-frames without readout noise, thus paving the way to in-depth time-resolved image analysis. High timing resolution can also be exploited to explore fluorescent dye blinking and other photophysical properties, which can be used for dye optimization. We present the methodology for the blinking analysis of fluorescent dyes on experimental data. Furthermore, the recent use of microlenses has enabled a substantial increase of SPAD imager overall sensitivity (12-fold in our case), reaching satisfactory values for sensitivity-critical applications. This has allowed us to record the first super resolution localization microscopy results obtained with a SPAD imager, with a localization uncertainty of 20 nm and a resolution of 80 nm.

A 65k pixel, 150k frames-per-second camera with global gating and micro-lenses suitable for fluorescence lifetime imaging.

This paper presents our work on a 65k pixel single-photon avalanche diode (SPAD) based imaging sensor realized in a 0.35µm standard CMOS process. At a resolution of 512 by 128 pixels the sensor is read out in 6.4µs to deliver over 150k monochrome frames per second. The individual pixel has a size of 24µm2 and contains the SPAD with a 12T quenching and gating circuitry along with a memory element. The gating signals are distributed across the chip through a balanced tree to minimize the signal skew between the pixels. The array of pixels is row-addressable and data is sent out of the chip on 128 lines in parallel at a frequency of 80MHz. The system is controlled by an FPGA which generates the gating and readout signals and can be used for arbitrary real-time computation on the frames from the sensor. The communication protocol between the camera and a conventional PC is USB2. The active area of the chip is 5% and can be significantly improved with the application of a micro-lens array. A micro-lens array, for use with collimated light, has been designed and its performance is reviewed in the paper. Among other high-speed phenomena the gating circuitry capable of generating illumination periods shorter than 5ns can be used for Fluorescence Lifetime Imaging (FLIM). In order to measure the lifetime of fluorophores excited by a picosecond laser, the sensor's illumination period is synchronized with the excitation laser pulses. A histogram of the photon arrival times relative to the excitation is then constructed by counting the photons arriving during the sensitive time for several positions of the illumination window. The histogram for each pixel is transferred afterwards to a computer where software routines extract the lifetime at each location with an accuracy better than 100ps. We show results for fluorescence lifetime measurements using different fluorophores with lifetimes ranging from 150ps to 5ns.