Fast light-field 3D microscopy with out-of-distribution detection and adaptation through conditional normalizing flows.

Real-time 3D fluorescence microscopy is crucial for the spatiotemporal analysis of live organisms, such as neural activity monitoring. The eXtended field-of-view light field microscope (XLFM), also known as Fourier light field microscope, is a straightforward, single snapshot solution to achieve this. The XLFM acquires spatial-angular information in a single camera exposure. In a subsequent step, a 3D volume can be algorithmically reconstructed, making it exceptionally well-suited for real-time 3D acquisition and potential analysis. Unfortunately, traditional reconstruction methods (like deconvolution) require lengthy processing times (0.0220 Hz), hampering the speed advantages of the XLFM. Neural network architectures can overcome the speed constraints but do not automatically provide a way to certify the realism of their reconstructions, which is essential in the biomedical realm. To address these shortcomings, this work proposes a novel architecture to perform fast 3D reconstructions of live immobilized zebrafish neural activity based on a conditional normalizing flow. It reconstructs volumes at 8 Hz spanning 512x512x96 voxels, and it can be trained in under two hours due to the small dataset requirements (50 image-volume pairs). Furthermore, normalizing flows provides a way to compute the exact likelihood of a sample. This allows us to certify whether the predicted output is in- or ood, and retrain the system when a novel sample is detected. We evaluate the proposed method on a cross-validation approach involving multiple in-distribution samples (genetically identical zebrafish) and various out-of-distribution ones.

Dense, Continuous Membrane Labeling and Expansion Microscopy Visualization of Ultrastructure in Tissues.

Lipid membranes are key to the nanoscale compartmentalization of biological systems, but fluorescent visualization of them in intact tissues, with nanoscale precision, is challenging to do with high labeling density. Here, we report ultrastructural membrane expansion microscopy (umExM), which combines a novel membrane label and optimized expansion microscopy protocol, to support dense labeling of membranes in tissues for nanoscale visualization. We validated the high signal-to-background ratio, and uniformity and continuity, of umExM membrane labeling in brain slices, which supported the imaging of membranes and proteins at a resolution of ~60 nm on a confocal microscope. We demonstrated the utility of umExM for the segmentation and tracing of neuronal processes, such as axons, in mouse brain tissue. Combining umExM with optical fluctuation imaging, or iterating the expansion process, yielded ~35 nm resolution imaging, pointing towards the potential for electron microscopy resolution visualization of brain membranes on ordinary light microscopes.

Imaging the voltage of neurons distributed across entire brains of larval zebrafish.

Neurons interact in networks distributed throughout the brain. Although much effort has focused on whole-brain calcium imaging, recent advances in genetically encoded voltage indicators (GEVIs) raise the possibility of imaging voltage of neurons distributed across brains. To achieve this, a microscope must image at high volumetric rate and signal-to-noise ratio. We present a remote scanning light-sheet microscope capable of imaging GEVI-expressing neurons distributed throughout entire brains of larval zebrafish at a volumetric rate of 200.8 Hz. We measured voltage of ∼1/3 of the neurons of the brain, distributed throughout. We observed that neurons firing at different times during a sequence were located at different brain locations, for sequences elicited by a visual stimulus, which mapped onto locations throughout the optic tectum, as well as during stimulus-independent bursts, which mapped onto locations in the cerebellum and medulla. Whole-brain voltage imaging may open up frontiers in the fundamental operation of neural systems.