Integration of Parallel Opposing Memories Underlies Memory Extinction.

Accurately predicting an outcome requires that animals learn supporting and conflicting evidence from sequential experience. In mammals and invertebrates, learned fear responses can be suppressed by experiencing predictive cues without punishment, a process called memory extinction. Here, we show that extinction of aversive memories in Drosophila requires specific dopaminergic neurons, which indicate that omission of punishment is remembered as a positive experience. Functional imaging revealed co-existence of intracellular calcium traces in different places in the mushroom body output neuron network for both the original aversive memory and a new appetitive extinction memory. Light and ultrastructural anatomy are consistent with parallel competing memories being combined within mushroom body output neurons that direct avoidance. Indeed, extinction-evoked plasticity in a pair of these neurons neutralizes the potentiated odor response imposed in the network by aversive learning. Therefore, flies track the accuracy of learned expectations by accumulating and integrating memories of conflicting events.

Site-Specific Integration of Hexagonal Boron Nitride Quantum Emitters on 2D DNA Origami Nanopores.

Optical emitters in hexagonal boron nitride (hBN) are promising probes for single-molecule sensing platforms. When engineered in nanoparticle form, they can be integrated as detectors in nanodevices, yet positional control at the nanoscale is lacking. Here we demonstrate the functionalization of DNA origami nanopores with optically active hBN nanoparticles (NPs) with nanometer precision. The NPs are active under three wavelengths of visible illumination and display both stable and blinking emission, enabling their accurate localization by using wide-field optical nanoscopy. Correlative opto-structural characterization reveals deterministic binding of bright, multicolor hBN NPs at the pore rim due to π-π stacking interactions at site-specific locations on the DNA origami. Our work provides a scalable, bottom-up approach toward deterministic assembly of solid-state emitters on arbitrary structural elements based on DNA origami. Such a nanoscale arrangement of optically active components can advance the development of single-molecule platforms, including optical nanopores and nanochannel sensors.

Structured illumination microscopy with noise-controlled image reconstructions.

Super-resolution structured illumination microscopy (SIM) has become a widely used method for biological imaging. Standard reconstruction algorithms, however, are prone to generate noise-specific artifacts that limit their applicability for lower signal-to-noise data. Here we present a physically realistic noise model that explains the structured noise artifact, which we then use to motivate new complementary reconstruction approaches. True-Wiener-filtered SIM optimizes contrast given the available signal-to-noise ratio, and flat-noise SIM fully overcomes the structured noise artifact while maintaining resolving power. Both methods eliminate ad hoc user-adjustable reconstruction parameters in favor of physical parameters, enhancing objectivity. The new reconstructions point to a trade-off between contrast and a natural noise appearance. This trade-off can be partly overcome by further notch filtering but at the expense of a decrease in signal-to-noise ratio. The benefits of the proposed approaches are demonstrated on focal adhesion and tubulin samples in two and three dimensions, and on nanofabricated fluorescent test patterns.

Image scanning microscopy: a vectorial physical optics analysis.

Image scanning microscopy (ISM) achieves resolution beyond the diffraction limit by a factor of 2. However, prior ISM research predominantly employs scalar diffraction theory, neglecting critical physical effects such as polarization, aberrations, and Stokes shift. This paper presents a comprehensive vectorial ISM point spread function (PSF) model that accounts for these phenomena. By considering the effect of polarization in emission and excitation paths, as well as aberrations and Stokes shift, our model provides a more accurate representation of ISM. We analyze the differences between scalar and vectorial theories in ISM and investigate the impact of pinhole size and aberration strength on resolution. At a numerical aperture of 1.2, the full width half maximum (FWHM) discrepancy between scalar and vectorial ISM PSFs can reach 45 nm, representing a 30% deviation from the vectorial model. Additionally, we explore multiphoton excitation in ISM and observe increased FWHM for 2-photon and 3-photon excitation compared to 1-photon excitation. The FWHM of the 2-photon excitation ISM PSF increases by 20% and the FWHM of the 3-photon excitation ISM PSF increases by 28% compared to the 1-photon excitation ISM. In addition, we found that the optimal sweep factor for 2-photon ISM is 1.22, and the optimal sweep factor of 3-photon ISM is 1.12 instead of the 2 predicted by the one-photon scalar ISM theory. Our work improves the understanding of ISM and contributes to its advancement as a high-resolution imaging technique.

Unveiling the limits of precision in iterative MINFLUX.

In single-molecule microscopy, a big question is how precisely we can estimate the location of a single molecule. Our research shows that by using iterative localisation microscopy and factoring in the prior information, we can boost precision and reduce the number of photons needed. Leveraging the Van Trees inequality aids in determining the optimal precision achievable. Our approach holds promise for wider application in discerning the optimal precision across diverse imaging scenarios, encompassing various illumination strategies, point spread functions and overarching control methodologies.

Localization microscopy at doubled precision with patterned illumination.

MINFLUX offers a breakthrough in single molecule localization precision, but is limited in field of view. Here we combine centroid estimation and illumination pattern induced photon count variations in a conventional widefield imaging setup to extract position information over a typical micrometer-sized field of view. We show a near two-fold improvement in precision over standard localization with the same photon count on DNA-origami nanostructures and tubulin in cells, using DNA-PAINT and STORM imaging.

ZIMFLUX: Single molecule localization microscopy with patterned illumination in 3D.

Three dimensional modulation-enhanced single-molecule localization techniques, such as ModLoc, offer advancements in axial localization precision across the entire field of view and axial capture range, by applying phase shifting to the illumination pattern. However, this improvement is limited by the pitch of the illumination pattern that can be used and requires registration between separate regions of the camera. To overcome these limitations, we present ZIMFLUX, a method that combines astigmatic point-spread-function (PSF) engineering with a structured illumination pattern in all three spatial dimensions. In order to achieve this we address challenges such as optical aberrations, refractive index mismatch, supercritical angle fluorescence (SAF), and imaging at varying depths within a sample, by implementing a vectorial PSF model. In scenarios involving refractive index mismatch between the sample and immersion medium, the astigmatic PSF loses its ellipticity at greater imaging depths, leading to a deterioration in axial localization precision. In contrast, our simulations demonstrate that ZIMFLUX maintains high axial localization precision even when imaging deeper into the sample. Experimental results show unbiased localization of 3D 80 nm DNA-origami nanostructures in SAF conditions with a 1.5-fold improvement in axial localization precision when comparing ZIMFLUX to conventional SMLM methods that rely solely on astigmatic PSF engineering.

Laser-Induced Cavitation for Controlling Crystallization from Solution.

We demonstrate that a cavitation bubble initiated by a Nd:YAG laser pulse below breakdown threshold induces crystallization from supersaturated aqueous solutions with supersaturation and laser-energy-dependent nucleation kinetics. Combining high-speed video microscopy and simulations, we argue that a competition between the dissipation of absorbed laser energy as latent and sensible heat dictates the solvent evaporation rate and creates a momentary supersaturation peak at the vapor-liquid interface. The number and morphology of crystals correlate to the characteristics of the simulated supersaturation peak.

Precision in iterative modulation enhanced single-molecule localization microscopy.

Modulation enhanced single-molecule localization microscopy (meSMLM) methods improve the localization precision by using patterned illumination to encode additional position information. Iterative meSMLM (imeSMLM) methods iteratively generate prior information on emitter positions, used to locally improve the localization precision during subsequent iterations. The Cramér-Rao lower bound cannot incorporate prior information to bound the best achievable localization precision because it requires estimators to be unbiased. By treating estimands as random variables with a known prior distribution, the Van Trees inequality (VTI) can be used to bound the best possible localization precision of imeSMLM methods. An imeSMLM method is considered, where the positions of in-plane standing-wave illumination patterns are controlled over the course of multiple iterations. Using the VTI, we analytically approximate a lower bound on the maximum localization precision of imeSMLM methods that make use of standing-wave illumination patterns. In addition, we evaluate the maximally achievable localization precision for different illumination pattern placement strategies using Monte Carlo simulations. We show that in the absence of background and under perfect modulation, the information content of signal photons increases exponentially as a function of the iteration count. However, the information increase is no longer exponential as a function of the iteration count under non-zero background, imperfect modulation, or limited mechanical resolution of the illumination positioning system. As a result, imeSMLM with two iterations reaches at most a fivefold improvement over SMLM at 8 expected background photons per pixel and 95% modulation contrast. Moreover, the information increase from imeSMLM is balanced by a reduced signal photon rate. Therefore, SMLM outperforms imeSMLM when considering an equal measurement time and illumination power per iteration. Finally, the VTI is an excellent tool for the assessment of the performance of illumination control and is therefore the method of choice for optimal design and control of imeSMLM methods.

Drift correction in localization microscopy using entropy minimization.

Localization microscopy offers resolutions down to a single nanometer but currently requires additional dedicated hardware or fiducial markers to reduce resolution loss from the drift of the sample. Drift estimation without fiducial markers is typically implemented using redundant cross correlation (RCC). We show that RCC has sub-optimal precision and bias, which leaves room for improvement. Here, we minimize a bound on the entropy of the obtained localizations to efficiently compute a precise drift estimate. Within practical compute-time constraints, simulations show a 5x improvement in drift estimation precision over the widely used RCC algorithm. The algorithm operates directly on fluorophore localizations and is tested on simulated and experimental datasets in 2D and 3D. An open source implementation is provided, implemented in Python and C++, and can utilize a GPU if available.

Theoretical minimum uncertainty of single-molecule localizations using a single-photon avalanche diode array.

Single-photon avalanche diode (SPAD) arrays can be used for single-molecule localization microscopy (SMLM) because of their high frame rate and lack of readout noise. SPAD arrays have a binary frame output, which means photon arrivals should be described as a binomial process rather than a Poissonian process. Consequentially, the theoretical minimum uncertainty of the localizations is not accurately predicted by the Poissonian Cramér-Rao lower bound (CRLB). Here, we derive a binomial CRLB and benchmark it using simulated and experimental data. We show that if the expected photon count is larger than one for all pixels within one standard deviation of a Gaussian point spread function, the binomial CRLB gives a 46% higher theoretical uncertainty than the Poissonian CRLB. For typical SMLM photon fluxes, where no saturation occurs, the binomial CRLB predicts the same uncertainty as the Poissonian CRLB. Therefore, the binomial CRLB can be used to predict and benchmark localization uncertainty for SMLM with SPAD arrays for all practical emitter intensities.

Anisoplanatic adaptive optics in parallelized laser scanning microscopy.

Inhomogeneities in the refractive index of a biological microscopy sample can introduce phase aberrations, severely impairing the quality of images. Adaptive optics can be employed to correct for phase aberrations and improve image quality. However, conventional adaptive optics can only correct a single phase aberration for the whole field of view (isoplanatic correction) while, due to the highly heterogeneous nature of biological tissues, the sample induced aberrations in microscopy often vary throughout the field of view (anisoplanatic aberration), limiting significantly the effectiveness of adaptive optics. This paper reports on a new approach for aberration correction in laser scanning confocal microscopy, in which a spatial light modulator is used to generate multiple excitation points in the sample to simultaneously scan different portions of the field of view with completely independent correction, achieving anisoplanatic compensation of sample induced aberrations, in a significantly shorter time compared to sequential isoplanatic correction of multiple image subregions. The method was tested in whole Drosophila brains and in larval Zebrafish, each showing a dramatic improvement in resolution and sharpness when compared to conventional isoplanatic adaptive optics.

Single molecule fluorescence in situ hybridisation for quantitating post-transcriptional regulation in Drosophila brains.

RNA in situ hybridization is a powerful method to investigate post-transcriptional regulation, but analysis of intracellular mRNA distributions in thick, complex tissues like the brain poses significant challenges. Here, we describe the application of single-molecule fluorescent in situ hybridization (smFISH) to quantitate primary nascent transcription and post-transcriptional regulation in whole-mount Drosophila larval and adult brains. Combining immunofluorescence and smFISH probes for different regions of a single gene, i.e., exons, 3'UTR, and introns, we show examples of a gene that is regulated post-transcriptionally and one that is regulated at the level of transcription. Our simple and rapid protocol can be used to co-visualise a variety of different transcripts and proteins in neuronal stem cells as well as deep brain structures such as mushroom body neuropils, using conventional confocal microscopy. Finally, we introduce the use of smFISH as a sensitive alternative to immunofluorescence for labelling specific neural stem cell populations in the brain.

Simultaneous measurement of emission color and 3D position of single molecules.

We show that the position of single molecules in all three spatial dimensions can be estimated alongside its emission color by diffractive optics based design of the Point Spread Function (PSF). The phase in a plane conjugate to the aperture stop of the objective lens is modified by a diffractive structure that splits the spot on the camera into closely spaced diffraction orders. The distance between and the size of these sub-spots are a measure of the emission color. Estimation of the axial position is enabled by imprinting aberrations such as astigmatism and defocus onto the orders. The overall spot shape is fitted with a fully vectorial PSF model. Proof-of-principle experiments on quantum dots indicate that a spectral precision of 10 to 20 nm, an axial localization precision of 25 to 50 nm, and a lateral localization precision of 10 to 30 nm can be achieved over a 1 µm range of axial positions for on average 800 signal photons and 17 background photons/pixel. The method appears to be rather sensitive to PSF model errors such as aberrations, giving in particular rise to biases in the fitted wavelength of up to 15 nm.

Quantifying the minimum localization uncertainty of image scanning localization microscopy.

Modulation enhanced single-molecule localization microscopy (meSMLM), where emitters are sparsely activated with sequentially applied patterned illumination, increases the localization precision over single-molecule localization microscopy (SMLM). The precision improvement of modulation enhanced SMLM is derived from retrieving the position of an emitter relative to individual illumination patterns, which adds to existing point spread function information from SMLM. Here, we introduce SpinFlux: modulation enhanced localization for spinning disk confocal microscopy. SpinFlux uses a spinning disk with pinholes in its illumination and emission paths, to sequentially illuminate regions in the sample during each measurement. The resulting intensity-modulated emission signal is analyzed for each individual pattern to localize emitters with improved precision. We derive a statistical image formation model for SpinFlux and we quantify the theoretical minimum localization uncertainty in terms of the Cramér-Rao lower bound. Using the theoretical minimum uncertainty, we compare SpinFlux to localization on Fourier reweighted image scanning microscopy reconstructions. We find that localization on image scanning microscopy reconstructions with Fourier reweighting ideally results in a global precision improvement of 2.1 over SMLM. When SpinFlux is used for sequential illumination with three patterns around the emitter position, the localization precision improvement over SMLM is twofold when patterns are focused around the emitter position. If four donut-shaped illumination patterns are used for SpinFlux, the maximum local precision improvement over SMLM is increased to 3.5. Localization of image scanning microscopy reconstructions thus has the largest potential for global improvements of the localization precision, where SpinFlux is the method of choice for local refinements.

Fast, single-molecule localization that achieves theoretically minimum uncertainty.

We describe an iterative algorithm that converges to the maximum likelihood estimate of the position and intensity of a single fluorophore. Our technique efficiently computes and achieves the Cramér-Rao lower bound, an essential tool for parameter estimation. An implementation of the algorithm on graphics processing unit hardware achieved more than 10(5) combined fits and Cramér-Rao lower bound calculations per second, enabling real-time data analysis for super-resolution imaging and other applications.

Iterative learning control of a membrane deformable mirror for optimal wavefront correction.

We present an iterative learning control (ILC) algorithm for controlling the shape of a membrane deformable mirror (DM). We furthermore give a physical interpretation of the design parameters of the ILC algorithm. On the basis of this insight, we derive a simple tuning procedure for the ILC algorithm that, in practice, guarantees stable and fast convergence of the membrane to the desired shape. In order to demonstrate the performance of the algorithm, we have built an experimental setup that consists of a commercial membrane DM, a wavefront sensor, and a real-time controller. The experimental results show that, by using the ILC algorithm, we are able to achieve a relatively small error between the real and desired shape of the DM while at the same time we are able to control the saturation of the actuators. Moreover, we show that the ILC algorithm outperforms other control algorithms available in the literature.