Three-dimensional adaptive optical nanoscopy for thick specimen imaging at sub-50-nm resolution.

Understanding cellular organization demands the best possible spatial resolution in all three dimensions. In fluorescence microscopy, this is achieved by 4Pi nanoscopy methods that combine the concepts of using two opposing objectives for optimal diffraction-limited 3D resolution with switching fluorescent molecules between bright and dark states to break the diffraction limit. However, optical aberrations have limited these nanoscopes to thin samples and prevented their application in thick specimens. Here we have developed an improved iso-stimulated emission depletion nanoscope, which uses an advanced adaptive optics strategy to achieve sub-50-nm isotropic resolution of structures such as neuronal synapses and ring canals previously inaccessible in tissue. The adaptive optics scheme presented in this work is generally applicable to any microscope with a similar beam path geometry involving two opposing objectives to optimize resolution when imaging deep in aberrating specimens.

Generalised adaptive optics method for high-NA aberration-free refocusing in refractive-index-mismatched media.

Phase aberrations are introduced when focusing by a high-numerical aperture (NA) objective lens into refractive-index-mismatched (RIM) media. The axial focus position in these media can be adjusted through either optical remote-focusing or mechanical stage translation. Despite the wide interest in remote-focusing, no generalised control algorithm using Zernike polynomials has been presented that performs independent remote-focusing and RIM correction in combination with mechanical stage translation. In this work, we thoroughly review derivations that model high-NA defocus and RIM aberration. We show through both numerical simulation and experimental results that optical remote-focusing using an adaptive device and mechanical stage translation are not optically equivalent processes, such that one cannot fully compensate for the other without additional aberration compensation. We further establish new orthogonal modes formulated using conventional Zernike modes and discuss its device programming to control high-NA remote-focusing and RIM correction as independent primary modes in combination with mechanical stage translation for aberration-free refocusing. Numerical simulations are performed, and control algorithms are validated experimentally by fabricating graphitic features in diamond using direct laser writing.

Multi-scale sensorless adaptive optics: application to stimulated emission depletion microscopy.

Sensorless adaptive optics is commonly used to compensate specimen-induced aberrations in high-resolution fluorescence microscopy, but requires a bespoke approach to detect aberrations in different microscopy techniques, which hinders its widespread adoption. To overcome this limitation, we propose using wavelet analysis to quantify the loss of resolution due to the aberrations in microscope images. By examining the variations of the wavelet coefficients at different scales, we are able to establish a multi-valued image quality metric that can be successfully deployed in different microscopy techniques. To corroborate our arguments, we provide experimental verification of our method by performing aberration correction experiments in both confocal and STED microscopy using three different specimens.

Calibration of a phase-only spatial light modulator for both phase and retardance modulation.

Liquid crystal spatial light modulators (SLMs) are usually configured and calibrated for phase modulation. However, as they are variable retarders, they also have application as polarization modulators. We show that conventional phase-only calibrations are insufficient for this purpose, and a separate retardance calibration is needed. To overcome this shortcoming we report a simple Twyman-Green interferometer-based setup to realize SLM phase and retardance calibration. For phase calibration, we identify the non-linear, spatially variant response to the drive voltage of the SLM using fringe analysis and both horizontally and vertically polarized incident light. For retardance calibration, we use incident light polarized at 45° and assess the intensity variation. The methods presented are compatible with in situ calibration of SLMs.

Aberrations in 4Pi Microscopy.

The combination of two opposing objective lenses in 4Pi fluorescence microscopy significantly improves the axial resolution and increases the collection efficiency. Combining 4Pi microscopy with other super-resolution techniques has resulted in the highest three-dimensional (3D) resolution in fluorescence microscopy to date. It has previously been shown that the performance of 4Pi microscopy is significantly affected by aberrations. However, a comprehensive description of 4Pi microscope aberrations has been missing. In this paper, we introduce an approach to describe aberrations in a 4Pi cavity through a new functional representation. We discuss the focusing properties of 4Pi systems affected by aberrations and discuss the implications for adaptive optics schemes for 4Pi microscopes based on this new insight.

Aberrations in stimulated emission depletion (STED) microscopy.

Like all methods of super-resolution microscopy, stimulated emission depletion (STED) microscopy can suffer from the effects of aberrations. The most important aspect of a STED microscope is that the depletion focus maintains a minimum, ideally zero, intensity point that is surrounded by a region of higher intensity. It follows that aberrations that cause a non-zero value of this minimum intensity are the most detrimental, as they inhibit fluorescence emission even at the centre of the depletion focus. We present analysis that elucidates the nature of these effects in terms of the different polarisation components at the focus for two-dimensional and three-dimensional STED resolution enhancement. It is found that only certain low-order aberration modes can affect the minimum intensity at the Gaussian focus. This has important consequences for the design of adaptive optics aberration correction systems.

Coma aberrations in combined two- and three-dimensional STED nanoscopy.

Stimulated emission depletion (STED) microscopes, like all super-resolution methods, are sensitive to aberrations. Of particular importance are aberrations that affect the quality of the depletion focus, which requires a point of near-zero intensity surrounded by strong illumination. We present analysis, modeling, and experimental measurements that show the effects of coma aberrations on depletion patterns of two-dimensional (2D) and three-dimensional (3D) STED configurations. Specifically, we find that identical coma aberrations create focal shifts in opposite directions in 2D and 3D STED. This phenomenon could affect the precision of microscopic measurements and has ramifications for the efficacy of combined 2D/3D STED systems.

Modal-based phase retrieval for adaptive optics.

We consider using phase retrieval (PR) to correct phase aberrations in an optical system. Three measurements of the point-spread function (PSF) are collected to estimate an aberration. For each measurement, a different defocus aberration is applied with a deformable mirror (DM). Once the aberration is estimated using a PR algorithm, we apply the aberration correction with the DM, and measure the residual aberration using a Shack-Hartmann wavefront sensor. The extended Nijboer-Zernike theory is used for modelling the PSF. The PR problem is solved using both an algorithm called PhaseLift, which is based on matrix rank minimization, and another algorithm based on alternating projections. For comparison, we include the results achieved using a classical PR algorithm, which is based on alternating projections and uses the fast Fourier transform.

Optimization-based wavefront sensorless adaptive optics for multiphoton microscopy.

Optical aberrations have detrimental effects in multiphoton microscopy. These effects can be curtailed by implementing model-based wavefront sensorless adaptive optics, which only requires the addition of a wavefront shaping device, such as a deformable mirror (DM) to an existing microscope. The aberration correction is achieved by maximizing a suitable image quality metric. We implement a model-based aberration correction algorithm in a second-harmonic microscope. The tip, tilt, and defocus aberrations are removed from the basis functions used for the control of the DM, as these aberrations induce distortions in the acquired images. We compute the parameters of a quadratic polynomial that is used to model the image quality metric directly from experimental input-output measurements. Finally, we apply the aberration correction by maximizing the image quality metric using the least-squares estimate of the unknown aberration.

Universal adaptive optics for microscopy through embedded neural network control.

The resolution and contrast of microscope imaging is often affected by aberrations introduced by imperfect optical systems and inhomogeneous refractive structures in specimens. Adaptive optics (AO) compensates these aberrations and restores diffraction limited performance. A wide range of AO solutions have been introduced, often tailored to a specific microscope type or application. Until now, a universal AO solution - one that can be readily transferred between microscope modalities - has not been deployed. We propose versatile and fast aberration correction using a physics-based machine learning assisted wavefront-sensorless AO control (MLAO) method. Unlike previous ML methods, we used a specially constructed neural network (NN) architecture, designed using physical understanding of the general microscope image formation, that was embedded in the control loop of different microscope systems. The approach means that not only is the resulting NN orders of magnitude simpler than previous NN methods, but the concept is translatable across microscope modalities. We demonstrated the method on a two-photon, a three-photon and a widefield three-dimensional (3D) structured illumination microscope. Results showed that the method outperformed commonly-used modal-based sensorless AO methods. We also showed that our ML-based method was robust in a range of challenging imaging conditions, such as 3D sample structures, specimen motion, low signal to noise ratio and activity-induced fluorescence fluctuations. Moreover, as the bespoke architecture encapsulated physical understanding of the imaging process, the internal NN configuration was no-longer a "black box", but provided physical insights on internal workings, which could influence future designs.

Semidefinite programming for model-based sensorless adaptive optics.

Wavefront sensorless adaptive optics methodologies are widely considered in scanning fluorescence microscopy where direct wavefront sensing is challenging. In these methodologies, aberration correction is performed by sequentially changing the settings of the adaptive element until a predetermined image quality metric is optimized. An efficient aberration correction can be achieved by modeling the image quality metric with a quadratic polynomial. We propose a new method to compute the parameters of the polynomial from experimental data. This method guarantees that the quadratic form in the polynomial is semidefinite, resulting in a more robust computation of the parameters with respect to existing methods. In addition, we propose an algorithm to perform aberration correction requiring a minimum of N+1 measurements, where N is the number of considered aberration modes. This algorithm is based on a closed-form expression for the exact optimization of the quadratic polynomial. Our arguments are corroborated by experimental validation in a laboratory environment.

3D super-resolution deep-tissue imaging in living mice.

Stimulated emission depletion (STED) microscopy enables the three-dimensional (3D) visualization of dynamic nanoscale structures in living cells, offering unique insights into their organization. However, 3D-STED imaging deep inside biological tissue is obstructed by optical aberrations and light scattering. We present a STED system that overcomes these challenges. Through the combination of two-photon excitation, adaptive optics, red-emitting organic dyes, and a long-working-distance water-immersion objective lens, our system achieves aberration-corrected 3D super-resolution imaging, which we demonstrate 164 µm deep in fixed mouse brain tissue and 76 µm deep in the brain of a living mouse.

Complex vectorial optics through gradient index lens cascades.

Graded index (GRIN) lenses are commonly used for compact imaging systems. It is not widely appreciated that the ion-exchange process that creates the rotationally symmetric GRIN lens index profile also causes a symmetric birefringence variation. This property is usually considered a nuisance, such that manufacturing processes are optimized to keep it to a minimum. Here, rather than avoiding this birefringence, we understand and harness it by using GRIN lenses in cascade with other optical components to enable extra functionality in commonplace GRIN lens systems. We show how birefringence in the GRIN cascades can generate vector vortex beams and foci, and how it can be used advantageously to improve axial resolution. Through using the birefringence for analysis, we show that the GRIN cascades form the basis of a new single-shot Müller matrix polarimeter with potential for endoscopic label-free cancer diagnostics. The versatility of these cascades opens up new technological directions.