Iterative tomography with digital adaptive optics permits hour-long intravital observation of 3D subcellular dynamics at millisecond scale.

Long-term subcellular intravital imaging in mammals is vital to study diverse intercellular behaviors and organelle functions during native physiological processes. However, optical heterogeneity, tissue opacity, and phototoxicity pose great challenges. Here, we propose a computational imaging framework, termed digital adaptive optics scanning light-field mutual iterative tomography (DAOSLIMIT), featuring high-speed, high-resolution 3D imaging, tiled wavefront correction, and low phototoxicity with a compact system. By tomographic imaging of the entire volume simultaneously, we obtained volumetric imaging across 225 × 225 × 16 µm3, with a resolution of up to 220 nm laterally and 400 nm axially, at the millisecond scale, over hundreds of thousands of time points. To establish the capabilities, we investigated large-scale cell migration and neural activities in different species and observed various subcellular dynamics in mammals during neutrophil migration and tumor cell circulation.

Integrated lithium niobate microwave photonic processing engine.

Integrated microwave photonics (MWP) is an intriguing technology for the generation, transmission and manipulation of microwave signals in chip-scale optical systems1,2. In particular, ultrafast processing of analogue signals in the optical domain with high fidelity and low latency could enable a variety of applications such as MWP filters3-5, microwave signal processing6-9 and image recognition10,11. An ideal integrated MWP processing platform should have both an efficient and high-speed electro-optic modulation block to faithfully perform microwave-optic conversion at low power and also a low-loss functional photonic network to implement various signal-processing tasks. Moreover, large-scale, low-cost manufacturability is required to monolithically integrate the two building blocks on the same chip. Here we demonstrate such an integrated MWP processing engine based on a 4 inch wafer-scale thin-film lithium niobate platform. It can perform multipurpose tasks with processing bandwidths of up to 67 GHz at complementary metal-oxide-semiconductor (CMOS)-compatible voltages. We achieve ultrafast analogue computation, namely temporal integration and differentiation, at sampling rates of up to 256 giga samples per second, and deploy these functions to showcase three proof-of-concept applications: solving ordinary differential equations, generating ultra-wideband signals and detecting edges in images. We further leverage the image edge detector to realize a photonic-assisted image segmentation model that can effectively outline the boundaries of melanoma lesion in medical diagnostic images. Our ultrafast lithium niobate MWP engine could provide compact, low-latency and cost-effective solutions for future wireless communications, high-resolution radar and photonic artificial intelligence.

Partial coherence enhances parallelized photonic computing.

Advancements in optical coherence control1-5 have unlocked many cutting-edge applications, including long-haul communication, light detection and ranging (LiDAR) and optical coherence tomography6-8. Prevailing wisdom suggests that using more coherent light sources leads to enhanced system performance and device functionalities9-11. Our study introduces a photonic convolutional processing system that takes advantage of partially coherent light to boost computing parallelism without substantially sacrificing accuracy, potentially enabling larger-size photonic tensor cores. The reduction of the degree of coherence optimizes bandwidth use in the photonic convolutional processing system. This breakthrough challenges the traditional belief that coherence is essential or even advantageous in integrated photonic accelerators, thereby enabling the use of light sources with less rigorous feedback control and thermal-management requirements for high-throughput photonic computing. Here we demonstrate such a system in two photonic platforms for computing applications: a photonic tensor core using phase-change-material photonic memories that delivers parallel convolution operations to classify the gaits of ten patients with Parkinson's disease with 92.2% accuracy (92.7% theoretically) and a silicon photonic tensor core with embedded electro-absorption modulators (EAMs) to facilitate 0.108 tera operations per second (TOPS) convolutional processing for classifying the Modified National Institute of Standards and Technology (MNIST) handwritten digits dataset with 92.4% accuracy (95.0% theoretically).

Nonlinear mechanics of human mitotic chromosomes.

In preparation for mitotic cell division, the nuclear DNA of human cells is compacted into individualized, X-shaped chromosomes1. This metamorphosis is driven mainly by the combined action of condensins and topoisomerase IIα (TOP2A)2,3, and has been observed using microscopy for over a century. Nevertheless, very little is known about the structural organization of a mitotic chromosome. Here we introduce a workflow to interrogate the organization of human chromosomes based on optical trapping and manipulation. This allows high-resolution force measurements and fluorescence visualization of native metaphase chromosomes to be conducted under tightly controlled experimental conditions. We have used this method to extensively characterize chromosome mechanics and structure. Notably, we find that under increasing mechanical load, chromosomes exhibit nonlinear stiffening behaviour, distinct from that predicted by classical polymer models4. To explain this anomalous stiffening, we introduce a hierarchical worm-like chain model that describes the chromosome as a heterogeneous assembly of nonlinear worm-like chains. Moreover, through inducible degradation of TOP2A5 specifically in mitosis, we provide evidence that TOP2A has a role in the preservation of chromosome compaction. The methods described here open the door to a wide array of investigations into the structure and dynamics of both normal and disease-associated chromosomes.

Deep learning-driven adaptive optics for single-molecule localization microscopy.

The inhomogeneous refractive indices of biological tissues blur and distort single-molecule emission patterns generating image artifacts and decreasing the achievable resolution of single-molecule localization microscopy (SMLM). Conventional sensorless adaptive optics methods rely on iterative mirror changes and image-quality metrics. However, these metrics result in inconsistent metric responses and thus fundamentally limit their efficacy for aberration correction in tissues. To bypass iterative trial-then-evaluate processes, we developed deep learning-driven adaptive optics for SMLM to allow direct inference of wavefront distortion and near real-time compensation. Our trained deep neural network monitors the individual emission patterns from single-molecule experiments, infers their shared wavefront distortion, feeds the estimates through a dynamic filter and drives a deformable mirror to compensate sample-induced aberrations. We demonstrated that our method simultaneously estimates and compensates 28 wavefront deformation shapes and improves the resolution and fidelity of three-dimensional SMLM through >130-µm-thick brain tissue specimens.

An optical design enabling lightweight and large field-of-view head-mounted microscopes.

Here we present a fluorescence microscope light path that enables imaging, during free behavior, of thousands of neurons in mice and hundreds of neurons in juvenile songbirds. The light path eliminates traditional illumination optics, allowing for head-mounted microscopes that have both a lower weight and a larger field of view (FOV) than previously possible. Using this light path, we designed two microscopes: one optimized for FOV (~4 mm FOV; 1.4 g), and the other optimized for weight (1.0 mm FOV; 1.0 g).

Surface Engineering of Two-Dimensional Black Phosphorus for Advanced Nanophotonics.

ConspectusEverything in the world has two sides. We should correctly understand its two sides to pursue the positive side and get rid of the negative side. Recently, two-dimensional (2D) black phosphorus (BP) has received a tremendous amount of attention and has been applied for broad applications in optoelectronics, transistors, logic devices, and biomedicines due to its intrinsic properties, e.g., thickness-dependent bandgap, high mobility, highly anisotropic charge transport, and excellent biodegradability and biocompatibility. On one hand, rapid degradation of 2D BP under ambient conditions becomes a vital bottleneck that largely hampers its practical applications in optical and optoelectronic devices and photocatalysis. On the other hand, just because of its ambient instability, 2D BP as a novel kind of nanomedicine in a cancer drug delivery system can not only satisfy effective cancer therapy but also enable its safe biodegradation in vivo. Until now, a variety of surface functionality types and approaches have been employed to rationally modify 2D BP to meet the growing requirements of advanced nanophotonics.In this Account, we describe our research on surface engineering of 2D BP in two opposite ways: (i) stabilizing 2D BP by various approaches for advanced nanophotonic devices with both remarkable photoresponse behavior and environmentally structural stability and (ii) making full use of biodegradation, biocompatibility, and biological activity (e.g., photothermal therapy, photodynamic therapy, and bioimaging) of 2D BP for the construction of high-performance delivery nanoplatforms for biophotonic applications. We highlight the targeted aims of the surface-engineered 2D BP for advanced nanophotonics, including photonic devices (optics, optoelectronics, and photocatalysis) and photoinduced cancer therapy, by means of various surface functionalities, such as heteroatom incorporation, polymer functionalization, coating, heterostructure design, etc. From the viewpoint of potential applications, the fundamental properties of surface-engineered 2D BP and recent advances in surface-engineered 2D BP-based nanophotonic devices are briefly discussed. For the photonic devices, surface-engineered 2D BP can not only effectively improve environmentally structural stability but also simultaneously maintain photoresponse performance, enabling 2D BP-based devices for a wide range of practical applications. In terms of the photoinduced cancer therapy, surface-engineered 2D BP is more appropriate for the treatment of cancer due to negligible toxicity and excellent biodegradation and biocompatibility. We also provide our perspectives on future opportunities and challenges in this important and fast-growing field. It is envisioned that this Account can attract more attention in this area and inspire more scientists in a variety of research communities to accelerate the development of 2D BP for more widespread high-performance nanophotonic applications.

Fossil insect eyes shed light on trilobite optics and the arthropod pigment screen.

Fossilized eyes permit inferences of the visual capacity of extinct arthropods1-3. However, structural and/or chemical modifications as a result of taphonomic and diagenetic processes can alter the original features, thereby necessitating comparisons with modern species. Here we report the detailed molecular composition and microanatomy of the eyes of 54-million-year-old crane-flies, which together provide a proxy for the interpretation of optical systems in some other ancient arthropods. These well-preserved visual organs comprise calcified corneal lenses that are separated by intervening spaces containing eumelanin pigment. We also show that eumelanin is present in the facet walls of living crane-flies, in which it forms the outermost ommatidial pigment shield in compound eyes incorporating a chitinous cornea. To our knowledge, this is the first record of melanic screening pigments in arthropods, and reveals a fossilization mode in insect eyes that involves a decay-resistant biochrome coupled with early diagenetic mineralization of the ommatidial lenses. The demonstrable secondary calcification of lens cuticle that was initially chitinous has implications for the proposed calcitic corneas of trilobites, which we posit are artefacts of preservation rather than a product of in vivo biomineralization4-7. Although trilobite eyes might have been partly mineralized for mechanical strength, a (more likely) organic composition would have enhanced function via gradient-index optics and increased control of lens shape.

Three-dimensional adaptive optical nanoscopy for thick specimen imaging at sub-50-nm resolution.

Understanding cellular organization demands the best possible spatial resolution in all three dimensions. In fluorescence microscopy, this is achieved by 4Pi nanoscopy methods that combine the concepts of using two opposing objectives for optimal diffraction-limited 3D resolution with switching fluorescent molecules between bright and dark states to break the diffraction limit. However, optical aberrations have limited these nanoscopes to thin samples and prevented their application in thick specimens. Here we have developed an improved iso-stimulated emission depletion nanoscope, which uses an advanced adaptive optics strategy to achieve sub-50-nm isotropic resolution of structures such as neuronal synapses and ring canals previously inaccessible in tissue. The adaptive optics scheme presented in this work is generally applicable to any microscope with a similar beam path geometry involving two opposing objectives to optimize resolution when imaging deep in aberrating specimens.

An adaptive optics module for deep tissue multiphoton imaging in vivo.

Understanding complex biological systems requires visualizing structures and processes deep within living organisms. We developed a compact adaptive optics module and incorporated it into two- and three-photon fluorescence microscopes, to measure and correct tissue-induced aberrations. We resolved synaptic structures in deep cortical and subcortical areas of the mouse brain, and demonstrated high-resolution imaging of neuronal structures and somatosensory-evoked calcium responses in the mouse spinal cord at great depths in vivo.

Near eye display based on multiplexed retinal projections for robust compensation of eye pupil variance.

Among various specifications of near eye display (NED) devices, a compact formfactor is essential for comfortable user experience but also the hardest one to accomplish due to the slowest progresses. A pinhole/pinlight array based light-field (LF) technique is considered as one of the candidates to achieve that goal without thicker and heavier refractive optics. Despite those promising advantages, however, there are critical issues, such as dark spots and contrast distortion, which degrade the image quality because of the vulnerability of the LF retinal image when the observer's eye pupil size changes. Regardless of previous attempts to overcome those artifacts, it was impossible to resolve both issues due to their trade-off relation. In this paper, in order to resolve them simultaneously, we propose a concept of multiplexed retinal projections to integrate the LF retinal image through rotating transitions of refined and modulated elemental images for robust compensation of eye pupil variance with improved conservation of contrast distribution. Experimental demonstrations and quantitative analysis are also provided to verify the principle.

Rapid measurement of hemoglobin-oxygen dissociation by leveraging Bohr effect and Soret band bathochromic shift.

Oxygen (O2) binds to hemoglobin (Hb) in the lungs and is then released (dissociated) in the tissues. The Bohr effect is a physiological mechanism that governs the affinity of Hb for O2 based on pH, where a lower pH results in a lower Hb-O2 affinity and higher Hb-O2 dissociation. Hb-O2 affinity and dissociation are crucial for maintaining aerobic metabolism in cells and tissues. Despite its vital role in human physiology, Hb-O2 dissociation measurement is underutilized in basic research and in clinical laboratories, primarily due to the technical complexity and limited throughput of existing methods. We present a rapid Hb-O2 dissociation measurement approach by leveraging the Bohr effect and detecting the optical shift in the Soret band that corresponds to the light absorption by the heme group in Hb. This new method reduces Hb-O2 dissociation measurement time from hours to minutes. We show that Hb deoxygenation can be accelerated chemically at the optimal pH of 6.9. We show that time and pH-controlled deoxygenation of Hb results in rapid and distinct conformational changes in its tertiary structure. These molecular conformational changes are manifested as significant, detectable shifts in Hb's optical absorption spectrum, particularly in the characteristic Soret band (414 nm). We extensively validated the method by testing human blood samples containing normal Hb and Hb variants. We show that rapid Hb-O2 dissociation can be used to screen for and detect Hb-O2 affinity disorders and to evaluate the function and efficacy of Hb-modifying therapies. The ubiquity of optical absorption spectrophotometers positions this approach as an accessible, rapid, and accurate Hb-O2 dissociation measurement method for basic research and clinical use. We anticipate this method's broad adoption will democratize the diagnosis and prognosis of Hb disorders, such as sickle cell disease. Further, this method has the potential to transform the research and development of new targeted and genome-editing-based therapies that aim to modify or improve Hb-O2 affinity.

Engineering van der Waals Materials for Advanced Metaphotonics.

The outstanding chemical and physical properties of 2D materials, together with their atomically thin nature, make them ideal candidates for metaphotonic device integration and construction, which requires deep subwavelength light-matter interaction to achieve optical functionalities beyond conventional optical phenomena observed in naturally available materials. In addition to their intrinsic properties, the possibility to further manipulate the properties of 2D materials via chemical or physical engineering dramatically enhances their capability, evoking new science on light-matter interaction, leading to leaped performance of existing functional devices and giving birth to new metaphotonic devices that were unattainable previously. Comprehensive understanding of the intrinsic properties of 2D materials, approaches and capabilities for chemical and physical engineering methods, the resulting property modifications and novel functionalities, and applications of metaphotonic devices are provided in this review. Through reviewing the detailed progress in each aspect and the state-of-the-art achievement, insightful analyses of the outstanding challenges and future directions are elucidated in this cross-disciplinary comprehensive review with the aim to provide an overall development picture in the field of 2D material metaphotonics and promote rapid progress in this fast emerging and prosperous field.

Multifunctional and Transformative Metaphotonics with Emerging Materials.

Future technologies underpinning multifunctional physical and chemical systems and compact biological sensors will rely on densely packed transformative and tunable circuitry employing nanophotonics. For many years, plasmonics was considered as the only available platform for subwavelength optics, but the recently emerged field of resonant metaphotonics may provide a versatile practical platform for nanoscale science by employing resonances in high-index dielectric nanoparticles and metasurfaces. Here, we discuss the recently emerged field of metaphotonics and describe its connection to material science and chemistry. For tunabilty, metaphotonics employs a variety of the recently highlighted materials such as polymers, perovskites, transition metal dichalcogenides, and phase change materials. This allows to achieve diverse functionalities of metasystems and metasurfaces for efficient spatial and temporal control of light by employing multipolar resonances and the physics of bound states in the continuum. We anticipate expanding applications of these concepts in nanolasers, tunable metadevices, metachemistry, as well as a design of a new generation of chemical and biological ultracompact sensing devices.

Heat-Mediated Optical Manipulation.

Progress in optical manipulation has stimulated remarkable advances in a wide range of fields, including materials science, robotics, medical engineering, and nanotechnology. This Review focuses on an emerging class of optical manipulation techniques, termed heat-mediated optical manipulation. In comparison to conventional optical tweezers that rely on a tightly focused laser beam to trap objects, heat-mediated optical manipulation techniques exploit tailorable optothermo-matter interactions and rich mass transport dynamics to enable versatile control of matter of various compositions, shapes, and sizes. In addition to conventional tweezing, more distinct manipulation modes, including optothermal pulling, nudging, rotating, swimming, oscillating, and walking, have been demonstrated to enhance the functionalities using simple and low-power optics. We start with an introduction to basic physics involved in heat-mediated optical manipulation, highlighting major working mechanisms underpinning a variety of manipulation techniques. Next, we categorize the heat-mediated optical manipulation techniques based on different working mechanisms and discuss working modes, capabilities, and applications for each technique. We conclude this Review with our outlook on current challenges and future opportunities in this rapidly evolving field of heat-mediated optical manipulation.

Artificial Intelligence in Meta-optics.

Recent years have witnessed promising artificial intelligence (AI) applications in many disciplines, including optics, engineering, medicine, economics, and education. In particular, the synergy of AI and meta-optics has greatly benefited both fields. Meta-optics are advanced flat optics with novel functions and light-manipulation abilities. The optical properties can be engineered with a unique design to meet various optical demands. This review offers comprehensive coverage of meta-optics and artificial intelligence in synergy. After providing an overview of AI and meta-optics, we categorize and discuss the recent developments integrated by these two topics, namely AI for meta-optics and meta-optics for AI. The former describes how to apply AI to the research of meta-optics for design, simulation, optical information analysis, and application. The latter reports the development of the optical Al system and computation via meta-optics. This review will also provide an in-depth discussion of the challenges of this interdisciplinary field and indicate future directions. We expect that this review will inspire researchers in these fields and benefit the next generation of intelligent optical device design.

Cataract surgery after corneal refractive surgery: preoperative considerations and management.

PURPOSE OF REVIEW: Corneal refractive surgery (CRS) is one of the most popular eye procedures, with more than 40 million cases performed globally. As CRS-treated patients age and develop cataract, the number of cases that require additional preoperative considerations and management will increase around the world. Thus, we provide an up-to-date, concise overview of the considerations and outcomes of cataract surgery in eyes with previous CRS, including surface ablation, laser in-situ keratomileusis (LASIK), and small-incision lenticule extraction (SMILE). RECENT FINDINGS: Challenges associated with accurate biometry in eyes with CRS have been mitigated recently through total keratometry, ray tracing, intraoperative aberrometry, and machine learning assisted intraocular lens (IOL) power calculation formulas to improve prediction. Emerging studies have highlighted the superior performance of ray tracing and/or total keratometry-based formulas for IOL power calculation in eyes with previous SMILE. Dry eye remains a common side effect after cataract surgery, especially in eyes with CRS, though the risk appears to be lower after SMILE than LASIK (in the short-term). Recent presbyopia-correcting IOL designs such as extended depth of focus (EDOF) IOLs may be suitable in carefully selected eyes with previous CRS. SUMMARY: Ophthalmologists will increasingly face challenges associated with the surgical management of cataract in patients with prior CRS. Careful preoperative assessment of the ocular surface, appropriate use of IOL power calculation formulas, and strategies for presbyopia correction are key to achieve good clinical and refractive outcomes and patient satisfaction. Recent advances in CRS techniques, such as SMILE, may pose new challenges for such eyes in the future.