Revealing speckle obscured living human retinal cells with artificial intelligence assisted adaptive optics optical coherence tomography.

BACKGROUND: In vivo imaging of the human retina using adaptive optics optical coherence tomography (AO-OCT) has transformed medical imaging by enabling visualization of 3D retinal structures at cellular-scale resolution, including the retinal pigment epithelial (RPE) cells, which are essential for maintaining visual function. However, because noise inherent to the imaging process (e.g., speckle) makes it difficult to visualize RPE cells from a single volume acquisition, a large number of 3D volumes are typically averaged to improve contrast, substantially increasing the acquisition duration and reducing the overall imaging throughput. METHODS: Here, we introduce parallel discriminator generative adversarial network (P-GAN), an artificial intelligence (AI) method designed to recover speckle-obscured cellular features from a single AO-OCT volume, circumventing the need for acquiring a large number of volumes for averaging. The combination of two parallel discriminators in P-GAN provides additional feedback to the generator to more faithfully recover both local and global cellular structures. Imaging data from 8 eyes of 7 participants were used in this study. RESULTS: We show that P-GAN not only improves RPE cell contrast by 3.5-fold, but also improves the end-to-end time required to visualize RPE cells by 99-fold, thereby enabling large-scale imaging of cells in the living human eye. RPE cell spacing measured across a large set of AI recovered images from 3 participants were in agreement with expected normative ranges. CONCLUSIONS: The results demonstrate the potential of AI assisted imaging in overcoming a key limitation of RPE imaging and making it more accessible in a routine clinical setting.

The retinal pigment epithelium (RPE) is a single layer of cells within the eye that is crucial for vision. These cells are unhealthy in many eye diseases, and this can result in vision problems, including blindness. Imaging RPE cells in living human eyes is time consuming and difficult with the current technology. Our method substantially speeds up the process of RPE imaging by incorporating artificial intelligence. This enables larger areas of the eye to be imaged more efficiently. Our method could potentially be used in the future during routine eye tests. This could lead to earlier detection and treatment of eye diseases, and the prevention of some causes of blindness.

Ultrahigh-speed multimodal adaptive optics system for microscopic structural and functional imaging of the human retina.

We describe the design and performance of a multimodal and multifunctional adaptive optics (AO) system that combines scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) for simultaneous retinal imaging at 13.4 Hz. The high-speed AO-OCT channel uses a 3.4 MHz Fourier-domain mode-locked (FDML) swept source. The system achieves exquisite resolution and sensitivity for pan-macular and transretinal visualization of retinal cells and structures while providing a functional assessment of the cone photoreceptors. The ultra-high speed also enables wide-field scans for clinical usability and angiography for vascular visualization. The FDA FDML-AO system is a powerful platform for studying various retinal and neurological diseases for vision science research, retina physiology investigation, and biomarker development.

Cone photoreceptor dysfunction in retinitis pigmentosa revealed by optoretinography.

Retinitis pigmentosa (RP) is the most common group of inherited retinal degenerative diseases, whose most debilitating phase is cone photoreceptor death. Perimetric and electroretinographic methods are the gold standards for diagnosing and monitoring RP and assessing cone function. However, these methods lack the spatial resolution and sensitivity to assess disease progression at the level of individual photoreceptor cells, where the disease originates and whose degradation causes vision loss. High-resolution retinal imaging methods permit visualization of human cone cells in vivo but have only recently achieved sufficient sensitivity to observe their function as manifested in the cone optoretinogram. By imaging with phase-sensitive adaptive optics optical coherence tomography, we identify a biomarker in the cone optoretinogram that characterizes individual cone dysfunction by stimulating cone cells with flashes of light and measuring nanometer-scale changes in their outer segments. We find that cone optoretinographic responses decrease with increasing RP severity and that even in areas where cone density appears normal, cones can respond differently than those in controls. Unexpectedly, in the most severely diseased patches examined, we find isolated cones that respond normally. Short-wavelength-sensitive cones are found to be more vulnerable to RP than medium- and long-wavelength-sensitive cones. We find that decreases in cone response and cone outer-segment length arise earlier in RP than changes in cone density but that decreases in response and length are not necessarily correlated within single cones.

Cell - Vessel Mismatch in Glaucoma: Correlation of Ganglion Cell Layer Soma and Capillary Densities.

Purpose: The purpose of this study was to characterize the relationship between retinal ganglion cell layer (GCL) soma density and capillary density in glaucomatous eyes. Methods: Six glaucoma subjects with known hemifield defects and 6 age-matched controls were imaged with adaptive optics - optical coherence tomography (AO-OCT) at 6 locations: 3 degrees, 6 degrees, and 12 degrees temporal to the fovea above and below the midline. GCL soma density and capillary density were measured at each location. Coefficients of determination (pseudo R2) and slopes between GCL soma and capillary density were determined from mixed-effects regressions and were compared between glaucoma and control subjects, between more and less affected hemifield in subjects with glaucoma, and between subjects with early and moderate glaucoma, both in a local, bivariate model and then a global, multivariable model controlling for eccentricity and soma size. Results: The global correlation between GCL soma and capillary density was stronger in control versus subjects with glaucoma (R2 = 0.59 vs. 0.22), less versus more affected hemifields (R2 = 0.55 vs. 0.01), and subjects with early versus moderate glaucoma subjects (R2 = 0.44 vs. 0.18). When controlling for eccentricity and soma size, we noted an inverse soma-capillary density local relationship in subjects with glaucoma (-388 ± 190 cells/mm2 per 1% change in capillary density, P = 0.046) and more affected hemifields (-602 ± 257 cells/mm2 per 1% change in capillary density, P = 0.03). Conclusions: An inverted soma-capillary density local relationship in areas affected by glaucoma potentially explains weaker global correlations observed between GCL soma and capillary density, suggesting cell-vessel mismatch is associated with the disease.

Quantification of Retinal Ganglion Cell Morphology in Human Glaucomatous Eyes.

Purpose: To characterize retinal ganglion cell morphological changes in patients with primary open-angle glaucoma associated with hemifield defect (HD) using adaptive optics-optical coherence tomography (AO-OCT). Methods: Six patients with early to moderate primary open-angle glaucoma with an average age of 58 years associated with HD and six age-matched healthy controls with an average age of 61 years were included. All participants underwent in vivo retinal ganglion cell (RGC) imaging at six primary locations across the macula with AO-OCT. Ganglion cell layer (GCL) somas were manually counted, and morphological parameters of GCL soma density, size, and symmetry were calculated. RGC cellular characteristics were correlated with functional visual field measurements. Results: GCL soma density was 12,799 ± 7747 cells/mm2, 9370 ± 5572 cells/mm2, and 2134 ± 1494 cells/mm2 at 3°, 6°, and 12°, respectively, in glaucoma patients compared with 25,058 ± 4649 cells/mm2, 15,551 ± 2301 cells/mm2, and 3891 ± 1105 cells/mm2 (P < 0.05 for all locations) at the corresponding retinal locations in healthy participants. Mean soma diameter was significantly larger in glaucoma patients (14.20 ± 2.30 µm) compared with the health controls (12.32 ± 1.94 µm, P < 0.05 for all locations); symmetry was 0.36 ± 0.32 and 0.86 ± 0.13 in glaucoma and control cohorts, respectively. Conclusions: Glaucoma patients had lower GCL soma density and symmetry, greater soma size, and increased variation of GCL soma reflectance compared with age-matched control subjects. The morphological changes corresponded with HD, and the cellular level structural loss correlated with visual function loss in glaucoma. AO-based morphological parameters could be potential sensitive biomarkers for glaucoma.

Revealing How Color Vision Phenotype and Genotype Manifest in Individual Cone Cells.

Purpose: Psychophysical and genetic testing provide substantial information about color vision phenotype and genotype. However, neither reveals how color vision phenotypes and genotypes manifest themselves in individual cones, where color vision and its anomalies are thought to originate. Here, we use adaptive-optics phase-sensitive optical coherence tomography (AO-PSOCT) to investigate these relationships. Methods: We used AO-PSOCT to measure cone function-optical response to light stimulation-in each of 16 human subjects with different phenotypes and genotypes of color vision (five color-normal, three deuteranopic, two protanopic, and six deuteranomalous trichromatic subjects). We classified three spectral types of cones (S, M, and L), and we measured cone structure-namely cone density, cone mosaic arrangement, and spatial arrangement of cone types. Results: For the different phenotypes, our cone function results show that (1) color normals possess S, M, and L cones; (2) deuteranopes are missing M cones but are normal otherwise; (3) protanopes are missing L cones but are normal otherwise; and (4) deuteranomalous trichromats are missing M cones but contain evidence of at least two subtypes of L cones. Cone function was consistent with the subjects' genotype in which only the first two M and L genes in the gene array are expressed and was correlated with the estimated spectral separation between photopigments, including in the deuteranomalous trichromats. The L/M cone ratio was highly variable in the color normals. No association was found between cone density and the genotypes and phenotypes investigated, and the cone mosaic arrangement was altered in the dichromats. Conclusions: AO-PSOCT is a novel method for assessing color vision phenotype and genotype in single cone cells.

Weakly supervised individual ganglion cell segmentation from adaptive optics OCT images for glaucomatous damage assessment.

Cell-level quantitative features of retinal ganglion cells (GCs) are potentially important biomarkers for improved diagnosis and treatment monitoring of neurodegenerative diseases such as glaucoma, Parkinson's disease, and Alzheimer's disease. Yet, due to limited resolution, individual GCs cannot be visualized by commonly used ophthalmic imaging systems, including optical coherence tomography (OCT), and assessment is limited to gross layer thickness analysis. Adaptive optics OCT (AO-OCT) enables in vivo imaging of individual retinal GCs. We present an automated segmentation of GC layer (GCL) somas from AO-OCT volumes based on weakly supervised deep learning (named WeakGCSeg), which effectively utilizes weak annotations in the training process. Experimental results show that WeakGCSeg is on par with or superior to human experts and is superior to other state-of-the-art networks. The automated quantitative features of individual GCLs show an increase in structure-function correlation in glaucoma subjects compared to using thickness measures from OCT images. Our results suggest that by automatic quantification of GC morphology, WeakGCSeg can potentially alleviate a major bottleneck in using AO-OCT for vision research.

Suite of methods for assessing inner retinal temporal dynamics across spatial and temporal scales in the living human eye.

Significance: There are no label-free imaging descriptors related to physiological activity of inner retinal cells in the living human eye. A major reason is that inner retinal neurons are highly transparent and reflect little light, making them extremely difficult to visualize and quantify. Aim: To measure physiologically-induced optical changes of inner retinal cells despite their challenging optical properties. Approach: We developed an imaging method based on adaptive optics and optical coherence tomography (AO-OCT) and a suite of postprocessing algorithms, most notably a new temporal correlation method. Results: We captured the temporal dynamics of entire inner retinal layers, of specific tissue types, and of individual cells across three different timescales from fast (seconds) to extremely slow (one year). Time correlation analysis revealed significant differences in time constant (up to 0.4 s) between the principal layers of the inner retina with the ganglion cell layer (GCL) being the most dynamic. At the cellular level, significant differences were found between individual GCL somas. The mean time constant of the GCL somas ( 0.69 ± 0.17 s ) was ∼ 30 % smaller than that of nerve fiber bundles and inner plexiform layer synapses and processes. Across longer durations, temporal speckle contrast and time-lapse imaging revealed motion of macrophage-like cells (over minutes) and GCL neuron loss and remodeling (over one year). Conclusions: Physiological activity of inner retinal cells is now measurable in the living human eye.

Four-wave mixing of Weyl semimetals in a strong magnetic field.

We theoretically investigate the four-wave mixing process in Weyl semimetals in a strong magnetic field using quantum theory. Weyl semimetals in a strong magnetic field have an extremely high third-order nonlinear optical susceptibility (several orders larger than that of the usual three dimensional materials) originating from the linear energy dispersion near the Weyl points. The third-order response of Weyl semimetal is nearly independent on the Fermi level, which is quite different from the sensitive dependence (on the Fermi level) of the linear response. The unusual polarization dependent selection rules lead to rich nonlinear optical properties, which can be tuned by the polarization of the incident light fields and the magnetic fields.

Cone photoreceptor classification in the living human eye from photostimulation-induced phase dynamics.

Human color vision is achieved by mixing neural signals from cone photoreceptors sensitive to different wavelengths of light. The spatial arrangement and proportion of these spectral types in the retina set fundamental limits on color perception, and abnormal or missing types are responsible for color vision loss. Imaging provides the most direct and quantitative means to study these photoreceptor properties at the cellular scale in the living human retina, but remains challenging. Current methods rely on retinal densitometry to distinguish cone types, a prohibitively slow process. Here, we show that photostimulation-induced optical phase changes occur in cone cells and carry substantial information about spectral type, enabling cones to be differentiated with unprecedented accuracy and efficiency. Moreover, these phase dynamics arise from physiological activity occurring on dramatically different timescales (from milliseconds to seconds) inside the cone outer segment, thus exposing the phototransduction cascade and subsequent downstream effects. We captured these dynamics in cones of subjects with normal color vision and a deuteranope, and at different macular locations by: (i) marrying adaptive optics to phase-sensitive optical coherence tomography to avoid optical blurring of the eye, (ii) acquiring images at high speed that samples phase dynamics at up to 3 KHz, and (iii) localizing phase changes to the cone outer segment, where photoactivation occurs. Our method should have broad appeal for color vision applications in which the underlying neural processing of photoreceptors is sought and for investigations of retinal diseases that affect cone function.

Imaging and quantifying ganglion cells and other transparent neurons in the living human retina.

Ganglion cells (GCs) are fundamental to retinal neural circuitry, processing photoreceptor signals for transmission to the brain via their axons. However, much remains unknown about their role in vision and their vulnerability to disease leading to blindness. A major bottleneck has been our inability to observe GCs and their degeneration in the living human eye. Despite two decades of development of optical technologies to image cells in the living human retina, GCs remain elusive due to their high optical translucency. Failure of conventional imaging-using predominately singly scattered light-to reveal GCs has led to a focus on multiply-scattered, fluorescence, two-photon, and phase imaging techniques to enhance GC contrast. Here, we show that singly scattered light actually carries substantial information that reveals GC somas, axons, and other retinal neurons and permits their quantitative analysis. We perform morphometry on GC layer somas, including projection of GCs onto photoreceptors and identification of the primary GC subtypes, even beneath nerve fibers. We obtained singly scattered images by: (i) marrying adaptive optics to optical coherence tomography to avoid optical blurring of the eye; (ii) performing 3D subcellular image registration to avoid motion blur; and (iii) using organelle motility inside somas as an intrinsic contrast agent. Moreover, through-focus imaging offers the potential to spatially map individual GCs to underlying amacrine, bipolar, horizontal, photoreceptor, and retinal pigment epithelium cells, thus exposing the anatomical substrate for neural processing of visual information. This imaging modality is also a tool for improving clinical diagnosis and assessing treatment of retinal disease.

Tunable Intrinsic Plasmons due to Band Inversion in Topological Materials.

Band inversion has led to rich physical effects in both topological insulators and topological semimetals. It has been found that the inverted band structure with the Mexican-hat dispersion could enhance the interband correlation leading to a strong intrinsic plasmon excitation. Its frequency ranges from several meV to tens of meV and can be effectively tuned by the external fields. The electron-hole asymmetric term splits the peak of the plasmon excitation into double peaks. The fate and properties of this plasmon excitation can also act as a probe to characterize the topological phases even in lightly doped systems. We numerically demonstrate the impact of band inversion on plasmon excitations in magnetically doped thin films of three-dimensional strong topological insulators, V- or Cr-doped (Bi,Sb)_{2}Te_{3}, which support the quantum anomalous Hall states. Our work thus sheds some new light on the potential applications of topological materials in plasmonics.

Photoreceptor disc shedding in the living human eye.

Cone photoreceptors undergo a daily cycle of renewal and shedding of membranous discs in their outer segments (OS), the portion responsible for light capture. These physiological processes are fundamental to maintaining photoreceptor health, and their dysfunction is associated with numerous retinal diseases. While both processes have been extensively studied in animal models and postmortem eyes, little is known about them in the living eye, in particular human. In this study, we report discovery of the optical signature associated with disc shedding using a method based on adaptive optics optical coherence tomography (AO-OCT) in conjunction with post-processing methods to track and monitor individual cone cells in 4D. The optical signature of disc shedding is characterized by an abrupt transient loss in the cone outer segment tip (COST) reflection followed by its return that is axially displaced anteriorly. Using this signature, we measured the temporal and spatial properties of shedding events in three normal subjects. Average duration of the shedding event was 8.8 ± 13.4 minutes, and average length loss of the OS was 2.1 µm (7.0% of OS length). Prevalence of cone shedding was highest in the morning (14.3%) followed by the afternoon (5.7%) and evening (4.0%), with load distributed across the imaged patch. To the best of our knowledge these are the first images of photoreceptor disc shedding in the living retina.

SAR Ground Moving Target Indication Based on Relative Residue of DPCA Processing.

For modern synthetic aperture radar (SAR), it has much more urgent demands on ground moving target indication (GMTI), which includes not only the point moving targets like cars, truck or tanks but also the distributed moving targets like river or ocean surfaces. Among the existing GMTI methods, displaced phase center antenna (DPCA) can effectively cancel the strong ground clutter and has been widely used. However, its detection performance is closely related to the target's signal-to-clutter ratio (SCR) as well as radial velocity, and it cannot effectively detect the weak large-sized river surfaces in strong ground clutter due to their low SCR caused by specular scattering. This paper proposes a novel method called relative residue of DPCA (RR-DPCA), which jointly utilizes the DPCA cancellation outputs and the multi-look images to improve the detection performance of weak river surfaces. Furthermore, based on the statistics analysis of the RR-DPCA outputs on the homogenous background, the cell average (CA) method can be well applied for subsequent constant false alarm rate (CFAR) detection. The proposed RR-DPCA method can well detect the point moving targets and distributed moving targets simultaneously. Finally, the results of both simulated and real data are provided to demonstrate the effectiveness of the proposed SAR/GMTI method.