Dynamic Stimulation of Visual Cortex Produces Form Vision in Sighted and Blind Humans.

A visual cortical prosthesis (VCP) has long been proposed as a strategy for restoring useful vision to the blind, under the assumption that visual percepts of small spots of light produced with electrical stimulation of visual cortex (phosphenes) will combine into coherent percepts of visual forms, like pixels on a video screen. We tested an alternative strategy in which shapes were traced on the surface of visual cortex by stimulating electrodes in dynamic sequence. In both sighted and blind participants, dynamic stimulation enabled accurate recognition of letter shapes predicted by the brain's spatial map of the visual world. Forms were presented and recognized rapidly by blind participants, up to 86 forms per minute. These findings demonstrate that a brain prosthetic can produce coherent percepts of visual forms.

Mammalian Near-Infrared Image Vision through Injectable and Self-Powered Retinal Nanoantennae.

Mammals cannot see light over 700 nm in wavelength. This limitation is due to the physical thermodynamic properties of the photon-detecting opsins. However, the detection of naturally invisible near-infrared (NIR) light is a desirable ability. To break this limitation, we developed ocular injectable photoreceptor-binding upconversion nanoparticles (pbUCNPs). These nanoparticles anchored on retinal photoreceptors as miniature NIR light transducers to create NIR light image vision with negligible side effects. Based on single-photoreceptor recordings, electroretinograms, cortical recordings, and visual behavioral tests, we demonstrated that mice with these nanoantennae could not only perceive NIR light, but also see NIR light patterns. Excitingly, the injected mice were also able to differentiate sophisticated NIR shape patterns. Moreover, the NIR light pattern vision was ambient-daylight compatible and existed in parallel with native daylight vision. This new method will provide unmatched opportunities for a wide variety of emerging bio-integrated nanodevice designs and applications. VIDEO ABSTRACT.

Visual Projection Neurons Mediating Directed Courtship in Drosophila.

Many animals rely on vision to detect, locate, and track moving objects. In Drosophila courtship, males primarily use visual cues to orient toward and follow females and to select the ipsilateral wing for courtship song. Here, we show that the LC10 visual projection neurons convey essential visual information during courtship. Males with LC10 neurons silenced are unable to orient toward or maintain proximity to the female and do not predominantly use the ipsilateral wing when singing. LC10 neurons preferentially respond to small moving objects using an antagonistic motion-based center-surround mechanism. Unilateral activation of LC10 neurons recapitulates the orienting and ipsilateral wing extension normally elicited by females, and the potency with which LC10 induces wing extension is enhanced in a state of courtship arousal controlled by male-specific P1 neurons. These data suggest that LC10 is a major pathway relaying visual input to the courtship circuits in the male brain.

Light Affects Mood and Learning through Distinct Retina-Brain Pathways.

Light exerts a range of powerful biological effects beyond image vision, including mood and learning regulation. While the source of photic information affecting mood and cognitive functions is well established, viz. intrinsically photosensitive retinal ganglion cells (ipRGCs), the central mediators are unknown. Here, we reveal that the direct effects of light on learning and mood utilize distinct ipRGC output streams. ipRGCs that project to the suprachiasmatic nucleus (SCN) mediate the effects of light on learning, independently of the SCN's pacemaker function. Mood regulation by light, on the other hand, requires an SCN-independent pathway linking ipRGCs to a previously unrecognized thalamic region, termed perihabenular nucleus (PHb). The PHb is integrated in a distinctive circuitry with mood-regulating centers and is both necessary and sufficient for driving the effects of light on affective behavior. Together, these results provide new insights into the neural basis required for light to influence mood and learning.

Ultrafast structural changes direct the first molecular events of vision.

Vision is initiated by the rhodopsin family of light-sensitive G protein-coupled receptors (GPCRs)1. A photon is absorbed by the 11-cis retinal chromophore of rhodopsin, which isomerizes within 200 femtoseconds to the all-trans conformation2, thereby initiating the cellular signal transduction processes that ultimately lead to vision. However, the intramolecular mechanism by which the photoactivated retinal induces the activation events inside rhodopsin remains experimentally unclear. Here we use ultrafast time-resolved crystallography at room temperature3 to determine how an isomerized twisted all-trans retinal stores the photon energy that is required to initiate the protein conformational changes associated with the formation of the G protein-binding signalling state. The distorted retinal at a 1-ps time delay after photoactivation has pulled away from half of its numerous interactions with its binding pocket, and the excess of the photon energy is released through an anisotropic protein breathing motion in the direction of the extracellular space. Notably, the very early structural motions in the protein side chains of rhodopsin appear in regions that are involved in later stages of the conserved class A GPCR activation mechanism. Our study sheds light on the earliest stages of vision in vertebrates and points to fundamental aspects of the molecular mechanisms of agonist-mediated GPCR activation.

Evolution of neuronal cell classes and types in the vertebrate retina.

The basic plan of the retina is conserved across vertebrates, yet species differ profoundly in their visual needs1. Retinal cell types may have evolved to accommodate these varied needs, but this has not been systematically studied. Here we generated and integrated single-cell transcriptomic atlases of the retina from 17 species: humans, two non-human primates, four rodents, three ungulates, opossum, ferret, tree shrew, a bird, a reptile, a teleost fish and a lamprey. We found high molecular conservation of the six retinal cell classes (photoreceptors, horizontal cells, bipolar cells, amacrine cells, retinal ganglion cells (RGCs) and Müller glia), with transcriptomic variation across species related to evolutionary distance. Major subclasses were also conserved, whereas variation among cell types within classes or subclasses was more pronounced. However, an integrative analysis revealed that numerous cell types are shared across species, based on conserved gene expression programmes that are likely to trace back to an early ancestral vertebrate. The degree of variation among cell types increased from the outer retina (photoreceptors) to the inner retina (RGCs), suggesting that evolution acts preferentially to shape the retinal output. Finally, we identified rodent orthologues of midget RGCs, which comprise more than 80% of RGCs in the human retina, subserve high-acuity vision, and were previously believed to be restricted to primates2. By contrast, the mouse orthologues have large receptive fields and comprise around 2% of mouse RGCs. Projections of both primate and mouse orthologous types are overrepresented in the thalamus, which supplies the primary visual cortex. We suggest that midget RGCs are not primate innovations, but are descendants of evolutionarily ancient types that decreased in size and increased in number as primates evolved, thereby facilitating high visual acuity and increased cortical processing of visual information.

Muscles that move the retina augment compound eye vision in Drosophila.

Most animals have compound eyes, with tens to thousands of lenses attached rigidly to the exoskeleton. A natural assumption is that all of these species must resort to moving either their head or their body to actively change their visual input. However, classic anatomy has revealed that flies have muscles poised to move their retinas under the stable lenses of each compound eye1-3. Here we show that Drosophila use their retinal muscles to smoothly track visual motion, which helps to stabilize the retinal image, and also to perform small saccades when viewing a stationary scene. We show that when the retina moves, visual receptive fields shift accordingly, and that even the smallest retinal saccades activate visual neurons. Using a head-fixed behavioural paradigm, we find that Drosophila perform binocular, vergence movements of their retinas-which could enhance depth perception-when crossing gaps, and impairing the physiology of retinal motor neurons alters gap-crossing trajectories during free behaviour. That flies evolved an ability to actuate their retinas suggests that moving the eye independently of the head is broadly paramount for animals. The similarities of smooth and saccadic movements of the Drosophila retina and the vertebrate eye highlight a notable example of convergent evolution.

State-dependent pupil dilation rapidly shifts visual feature selectivity.

To increase computational flexibility, the processing of sensory inputs changes with behavioural context. In the visual system, active behavioural states characterized by motor activity and pupil dilation1,2 enhance sensory responses, but typically leave the preferred stimuli of neurons unchanged2-9. Here we find that behavioural state also modulates stimulus selectivity in the mouse visual cortex in the context of coloured natural scenes. Using population imaging in behaving mice, pharmacology and deep neural network modelling, we identified a rapid shift in colour selectivity towards ultraviolet stimuli during an active behavioural state. This was exclusively caused by state-dependent pupil dilation, which resulted in a dynamic switch from rod to cone photoreceptors, thereby extending their role beyond night and day vision. The change in tuning facilitated the decoding of ethological stimuli, such as aerial predators against the twilight sky10. For decades, studies in neuroscience and cognitive science have used pupil dilation as an indirect measure of brain state. Our data suggest that, in addition, state-dependent pupil dilation itself tunes visual representations to behavioural demands by differentially recruiting rods and cones on fast timescales.

Probing Computation in the Primate Visual System at Single-Cone Resolution.

Daylight vision begins when light activates cone photoreceptors in the retina, creating spatial patterns of neural activity. These cone signals are then combined and processed in downstream neural circuits, ultimately producing visual perception. Recent technical advances have made it possible to deliver visual stimuli to the retina that probe this processing by the visual system at its elementary resolution of individual cones. Physiological recordings from nonhuman primate retinas reveal the spatial organization of cone signals in retinal ganglion cells, including how signals from cones of different types are combined to support both spatial and color vision. Psychophysical experiments with human subjects characterize the visual sensations evoked by stimulating a single cone, including the perception of color. Future combined physiological and psychophysical experiments focusing on probing the elementary visual inputs are likely to clarify how neural processing generates our perception of the visual world.

Reprogramming to recover youthful epigenetic information and restore vision.

Ageing is a degenerative process that leads to tissue dysfunction and death. A proposed cause of ageing is the accumulation of epigenetic noise that disrupts gene expression patterns, leading to decreases in tissue function and regenerative capacity1-3. Changes to DNA methylation patterns over time form the basis of ageing clocks4, but whether older individuals retain the information needed to restore these patterns-and, if so, whether this could improve tissue function-is not known. Over time, the central nervous system (CNS) loses function and regenerative capacity5-7. Using the eye as a model CNS tissue, here we show that ectopic expression of Oct4 (also known as Pou5f1), Sox2 and Klf4 genes (OSK) in mouse retinal ganglion cells restores youthful DNA methylation patterns and transcriptomes, promotes axon regeneration after injury, and reverses vision loss in a mouse model of glaucoma and in aged mice. The beneficial effects of OSK-induced reprogramming in axon regeneration and vision require the DNA demethylases TET1 and TET2. These data indicate that mammalian tissues retain a record of youthful epigenetic information-encoded in part by DNA methylation-that can be accessed to improve tissue function and promote regeneration in vivo.

Pharmacologic fibroblast reprogramming into photoreceptors restores vision.

Photoreceptor loss is the final common endpoint in most retinopathies that lead to irreversible blindness, and there are no effective treatments to restore vision1,2. Chemical reprogramming of fibroblasts offers an opportunity to reverse vision loss; however, the generation of sensory neuronal subtypes such as photoreceptors remains a challenge. Here we report that the administration of a set of five small molecules can chemically induce the transformation of fibroblasts into rod photoreceptor-like cells. The transplantation of these chemically induced photoreceptor-like cells (CiPCs) into the subretinal space of rod degeneration mice (homozygous for rd1, also known as Pde6b) leads to partial restoration of the pupil reflex and visual function. We show that mitonuclear communication is a key determining factor for the reprogramming of fibroblasts into CiPCs. Specifically, treatment with these five compounds leads to the translocation of AXIN2 to the mitochondria, which results in the production of reactive oxygen species, the activation of NF-κB and the upregulation of Ascl1. We anticipate that CiPCs could have therapeutic potential for restoring vision.

Looking across the gap: Understanding the evolution of eyes and vision among insects.

The compound eyes of insects exhibit stunning variation in size, structure, and function, which has allowed these animals to use their vision to adapt to a huge range of different environments and lifestyles, and evolve complex behaviors. Much of our knowledge of eye development has been learned from Drosophila, while visual adaptations and behaviors are often more striking and better understood from studies of other insects. However, recent studies in Drosophila and other insects, including bees, beetles, and butterflies, have begun to address this gap by revealing the genetic and developmental bases of differences in eye morphology and key new aspects of compound eye structure and function. Furthermore, technical advances have facilitated the generation of high-resolution connectomic data from different insect species that enhances our understanding of visual information processing, and the impact of changes in these processes on the evolution of vision and behavior. Here, we review these recent breakthroughs and propose that future integrated research from the development to function of visual systems within and among insect species represents a great opportunity to understand the remarkable diversification of insect eyes and vision.

Ablation of Fatty Acid Transport Protein-4 Enhances Cone Survival, M-cone Vision, and Synthesis of Cone-Tropic 9-cis-Retinal in rd12 Mouse Model of Leber Congenital Amaurosis.

The canonical visual cycle employing RPE65 as the retinoid isomerase regenerates 11-cis-retinal to support both rod- and cone-mediated vision. Mutations of RPE65 are associated with Leber congenital amaurosis that results in rod and cone photoreceptor degeneration and vision loss of affected patients at an early age. Dark-reared Rpe65-/- mouse has been known to form isorhodopsin that employs 9-cis-retinal as the photosensitive chromophore. The mechanism regulating 9-cis-retinal synthesis and the role of the endogenous 9-cis-retinal in cone survival and function remain largely unknown. In this study, we found that ablation of fatty acid transport protein-4 (FATP4), a negative regulator of 11-cis-retinol synthesis catalyzed by RPE65, increased the formation of 9-cis-retinal, but not 11-cis-retinal, in a light-independent mechanism in both sexes of RPE65-null rd12 mice. Both rd12 and rd12;Fatp4-/- mice contained a massive amount of all-trans-retinyl esters in the eyes, exhibiting comparable scotopic vision and rod degeneration. However, expression levels of M- and S-opsins as well as numbers of M- and S-cones surviving in the superior retinas of rd12;Fatp4-/ - mice were at least twofold greater than those in age-matched rd12 mice. Moreover, FATP4 deficiency significantly shortened photopic b-wave implicit time, improved M-cone visual function, and substantially deaccelerated the progression of cone degeneration in rd12 mice, whereas FATP4 deficiency in mice with wild-type Rpe65 alleles neither induced 9-cis-retinal formation nor influenced cone survival and function. These results identify FATP4 as a new regulator of synthesis of 9-cis-retinal, which is a "cone-tropic" chromophore supporting cone survival and function in the retinas with defective RPE65.

Tadpoles rely on mechanosensory stimuli for communication when visual capabilities are poor.

The ways in which animals sense the world changes throughout development. For example, young of many species have limited visual capabilities, but still make social decisions, likely based on information gathered through other sensory modalities. Poison frog tadpoles display complex social behaviors that have been suggested to rely on vision despite a century of research indicating tadpoles have poorly-developed visual systems relative to adults. Alternatively, other sensory modalities, such as the lateral line system, are functional at hatching in frogs and may guide social decisions while other sensory systems mature. Here, we examined development of the mechanosensory lateral line and visual systems in tadpoles of the mimic poison frog (Ranitomeya imitator) that use vibrational begging displays to stimulate egg feeding from their mothers. We found that tadpoles hatch with a fully developed lateral line system. While begging behavior increases with development, ablating the lateral line system inhibited begging in pre-metamorphic tadpoles, but not in metamorphic tadpoles. We also found that the increase in begging and decrease in reliance on the lateral line co-occurs with increased retinal neural activity and gene expression associated with eye development. Using the neural tracer neurobiotin, we found that axonal innervations from the eye to the brain proliferate during metamorphosis, with few retinotectal connections in recently-hatched tadpoles. We then tested visual function in a phototaxis assay and found tadpoles prefer darker environments. The strength of this preference increased with developmental stage, but eyes were not required for this behavior, possibly indicating a role for the pineal gland. Together, these data suggest that tadpoles rely on different sensory modalities for social interactions across development and that the development of sensory systems in socially complex poison frog tadpoles is similar to that of other frog species.

Architecture, Function, and Assembly of the Mouse Visual System.

Vision is the sense humans rely on most to navigate the world, make decisions, and perform complex tasks. Understanding how humans see thus represents one of the most fundamental and important goals of neuroscience. The use of the mouse as a model for parsing how vision works at a fundamental level started approximately a decade ago, ushered in by the mouse's convenient size, relatively low cost, and, above all, amenability to genetic perturbations. In the course of that effort, a large cadre of new and powerful tools for in vivo labeling, monitoring, and manipulation of neurons were applied to this species. As a consequence, a significant body of work now exists on the architecture, function, and development of mouse central visual pathways. Excitingly, much of that work includes causal testing of the role of specific cell types and circuits in visual perception and behavior-something rare to find in studies of the visual system of other species. Indeed, one could argue that more information is now available about the mouse visual system than any other sensory system, in any species, including humans. As such, the mouse visual system has become a platform for multilevel analysis of the mammalian central nervous system generally. Here we review the mouse visual system structure, function, and development literature and comment on the similarities and differences between the visual system of this and other model species. We also make it a point to highlight the aspects of mouse visual circuitry that remain opaque and that are in need of additional experimentation to enrich our understanding of how vision works on a broad scale.

Understanding the retinal basis of vision across species.

The vertebrate retina first evolved some 500 million years ago in ancestral marine chordates. Since then, the eyes of different species have been tuned to best support their unique visuoecological lifestyles. Visual specializations in eye designs, large-scale inhomogeneities across the retinal surface and local circuit motifs mean that all species' retinas are unique. Computational theories, such as the efficient coding hypothesis, have come a long way towards an explanation of the basic features of retinal organization and function; however, they cannot explain the full extent of retinal diversity within and across species. To build a truly general understanding of vertebrate vision and the retina's computational purpose, it is therefore important to more quantitatively relate different species' retinal functions to their specific natural environments and behavioural requirements. Ultimately, the goal of such efforts should be to build up to a more general theory of vision.

Specialization of the photoreceptor transcriptome by Srrm3-dependent microexons is required for outer segment maintenance and vision.

Retinal photoreceptors have a distinct transcriptomic profile compared to other neuronal subtypes, likely reflecting their unique cellular morphology and function in the detection of light stimuli by way of the ciliary outer segment. We discovered a layer of this molecular specialization by revealing that the vertebrate retina expresses the largest number of tissue-enriched microexons of all tissue types. A subset of these microexons is included exclusively in photoreceptor transcripts, particularly in genes involved in cilia biogenesis and vesicle-mediated transport. This microexon program is regulated by Srrm3, a paralog of the neural microexon regulator Srrm4. Despite the fact that both proteins positively regulate retina microexons in vitro, only Srrm3 is highly expressed in mature photoreceptors. Its deletion in zebrafish results in widespread down-regulation of microexon inclusion from early developmental stages, followed by other transcriptomic alterations, severe photoreceptor defects, and blindness. These results shed light on the transcriptomic specialization and functionality of photoreceptors, uncovering unique cell type-specific roles for Srrm3 and microexons with implications for retinal diseases.

Visual object categorization in infancy.

Humans make sense of the world by organizing things into categories. When and how does this process begin? We investigated whether real-world object categories that spontaneously emerge in the first months of life match categorical representations of objects in the human visual cortex. Using eye tracking, we measured the differential looking time of 4-, 10-, and 19-mo-olds as they looked at pairs of pictures belonging to eight animate or inanimate categories (human/nonhuman, faces/bodies, real-world size big/small, natural/artificial). Taking infants' looking times as a measure of similarity, for each age group, we defined a representational space where each object was defined in relation to others of the same or of a different category. This space was compared with hypothesis-based and functional MRI-based models of visual object categorization in the adults' visual cortex. Analyses across different age groups showed that, as infants grow older, their looking behavior matches neural representations in ever-larger portions of the adult visual cortex, suggesting progressive recruitment and integration of more and more feature spaces distributed over the visual cortex. Moreover, the results characterize infants' visual categorization as an incremental process with two milestones. Between 4 and 10 mo, visual exploration guided by saliency gives way to an organization according to the animate-inanimate distinction. Between 10 and 19 mo, a category spurt leads toward a mature organization. We propose that these changes underlie the coupling between seeing and thinking in the developing mind.

Noise-trained deep neural networks effectively predict human vision and its neural responses to challenging images.

Deep neural networks (DNNs) for object classification have been argued to provide the most promising model of the visual system, accompanied by claims that they have attained or even surpassed human-level performance. Here, we evaluated whether DNNs provide a viable model of human vision when tested with challenging noisy images of objects, sometimes presented at the very limits of visibility. We show that popular state-of-the-art DNNs perform in a qualitatively different manner than humans-they are unusually susceptible to spatially uncorrelated white noise and less impaired by spatially correlated noise. We implemented a noise training procedure to determine whether noise-trained DNNs exhibit more robust responses that better match human behavioral and neural performance. We found that noise-trained DNNs provide a better qualitative match to human performance; moreover, they reliably predict human recognition thresholds on an image-by-image basis. Functional neuroimaging revealed that noise-trained DNNs provide a better correspondence to the pattern-specific neural representations found in both early visual areas and high-level object areas. A layer-specific analysis of the DNNs indicated that noise training led to broad-ranging modifications throughout the network, with greater benefits of noise robustness accruing in progressively higher layers. Our findings demonstrate that noise-trained DNNs provide a viable model to account for human behavioral and neural responses to objects in challenging noisy viewing conditions. Further, they suggest that robustness to noise may be acquired through a process of visual learning.

Photophysiological cycles in Arctic krill are entrained by weak midday twilight during the Polar Night.

Light plays a fundamental role in the ecology of organisms in nearly all habitats on Earth and is central for processes such as vision and the entrainment of the circadian clock. The poles represent extreme light regimes with an annual light cycle including periods of Midnight Sun and Polar Night. The Arctic Ocean extends to the North Pole, and marine light extremes reach their maximum extent in this habitat. During the Polar Night, traditional definitions of day and night and seasonal photoperiod become irrelevant since there are only "twilight" periods defined by the sun's elevation below the horizon at midday; we term this "midday twilight." Here, we characterize light across a latitudinal gradient (76.5° N to 81° N) during Polar Night in January. Our light measurements demonstrate that the classical solar diel light cycle dominant at lower latitudes is modulated during Arctic Polar Night by lunar and auroral components. We therefore question whether this particular ambient light environment is relevant to behavioral and visual processes. We reveal from acoustic field observations that the zooplankton community is undergoing diel vertical migration (DVM) behavior. Furthermore, using electroretinogram (ERG) recording under constant darkness, we show that the main migratory species, Arctic krill (Thysanoessa inermis) show endogenous increases in visual sensitivity during the subjective night. This change in sensitivity is comparable to that under exogenous dim light acclimations, although differences in speed of vision suggest separate mechanisms. We conclude that the extremely weak midday twilight experienced by krill at high latitudes during the darkest parts of the year has physiological and ecological relevance.