A Whole-Brain Topographic Ontology.

It is a common view that the intricate array of specialized domains in the ventral visual pathway is innately prespecified. What this review postulates is that it is not. We explore the origins of domain specificity, hypothesizing that the adult brain emerges from an interplay between a domain-general map-based architecture, shaped by intrinsic mechanisms, and experience. We argue that the most fundamental innate organization of cortex in general, and not just the visual pathway, is a map-based topography that governs how the environment maps onto the brain, how brain areas interconnect, and ultimately, how the brain processes information.

Development of the Binocular Circuit.

Seeing in three dimensions is a major property of the visual system in mammals. The circuit underlying this property begins in the retina, from which retinal ganglion cells (RGCs) extend to the same or opposite side of the brain. RGC axons decussate to form the optic chiasm, then grow to targets in the thalamus and midbrain, where they synapse with neurons that project to the visual cortex. Here we review the cellular and molecular mechanisms of RGC axonal growth cone guidance across or away from the midline via receptors to cues in the midline environment. We present new views on the specification of ipsi- and contralateral RGC subpopulations and factors implementing their organization in the optic tract and termination in subregions of their targets. Lastly, we describe the functional and behavioral aspects of binocular vision, focusing on the mouse, and discuss recent discoveries in the evolution of the binocular circuit.

The Visual Systems of Zebrafish.

The zebrafish visual system has become a paradigmatic preparation for behavioral and systems neuroscience. Around 40 types of retinal ganglion cells (RGCs) serve as matched filters for stimulus features, including light, optic flow, prey, and objects on a collision course. RGCs distribute their signals via axon collaterals to 12 retinorecipient areas in forebrain and midbrain. The major visuomotor hub, the optic tectum, harbors nine RGC input layers that combine information on multiple features. The retinotopic map in the tectum is locally adapted to visual scene statistics and visual subfield-specific behavioral demands. Tectal projections to premotor centers are topographically organized according to behavioral commands. The known connectivity in more than 20 processing streams allows us to dissect the cellular basis of elementary perceptual and cognitive functions. Visually evoked responses, such as prey capture or loom avoidance, are controlled by dedicated multistation pathways that-at least in the larva-resemble labeled lines. This architecture serves the neuronal code's purpose of driving adaptive behavior.

How Flies See Motion.

How neurons detect the direction of motion is a prime example of neural computation: Motion vision is found in the visual systems of virtually all sighted animals, it is important for survival, and it requires interesting computations with well-defined linear and nonlinear processing steps-yet the whole process is of moderate complexity. The genetic methods available in the fruit fly Drosophila and the charting of a connectome of its visual system have led to rapid progress and unprecedented detail in our understanding of how neurons compute the direction of motion in this organism. The picture that emerged incorporates not only the identity, morphology, and synaptic connectivity of each neuron involved but also its neurotransmitters, its receptors, and their subcellular localization. Together with the neurons' membrane potential responses to visual stimulation, this information provides the basis for a biophysically realistic model of the circuit that computes the direction of visual motion.

Integration of Feedforward and Feedback Information Streams in the Modular Architecture of Mouse Visual Cortex.

Radial cell columns are a hallmark feature of cortical architecture in many mammalian species. It has long been held, based on the lack of orientation columns, that such functional units are absent in rodent primary visual cortex (V1). These observations led to the view that rodent visual cortex has a fundamentally different network architecture than that of carnivores and primates. While columns may be lacking in rodent V1, we describe in this review that modular clusters of inputs to layer 1 and projection neurons in the layers below are prominent features of the mouse visual cortex. We propose that modules organize thalamocortical inputs, intracortical processing streams, and transthalamic communications that underlie distinct sensory and sensorimotor functions.

Response sub-additivity and variability quenching in visual cortex.

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Cortico-cortical feedback engages active dendrites in visual cortex.

Sensory processing in the neocortex requires both feedforward and feedback information flow between cortical areas1. In feedback processing, higher-level representations provide contextual information to lower levels, and facilitate perceptual functions such as contour integration and figure-ground segmentation2,3. However, we have limited understanding of the circuit and cellular mechanisms that mediate feedback influence. Here we use long-range all-optical connectivity mapping in mice to show that feedback influence from the lateromedial higher visual area (LM) to the primary visual cortex (V1) is spatially organized. When the source and target of feedback represent the same area of visual space, feedback is relatively suppressive. By contrast, when the source is offset from the target in visual space, feedback is relatively facilitating. Two-photon calcium imaging data show that this facilitating feedback is nonlinearly integrated in the apical tuft dendrites of V1 pyramidal neurons: retinotopically offset (surround) visual stimuli drive local dendritic calcium signals indicative of regenerative events, and two-photon optogenetic activation of LM neurons projecting to identified feedback-recipient spines in V1 can drive similar branch-specific local calcium signals. Our results show how neocortical feedback connectivity and nonlinear dendritic integration can together form a substrate to support both predictive and cooperative contextual interactions.

Motion detection: neuronal circuit meets theory.

Motion detection in fly vision has been investigated experimentally and theoretically for half of a century, yet mechanistic insights into the neuronal computation have only started to emerge. In a recent issue of Nature, two studies provide major insights into how motion direction is extracted from the image flow projected onto the retina.

Modular strategy for development of the hierarchical visual network in mice.

Hierarchical and parallel networks are fundamental structures of the mammalian brain1-8. During development, lower- and higher-order thalamic nuclei and many cortical areas in the visual system form interareal connections and build hierarchical dorsal and ventral streams9-13. One hypothesis for the development of visual network wiring involves a sequential strategy wherein neural connections are sequentially formed alongside hierarchical structures from lower to higher areas14-17. However, this sequential strategy would be inefficient for building the entire visual network comprising numerous interareal connections. We show that neural pathways from the mouse retina to primary visual cortex (V1) or dorsal/ventral higher visual areas (HVAs) through lower- or higher-order thalamic nuclei form as parallel modules before corticocortical connections. Subsequently, corticocortical connections among V1 and HVAs emerge to combine these modules. Retina-derived activity propagating the initial parallel modules is necessary to establish retinotopic inter-module connections. Thus, the visual network develops in a modular manner involving initial establishment of parallel modules and their subsequent concatenation. Findings in this study raise the possibility that parallel modules from higher-order thalamic nuclei to HVAs act as templates for cortical ventral and dorsal streams and suggest that the brain has an efficient strategy for the development of a hierarchical network comprising numerous areas.

Visual recognition of social signals by a tectothalamic neural circuit.

Social affiliation emerges from individual-level behavioural rules that are driven by conspecific signals1-5. Long-distance attraction and short-distance repulsion, for example, are rules that jointly set a preferred interanimal distance in swarms6-8. However, little is known about their perceptual mechanisms and executive neural circuits3. Here we trace the neuronal response to self-like biological motion9,10, a visual trigger for affiliation in developing zebrafish2,11. Unbiased activity mapping and targeted volumetric two-photon calcium imaging revealed 21 activity hotspots distributed throughout the brain as well as clustered biological-motion-tuned neurons in a multimodal, socially activated nucleus of the dorsal thalamus. Individual dorsal thalamus neurons encode local acceleration of visual stimuli mimicking typical fish kinetics but are insensitive to global or continuous motion. Electron microscopic reconstruction of dorsal thalamus neurons revealed synaptic input from the optic tectum and projections into hypothalamic areas with conserved social function12-14. Ablation of the optic tectum or dorsal thalamus selectively disrupted social attraction without affecting short-distance repulsion. This tectothalamic pathway thus serves visual recognition of conspecifics, and dissociates neuronal control of attraction from repulsion during social affiliation, revealing a circuit underpinning collective behaviour.

Spiking activity in the visual thalamus is coupled to pupil dynamics across temporal scales.

The processing of sensory information, even at early stages, is influenced by the internal state of the animal. Internal states, such as arousal, are often characterized by relating neural activity to a single "level" of arousal, defined by a behavioral indicator such as pupil size. In this study, we expand the understanding of arousal-related modulations in sensory systems by uncovering multiple timescales of pupil dynamics and their relationship to neural activity. Specifically, we observed a robust coupling between spiking activity in the mouse dorsolateral geniculate nucleus (dLGN) of the thalamus and pupil dynamics across timescales spanning a few seconds to several minutes. Throughout all these timescales, 2 distinct spiking modes-individual tonic spikes and tightly clustered bursts of spikes-preferred opposite phases of pupil dynamics. This multi-scale coupling reveals modulations distinct from those captured by pupil size per se, locomotion, and eye movements. Furthermore, coupling persisted even during viewing of a naturalistic movie, where it contributed to differences in the encoding of visual information. We conclude that dLGN spiking activity is under the simultaneous influence of multiple arousal-related processes associated with pupil dynamics occurring over a broad range of timescales.

Human subcortical pathways automatically detect collision trajectory without attention and awareness.

Detecting imminent collisions is essential for survival. Here, we used high-resolution fMRI at 7 Tesla to investigate the role of attention and consciousness for detecting collision trajectory in human subcortical pathways. Healthy participants can precisely discriminate collision from near-miss trajectory of an approaching object, with pupil size change reflecting collision sensitivity. Subcortical pathways from the superior colliculus (SC) to the ventromedial pulvinar (vmPul) and ventral tegmental area (VTA) exhibited collision-sensitive responses even when participants were not paying attention to the looming stimuli. For hemianopic patients with unilateral lesions of the geniculostriate pathway, the ipsilesional SC and VTA showed significant activation to collision stimuli in their scotoma. Furthermore, stronger SC responses predicted better behavioral performance in collision detection even in the absence of awareness. Therefore, human tectofugal pathways could automatically detect collision trajectories without the observers' attention to and awareness of looming stimuli, supporting "blindsight" detection of impending visual threats.

Predation without direction selectivity.

Across the animal kingdom, visual predation relies on motion-sensing neurons in the superior colliculus (SC) and its orthologs. These neurons exhibit complex stimulus preferences, including direction selectivity, which is thought to be critical for tracking the unpredictable escape routes of prey. The source of direction selectivity in the SC is contested, and its contributions to predation have not been tested experimentally. Here, we use type-specific cell removal to show that narrow-field (NF) neurons in the mouse SC guide predation. In vivo recordings demonstrate that direction-selective responses of NF cells are independent of recently reported stimulus-edge effects. Monosynaptic retrograde tracing reveals that NF cells receive synaptic input from direction-selective ganglion cells. When we eliminate direction selectivity in the retina of adult mice, direction-selective responses in the SC, including in NF cells, are lost. However, eliminating retinal direction selectivity does not affect the hunting success or strategies of mice, even when direction selectivity is removed after mice have learned to hunt, and despite abolishing the gaze-stabilizing optokinetic reflex. Thus, our results identify the retinal source of direction selectivity in the SC. They show that NF cells in the SC guide predation, an essential spatial orienting task, independent of their direction selectivity, revealing behavioral multiplexing of complex neural feature preferences and highlighting the importance of feature-selective manipulations for neuroethology.

On the relationship between maps and domains in inferotemporal cortex.

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

Complexity Matters: Normalization to Prototypical Viewpoint Induces Memory Distortion along the Vertical Axis of Scenes.

Scene memory is prone to systematic distortions potentially arising from experience with the external world. Boundary transformation, a well-known memory distortion effect along the near-far axis of the three-dimensional space, represents the observer's erroneous recall of scenes' viewing distance. Researchers argued that normalization to the prototypical viewpoint with the high-probability viewing distance influenced this phenomenon. Herein, we hypothesized that the prototypical viewpoint also exists in the vertical angle of view (AOV) dimension and could cause memory distortion along scenes' vertical axis. Human subjects of both sexes were recruited to test this hypothesis, and two behavioral experiments were conducted, revealing a systematic memory distortion in the vertical AOV in both the forced choice (n = 79) and free adjustment (n = 30) tasks. Furthermore, the regression analysis implied that the complexity information asymmetry in scenes' vertical axis and the independent subjective AOV ratings from a large set of online participants (n = 1,208) could jointly predict AOV biases. Furthermore, in a functional magnetic resonance imaging experiment (n = 24), we demonstrated the involvement of areas in the ventral visual pathway (V3/V4, PPA, and OPA) in AOV bias judgment. Additionally, in a magnetoencephalography experiment (n = 20), we could significantly decode the subjects' AOV bias judgments ∼140 ms after scene onset and the low-level visual complexity information around the similar temporal interval. These findings suggest that AOV bias is driven by the normalization process and associated with the neural activities in the early stage of scene processing.

Transformation of Motion Pattern Selectivity from Retina to Superior Colliculus.

The superior colliculus (SC) is a prominent and conserved visual center in all vertebrates. In mice, the most superficial lamina of the SC is enriched with neurons that are selective for the moving direction of visual stimuli. Here, we study how these direction selective neurons respond to complex motion patterns known as plaids, using two-photon calcium imaging in awake male and female mice. The plaid pattern consists of two superimposed sinusoidal gratings moving in different directions, giving an apparent pattern direction that lies between the directions of the two component gratings. Most direction selective neurons in the mouse SC respond robustly to the plaids and show a high selectivity for the moving direction of the plaid pattern but not of its components. Pattern motion selectivity is seen in both excitatory and inhibitory SC neurons and is especially prevalent in response to plaids with large cross angles between the two component gratings. However, retinal inputs to the SC are ambiguous in their selectivity to pattern versus component motion. Modeling suggests that pattern motion selectivity in the SC can arise from a nonlinear transformation of converging retinal inputs. In contrast, the prevalence of pattern motion selective neurons is not seen in the primary visual cortex (V1). These results demonstrate an interesting difference between the SC and V1 in motion processing and reveal the SC as an important site for encoding pattern motion.

Visual Deprivation during Mouse Critical Period Reorganizes Network-Level Functional Connectivity.

A classic example of experience-dependent plasticity is ocular dominance (OD) shift, in which the responsiveness of neurons in the visual cortex is profoundly altered following monocular deprivation (MD). It has been postulated that OD shifts also modify global neural networks, but such effects have never been demonstrated. Here, we use wide-field fluorescence optical imaging (WFOI) to characterize calcium-based resting-state functional connectivity during acute (3 d) MD in female and male mice with genetically encoded calcium indicators (Thy1-GCaMP6f). We first establish the fundamental performance of WFOI by computing signal to noise properties throughout our data processing pipeline. Following MD, we found that Δ band (0.4-4 Hz) GCaMP6 activity in the deprived visual cortex decreased, suggesting that excitatory activity in this region was reduced by MD. In addition, interhemispheric visual homotopic functional connectivity decreased following MD, which was accompanied by a reduction in parietal and motor homotopic connectivity. Finally, we observed enhanced internetwork connectivity between the visual and parietal cortex that peaked 2 d after MD. Together, these findings support the hypothesis that early MD induces dynamic reorganization of disparate functional networks including the association cortices.

Differential Expression Analysis Identifies Candidate Synaptogenic Molecules for Wiring Direction-Selective Circuits in the Retina.

An organizational feature of neural circuits is the specificity of synaptic connections. A striking example is the direction-selective (DS) circuit of the retina. There are multiple subtypes of DS retinal ganglion cells (DSGCs) that prefer motion along one of four preferred directions. This computation is mediated by selective wiring of a single inhibitory interneuron, the starburst amacrine cell (SAC), with each DSGC subtype preferentially receiving input from a subset of SAC processes. We hypothesize that the molecular basis of this wiring is mediated in part by unique expression profiles of DSGC subtypes. To test this, we first performed paired recordings from isolated mouse retinas of both sexes to determine that postnatal day 10 (P10) represents the age at which asymmetric synapses form. Second, we performed RNA sequencing and differential expression analysis on isolated P10 ON-OFF DSGCs tuned for either nasal or ventral motion and identified candidates which may promote direction-specific wiring. We then used a conditional knock-out strategy to test the role of one candidate, the secreted synaptic organizer cerebellin-4 (Cbln4), in the development of DS tuning. Using two-photon calcium imaging, we observed a small deficit in directional tuning among ventral-preferring DSGCs lacking Cbln4, though whole-cell voltage-clamp recordings did not identify a significant change in inhibitory inputs. This suggests that Cbln4 does not function primarily via a cell-autonomous mechanism to instruct wiring of DS circuits. Nevertheless, our transcriptomic analysis identified unique candidate factors for gaining insights into the molecular mechanisms that instruct wiring specificity in the DS circuit.

Temporal Sensitivity for Achromatic and Chromatic Flicker across the Visual Cortex.

The retinal ganglion cells (RGCs) receive different combinations of L, M, and S cone inputs and give rise to one achromatic and two chromatic postreceptoral channels. The goal of the current study was to determine temporal sensitivity across the three postreceptoral channels in subcortical and cortical regions involved in human vision. We measured functional magnetic resonance imaging (fMRI) responses at 7 T from three participants (two males, one female) viewing a high-contrast, flickering, spatially uniform wide field (∼140°). Stimulus flicker frequency varied logarithmically between 2 and 64 Hz and targeted the L + M + S, L - M, and S - (L + M) cone combinations. These measurements were used to create temporal sensitivity functions of the primary visual cortex (V1) across eccentricity and spatially averaged responses from the lateral geniculate nucleus (LGN), and the V2/V3, hV4, and V3A/B regions. fMRI responses reflected the known properties of the visual system, including higher peak temporal sensitivity to achromatic versus chromatic stimuli and low-pass filtering between the LGN and V1. Peak temporal sensitivity increased across levels of the cortical visual hierarchy. Unexpectedly, peak temporal sensitivity varied little across eccentricity within area V1. Measures of adaptation and distributed pattern activity revealed a subtle influence of 64 Hz achromatic flicker in area V1, despite this stimulus evoking only a minimal overall response. The comparison of measured cortical responses to a model of the integrated retinal output to our stimuli demonstrates that extensive filtering and amplification are applied to postretinal signals.

Visual Corticotectal Neurons in Awake Rabbits: Receptive Fields and Driving Monosynaptic Thalamocortical Inputs.

The superior colliculus receives powerful synaptic inputs from corticotectal neurons in the visual cortex. The function of these corticotectal neurons remains largely unknown due to a limited understanding of their response properties and connectivity. Here, we use antidromic methods to identify corticotectal neurons in awake male and female rabbits, and measure their axonal conduction times, thalamic inputs and receptive field properties. All corticotectal neurons responded to sinusoidal drifting gratings with a nonlinear (nonsinusoidal) increase in mean firing rate but showed pronounced differences in their ON-OFF receptive field structures that we classified into three groups, Cx, S2, and S1. Cx receptive fields had highly overlapping ON and OFF subfields as classical complex cells, S2 had largely separated ON and OFF subfields as classical simple cells, and S1 had a single ON or OFF subfield. Thus, all corticotectal neurons are homogeneous in their nonlinear spatial summation but very heterogeneous in their spatial integration of ON and OFF inputs. The Cx type had the fastest conducting axons, the highest spontaneous activity, and the strongest and fastest visual responses. The S2 type had the highest orientation selectivity, and the S1 type had the slowest conducting axons. Moreover, our cross-correlation analyses found that a subpopulation of corticotectal neurons with very fast conducting axons and high spontaneous firing rates (largely "Cx" type) receives monosynaptic input from retinotopically aligned thalamic neurons. This previously unrecognized fast-conducting thalamic-mediated corticotectal pathway may provide specialized information to superior colliculus and prime recipient neurons for subsequent corticotectal or retinal synaptic input.