How Stimulus Statistics Affect the Receptive Fields of Cells in Primary Visual Cortex.

We studied the changes that neuronal receptive field (RF) models undergo when the statistics of the stimulus are changed from those of white Gaussian noise (WGN) to those of natural scenes (NSs), by fitting the models to multielectrode data recorded from primary visual cortex (V1) of female cats. This allowed the estimation of both a cascade of linear filters on the stimulus, as well as the static nonlinearities that map the output of the filters to the neuronal spike rates. We found that cells respond differently to these two classes of stimuli, with mostly higher spike rates and shorter response latencies to NSs than to WGN. The most striking finding was that NSs resulted in RFs that had additional uncovered filters compared with WGN. This finding was not an artifact of the higher spike rates observed for NSs relative to WGN, but rather was related to a change in coding. Our results reveal a greater extent of nonlinear processing in V1 neurons when stimulated using NSs compared with WGN. Our findings indicate the existence of nonlinear mechanisms that endow V1 neurons with context-dependent transmission of visual information.SIGNIFICANCE STATEMENT This study addresses a fundamental question about the concept of the receptive field (RF): does the encoding of information depend on the context or statistical regularities of the stimulus type? We applied state-of-the-art RF modeling techniques to data collected from multielectrode recordings from cat visual cortex in response to two statistically distinct stimulus types: white Gaussian noise and natural scenes. We find significant differences between the RFs that emerge from our data-driven modeling. Natural scenes result in far more complex RFs that combine multiple features in the visual input. Our findings reveal that different regimes or modes of operation are at work in visual cortical processing depending on the information present in the visual input. The complexity of V1 neural coding appears to be dependent on the complexity of the stimulus. We believe this new finding will have interesting implications for our understanding of the efficient transmission of information in sensory systems, which is an integral assumption of many computational theories (e.g., efficient and predictive coding of sensory processing in the brain).

Learning receptive field properties of complex cells in V1.

There are two distinct classes of cells in the primary visual cortex (V1): simple cells and complex cells. One defining feature of complex cells is their spatial phase invariance; they respond strongly to oriented grating stimuli with a preferred orientation but with a wide range of spatial phases. A classical model of complete spatial phase invariance in complex cells is the energy model, in which the responses are the sum of the squared outputs of two linear spatially phase-shifted filters. However, recent experimental studies have shown that complex cells have a diverse range of spatial phase invariance and only a subset can be characterized by the energy model. While several models have been proposed to explain how complex cells could learn to be selective to orientation but invariant to spatial phase, most existing models overlook many biologically important details. We propose a biologically plausible model for complex cells that learns to pool inputs from simple cells based on the presentation of natural scene stimuli. The model is a three-layer network with rate-based neurons that describes the activities of LGN cells (layer 1), V1 simple cells (layer 2), and V1 complex cells (layer 3). The first two layers implement a recently proposed simple cell model that is biologically plausible and accounts for many experimental phenomena. The neural dynamics of the complex cells is modeled as the integration of simple cells inputs along with response normalization. Connections between LGN and simple cells are learned using Hebbian and anti-Hebbian plasticity. Connections between simple and complex cells are learned using a modified version of the Bienenstock, Cooper, and Munro (BCM) rule. Our results demonstrate that the learning rule can describe a diversity of complex cells, similar to those observed experimentally.

Analysis of extracellular spike waveforms and associated receptive fields of neurons in cat primary visual cortex.

KEY POINTS: Extracellular spikes recorded in the visual cortex (Area 17/18, V1) are commonly classified into either regular-spiking (RS) or fast-spiking (FS). Using multi-electrode arrays positioned in cat V1 and a broadband stimulus, we show that there is also a distinct class with positive-spiking (PS) waveforms. PS units were associated mainly with non-oriented receptive fields while RS and FS units had orientation-selective receptive fields. We suggest that PS units are recordings of axons originating from the thalamus. This conclusion was reinforced by our finding that we could record PS units after cortical silencing, but not record RS and FS units. The importance of our findings is that we were able to correlate spike shapes with receptive field characteristics with high precision using multi-electrode extracellular recording techniques. This allows considerable increases in the amount of information that can be extracted from future cortical experiments. ABSTRACT: Extracellular spike waveforms from recordings in the visual cortex have been classified into either regular-spiking (RS) or fast-spiking (FS) units. While both these types of spike waveforms are negative-dominant, we show that there are also distinct classes of spike waveforms in visual Area 17/18 (V1) of anaesthetised cats with positive-dominant waveforms, which are not regularly reported. The spatial receptive fields (RFs) of these different spike waveform types were estimated, which objectively revealed the existence of oriented and non-oriented RFs. We found that units with positive-dominant spikes, which have been associated with recordings from axons in the literature, had mostly non-oriented RFs (84%), which are similar to the centre-surround RFs observed in the dorsal lateral geniculate nucleus (dLGN). Thus, we hypothesise that these positive-dominant waveforms may be recordings from dLGN afferents. We recorded from V1 before and after the application of muscimol (a cortical silencer) and found that the positive-dominant spikes (PS) remained while the RS and FS cells did not. We also noted that the PS units had spiking characteristics normally associated with dLGN units (i.e. higher response spike rates, lower response latencies and higher proportion of burst spikes). Our findings show quantitatively that it is possible to correlate the RF properties of cortical neurons with particular spike waveforms. This has implications for how extracellular recordings should be interpreted and complex experiments can now be contemplated that would have been very challenging previously, such as assessing the feedforward connectivity between brain areas in the same location of cortical tissue.

Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex.

Visual object identification requires both selectivity for specific visual features that are important to the object's identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognized as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we quantitatively describe the balance between selectivity and invariance in complex cells. Phase invariance is frequently partial, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.

Electrical receptive fields of retinal ganglion cells: Influence of presynaptic neurons.

Implantable retinal stimulators activate surviving neurons to restore a sense of vision in people who have lost their photoreceptors through degenerative diseases. Complex spatial and temporal interactions occur in the retina during multi-electrode stimulation. Due to these complexities, most existing implants activate only a few electrodes at a time, limiting the repertoire of available stimulation patterns. Measuring the spatiotemporal interactions between electrodes and retinal cells, and incorporating them into a model may lead to improved stimulation algorithms that exploit the interactions. Here, we present a computational model that accurately predicts both the spatial and temporal nonlinear interactions of multi-electrode stimulation of rat retinal ganglion cells (RGCs). The model was verified using in vitro recordings of ON, OFF, and ON-OFF RGCs in response to subretinal multi-electrode stimulation with biphasic pulses at three stimulation frequencies (10, 20, 30 Hz). The model gives an estimate of each cell's spatiotemporal electrical receptive fields (ERFs); i.e., the pattern of stimulation leading to excitation or suppression in the neuron. All cells had excitatory ERFs and many also had suppressive sub-regions of their ERFs. We show that the nonlinearities in observed responses arise largely from activation of presynaptic interneurons. When synaptic transmission was blocked, the number of sub-regions of the ERF was reduced, usually to a single excitatory ERF. This suggests that direct cell activation can be modeled accurately by a one-dimensional model with linear interactions between electrodes, whereas indirect stimulation due to summated presynaptic responses is nonlinear.

A Simple and Accurate Model to Predict Responses to Multi-electrode Stimulation in the Retina.

Implantable electrode arrays are widely used in therapeutic stimulation of the nervous system (e.g. cochlear, retinal, and cortical implants). Currently, most neural prostheses use serial stimulation (i.e. one electrode at a time) despite this severely limiting the repertoire of stimuli that can be applied. Methods to reliably predict the outcome of multi-electrode stimulation have not been available. Here, we demonstrate that a linear-nonlinear model accurately predicts neural responses to arbitrary patterns of stimulation using in vitro recordings from single retinal ganglion cells (RGCs) stimulated with a subretinal multi-electrode array. In the model, the stimulus is projected onto a low-dimensional subspace and then undergoes a nonlinear transformation to produce an estimate of spiking probability. The low-dimensional subspace is estimated using principal components analysis, which gives the neuron's electrical receptive field (ERF), i.e. the electrodes to which the neuron is most sensitive. Our model suggests that stimulation proportional to the ERF yields a higher efficacy given a fixed amount of power when compared to equal amplitude stimulation on up to three electrodes. We find that the model captures the responses of all the cells recorded in the study, suggesting that it will generalize to most cell types in the retina. The model is computationally efficient to evaluate and, therefore, appropriate for future real-time applications including stimulation strategies that make use of recorded neural activity to improve the stimulation strategy.

Single-compartment models of retinal ganglion cells with different electrophysiologies.

There are more than 15 different types of retinal ganglion cells (RGCs) in the mammalian retina. To model responses of RGCs to electrical stimulation, we use single-compartment Hodgkin-Huxley-type models and run simulations in the Neuron environment. We use our recently published in vitro data of different morphological cell types to constrain the model, and study the effects of electrophysiology on the cell responses separately from the effects of morphology. We find simple models that can match the spike patterns of different types of RGCs. These models, with different input-output properties, may be used in a network to study retinal network dynamics and interactions.

Development of a Magnetic Attachment Method for Bionic Eye Applications.

Successful visual prostheses require stable, long-term attachment. Epiretinal prostheses, in particular, require attachment methods to fix the prosthesis onto the retina. The most common method is fixation with a retinal tack; however, tacks cause retinal trauma, and surgical proficiency is important to ensure optimal placement of the prosthesis near the macula. Accordingly, alternate attachment methods are required. In this study, we detail a novel method of magnetic attachment for an epiretinal prosthesis using two prostheses components positioned on opposing sides of the retina. The magnetic attachment technique was piloted in a feline animal model (chronic, nonrecovery implantation). We also detail a new method to reliably control the magnet coupling force using heat. It was found that the force exerted upon the tissue that separates the two components could be minimized as the measured force is proportionately smaller at the working distance. We thus detail, for the first time, a surgical method using customized magnets to position and affix an epiretinal prosthesis on the retina. The position of the epiretinal prosthesis is reliable, and its location on the retina is accurately controlled by the placement of a secondary magnet in the suprachoroidal location. The electrode position above the retina is less than 50 microns at the center of the device, although there were pressure points seen at the two edges due to curvature misalignment. The degree of retinal compression found in this study was unacceptably high; nevertheless, the normal structure of the retina remained intact under the electrodes.

Spike history neural response model.

There is a potential for improved efficacy of neural stimulation if stimulation levels can be modified dynamically based on the responses of neural tissue in real time. A neural model is developed that describes the response of neurons to electrical stimulation and that is suitable for feedback control neuroprosthetic stimulation. Experimental data from NZ white rabbit retinae is used with a data-driven technique to model neural dynamics. The linear-nonlinear approach is adapted to incorporate spike history and to predict the neural response of ganglion cells to electrical stimulation. To validate the fitness of the model, the penalty term is calculated based on the time difference between each simulated spike and the closest spike in time in the experimentally recorded train. The proposed model is able to robustly predict experimentally observed spike trains.

The effect of morphology upon electrophysiological responses of retinal ganglion cells: simulation results.

Retinal ganglion cells (RGCs) display differences in their morphology and intrinsic electrophysiology. The goal of this study is to characterize the ionic currents that explain the behavior of ON and OFF RGCs and to explore if all morphological types of RGCs exhibit the phenomena described in electrophysiological data. We extend our previous single compartment cell models of ON and OFF RGCs to more biophysically realistic multicompartment cell models and investigate the effect of cell morphology on intrinsic electrophysiological properties. The membrane dynamics are described using the Hodgkin - Huxley type formalism. A subset of published patch-clamp data from isolated intact mouse retina is used to constrain the model and another subset is used to validate the model. Two hundred morphologically distinct ON and OFF RGCs are simulated with various densities of ionic currents in different morphological neuron compartments. Our model predicts that the differences between ON and OFF cells are explained by the presence of the low voltage activated calcium current in OFF cells and absence of such in ON cells. Our study shows through simulation that particular morphological types of RGCs are capable of exhibiting the full range of phenomena described in recent experiments. Comparisons of outputs from different cells indicate that the RGC morphologies that best describe recent experimental results are ones that have a larger ratio of soma to total surface area.

Data-driven modelling of visual receptive fields: comparison between the generalized quadratic model and the nonlinear input model.

Neurons in primary visual cortex (V1) display a range of sensitivity in their response to translations of their preferred visual features within their receptive field: from high specificity to a precise position through to complete invariance. This visual feature selectivity and invariance is frequently modelled by applying a selection of linear spatial filters to the input image, that define the feature selectivity, followed by a nonlinear function that combines the filter outputs, that defines the invariance, to predict the neural response. We compare two such classes of model, that are both popular and parsimonious, by applying them to data from multielectrode recordings from cat primary visual cortex in response to spatially white Gaussian noise: the Generalized Quadratic Model (GQM) and the Nonlinear Input Model (NIM). These two classes of model differ primarily in that the NIM can accommodate a greater diversity in the form of nonlinearity that is applied to the outputs of the filters. After fitting both classes of model to a database of 342 single units, we analyze the qualitative and quantitative differences in the visual feature processing performed by the two models and their ability to predict neural response. We find that the NIM predicts response rates on a held-out data at least as well as the GQM for 95% of single units. Superior performance occurs predominantly for those units with above average spike rates and is largely due to the NIMs ability to capture aspects of the model's nonlinear function cannot be captured with the GQM rather than differences in the visual features being processed by the two different models. .

Quantifying visual acuity for pre-clinical testing of visual prostheses.

Objective.Visual prostheses currently restore only limited vision. More research and pre-clinical work are required to improve the devices and stimulation strategies that are used to induce neural activity that results in visual perception. Evaluation of candidate strategies and devices requires an objective way to convert measured and modelled patterns of neural activity into a quantitative measure of visual acuity.Approach.This study presents an approach that compares evoked patterns of neural activation with target and reference patterns. A d-prime measure of discriminability determines whether the evoked neural activation pattern is sufficient to discriminate between the target and reference patterns and thus provides a quantified level of visual perception in the clinical Snellen and MAR scales. The magnitude of the resulting value was demonstrated using scaled standardized 'C' and 'E' optotypes.Main results.The approach was used to assess the visual acuity provided by two alternative stimulation strategies applied to simulated retinal implants with different electrode pitch configurations and differently sized spreads of neural activity. It was found that when there is substantial overlap in neural activity generated by different electrodes, an estimate of acuity based only upon electrode pitch is incorrect; our proposed method gives an accurate result in both circumstances.Significance.Quantification of visual acuity using this approach in pre-clinical development will allow for more rapid and accurate prototyping of improved devices and neural stimulation strategies.

Characterization of extracellular spike waveforms recorded in wallaby primary visual cortex.

Extracellular recordings were made from 642 units in the primary visual cortex (V1) of a highly visual marsupial, the Tammar wallaby. The receptive field (RF) characteristics of the cells were objectively estimated using the non-linear input model (NIM), and these were correlated with spike shapes. We found that wallaby cortical units had 68% regular spiking (RS), 12% fast spiking (FS), 4% triphasic spiking (TS), 5% compound spiking (CS) and 11% positive spiking (PS). RS waveforms are most often associated with recordings from pyramidal or spiny stellate cell bodies, suggesting that recordings from these cell types dominate in the wallaby cortex. In wallaby, 70-80% of FS and RS cells had orientation selective RFs and had evenly distributed linear and nonlinear RFs. We found that 47% of wallaby PS units were non-orientation selective and they were dominated by linear RFs. Previous studies suggest that the PS units represent recordings from the axon terminals of non-orientation selective cells originating in the lateral geniculate nucleus (LGN). If this is also true in wallaby, as strongly suggested by their low response latencies and bursty spiking properties, the results suggest that significantly more neurons in wallaby LGN are already orientation selective. In wallaby, less than 10% of recorded spikes had triphasic (TS) or sluggish compound spiking (CS) waveforms. These units had a mixture of orientation selective and non-oriented properties, and their cellular origins remain difficult to classify.

Orientation pinwheels in primary visual cortex of a highly visual marsupial.

Primary visual cortices in many mammalian species exhibit modular and periodic orientation preference maps arranged in pinwheel-like layouts. The role of inherited traits as opposed to environmental influences in determining this organization remains unclear. Here, we characterize the cortical organization of an Australian marsupial, revealing pinwheel organization resembling that of eutherian carnivores and primates but distinctly different from the simpler salt-and-pepper arrangement of eutherian rodents and rabbits. The divergence of marsupials from eutherians 160 million years ago and the later emergence of rodents and rabbits suggest that the salt-and-pepper structure is not the primitive ancestral form. Rather, the genetic code that enables complex pinwheel formation is likely widespread, perhaps extending back to the common therian ancestors of modern mammals.

Preferential modulation of individual retinal ganglion cells by electrical stimulation.

Objective.Retinal prostheses have had limited success in vision restoration through electrical stimulation of surviving retinal ganglion cells (RGCs) in the degenerated retina. This is partly due to non-preferential stimulation of all RGCs near a single stimulating electrode, which include cells that conflict in their response properties and their contribution to visiual processing. Our study proposes a stimulation strategy to preferentially stimulate individual RGCs based on their temporal electrical receptive fields (tERFs).Approach.We recorded the responses of RGCs using whole-cell patch clamping and demonstrated the stimulation strategy, first using intracellular stimulation, then via extracellular stimulation.Main results. We successfully reconstructed the tERFs according to the RGC response to Gaussian white noise current stimulation. The characteristics of the tERFs were extracted and compared based on the morphological and light response types of the cells. By re-delivering stimulation trains that were composed of the tERFs obtained from different cells, we could preferentially stimulate individual RGCs as the cells showed lower activation thresholds to their own tERFs.Significance.This proposed stimulation strategy implemented in the next generation of recording and stimulating retinal prostheses may improve the quality of artificial vision.

Modelling intrinsic electrophysiological properties of ON and OFF retinal ganglion cells.

ON and OFF retinal ganglion cells (RGCs) display differences in their intrinsic electrophysiology: OFF cells maintain spontaneous activity in the absence of any input, exhibit subthreshold membrane potential oscillations, rebound excitation and burst firing; ON cells require excitatory input to drive their activity and display none of the aforementioned phenomena. The goal of this study was to identify and characterize ionic currents that explain these intrinsic electrophysiological differences between ON and OFF RGCs. A mathematical model of the electrophysiological properties of ON and OFF RGCs was constructed and validated using published patch-clamp data from isolated intact mouse retina. The model incorporates three ionic currents hypothesized to play a role in generating behaviors that are different between ON and OFF RGCs. These currents are persistent Na( + ), I (NaP), hyperpolarization-activated, I (h), and low voltage activated Ca(2 + ), I (T), currents. Using computer simulations of Hodgkin-Huxley type neuron with a single compartment model we found two distinct sets of I (NaP), I (h), I (T) conductances that correspond to ON and OFF RGCs populations. Simulations indicated that special properties of I (T) explain the differences in intrinsic electrophysiology between ON and OFF RGCs examined here. The modelling shows that the maximum conductance of I (T) is higher in OFF than in ON cells, in agreement with recent experimental data.

Learning a sparse code for temporal sequences using STDP and sequence compression.

A spiking neural network that learns temporal sequences is described. A sparse code in which individual neurons represent sequences and subsequences enables multiple sequences to be stored without interference. The network is founded on a model of sequence compression in the hippocampus that is robust to variation in sequence element duration and well suited to learn sequences through spike-timing dependent plasticity (STDP). Three additions to the sequence compression model underlie the sparse representation: synapses connecting the neurons of the network that are subject to STDP, a competitive plasticity rule so that neurons specialize to individual sequences, and neural depolarization after spiking so that neurons have a memory. The response to new sequence elements is determined by the neurons that have responded to the previous subsequence, according to the competitively learned synaptic connections. Numerical simulations show that the model can learn sets of intersecting sequences, presented with widely differing frequencies, with elements of varying duration.

Neural activity shaping utilizing a partitioned target pattern.

Electrical stimulation of neural tissue is used in both clinical and experimental devices to evoke a desired spatiotemporal pattern of neural activity. These devices induce a local field that drives neural activation, referred to as an activating function or generator signal. In visual prostheses, the spread of generator signal from each electrode within the neural tissue results in a spread of visual perception, referred to as a phosphene.Objective.In cases where neighbouring phosphenes overlap, it is desirable to use current steering or neural activity shaping strategies to manipulate the generator signal between the electrodes to provide greater control over the total pattern of neural activity. Applying opposite generator signal polarities in neighbouring regions of the retina forces the generator signal to pass through zero at an intermediate point, thus inducing low neural activity that may be perceived as a high-contrast line. This approach provides a form of high contrast visual perception, but it requires partitioning of the target pattern into those regions that use positive or negative generator signals. This discrete optimization is an NP-hard problem that is subject to being trapped in detrimental local minima.Approach.This investigation proposes a new partitioning method using image segmentation to determine the most beneficial positive and negative generator signal regions. Utilizing a database of 1000 natural images, the method is compared to alternative approaches based upon the mean squared error of the outcome.Main results.Under nominal conditions and with a set computation limit, partitioning provided improvement for 32% of these images. This percentage increased to 89% when utilizing image pre-processing to emphasize perceptual features of the images. The percentage of images that were dealt with most effectively with image segmentation increased as lower computation limits were imposed on the algorithms.Significance.These results provide a new method to increase the resolution of neural stimulating arrays and thus improve the experience of visual prosthesis users.

Spiking neuron model for temporal sequence recognition.

A biologically inspired neuronal network that stores and recognizes temporal sequences of symbols is described. Each symbol is represented by excitatory input to distinct groups of neurons (symbol pools). Unambiguous storage of multiple sequences with common subsequences is ensured by partitioning each symbol pool into subpools that respond only when the current symbol has been preceded by a particular sequence of symbols. We describe synaptic structure and neural dynamics that permit the selective activation of subpools by the correct sequence. Symbols may have varying durations of the order of hundreds of milliseconds. Physiologically plausible plasticity mechanisms operate on a time scale of tens of milliseconds; an interaction of the excitatory input with periodic global inhibition bridges this gap so that neural events representing successive symbols occur on this much faster timescale. The network is shown to store multiple overlapping sequences of events. It is robust to variation in symbol duration, it is scalable, and its performance degrades gracefully with perturbation of its parameters.

Stimulation Strategies for Improving the Resolution of Retinal Prostheses.

Electrical stimulation using implantable devices with arrays of stimulating electrodes is an emerging therapy for neurological diseases. The performance of these devices depends greatly on their ability to activate populations of neurons with high spatiotemporal resolution. To study electrical stimulation of populations of neurons, retina serves as a useful model because the neural network is arranged in a planar array that is easy to access. Moreover, retinal prostheses are under development to restore vision by replacing the function of damaged light sensitive photoreceptors, which makes retinal research directly relevant for curing blindness. Here we provide a progress review on stimulation strategies developed in recent years to improve the resolution of electrical stimulation in retinal prostheses. We focus on studies performed with explanted retinas, in which electrophysiological techniques are the most advanced. We summarize achievements in improving the spatial and temporal resolution of electrical stimulation of the retina and methods to selectively stimulate neurons with different visual functions. Future directions for retinal prostheses development are also discussed, which could provide insights for other types of neuromodulatory devices in which high-resolution electrical stimulation is required.