ABSTRACT
Analyzing neuronal activity during human seizures is pivotal to understanding mechanisms of seizure onset and propagation. These analyses, however, invariably using extracellular recordings, are greatly hindered by various phenomena that are well established in animal studies: changes in local ionic concentration, changes in ionic conductance, and intense, hypersynchronous firing. The first two alter the action potential waveform, whereas the third increases the "noise"; all three factors confound attempts to detect and classify single neurons. To address these analytical difficulties, we developed a novel template-matching-based spike sorting method, which enabled identification of 1239 single neurons in 27 patients (13 female) with intractable focal epilepsy, that were tracked throughout multiple seizures. These new analyses showed continued neuronal firing with widespread intense activation and stereotyped action potential alterations in tissue that was invaded by the seizure: neurons displayed increased waveform duration (p < 0.001) and reduced amplitude (p < 0.001), consistent with prior animal studies. By contrast, neurons in "penumbral" regions (those receiving intense local synaptic drive from the seizure but without neuronal evidence of local seizure invasion) showed stable waveforms. All neurons returned to their preictal waveforms after seizure termination. We conclude that the distinction between "core" territories invaded by the seizure versus "penumbral" territories is evident at the level of single neurons. Furthermore, the increased waveform duration and decreased waveform amplitude are neuron-intrinsic hallmarks of seizure invasion that impede traditional spike sorting and could be used as defining characteristics of local recruitment.SIGNIFICANCE STATEMENT Animal studies consistently show marked changes in action potential waveform during epileptic discharges, but acquiring similar evidence in humans has proven difficult. Assessing neuronal involvement in ictal events is pivotal to understanding seizure dynamics and in defining clinical localization of epileptic pathology. Using a novel method to track neuronal firing, we analyzed microelectrode array recordings of spontaneously occurring human seizures, and here report two dichotomous activity patterns. In cortex that is recruited to the seizure, neuronal firing rates increase and waveforms become longer in duration and shorter in amplitude as the neurons are recruited to the seizure, while penumbral tissue shows stable action potentials, in keeping with the "dual territory" model of seizure dynamics.
Subject(s)
Electroencephalography , Neurons , Seizures/physiopathology , Action Potentials , Adult , Brain Waves , Cerebral Cortex/physiopathology , Drug Resistant Epilepsy/physiopathology , Female , Humans , Male , Middle Aged , Recruitment, Neurophysiological , Wavelet Analysis , Young AdultABSTRACT
The local field potential (LFP) is of growing importance in neurophysiology as a metric of network activity and as a readout signal for use in brain-machine interfaces. However, there are uncertainties regarding the kind and visual field extent of information carried by LFP signals, as well as the specific features of the LFP signal conveying such information, especially under naturalistic conditions. To address these questions, we recorded LFP responses to natural images in V1 of awake and anesthetized macaques using Utah multielectrode arrays. First, we have shown that it is possible to identify presented natural images from the LFP responses they evoke using trained Gabor wavelet (GW) models. Because GW models were devised to explain the spiking responses of V1 cells, this finding suggests that local spiking activity and LFPs (thought to reflect primarily local synaptic activity) carry similar visual information. Second, models trained on scalar metrics, such as the evoked LFP response range, provide robust image identification, supporting the informative nature of even simple LFP features. Third, image identification is robust only for the first 300 ms following image presentation, and image information is not restricted to any of the spectral bands. This suggests that the short-latency broadband LFP response carries most information during natural scene viewing. Finally, best image identification was achieved by GW models incorporating information at the scale of â¼ 0.5° in size and trained using four different orientations. This suggests that during natural image viewing, LFPs carry stimulus-specific information at spatial scales corresponding to few orientation columns in macaque V1.
Subject(s)
Evoked Potentials, Visual , Visual Cortex/physiology , Visual Perception , Animals , Macaca fascicularis , Male , Photic StimulationABSTRACT
There is active debate regarding how GABAergic function changes during seizure initiation and propagation, and whether interneuronal activity drives or impedes the pathophysiology. Here, we track cell-type specific firing during spontaneous human seizures to identify neocortical mechanisms of inhibitory failure. Fast-spiking interneuron activity was maximal over 1 second before equivalent excitatory increases, and showed transitions to out-of-phase firing prior to local tissue becoming incorporated into the seizure-driving territory. Using computational modeling, we linked this observation to transient saturation block as a precursor to seizure invasion, as supported by multiple lines of evidence in the patient data. We propose that transient blocking of inhibitory firing due to selective fast-spiking interneuron saturation-resulting from intense excitatory synaptic drive-is a novel mechanism that contributes to inhibitory failure, allowing seizure propagation.
ABSTRACT
PURPOSE: Recent studies in epilepsy, cognition, and brain machine interfaces have shown the utility of recording intracranial electroencephalography (iEEG) with greater spatial resolution. Many of these studies utilize microelectrodes connected to specialized amplifiers that are optimized for such recordings. We recently measured the impedances of several commercial microelectrodes and demonstrated that they will distort iEEG signals if connected to clinical EEG amplifiers commonly used in most centers. In this study we demonstrate the clinical implications of this effect and identify some of the potential difficulties in using microelectrodes. METHODS: Human iEEG data were digitally filtered to simulate the signal recorded by a hybrid grid (two macroelectrodes and eight microelectrodes) connected to a standard EEG amplifier. The filtered iEEG data were read by three trained epileptologists, and high frequency oscillations (HFOs) were detected with a well-known algorithm. The filtering method was verified experimentally by recording an injected EEG signal in a saline bath with the same physical acquisition system used to generate the model. Several electrodes underwent scanning electron microscopy (SEM). KEY FINDINGS: Macroelectrode recordings were unaltered compared to the source iEEG signal, but microelectrodes attenuated low frequencies. The attenuated signals were difficult to interpret: all three clinicians changed their clinical scoring of slowing and seizures when presented with the same data recorded on different sized electrodes. The HFO detection algorithm was oversensitive with microelectrodes, classifying many more HFOs than when the same data were recorded with macroelectrodes. In addition, during experimental recordings the microelectrodes produced much greater noise as well as large baseline fluctuations, creating sharply contoured transients, and superimposed "false" HFOs. SEM of these microelectrodes demonstrated marked variability in exposed electrode surface area, lead fractures, and sharp edges. SIGNIFICANCE: Microelectrodes should not be used with low impedance (<1 GΩ) amplifiers due to severe signal attenuation and variability that changes clinical interpretations. The current method of preparing microelectrodes can leave sharp edges and nonuniform amounts of exposed wire. Even when recorded with higher impedance amplifiers, microelectrode data are highly prone to artifacts that are difficult to interpret. Great care must be taken when analyzing iEEG from high impedance microelectrodes.
Subject(s)
Brain Mapping , Brain/physiology , Electroencephalography/methods , Epilepsy/diagnosis , Microelectrodes , Algorithms , Artifacts , Brain Waves/physiology , Databases, Factual/statistics & numerical data , Electric Impedance , Electronic Data Processing , HumansABSTRACT
OBJECTIVE: We investigated the electrophysiological relationships in the cortico-basal ganglia network on a sub-centimeter scale to increase our understanding of neural functional relationships in Parkinson's disease (PD). METHODS: Data was intraoperatively recorded from 2 sources in the human brain-a microelectrode in the subthalamic nucleus (STN) and a micro-electrocorticography grid on the motor association cortex-during bilateral deep brain stimulation (DBS) electrode placement. STN neurons and local field potential (LFP) were defined as functionally connected when the 99.7% confidence intervals of the action potential (AP)-aligned average LFP and control did not overlap. RESULTS: APs from STN neurons were functionally connected to the STN LFP for 18/46 STN neurons. This functional connection was observed between STN neuron APs and cortical LFP for 25/46 STN neurons. The cortical patterns of electrophysiological functional connectivity differed for each neuron. CONCLUSIONS: A subset of single neurons in the STN exhibited functional connectivity with electrophysiological activity in the STN and at a distance with the motor association cortex surveyed on a sub-centimeter spatial scale. These connections show a per neuron differential topography on the cortex. SIGNIFICANCE: The cortico-basal ganglia circuit is organized on a sub-centimeter scale, and plays an important role in the mechanisms of PD and DBS.
Subject(s)
Deep Brain Stimulation , Motor Cortex , Parkinson Disease , Subthalamic Nucleus , Basal Ganglia , Humans , Parkinson Disease/therapyABSTRACT
Interictal epileptiform discharges (IEDs), also known as interictal spikes, are large intermittent electrophysiological events observed between seizures in patients with epilepsy. Although they occur far more often than seizures, IEDs are less studied, and their relationship to seizures remains unclear. To better understand this relationship, we examined multi-day recordings of microelectrode arrays implanted in human epilepsy patients, allowing us to precisely observe the spatiotemporal propagation of IEDs, spontaneous seizures, and how they relate. These recordings showed that the majority of IEDs are traveling waves, traversing the same path as ictal discharges during seizures, and with a fixed direction relative to seizure propagation. Moreover, the majority of IEDs, like ictal discharges, were bidirectional, with one predominant and a second, less frequent antipodal direction. These results reveal a fundamental spatiotemporal similarity between IEDs and ictal discharges. These results also imply that most IEDs arise in brain tissue outside the site of seizure onset and propagate toward it, indicating that the propagation of IEDs provides useful information for localizing the seizure focus.
Subject(s)
Brain Mapping/methods , Electroencephalography/methods , Epilepsy/physiopathology , Seizures/physiopathology , Adult , Female , Humans , Male , Young AdultABSTRACT
OBJECTIVE: Brain-Machine Interfaces (BMIs) hold great promises for advancing neuroprosthetics, robotics, and for providing treatment options for severe neurological diseases. The objective of this work is the development and in vivo evaluation of electrodes for BMIs that meet the needs to record brain activity at sub-millimeter resolution over a large area of the cortex while being soft and electromechanically robust (i.e. stretchable). APPROACH: Current electrodes require a trade-off between high spatiotemporal resolution and cortical coverage area. To address the needs for simultaneous high resolution and large cortical coverage, the prototype electrode array developed in this study employs a novel bilayer routing of soft and stretchable lead wires from the recording sites on the surface of the brain (electrocorticography, ECoG) to the data acquisition system. MAIN RESULTS: To validate the recording characteristics, the array was implanted in healthy felines for up to 5 months. Neural signals recorded from both layers of the device showed elevated mid-frequency structures typical of local field potential (LFP) signals that were stable in amplitude over implant duration, and also exhibited consistent frequency-dependent modulation after anesthesia induction by Telazol. SIGNIFICANCE: The successful development of a soft and stretchable large-area, high resolution micro ECoG electrode array (lahrµECoG) is an important step to meet the neurotechnological needs of advanced BMI applications.
Subject(s)
Brain-Computer Interfaces , Animals , Brain , Cats , Electrocorticography , Electrodes, ImplantedABSTRACT
OBJECT: The goal of this study was to determine whether a nonpenetrating, high-density microwire array could provide sufficient information to serve as the interface for decoding motor cortical signals. METHODS: Arrays of nonpenetrating microwires were implanted over the human motor cortex in 2 patients. The patients performed directed stereotypical reaching movements in 2 directions. The resulting data were used to determine whether the reach direction could be distinguished through a frequency power analysis. RESULTS: Correlation analysis revealed decreasing signal correlation with distance. The gamma-band power during motor planning allowed binary classification of gross directionality in the reaching movements. The degree of power change was correlated to the underlying gyral pattern. CONCLUSIONS: The nonpenetrating microwire platform showed good potential for allowing differentiated signals to be recorded with high spatial fidelity without cortical penetration.
Subject(s)
Electroencephalography/methods , Microelectrodes , Motor Cortex/physiology , Movement/physiology , Prostheses and Implants , User-Computer Interface , Action Potentials , Arm/physiology , Electrodes, Implanted , Electrophysiology , Epilepsy/diagnosis , Epilepsy/physiopathology , Fingers/physiology , Humans , Male , Motor Activity/physiology , Neocortex/physiology , Task Performance and AnalysisABSTRACT
Medically induced loss of consciousness (mLOC) during anesthesia is associated with a macroscale breakdown of brain connectivity, yet the neural microcircuit correlates of mLOC remain unknown. To explore this, we applied different analytical approaches (t-SNE/watershed segmentation, affinity propagation clustering, PCA, and LZW complexity) to two-photon calcium imaging of neocortical and hippocampal microcircuit activity and local field potential (LFP) measurements across different anesthetic depths in mice, and to micro-electrode array recordings in human subjects. We find that in both cases, mLOC disrupts population activity patterns by generating (1) fewer discriminable network microstates and (2) fewer neuronal ensembles. Our results indicate that local neuronal ensemble dynamics could causally contribute to the emergence of conscious states.
Subject(s)
Consciousness/physiology , Nerve Net/physiology , Unconsciousness/metabolism , Adult , Animals , Brain/physiology , Brain Mapping/methods , Humans , Image Processing, Computer-Assisted/methods , Male , Mice , Mice, Inbred C57BL , Mice, Transgenic , Middle Aged , Neurons/physiologyABSTRACT
[This corrects the article on p. 22 in vol. 12, PMID: 29467602.].
ABSTRACT
Objective: The performance of machine learning algorithms used for neural decoding of dexterous tasks may be impeded due to problems arising when dealing with high-dimensional data. The objective of feature selection algorithms is to choose a near-optimal subset of features from the original feature space to improve the performance of the decoding algorithm. The aim of our study was to compare the effects of four feature selection techniques, Wilcoxon signed-rank test, Relative Importance, Principal Component Analysis (PCA), and Mutual Information Maximization on SVM classification performance for a dexterous decoding task. Approach: A nonhuman primate (NHP) was trained to perform small coordinated movements-similar to typing. An array of microelectrodes was implanted in the hand area of the motor cortex of the NHP and used to record action potentials (AP) during finger movements. A Support Vector Machine (SVM) was used to classify which finger movement the NHP was making based upon AP firing rates. We used the SVM classification to examine the functional parameters of (i) robustness to simulated failure and (ii) longevity of classification. We also compared the effect of using isolated-neuron and multi-unit firing rates as the feature vector supplied to the SVM. Main results: The average decoding accuracy for multi-unit features and single-unit features using Mutual Information Maximization (MIM) across 47 sessions was 96.74 ± 3.5% and 97.65 ± 3.36% respectively. The reduction in decoding accuracy between using 100% of the features and 10% of features based on MIM was 45.56% (from 93.7 to 51.09%) and 4.75% (from 95.32 to 90.79%) for multi-unit and single-unit features respectively. MIM had best performance compared to other feature selection methods. Significance: These results suggest improved decoding performance can be achieved by using optimally selected features. The results based on clinically relevant performance metrics also suggest that the decoding algorithm can be made robust by using optimal features and feature selection algorithms. We believe that even a few percent increase in performance is important and improves the decoding accuracy of the machine learning algorithm potentially increasing the ease of use of a brain machine interface.
ABSTRACT
We describe a device for assessing the effects of diffusible molecules on electrophysiological recordings from multiple neurons. This device allows for the infusion of reagents through a cannula located among an array of micro-electrodes. The device can easily be customized to target specific neural structures. It is designed to be chronically implanted so that isolated neural units and local field potentials are recorded over the course of several weeks or months. Multivariate statistical and spectral analysis of electrophysiological signals acquired using this system could quantitatively identify electrical "signatures" of therapeutically useful drugs.
Subject(s)
Catheterization/instrumentation , Electrophysiology/instrumentation , Infusion Pumps, Implantable , Neuropharmacology/instrumentation , Signal Processing, Computer-Assisted , Action Potentials/drug effects , Action Potentials/physiology , Animals , Behavior, Animal , Brain/drug effects , Brain/physiology , Catheterization/methods , Drug Evaluation, Preclinical/methods , Electrodes, Implanted , Electrophysiology/methods , Infusion Pumps, Implantable/standards , Movement , Neurons/drug effects , Neurons/physiology , Neuropharmacology/methods , RatsABSTRACT
OBJECTIVE: Epileptiform discharges, an electrophysiological hallmark of seizures, can propagate across cortical tissue in a manner similar to traveling waves. Recent work has focused attention on the origination and propagation patterns of these discharges, yielding important clues to their source location and mechanism of travel. However, systematic studies of methods for measuring propagation are lacking. APPROACH: We analyzed epileptiform discharges in microelectrode array recordings of human seizures. The array records multiunit activity and local field potentials at 400 micron spatial resolution, from a small cortical site free of obstructions. We evaluated several computationally efficient statistical methods for calculating traveling wave velocity, benchmarking them to analyses of associated neuronal burst firing. MAIN RESULTS: Over 90% of discharges met statistical criteria for propagation across the sampled cortical territory. Detection rate, direction and speed estimates derived from a multiunit estimator were compared to four field potential-based estimators: negative peak, maximum descent, high gamma power, and cross-correlation. Interestingly, the methods that were computationally simplest and most efficient (negative peak and maximal descent) offer non-inferior results in predicting neuronal traveling wave velocities compared to the other two, more complex methods. Moreover, the negative peak and maximal descent methods proved to be more robust against reduced spatial sampling challenges. Using least absolute deviation in place of least squares error minimized the impact of outliers, and reduced the discrepancies between local field potential-based and multiunit estimators. SIGNIFICANCE: Our findings suggest that ictal epileptiform discharges typically take the form of exceptionally strong, rapidly traveling waves, with propagation detectable across millimeter distances. The sequential activation of neurons in space can be inferred from clinically-observable EEG data, with a variety of straightforward computation methods available. This opens possibilities for systematic assessments of ictal discharge propagation in clinical and research settings.
Subject(s)
Electrodes, Implanted , Electroencephalography/instrumentation , Electroencephalography/methods , Seizures/diagnosis , Seizures/physiopathology , Action Potentials/physiology , Humans , Microelectrodes , Multivariate Analysis , Regression AnalysisABSTRACT
OBJECTIVE: In order to move forward with the development of a cortical vision prosthesis, the critical issues in the field must be identified. APPROACH: To begin this process, we performed a brief review of several different cortical and retinal stimulation techniques that can be used to restore vision. MAIN RESULTS: Intracortical microelectrodes and epicortical macroelectrodes have been evaluated as the basis of a vision prosthesis. We concluded that an important knowledge gap necessitates an experimental in vivo performance evaluation of microelectrodes placed on the surface of the visual cortex. A comparison of the level of vision restored by intracortical versus epicortical microstimulation is necessary. Because foveal representation in the primary visual cortex involves more cortical columns per degree of visual field than does peripheral vision, restoration of foveal vision may require a large number of closely spaced microelectrodes. Based on previous studies of epicortical macrostimulation, it is possible that stimulation via surface microelectrodes could produce a lower spatial resolution, making them better suited for restoring peripheral vision. SIGNIFICANCE: The validation of epicortical microstimulation in addition to the comparison of epicortical and intracortical approaches for vision restoration will fill an important knowledge gap and may have important implications for surgical strategies and device longevity. It is possible that the best approach to vision restoration will utilize both epicortical and intracortical microstimulation approaches, applying them appropriately to different visual representations in the primary visual cortex.
Subject(s)
Electrodes, Implanted , Microelectrodes , Visual Cortex/physiology , Visual Prosthesis , Animals , Electric Stimulation/instrumentation , Electric Stimulation/methods , Electrodes, Implanted/trends , Evoked Potentials, Visual/physiology , Humans , Microelectrodes/standards , Vision Disorders/surgery , Vision Disorders/therapy , Visual Prosthesis/trendsABSTRACT
OBJECTIVE: Electrocorticography grids have been used to study and diagnose neural pathophysiology for over 50 years, and recently have been used for various neural prosthetic applications. Here we provide evidence that micro-scale electrodes are better suited for studying cortical pathology and function, and for implementing neural prostheses. METHODS: This work compares dynamics in space, time, and frequency of cortical field potentials recorded by three types of electrodes: electrocorticographic (ECoG) electrodes, non-penetrating micro-ECoG (µECoG) electrodes that use microelectrodes and have tighter interelectrode spacing; and penetrating microelectrodes (MEA) that penetrate the cortex to record single- or multiunit activity (SUA or MUA) and local field potentials (LFP). RESULTS: While the finest spatial scales are found in LFPs recorded intracortically, we found that LFP recorded from µECoG electrodes demonstrate scales of linear similarity (i.e., correlation, coherence, and phase) closer to the intracortical electrodes than the clinical ECoG electrodes. CONCLUSIONS: We conclude that LFPs can be recorded intracortically and epicortically at finer scales than clinical ECoG electrodes are capable of capturing. SIGNIFICANCE: Recorded with appropriately scaled electrodes and grids, field potentials expose a more detailed representation of cortical network activity, enabling advanced analyses of cortical pathology and demanding applications such as brain-computer interfaces.
Subject(s)
Electrocorticography/instrumentation , Electrodes, Implanted , Motor Cortex/physiology , Nerve Net/physiology , Somatosensory Cortex/physiology , Electrocorticography/standards , Electrodes, Implanted/standards , Humans , Male , Microelectrodes/standardsABSTRACT
The extensive distribution and simultaneous termination of seizures across cortical areas has led to the hypothesis that seizures are caused by large-scale coordinated networks spanning these areas. This view, however, is difficult to reconcile with most proposed mechanisms of seizure spread and termination, which operate on a cellular scale. We hypothesize that seizures evolve into self-organized structures wherein a small seizing territory projects high-intensity electrical signals over a broad cortical area. Here we investigate human seizures on both small and large electrophysiological scales. We show that the migrating edge of the seizing territory is the source of travelling waves of synaptic activity into adjacent cortical areas. As the seizure progresses, slow dynamics in induced activity from these waves indicate a weakening and eventual failure of their source. These observations support a parsimonious theory for how large-scale evolution and termination of seizures are driven from a small, migrating cortical area.
Subject(s)
Brain Waves/physiology , Seizures/physiopathology , Computer Simulation , Electroencephalography , Gamma Rhythm , Humans , Microelectrodes , Models, Neurological , Nerve Net/physiopathologyABSTRACT
The emerging field of neuroprosthetics is focused on the development of new therapeutic interventions that will be able to restore some lost neural function by selective electrical stimulation or by harnessing activity recorded from populations of neurons. As more and more patients benefit from these approaches, the interest in neural interfaces has grown significantly and a new generation of penetrating microelectrode arrays are providing unprecedented access to the neurons of the central nervous system (CNS). These microelectrodes have active tip dimensions that are similar in size to neurons and because they penetrate the nervous system, they provide selective access to these cells (within a few microns). However, the very long-term viability of chronically implanted microelectrodes and the capability of recording the same spiking activity over long time periods still remain to be established and confirmed in human studies. Here we review the main responses to acute implantation of microelectrode arrays, and emphasize that it will become essential to control the neural tissue damage induced by these intracortical microelectrodes in order to achieve the high clinical potentials accompanying this technology.
ABSTRACT
OBJECTIVE: Hierarchical processing of auditory sensory information is believed to occur in two streams: a ventral stream responsible for stimulus identity and a dorsal stream responsible for processing spatial elements of a stimulus. The objective of the current study is to examine neural coding in this processing stream in the context of understanding the possibility for an auditory cortical neural prosthesis. APPROACH: We examined the selectivity for species-specific primate vocalizations in the ventral auditory processing stream by applying a statistical classifier to neural data recorded from microelectrode arrays. Multi-unit activity (MUA) and local field potential (LFP) data recorded simultaneously from primary auditory complex (AI) and rostral parabelt (PBr) were decoded on a trial-by-trial basis. MAIN RESULTS: While decode performance in AI was well above chance, mean performance in PBr did not deviate >15% from chance level. Mean performance levels were similar for MUA and LFP decodes. Increasing the spectral and temporal resolution improved decode performance; while inter-electrode spacing could be as large as 1.14 mm without degrading decode performance. SIGNIFICANCE: These results serve as preliminary guidance for a human auditory cortical neural prosthesis; instructing interface implementation, microstimulation patterns and anatomical placement.
Subject(s)
Action Potentials/physiology , Auditory Cortex/physiology , Auditory Pathways/physiology , Macaca mulatta/physiology , Microelectrodes , Neural Prostheses , Wakefulness/physiology , Acoustic Stimulation/methods , Animals , Male , Random AllocationABSTRACT
In interpersonal communication, the listener can often see as well as hear the speaker. Visual stimuli can subtly change a listener's auditory perception, as in the McGurk illusion, in which perception of a phoneme's auditory identity is changed by a concurrent video of a mouth articulating a different phoneme. Studies have yet to link visual influences on the neural representation of language with subjective language perception. Here we show that vision influences the electrophysiological representation of phonemes in human auditory cortex prior to the presentation of the auditory stimulus. We used the McGurk effect to dissociate the subjective perception of phonemes from the auditory stimuli. With this paradigm we demonstrate that neural representations in auditory cortex are more closely correlated with the visual stimuli of mouth articulation, which drive the illusory subjective auditory perception, than the actual auditory stimuli. Additionally, information about visual and auditory stimuli transfer in the caudal-rostral direction along the superior temporal gyrus during phoneme perception as would be expected of visual information flowing from the occipital cortex into the ventral auditory processing stream. These results show that visual stimuli influence the neural representation in auditory cortex early in sensory processing and may override the subjective auditory perceptions normally generated by auditory stimuli. These findings depict a marked influence of vision on the neural processing of audition in tertiary auditory cortex and suggest a mechanistic underpinning for the McGurk effect.