NIMH perspectives on future directions in neuroimaging for mental health.

NIMH's mission is to transform the understanding and treatment of mental illnesses through basic and clinical research, paving the way for prevention, recovery, and cure. New imaging techniques hold great promise for improving our understanding of the pathophysiology of mental illnesses, stratifying patients for treatment selection, and developing a personalized medicine approach. Here, we highlight emerging and promising new technologies that are likely to be vital in helping NIMH accomplish its mission, the potential for utilizing multimodal approaches to study mental illness, and considerations for data analytics and data sharing.

Lesions of prefrontal cortex reduce attentional modulation of neuronal responses and synchrony in V4.

It is widely held that the frontal eye field (FEF) in prefrontal cortex (PFC) modulates processing in visual cortex with attention, although the evidence that it is necessary is equivocal. To help identify critical sources of attentional feedback to area V4, we surgically removed the entire lateral PFC, including the FEF, in one hemisphere and transected the corpus callosum and anterior commissure in two macaques. This deprived V4 of PFC input in one hemisphere while keeping the other hemisphere intact. In the absence of PFC, attentional effects on neuronal responses and synchrony in V4 were substantially reduced and the remaining effects of attention were delayed in time, indicating a critical role for PFC. Conversely, distracters captured attention and influenced V4 responses. However, because the effects of attention in V4 were not eliminated by PFC lesions, other sources of top-down attentional control signals to visual cortex must exist outside of PFC.

The prefrontal cortex and the executive control of attention.

We review two studies aimed at understanding the role of prefrontal cortex (PFC) in the control of attention. The first study examined which attentional functions are critically dependent on PFC by removing PFC unilaterally and transecting the forebrain commissures in two macaques. The monkeys fixated a central cue and discriminated the orientation of a colored target grating presented among colored distracter gratings in either the hemifield affected by the PFC lesion or the normal control hemifield. When the cue was held constant for many trials, task performance in the affected hemifield was nearly normal. However, performance was severely impaired when the cue was switched frequently across trials. The monkeys were unimpaired in a pop-out task with changing targets that did not require top-down attentional control. Thus, the PFC lesion resulted in selective impairment in the monkeys' ability to switch top-down control. In the second study, we used fMRI to investigate the neural correlates of top-down control in humans performing tasks identical to those used in the monkey experiments. Several fronto-parietal and posterior visual areas showed enhanced activation when attention was switched, which was greater on color cueing (top-down) trials relative to pop-out trials. Taken together, our findings indicate that both frontal and parietal cortices are involved in generating top-down control signals for attentive switching, which may then be fed back to visual processing areas. The PFC in particular plays a critical role in the ability to switch attentional control on the basis of changing task demands.

Carbon nanotube coating improves neuronal recordings.

Implanting electrical devices in the nervous system to treat neural diseases is becoming very common. The success of these brain-machine interfaces depends on the electrodes that come into contact with the neural tissue. Here we show that conventional tungsten and stainless steel wire electrodes can be coated with carbon nanotubes using electrochemical techniques under ambient conditions. The carbon nanotube coating enhanced both recording and electrical stimulation of neurons in culture, rats and monkeys by decreasing the electrode impedance and increasing charge transfer. Carbon nanotube-coated electrodes are expected to improve current electrophysiological techniques and to facilitate the development of long-lasting brain-machine interface devices.

Top down attentional deficits in macaques with lesions of lateral prefrontal cortex.

Brain imaging, electrical stimulation, and neurophysiological studies have all implicated the prefrontal cortex (PFC) in the top-down control of attention. Specifically, feedback from PFC has been proposed to bias activity in visual cortex in favor of attended stimuli over irrelevant distracters. To identify which attentional functions are critically dependent on PFC, we removed PFC unilaterally in combination with transection of the corpus callosum and anterior commissure in two macaques. In such a preparation, the ipsilesional hemisphere is deprived of top-down feedback from PFC to visual cortex, and the contralesional hemisphere can serve as an intact normal control. Monkeys were trained to fixate a central cue and discriminate the orientation of a colored target grating presented among colored distracter gratings in either the hemifield affected by the PFC lesion or the normal control hemifield. Locations of the targets and distracters were varied, and the color of the central cue specified the color of the target on each trial. The behavioral response was a bar release, and thus attentional impairments could be distinguished from impaired oculomotor control. When the cue was held constant for many trials, task performance in the affected hemifield was nearly normal. However, the monkeys were severely impaired when the cue was switched frequently across trials. The monkeys were unimpaired in a pop-out task with changing targets that did not require top-down attentional control. The PFC thus appears to play a critical role in the ability to flexibly reallocate attention on the basis of changing task demands.

Nonhuman primate event-related potentials indexing covert shifts of attention.

A half-century's worth of research has established the existence of numerous event-related potential components measuring different cognitive operations in humans including the selection of stimuli by covert attention mechanisms. Surprisingly, it is unknown whether nonhuman primates exhibit homologous electrophysiological signatures of selective visual processing while viewing complex scenes. We used an electrophysiological technique with macaque monkeys analogous to procedures for recording scalp event-related potentials from humans and found that monkeys exhibit short-latency visual components sensitive to sensory processing demands and lateralizations related to shifting of covert attention similar to the human N2pc component. These findings begin to bridge the gap between the disparate literatures by using electrophysiological measurements to study the deployment of visual attention in the brains of humans and nonhuman primates.

Difficulty of visual search modulates neuronal interactions and response variability in the frontal eye field.

The frontal eye field (FEF) is involved in selecting visual targets for eye movements. To understand how populations of FEF neurons interact during target selection, we recorded activity from multiple neurons simultaneously while macaques performed two versions of a visual search task. We used a multivariate analysis in a point process statistical framework to estimate the instantaneous firing rate and compare interactions among neurons between tasks. We found that FEF neurons were engaged in more interactions during easier visual search tasks compared with harder search tasks. In particular, eye movement-related neurons were involved in more interactions than visual-related neurons. In addition, our analysis revealed a decrease in the variability of spiking activity in the FEF beginning approximately 100 ms before saccade onset. The minimum in response variability occurred approximately 20 ms earlier for the easier search task compared with the harder one. This difference is positively correlated with the difference in saccade reaction times for the two tasks. These findings show that a multivariate analysis can provide a measure of neuronal interactions and characterize the spiking activity of FEF neurons in the context of a population of neurons.

Lightness, filling-in, and the fundamental role of context in visual perception.

Visual perception is defined by the unique spatial interactions that distinguish it from the point-to-point precision of a photometer. Over several decades, Lothar Spillmann has made key observations about the nature of these interactions and the role of context in perception. Our lab has explored the perceptual properties of spatial interactions and more generally the importance of visual context for neuronal responses and perception. Our investigations into the spatiotemporal dynamics of lightness provide insight into underlying mechanisms. For example, backward masking and luminance modulation experiments suggest that the representation of a uniformly luminous object develops first at the borders and, in some manner, the center fills in. The temporal dynamics of lightness induction are also consistent with a filling-in process. There is a slow cutoff temporal frequency above which surround luminance modulation will not elicit perceptual induction of a central area. The larger the central area, the lower the cutoff frequency for induction, perhaps indicating that an edge-based process requires more time to "complete" the larger area. In recordings from primary visual cortex we find that neurons respond in a manner surprisingly consistent with lightness perception and the spatial and temporal properties of induction. For example, the activity of V1 neurons can be modulated by light outside the receptive field and as the modulation rate is increased response modulation falls off more rapidly for large uniform areas than smaller areas. The conclusion we draw from these experiments is that lightness appears to be computed slowly on the basis of edge and context information. A possible role for the spatial interactions is lightness constancy, which is thought to depend on extensive spatial integration. We find not only that V1 responses are strongly context dependent, but that this dependence makes V1 lightness constant on average. The dependence of constancy on surround interactions underscores the fundamental role that context plays in perception. In more recent studies, further support has been found for the importance of context in experiments using natural scene stimuli.

Parallel and serial neural mechanisms for visual search in macaque area V4.

To find a target object in a crowded scene, a face in a crowd for example, the visual system might turn the neural representation of each object on and off in a serial fashion, testing each representation against a template of the target item. Alternatively, it might allow the processing of all objects in parallel but bias activity in favor of those neurons that represent critical features of the target, until the target emerges from the background. To test these possibilities, we recorded neurons in area V4 of monkeys freely scanning a complex array to find a target defined by color, shape, or both. Throughout the period of searching, neurons gave enhanced responses and synchronized their activity in the gamma range whenever a preferred stimulus in their receptive field matched a feature of the target, as predicted by parallel models. Neurons also gave enhanced responses to candidate targets that were selected for saccades, or foveation, reflecting a serial component of visual search. Thus, serial and parallel mechanisms of response enhancement and neural synchrony work together to identify objects in a scene. To find a target object in a crowded scene, a face in a crowd for example, the visual system might turn the neural representation of each object on and off in a serial fashion, testing each representation against a template of the target item. Alternatively, it might allow the processing of all objects in parallel but bias activity in favor of those neurons that represent critical features of the target, until the target emerges from the background. To test these possibilities, we recorded neurons in area V4 of monkeys freely scanning a complex array to find a target defined by color, shape, or both. Throughout the period of searching, neurons gave enhanced responses and synchronized their activity in the gamma range whenever a preferred stimulus in their receptive field matched a feature of the target, as predicted by parallel models. Neurons also gave enhanced responses to candidate targets that were selected for saccades, or foveation, reflecting a serial component of visual search. Thus, serial and parallel mechanisms of response enhancement and neural synchrony work together to identify objects in a scene.