Pupillary dilations in a Target/Distractor visual task paradigm and attention deficit hyperactivity disorder (ADHD).

ADHD is a neurocognitive disorder characterized by attention difficulties, hyperactivity, and impulsivity, often persisting into adulthood with substantial personal and societal consequences. Despite the importance of neurophysiological assessment and treatment monitoring tests, their availability outside of research settings remains limited. Cognitive neuroscience investigations have identified distinct components associated with ADHD, including deficits in sustained attention, inefficient enhancement of attended Targets, and altered suppression of ignored Distractors. In this study, we examined pupil activity in control and ADHD subjects during a sustained visual attention task specifically designed to evaluate the mechanisms underlying Target enhancement and Distractor suppression. Our findings revealed some distinguishing factors between the two groups which we discuss in light of their neurobiological implications.

Neural saccadic response estimation during natural viewing.

Studying neural activity during natural viewing conditions is not often attempted. Isolating the neural response of a single saccade is necessary to study neural activity during natural viewing; however, the close temporal spacing of saccades that occurs during natural viewing makes it difficult to determine the response to a single saccade. Herein, a general linear model (GLM) approach is applied to estimate the EEG neural saccadic response for different segments of the saccadic main sequence separately. It is determined that, in visual search conditions, neural responses estimated by conventional event-related averaging are significantly and systematically distorted relative to GLM estimates due to the close temporal spacing of saccades during visual search. Before the GLM is applied, analyses are applied that demonstrate that saccades during visual search with intersaccadic spacings as low as 100-150 ms do not exhibit significant refractory effects. Therefore, saccades displaying different intersaccadic spacings during visual search can be modeled using the same regressor in a GLM. With the use of the GLM approach, neural responses were separately estimated for five different ranges of saccade amplitudes during visual search. Occipital responses time locked to the onsets of saccades during visual search were found to account for, on average, 79 percent of the variance of EEG activity in a window 90-200 ms after the onsets of saccades for all five saccade amplitude ranges that spanned a range of 0.2-6.0 degrees. A GLM approach was also used to examine the lateralized ocular artifacts associated with saccades. Possible extensions of the methods presented here to account for the superposition of microsaccades in event-related EEG studies conducted in nominal fixation conditions are discussed.

The effect of flankers on three tasks in central, peripheral, and amblyopic vision.

Using identical stimuli and methods, we assessed the effects of flankers on three different tasks, orientation discrimination, contrast discrimination, and detection, in central, peripheral, and amblyopic vision. The goal was to understand the factors that limit performance of a task in the presence of flankers in each of these visual systems. The results demonstrate that: (1) For unflanked targets, the losses in peripheral and amblyopic vision (relative to the normal fovea) are ordered, with the loss of unflanked contrast discrimination thresholds considerably smaller than those for either detection or orientation discrimination. (2) For flanked targets, in normal foveal vision and anisometropic amblyopia, the critical distance is more or less proportional to the target size, whereas in peripheral and strabismic amblyopic vision, the critical distance shows much less (or no) dependence on target size. (3) For the normal fovea, and anisometropic amblyopia, when the target is large (>≈0.2 deg) the amount of threshold elevation induced by flankers is low, increasing when the target is very small. On the other hand, for the periphery and the amblyopic eyes of most strabismic amblyopes, the elevation is large over the range of sizes tested. (4) In peripheral and strabismic amblyopic vision, remote flankers elevate orientation discrimination and contrast discrimination thresholds but not detection thresholds. Our results show clearly that the effects of flanks depend on both the task and the type of visual system. We conclude that in normal foveal vision and anisometropic amblyopia, the effects of flankers largely reflects a reduction in visibility and may be explained by masking. On the other hand, in peripheral vision and strabismic amblyopia, the effects of flankers on orientation discrimination and to a lesser extent contrast discrimination cannot be explained by simple masking and are due to crowding.

The folding fingerprint of visual cortex reveals the timing of human V1 and V2.

Primate neocortex contains over 30 visual areas. Recent techniques such as functional magnetic resonance imaging (fMRI) have successfully identified many of these areas in the human brain, but have been of limited value for revealing the temporal dynamics between visual areas. The electroencephalogram (EEG) provides information with high temporal precision, but has had limited success separating out the signals from individual neighboring cortical areas. Consequently, controversies exist over the temporal dynamics across cortical areas. In order to address this problem we developed a new method to identify the sources of the EEG. An individual's unique cortical pattern of sulci and gyri along with a visual area's functional retinotopic layout provides a folding fingerprint that predicts specific scalp topographies for stimuli presented in different parts of the visual field. Using this folding fingerprint with a 96 or 192 location stimulus severely constrains the solution space making it relatively easy to extract the temporal response of multiple visual areas to multiple stimulus locations. The large number of stimuli also provides a means to validate the waveforms by comparing across stimulus sets, an important feature not present in most EEG source identification procedures. Using this method our data reveal that both V1 and V2 waveforms have similar onset latencies, and their temporal dynamics provide new information regarding the response latencies of these areas in humans. Our method enables the previously unattainable separation of EEG responses from neighboring brain areas. While we applied the method to the first two cortical visual areas, V1 and V2, this method is also applicable to somatosensory areas that have defined mappings. This method provides a means to study the rapid information flow in the human brain to reveal top-down and bottom-up cognitive processes.

Pupil dilation during visual target detection.

It has long been documented that emotional and sensory events elicit a pupillary dilation. Is the pupil response a reliable marker of a visual detection event while viewing complex imagery? In two experiments where viewers were asked to report the presence of a visual target during rapid serial visual presentation (RSVP), pupil dilation was significantly associated with target detection. The amplitude of the dilation depended on the frequency of targets and the time of target presentation relative to the start of the trial. Larger dilations were associated with trials having fewer targets and with targets viewed earlier in the run. We found that dilation was influenced by, but not dependent on, the requirement of a button press. Interestingly, we also found that dilation occurred when viewers fixated a target but did not report seeing it. We will briefly discuss the role of noradrenaline in mediating these pupil behaviors.

Methods for quantifying intra- and inter-subject variability of evoked potential data applied to the multifocal visual evoked potential.

Differences in cortical geometry within and between subjects can complicate multifocal visual evoked potential (mfVEP) and standard evoked potential (EP) intra- and inter-subject comparisons. We present methods for aligning temporal intra- and inter-subject data prior to comparison. Multiple groups have informally observed that the two dominant temporal principal components (PCs) of the pattern reversal visual evoked potential (VEP) obtained with singular value decomposition (SVD) exhibit little inter-subject variability relative to the inter-subject variability of the raw VEP. We present methods that employ the temporal PCs to formally quantify intra- and inter-subject variability of the mfVEP. When SVD was applied to data from eight subjects separately, it was found that two PCs accounted for, on average, 73% of intra-subject variance. When a single SVD was applied to combined data from multiple subjects, it was found that two PCs accounted for 67% of inter-subject variance. We used the 2D temporal subspaces derived from SVD as a basis for intra- and inter-subject comparisons.

Localizing sites of activation in primary visual cortex using visual-evoked potentials and functional magnetic resonance imaging.

This study compared retinotopic map identification in primary visual cortex (V1) using: (i) functional magnetic resonance imaging (fMRI) and (ii) visual evoked potentials (VEPs) coupled with dipole source localization (DSL). A multielectrode array was used to record VEPs while subjects viewed a flickering dartboard pattern modulated by a 16-bit m-sequence. The stimulus preferentially activates V1. Using a common time function DSL algorithm, the primary source of each stimulus patch was found independent of the fMRI. The VEP/DSL and fMRI localization data for each subject were aligned by a rigid translation and rotation. The average distance between VEP and corresponding fMRI sources was 10.8 mm +/- 3.8 mm. To assess the significance of the results, fMRI and DSL solutions were scrambled so the comparisons were no longer for corresponding patches. The average distance between the noncorresponding data sets was 17.2 mm for 50 million scrambles. The probability of the scrambled data yielding a better fit than the real data was p < 10(-7). The combination of multielectrode recording, multiinput visual stimulation and common time function DSL analysis can provide a detailed retinotopic map of visual cortex that has high correspondence with independent fMRI localization analysis on the same subject.

Bias-free double judgment accuracy during spatial attention cueing: performance enhancement from voluntary and involuntary attention.

Recent research has demonstrated that involuntary attention improves target identification accuracy for letters using non-predictive peripheral cues, helping to resolve some of the controversy over performance enhancement from involuntary attention. While various cueing studies have demonstrated that their reported cueing effects were not due to response bias to the cue, very few investigations have quantified the extent of any response bias or developed methods of removing bias from observed results in a double judgment accuracy task. We have devised a method to quantify and remove response bias to cued locations in a double judgment accuracy cueing task, revealing the true, unbiased performance enhancement from involuntary and voluntary attention. In a 7-alternative forced choice cueing task using backward masked stimuli to temporally constrain stimulus processing, non-predictive cueing increased target detection and discrimination at cued locations relative to uncued locations even after cue location bias had been corrected.

Bias corrected double judgment accuracy during spatial attention cueing: unmasked stimuli with non-predictive and semi-predictive cues.

The present experiments indicate that in a 7-AFC double judgment accuracy task with unmasked stimuli, cue location response bias can be quantified and removed, revealing unbiased improvements in response accuracy for valid cues compared to invalid cues. By testing for cueing effects over a range of contrast levels with unmasked stimuli, changes in the psychometric function were examined and provide insight into the mechanisms of involuntary attention which might account for the observed cueing effects. Cue validity was varied between two separate experiments showing that non-predictive (14.3%) and moderately-predictive cues (50%) equally facilitate stimulus identification and localization during transient involuntary attention capture. Observers had improved accuracy at identifying both the location and the feature identity of target letters throughout a range of contrast levels, without any dependence on backward masking. There was a leftward shift of the psychometric function threshold with valid cued data and no slope reduction suggesting that any additive hypothesis based on spatial uncertainty reduction or perceptual enhancement is not a sufficient explanation for the observed cueing effects. The interdependence of the perceptual processes of stimulus discrimination and localization were also investigated by analyzing response contingencies, showing that observers were equally skilled at making identification and localization accuracy judgments with unmasked stimuli.

Analysis of microsaccades and pupil dilation reveals a common decisional origin during visual search.

During free viewing visual search, observers often refixate the same locations several times before and after target detection is reported with a button press. We analyzed the rate of microsaccades in the sequence of refixations made during visual search and found two important components. One related to the visual content of the region being fixated; fixations on targets generate more microsaccades and more microsaccades are generated for those targets that are more difficult to disambiguate. The other empathizes non-visual decisional processes; fixations containing the button press generate more microsaccades than those made on the same target but without the button press. Pupil dilation during the same refixations reveals a similar modulation. We inferred that generic sympathetic arousal mechanisms are part of the articulated complex of perceptual processes governing fixational eye movements.

Involuntary attention enhances identification accuracy for unmasked low contrast letters using non-predictive peripheral cues.

There is controversy regarding whether or not involuntary attention improves response accuracy at a cued location when the cue is non-predictive and if these cueing effects are dependent on backward masking. Various perceptual and decisional mechanisms of performance enhancement have been proposed, such as signal enhancement, noise reduction, spatial uncertainty reduction, and decisional processes. Herein we review a recent report of mask-dependent accuracy improvements with low contrast stimuli and demonstrate that the experiments contained stimulus artifacts whereby the cue impaired perception of low contrast stimuli, leading to an absence of improved response accuracy with unmasked stimuli. Our experiments corrected these artifacts by implementing an isoluminant cue and increasing its distance relative to the targets. The results demonstrate that cueing effects are robust for unmasked stimuli presented in the periphery, resolving some of the controversy concerning cueing enhancement effects from involuntary attention and mask dependency. Unmasked low contrast and/or short duration stimuli as implemented in these experiments may have a short enough iconic decay that the visual system functions similarly as if a mask were present leading to improved accuracy with a valid cue.

The fixation and saccade P3.

Although most instances of object recognition during natural viewing occur in the presence of saccades, the neural correlates of objection recognition have almost exclusively been examined during fixation. Recent studies have indicated that there are post-saccadic modulations of neural activity immediately following eye movement landing; however, whether post-saccadic modulations affect relatively late occurring cognitive components such as the P3 has not been explored. The P3 as conventionally measured at fixation is commonly used in brain computer interfaces, hence characterizing the post-saccadic P3 could aid in the development of improved brain computer interfaces that allow for eye movements. In this study, the P3 observed after saccadic landing was compared to the P3 measured at fixation. No significant differences in P3 start time, temporal persistence, or amplitude were found between fixation and saccade trials. Importantly, sensory neural responses canceled in the target minus distracter comparisons used to identify the P3. Our results indicate that relatively late occurring cognitive neural components such as the P3 are likely less sensitive to post saccadic modulations than sensory neural components and other neural activity occurring shortly after eye movement landing. Furthermore, due to the similarity of the fixation and saccade P3, we conclude that the P3 following saccadic landing could possibly be used as a viable signal in brain computer interfaces allowing for eye movements.

Crowding in peripheral vision: why bigger is better.

We enjoy the illusion that visual resolution is high across the entire field of vision. However, this illusion can be easily dispelled by trying to identify objects in a cluttered environment out of the corner of your eye. This reflects, in part, the well-known decline in visual resolution in peripheral vision; however, the main bottleneck for reading or object recognition in peripheral vision is crowding. Objects that can be easily identified in isolation seem indistinct and jumbled in clutter. Crowding is thought to reflect inappropriate integration of the target and flankers in peripheral vision [1, 2]. Here, we uncover and explain a paradox in peripheral crowding: under certain conditions, increasing the size or number of flanking rings results in a paradoxical decrease in the magnitude of crowding-i.e., the bigger or more numerous the flanks, the smaller the crowding. These surprising results are predicted by a model in which crowding is determined by the centroids of approximately 4-8 independent features within approximately 0.5x the target eccentricity. These features are then integrated into a texture beyond the stage of feature analysis. We speculate that this process may contribute to the illusion of high resolution across the field of vision.

Decision-level fusion of EEG and pupil features for single-trial visual detection analysis.

Several recent studies have reported success in applying EEG-based signal analysis to achieve accurate single-trial classification of responses to visual target detection. Pupil responses are proposed as a complementary modality that can support improved accuracy of single-trial signal analysis. We develop a pupillary response feature-extraction and -selection procedure that helps to improve the classification performance of a system based only on EEG signal analysis. We apply a two-level linear classifier to obtain cognitive-task-related analysis of EEG and pupil responses. The classification results based on the two modalities are then fused at the decision level. Here, the goal is to support increased classification confidence through the inherent modality complementarities. The fusion results show significant improvement over classification performance based on a single modality.