Rapid saccadic categorization of other-race faces.

The human visual system is very fast and efficient at extracting socially relevant information from faces. Visual studies employing foveated faces have consistently reported faster categorization by race response times for other-race compared with same-race faces. However, in everyday life we typically encounter faces outside the foveated visual field. In study 1, we explored whether and how race is categorized extrafoveally in same- and other-race faces normalized for low-level properties by tracking eye movements of Western Caucasian and East Asian observers in a saccadic response task. The results show that not only are people sensitive to race in faces presented outside of central vision, but the speed advantage in categorizing other-race faces occurs astonishingly quickly in as little as 200 ms. Critically, this visual categorization process was approximately 300 ms faster than the typical button press responses on centrally presented foveated faces. Study 2 investigated the genesis of the extrafoveal saccadic response speed advantage by comparing the influences of the response modality (button presses and saccadic responses), as well as the potential contribution of the impoverished low-spatial frequency spectrum characterizing extrafoveal visual information processing. Button press race categorization was not significantly faster with reconstructed retinal-filtered low spatial frequency faces, regardless of the visual field presentation. The speed of race categorization was significantly boosted only by extrafoveal saccades and not centrally foveated faces. Race is a potent, rapid, and effective visual signal transmitted by faces used for the categorization of ingroup/outgroup members. This fast universal visual categorization can occur outside central vision, igniting a cascade of social processes.

Children reading spoken words: interactions between vocabulary and orthographic expectancy.

There is an established association between children's oral vocabulary and their word reading but its basis is not well understood. Here, we present evidence from eye movements for a novel mechanism underlying this association. Two groups of 18 Grade 4 children received oral vocabulary training on one set of 16 novel words (e.g., 'nesh', 'coib'), but no training on another set. The words were assigned spellings that were either predictable from phonology (e.g., nesh) or unpredictable (e.g., koyb). These were subsequently shown in print, embedded in sentences. Reading times were shorter for orally familiar than unfamiliar items, and for words with predictable than unpredictable spellings but, importantly, there was an interaction between the two: children demonstrated a larger benefit of oral familiarity for predictable than for unpredictable items. These findings indicate that children form initial orthographic expectations about spoken words before first seeing them in print. A video abstract of this article can be viewed at: https://youtu.be/jvpJwpKMM3E.

Adaptive Motor Imagery: A Multimodal Study of Immobilization-Induced Brain Plasticity.

The consequences of losing the ability to move a limb are traumatic. One approach that examines the impact of pathological limb nonuse on the brain involves temporary immobilization of a healthy limb. Here, we investigated immobilization-induced plasticity in the motor imagery (MI) circuitry during hand immobilization. We assessed these changes with a multimodal paradigm, using functional magnetic resonance imaging (fMRI) to measure neural activation, magnetoencephalography (MEG) to track neuronal oscillatory dynamics, and transcranial magnetic stimulation (TMS) to assess corticospinal excitability. fMRI results show a significant decrease in neural activation for MI of the constrained hand, localized to sensorimotor areas contralateral to the immobilized hand. MEG results show a significant decrease in beta desynchronization and faster resynchronization in sensorimotor areas contralateral to the immobilized hand. TMS results show a significant increase in resting motor threshold in motor cortex contralateral to the constrained hand, suggesting a decrease in corticospinal excitability in the projections to the constrained hand. These results demonstrate a direct and rapid effect of immobilization on MI processes of the constrained hand, suggesting that limb nonuse may not only affect motor execution, as evidenced by previous studies, but also MI. These findings have important implications for the effectiveness of therapeutic approaches that use MI as a rehabilitation tool to ameliorate the negative effects of limb nonuse.

The neural time course of evaluating self-initiated joint attention bids.

BACKGROUND: During interactions with other people, we constantly evaluate the significance of our social partner's gaze shifts in order to coordinate our behaviour with their perspective. In this study, we used event-related potentials (ERPs) to investigate the neural time course of evaluating gaze shifts that signal the success of self-initiated joint attention bids. METHOD: Nineteen participants were allocated to a "social" condition, in which they played a cooperative game with an anthropomorphic virtual character whom they believed was controlled by a human partner in a nearby laboratory. Participants were required to initiate joint attention towards a target. In response, the virtual partner shifted his gaze congruently towards the target-thus achieving joint attention--or incongruently towards a different location. Another 19 participants completed the same task in a non-social "control" condition, in which arrows, believed to be controlled by a computer program, pointed at a location that was either congruent or incongruent with the participant's target fixation. RESULTS: In the social condition, ERPs to the virtual partner's incongruent gaze shifts evoked significantly larger P350 and P500 peaks compared to congruent gaze shifts. This P350 and P500 morphology was absent in both the congruent and incongruent control conditions. DISCUSSION: These findings are consistent with previous claims that gaze shifts differing in their social significance modulate central-parietal ERPs 350 ms following the onset of the gaze shift. Our control data highlights the social specificity of the observed P350 effect, ruling out explanations pertaining to attention modulation or error detection.

The speed of race.

When asked to categorize faces according to 'race', people typically categorize other-race faces faster than faces belonging to their own race. This 'Other Race Categorization Advantage' is thought to reflect enhanced sensitivity to early visual signals characteristic of other-race faces, and can manifest within 200 ms of face presentation. However, recent research has highlighted the importance of signal intensity in this effect, where visual-degradation of the face images significantly enhances the effect and exposes a behavioural threshold at very low levels of visual quality where other-race visual signals are able to be perceived while same-race signals are not. The current study investigated the effect of signal intensity in race categorization processes in the brain through electroencephalography and in accuracy/reaction times. While replicating the previously observed enhancement of the other-race categorization advantage, we also found enhanced sensitivity to other-race faces in early P1 peaks, as well as later N170 and N250 peaks. These effects, however, related to the varying levels of signal intensity in the face stimuli, suggesting that race categorization may involve different types of perceptual and neural processes rather than one discrete process. The speed at which race is perceived depends on the intensity of the face signal.

Race categorization in noise.

People are typically faster to categorize the race of a face if it belongs to a race different from their own. This Other Race Categorization Advantage (ORCA) is thought to reflect an enhanced sensitivity to the visual race signals of other race faces, leading to faster response times. The current study investigated this sensitivity in a cross-cultural sample of Swiss and Japanese observers with a race categorization task using faces that had been parametrically degraded of visual structure, with normalized luminance and contrast. While Swiss observers exhibited an increasingly strong ORCA in both reaction time and accuracy as the face images were visually degraded up to 20% structural coherence, the Japanese observers manifested this pattern most distinctly when the faces were fully structurally-intact. Critically, for both observer groups, there was a clear accuracy effect at the 20% structural coherence level, indicating that the enhanced sensitivity to other race visual signals persists in significantly degraded stimuli. These results suggest that different cultural groups may rely on and extract distinct types of visual race signals during categorization, which may depend on the available visual information. Nevertheless, heavily degraded stimuli specifically favor the perception of other race faces, indicating that the visual system is tuned by experience and is sensitive to the detection of unfamiliar signals.

EPOC outside the shield: comparing the performance of a consumer-grade EEG device in shielded and unshielded environments.

Low-cost, portable electroencephalography (EEG) devices have become commercially available in the last 10 years. One such system, Emotiv's EPOC, has been modified to allow event-related potential (ERP) research. Although the EPOC has been shown to provide data comparable to research-grade equipment and has been used in real-world settings, how EPOC performs without the electrical shielding, commonly used in research-grade laboratories, is yet to be systematically tested. In the current article we address this gap by conducting a simple EEG experiment in shielded and unshielded contexts. Participants (n = 13, mean age = 23.2 years, SD = 7.9) monitored the presentation of human versus wristwatch faces, responding whether the images were inverted or not. This method elicited the face-sensitive N170 ERP. In both shielded and unshielded contexts, the N170 amplitude was larger when participants viewed human faces and peaked later when a human face was inverted. More importantly, Bayesian analysis showed no difference in the N170 measured in the shielded and unshielded contexts. Further, the signal recorded in both contexts was highly correlated. The EPOC appears to reliably record EEG signals without a purpose-built electrically-shielded room.

In pursuit of visual attention: SSVEP frequency-tagging moving targets.

Previous research has shown that visual attention does not always exactly follow gaze direction, leading to the concepts of overt and covert attention. However, it is not yet clear how such covert shifts of visual attention to peripheral regions impact the processing of the targets we directly foveate as they move in our visual field. The current study utilised the co-registration of eye-position and EEG recordings while participants tracked moving targets that were embedded with a 30 Hz frequency tag in a Steady State Visually Evoked Potentials (SSVEP) paradigm. When the task required attention to be divided between the moving target (overt attention) and a peripheral region where a second target might appear (covert attention), the SSVEPs elicited by the tracked target at the 30 Hz frequency band were significantly, but transiently, lower than when participants did not have to covertly monitor for a second target. Our findings suggest that neural responses of overt attention are only briefly reduced when attention is divided between covert and overt areas. This neural evidence is in line with theoretical accounts describing attention as a pool of finite resources, such as the perceptual load theory. Altogether, these results have practical implications for many real-world situations where covert shifts of attention may discretely reduce visual processing of objects even when they are directly being tracked with the eyes.

Developing attentional control in naturalistic dynamic road crossing situations.

In the last 20 years, there has been increasing interest in studying visual attentional processes under more natural conditions. In the present study, we propose to determine the critical age at which children show similar to adult performance and attentional control in a visually guided task; in a naturalistic dynamic and socially relevant context: road crossing. We monitored visual exploration and crossing decisions in adults and children aged between 5 and 15 while they watched road traffic videos containing a range of traffic densities with or without pedestrians. 5-10 year old (y/o) children showed less systematic gaze patterns. More specifically, adults and 11-15 y/o children look mainly at the vehicles' appearing point, which is an optimal location to sample diagnostic information for the task. In contrast, 5-10 y/os look more at socially relevant stimuli and attend to moving vehicles further down the trajectory when the traffic density is high. Critically, 5-10 y/o children also make an increased number of crossing decisions compared to 11-15 y/os and adults. Our findings reveal a critical shift around 10 y/o in attentional control and crossing decisions in a road crossing task.

Beliefs about human agency influence the neural processing of gaze during joint attention.

The current study measured adults' P350 and N170 ERPs while they interacted with a character in a virtual reality paradigm. Some participants believed the character was controlled by a human ("avatar" condition, n = 19); others believed it was controlled by a computer program ("agent" condition, n = 19). In each trial, participants initiated joint attention in order to direct the character's gaze toward a target. In 50% of trials, the character gazed toward the target (congruent responses), and in 50% of trials the character gazed to a different location (incongruent response). In the avatar condition, the character's incongruent gaze responses generated significantly larger P350 peaks at centro-parietal sites than congruent gaze responses. In the agent condition, the P350 effect was strikingly absent. Left occipitotemporal N170 responses were significantly smaller in the agent condition compared to the avatar condition for both congruent and incongruent gaze shifts. These data suggest that beliefs about human agency may recruit mechanisms that discriminate the social outcome of a gaze shift after approximately 350 ms, and that these mechanisms may modulate the early perceptual processing of gaze. These findings also suggest that the ecologically valid measurement of social cognition may depend upon paradigms that simulate genuine social interactions.

Objective Assessment of Listening Effort: Coregistration of Pupillometry and EEG.

Listening to speech in noise is effortful, particularly for people with hearing impairment. While it is known that effort is related to a complex interplay between bottom-up and top-down processes, the cognitive and neurophysiological mechanisms contributing to effortful listening remain unknown. Therefore, a reliable physiological measure to assess effort remains elusive. This study aimed to determine whether pupil dilation and alpha power change, two physiological measures suggested to index listening effort, assess similar processes. Listening effort was manipulated by parametrically varying spectral resolution (16- and 6-channel noise vocoding) and speech reception thresholds (SRT; 50% and 80%) while 19 young, normal-hearing adults performed a speech recognition task in noise. Results of off-line sentence scoring showed discrepancies between the target SRTs and the true performance obtained during the speech recognition task. For example, in the SRT80% condition, participants scored an average of 64.7%. Participants' true performance levels were therefore used for subsequent statistical modelling. Results showed that both measures appeared to be sensitive to changes in spectral resolution (channel vocoding), while pupil dilation only was also significantly related to their true performance levels (%) and task accuracy (i.e., whether the response was correctly or partially recalled). The two measures were not correlated, suggesting they each may reflect different cognitive processes involved in listening effort. This combination of findings contributes to a growing body of research aiming to develop an objective measure of listening effort.

Monitoring Alpha Oscillations and Pupil Dilation across a Performance-Intensity Function.

Listening to degraded speech can be challenging and requires a continuous investment of cognitive resources, which is more challenging for those with hearing loss. However, while alpha power (8-12 Hz) and pupil dilation have been suggested as objective correlates of listening effort, it is not clear whether they assess the same cognitive processes involved, or other sensory and/or neurophysiological mechanisms that are associated with the task. Therefore, the aim of this study is to compare alpha power and pupil dilation during a sentence recognition task in 15 randomized levels of noise (-7 to +7 dB SNR) using highly intelligible (16 channel vocoded) and moderately intelligible (6 channel vocoded) speech. Twenty young normal-hearing adults participated in the study, however, due to extraneous noise, data from only 16 (10 females, 6 males; aged 19-28 years) was used in the Electroencephalography (EEG) analysis and 10 in the pupil analysis. Behavioral testing of perceived effort and speech performance was assessed at 3 fixed SNRs per participant and was comparable to sentence recognition performance assessed in the physiological test session for both 16- and 6-channel vocoded sentences. Results showed a significant interaction between channel vocoding for both the alpha power and the pupil size changes. While both measures significantly decreased with more positive SNRs for the 16-channel vocoding, this was not observed with the 6-channel vocoding. The results of this study suggest that these measures may encode different processes involved in speech perception, which show similar trends for highly intelligible speech, but diverge for more spectrally degraded speech. The results to date suggest that these objective correlates of listening effort, and the cognitive processes involved in listening effort, are not yet sufficiently well understood to be used within a clinical setting.

Meditation and auditory attention: An ERP study of meditators and non-meditators.

The findings of a study by Cahn and Polich (2009) suggests that there is an effect of a meditative state on three event-related potential (ERP) brain markers of "low-level" auditory attention (i.e., acoustic representations in sensory memory) in expert meditators: the N1, the P2, and the P3a. The current study built on these findings by examining trait and state effects of meditation on the passive auditory mismatch negativity (MMN), N1, and P2 ERPs. We found that the MMN was significantly larger in meditators than non-meditators regardless of whether they were meditating or not (a trait effect), and that N1 amplitude was significantly attenuated during meditation in non-meditators but not expert meditators (an interaction between trait and state). These outcomes suggest that low-level attention is superior in long-term meditators in general. In contrast, low-level attention is reduced in non-meditators when they are asked to meditate for the first time, possibly due to auditory fatigue or cognitive overload.

Measuring the face-sensitive N170 with a gaming EEG system: A validation study.

BACKGROUND: The N170 is a "face-sensitive" event-related potential (ERP) that occurs at around 170ms over occipito-temporal brain regions. The N170's potential to provide insight into the neural processing of faces in certain populations (e.g., children and adults with cognitive impairments) is limited by its measurement in scientific laboratories that can appear threatening to some people. NEW METHOD: The advent of cheap, easy-to-use portable gaming EEG systems provides an opportunity to record EEG in new contexts and populations. This study tested the validity of the face-sensitive N170 ERP measured with an adapted commercial EEG system (the Emotiv EPOC) that is used at home by gamers. RESULTS: The N170 recorded through both the gaming EEG system and the research EEG system exhibited face-sensitivity, with larger mean amplitudes in response to the face stimuli than the non-face stimuli, and a delayed N170 peak in response to face inversion. COMPARISON WITH EXISTING METHOD: The EPOC system produced very similar N170 ERPs to a research-grade Neuroscan system, and was capable of recording face-sensitivity in the N170, validating its use as research tool in this arena. CONCLUSIONS: This opens new possibilities for measuring the face-sensitive N170 ERP in people who cannot travel to a traditional ERP laboratory (e.g., elderly people in care), who cannot tolerate laboratory conditions (e.g., people with autism), or who need to be tested in situ for practical or experimental reasons (e.g., children in schools).

Fixation location on upright and inverted faces modulates the N170.

The current study used event-related potentials (ERP) in combination with a variable viewing position paradigm (VVPP) to direct fixations to specific face parts (eyes or mouths) in upright or inverted whole faces. The N170 elicited by the VVPP was greater to faces than to non-face objects (wristwatches), and was delayed and enhanced in response to face inversion. A larger N170 response was elicited when the participants׳ fixation was directed to the eyes than when directed to the mouths of both upright and inverted faces, an effect that was also modulated by the spatial location of the face in the visual field. The N170 face inversion effect (upright minus inverted) was greater when fixations were directed to the mouth than when directed to the eyes, suggesting that the point of fixation within a face modulates brain potentials due to contributions from the features themselves, as well as their relative location in the visual field.

Validation of the Emotiv EPOC(®) EEG gaming system for measuring research quality auditory ERPs.

Background. Auditory event-related potentials (ERPs) have proved useful in investigating the role of auditory processing in cognitive disorders such as developmental dyslexia, specific language impairment (SLI), attention deficit hyperactivity disorder (ADHD), schizophrenia, and autism. However, laboratory recordings of auditory ERPs can be lengthy, uncomfortable, or threatening for some participants - particularly children. Recently, a commercial gaming electroencephalography (EEG) system has been developed that is portable, inexpensive, and easy to set up. In this study we tested if auditory ERPs measured using a gaming EEG system (Emotiv EPOC(®), www.emotiv.com) were equivalent to those measured by a widely-used, laboratory-based, research EEG system (Neuroscan). Methods. We simultaneously recorded EEGs with the research and gaming EEG systems, whilst presenting 21 adults with 566 standard (1000 Hz) and 100 deviant (1200 Hz) tones under passive (non-attended) and active (attended) conditions. The onset of each tone was marked in the EEGs using a parallel port pulse (Neuroscan) or a stimulus-generated electrical pulse injected into the O1 and O2 channels (Emotiv EPOC(®)). These markers were used to calculate research and gaming EEG system late auditory ERPs (P1, N1, P2, N2, and P3 peaks) and the mismatch negativity (MMN) in active and passive listening conditions for each participant. Results. Analyses were restricted to frontal sites as these are most commonly reported in auditory ERP research. Intra-class correlations (ICCs) indicated that the morphology of the research and gaming EEG system late auditory ERP waveforms were similar across all participants, but that the research and gaming EEG system MMN waveforms were only similar for participants with non-noisy MMN waveforms (N = 11 out of 21). Peak amplitude and latency measures revealed no significant differences between the size or the timing of the auditory P1, N1, P2, N2, P3, and MMN peaks. Conclusions. Our findings suggest that the gaming EEG system may prove a valid alternative to laboratory ERP systems for recording reliable late auditory ERPs (P1, N1, P2, N2, and the P3) over the frontal cortices. In the future, the gaming EEG system may also prove useful for measuring less reliable ERPs, such as the MMN, if the reliability of such ERPs can be boosted to the same level as late auditory ERPs.