Examining the role of action-driven attention in ensemble processing.

Ensemble processing allows the visual system to condense visual information into useful summary statistics (e.g., average size), thereby overcoming capacity limitations to visual working memory and attention. To examine the role of attention in ensemble processing, we conducted three experiments using a novel paradigm that merged the action effect (a manipulation of attention) and ensemble processing. Participants were instructed to make a simple action if the feature of a cue word corresponded to a subsequent shape. Immediately after, they were shown an ensemble display of eight ovals of varying sizes and were asked to report either the average size of all ovals or the size of a single oval from the set. In Experiments 1 and 2, participants were cued with a task-relevant feature, and in Experiment 3, participants were cued with a task-irrelevant feature. Overall, the task-relevant cues that elicited an action influenced reports of average size in the ensemble phase more than the cues that were passively viewed, whereas task-irrelevant cues did not bias the reports of average size. The results of this study suggest that attention influences ensemble processing only when it is directed toward a task-relevant feature.

Multi-response deconvolution of auditory evoked potentials in a reduced representation space.

The estimation of auditory evoked potentials requires deconvolution when the duration of the responses to be recovered exceeds the inter-stimulus interval. Based on least squares deconvolution, in this article we extend the procedure to the case of a multi-response convolutional model, that is, a model in which different categories of stimulus are expected to evoke different responses. The computational cost of the multi-response deconvolution significantly increases with the number of responses to be deconvolved, which restricts its applicability in practical situations. In order to alleviate this restriction, we propose to perform the multi-response deconvolution in a reduced representation space associated with a latency-dependent filtering of auditory responses, which provides a significant dimensionality reduction. We demonstrate the practical viability of the multi-response deconvolution with auditory responses evoked by clicks presented at different levels and categorized according to their stimulation level. The multi-response deconvolution applied in a reduced representation space provides the least squares estimation of the responses with a reasonable computational load. matlab/Octave code implementing the proposed procedure is included as supplementary material.

Modulation of response times in early-stage Parkinson's disease during emotional processing of embodied and non-embodied stimuli.

Valence (positive and negative) and content (embodied vs non-embodied) characteristics of visual stimuli have been shown to influence motor readiness, as tested with response time paradigms. Both embodiment and emotional processing are affected in Parkinson's disease (PD) due to basal ganglia dysfunction. Here we aimed to investigate, using a two-choice response time paradigm, motor readiness when processing embodied (emotional body language [EBL] and emotional facial expressions [FACS]) vs non-embodied (emotional scenes [IAPS]) stimuli with neutral, happy, and fearful content. We enrolled twenty-five patients with early-stage PD and twenty-five age matched healthy participants. Motor response during emotional processing was assessed by measuring response times (RTs) in a home-based, forced two-choice discrimination task where participants were asked to discriminate the emotional stimulus from the neutral one. Rating of valence and arousal was also performed. A clinical and neuropsychological evaluation was performed on PD patients. Results showed that RTs for PD patients were longer for all conditions compared to HC and that RTs were generally longer in both groups for EBL compared to FACS and IAPS, with the sole exception retrieved for PD, where in discriminating fearful stimuli, RTs for EBL were longer compared to FACS but not to IAPS. Furthermore, in PD only, when discriminating fearful respect to neutral stimuli, RTs were shorter when discriminating FACS compared to IAPS. This study shows that PD patients were faster in discriminating fearful embodied stimuli, allowing us to speculate on mechanisms involving an alternative, compensatory, emotional motor pathway for PD patients undergoing fear processing.

Differences in visuospatial cognition among table tennis players of different skill levels: an event-related potential study.

This study aimed to examine the influence of sport skill levels on behavioural and neuroelectric performance in visuospatial attention and memory visuospatial tasks were administered to 54 participants, including 18 elite and 18 amateur table tennis players and 18 nonathletes, while event-related potentials were recorded. In all the visuospatial attention and memory conditions, table tennis players displayed faster reaction times than nonathletes, regardless of skill level, although there was no difference in accuracy between groups. In addition, regardless of task conditions, both player groups had a greater P3 amplitude than nonathletes, and elite players exhibited a greater P3 amplitude than amateurs players. The results of this study indicate that table tennis players, irrespective of their skill level, exhibit enhanced visuospatial capabilities. Notably, athletes at the elite level appear to benefit from an augmented allocation of attentional resources when engaging in visuospatial tasks.

Attention deployment in natural scenes: Higher-order scene statistics rather than semantics modulate the N2pc component.

Which properties of a natural scene affect visual search? We consider the alternative hypotheses that low-level statistics, higher-level statistics, semantics, or layout affect search difficulty in natural scenes. Across three experiments (n = 20 each), we used four different backgrounds that preserve distinct scene properties: (a) natural scenes (all experiments); (b) 1/f noise (pink noise, which preserves only low-level statistics and was used in Experiments 1 and 2); (c) textures that preserve low-level and higher-level statistics but not semantics or layout (Experiments 2 and 3); and (d) inverted (upside-down) scenes that preserve statistics and semantics but not layout (Experiment 2). We included "split scenes" that contained different backgrounds left and right of the midline (Experiment 1, natural/noise; Experiment 3, natural/texture). Participants searched for a Gabor patch that occurred at one of six locations (all experiments). Reaction times were faster for targets on noise and slower on inverted images, compared to natural scenes and textures. The N2pc component of the event-related potential, a marker of attentional selection, had a shorter latency and a higher amplitude for targets in noise than for all other backgrounds. The background contralateral to the target had an effect similar to that on the target side: noise led to faster reactions and shorter N2pc latencies than natural scenes, although we observed no difference in N2pc amplitude. There were no interactions between the target side and the non-target side. Together, this shows that-at least when searching simple targets without own semantic content-natural scenes are more effective distractors than noise and that this results from higher-order statistics rather than from semantics or layout.

Addressing the Association Between Action Video Game Playing Experience and Visual Search in Naturalistic Multisensory Scenes.

Prior studies investigating the effects of routine action video game play have demonstrated improvements in a variety of cognitive processes, including improvements in attentional tasks. However, there is little evidence indicating that the cognitive benefits of playing action video games generalize from simplified unisensory stimuli to multisensory scenes - a fundamental characteristic of natural, everyday life environments. The present study addressed if video game experience has an impact on crossmodal congruency effects when searching through such multisensory scenes. We compared the performance of action video game players (AVGPs) and non-video game players (NVGPs) on a visual search task for objects embedded in video clips of realistic scenes. We conducted two identical online experiments with gender-balanced samples, for a total of N = 130. Overall, the data replicated previous findings reporting search benefits when visual targets were accompanied by semantically congruent auditory events, compared to neutral or incongruent ones. However, according to the results, AVGPs did not consistently outperform NVGPs in the overall search task, nor did they use multisensory cues more efficiently than NVGPs. Exploratory analyses with self-reported gender as a variable revealed a potential difference in response strategy between experienced male and female AVGPs when dealing with crossmodal cues. These findings suggest that the generalization of the advantage of AVG experience to realistic, crossmodal situations should be made with caution and considering gender-related issues.

Perceived Audio-Visual Simultaneity Is Recalibrated by the Visual Intensity of the Preceding Trial.

A vital heuristic used when making judgements on whether audio-visual signals arise from the same event, is the temporal coincidence of the respective signals. Previous research has highlighted a process, whereby the perception of simultaneity rapidly recalibrates to account for differences in the physical temporal offsets of stimuli. The current paper investigated whether rapid recalibration also occurs in response to differences in central arrival latencies, driven by visual-intensity-dependent processing times. In a behavioural experiment, observers completed a temporal-order judgement (TOJ), simultaneity judgement (SJ) and simple reaction-time (RT) task and responded to audio-visual trials that were preceded by other audio-visual trials with either a bright or dim visual stimulus. It was found that the point of subjective simultaneity shifted, due to the visual intensity of the preceding stimulus, in the TOJ, but not SJ task, while the RT data revealed no effect of preceding intensity. Our data therefore provide some evidence that the perception of simultaneity rapidly recalibrates based on stimulus intensity.

Lessons learned from an fMRI-guided rTMS study on performance in a numerical Stroop task.

The Stroop task is a well-established tool to investigate the influence of competing visual categories on decision making. Neuroimaging as well as rTMS studies have demonstrated the involvement of parietal structures, particularly the intraparietal sulcus (IPS), in this task. Given its reliability, the numerical Stroop task was used to compare the effects of different TMS targeting approaches by Sack and colleagues (Sack AT 2009), who elegantly demonstrated the superiority of individualized fMRI targeting. We performed the present study to test whether fMRI-guided rTMS effects on numerical Stroop task performance could still be observed while using more advanced techniques that have emerged in the last decade (e.g., electrical sham, robotic coil holder system, etc.). To do so we used a traditional reaction time analysis and we performed, post-hoc, a more advanced comprehensive drift diffusion modeling approach. Fifteen participants performed the numerical Stroop task while active or sham 10 Hz rTMS was applied over the region of the right intraparietal sulcus (IPS) showing the strongest functional activation in the Incongruent > Congruent contrast. This target was determined based on individualized fMRI data collected during a separate session. Contrary to our assumption, the classical reaction time analysis did not show any superiority of active rTMS over sham, probably due to confounds such as potential cumulative rTMS effects, and the effect of practice. However, the modeling approach revealed a robust effect of rTMS on the drift rate variable, suggesting differential processing of congruent and incongruent properties in perceptual decision-making, and more generally, illustrating that more advanced computational analysis of performance can elucidate the effects of rTMS on the brain where simpler methods may not.

Flexible processing of distractor stimuli under stress.

Acute stress is assumed to affect executive processing of stimulus information, although extant studies have yielded heterogeneous findings. The temporal flanker task, in which a target stimulus is preceded by a distractor of varying utility, offers a means of investigating various components involved in the adjustment of information processing and conflict control. Both behavioral and EEG data obtained with this task suggest stronger distractor-related response activation in conditions associated with higher predictivity of the distractor for the upcoming target. In two experiments we investigated distractor-related processing and conflict control after inducing acute stress (Trier Social Stress Test). Although the stressed groups did not differ significantly from unstressed control groups concerning behavioral markers of attentional adjustment (i.e., Proportion Congruent Effect), or event-related sensory components in the EEG (i.e., posterior P1 and N1), the lateralized readiness potential demonstrated reduced activation evoked by (predictive) distractor information under stress. Our results suggest flexible adjustment of attention under stress but hint at decreased usage of nominally irrelevant stimulus information for biasing response selection.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

The effects of verbal and spatial working memory on short- and long-latency sensorimotor circuits in the motor cortex.

Multiple sensorimotor loops converge in the motor cortex to create an adaptable system capable of context-specific sensorimotor control. Afferent inhibition provides a non-invasive tool to investigate the substrates by which procedural and cognitive control processes interact to shape motor corticospinal projections. Varying the transcranial magnetic stimulation properties during afferent inhibition can probe specific sensorimotor circuits that contribute to short- and long-latency periods of inhibition in response to the peripheral stimulation. The current study used short- (SAI) and long-latency (LAI) afferent inhibition to probe the influence of verbal and spatial working memory load on the specific sensorimotor circuits recruited by posterior-anterior (PA) and anterior-posterior (AP) TMS-induced current. Participants completed two sessions where SAI and LAI were assessed during the short-term maintenance of two- or six-item sets of letters (verbal) or stimulus locations (spatial). The only difference between the sessions was the direction of the induced current. PA SAI decreased as the verbal working memory load increased. In contrast, AP SAI was not modulated by verbal working memory load. Visuospatial working memory load did not affect PA or AP SAI. Neither PA LAI nor AP LAI were sensitive to verbal or spatial working memory load. The dissociation of short-latency PA and AP sensorimotor circuits and short- and long-latency PA sensorimotor circuits with increasing verbal working memory load support multiple convergent sensorimotor loops that provide distinct functional information to facilitate context-specific supraspinal control.

The Latency of Auditory Event-Related Potential P300 Prolonged in School-Age Students with Unilateral Hearing Loss in a Mandarin Learning Environment.

Our study investigated the differences in speech performance and neurophysiological response in groups of school-age children with unilateral hearing loss (UHL) who were otherwise typically developing (TD). We recruited a total of 16 primary school-age children for our study (UHL = 9/TD = 7), who were screened by doctors at Shin Kong Wu-Ho-Su Memorial Hospital. We used the Peabody Picture Vocabulary Test-Revised (PPVT-R) to test word comprehension, and the PPVT-R percentile rank (PR) value was proportional to the auditory memory score (by The Children's Oral Comprehension Test) in both groups. Later, we assessed the latency and amplitude of auditory ERP P300 and found that the latency of auditory ERP P300 in the UHL group was prolonged compared with that in the TD group. Although students with UHL have typical hearing in one ear, based on our results, long-term UHL might be the cause of atypical organization of brain areas responsible for auditory processing or even visual perceptions attributed to speech delay and learning difficulties.

Anodal transcranial direct current stimulation enhances response inhibition and attention allocation in fencers.

Background: The aim of this study is to investigate the acute effects of anodal transcranial direct current stimulation (tDCS) on reaction time, response inhibition and attention in fencers. Methods: Sixteen professional female fencers were recruited, and subjected to anodal tDCS and sham stimulation in the primary motor area (M1) one week apart in a randomized, crossover, single-blind design. A two-factor analysis of variance with repeated measures was used to analyze the effects of stimulation conditions (anodal stimulation, sham stimulation) and time (pre-stimulation, post-stimulation) on reaction time, response inhibition, and attention in fencers. Results: The study found a significant improvement in response inhibition and attention allocation from pre-stimulation to post-stimulation following anodal tDCS but not after sham stimulation. There was no statistically significant improvement in reaction time and selective attention. Conclusions: A single session of anodal tDCS could improve response inhibition, attention allocation in female fencers. This shows that tDCS has potential to improve aspects of an athlete's cognitive performance, although we do not know if such improvements would transfer to improved performance in competition. However, more studies involving all genders, large samples, and different sports groups are needed in the future to further validate the effect of tDCS in improving the cognitive performance of athletes.

Pulling the lever in a hurry: the influence of impulsivity and sensitivity to reward on moral decision-making under time pressure.

BACKGROUND: Making timely moral decisions can save a life. However, literature on how moral decisions are made under time pressure reports conflicting results. Moreover, it is unclear whether and how moral choices under time pressure may be influenced by personality traits like impulsivity and sensitivity to reward and punishment. METHODS: To address these gaps, in this study we employed a moral dilemma task, manipulating decision time between participants: one group (N = 25) was subjected to time pressure (TP), with 8 s maximum time for response (including the reading time), the other (N = 28) was left free to take all the time to respond (noTP). We measured type of choice (utilitarian vs. non-utilitarian), decision times, self-reported unpleasantness and arousal during decision-making, and participants' impulsivity and BIS-BAS sensitivity. RESULTS: We found no group effect on the type of choice, suggesting that time pressure per se did not influence moral decisions. However, impulsivity affected the impact of time pressure, in that individuals with higher cognitive instability showed slower response times under no time constraint. In addition, higher sensitivity to reward predicted a higher proportion of utilitarian choices regardless of the time available for decision. CONCLUSIONS: Results are discussed within the dual-process theory of moral judgement, revealing that the impact of time pressure on moral decision-making might be more complex and multifaceted than expected, potentially interacting with a specific facet of attentional impulsivity.

The effect of visual sensory interference during multitask obstacle crossing in younger and older adults.

When older adults step over obstacles during multitasking, their performance is impaired; the impairment results from central and/or sensory interference. The purpose was to determine if sensory interference alters performance under low levels of cognitive, temporal, and gait demand, and if the change in performance is different for younger versus older adults. Participants included 17 younger adults (20.9±1.9 years) and 14 older adults (69.7±5.4 years). The concurrent task was a single, simple reaction time (RT) task: depress button in response to light cue. The gait task was stepping over an obstacle (8 m walkway) in three conditions: (1) no sensory interference (no RT task), (2) low sensory interference (light cue on obstacle, allowed concurrent foveation of cue and obstacle), or (3) high sensory interference (light cue away from obstacle, prevented concurrent foveation of cue and obstacle). When standing, the light cue location was not relevant (no sensory interference). An interaction (sensory interference by task, p<0.01) indicated that RT was longer for high sensory interference during walking, but RT was not altered for standing, confirming that sensory interference increased RT during obstacle approach. An interaction (sensory interference by age, p<0.01) was observed for foot placement before the obstacle: With high sensory interference, younger adults placed the trail foot closer to the obstacle while older adults placed it farther back from the obstacle. The change increases the likelihood of tripping with the trail foot for younger adults, but with the lead limb for older adults. Recovery from a lead limb trip is more difficult due to shorter time for corrective actions. Overall, visual sensory interference impaired both RT and gait behavior with low levels of multitask demand. Changes in foot placement increased trip risk for both ages, but for different limbs, reducing the likelihood of balance recovery in older adults.

Mindfulness and inhibitory control: Insights from the stop signal task with neutral and reward-associated stimuli.

Mindfulness has been linked to enhanced inhibitory control, yet the dynamics of this relationship, especially in reward situations, are not well understood. Our cross-sectional study aimed to explore the relationship between trait mindfulness and a performance measure of inhibitory control as a function of reward context operationalized by stimuli characteristics, and temporal inhibitory demands. Thirty-six individuals aged 19 to 41 filled out the Mindful Attention Awareness Scale (MAAS) and performed a stop signal task (SST), that included both neutral (stone images) and reward-related (money images) stimuli. The SST encompassed four conditions: neutral go/neutral stop, neutral go/reward stop, reward go/neutral stop, and reward go/reward stop, requiring participants to suppress reactions either during or after encountering reward-related stimuli. The relevant index of inhibitory control is the stop signal reaction time (SSRT), a performance measure of inhibitory control. Our findings showed no notable variation in the relationship between the MAAS score and SSRT across the different conditions. However, there was an overall significant effect of MAAS score on SSRT, irrespective of condition. Results may reflect the benefit of mindfulness on inhibitory control after generalized reward exposure.

Visual bodily signals and conversational context benefit the anticipation of turn ends.

The typical pattern of alternating turns in conversation seems trivial at first sight. But a closer look quickly reveals the cognitive challenges involved, with much of it resulting from the fast-paced nature of conversation. One core ingredient to turn coordination is the anticipation of upcoming turn ends so as to be able to ready oneself for providing the next contribution. Across two experiments, we investigated two variables inherent to face-to-face conversation, the presence of visual bodily signals and preceding discourse context, in terms of their contribution to turn end anticipation. In a reaction time paradigm, participants anticipated conversational turn ends better when seeing the speaker and their visual bodily signals than when they did not, especially so for longer turns. Likewise, participants were better able to anticipate turn ends when they had access to the preceding discourse context than when they did not, and especially so for longer turns. Critically, the two variables did not interact, showing that visual bodily signals retain their influence even in the context of preceding discourse. In a pre-registered follow-up experiment, we manipulated the visibility of the speaker's head, eyes and upper body (i.e. torso + arms). Participants were better able to anticipate turn ends when the speaker's upper body was visible, suggesting a role for manual gestures in turn end anticipation. Together, these findings show that seeing the speaker during conversation may critically facilitate turn coordination in interaction.

Multitasking across the lifespan in different task contexts.

We assessed lifespan development of multitasking in a sample of 187 individuals aged 8-82 years. Participants performed a visuo-spatial working memory (VSWM) task together with either postural control or reaction time (RT) tasks. Using criterion-referenced testing we individually adjusted difficulty levels for the VSWM task to control for single-task differences. Age-differences in single-task performances followed U-shaped patterns with young adults outperforming children and older adults. Multitasking manipulations yielded robust performance decrements in VSWM, postural control and RT tasks. Presumably due to our adjustment of VSWM challenges, costs in this task were small and similar across age groups suggesting that age-differential costs found in earlier studies largely reflected differences already present during single-task performance. Age-differences in multitasking costs for concurrent tasks depended on specific combinations. For VSWM and RT task combinations increases in RT were the smallest for children but pronounced in adults highlighting the role of cognitive control processes. Stabilogram diffusion analysis of postural control demonstrated that long-term control mechanisms were affected by concurrent VSWM demands. This interference was pronounced in older adults supporting concepts of compensation or increased cognitive involvement in sensorimotor processes at older age. Our study demonstrates how a lifespan approach can delineate the explanatory scope of models of human multitasking.

The neurocognitive mechanism linking temperature and humidity with miners' alertness: an fNIRS study.

As the depth of coal mining increases, the temperature and humidity of the underground environment also rise, which can negatively impact the physiological health of miners, and may even pose a threat to their safety and lives. However, studies on the neurocognitive mechanisms underlying the relationship between temperature, humidity, and miners' alertness are scant. This study investigates several research objectives: (A) the differences in reaction time and error rate in different temperature and humidity conditions, which factor has a greater impact; (B) the differences in the levels of Oxy-Hb in different conditions and which factor has a greater impact; (C) the differences of activation degree between different regions of interest; and (D) the differences in the shape of Oxy-Hb time course between different conditions between different regions of interests. The fNIRS was used to measure the activity in 100 participants' prefrontal cortex in this study. The results showed that both temperature and humidity would lead to decreased alertness of miners, which would not only prolong the reaction time, increase the error rate, and increase the Oxy-Hb concentration, but also lead to increased activation of the prefrontal cortex and greater activation of the right side than that of the left side, the Oxy-Hb time course was different on both sides, and temperature has a greater effect on alertness than humidity.

Microsaccade-inspired event camera for robotics.

Neuromorphic vision sensors or event cameras have made the visual perception of extremely low reaction time possible, opening new avenues for high-dynamic robotics applications. These event cameras' output is dependent on both motion and texture. However, the event camera fails to capture object edges that are parallel to the camera motion. This is a problem intrinsic to the sensor and therefore challenging to solve algorithmically. Human vision deals with perceptual fading using the active mechanism of small involuntary eye movements, the most prominent ones called microsaccades. By moving the eyes constantly and slightly during fixation, microsaccades can substantially maintain texture stability and persistence. Inspired by microsaccades, we designed an event-based perception system capable of simultaneously maintaining low reaction time and stable texture. In this design, a rotating wedge prism was mounted in front of the aperture of an event camera to redirect light and trigger events. The geometrical optics of the rotating wedge prism allows for algorithmic compensation of the additional rotational motion, resulting in a stable texture appearance and high informational output independent of external motion. The hardware device and software solution are integrated into a system, which we call artificial microsaccade-enhanced event camera (AMI-EV). Benchmark comparisons validated the superior data quality of AMI-EV recordings in scenarios where both standard cameras and event cameras fail to deliver. Various real-world experiments demonstrated the potential of the system to facilitate robotics perception both for low-level and high-level vision tasks.