Dynamics in interbrain synchronization while playing a piano duet.

Humans interact with each other through actions that are implemented by sensory and motor processes. To investigate the role of interbrain synchronization emerging during interpersonal action coordination, electroencephalography data from 13 pairs of pianists were recorded simultaneously while they performed a duet together. The study aimed to investigate whether interbrain phase couplings can be reduced to similar bottom-up driven processes during synchronous play, or rather represent cognitive top-down control required during periods of higher coordination demands. To induce such periods, one of the musicians acted as a confederate who deliberately desynchronized the play. As intended, on the behavioral level, the perturbation caused a breakdown in the synchronization of the musicians' play and in its stability across trials. On the brain level, interbrain synchrony, as measured by the interbrain phase coherence (IPC), increased in the delta and theta frequency bands during perturbation as compared to non-perturbed trials. Interestingly, this increase in IPC in the delta band was accompanied by the shift of the phase difference angle from in-phase toward anti-phase synchrony. In conclusion, the current study demonstrates that interbrain synchronization is based on the interpersonal temporal alignment of different brain mechanisms and is not simply reducible to similar sensory or motor responses.

Modeling Biological Face Recognition with Deep Convolutional Neural Networks.

Deep convolutional neural networks (DCNNs) have become the state-of-the-art computational models of biological object recognition. Their remarkable success has helped vision science break new ground, and recent efforts have started to transfer this achievement to research on biological face recognition. In this regard, face detection can be investigated by comparing face-selective biological neurons and brain areas to artificial neurons and model layers. Similarly, face identification can be examined by comparing in vivo and in silico multidimensional "face spaces." In this review, we summarize the first studies that use DCNNs to model biological face recognition. On the basis of a broad spectrum of behavioral and computational evidence, we conclude that DCNNs are useful models that closely resemble the general hierarchical organization of face recognition in the ventral visual pathway and the core face network. In two exemplary spotlights, we emphasize the unique scientific contributions of these models. First, studies on face detection in DCNNs indicate that elementary face selectivity emerges automatically through feedforward processing even in the absence of visual experience. Second, studies on face identification in DCNNs suggest that identity-specific experience and generative mechanisms facilitate this particular challenge. Taken together, as this novel modeling approach enables close control of predisposition (i.e., architecture) and experience (i.e., training data), it may be suited to inform long-standing debates on the substrates of biological face recognition.

Guiding visual attention in deep convolutional neural networks based on human eye movements.

Deep Convolutional Neural Networks (DCNNs) were originally inspired by principles of biological vision, have evolved into best current computational models of object recognition, and consequently indicate strong architectural and functional parallelism with the ventral visual pathway throughout comparisons with neuroimaging and neural time series data. As recent advances in deep learning seem to decrease this similarity, computational neuroscience is challenged to reverse-engineer the biological plausibility to obtain useful models. While previous studies have shown that biologically inspired architectures are able to amplify the human-likeness of the models, in this study, we investigate a purely data-driven approach. We use human eye tracking data to directly modify training examples and thereby guide the models' visual attention during object recognition in natural images either toward or away from the focus of human fixations. We compare and validate different manipulation types (i.e., standard, human-like, and non-human-like attention) through GradCAM saliency maps against human participant eye tracking data. Our results demonstrate that the proposed guided focus manipulation works as intended in the negative direction and non-human-like models focus on significantly dissimilar image parts compared to humans. The observed effects were highly category-specific, enhanced by animacy and face presence, developed only after feedforward processing was completed, and indicated a strong influence on face detection. With this approach, however, no significantly increased human-likeness was found. Possible applications of overt visual attention in DCNNs and further implications for theories of face detection are discussed.

Self-efficacy matters: Influence of students' perceived self-efficacy on statistics anxiety.

Statistical knowledge is a key competency for psychologists in order to correctly interpret assessment outcomes. Importantly, when learning statistics (and its mathematical foundations), self-efficacy (defined as an individual's belief to successfully accomplish specific performance attainments) is a central predictor of students' motivation to learn, learning engagement, and actual achievement. Therefore, it is crucial to gain a better understanding of students' self-efficacy for statistics and its interrelations with statistics anxiety and students' belief in the relevance of statistics. Here, we present results showing development and validation of a self-assessment questionnaire for examining self-efficacy for statistics in psychology students (Self-Efficacy for Learning Statistics for Psychologists, SES-Psy). Upon using different methodological approaches, we demonstrate that the SES-Psy questionnaire has (1) sound psychometric properties, and within our sample of university students, (2) a robust latent structure disclosing three clearly distinctive profiles that are characterized by a complex and nonlinear interplay between perceived self-efficacy (for basic and advanced statistics), statistics anxiety, and students' belief in the relevance of statistics. Implications for educational settings and future research are discussed.

Comparing Object Recognition in Humans and Deep Convolutional Neural Networks-An Eye Tracking Study.

Deep convolutional neural networks (DCNNs) and the ventral visual pathway share vast architectural and functional similarities in visual challenges such as object recognition. Recent insights have demonstrated that both hierarchical cascades can be compared in terms of both exerted behavior and underlying activation. However, these approaches ignore key differences in spatial priorities of information processing. In this proof-of-concept study, we demonstrate a comparison of human observers (N = 45) and three feedforward DCNNs through eye tracking and saliency maps. The results reveal fundamentally different resolutions in both visualization methods that need to be considered for an insightful comparison. Moreover, we provide evidence that a DCNN with biologically plausible receptive field sizes called vNet reveals higher agreement with human viewing behavior as contrasted with a standard ResNet architecture. We find that image-specific factors such as category, animacy, arousal, and valence have a direct link to the agreement of spatial object recognition priorities in humans and DCNNs, while other measures such as difficulty and general image properties do not. With this approach, we try to open up new perspectives at the intersection of biological and computer vision research.

Investigating the Effects of Seizures on Procedural Memory Performance in Patients with Epilepsy.

Memory complaints are frequently reported by patients with epilepsy and are associated with seizure occurrence. Yet, the direct effects of seizures on memory retention are difficult to assess given their unpredictability. Furthermore, previous investigations have predominantly assessed declarative memory. This study evaluated within-subject effects of seizure occurrence on retention and consolidation of a procedural motor sequence learning task in patients with epilepsy undergoing continuous monitoring for five consecutive days. Of the total sample of patients considered for analyses (N = 53, Mage = 32.92 ± 13.80 y, range = 18-66 y; 43% male), 15 patients experienced seizures and were used for within-patient analyses. Within-patient contrasts showed general improvements over seizure-free (day + night) and seizure-affected retention periods. Yet, exploratory within-subject contrasts for patients diagnosed with temporal lobe epilepsy (n = 10) showed that only seizure-free retention periods resulted in significant improvements, as no performance changes were observed following seizure-affected retention. These results indicate general performance improvements and offline consolidation of procedural memory during the day and night. Furthermore, these results suggest the relevance of healthy temporal lobe functioning for successful consolidation of procedural information, as well as the importance of seizure control for effective retention and consolidation of procedural memory.

"How does Austria sleep?" self-reported sleep habits and complaints in an online survey.

During the past years, the prevalence of sleep problems has been increasing steadily in industrial societies and represents a major social and socioeconomic burden. The situation in Austria was last evaluated in 2007 by Zeitlhofer and colleagues in a representative sample of 1000 participants. In the current study, we sought to evaluate the sleep behaviour of the Austrian population in an ongoing online survey, in which we have collected data from 986 participants (66% women, mean age 40.9 ± 16.4 years) between March 2018 and May 2019. Sleep duration was appropriate in 52% of the respondents (i.e. 7-9 h per night). However, we found an alarmingly high number of self-reported sleep problems (46%), and only 31% of the participants classified themselves as "good sleepers" using a validated self-report questionnaire (Pittsburgh Sleep Quality Index, PSQI). Furthermore, many participants reported suffering from sleep problems for a very long time (86% > 6 months; 37% > 5 years) suggesting that currently available treatment options are either ineffective or not employed. Possible reasons for sleep problems could include irregular sleep-wake cycles, increased perceived stress levels, and the use of electronic devices just before sleep.

Coupling and Decoupling between Brain and Body Oscillations.

Cross frequency coupling is used to study the cross talk between brain oscillations. In this paper we focus on a special type of frequency coupling between brain and body oscillations, which is reflected by the numerical ratio (r) between two frequencies (m and n; n > m). This approach is motivated by theoretical considerations, indicating that during alert wakefulness brain-body oscillations form a coupled hierarchy of frequencies with integer relationships that are binary multiples (r = n:m = 1:2, 1:4, 1:8…..). During sleep we expect an irrational relationship (r = n/m = irrational number) between brain and body oscillations that reflects decoupling. We analyzed alpha frequency, heart rate, breathing frequency during performance of a memory tasks and in addition spindle frequency from data collected by the SIESTA sleep research group. As predicted, our results show a binary multiple frequency relationship between alpha, heart rate and breathing frequency during task performance but an irrational relationship between spindle frequency, heart rate and breathing frequency during sleep.

Event-related EEG power modulations and phase connectivity indicate the focus of attention in an auditory own name paradigm.

Estimating cognitive abilities in patients suffering from Disorders of Consciousness remains challenging. One cognitive task to address this issue is the so-called own name paradigm, in which subjects are presented with first names including the own name. In the active condition, a specific target name has to be silently counted. We recorded EEG during this task in 24 healthy controls, 8 patients suffering from Unresponsive Wakefulness Syndrome (UWS) and 7 minimally conscious (MCS) patients. EEG was analysed with respect to amplitude as well as phase modulations and connectivity. Results showed that general reactivity in the delta, theta and alpha frequency (event-related de-synchronisation, ERS/ERD, and phase locking between trials and electrodes) toward auditory stimulation was higher in controls than in patients. In controls, delta ERS and lower alpha ERD indexed the focus of attention in both conditions, late theta ERS only in the active condition. Additionally, phase locking between trials and delta phase connectivity was highest for own names in the passive and targets in the active condition. In patients, clear stimulus-specific differences could not be detected. However, MCS patients could reliably be differentiated from UWS patients based on their general event-related delta and theta increase independent of the type of stimulus. In conclusion, the EEG signature of the active own name paradigm revealed instruction-following in healthy participants. On the other hand, DOC patients did not show clear stimulus-specific processing. General reactivity toward any auditory input, however, allowed for a reliable differentiation between MCS and UWS patients.

Heartbeat-related EEG amplitude and phase modulations from wakefulness to deep sleep: Interactions with sleep spindles and slow oscillations.

Based on physiological models of neurovisceral integration, different studies have shown how cognitive processes modulate heart rate and how the heartbeat, on the other hand, modulates brain activity. We tried to further determine interactions between cardiac and electrical brain activity by means of EEG. We investigated how the heartbeat modulates EEG in 23 healthy controls from wakefulness to deep sleep and showed that frontocentral heartbeat evoked EEG amplitude and phase locking (as measured by intertrial phase locking), at about 300-400 ms after the R peak, decreased with increasing sleep depth with a renewed increase during REM sleep, which underpins the assumption that the heartbeat evoked positivity constitutes an active frontocortical response to the heartbeat. Additionally, we found that individual heart rate was correlated with the frequency of the EEG's spectral peak (i.e., alpha peak frequency during wakefulness). This correlation was strongest during wakefulness and declined linearly with increasing sleep depth. Furthermore, we show that the QRS complex modulates spindle phase possibly related to the correspondence between the frequency of the QRS complex and the spindle frequency of about 12-15 Hz. Finally, during deep sleep stages, a loose temporal coupling between heartbeats and slow oscillation (0.8 Hz) could be observed. These findings indicate that cardiac activity such as heart rate or individual heartbeats can modulate or be modulated by ongoing oscillatory brain activity.

Prestimulus amplitudes modulate P1 latencies and evoked traveling alpha waves.

Traveling waves have been well documented in the ongoing, and more recently also in the evoked EEG. In the present study we investigate what kind of physiological process might be responsible for inducing an evoked traveling wave. We used a semantic judgment task which already proved useful to study evoked traveling alpha waves that coincide with the appearance of the P1 component. We found that the P1 latency of the leading electrode is significantly correlated with prestimulus amplitude size and that this event is associated with a transient change in alpha frequency. We assume that cortical background excitability, as reflected by an increase in prestimulus amplitude, is responsible for the observed change in alpha frequency and the initiation of an evoked traveling trajectory.

Alpha phase, temporal attention, and the generation of early event related potentials.

In the present study, we have investigated the influence of ongoing alpha phase on the generation of the P1 component of the visual ERP, recorded in a target detection task. Our hypothesis is that in trials where pre- or peristimulus alpha phase is already aligned in a way that voltage positive alpha peaks develop seamlessly into the P1, detection performance will be enhanced as compared to trials where alpha is not aligned. The findings supported our hypothesis and showed that target detection times for the subset of seamless alpha trials was significantly shorter than for trials that are not seamless. Our findings contradict the evoked model for the generation of early ERP components, which rests on the assumption of fixed latency, fixed polarity components. We found that in the non-seamless trials the 'candidate' component of the single trial P1 was at the opposite polarity. Despite this fact, alpha phase locking was at the same high level as was observed for the seamless trials. Finally, we found that prestimulus alpha phase was aligned already in a time window preceding the P1 by 400ms.

Lexical access and evoked traveling alpha waves.

Retrieval from semantic memory is usually considered within a time window around 300-600ms. Here we suggest that lexical access already occurs at around 100ms. This interpretation is based on the finding that semantically rich and frequent words exhibit a significantly shorter topographical latency difference between the site with the shortest P1 latency (leading site) and that with the longest P1 latency (trailing site). This latency difference can be described in terms of an evoked traveling alpha wave as was already shown in earlier studies.

Alpha entrainment is responsible for the attentional blink phenomenon.

The attentional blink phenomenon is the reduced ability to report a second target (T2) after identifying a first target (T1) in a rapid serial visual presentation (RSVP) of stimuli (e.g., letters), which are presented at approximately 10 items per second. Several explanations have been proposed, which focus primarily on cognitive aspects, such as attentional filter-, capacity limitation- and retrieval failure-processes. Here, we focus on the hypothesis that an entrainment of alpha oscillations (with a frequency of about 10Hz) is a critical factor for the attentional blink phenomenon. Our hypothesis is based on the fact that item presentation rate in the RSVP typically lies in the alpha frequency range and is motivated by theories assuming an inhibitory function for alpha. We predict that entrainment--during the time window of T2 presentation--is larger for attentional blink (AB) items (when T2 cannot be reported) than for NoAB trials (when T2 cannot be reported). The results support our hypothesis and show that alpha entrainment as measured by the amplitude of the alpha evoked response and the extent of alpha phase concentration is larger for AB than for NoAB trials. Together with the lack of differences in alpha power these findings demonstrate that the differences between AB and NoAB trials--during presentation onset of T2--are due to an entrainment of alpha phase and not due to an amplitude modulation. Thus, we conclude that alpha entrainment may be considered the critical factor underlying the attentional blink phenomenon.

Evoked traveling alpha waves predict visual-semantic categorization-speed.

In the present study we have tested the hypothesis that evoked traveling alpha waves are behaviorally significant. The results of a visual-semantic categorization task show that three early ERP components including the P1-N1 complex had a dominant frequency characteristic in the alpha range and behaved like traveling waves do. They exhibited a traveling direction from midline occipital to right lateral parietal sites. Phase analyses revealed that this traveling behavior of ERP components could be explained by phase-delays in the alpha but not theta and beta frequency range. Most importantly, we found that the speed of the traveling alpha wave was significantly and negatively correlated with reaction time indicating that slow traveling speed was associated with fast picture-categorization. We conclude that evoked alpha oscillations are functionally associated with early access to visual-semantic information and generate--or at least modulate--the early waveforms of the visual ERP.

Event-related activity and phase locking during a psychomotor vigilance task over the course of sleep deprivation.

There is profound knowledge that sleep restriction increases tonic (event-unrelated) electroencephalographic (EEG) activity. In the present study we focused on time-locked activity by means of phasic (event-related) EEG analysis during a psychomotor vigilance task (PVT) over the course of sleep deprivation. Twenty healthy subjects (10 male; mean age ± SD: 23.45 ± 1.97 years) underwent sleep deprivation for 24 h. Subjects had to rate their sleepiness hourly (Karolinska Sleepiness Scale) and to perform a PVT while EEG was recorded simultaneously. Tonic EEG changes in the δ (1-4 Hz), θ (4-8 Hz) and α (8-12 Hz) frequency range were investigated by power spectral analyses. Single-trial (phase-locking index, PLI) and event-related potential (ERP) analyses (P1, N1) were used to examine event-related changes in EEG activity. Subjective sleepiness, PVT reaction times and tonic EEG activity (delta and theta spectral power) significantly increased over the night. In contrast, event-related EEG parameters decreased throughout sleep deprivation. Specifically, the ERP component P1 diminished in amplitude, and delta and theta PLI estimates decreased progressively over the night. It is suggested that event-related EEG measures (such as the amplitude of the P1 and especially delta/theta phase-locking) serve as a complimentary method to track the deterioration of attention and performance during sleep loss. As these measures actually reflect the impaired response to specific events rather than tonic changes during sleep deprivation they are a promising tool for future sleep research.

Human frontal midline theta and its synchronization to gamma during a verbal delayed match to sample task.

The involvement of oscillatory activity, especially at theta and gamma frequency, in human working memory has been reported frequently. A salient pattern during working memory is electroencephalographic frontal midline theta activity which has been suggested to reflect monitoring functions in order to deal with a task. In general, theta activity has been credited with integrative functions of distributed activity. In the present study, we focused on electroencephalographic power analyses and cross-frequency phase synchronization in order to test whether frontal midline theta activity is linked to more locally generated gamma oscillations during the performance of a verbal delayed match to sample task. The task consisted of two different conditions where subjects either had to reorganize three consonant letters in alphabetical order (manipulation condition) or where they merely had to retain the three consonant letters (retention condition). Results revealed higher frontal midline theta activity for the manipulation of maintained stimulus material compared to pure retention of stimulus material. Interestingly, power differences between conditions were most pronounced during the second half of the delay period. Cross-frequency phase synchronization between frontal midline theta activity and distributed gamma activity, on the other hand, was predominant during the first half of the delay period and was stronger for manipulation compared to retention. We suggest that coupling of frontal midline theta to gamma activity reflects monitoring functions on the temporal segregation of memory items, whereas higher frontal midline theta power in the second half of the delay period might be associated with rehearsal processes. Rehearsal processes in the manipulation condition are likely more pronounced, because rehearsal of a new letter string in a limited time window requires higher mental effort compared to pure retention where rehearsal processes may already start at the beginning of the delay period.

Brain oscillatory substrates of visual short-term memory capacity.

The amount of information that can be stored in visual short-term memory is strictly limited to about four items. Therefore, memory capacity relies not only on the successful retention of relevant information but also on efficient suppression of distracting information, visual attention, and executive functions. However, completely separable neural signatures for these memory capacity-limiting factors remain to be identified. Because of its functional diversity, oscillatory brain activity may offer a utile solution. In the present study, we show that capacity-determining mechanisms, namely retention of relevant information and suppression of distracting information, are based on neural substrates independent of each other: the successful maintenance of relevant material in short-term memory is associated with cross-frequency phase synchronization between theta (rhythmical neural activity around 5 Hz) and gamma (> 50 Hz) oscillations at posterior parietal recording sites. On the other hand, electroencephalographic alpha activity (around 10 Hz) predicts memory capacity based on efficient suppression of irrelevant information in short-term memory. Moreover, repetitive transcranial magnetic stimulation at alpha frequency can modulate short-term memory capacity by influencing the ability to suppress distracting information. Taken together, the current study provides evidence for a double dissociation of brain oscillatory correlates of visual short-term memory capacity.

Lifespan differences in cortical dynamics of auditory perception.

Using electroencephalographic recordings (EEG), we assessed differences in oscillatory cortical activity during auditory-oddball performance between children aged 9-13 years, younger adults, and older adults. From childhood to old age, phase synchronization increased within and between electrodes, whereas whole power and evoked power decreased. We conclude that the cortical dynamics of perceptual processing undergo substantial reorganization from childhood to old age, and discuss possible reasons for the inverse relation between age trends in phase synchronization and power, such as lifespan differences in neural background activity, or a lifespan shift from rate coding in children to temporal coding in adults.

Dissociation between phase-locked and nonphase-locked alpha oscillations in a working memory task.

The functions of human alpha oscillations ( approximately 10 Hz) were related to cognitive processes such as memory and top-down control. Recent models suggest that alpha phase serves as a mechanism especially relevant for the timing of neural activity, whereas alpha amplitude is important for the inhibition of task-irrelevant brain areas. This study investigates directly the influence of top-down modulation on phase-locked and nonphase-locked alpha rhythms. We conducted an EEG experiment where subjects performed a working memory task. In the encoding phase of the task subjects had to learn presented pictures of nonliving objects that could later be asked to be retrieved. We varied the top-down modulation by including cues indicating either to remember or to forget (not to remember) the next following item. Spectral analyses showed that nonremember cues elicited pronounced alpha amplitude increase compared to remember cues. Furthermore, phase-locking in low frequencies, especially in the alpha range (7-12 Hz), was stronger for remember as opposed to not-to-remember items. In conclusion, we propose that alpha amplitude reflects top-down modulated inhibition and that alpha phase is important for the exact timing of neural activity and can be related to binding processes.