Event-related potentials of social comparisons in depression and social anxiety.

Social comparison is central in human life and can be especially challenging in depression and social anxiety. We assessed event-related potentials and emotions using a social comparison task in which participants received feedback on both their own and a co-player's performance, in participants with depression and/or social anxiety (n = 63) and healthy controls (n = 72). Participants reported more negative emotions for downward (being better than the co-player [participant correct, co-player wrong]) and upward (being worse than the co-player [participant wrong, co-player correct]) comparisons versus even outcomes, with these effects being stronger in depression and social anxiety. At the Medial Frontal Negativity, both controls and depressed participants showed a more negative amplitude for upward comparison versus both the participant and co-player performing wrong. Socially anxious subjects showed the opposite effect, possibly due to greater expectations about being worse than others. The P300 decreased for downward and upward comparisons compared to even outcomes, which may relate to the higher levels of conflict of social inequality. Depressed and socially anxious subjects showed a blunted P300 increase over time in response to the task outcomes, suggesting deficits in allocating resources for the attention of incoming social information. The LPP showed increased amplitude for downward and upward comparison versus the even outcomes and no group effect. Emotional findings suggest that social comparisons are more difficult for depressed and socially anxious individuals. Event-related potentials findings may shed light on the neural substrates of these difficulties.

Visuospatial attention revamps cortical processing of sound amid audiovisual uncertainty.

Selective attentional biases arising from one sensory modality manifest in others. The effects of visuospatial attention, important in visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. We investigate temporal and spatial factors that underlie such transfer neurally. Auditory encoding of random tone pips in AV scenes was addressed via a temporal response function model (TRF) of participants' electroencephalogram (N = 30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals ("flips"), through asynchronous probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal influence over the neural representation of pips was found in the original and a replication study (N = 21). Transfer depended on selected visual input being (i) presented during or shortly after a related sound, in relatively limited temporal distributions (<165 ms); (ii) positioned across limited (1:4) visual foreground to background ratios. Neural encoding of auditory input, as a function of visual input, was largest at visual foreground quadrant sectors and lowest at locations opposite to the target. The results indicate that ongoing neural representations of sounds incorporate visuospatial attributes for auditory stream segregation, as cross-modal transfer conveys information that specifies the identity of multisensory signals. A potential mechanism is by enhancing or recalibrating the tuning properties of the auditory populations that represent them as objects. The results account for the dynamic evolution under visual attention of multisensory integration, specifying critical latencies at which relevant cortical networks operate.

Event-related potentials during the ultimatum game in people with symptoms of depression and/or social anxiety.

Depression and social anxiety are common disorders that have a profound impact on social functioning. The need for studying the neural substrates of social interactions in mental disorders using interactive tasks has been emphasized. The field of neuroeconomics, which combines neuroscience techniques and behavioral economics multiplayer tasks such as the Ultimatum Game (UG), can contribute in this direction. We assessed emotions, behavior, and Event-Related Potentials in participants with depression and/or social anxiety symptoms (MD/SA, n = 63, 57 females) and healthy controls (n = 72, 67 females), while they played the UG. In this task, participants received fair, mid-value, and unfair offers from other players. Mixed linear models were implemented to assess trial level changes in neural activity. The MD/SA group reported higher levels of sadness in response to mid-value and unfair offers compared to controls. In controls, the Medial Frontal Negativity associated with fair offers increased over time, while this dynamic was not observed in the MD/SA group. The MD/SA group showed a decreased P3/LPP in all offers, compared to controls. These results indicate an enhanced negative emotional response to unfairness in the MD/SA group. Neural results reveal a blunted response over time to positive social stimuli in the MD/SA group. Moreover, between-group differences in P3/LPP may relate to a reduced saliency of offers and/or to a reduced availability of resources for processing incoming stimuli in the MD/SA group. Findings may shed light into the neural substrates of social difficulties in these disorders.

Neural processing of iterated prisoner's dilemma outcomes indicates next-round choice and speed to reciprocate cooperation.

The iterated prisoner's dilemma (iPD) game is a well-established model for testing how people cooperate, and the neural processes that unfold after its distinct outcomes have been partly described. Recent theoretical models suggest evolution favors intuitive cooperation, which raises questions on the behavioral but also neural timelines involved. We studied the outcome/feedback stage of iPD rounds with electroencephalography (EEG) methods. Results showed that neural signals associated with this stage also relate to future choice, in an outcome-dependent manner: (i) after zero-gain "sucker's payoffs" (unreciprocated cooperation), a participant's decision thereafter relates to changes to the feedback-related negativity (FRN); (ii) after one-sided non-cooperation (participant wins at co-player's expense), by the P3; (iii) after mutual cooperation, by late frontal delta-band modulations. Critically, faster reciprocation behavior towards a co-player's choice to cooperate was predicted, on a single-trial basis, by players' P3 and frontal delta modulations at the immediately preceding trial. Delta-band signaling is discussed in relation to homeostatic regulation processing in the literature. The findings relate the early outcome/feedback stage to subsequent decisional processes in the iPD, providing a first neural account of the brief timelines implied in heuristic modes of cooperation.

Restoration and Efficiency of the Neural Processing of Continuous Speech Are Promoted by Prior Knowledge.

Sufficiently noisy listening conditions can completely mask the acoustic signal of significant parts of a sentence, and yet listeners may still report the perception of hearing the masked speech. This occurs even when the speech signal is removed entirely, if the gap is filled with stationary noise, a phenomenon known as perceptual restoration. At the neural level, however, it is unclear the extent to which the neural representation of missing extended speech sequences is similar to the dynamic neural representation of ordinary continuous speech. Using auditory magnetoencephalography (MEG), we show that stimulus reconstruction, a technique developed for use with neural representations of ordinary speech, works also for the missing speech segments replaced by noise, even when spanning several phonemes and words. The reconstruction fidelity of the missing speech, up to 25% of what would be attained if present, depends however on listeners' familiarity with the missing segment. This same familiarity also speeds up the most prominent stage of the cortical processing of ordinary speech by approximately 5 ms. Both effects disappear when listeners have no or little prior experience with the speech segment. The results are consistent with adaptive expectation mechanisms that consolidate detailed representations about speech sounds as identifiable factors assisting automatic restoration over ecologically relevant timescales.

Dynamic cortical representations of perceptual filling-in for missing acoustic rhythm.

In the phenomenon of perceptual filling-in, missing sensory information can be reconstructed via interpolation or extrapolation from adjacent contextual cues by what is necessarily an endogenous, not yet well understood, neural process. In this investigation, sound stimuli were chosen to allow observation of fixed cortical oscillations driven by contextual (but missing) sensory input, thus entirely reflecting endogenous neural activity. The stimulus employed was a 5 Hz frequency-modulated tone, with brief masker probes (noise bursts) occasionally added. For half the probes, the rhythmic frequency modulation was moreover removed. Listeners reported whether the tone masked by each probe was perceived as being rhythmic or not. Time-frequency analysis of neural responses obtained by magnetoencephalography (MEG) shows that for maskers without the underlying acoustic rhythm, trials where rhythm was nonetheless perceived show higher evoked sustained rhythmic power than trials for which no rhythm was reported. The results support a model in which perceptual filling-in is aided by differential co-modulations of cortical activity at rates directly relevant to human speech communication. We propose that the presence of rhythmically-modulated neural dynamics predicts the subjective experience of a rhythmically modulated sound in real time, even when the perceptual experience is not supported by corresponding sensory data.

Detection of appearing and disappearing objects in complex acoustic scenes.

The ability to detect sudden changes in the environment is critical for survival. Hearing is hypothesized to play a major role in this process by serving as an "early warning device," rapidly directing attention to new events. Here, we investigate listeners' sensitivity to changes in complex acoustic scenes-what makes certain events "pop-out" and grab attention while others remain unnoticed? We use artificial "scenes" populated by multiple pure-tone components, each with a unique frequency and amplitude modulation rate. Importantly, these scenes lack semantic attributes, which may have confounded previous studies, thus allowing us to probe low-level processes involved in auditory change perception. Our results reveal a striking difference between "appear" and "disappear" events. Listeners are remarkably tuned to object appearance: change detection and identification performance are at ceiling; response times are short, with little effect of scene-size, suggesting a pop-out process. In contrast, listeners have difficulty detecting disappearing objects, even in small scenes: performance rapidly deteriorates with growing scene-size; response times are slow, and even when change is detected, the changed component is rarely successfully identified. We also measured change detection performance when a noise or silent gap was inserted at the time of change or when the scene was interrupted by a distractor that occurred at the time of change but did not mask any scene elements. Gaps adversely affected the processing of item appearance but not disappearance. However, distractors reduced both appearance and disappearance detection. Together, our results suggest a role for neural adaptation and sensitivity to transients in the process of auditory change detection, similar to what has been demonstrated for visual change detection. Importantly, listeners consistently performed better for item addition (relative to deletion) across all scene interruptions used, suggesting a robust perceptual representation of item appearance.