Single-trial visually evoked potentials predict both individual choice and market outcomes.

A central assumption in the behavioral sciences is that choice behavior generalizes enough across individuals that measurements from a sampled group can predict the behavior of the population. Following from this assumption, the unit of behavioral sampling or measurement for most neuroimaging studies is the individual; however, cognitive neuroscience is increasingly acknowledging a dissociation between neural activity that predicts individual behavior and that which predicts the average or aggregate behavior of the population suggesting a greater importance of individual differences than is typically acknowledged. For instance, past work has demonstrated that some, but not all, of the neural activity observed during value-based decision-making is able to predict not just individual subjects' choices but also the success of products on large, online marketplaces-even when those two behavioral outcomes deviate from one another-suggesting that some neural component processes of decision-making generalize to aggregate market responses more readily across individuals than others do. While the bulk of such research has highlighted affect-related neural responses (i.e. in the nucleus accumbens) as a better predictor of group-level behavior than frontal cortical activity associated with the integration of more idiosyncratic choice components, more recent evidence has implicated responses in visual cortical regions as strong predictors of group preference. Taken together, these findings suggest a role of neural responses during early perception in reinforcing choice consistency across individuals and raise fundamental scientific questions about the role sensory systems in value-based decision-making processes. We use a multivariate pattern analysis approach to show that single-trial visually evoked electroencephalographic (EEG) activity can predict individual choice throughout the post-stimulus epoch; however, a nominally sparser set of activity predicts the aggregate behavior of the population. These findings support an account in which a subset of the neural activity underlying individual choice processes can scale to predict behavioral consistency across people, even when the choice behavior of the sample does not match the aggregate behavior of the population.

Temporal Dynamics of Brain Activity Predicting Sense of Agency over Muscle Movements.

Our muscles are the primary means through which we affect the external world, and the sense of agency (SoA) over the action through those muscles is fundamental to our self-awareness. However, SoA research to date has focused almost exclusively on agency over action outcomes rather than over the musculature itself, as it was believed that SoA over the musculature could not be manipulated directly. Drawing on methods from human-computer interaction and adaptive experimentation, we use human-in-the-loop Bayesian optimization to tune the timing of electrical muscle stimulation so as to robustly elicit a SoA over electrically actuated muscle movements in male and female human subjects. We use time-resolved decoding of subjects' EEG to estimate the time course of neural activity which predicts reported agency on a trial-by-trial basis. Like paradigms which assess SoA over action consequences, we found that the late (post-conscious) neural activity predicts SoA. Unlike typical paradigms, however, we also find patterns of early (sensorimotor) activity with distinct temporal dynamics predicts agency over muscle movements, suggesting that the "neural correlates of agency" may depend on the level of abstraction (i.e., direct sensorimotor feedback versus downstream consequences) most relevant to a given agency judgment. Moreover, fractal analysis of the EEG suggests that SoA-contingent dynamics of neural activity may modulate the sensitivity of the motor system to external input.SIGNIFICANCE STATEMENT The sense of agency, the feeling of "I did that," when directing one's own musculature is a core feature of human experience. We show that we can robustly manipulate the sense of agency over electrically actuated muscle movements, and we investigate the time course of neural activity that predicts the sense of agency over these actuated movements. We find evidence of two distinct neural processes: a transient sequence of patterns that begins in the early sensorineural response to muscle stimulation and a later, sustained signature of agency. These results shed light on the neural mechanisms by which we experience our movements as volitional.

Permutation-based group sequential analyses for cognitive neuroscience.

Cognitive neuroscientists have been grappling with two related experimental design problems. First, the complexity of neuroimaging data (e.g. often hundreds of thousands of correlated measurements) and analysis pipelines demands bespoke, non-parametric statistical tests for valid inference, and these tests often lack an agreed-upon method for performing a priori power analyses. Thus, sample size determination for neuroimaging studies is often arbitrary or inferred from other putatively but questionably similar studies, which can result in underpowered designs - undermining the efficacy of neuroimaging research. Second, when meta-analyses estimate the sample sizes required to obtain reasonable statistical power, estimated sample sizes can be prohibitively large given the resource constraints of many labs. We propose the use of sequential analyses to partially address both of these problems. Sequential study designs - in which the data is analyzed at interim points during data collection and data collection can be stopped if the planned test statistic satisfies a stopping rule specified a priori - are common in the clinical trial literature, due to the efficiency gains they afford over fixed-sample designs. However, the corrections used to control false positive rates in existing approaches to sequential testing rely on parametric assumptions that are often violated in neuroimaging settings. We introduce a general permutation scheme that allows sequential designs to be used with arbitrary test statistics. By simulation, we show that this scheme controls the false positive rate across multiple interim analyses. Then, performing power analyses for seven evoked response effects seen in the EEG literature, we show that this sequential analysis approach can substantially outperform fixed-sample approaches (i.e. require fewer subjects, on average, to detect a true effect) when study designs are sufficiently well-powered. To facilitate the adoption of this methodology, we provide a Python package "niseq" with sequential implementations of common tests used for neuroimaging: cluster-based permutation tests, threshold-free cluster enhancement, t-max, F-max, and the network-based statistic with tutorial examples using EEG and fMRI data.

Absolute pitch judgments of familiar melodies generalize across timbre and octave.

Most listeners can determine when a familiar recording of music has been shifted in musical key by as little as one semitone (e.g., from B to C major). These findings appear to suggest that absolute pitch memory is widespread in the general population. However, the use of familiar recordings makes it unclear whether these findings genuinely reflect absolute melody-key associations for at least two reasons. First, listeners may be able to use spectral cues from the familiar instrumentation of the recordings to determine when a familiar recording has been shifted in pitch. Second, listeners may be able to rely solely on pitch height cues (e.g., relying on a feeling that an incorrect recording sounds "too high" or "too low"). Neither of these strategies would require an understanding of pitch chroma or musical key. The present experiments thus assessed whether listeners could make accurate absolute melody-key judgments when listening to novel versions of these melodies, differing from the iconic recording in timbre (Experiment 1) or timbre and octave (Experiment 2). Listeners in both experiments were able to select the correct-key version of the familiar melody at rates that were well above chance. These results fit within a growing body of research supporting the idea that most listeners, regardless of formal musical training, have robust representations of absolute pitch - based on pitch chroma - that generalize to novel listening situations. Implications for theories of auditory pitch memory are discussed.

Generalizing across tonal context, timbre, and octave in rapid absolute pitch training.

Absolute pitch (AP) is the rare ability to name any musical note without the use of a reference note. Given that genuine AP representations are based on the identification of isolated notes by their tone chroma, they are considered to be invariant to (1) surrounding tonal context, (2) changes in instrumental timbre, and (3) changes in octave register. However, there is considerable variability in the literature in terms of how AP is trained and tested along these dimensions, making recent claims about AP learning difficult to assess. Here, we examined the effect of tonal context on participant success with a single-note identification training paradigm, including how learning generalized to an untested instrument and octave. We found that participants were able to rapidly learn to distinguish C from other notes, with and without feedback and regardless of the tonal context in which C was presented. Participants were also able to partly generalize this skill to an untrained instrument. However, participants displayed the weakest generalization in recognizing C in a higher octave. The results indicate that participants were likely attending to pitch height in addition to pitch chroma - a conjecture that was supported by analyzing the pattern of response errors. These findings highlight the complex nature of note representation in AP, which requires note identification across contexts, going beyond the simple storage of a note fundamental. The importance of standardizing testing that spans both timbre and octave in assessing AP and further implications on past literature and future work are discussed.

Going beyond ourselves: the role of self-transcendent experiences in wisdom.

Having good moral character often involves shifting one's focus of attention from the self to others and the world. Across three studies (N = 605 adults), we found converging evidence that self-transcendent experiences, specifically awe and flow, enabled the expression of wisdom, as captured by wise reasoning and epistemic humility measures. Study 1 found that dispositionally awe- and flow-prone people have stronger wise reasoning and epistemic humility abilities, over and above dispositional happiness. Consistent with Study 1, Study 2 found that, across diverse recalled experiences, individuals who experienced more awe showed greater wise reasoning, and those who experienced more flow showed greater epistemic humility. In Study 3, using situated interventions, we induced awe (watching a video involving vast nature scenes) and flow (composing a song using an online music maker) and compared them with neutral and amusement experiences. Compared to these control conditions, eliciting awe and flow facilitated one's (1) ability to address interpersonal conflicts with wise reasoning, (2) ability to acknowledge one's epistemic gaps, and (3) willingness to improve those aspects and one's general moral character. Altogether, these findings reveal the promising role of self-transcendent experiences in motivating people to appreciate others' perspectives beyond one's own.

Going Beyond Rote Auditory Learning: Neural Patterns of Generalized Auditory Learning.

The ability to generalize across specific experiences is vital for the recognition of new patterns, especially in speech perception considering acoustic-phonetic pattern variability. Indeed, behavioral research has demonstrated that listeners are able via a process of generalized learning to leverage their experiences of past words said by difficult-to-understand talker to improve their understanding for new words said by that talker. Here, we examine differences in neural responses to generalized versus rote learning in auditory cortical processing by training listeners to understand a novel synthetic talker. Using a pretest-posttest design with EEG, participants were trained using either (1) a large inventory of words where no words were repeated across the experiment (generalized learning) or (2) a small inventory of words where words were repeated (rote learning). Analysis of long-latency auditory evoked potentials at pretest and posttest revealed that rote and generalized learning both produced rapid changes in auditory processing, yet the nature of these changes differed. Generalized learning was marked by an amplitude reduction in the N1-P2 complex and by the presence of a late negativity wave in the auditory evoked potential following training; rote learning was marked only by temporally later scalp topography differences. The early N1-P2 change, found only for generalized learning, is consistent with an active processing account of speech perception, which proposes that the ability to rapidly adjust to the specific vocal characteristics of a new talker (for which rote learning is rare) relies on attentional mechanisms to selectively modify early auditory processing sensitivity.

Individual differences in human frequency-following response predict pitch labeling ability.

The frequency-following response (FFR) provides a measure of phase-locked auditory encoding in humans and has been used to study subcortical processing in the auditory system. While effects of experience on the FFR have been reported, few studies have examined whether individual differences in early sensory encoding have measurable effects on human performance. Absolute pitch (AP), the rare ability to label musical notes without reference notes, provides an excellent model system for testing how early neural encoding supports specialized auditory skills. Results show that the FFR predicts pitch labelling performance better than traditional measures related to AP (age of music onset, tonal language experience, pitch adjustment and just-noticeable-difference scores). Moreover, the stimulus type used to elicit the FFR (tones or speech) impacts predictive performance in a manner that is consistent with prior research. Additionally, the FFR predicts labelling performance for piano tones better than unfamiliar sine tones. Taken together, the FFR reliably distinguishes individuals based on their explicit pitch labeling abilities, which highlights the complex dynamics between sensory processing and cognition.

Talker familiarity and the accommodation of talker variability.

A fundamental problem in speech perception is how (or whether) listeners accommodate variability in the way talkers produce speech. One view of the way listeners cope with this variability is that talker differences are normalized - a mapping between talker-specific characteristics and phonetic categories is computed such that speech is recognized in the context of the talker's vocal characteristics. Consistent with this view, listeners process speech more slowly when the talker changes randomly than when the talker remains constant. An alternative view is that speech perception is based on talker-specific auditory exemplars in memory clustered around linguistic categories that allow talker-independent perception. Consistent with this view, listeners become more efficient at talker-specific phonetic processing after voice identification training. We asked whether phonetic efficiency would increase with talker familiarity by testing listeners with extremely familiar talkers (family members), newly familiar talkers (based on laboratory training), and unfamiliar talkers. We also asked whether familiarity would reduce the need for normalization. As predicted, phonetic efficiency (word recognition in noise) increased with familiarity (unfamiliar < trained-on < family). However, we observed a constant processing cost for talker changes even for pairs of family members. We discuss how normalization and exemplar theories might account for these results, and constraints the results impose on theoretical accounts of phonetic constancy.

Revisiting discrete versus continuous models of human behavior: The case of absolute pitch.

Many human behaviors are discussed in terms of discrete categories. Quantizing behavior in this fashion may provide important traction for understanding the complexities of human experience, but it also may bias understanding of phenomena and associated mechanisms. One example of this is absolute pitch (AP), which is often treated as a discrete trait that is either present or absent (i.e., with easily identifiable near-perfect "genuine" AP possessors and at-chance non-AP possessors) despite emerging evidence that pitch-labeling ability is not all-or-nothing. We used a large-scale online assessment to test the discrete model of AP, specifically by measuring how intermediate performers related to the typically defined "non-AP" and "genuine AP" populations. Consistent with prior research, individuals who performed at-chance (non-AP) reported beginning musical instruction much later than the near-perfect AP participants, and the highest performers were more likely to speak a tonal language than were the lowest performers (though this effect was not as statistically robust as one would expect from prior research). Critically, however, these developmental factors did not differentiate the near-perfect AP performers from the intermediate AP performers. Gaussian mixture modeling supported the existence of two performance distributions-the first distribution encompassed both the intermediate and near-perfect AP possessors, whereas the second distribution encompassed only the at-chance participants. Overall, these results provide support for conceptualizing intermediate levels of pitch-labeling ability along the same continuum as genuine AP-level pitch labeling ability-in other words, a continuous distribution of AP skill among all above-chance performers rather than discrete categories of ability. Expanding the inclusion criteria for AP makes it possible to test hypotheses about the mechanisms that underlie this ability and relate this ability to more general cognitive mechanisms involved in other abilities.

Shaping perceptual learning of synthetic speech through feedback.

Listeners exposed to accented speech must adjust how they map between acoustic features and lexical representations such as phonetic categories. A robust form of this adaptive perceptual learning is learning to perceive synthetic speech where the connections between acoustic features and phonetic categories must be updated. Both implicit learning through mere exposure and explicit learning through directed feedback have previously been shown to produce this type of adaptive learning. The present study crosses implicit exposure and explicit feedback with the presence or absence of a written identification task. We show that simple exposure produces some learning, but explicit feedback produces substantially stronger learning, whereas requiring written identification did not measurably affect learning. These results suggest that explicit feedback guides learning of new mappings between acoustic patterns and known phonetic categories. We discuss mechanisms that may support learning via implicit exposure.

Cortical mechanisms of talker normalization in fluent sentences.

Adjusting to the vocal characteristics of a new talker is important for speech recognition. Previous research has indicated that adjusting to talker differences is an active cognitive process that depends on attention and working memory (WM). These studies have not examined how talker variability affects perception and neural responses in fluent speech. Here we use source analysis from high-density EEG to show that perceiving fluent speech in which the talker changes recruits early involvement of parietal and temporal cortical areas, suggesting functional involvement of WM and attention in talker normalization. We extend these findings to acoustic source change in general by examining understanding environmental sounds in spoken sentence context. Though there may be differences in cortical recruitment to processing demands for non-speech sounds versus a changing talker, the underlying mechanisms are similar, supporting the view that shared cognitive-general mechanisms assist both talker normalization and speech-to-nonspeech transitions.

Absolute pitch can be learned by some adults.

Absolute pitch (AP), the rare ability to name any musical note without the aid of a reference note, is thought to depend on an early critical period of development. Although recent research has shown that adults can improve AP performance in a single training session, the best learners still did not achieve note classification levels comparable to performance of a typical, "genuine" AP possessor. Here, we demonstrate that these "genuine" levels of AP performance can be achieved within eight weeks of training for at least some adults, with the best learner passing all measures of AP ability after training and retaining this knowledge for at least four months after training. Alternative explanations of these positive results, such as improving accuracy through adopting a slower, relative pitch strategy, are not supported based on joint analyses of response time and accuracy. The results also did not appear to be driven by extreme familiarity with a single instrument or octave range, as the post-training AP assessments used eight different timbres and spanned over seven octaves. Yet, it is also important to note that a majority of the participants only exhibited modest improvements in performance, suggesting that adult AP learning is difficult and that near-perfect levels of AP may only be achievable by subset of adults. Overall, these results demonstrate that explicit perceptual training in some adults can lead to AP performance that is behaviorally indistinguishable from AP that manifests within a critical period of development. Implications for theories of AP acquisition are discussed.

The Aesthetic Preference for Nature Sounds Depends on Sound Object Recognition.

People across the world seek out beautiful sounds in nature, such as a babbling brook or a nightingale song, for positive human experiences. However, it is unclear whether this positive aesthetic response is driven by a preference for the perceptual features typical of nature sounds versus a higher-order association of nature with beauty. To test these hypotheses, participants provided aesthetic judgments for nature and urban soundscapes that varied on ease of recognition. Results demonstrated that the aesthetic preference for nature soundscapes was eliminated for the sounds hardest to recognize, and moreover the relationship between aesthetic ratings and several measured acoustic features significantly changed as a function of recognition. In a follow-up experiment, requiring participants to classify these difficult-to-identify sounds into nature or urban categories resulted in a robust preference for nature sounds and a relationship between aesthetic ratings and our measured acoustic features that was more typical of easy-to-identify sounds. This pattern of results was replicated with computer-generated artificial noises, which acoustically shared properties with the nature and urban soundscapes but by definition did not come from these environments. Taken together, these results support the conclusion that the recognition of a sound as either natural or urban dynamically organizes the relationship between aesthetic preference and perceptual features and that these preferences are not inherent to the acoustic features. Implications for nature's role in cognitive and affective restoration are discussed.

Emerging Opportunities for Advancing Cognitive Neuroscience.

Cognitive neuroscience can be substantially advanced if structured mechanisms are created to increase its social impact and to develop synergies with some currently more distant disciplines that are developing relevant knowledge. We present such opportunities and argue that pursuing these can benefit from establishing a centralized coordinating organizational approach.

Of cricket chirps and car horns: The effect of nature sounds on cognitive performance.

Attention restoration theory (ART) posits that stimuli found in nature may restore directed attention functioning by reducing demands on the endogenous attention system. In the present experiment, we assessed whether nature-related cognitive benefits extended to auditory presentations of nature, a topic that has been understudied. To assess directed attention, we created a composite measure consisting of a backward digit span task and a dual n-back task. Participants completed these cognitive measures and an affective questionnaire before and after listening to and aesthetically judging either natural or urban soundscapes (between-participants). Relative to participants who were exposed to urban soundscapes, we observed significant improvements in cognitive performance for individuals exposed to nature. Urban soundscapes did not systematically affect performance either adversely or beneficially. Natural sounds did not differentially change positive or negative affect, despite these sounds being aesthetically preferred to urban sounds. These results provide initial evidence that brief experiences with natural sounds can improve directed attention functioning in a single experimental session.

Individual differences in absolute pitch performance: Contributions of working memory, musical expertise, and tonal language background.

By definition, individuals with absolute pitch (AP) can categorize with near perfect accuracy without a reference pitch. This definition implies a uniformity of performance across people; however, in reality AP is a complex, multidimensional ability, shaped by both early and recent auditory experiences. In the present study we assess whether AP possessors' accuracy for identifying isolated notes is more distributed when judging more challenging instrumental timbres and octaves, as well as whether variability in note categorization could be explained through individual differences in musical expertise, language background, or working memory. In a standard test of AP, all participants performed virtually perfectly. When tested on the challenging notes, performance was more normally distributed. In exploratory analyses, we found (1) lower accuracy among participants who speak a tonal language, (2) less musical expertise among tonal language participants, and (3) a positive relationship between working memory and note performance among tonal language participants that was not present for non-tonal language participants. Taken together, these results highlight the complexity of AP categorization when considered as an auditory skill rather than a native talent. The observation that working memory may be an important in AP categorization under some challenging circumstances is consistent with recent theoretical accounts of how working memory and expertise relate to auditory recognition more broadly.