Repurposing electroencephalogram monitoring of general anaesthesia for building biomarkers of brain ageing: an exploratory study.

Background: Electroencephalography (EEG) is increasingly used for monitoring the depth of general anaesthesia, but EEG data from general anaesthesia monitoring are rarely reused for research. Here, we explored repurposing EEG monitoring from general anaesthesia for brain-age modelling using machine learning. We hypothesised that brain age estimated from EEG during general anaesthesia is associated with perioperative risk. Methods: We reanalysed four-electrode EEGs of 323 patients under stable propofol or sevoflurane anaesthesia to study four EEG signatures (95% of EEG power <8-13 Hz) for age prediction: total power, alpha-band power (8-13 Hz), power spectrum, and spatial patterns in frequency bands. We constructed age-prediction models from EEGs of a healthy reference group (ASA 1 or 2) during propofol anaesthesia. Although all signatures were informative, state-of-the-art age-prediction performance was unlocked by parsing spatial patterns across electrodes along the entire power spectrum (mean absolute error=8.2 yr; R2=0.65). Results: Clinical exploration in ASA 1 or 2 patients revealed that brain age was positively correlated with intraoperative burst suppression, a risk factor for general anaesthesia complications. Surprisingly, brain age was negatively correlated with burst suppression in patients with higher ASA scores, suggesting hidden confounders. Secondary analyses revealed that age-related EEG signatures were specific to propofol anaesthesia, reflected by limited model generalisation to anaesthesia maintained with sevoflurane. Conclusions: Although EEG from general anaesthesia may enable state-of-the-art age prediction, differences between anaesthetic drugs can impact the effectiveness and validity of brain-age models. To unleash the dormant potential of EEG monitoring for clinical research, larger datasets from heterogeneous populations with precisely documented drug dosage will be essential.

A systematic review of multimodal brain age studies: Uncovering a divergence between model accuracy and utility.

Brain aging is a complex, multifaceted process that can be challenging to model in ways that are accurate and clinically useful. One of the most common approaches has been to apply machine learning to neuroimaging data with the goal of predicting age in a data-driven manner. Building on initial brain age studies that were derived solely from T1-weighted scans (i.e., unimodal), recent studies have incorporated features across multiple imaging modalities (i.e., "multimodal"). In this systematic review, we show that unimodal and multimodal models have distinct advantages. Multimodal models are the most accurate and sensitive to differences in chronic brain disorders. In contrast, unimodal models from functional magnetic resonance imaging were most sensitive to differences across a broad array of phenotypes. Altogether, multimodal imaging has provided us valuable insight for improving the accuracy of brain age models, but there is still much untapped potential with regard to achieving widespread clinical utility.

A reusable benchmark of brain-age prediction from M/EEG resting-state signals.

Population-level modeling can define quantitative measures of individual aging by applying machine learning to large volumes of brain images. These measures of brain age, obtained from the general population, helped characterize disease severity in neurological populations, improving estimates of diagnosis or prognosis. Magnetoencephalography (MEG) and Electroencephalography (EEG) have the potential to further generalize this approach towards prevention and public health by enabling assessments of brain health at large scales in socioeconomically diverse environments. However, more research is needed to define methods that can handle the complexity and diversity of M/EEG signals across diverse real-world contexts. To catalyse this effort, here we propose reusable benchmarks of competing machine learning approaches for brain age modeling. We benchmarked popular classical machine learning pipelines and deep learning architectures previously used for pathology decoding or brain age estimation in 4 international M/EEG cohorts from diverse countries and cultural contexts, including recordings from more than 2500 participants. Our benchmarks were built on top of the M/EEG adaptations of the BIDS standard, providing tools that can be applied with minimal modification on any M/EEG dataset provided in the BIDS format. Our results suggest that, regardless of whether classical machine learning or deep learning was used, the highest performance was reached by pipelines and architectures involving spatially aware representations of the M/EEG signals, leading to R2 scores between 0.60-0.74. Hand-crafted features paired with random forest regression provided robust benchmarks even in situations in which other approaches failed. Taken together, this set of benchmarks, accompanied by open-source software and high-level Python scripts, can serve as a starting point and quantitative reference for future efforts at developing M/EEG-based measures of brain aging. The generality of the approach renders this benchmark reusable for other related objectives such as modeling specific cognitive variables or clinical endpoints.

Predicting future cognitive decline from non-brain and multimodal brain imaging data in healthy and pathological aging.

Previous literature has focused on predicting a diagnostic label from structural brain imaging. Since subtle changes in the brain precede a cognitive decline in healthy and pathological aging, our study predicts future decline as a continuous trajectory instead. Here, we tested whether baseline multimodal neuroimaging data improve the prediction of future cognitive decline in healthy and pathological aging. Nonbrain data (demographics, clinical, and neuropsychological scores), structural MRI, and functional connectivity data from OASIS-3 (N = 662; age = 46-96 years) were entered into cross-validated multitarget random forest models to predict future cognitive decline (measured by CDR and MMSE), on average 5.8 years into the future. The analysis was preregistered, and all analysis code is publicly available. Combining non-brain with structural data improved the continuous prediction of future cognitive decline (best test-set performance: R2 = 0.42). Cognitive performance, daily functioning, and subcortical volume drove the performance of our model. Including functional connectivity did not improve predictive accuracy. In the future, the prognosis of age-related cognitive decline may enable earlier and more effective individualized cognitive, pharmacological, and behavioral interventions.

Interactive Psychometrics for Autism With the Human Dynamic Clamp: Interpersonal Synchrony From Sensorimotor to Sociocognitive Domains.

The human dynamic clamp (HDC) is a human-machine interface designed on the basis of coordination dynamics for studying realistic social interaction under controlled and reproducible conditions. Here, we propose to probe the validity of the HDC as a psychometric instrument for quantifying social abilities in children with autism spectrum disorder (ASD) and neurotypical development. To study interpersonal synchrony with the HDC, we derived five standardized scores following a gradient from sensorimotor and motor to higher sociocognitive skills in a sample of 155 individuals (113 participants with ASD, 42 typically developing participants; aged 5 to 25 years; IQ > 70). Regression analyses were performed using normative modeling on global scores according to four subconditions (HDC behavior "cooperative/competitive," human task "in-phase/anti-phase," diagnosis, and age at inclusion). Children with ASD had lower scores than controls for motor skills. HDC motor coordination scores were the best candidates for stratification and diagnostic biomarkers according to exploratory analyses of hierarchical clustering and multivariate classification. Independently of phenotype, sociocognitive skills increased with developmental age while being affected by the ongoing task and HDC behavior. Weaker performance in ASD for motor skills suggests the convergent validity of the HDC for evaluating social interaction. Results provided additional evidence of a relationship between sensorimotor and sociocognitive skills. HDC may also be used as a marker of maturation of sociocognitive skills during real-time social interaction. Through its standardized and objective evaluation, the HDC not only represents a valid paradigm for the study of interpersonal synchrony but also offers a promising, clinically relevant psychometric instrument for the evaluation and stratification of sociomotor dysfunctions.

Combining magnetoencephalography with magnetic resonance imaging enhances learning of surrogate-biomarkers.

Electrophysiological methods, that is M/EEG, provide unique views into brain health. Yet, when building predictive models from brain data, it is often unclear how electrophysiology should be combined with other neuroimaging methods. Information can be redundant, useful common representations of multimodal data may not be obvious and multimodal data collection can be medically contraindicated, which reduces applicability. Here, we propose a multimodal model to robustly combine MEG, MRI and fMRI for prediction. We focus on age prediction as a surrogate biomarker in 674 subjects from the Cam-CAN dataset. Strikingly, MEG, fMRI and MRI showed additive effects supporting distinct brain-behavior associations. Moreover, the contribution of MEG was best explained by cortical power spectra between 8 and 30 Hz. Finally, we demonstrate that the model preserves benefits of stacking when some data is missing. The proposed framework, hence, enables multimodal learning for a wide range of biomarkers from diverse types of brain signals.

How old are you? What about your body, and your brain? People are used to answering this question by counting the years since birth. However, biological age could also be measured by looking at the integrity of the DNA in cells or by measuring the levels of proteins in the blood. Whether one goes by chronological age or biological age, each is simply an indicator of general health ­ but people with the same chronological age may have different biological ages, and vice versa. There are different imaging techniques that can be used to study the brain. A method called MRI reveals the brain's structure and the different types of tissue present, like white and grey matter. Functional MRIs (fMRIs for short) measure activity across different brain regions, while electrophysiology records electrical signals sent between neurons. Distinct features measured by all three techniques ­ MRI, fMRI and electrophysiology ­ have been associated with aging. For example, differences between younger and older people have been observed in the proportion of grey to white matter, the communication between certain brain regions, and the intensity of neural activity. MRIs, with their anatomical detail, remain the go-to for predicting the biological age of the brain. Patterns of neuronal activity captured by electrophysiology also provide information about how well the brain is working. However, it remains unclear how electrophysiology could be combined with other brain imaging methods, like MRI and fMRI. Can data from these three techniques be combined to better predict brain age? Engemann et al. designed a computer algorithm stacking electrophysiology data on top of MRI and fMRI imaging to assess the benefit of this three-pronged approach compared to using MRI alone. Brain scans from healthy people between 17 and 90 years old were used to build the computer model. The experiments showed that combining all three methods predicted brain age better. The predictions also correlated with the cognitive fitness of individuals. People whose brains were predicted to be older than their years tended to complain about the quality of their sleep and scored worse on memory and speed-thinking tasks. Crucially, Engemann et al. tested how the algorithm would hold up if some data were missing. This can happen in clinical practice where some tests are required but not others. Positively, prediction was maintained even with incomplete data, meaning this could be a useful clinical tool for characterizing the brain.

Predictive regression modeling with MEG/EEG: from source power to signals and cognitive states.

Predicting biomedical outcomes from Magnetoencephalography and Electroencephalography (M/EEG) is central to applications like decoding, brain-computer-interfaces (BCI) or biomarker development and is facilitated by supervised machine learning. Yet, most of the literature is concerned with classification of outcomes defined at the event-level. Here, we focus on predicting continuous outcomes from M/EEG signal defined at the subject-level, and analyze about 600 MEG recordings from Cam-CAN dataset and about 1000 EEG recordings from TUH dataset. Considering different generative mechanisms for M/EEG signals and the biomedical outcome, we propose statistically-consistent predictive models that avoid source-reconstruction based on the covariance as representation. Our mathematical analysis and ground-truth simulations demonstrated that consistent function approximation can be obtained with supervised spatial filtering or by embedding with Riemannian geometry. Additional simulations revealed that Riemannian methods were more robust to model violations, in particular geometric distortions induced by individual anatomy. To estimate the relative contribution of brain dynamics and anatomy to prediction performance, we propose a novel model inspection procedure based on biophysical forward modeling. Applied to prediction of outcomes at the subject-level, the analysis revealed that the Riemannian model better exploited anatomical information while sensitivity to brain dynamics was similar across methods. We then probed the robustness of the models across different data cleaning options. Environmental denoising was globally important but Riemannian models were strikingly robust and continued performing well even without preprocessing. Our results suggest each method has its niche: supervised spatial filtering is practical for event-level prediction while the Riemannian model may enable simple end-to-end learning.

Robust EEG-based cross-site and cross-protocol classification of states of consciousness.

Determining the state of consciousness in patients with disorders of consciousness is a challenging practical and theoretical problem. Recent findings suggest that multiple markers of brain activity extracted from the EEG may index the state of consciousness in the human brain. Furthermore, machine learning has been found to optimize their capacity to discriminate different states of consciousness in clinical practice. However, it is unknown how dependable these EEG markers are in the face of signal variability because of different EEG configurations, EEG protocols and subpopulations from different centres encountered in practice. In this study we analysed 327 recordings of patients with disorders of consciousness (148 unresponsive wakefulness syndrome and 179 minimally conscious state) and 66 healthy controls obtained in two independent research centres (Paris Pitié-Salpêtrière and Liège). We first show that a non-parametric classifier based on ensembles of decision trees provides robust out-of-sample performance on unseen data with a predictive area under the curve (AUC) of ~0.77 that was only marginally affected when using alternative EEG configurations (different numbers and positions of sensors, numbers of epochs, average AUC = 0.750 ± 0.014). In a second step, we observed that classifiers based on multiple as well as single EEG features generalize to recordings obtained from different patient cohorts, EEG protocols and different centres. However, the multivariate model always performed best with a predictive AUC of 0.73 for generalization from Paris 1 to Paris 2 datasets, and an AUC of 0.78 from Paris to Liège datasets. Using simulations, we subsequently demonstrate that multivariate pattern classification has a decisive performance advantage over univariate classification as the stability of EEG features decreases, as different EEG configurations are used for feature-extraction or as noise is added. Moreover, we show that the generalization performance from Paris to Liège remains stable even if up to 20% of the diagnostic labels are randomly flipped. Finally, consistent with recent literature, analysis of the learned decision rules of our classifier suggested that markers related to dynamic fluctuations in theta and alpha frequency bands carried independent information and were most influential. Our findings demonstrate that EEG markers of consciousness can be reliably, economically and automatically identified with machine learning in various clinical and acquisition contexts.

A Reproducible MEG/EEG Group Study With the MNE Software: Recommendations, Quality Assessments, and Good Practices.

Cognitive neuroscience questions are commonly tested with experiments that involve a cohort of subjects. The cohort can consist of a handful of subjects for small studies to hundreds or thousands of subjects in open datasets. While there exist various online resources to get started with the analysis of magnetoencephalography (MEG) or electroencephalography (EEG) data, such educational materials are usually restricted to the analysis of a single subject. This is in part because data from larger group studies are harder to share, but also analyses of such data often require subject-specific decisions which are hard to document. This work presents the results obtained by the reanalysis of an open dataset from Wakeman and Henson (2015) using the MNE software package. The analysis covers preprocessing steps, quality assurance steps, sensor space analysis of evoked responses, source localization, and statistics in both sensor and source space. Results with possible alternative strategies are presented and discussed at different stages such as the use of high-pass filtering versus baseline correction, tSSS vs. SSS, the use of a minimum norm inverse vs. LCMV beamformer, and the use of univariate or multivariate statistics. This aims to provide a comparative study of different stages of M/EEG analysis pipeline on the same dataset, with open access to all of the scripts necessary to reproduce this analysis.

Brain-heart interactions reveal consciousness in noncommunicating patients.

OBJECTIVE: We here aimed at characterizing heart-brain interactions in patients with disorders of consciousness. We tested how this information impacts data-driven classification between unresponsive and minimally conscious patients. METHODS: A cohort of 127 patients in vegetative state/unresponsive wakefulness syndrome (VS/UWS; n = 70) and minimally conscious state (MCS; n = 57) were presented with the local-global auditory oddball paradigm, which distinguishes 2 levels of processing: short-term deviation of local auditory regularities and global long-term rule violations. In addition to previously validated markers of consciousness extracted from electroencephalograms (EEG), we computed autonomic cardiac markers, such as heart rate (HR) and HR variability (HRV), and cardiac cycle phase shifts triggered by the processing of the auditory stimuli. RESULTS: HR and HRV were similar in patients across groups. The cardiac cycle was not sensitive to the processing of local regularities in either the VS/UWS or MCS patients. In contrast, global regularities induced a phase shift of the cardiac cycle exclusively in the MCS group. The interval between the auditory stimulation and the following R peak was significantly shortened in MCS when the auditory rule was violated. When the information for the cardiac cycle modulations and other consciousness-related EEG markers were combined, single patient classification performance was enhanced compared to classification with solely EEG markers. INTERPRETATION: Our work shows a link between residual cognitive processing and the modulation of autonomic somatic markers. These results open a new window to evaluate patients with disorders of consciousness via the embodied paradigm, according to which body-brain functions contribute to a holistic approach to conscious processing. Ann Neurol 2017;82:578-591.

Autoreject: Automated artifact rejection for MEG and EEG data.

We present an automated algorithm for unified rejection and repair of bad trials in magnetoencephalography (MEG) and electroencephalography (EEG) signals. Our method capitalizes on cross-validation in conjunction with a robust evaluation metric to estimate the optimal peak-to-peak threshold - a quantity commonly used for identifying bad trials in M/EEG. This approach is then extended to a more sophisticated algorithm which estimates this threshold for each sensor yielding trial-wise bad sensors. Depending on the number of bad sensors, the trial is then repaired by interpolation or by excluding it from subsequent analysis. All steps of the algorithm are fully automated thus lending itself to the name Autoreject. In order to assess the practical significance of the algorithm, we conducted extensive validation and comparisons with state-of-the-art methods on four public datasets containing MEG and EEG recordings from more than 200 subjects. The comparisons include purely qualitative efforts as well as quantitatively benchmarking against human supervised and semi-automated preprocessing pipelines. The algorithm allowed us to automate the preprocessing of MEG data from the Human Connectome Project (HCP) going up to the computation of the evoked responses. The automated nature of our method minimizes the burden of human inspection, hence supporting scalability and reliability demanded by data analysis in modern neuroscience.

Assessing and tuning brain decoders: Cross-validation, caveats, and guidelines.

Decoding, i.e. prediction from brain images or signals, calls for empirical evaluation of its predictive power. Such evaluation is achieved via cross-validation, a method also used to tune decoders' hyper-parameters. This paper is a review on cross-validation procedures for decoding in neuroimaging. It includes a didactic overview of the relevant theoretical considerations. Practical aspects are highlighted with an extensive empirical study of the common decoders in within- and across-subject predictions, on multiple datasets -anatomical and functional MRI and MEG- and simulations. Theory and experiments outline that the popular "leave-one-out" strategy leads to unstable and biased estimates, and a repeated random splits method should be preferred. Experiments outline the large error bars of cross-validation in neuroimaging settings: typical confidence intervals of 10%. Nested cross-validation can tune decoders' parameters while avoiding circularity bias. However we find that it can be favorable to use sane defaults, in particular for non-sparse decoders.

Clustered marginalization of minorities during social transitions induced by co-evolution of behaviour and network structure.

Large-scale transitions in societies are associated with both individual behavioural change and restructuring of the social network. These two factors have often been considered independently, yet recent advances in social network research challenge this view. Here we show that common features of societal marginalization and clustering emerge naturally during transitions in a co-evolutionary adaptive network model. This is achieved by explicitly considering the interplay between individual interaction and a dynamic network structure in behavioural selection. We exemplify this mechanism by simulating how smoking behaviour and the network structure get reconfigured by changing social norms. Our results are consistent with empirical findings: The prevalence of smoking was reduced, remaining smokers were preferentially connected among each other and formed increasingly marginalized clusters. We propose that self-amplifying feedbacks between individual behaviour and dynamic restructuring of the network are main drivers of the transition. This generative mechanism for co-evolution of individual behaviour and social network structure may apply to a wide range of examples beyond smoking.

Automated model selection in covariance estimation and spatial whitening of MEG and EEG signals.

Magnetoencephalography and electroencephalography (M/EEG) measure non-invasively the weak electromagnetic fields induced by post-synaptic neural currents. The estimation of the spatial covariance of the signals recorded on M/EEG sensors is a building block of modern data analysis pipelines. Such covariance estimates are used in brain-computer interfaces (BCI) systems, in nearly all source localization methods for spatial whitening as well as for data covariance estimation in beamformers. The rationale for such models is that the signals can be modeled by a zero mean Gaussian distribution. While maximizing the Gaussian likelihood seems natural, it leads to a covariance estimate known as empirical covariance (EC). It turns out that the EC is a poor estimate of the true covariance when the number of samples is small. To address this issue the estimation needs to be regularized. The most common approach downweights off-diagonal coefficients, while more advanced regularization methods are based on shrinkage techniques or generative models with low rank assumptions: probabilistic PCA (PPCA) and factor analysis (FA). Using cross-validation all of these models can be tuned and compared based on Gaussian likelihood computed on unseen data. We investigated these models on simulations, one electroencephalography (EEG) dataset as well as magnetoencephalography (MEG) datasets from the most common MEG systems. First, our results demonstrate that different models can be the best, depending on the number of samples, heterogeneity of sensor types and noise properties. Second, we show that the models tuned by cross-validation are superior to models with hand-selected regularization. Hence, we propose an automated solution to the often overlooked problem of covariance estimation of M/EEG signals. The relevance of the procedure is demonstrated here for spatial whitening and source localization of MEG signals.

Children's norm enforcement in their interactions with peers.

This study investigates how children negotiate social norms with peers. In Study 1, 48 pairs of 3- and 5-year-olds (N = 96) and in Study 2, 48 pairs of 5- and 7-year-olds (N = 96) were presented with sorting tasks with conflicting instructions (one child by color, the other by shape) or identical instructions. Three-year-olds differed from older children: They were less selective for the contexts in which they enforced norms, and they (as well as the older children to a lesser extent) used grammatical constructions objectifying the norms ("It works like this" rather than "You must do it like this"). These results suggested that children's understanding of social norms becomes more flexible during the preschool years.

MNE software for processing MEG and EEG data.

Magnetoencephalography and electroencephalography (M/EEG) measure the weak electromagnetic signals originating from neural currents in the brain. Using these signals to characterize and locate brain activity is a challenging task, as evidenced by several decades of methodological contributions. MNE, whose name stems from its capability to compute cortically-constrained minimum-norm current estimates from M/EEG data, is a software package that provides comprehensive analysis tools and workflows including preprocessing, source estimation, time-frequency analysis, statistical analysis, and several methods to estimate functional connectivity between distributed brain regions. The present paper gives detailed information about the MNE package and describes typical use cases while also warning about potential caveats in analysis. The MNE package is a collaborative effort of multiple institutes striving to implement and share best methods and to facilitate distribution of analysis pipelines to advance reproducibility of research. Full documentation is available at http://martinos.org/mne.

Segregation of the human medial prefrontal cortex in social cognition.

While the human medial prefrontal cortex (mPFC) is widely believed to be a key node of neural networks relevant for socio-emotional processing, its functional subspecialization is still poorly understood. We thus revisited the often assumed differentiation of the mPFC in social cognition along its ventral-dorsal axis. Our neuroinformatic analysis was based on a neuroimaging meta-analysis of perspective-taking that yielded two separate clusters in the ventral and dorsal mPFC, respectively. We determined each seed region's brain-wide interaction pattern by two complementary measures of functional connectivity: co-activation across a wide range of neuroimaging studies archived in the BrainMap database and correlated signal fluctuations during unconstrained ("resting") cognition. Furthermore, we characterized the functions associated with these two regions using the BrainMap database. Across methods, the ventral mPFC was more strongly connected with the nucleus accumbens, hippocampus, posterior cingulate cortex, and retrosplenial cortex, while the dorsal mPFC was more strongly connected with the inferior frontal gyrus, temporo-parietal junction, and middle temporal gyrus. Further, the ventral mPFC was selectively associated with reward related tasks, while the dorsal mPFC was selectively associated with perspective-taking and episodic memory retrieval. The ventral mPFC is therefore predominantly involved in bottom-up-driven, approach/avoidance-modulating, and evaluation-related processing, whereas the dorsal mPFC is predominantly involved in top-down-driven, probabilistic-scene-informed, and metacognition-related processing in social cognition.

MEG and EEG data analysis with MNE-Python.

Magnetoencephalography and electroencephalography (M/EEG) measure the weak electromagnetic signals generated by neuronal activity in the brain. Using these signals to characterize and locate neural activation in the brain is a challenge that requires expertise in physics, signal processing, statistics, and numerical methods. As part of the MNE software suite, MNE-Python is an open-source software package that addresses this challenge by providing state-of-the-art algorithms implemented in Python that cover multiple methods of data preprocessing, source localization, statistical analysis, and estimation of functional connectivity between distributed brain regions. All algorithms and utility functions are implemented in a consistent manner with well-documented interfaces, enabling users to create M/EEG data analysis pipelines by writing Python scripts. Moreover, MNE-Python is tightly integrated with the core Python libraries for scientific comptutation (NumPy, SciPy) and visualization (matplotlib and Mayavi), as well as the greater neuroimaging ecosystem in Python via the Nibabel package. The code is provided under the new BSD license allowing code reuse, even in commercial products. Although MNE-Python has only been under heavy development for a couple of years, it has rapidly evolved with expanded analysis capabilities and pedagogical tutorials because multiple labs have collaborated during code development to help share best practices. MNE-Python also gives easy access to preprocessed datasets, helping users to get started quickly and facilitating reproducibility of methods by other researchers. Full documentation, including dozens of examples, is available at http://martinos.org/mne.

Games people play-toward an enactive view of cooperation in social neuroscience.

The field of social neuroscience has made considerable progress in unraveling the neural correlates of human cooperation by making use of brain imaging methods. Within this field, neuroeconomic research has drawn on paradigms from experimental economics, such as the Prisoner's Dilemma (PD) and the Trust Game. These paradigms capture the topic of conflict in cooperation, while focusing strongly on outcome-related decision processes. Cooperation, however, does not equate with that perspective, but relies on additional psychological processes and events, including shared intentions and mutually coordinated joint action. These additional facets of cooperation have been successfully addressed by research in developmental psychology, cognitive science, and social philosophy. Corresponding neuroimaging data, however, is still sparse. Therefore, in this paper, we present a juxtaposition of these mutually related but mostly independent trends in cooperation research. We propose that the neuroscientific study of cooperation could benefit from paradigms and concepts employed in developmental psychology and social philosophy. Bringing both to a neuroimaging environment might allow studying the neural correlates of cooperation by using formal models of decision-making as well as capturing the neural responses that underlie joint action scenarios, thus, promising to advance our understanding of the nature of human cooperation.