The neural representation of body part concepts.

Neuropsychological and neuroimaging studies provide evidence for a degree of category-related organization of conceptual knowledge in the brain. Some of this evidence indicates that body part concepts are distinctly represented from other categories; yet, the neural correlates and mechanisms underlying these dissociations are unclear. We expand on the limited prior data by measuring functional magnetic resonance imaging responses induced by body part words and performing a series of analyses investigating the cortical representation of this semantic category. Across voxel-level contrasts, pattern classification, representational similarity analysis, and vertex-wise encoding analyses, we find converging evidence that the posterior middle temporal gyrus, the supramarginal gyrus, and the ventral premotor cortex in the left hemisphere play important roles in the preferential representation of this category compared to other concrete objects.

Decoding the information structure underlying the neural representation of concepts.

The nature of the representational code underlying conceptual knowledge remains a major unsolved problem in cognitive neuroscience. We assessed the extent to which different representational systems contribute to the instantiation of lexical concepts in high-level, heteromodal cortical areas previously associated with semantic cognition. We found that lexical semantic information can be reliably decoded from a wide range of heteromodal cortical areas in the frontal, parietal, and temporal cortex. In most of these areas, we found a striking advantage for experience-based representational structures (i.e., encoding information about sensory-motor, affective, and other features of phenomenal experience), with little evidence for independent taxonomic or distributional organization. These results were found independently for object and event concepts. Our findings indicate that concept representations in the heteromodal cortex are based, at least in part, on experiential information. They also reveal that, in most heteromodal areas, event concepts have more heterogeneous representations (i.e., they are more easily decodable) than object concepts and that other areas beyond the traditional "semantic hubs" contribute to semantic cognition, particularly the posterior cingulate gyrus and the precuneus.

Spatial correspondence of cortical activity measured with whole head fNIRS and fMRI: Toward clinical use within subject.

Functional near infrared spectroscopy (fNIRS) and functional magnetic resonance imaging (fMRI) both measure the hemodynamic response, and so both imaging modalities are expected to have a strong correspondence in regions of cortex adjacent to the scalp. To assess whether fNIRS can be used clinically in a manner similar to fMRI, 22 healthy adult participants underwent same-day fMRI and whole-head fNIRS testing while they performed separate motor (finger tapping) and visual (flashing checkerboard) tasks. Analyses were conducted within and across subjects for each imaging approach, and regions of significant task-related activity were compared on the cortical surface. The spatial correspondence between fNIRS and fMRI detection of task-related activity was good in terms of true positive rate, with fNIRS overlap of up to 68 % of the fMRI for analyses across subjects (group analysis) and an average overlap of up to 47.25 % for individual analyses within subject. At the group level, the positive predictive value of fNIRS was 51 % relative to fMRI. The positive predictive value for within subject analyses was lower (41.5 %), reflecting the presence of significant fNIRS activity in regions without significant fMRI activity. This could reflect task-correlated sources of physiologic noise and/or differences in the sensitivity of fNIRS and fMRI measures to changes in separate (vs. combined) measures of oxy and de-oxyhemoglobin. The results suggest whole-head fNIRS as a noninvasive imaging modality with promising clinical utility for the functional assessment of brain activity in superficial regions of cortex physically adjacent to the skull.

Multi-shell connectome DWI-based graph theory measures for the prediction of temporal lobe epilepsy and cognition.

Temporal lobe epilepsy (TLE) is the most common epilepsy syndrome that empirically represents a network disorder, which makes graph theory (GT) a practical approach to understand it. Multi-shell diffusion-weighted imaging (DWI) was obtained from 89 TLE and 50 controls. GT measures extracted from harmonized DWI matrices were used as factors in a support vector machine (SVM) analysis to discriminate between groups, and in a k-means algorithm to find intrinsic structural phenotypes within TLE. SVM was able to predict group membership (mean accuracy = 0.70, area under the curve (AUC) = 0.747, Brier score (BS) = 0.264) using 10-fold cross-validation. In addition, k-means clustering identified 2 TLE clusters: 1 similar to controls, and 1 dissimilar. Clusters were significantly different in their distribution of cognitive phenotypes, with the Dissimilar cluster containing the majority of TLE with cognitive impairment (χ2 = 6.641, P = 0.036). In addition, cluster membership showed significant correlations between GT measures and clinical variables. Given that SVM classification seemed driven by the Dissimilar cluster, SVM analysis was repeated to classify Dissimilar versus Similar + Controls with a mean accuracy of 0.91 (AUC = 0.957, BS = 0.189). Altogether, the pattern of results shows that GT measures based on connectome DWI could be significant factors in the search for clinical and neurobehavioral biomarkers in TLE.

A Distributed Network for Multimodal Experiential Representation of Concepts.

Neuroimaging, neuropsychological, and psychophysical evidence indicate that concept retrieval selectively engages specific sensory and motor brain systems involved in the acquisition of the retrieved concept. However, it remains unclear which supramodal cortical regions contribute to this process and what kind of information they represent. Here, we used representational similarity analysis of two large fMRI datasets with a searchlight approach to generate a detailed map of human brain regions where the semantic similarity structure across individual lexical concepts can be reliably detected. We hypothesized that heteromodal cortical areas typically associated with the default mode network encode multimodal experiential information about concepts, consistent with their proposed role as cortical integration hubs. In two studies involving different sets of concepts and different participants (both sexes), we found a distributed, bihemispheric network engaged in concept representation, composed of high-level association areas in the anterior, lateral, and ventral temporal lobe; inferior parietal lobule; posterior cingulate gyrus and precuneus; and medial, dorsal, ventrolateral, and orbital prefrontal cortex. In both studies, a multimodal model combining sensory, motor, affective, and other types of experiential information explained significant variance in the neural similarity structure observed in these regions that was not explained by unimodal experiential models or by distributional semantics (i.e., word2vec similarity). These results indicate that during concept retrieval, lexical concepts are represented across a vast expanse of high-level cortical regions, especially in the areas that make up the default mode network, and that these regions encode multimodal experiential information.SIGNIFICANCE STATEMENT Conceptual knowledge includes information acquired through various modalities of experience, such as visual, auditory, tactile, and emotional information. We investigated which brain regions encode mental representations that combine information from multiple modalities when participants think about the meaning of a word. We found that such representations are encoded across a widely distributed network of cortical areas in both hemispheres, including temporal, parietal, limbic, and prefrontal association areas. Several areas not traditionally associated with semantic cognition were also implicated. Our results indicate that the retrieval of conceptual knowledge during word comprehension relies on a much larger portion of the cerebral cortex than previously thought and that multimodal experiential information is represented throughout the entire network.

Association of neighborhood deprivation with white matter connectome abnormalities in temporal lobe epilepsy.

OBJECTIVE: Social determinants of health, including the effects of neighborhood disadvantage, impact epilepsy prevalence, treatment, and outcomes. This study characterized the association between aberrant white matter connectivity in temporal lobe epilepsy (TLE) and disadvantage using a US census-based neighborhood disadvantage metric, the Area Deprivation Index (ADI), derived from measures of income, education, employment, and housing quality. METHODS: Participants including 74 TLE patients (47 male, mean age = 39.2 years) and 45 healthy controls (27 male, mean age = 31.9 years) from the Epilepsy Connectome Project were classified into ADI-defined low and high disadvantage groups. Graph theoretic metrics were applied to multishell connectome diffusion-weighted imaging (DWI) measurements to derive 162 × 162 structural connectivity matrices (SCMs). The SCMs were harmonized using neuroCombat to account for interscanner differences. Threshold-free network-based statistics were used for analysis, and findings were correlated with ADI quintile metrics. A decrease in cross-sectional area (CSA) indicates reduced white matter integrity. RESULTS: Sex- and age-adjusted CSA in TLE groups was significantly reduced compared to controls regardless of disadvantage status, revealing discrete aberrant white matter tract connectivity abnormalities in addition to apparent differences in graph measures of connectivity and network-based statistics. When comparing broadly defined disadvantaged TLE groups, differences were at trend level. Sensitivity analyses of ADI quintile extremes revealed significantly lower CSA in the most compared to least disadvantaged TLE group. SIGNIFICANCE: Our findings demonstrate (1) the general impact of TLE on DWI connectome status is larger than the association with neighborhood disadvantage; however, (2) neighborhood disadvantage, indexed by ADI, revealed modest relationships with white matter structure and integrity on sensitivity analysis in TLE. Further studies are needed to explore this relationship and determine whether the white matter relationship with ADI is driven by social drift or environmental influences on brain development. Understanding the etiology and course of the disadvantage-brain integrity relationship may serve to inform care, management, and policy for patients.

Deep Artificial Neural Networks Reveal a Distributed Cortical Network Encoding Propositional Sentence-Level Meaning.

Understanding how and where in the brain sentence-level meaning is constructed from words presents a major scientific challenge. Recent advances have begun to explain brain activation elicited by sentences using vector models of word meaning derived from patterns of word co-occurrence in text corpora. These studies have helped map out semantic representation across a distributed brain network spanning temporal, parietal, and frontal cortex. However, it remains unclear whether activation patterns within regions reflect unified representations of sentence-level meaning, as opposed to superpositions of context-independent component words. This is because models have typically represented sentences as "bags-of-words" that neglect sentence-level structure. To address this issue, we interrogated fMRI activation elicited as 240 sentences were read by 14 participants (9 female, 5 male), using sentences encoded by a recurrent deep artificial neural-network trained on a sentence inference task (InferSent). Recurrent connections and nonlinear filters enable InferSent to transform sequences of word vectors into unified "propositional" sentence representations suitable for evaluating intersentence entailment relations. Using voxelwise encoding modeling, we demonstrate that InferSent predicts elements of fMRI activation that cannot be predicted by bag-of-words models and sentence models using grammatical rules to assemble word vectors. This effect occurs throughout a distributed network, which suggests that propositional sentence-level meaning is represented within and across multiple cortical regions rather than at any single site. In follow-up analyses, we place results in the context of other deep network approaches (ELMo and BERT) and estimate the degree of unpredicted neural signal using an "experiential" semantic model and cross-participant encoding.SIGNIFICANCE STATEMENT A modern-day scientific challenge is to understand how the human brain transforms word sequences into representations of sentence meaning. A recent approach, emerging from advances in functional neuroimaging, big data, and machine learning, is to computationally model meaning, and use models to predict brain activity. Such models have helped map a cortical semantic information-processing network. However, how unified sentence-level information, as opposed to word-level units, is represented throughout this network remains unclear. This is because models have typically represented sentences as unordered "bags-of-words." Using a deep artificial neural network that recurrently and nonlinearly combines word representations into unified propositional sentence representations, we provide evidence that sentence-level information is encoded throughout a cortical network, rather than in a single region.

Late dominance of the right hemisphere during narrative comprehension.

PET and fMRI studies suggest that auditory narrative comprehension is supported by a bilateral multilobar cortical network. The superior temporal resolution of magnetoencephalography (MEG) makes it an attractive tool to investigate the dynamics of how different neuroanatomic substrates engage during narrative comprehension. Using beta-band power changes as a marker of cortical engagement, we studied MEG responses during an auditory story comprehension task in 31 healthy adults. The protocol consisted of two runs, each interleaving 7 blocks of the story comprehension task with 15 blocks of an auditorily presented math task as a control for phonological processing, working memory, and attention processes. Sources at the cortical surface were estimated with a frequency-resolved beamformer. Beta-band power was estimated in the frequency range of 16-24 Hz over 1-sec epochs starting from 400 msec after stimulus onset until the end of a story or math problem presentation. These power estimates were compared to 1-second epochs of data before the stimulus block onset. The task-related cortical engagement was inferred from beta-band power decrements. Group-level source activations were statistically compared using non-parametric permutation testing. A story-math contrast of beta-band power changes showed greater bilateral cortical engagement within the fusiform gyrus, inferior and middle temporal gyri, parahippocampal gyrus, and left inferior frontal gyrus (IFG) during story comprehension. A math-story contrast of beta power decrements showed greater bilateral but left-lateralized engagement of the middle frontal gyrus and superior parietal lobule. The evolution of cortical engagement during five temporal windows across the presentation of stories showed significant involvement during the first interval of the narrative of bilateral opercular and insular regions as well as the ventral and lateral temporal cortex, extending more posteriorly on the left and medially on the right. Over time, there continued to be sustained right anterior ventral temporal engagement, with increasing involvement of the right anterior parahippocampal gyrus, STG, MTG, posterior superior temporal sulcus, inferior parietal lobule, frontal operculum, and insula, while left hemisphere engagement decreased. Our findings are consistent with prior imaging studies of narrative comprehension, but in addition, they demonstrate increasing right-lateralized engagement over the course of narratives, suggesting an important role for these right-hemispheric regions in semantic integration as well as social and pragmatic inference processing.

Regional and global resting-state functional MR connectivity in temporal lobe epilepsy: Results from the Epilepsy Connectome Project.

Temporal lobe epilepsy (TLE) has been conceptualized as focal disease with a discrete neurobiological focus and can respond well to targeted resection or ablation. In contrast, the neuro-cognitive deficits resulting from TLE can be widespread involving regions beyond the primary epileptic network. We hypothesize that this seemingly paradoxical findings can be explained by differences in connectivity between the primary epileptic region which is hyper-connected and its secondary influence on global connectome organization. This hypothesis is tested using regional and global graph theory metrics where we anticipate that regional mesial-temporal hyperconnectivity will be found and correlate with seizure frequency while global networks will be disorganized and be more closely associated with neuro-cognitive deficits. Resting-state fMRI was used to examine temporal lobe regional connectivity and global functional connectivity from 102 patients with TLE and 55 controls. Connectivity matrices were calculated for subcortical volumes and cortical parcellations. Graph theory metrics (global clustering coefficient (GCC), degree, closeness) were compared between groups and in relation to neuropsychological profiles and disease covariates using permutation testing and causal analysis. In TLE there was a decrease in GCC (p = 0.0345) associated with a worse neuropsychological profile (p = 0.0134). There was increased connectivity in the left hippocampus/amygdala (degree p = 0.0103, closeness p = 0.0104) and a decrease in connectivity in the right lateral temporal lobe (degree p = 0.0186, closeness p = 0.0122). A ratio between the hippocampus/amygdala and lateral temporal lobe-temporal lobe connectivity ratio (TLCR) revealed differences between TLE and controls for closeness (left p = 0.00149, right p = 0.0494) and for degree on left p = 0.00169; with trend on right p = 0.0567. Causal analysis suggested that "Epilepsy Activity" (seizure frequency, anti-seizure medications) was associated with increase in TLCR but not in GCC, while cognitive decline was associated with decreased GCC. These findings support the hypothesis that in TLE there is hyperconnectivity in the hippocampus/amygdala and hypoconnectivity in the lateral temporal lobe associated with "Epilepsy Activity." While, global connectome disorganization was associated with worse neuropsychological phenotype.

An Integrated Neural Decoder of Linguistic and Experiential Meaning.

The brain is thought to combine linguistic knowledge of words and nonlinguistic knowledge of their referents to encode sentence meaning. However, functional neuroimaging studies aiming at decoding language meaning from neural activity have mostly relied on distributional models of word semantics, which are based on patterns of word co-occurrence in text corpora. Here, we present initial evidence that modeling nonlinguistic "experiential" knowledge contributes to decoding neural representations of sentence meaning. We model attributes of peoples' sensory, motor, social, emotional, and cognitive experiences with words using behavioral ratings. We demonstrate that fMRI activation elicited in sentence reading is more accurately decoded when this experiential attribute model is integrated with a text-based model than when either model is applied in isolation (participants were 5 males and 9 females). Our decoding approach exploits a representation-similarity-based framework, which benefits from being parameter free, while performing at accuracy levels comparable with those from parameter fitting approaches, such as ridge regression. We find that the text-based model contributes particularly to the decoding of sentences containing linguistically oriented "abstract" words and reveal tentative evidence that the experiential model improves decoding of more concrete sentences. Finally, we introduce a cross-participant decoding method to estimate an upper bound on model-based decoding accuracy. We demonstrate that a substantial fraction of neural signal remains unexplained, and leverage this gap to pinpoint characteristics of weakly decoded sentences and hence identify model weaknesses to guide future model development.SIGNIFICANCE STATEMENT Language gives humans the unique ability to communicate about historical events, theoretical concepts, and fiction. Although words are learned through language and defined by their relations to other words in dictionaries, our understanding of word meaning presumably draws heavily on our nonlinguistic sensory, motor, interoceptive, and emotional experiences with words and their referents. Behavioral experiments lend support to the intuition that word meaning integrates aspects of linguistic and nonlinguistic "experiential" knowledge. However, behavioral measures do not provide a window on how meaning is represented in the brain and tend to necessitate artificial experimental paradigms. We present a model-based approach that reveals early evidence that experiential and linguistically acquired knowledge can be detected in brain activity elicited in reading natural sentences.

Mapping language from MEG beta power modulations during auditory and visual naming.

Evaluation of language dominance is an essential step prior to epilepsy surgery. There is no consensus on an optimal methodology for determining language dominance using magnetoencephalography (MEG). Oscillatory dynamics are increasingly recognized as being of fundamental importance for brain function and dysfunction. Using task-related beta power modulations in MEG, we developed an analysis framework for localizing and lateralizing areas relevant to language processing in patients with focal epilepsy. We examined MEG responses from 29 patients (age 42 â€‹± â€‹13 years, 15M/14F) during auditory description naming (ADN) and visual picture naming (PN). MEG data were preprocessed using a combination of spatiotemporal filtering, signal thresholding, and ICA decomposition. Beta-band 17-25Hz power decrements were examined at both sensor and source levels. Volumetric grids of anatomical source space were constructed in MNI space at 8 â€‹mm isotropic resolution, and beta-band power changes were estimated using the dynamic imaging of coherent sources beamformer technique. A 600 â€‹ms temporal-window that ends 100 â€‹ms before speech onset was selected for analysis, to focus on later stages of word production such as phonologic selection and motor speech preparation. Cluster-based permutation testing was employed for patient- and group-level statistical inferences. Automated anatomic labeling atlas-driven laterality indices (LIs) were computed for 13 left and right language- and motor speech-related cortical regions. Group localization of ADN and PN consistently revealed significant task-related decrements of beta-power within language-related areas in the frontal, temporal and parietal lobes as well as motor-related regions of precentral/premotor and postcentral/somatomotor gyri. A region-of-interest analysis of ADN and PN suggested a strong correlation of r â€‹= â€‹0.74 (p â€‹< â€‹0.05, FDR corrected) between the two tasks within the language-related brain regions, with the highest spatial overlap in the prefrontal areas. Laterality indices (LIs) consistently showed left dominance (LI â€‹> â€‹0.1) for most individuals (93% and 82% during ADN and PN, respectively), with average LIs of 0.40 â€‹± â€‹0.25 and 0.34 â€‹± â€‹0.20 for ADN and PN, respectively. Source analysis of task-related beta power decrements appears to be a reliable method for lateralizing and localizing brain activations associated with language processing in patients with epilepsy.

Temporal lobe regions essential for preserved picture naming after left temporal epilepsy surgery.

OBJECTIVE: To define left temporal lobe regions where surgical resection produces a persistent postoperative decline in naming visual objects. METHODS: Pre- and postoperative brain magnetic resonance imaging data and picture naming (Boston Naming Test) scores were obtained prospectively from 59 people with drug-resistant left temporal lobe epilepsy. All patients had left hemisphere language dominance at baseline and underwent surgical resection or ablation in the left temporal lobe. Postoperative naming assessment occurred approximately 7 months after surgery. Surgical lesions were mapped to a standard template, and the relationship between presence or absence of a lesion and the degree of naming decline was tested at each template voxel while controlling for effects of overall lesion size. RESULTS: Patients declined by an average of 15% in their naming score, with wide variation across individuals. Decline was significantly related to damage in a cluster of voxels in the ventral temporal lobe, located mainly in the fusiform gyrus approximately 4-6 cm posterior to the temporal tip. Extent of damage to this region explained roughly 50% of the variance in outcome. Picture naming decline was not related to hippocampal or temporal pole damage. SIGNIFICANCE: The results provide the first statistical map relating lesion location in left temporal lobe epilepsy surgery to picture naming decline, and they support previous observations of transient naming deficits from electrical stimulation in the basal temporal cortex. The critical lesion is relatively posterior and could be avoided in many patients undergoing left temporal lobe surgery for intractable epilepsy.

Changes in description naming for common and proper nouns after left anterior temporal lobectomy.

Numerous studies have shown that surgical resection of the left anterior temporal lobe (ATL) is associated with a decline in object naming ability (Hermann et al., 1999). In contrast, few studies have examined the effects of left ATL surgery on auditory description naming (ADN) or category-specific naming. Compared with object naming, which loads heavily on visual recognition processes, ADN provides a more specific measure of concept retrieval. The present study examined ADN declines in a large group of patients who were tested before and after left ATL surgery, using a 2 × 2 × 2 factorial manipulation of uniqueness (common vs. proper nouns), taxonomic category (living vs. nonliving things), and time (pre- vs. postsurgery). Significant declines occurred across all categories but were substantially larger for proper living (PL) concepts, i.e., famous individuals. The disproportionate decline in PL noun naming relative to other conditions is consistent with the notion that the left ATL is specialized not only for retrieval of unique entity concepts, but also plays a role in processing social concepts and person-specific features.

Neuroticism in temporal lobe epilepsy is associated with altered limbic-frontal lobe resting-state functional connectivity.

Neuroticism, a core personality trait characterized by a tendency towards experiencing negative affect, has been reported to be higher in people with temporal lobe epilepsy (TLE) compared with healthy individuals. Neuroticism is a known predictor of depression and anxiety, which also occur more frequently in people with TLE. The purpose of this study was to identify abnormalities in whole-brain resting-state functional connectivity in relation to neuroticism in people with TLE and to determine the degree of unique versus shared patterns of abnormal connectivity in relation to elevated symptoms of depression and anxiety. Ninety-three individuals with TLE (55 females) and 40 healthy controls (18 females) from the Epilepsy Connectome Project (ECP) completed measures of neuroticism, depression, and anxiety, which were all significantly higher in people with TLE compared with controls. Resting-state functional connectivity was compared between controls and groups with TLE with high and low neuroticism using analysis of variance (ANOVA) and t-test. In secondary analyses, the same analytics were performed using measures of depression and anxiety and the unique variance in resting-state connectivity associated with neuroticism independent of symptoms of depression and anxiety identified. Increased neuroticism was significantly associated with hyposynchrony between the right hippocampus and Brodmann area (BA) 9 (region of prefrontal cortex (PFC)) (p < 0.005), representing a unique relationship independent of symptoms of depression and anxiety. Hyposynchrony of connection between the right hippocampus and BA47 (anterior frontal operculum) was associated with high neuroticism and with higher depression and anxiety scores (p < 0.05), making it a shared abnormal connection for the three measures. In conclusion, increased neuroticism exhibits both unique and shared patterns of abnormal functional connectivity with depression and anxiety symptoms between regions of the mesial temporal and frontal lobe.

Multiple Regions of a Cortical Network Commonly Encode the Meaning of Words in Multiple Grammatical Positions of Read Sentences.

Deciphering how sentence meaning is represented in the brain remains a major challenge to science. Semantically related neural activity has recently been shown to arise concurrently in distributed brain regions as successive words in a sentence are read. However, what semantic content is represented by different regions, what is common across them, and how this relates to words in different grammatical positions of sentences is weakly understood. To address these questions, we apply a semantic model of word meaning to interpret brain activation patterns elicited in sentence reading. The model is based on human ratings of 65 sensory/motor/emotional and cognitive features of experience with words (and their referents). Through a process of mapping functional Magnetic Resonance Imaging activation back into model space we test: which brain regions semantically encode content words in different grammatical positions (e.g., subject/verb/object); and what semantic features are encoded by different regions. In left temporal, inferior parietal, and inferior/superior frontal regions we detect the semantic encoding of words in all grammatical positions tested and reveal multiple common components of semantic representation. This suggests that sentence comprehension involves a common core representation of multiple words' meaning being encoded in a network of regions distributed across the brain.

Neuroanatomical correlates of personality traits in temporal lobe epilepsy: Findings from the Epilepsy Connectome Project.

Behavioral and personality disorders in temporal lobe epilepsy (TLE) have been a topic of interest and controversy for decades, with less attention paid to alterations in normal personality structure and traits. In this investigation, core personality traits (the Big 5) and their neurobiological correlates in TLE were explored using the Neuroticism Extraversion Openness-Five Factor Inventory (NEO-FFI) and structural magnetic resonance imaging (MRI) through the Epilepsy Connectome Project (ECP). NEO-FFI scores from 67 individuals with TLE (34.6 ±â€¯9.5 years; 67% women) were compared to 31 healthy controls (32.8 ±â€¯8.9 years; 41% women) to assess differences in the Big 5 traits (agreeableness, openness, conscientiousness, neuroticism, and extraversion). Individuals with TLE showed significantly higher neuroticism, with no significant differences on the other traits. Neural correlates of neuroticism were then determined in participants with TLE including cortical and subcortical volumes. Distributed reductions in cortical gray matter volumes were associated with increased neuroticism. Subcortically, hippocampal and amygdala volumes were negatively associated with neuroticism. These results offer insight into alterations in the Big 5 personality traits in TLE and their brain-related correlates.

Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation.

We introduce an approach that predicts neural representations of word meanings contained in sentences then superposes these to predict neural representations of new sentences. A neurobiological semantic model based on sensory, motor, social, emotional, and cognitive attributes was used as a foundation to define semantic content. Previous studies have predominantly predicted neural patterns for isolated words, using models that lack neurobiological interpretation. Fourteen participants read 240 sentences describing everyday situations while undergoing fMRI. To connect sentence-level fMRI activation patterns to the word-level semantic model, we devised methods to decompose the fMRI data into individual words. Activation patterns associated with each attribute in the model were then estimated using multiple-regression. This enabled synthesis of activation patterns for trained and new words, which were subsequently averaged to predict new sentences. Region-of-interest analyses revealed that prediction accuracy was highest using voxels in the left temporal and inferior parietal cortex, although a broad range of regions returned statistically significant results, showing that semantic information is widely distributed across the brain. The results show how a neurobiologically motivated semantic model can decompose sentence-level fMRI data into activation features for component words, which can be recombined to predict activation patterns for new sentences.

Heteromodal Cortical Areas Encode Sensory-Motor Features of Word Meaning.

UNLABELLED: The capacity to process information in conceptual form is a fundamental aspect of human cognition, yet little is known about how this type of information is encoded in the brain. Although the role of sensory and motor cortical areas has been a focus of recent debate, neuroimaging studies of concept representation consistently implicate a network of heteromodal areas that seem to support concept retrieval in general rather than knowledge related to any particular sensory-motor content. We used predictive machine learning on fMRI data to investigate the hypothesis that cortical areas in this "general semantic network" (GSN) encode multimodal information derived from basic sensory-motor processes, possibly functioning as convergence-divergence zones for distributed concept representation. An encoding model based on five conceptual attributes directly related to sensory-motor experience (sound, color, shape, manipulability, and visual motion) was used to predict brain activation patterns associated with individual lexical concepts in a semantic decision task. When the analysis was restricted to voxels in the GSN, the model was able to identify the activation patterns corresponding to individual concrete concepts significantly above chance. In contrast, a model based on five perceptual attributes of the word form performed at chance level. This pattern was reversed when the analysis was restricted to areas involved in the perceptual analysis of written word forms. These results indicate that heteromodal areas involved in semantic processing encode information about the relative importance of different sensory-motor attributes of concepts, possibly by storing particular combinations of sensory and motor features. SIGNIFICANCE STATEMENT: The present study used a predictive encoding model of word semantics to decode conceptual information from neural activity in heteromodal cortical areas. The model is based on five sensory-motor attributes of word meaning (color, shape, sound, visual motion, and manipulability) and encodes the relative importance of each attribute to the meaning of a word. This is the first demonstration that heteromodal areas involved in semantic processing can discriminate between different concepts based on sensory-motor information alone. This finding indicates that the brain represents concepts as multimodal combinations of sensory and motor representations.

Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics.

Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes--color, shape, visual motion, sound, and manipulation--for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes.

Toward a brain-based componential semantic representation.

Componential theories of lexical semantics assume that concepts can be represented by sets of features or attributes that are in some sense primitive or basic components of meaning. The binary features used in classical category and prototype theories are problematic in that these features are themselves complex concepts, leaving open the question of what constitutes a primitive feature. The present availability of brain imaging tools has enhanced interest in how concepts are represented in brains, and accumulating evidence supports the claim that these representations are at least partly "embodied" in the perception, action, and other modal neural systems through which concepts are experienced. In this study we explore the possibility of devising a componential model of semantic representation based entirely on such functional divisions in the human brain. We propose a basic set of approximately 65 experiential attributes based on neurobiological considerations, comprising sensory, motor, spatial, temporal, affective, social, and cognitive experiences. We provide normative data on the salience of each attribute for a large set of English nouns, verbs, and adjectives, and show how these attribute vectors distinguish a priori conceptual categories and capture semantic similarity. Robust quantitative differences between concrete object categories were observed across a large number of attribute dimensions. A within- versus between-category similarity metric showed much greater separation between categories than representations derived from distributional (latent semantic) analysis of text. Cluster analyses were used to explore the similarity structure in the data independent of a priori labels, revealing several novel category distinctions. We discuss how such a representation might deal with various longstanding problems in semantic theory, such as feature selection and weighting, representation of abstract concepts, effects of context on semantic retrieval, and conceptual combination. In contrast to componential models based on verbal features, the proposed representation systematically relates semantic content to large-scale brain networks and biologically plausible accounts of concept acquisition.