Expansive linguistic representations to predict interpretable odor mixture discriminability.

Language is often thought as being poorly adapted to precisely describe or quantify smell and olfactory attributes. In this work, we show that semantic descriptors of odors can be implemented in a model to successfully predict odor mixture discriminability, an olfactory attribute. We achieved this by taking advantage of the structure-to-percept model we previously developed for monomolecular odorants, using chemical descriptors to predict pleasantness, intensity and 19 semantic descriptors such as "fish," "cold," "burnt," "garlic," "grass," and "sweet" for odor mixtures, followed by a metric learning to obtain odor mixture discriminability. Through this expansion of the representation of olfactory mixtures, our Semantic model outperforms state of the art methods by taking advantage of the intermediary semantic representations learned from human perception data to enhance and generalize the odor discriminability/similarity predictions. As 10 of the semantic descriptors were selected to predict discriminability/similarity, our approach meets the need of rapidly obtaining interpretable attributes of odor mixtures as illustrated by the difficulty of finding olfactory metamers. More fundamentally, it also shows that language can be used to establish a metric of discriminability in the everyday olfactory space.

Loss of nucleus accumbens low-frequency fluctuations is a signature of chronic pain.

Chronic pain is a highly prevalent disease with poorly understood pathophysiology. In particular, the brain mechanisms mediating the transition from acute to chronic pain remain largely unknown. Here, we identify a subcortical signature of back pain. Specifically, subacute back pain patients who are at risk for developing chronic pain exhibit a smaller nucleus accumbens volume, which persists in the chronic phase, compared to healthy controls. The smaller accumbens volume was also observed in a separate cohort of chronic low-back pain patients and was associated with dynamic changes in functional connectivity. At baseline, subacute back pain patients showed altered local nucleus accumbens connectivity between putative shell and core, irrespective of the risk of transition to chronic pain. At follow-up, connectivity changes were observed between nucleus accumbens and rostral anterior cingulate cortex in the patients with persistent pain. Analysis of the power spectral density of nucleus accumbens resting-state activity in the subacute and chronic back pain patients revealed loss of power in the slow-5 frequency band (0.01 to 0.027 Hz) which developed only in the chronic phase of pain. This loss of power was reproducible across two cohorts of chronic low-back pain patients obtained from different sites and accurately classified chronic low-back pain patients in two additional independent datasets. Our results provide evidence that lower nucleus accumbens volume confers risk for developing chronic pain and altered nucleus accumbens activity is a signature of the state of chronic pain.

Predictive Modeling of Huntington's Disease Unfolds Thalamic and Caudate Atrophy Dissociation.

BACKGROUND: Atrophy in the striatum is a hallmark of Huntington's disease (HD), including the period before clinical motor diagnosis (before-CMD), but it extends to other subcortical structures. The study of the covariation of these structures could improve the detection of disease-related longitudinal progression before-CMD, provide mechanistic insights of the disease, and potentially be used to obtain accurate prospective estimates of atrophy before-CMD and early after-CMD. METHODS: We analyzed data from 337 before-CMD individuals, 236 healthy control subjects, and 95 early after-CMD individuals from three studies, and we used nine subcortical regions volumes in two analyses. First, we discriminated before-CMD from healthy control trajectories by integrating volume changes from these regions. Second, we estimated prospective atrophy before-CMD and early after-CMD by considering the influence of a region's present volume over the future volume of another one. RESULTS: Before-CMD progression was robustly detected across studies. Indeed, detection of before-CMD progression improved when multiple structures were integrated, as opposed to analyzing the striatum alone, likely because of the reduced partial correlation between caudate and thalamic volume change before-CMD. Our multivariate atrophy prediction model found a thalamus-caudate association that is consistent with this pattern, which yields an improved caudate atrophy prediction in early after-CMD. CONCLUSIONS: This study is the first attempt to validate before-CMD multivariate subcortical change detection across studies and to do multivariate prospective atrophy prediction in HD. These models achieve improved performance by detecting a dissociation between caudate and thalamic atrophy trajectories, and they provide a possible mechanistic understanding of the dynamics of HD. © 2022 International Parkinson and Movement Disorder Society.

An entropic barriers diffusion theory of decision-making in multiple alternative tasks.

We present a theory of decision-making in the presence of multiple choices that departs from traditional approaches by explicitly incorporating entropic barriers in a stochastic search process. We analyze response time data from an on-line repository of 15 million blitz chess games, and show that our model fits not just the mean and variance, but the entire response time distribution (over several response-time orders of magnitude) at every stage of the game. We apply the model to show that (a) higher cognitive expertise corresponds to the exploration of more complex solution spaces, and (b) reaction times of users at an on-line buying website can be similarly explained. Our model can be seen as a synergy between diffusion models used to model simple two-choice decision-making and planning agents in complex problem solving.

Loss of Consciousness Is Associated with Stabilization of Cortical Activity.

What aspects of neuronal activity distinguish the conscious from the unconscious brain? This has been a subject of intense interest and debate since the early days of neurophysiology. However, as any practicing anesthesiologist can attest, it is currently not possible to reliably distinguish a conscious state from an unconscious one on the basis of brain activity. Here we approach this problem from the perspective of dynamical systems theory. We argue that the brain, as a dynamical system, is self-regulated at the boundary between stable and unstable regimes, allowing it in particular to maintain high susceptibility to stimuli. To test this hypothesis, we performed stability analysis of high-density electrocorticography recordings covering an entire cerebral hemisphere in monkeys during reversible loss of consciousness. We show that, during loss of consciousness, the number of eigenmodes at the edge of instability decreases smoothly, independently of the type of anesthetic and specific features of brain activity. The eigenmodes drift back toward the unstable line during recovery of consciousness. Furthermore, we show that stability is an emergent phenomenon dependent on the correlations among activity in different cortical regions rather than signals taken in isolation. These findings support the conclusion that dynamics at the edge of instability are essential for maintaining consciousness and provide a novel and principled measure that distinguishes between the conscious and the unconscious brain. SIGNIFICANCE STATEMENT: What distinguishes brain activity during consciousness from that observed during unconsciousness? Answering this question has proven difficult because neither consciousness nor lack thereof have universal signatures in terms of most specific features of brain activity. For instance, different anesthetics induce different patterns of brain activity. We demonstrate that loss of consciousness is universally and reliably associated with stabilization of cortical dynamics regardless of the specific activity characteristics. To give an analogy, our analysis suggests that loss of consciousness is akin to depressing the damper pedal on the piano, which makes the sounds dissipate quicker regardless of the specific melody being played. This approach may prove useful in detecting consciousness on the basis of brain activity under anesthesia and other settings.

Perceptual basis of evolving Western musical styles.

The brain processes temporal statistics to predict future events and to categorize perceptual objects. These statistics, called expectancies, are found in music perception, and they span a variety of different features and time scales. Specifically, there is evidence that music perception involves strong expectancies regarding the distribution of a melodic interval, namely, the distance between two consecutive notes within the context of another. The recent availability of a large Western music dataset, consisting of the historical record condensed as melodic interval counts, has opened new possibilities for data-driven analysis of musical perception. In this context, we present an analytical approach that, based on cognitive theories of music expectation and machine learning techniques, recovers a set of factors that accurately identifies historical trends and stylistic transitions between the Baroque, Classical, Romantic, and Post-Romantic periods. We also offer a plausible musicological and cognitive interpretation of these factors, allowing us to propose them as data-driven principles of melodic expectation.

Multimodal fusion of brain signals for robust prediction of psychosis transition.

The prospective study of youths at clinical high risk (CHR) for psychosis, including neuroimaging, can identify neural signatures predictive of psychosis outcomes using algorithms that integrate complex information. Here, to identify risk and psychosis conversion, we implemented multiple kernel learning (MKL), a multimodal machine learning approach allowing patterns from each modality to inform each other. Baseline multimodal scans (n = 74, 11 converters) included structural, resting-state functional imaging, and diffusion-weighted data. Multimodal MKL outperformed unimodal models (AUC = 0.73 vs. 0.66 in predicting conversion). Moreover, patterns learned by MKL were robust to training set variations, suggesting it can identify cross-modality redundancies and synergies to stabilize the predictive pattern. We identified many predictors consistent with the literature, including frontal cortices, cingulate, thalamus, and striatum. This highlights the advantage of methods that leverage the complex pathophysiology of psychosis.

Fusion of biomedical imaging studies for increased sample size and diversity: a case study of brain MRI.

Data collection, curation, and cleaning constitute a crucial phase in Machine Learning (ML) projects. In biomedical ML, it is often desirable to leverage multiple datasets to increase sample size and diversity, but this poses unique challenges, which arise from heterogeneity in study design, data descriptors, file system organization, and metadata. In this study, we present an approach to the integration of multiple brain MRI datasets with a focus on homogenization of their organization and preprocessing for ML. We use our own fusion example (approximately 84,000 images from 54,000 subjects, 12 studies, and 88 individual scanners) to illustrate and discuss the issues faced by study fusion efforts, and we examine key decisions necessary during dataset homogenization, presenting in detail a database structure flexible enough to accommodate multiple observational MRI datasets. We believe our approach can provide a basis for future similarly-minded biomedical ML projects.

Speech and language patterns in autism: Towards natural language processing as a research and clinical tool.

Speech and language differences have long been described as important characteristics of autism spectrum disorder (ASD). Linguistic abnormalities range from prosodic differences in pitch, intensity, and rate of speech, to language idiosyncrasies and difficulties with pragmatics and reciprocal conversation. Heterogeneity of findings and a reliance on qualitative, subjective ratings, however, limit a full understanding of linguistic phenotypes in autism. This review summarizes evidence of both speech and language differences in ASD. We also describe recent advances in linguistic research, aided by automated methods and software like natural language processing (NLP) and speech analytic software. Such approaches allow for objective, quantitative measurement of speech and language patterns that may be more tractable and unbiased. Future research integrating both speech and language features and capturing "natural language" samples may yield a more comprehensive understanding of language differences in autism, offering potential implications for diagnosis, intervention, and research.

Predictive dynamics of human pain perception.

While the static magnitude of thermal pain perception has been shown to follow a power-law function of the temperature, its dynamical features have been largely overlooked. Due to the slow temporal experience of pain, multiple studies now show that the time evolution of its magnitude can be captured with continuous online ratings. Here we use such ratings to model quantitatively the temporal dynamics of thermal pain perception. We show that a differential equation captures the details of the temporal evolution in pain ratings in individual subjects for different stimulus pattern complexities, and also demonstrates strong predictive power to infer pain ratings, including readouts based only on brain functional images.

ChatGPT and Bard exhibit spontaneous citation fabrication during psychiatry literature search.

ChatGPT (Generative Pre-Trained Transformer) is a large language model (LLM), which comprises a neural network that has learned information and patterns of language use from large amounts of text on the internet. ChatGPT, introduced by OpenAI, responds to human queries in a conversational manner. Here, we aimed to assess whether ChatGPT could reliably produce accurate references to supplement the literature search process. We describe our March 2023 exchange with ChatGPT, which generated thirty-five citations, two of which were real. 12 citations were similar to actual manuscripts (e.g., titles with incorrect author lists, journals, or publication years) and the remaining 21, while plausible, were in fact a pastiche of multiple existent manuscripts. In June 2023, we re-tested ChatGPT's performance and compared it to that of Google's GPT counterpart, Bard 2.0. We investigated performance in English, as well as in Spanish and Italian. Fabrications made by LLMs, including erroneous citations, have been called "hallucinations"; we discuss reasons for which this is a misnomer. Furthermore, we describe potential explanations for citation fabrication by GPTs, as well as measures being taken to remedy this issue, including reinforcement learning. Our results underscore that output from conversational LLMs should be verified.

Linguistic correlates of suicidal ideation in youth at clinical high-risk for psychosis.

Suicidal ideation (SI) is prevalent among individuals at clinical high-risk for psychosis (CHR). Natural language processing (NLP) provides an efficient method to identify linguistic markers of suicidality. Prior work has demonstrated that an increased use of "I", as well as words with semantic similarity to "anger", "sadness", "stress" and "lonely", are correlated with SI in other cohorts. The current project analyzes data collected in an SI supplement to an NIH R01 study of thought disorder and social cognition in CHR. This study is the first to use NLP analyses of spoken language to identify linguistic correlates of recent suicidal ideation among CHR individuals. The sample included 43 CHR individuals, 10 with recent suicidal ideation and 33 without, as measured by the Columbia-Suicide Severity Rating Scale, as well as 14 healthy volunteers without SI. NLP methods include part-of-speech (POS) tagging, a GoEmotions-trained BERT Model, and Zero-Shot Learning. As hypothesized, individuals at CHR for psychosis who endorsed recent SI utilized more words with semantic similarity to "anger" compared to those who did not. Words with semantic similarity to "stress", "loneliness", and "sadness" were not significantly different between the two CHR groups. Contrary to our hypotheses, CHR individuals with recent SI did not use the word "I" more than those without recent SI. As anger is not characteristic of CHR, findings have implications for the consideration of subthreshold anger-related sentiment in suicidal risk assessment. As NLP is scalable, findings suggest that language markers may improve suicide screening and prediction in this population.

Emergence of Language Related to Self-experience and Agency in Autobiographical Narratives of Individuals With Schizophrenia.

BACKGROUND AND HYPOTHESIS: Disturbances in self-experience are a central feature of schizophrenia and its study can enhance phenomenological understanding and inform mechanisms underlying clinical symptoms. Self-experience involves the sense of self-presence, of being the subject of one's own experiences and agent of one's own actions, and of being distinct from others. Self-experience is traditionally assessed by manual rating of interviews; however, natural language processing (NLP) offers automated approach that can augment manual ratings by rapid and reliable analysis of text. STUDY DESIGN: We elicited autobiographical narratives from 167 patients with schizophrenia or schizoaffective disorder (SZ) and 90 healthy controls (HC), amounting to 490 000 words and 26 000 sentences. We used NLP techniques to examine transcripts for language related to self-experience, machine learning to validate group differences in language, and canonical correlation analysis to examine the relationship between language and symptoms. STUDY RESULTS: Topics related to self-experience and agency emerged as significantly more expressed in SZ than HC (P < 10-13) and were decoupled from similarly emerging features such as emotional tone, semantic coherence, and concepts related to burden. Further validation on hold-out data showed that a classifier trained on these features achieved patient-control discrimination with AUC = 0.80 (P < 10-5). Canonical correlation analysis revealed significant relationships between self-experience and agency language features and clinical symptoms. CONCLUSIONS: Notably, the self-experience and agency topics emerged without any explicit probing by the interviewer and can be algorithmically detected even though they involve higher-order metacognitive processes. These findings illustrate the utility of NLP methods to examine phenomenological aspects of schizophrenia.

Differential Expression of Anomalous Self-Experiences in Spontaneous Speech in Clinical High-Risk and Early-Course Psychosis Quantified by Natural Language Processing.

BACKGROUND: Basic self-disturbance, or anomalous self-experiences (ASEs), is a core feature of the schizophrenia spectrum. We propose a novel method of natural language processing to quantify ASEs in spoken language by direct comparison to an inventory of self-disturbance, the Inventory of Psychotic-Like Anomalous Self-Experiences (IPASE). We hypothesized that there would be increased similarity in open-ended speech to the IPASE items in individuals with early-course psychosis (PSY) compared with healthy individuals, with clinical high-risk (CHR) individuals intermediate in similarity. METHODS: Open-ended interviews were obtained from 170 healthy control participants, 167 CHR participants, and 89 PSY participants. We calculated the semantic similarity between IPASE items and "I" sentences from transcribed speech samples using S-BERT (Sentence Bidirectional Encoder Representation from Text). Kolmogorov-Smirnov tests were used to compare distributions across groups. A nonnegative matrix factorization of cosine similarity was performed to rank IPASE items. RESULTS: Spoken language of CHR individuals had the greatest semantic similarity to IPASE items when compared to both healthy control (s = 0.44, p < 10-14) and PSY (s = 0.36, p < 10-6) individuals, while IPASE scores were higher among PSY than CHR group participants. In addition, the nonnegative matrix factorization approach produced a data-driven domain that differentiated the CHR group from the others. CONCLUSIONS: We found that open-ended interviews elicited language with increased semantic similarity to the IPASE by participants in the CHR group compared with patients with psychosis. This demonstrates the utility of these methods for differentiating patients from healthy control participants. This complementary approach has the capacity to scale to large studies investigating phenomenological features of schizophrenia and potentially other clinical populations.

Detecting at-risk mental states for psychosis (ARMS) using machine learning ensembles and facial features.

AIMS: Our study aimed to develop a machine learning ensemble to distinguish "at-risk mental states for psychosis" (ARMS) subjects from control individuals from the general population based on facial data extracted from video-recordings. METHODS: 58 non-help-seeking medication-naïve ARMS and 70 healthy subjects were screened from a general population sample. At-risk status was assessed with the Structured Interview for Prodromal Syndromes (SIPS), and "Subject's Overview" section was filmed (5-10 min). Several features were extracted, e.g., eye and mouth aspect ratio, Euler angles, coordinates from 51 facial landmarks. This elicited 649 facial features, which were further selected using Gradient Boosting Machines (AdaBoost combined with Random Forests). Data was split in 70/30 for training, and Monte Carlo cross validation was used. RESULTS: Final model reached 83 % of mean F1-score, and balanced accuracy of 85 %. Mean area under the curve for the receiver operator curve classifier was 93 %. Convergent validity testing showed that two features included in the model were significantly correlated with Avolition (SIPS N2 item) and expression of emotion (SIPS N3 item). CONCLUSION: Our model capitalized on short video-recordings from individuals recruited from the general population, effectively distinguishing between ARMS and controls. Results are encouraging for large-screening purposes in low-resource settings.

Natural Language Processing Markers for Psychosis and Other Psychiatric Disorders: Emerging Themes and Research Agenda From a Cross-Linguistic Workshop.

This workshop summary on natural language processing (NLP) markers for psychosis and other psychiatric disorders presents some of the clinical and research issues that NLP markers might address and some of the activities needed to move in that direction. We propose that the optimal development of NLP markers would occur in the context of research efforts to map out the underlying mechanisms of psychosis and other disorders. In this workshop, we identified some of the challenges to be addressed in developing and implementing NLP markers-based Clinical Decision Support Systems (CDSSs) in psychiatric practice, especially with respect to psychosis. Of note, a CDSS is meant to enhance decision-making by clinicians by providing additional relevant information primarily through software (although CDSSs are not without risks). In psychiatry, a field that relies on subjective clinical ratings that condense rich temporal behavioral information, the inclusion of computational quantitative NLP markers can plausibly lead to operationalized decision models in place of idiosyncratic ones, although ethical issues must always be paramount.

Seeing with the eyes shut: neural basis of enhanced imagery following Ayahuasca ingestion.

The hallucinogenic brew Ayahuasca, a rich source of serotonergic agonists and reuptake inhibitors, has been used for ages by Amazonian populations during religious ceremonies. Among all perceptual changes induced by Ayahuasca, the most remarkable are vivid "seeings." During such seeings, users report potent imagery. Using functional magnetic resonance imaging during a closed-eyes imagery task, we found that Ayahuasca produces a robust increase in the activation of several occipital, temporal, and frontal areas. In the primary visual area, the effect was comparable in magnitude to the activation levels of natural image with the eyes open. Importantly, this effect was specifically correlated with the occurrence of individual perceptual changes measured by psychiatric scales. The activity of cortical areas BA30 and BA37, known to be involved with episodic memory and the processing of contextual associations, was also potentiated by Ayahuasca intake during imagery. Finally, we detected a positive modulation by Ayahuasca of BA 10, a frontal area involved with intentional prospective imagination, working memory and the processing of information from internal sources. Therefore, our results indicate that Ayahuasca seeings stem from the activation of an extensive network generally involved with vision, memory, and intention. By boosting the intensity of recalled images to the same level of natural image, Ayahuasca lends a status of reality to inner experiences. It is therefore understandable why Ayahuasca was culturally selected over many centuries by rain forest shamans to facilitate mystical revelations of visual nature.

Ethical Implications of the Use of Language Analysis Technologies for the Diagnosis and Prediction of Psychiatric Disorders.

Recent developments in artificial intelligence technologies have come to a point where machine learning algorithms can infer mental status based on someone's photos and texts posted on social media. More than that, these algorithms are able to predict, with a reasonable degree of accuracy, future mental illness. They potentially represent an important advance in mental health care for preventive and early diagnosis initiatives, and for aiding professionals in the follow-up and prognosis of their patients. However, important issues call for major caution in the use of such technologies, namely, privacy and the stigma related to mental disorders. In this paper, we discuss the bioethical implications of using such technologies to diagnose and predict future mental illness, given the current scenario of swiftly growing technologies that analyze human language and the online availability of personal information given by social media. We also suggest future directions to be taken to minimize the misuse of such important technologies.

Full-brain auto-regressive modeling (FARM) using fMRI.

In order to fully uncover the information potentially available in the fMRI signal, we model it as a multivariate auto-regressive process. To infer the model, we do not apply any form of clustering or dimensionality reduction, and solve the problem of under-determinacy using sparse regression. We find that only a few small clusters (with average size of 3-4 voxels) are useful in predicting the activity of other voxels, and demonstrate remarkable consistency within a subject as well as across multiple subjects. Moreover, we find that: (a) the areas that can predict activity of other voxels are consistent with previous results related to networks activated by the specific somatosensory task, as well as networks related to the default mode activity; (b) there is a global dynamical state dominated by two prominent (although not unique) streams, originating in the posterior parietal cortex and the posterior cingulate/precuneus cortex; (c) these streams span default mode and task-specific networks, and interact in several regions, notably the insula; and (d) the posterior cingulate is a central node of the default mode network, in terms of its ability to determine the future evolution of the rest of the nodes.

Ordered cyclic motifs contribute to dynamic stability in biological and engineered networks.

Representation and analysis of complex biological and engineered systems as directed networks is useful for understanding their global structure/function organization. Enrichment of network motifs, which are over-represented subgraphs in real networks, can be used for topological analysis. Because counting network motifs is computationally expensive, only characterization of 3- to 5-node motifs has been previously reported. In this study we used a supercomputer to analyze cyclic motifs made of 3-20 nodes for 6 biological and 3 technological networks. Using tools from statistical physics, we developed a theoretical framework for characterizing the ensemble of cyclic motifs in real networks. We have identified a generic property of real complex networks, antiferromagnetic organization, which is characterized by minimal directional coherence of edges along cyclic subgraphs, such that consecutive links tend to have opposing direction. As a consequence, we find that the lack of directional coherence in cyclic motifs leads to depletion in feedback loops, where the number of nodes affected by feedback loops appears to be at a local minimum compared with surrogate shuffled networks. This topology provides more dynamic stability in large networks.