Psychiatric Risk Assessment from the Clinician's Perspective: Lessons for the Future.

Accurate prediction of risk-states in Serious Mental Illnesses (SMIs) is critical for reducing their massive societal burden. Risk-state assessments are notably inaccurate. Recent innovations, including widely available and inexpensive mobile technologies for ambulatory "biobehavioral" data, can reshape risk assessment. To help understand and accelerate clinician involvement, we surveyed 90 multi-disciplinary clinicians serving SMI populations in various settings to evaluate how risk assessment is conducted and can improve. Clinicians reported considerable variability in conducting risk assessment, and few clinicians explicated their procedures beyond tying it to broader mental status examinations or interviews. Very few clinicians endorsed using currently-available standardized risk measures, and most reported low confidence in their utility. Clinicians also reported spending approximately half the time conducting individual risk assessments than optimally needed. When asked about improvement, virtually no clinicians acknowledged biobehavioral, objective technologies, or ambulatory recording. Overall, clinicians seemed unaware of meaningful ways to improve risk assessment.

An examination of the language construct in NIMH's research domain criteria: Time for reconceptualization!

The National Institute of Mental Health's Research Domain Criteria (RDoC) Initiative "calls for the development of new ways of classifying psychopathology based on dimensions of observable behavior." As a result of this ambitious initiative, language has been identified as an independent construct in the RDoC matrix. In this article, we frame language within an evolutionary and neuropsychological context and discuss some of the limitations to the current measurements of language. Findings from genomics and the neuroimaging of performance during language tasks are discussed in relation to serious mental illness and within the context of caveats regarding measuring language. Indeed, the data collection and analysis methods employed to assay language have been both aided and constrained by the available technologies, methodologies, and conceptual definitions. Consequently, different fields of language research show inconsistent definitions of language that have become increasingly broad over time. Individually, they have also shown significant improvements in conceptual resolution, as well as in experimental and analytic techniques. More recently, language research has embraced collaborations across disciplines, notably neuroscience, cognitive science, and computational linguistics and has ultimately re-defined classical ideas of language. As we move forward, the new models of language with their remarkably multifaceted constructs force a re-examination of the NIMH RDoC conceptualization of language and thus the neuroscience and genetics underlying this concept. © 2016 The Authors. American Journal of Medical Genetics Part B: Neuropsychiatric Genetics Published by Wiley Periodicals, Inc.

Cognitive Screening for Mild Cognitive Impairment: Clinician Perspectives on Current Practices and Future Directions.

 This study surveyed 51 specialist clinicians for their views on existing cognitive screening tests for mild cognitive impairment and their opinions about a hypothetical remote screener driven by artificial intelligence (AI). Responses revealed significant concerns regarding the sensitivity, specificity, and time taken to administer current tests, along with a general willingness to consider adopting telephone-based screening driven by AI. Findings highlight the need to design screeners that address the challenges of recognizing the earliest stages of cognitive decline and that prioritize not only accuracy but also stakeholder input.

A framework for language technologies in behavioral research and clinical applications: Ethical challenges, implications, and solutions.

Technological advances in the assessment and understanding of speech and language within the domains of automatic speech recognition, natural language processing, and machine learning present a remarkable opportunity for psychologists to learn more about human thought and communication, evaluate a variety of clinical conditions, and predict cognitive and psychological states. These innovations can be leveraged to automate traditionally time-intensive assessment tasks (e.g., educational assessment), provide psychological information and care (e.g., chatbots), and when delivered remotely (e.g., by mobile phone or wearable sensors) promise underserved communities greater access to health care. Indeed, the automatic analysis of speech provides a wealth of information that can be used for patient care in a wide range of settings (e.g., mHealth applications) and for diverse purposes (e.g., behavioral and clinical research, medical tools that are implemented into practice) and patient types (e.g., numerous psychological disorders and in psychiatry and neurology). However, automation of speech analysis is a complex task that requires the integration of several different technologies within a large distributed process with numerous stakeholders. Many organizations have raised awareness about the need for robust systems for ensuring transparency, oversight, and regulation of technologies utilizing artificial intelligence. Since there is limited knowledge about the ethical and legal implications of these applications in psychological science, we provide a balanced view of both the optimism that is widely published on and also the challenges and risks of use, including discrimination and exacerbation of structural inequalities. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Ergotism in Norway. Part 1: The symptoms and their interpretation from the late Iron Age to the seventeenth century.

Ergotism is a horrendous disease with grotesque symptoms caused by ingesting specific ergot alkaloids. Mass poisoning episodes are attributable to consumption of grain - usually rye - infected with the fungus Claviceps purpurea. By focusing on possible cases of ergotism, we re-examine Norwegian history from the sagas through to the end of the seventeenth century. Our review - not intended to be exhaustive, or ex post facto to assign medical or psychiatric labels - draws attention to the very real possibility that many remarkable medical cases may have been the result of the ingestion of highly poisonous and psychoactive food substances. Where possible we highlight explanations given at the time - often rooted in religion or demonology - to explain the disease.

Ergotism in Norway. Part 2: The symptoms and their interpretation from the eighteenth century onwards.

Ergotism, the disease caused by consuming Claviceps purpurea, a highly poisonous, grain-infecting fungus, occurred at various places scattered throughout Norway during the eighteenth and nineteenth centuries. By focusing on these cases we chart the changing interpretations of the peculiar disease, frequently understood within a religious context or considered as a supernatural (e.g. ghostly) experience. However, there was a growing awareness of the disease ergotism, and from the late eighteenth century onwards it was often correctly interpreted as being due to a fungus consumed via bread or porridge. Also, nineteenth-century fairy-tales and regional legends reveal that people were increasingly aware and fearful of the effects of consuming infected grain.

Reflections on measuring disordered thoughts as expressed via language.

Thought disorder, as inferred from disorganized and incoherent speech, is an important part of the clinical presentation in schizophrenia. Traditional measurement approaches essentially count occurrences of certain speech events which may have restricted their usefulness. Applying speech technologies in assessment can help automate traditional clinical rating tasks and thereby complement the process. Adopting these computational approaches affords clinical translational opportunities to enhance the traditional assessment by applying such methods remotely and scoring various parts of the assessment automatically. Further, digital measures of language may help detect subtle clinically significant signs and thus potentially disrupt the usual manner by which things are conducted. If proven beneficial to patient care, methods where patients' voice are the primary data source could become core components of future clinical decision support systems that improve risk assessment. However, even if it is possible to measure thought disorder in a sensitive, reliable and efficient manner, there remain many challenges to then translate into a clinically implementable tool that can contribute towards providing better care. Indeed, embracing technology - notably artificial intelligence - requires vigorous standards for reporting underlying assumptions so as to ensure a trustworthy and ethical clinical science.

An explainable machine learning model of cognitive decline derived from speech.

INTRODUCTION: Traditional Alzheimer's disease (AD) and mild cognitive impairment (MCI) screening lacks the sensitivity and timeliness required to detect subtle indicators of cognitive decline. Multimodal artificial intelligence technologies using only speech data promise improved detection of neurodegenerative disorders. METHODS: Speech collected over the telephone from 91 older participants who were cognitively healthy (n = 29) or had diagnoses of AD (n = 30) or amnestic MCI (aMCI; n = 32) was analyzed with multimodal natural language and speech processing methods. An explainable ensemble decision tree classifier for the multiclass prediction of cognitive decline was created. RESULTS: This approach was 75% accurate overall-an improvement over traditional speech-based screening tools and a unimodal language-based model. We include a dashboard for the examination of the results, allowing for novel ways of interpreting such data. DISCUSSION: This work provides a foundation for a meaningful change in medicine as clinical translation, scalability, and user friendliness were core to the methodologies. Highlights: Remote assessments and artificial intelligence (AI) models allow greater access to cognitive decline screening.Speech impairments differ significantly between mild AD, amnestic mild cognitive impairment (aMCI), and healthy controls.AI predictions of cognitive decline are more accurate than experts and standard tools.The AI model was 75% accurate in classifying mild AD, aMCI, and healthy controls.

Towards a temporospatial framework for measurements of disorganization in speech using semantic vectors.

Incoherent speech in schizophrenia has long been described as the mind making "leaps" of large distances between thoughts and ideas. Such a view seems intuitive, and for almost two decades, attempts to operationalize these conceptual "leaps" in spoken word meanings have used language-based embedding spaces. An embedding space represents meaning of words as numerical vectors where a greater proximity between word vectors represents more shared meaning. However, there are limitations with word vector-based operationalizations of coherence which can limit their appeal and utility in clinical practice. First, the use of esoteric word embeddings can be conceptually hard to grasp, and this is complicated by several different operationalizations of incoherent speech. This problem can be overcome by a better visualization of methods. Second, temporal information from the act of speaking has been largely neglected since models have been built using written text, yet speech is spoken in real time. This issue can be resolved by leveraging time stamped transcripts of speech. Third, contextual information - namely the situation of where something is spoken - has often only been inferred and never explicitly modeled. Addressing this situational issue opens up new possibilities for models with increased temporal resolution and contextual relevance. In this paper, direct visualizations of semantic distances are used to enable the inspection of examples of incoherent speech. Some common operationalizations of incoherence are illustrated, and suggestions are made for how temporal and spatial contextual information can be integrated in future implementations of measures of incoherence.

Reflections on the nature of measurement in language-based automated assessments of patients' mental state and cognitive function.

Modern advances in computational language processing methods have enabled new approaches to the measurement of mental processes. However, the field has primarily focused on model accuracy in predicting performance on a task or a diagnostic category. Instead the field should be more focused on determining which computational analyses align best with the targeted neurocognitive/psychological functions that we want to assess. In this paper we reflect on two decades of experience with the application of language-based assessment to patients' mental state and cognitive function by addressing the questions of what we are measuring, how it should be measured and why we are measuring the phenomena. We address the questions by advocating for a principled framework for aligning computational models to the constructs being assessed and the tasks being used, as well as defining how those constructs relate to patient clinical states. We further examine the assumptions that go into the computational models and the effects that model design decisions may have on the accuracy, bias and generalizability of models for assessing clinical states. Finally, we describe how this principled approach can further the goal of transitioning language-based computational assessments to part of clinical practice while gaining the trust of critical stakeholders.

Using Automated Speech Processing for Repeated Measurements in a Clinical Setting of the Behavioral Variability in the Stroop Task.

The Stroop interference task is indispensable to current neuropsychological practice. Despite this, it is limited in its potential for repeated administration, its sensitivity and its demands on professionals and their clients. We evaluated a digital Stroop deployed using a smart device. Spoken responses were timed using automated speech recognition. Participants included adult nonpatients (N = 113; k = 5 sessions over 5 days) and patients with psychiatric diagnoses (N = 85; k = 3-4 sessions per week over 4 weeks). Traditional interference (difference in response time between color incongruent words vs. color neutral words; M = 0.121 s) and facilitation (neutral vs. color congruent words; M = 0.085 s) effects were robust and temporally stable over testing sessions (ICCs 0.50-0.86). The performance showed little relation to clinical symptoms for a two-week window for either nonpatients or patients but was related to self-reported concentration at the time of testing for both groups. Performance was also related to treatment outcomes in patients. The duration of response word utterances was longer in patients than in nonpatients. Measures of intra-individual variability showed promise for understanding clinical state and treatment outcome but were less temporally stable than measures based solely on average response time latency. This framework of remote assessment using speech processing technology enables the fine-grained longitudinal charting of cognition and verbal behavior. However, at present, there is a problematic lower limit to the absolute size of the effects that can be examined when using voice in such a brief 'out-of-the-laboratory condition' given the temporal resolution of the speech-to-text detection system (in this case, 10 ms). This resolution will limit the parsing of meaningful effect sizes.

What Drives Animal Fluency Performance in Cantonese-Speaking Chinese Patients with Adult-Onset Psychosis?

Among the numerous studies investigating semantic factors associated with functioning in psychotic patients, most have been conducted on western populations. By contrast, the current cross-sectional study involved native Cantonese-speaking Chinese participants. Using the category fluency task, we compared performance between patients and healthy participants and examined clinical and sociodemographic correlates. First-episode psychosis patients (n = 356) and gender- and age-matched healthy participants (n = 35) were asked to generate as many 'animals' as they could in a minute. As expected, patients generated fewer correct responses (an average of 15.5 vs. 22.9 words), generated fewer clusters (an average of 3.7 vs. 5.4 thematically grouped nouns), switched less between clusters (on average 8.0 vs. 11.9 switches) and, interestingly, produced a larger percentage of Chinese zodiac animals than healthy participants (an average of 37.7 vs. 24.2). However, these significant group differences in the clusters and switches disappeared when the overall word production was controlled for. Within patients, education was the strongest predictor of category fluency performance (namely the number of correct responses, clusters, and switches). The findings suggest that an overall slowness in patients may account for the group differences in category fluency performance rather than any specific abnormality per se.

Natural Language Processing Markers for Psychosis and Other Psychiatric Disorders: Emerging Themes and Research Agenda From a Cross-Linguistic Workshop.

This workshop summary on natural language processing (NLP) markers for psychosis and other psychiatric disorders presents some of the clinical and research issues that NLP markers might address and some of the activities needed to move in that direction. We propose that the optimal development of NLP markers would occur in the context of research efforts to map out the underlying mechanisms of psychosis and other disorders. In this workshop, we identified some of the challenges to be addressed in developing and implementing NLP markers-based Clinical Decision Support Systems (CDSSs) in psychiatric practice, especially with respect to psychosis. Of note, a CDSS is meant to enhance decision-making by clinicians by providing additional relevant information primarily through software (although CDSSs are not without risks). In psychiatry, a field that relies on subjective clinical ratings that condense rich temporal behavioral information, the inclusion of computational quantitative NLP markers can plausibly lead to operationalized decision models in place of idiosyncratic ones, although ethical issues must always be paramount.

The mental health consequences on children of the war in Ukraine: A commentary.

The news from Ukraine is currently full of heart-wrenching stories accompanied by graphic images of civilian casualties and massacres that are telecast world-wide on a daily basis. It is hard to fathom the magnitude of the devastation and disruption to regular lives and everyday routines that war brings with it, the witnessing of countless deaths, the associated trauma of living in perpetual fear, and the daily experience of many families and orphans who are crowded into basement bomb shelters now for months on end. These issues make us contemplate the mental health consequences, among other lasting effects, of this costly war in Ukraine, and wars in other countries not so widely featured in Western news. Despite people of all ages being affected by war, children are especially vulnerable. This commentary outlines some of the epidemiology of the consequences of war, the mental health sequelae specifically, and the complexity of providing culturally and contextually relevant interventions that meet the needs of children.

Improving the Applicability of AI for Psychiatric Applications through Human-in-the-loop Methodologies.

OBJECTIVES: Machine learning (ML) and natural language processing have great potential to improve efficiency and accuracy in diagnosis, treatment recommendations, predictive interventions, and scarce resource allocation within psychiatry. Researchers often conceptualize such an approach as operating in isolation without much need for human involvement, yet it remains crucial to harness human-in-the-loop practices when developing and implementing such techniques as their absence may be catastrophic. We advocate for building ML-based technologies that collaborate with experts within psychiatry in all stages of implementation and use to increase model performance while simultaneously increasing the practicality, robustness, and reliability of the process. METHODS: We showcase pitfalls of the traditional ML framework and explain how it can be improved with human-in-the-loop techniques. Specifically, we applied active learning strategies to the automatic scoring of a story recall task and compared the results to a traditional approach. RESULTS: Human-in-the-loop methodologies supplied a greater understanding of where the model was least confident or had knowledge gaps during training. As compared to the traditional framework, less than half of the training data were needed to reach a given accuracy. CONCLUSIONS: Human-in-the-loop ML is an approach to data collection and model creation that harnesses active learning to select the most critical data needed to increase a model's accuracy and generalizability more efficiently than classic random sampling would otherwise allow. Such techniques may additionally operate as safeguards from spurious predictions and can aid in decreasing disparities that artificial intelligence systems otherwise propagate.

Increasing access to cognitive screening in the elderly: Applying natural language processing methods to speech collected over the telephone.

Barriers to healthcare access are widespread in elderly populations, with a major consequence that older people are not benefiting from the latest technologies to diagnose disease. Recent advances in the automated analysis of speech show promising results in the identification of cognitive decline associated with Alzheimer's disease (AD), as well as its purported pre-clinical stage. We utilized automated methods to analyze speech recorded over the telephone in 91 community-dwelling older adults diagnosed with mild AD, amnestic mild cognitive impairment (aMCI) or cognitively healthy. We asked whether natural language processing (NLP) and machine learning could more accurately identify groups than traditional screening tools and be sensitive to subtle differences in speech between the groups. Despite variable recording quality, NLP methods differentiated the three groups with greater accuracy than two traditional dementia screeners and a clinician who read transcripts of their speech. Imperfect speech data collected via a telephone is of sufficient quality to be examined with the latest speech technologies. Critically, these data reveal significant differences in speech that closely match the clinical diagnoses of AD, aMCI and healthy control.

Celebrating the accomplishments of thought leaders in psychiatry research: Introduction.

In academia and related industry, particularly in the medical sciences, some individuals are noticed for their ability to attract others towards their ideas, theories and objectives. They are often referred to as the "thought leaders" of the field. Noticeably, individuals who are labeled as "thought leaders" appear more often to be males than females. Moreover, this is not a racially or ethnically diverse group. In this special issue, we intend to challenge that bias. As we look world-wide at the incredibly important contributions of women in both psychiatry and related neuroscience, it was a logical step to ask these 'thought leaders' to write commentaries on their most important work, how they got there, and what they predict for the future. When compiling a list of "thought leaders" for future academic and industry workshops, these scientists are certain to enrich and advance the discourse.

Using automated syllable counting to detect missing information in speech transcripts from clinical settings.

Speech rate and quantity reflect clinical state; thus automated transcription holds potential clinical applications. We describe two datasets where recording quality and speaker characteristics affected transcription accuracy. Transcripts of low-quality recordings omitted significant portions of speech. An automated syllable counter estimated actual speech output and quantified the amount of missing information. The efficacy of this method differed by audio quality: the correlation between missing syllables and word error rate was only significant when quality was low. Automatically counting syllables could be useful to measure and flag transcription omissions in clinical contexts where speaker characteristics and recording quality are problematic.

Discovering the structure and organization of a free Cantonese emotion-label word association graph to understand mental lexicons of emotions.

Emotions are not necessarily universal across different languages and cultures. Mental lexicons of emotions depend strongly on contextual factors, such as language and culture. The Chinese language has unique linguistic properties that are different from other languages. As a main variant of Chinese, Cantonese has some emotional expressions that are only used by Cantonese speakers. Previous work on Chinese emotional vocabularies focused primarily on Mandarin. However, little is known about Cantonese emotion vocabularies. This is important since both language variants might have distinct emotional expressions, despite sharing the same writing system. To explore the structure and organization of Cantonese-label emotion words, we selected 79 highly representative emotion cue words from an ongoing large-scale Cantonese word association study (SWOW-HK). We aimed to identify the categories of these emotion words and non-emotion words that related to emotion concepts. Hierarchical cluster analysis was used to generate word clusters and investigate the underlying emotion dimensions. As the cluster quality was low in hierarchical clustering, we further constructed an emotion graph using a network approach to explore how emotions are organized in the Cantonese mental lexicon. With the support of emotion knowledge, the emotion graph defined more distinct emotion categories. The identified network communities covered basic emotions such as love, happiness, and sadness. Our results demonstrate that mental lexicon graphs constructed from free associations of Cantonese emotion-label words can reveal fine categories of emotions and their relevant concepts.

A Longitudinal Study of Semantic Networks in Schizophrenia and other Psychotic Disorders Using the Word Association Task.

The underpinnings of language deviations in psychotic symptoms (eg, formal thought disorder, delusions) remain unclear. We examined whether the semantic networks underlying word associations are useful predictors of clinical outcomes in psychosis. Fifty-one patients with schizophrenia and other psychotic disorders and 51 matched healthy controls generated words in a Cantonese continued word association task. Patterns of word associations were examined using semantic similarity metrics derived from word embeddings (fastText) and the structure of individual semantic networks. A longitudinal design-baseline and 6 months later-enabled investigation of the relationship of changes in semantic associations in patients who were in an acute psychotic state at baseline compared to clinical stabilization 6 months later. The semantic similarity measure increased over time in patients, while it remained stable in controls. Moreover, the change in semantic similarity over time correlated with the changes in patients' formal thought disorder symptoms. There were differences in individual semantic networks between the groups at both time points. Patients had less structured networks on average, as evidenced by a smaller network diameter and clustering coefficient, and smaller average shortest path lengths. The identification of several state-like semantic measures that change over time with patients' mental states allows for nuanced comparison with clinical measures. Semantic measures are complex. Semantic similarity was a state-like measure that changed over time with mental state in psychotic disorders, whereas individual semantic network parameters were trait-like and stable over time.