Validating Biobehavioral Technologies for Use in Clinical Psychiatry.

The last decade has witnessed the development of sophisticated biobehavioral and genetic, ambulatory, and other measures that promise unprecedented insight into psychiatric disorders. As yet, clinical sciences have struggled with implementing these objective measures and they have yet to move beyond "proof of concept." In part, this struggle reflects a traditional, and conceptually flawed, application of traditional psychometrics (i.e., reliability and validity) for evaluating them. This paper focuses on "resolution," concerning the degree to which changes in a signal can be detected and quantified, which is central to measurement evaluation in informatics, engineering, computational and biomedical sciences. We define and discuss resolution in terms of traditional reliability and validity evaluation for psychiatric measures, then highlight its importance in a study using acoustic features to predict self-injurious thoughts/behaviors (SITB). This study involved tracking natural language and self-reported symptoms in 124 psychiatric patients: (a) over 5-14 recording sessions, collected using a smart phone application, and (b) during a clinical interview. Importantly, the scope of these measures varied as a function of time (minutes, weeks) and spatial setting (i.e., smart phone vs. interview). Regarding reliability, acoustic features were temporally unstable until we specified the level of temporal/spatial resolution. Regarding validity, accuracy based on machine learning of acoustic features predicting SITB varied as a function of resolution. High accuracy was achieved (i.e., ~87%), but only when the acoustic and SITB measures were "temporally-matched" in resolution was the model generalizable to new data. Unlocking the potential of biobehavioral technologies for clinical psychiatry will require careful consideration of resolution.

Frontal alpha asymmetry in schizotypy: electrophysiological evidence for motivational dysfunction.

Introduction: Schizotypy is defined as personality traits reflecting an underlying risk for schizophrenia-spectrum disorders. As yet, there is a dearth of suitable objective markers for measuring schizotypy. Frontal alpha asymmetry, characterised by reduced left versus right frontal region activity, reflects trait-like diminished approach-related systems and has been found in schizophrenia. Methods: The present study used electroencephalography (EEG) recorded on a consumer-grade mobile headset to examine asymmetric resting-state frontal alpha, beta, and gamma power within the multidimensional schizotypy (e.g. positive, negative, disorganised) during a three-minute "eyes closed" resting period in college undergraduates (n=49). Results: Findings suggest that schizotypy was exclusively related to reduced left versus right-lateralised power in the alpha frequency (8.1-12.9 Hz., R2= .16). Follow-up analysis suggested that positive schizotypy was uniquely associated with increased right alpha activity, indicating increased withdrawal motivation. Conclusions: Frontal asymmetry is a possible ecologically valid objective marker for schizotypy that may be detectable using easily accessible, consumer-grade technology.

Blunted vocal affect and expression is not associated with schizophrenia: A computerized acoustic analysis of speech under ambiguous conditions.

INTRODUCTION: Patients with schizophrenia are consistently rated by clinicians as having high levels of blunted vocal affect and alogia. However, objective technologies have often failed to substantiate these abnormalities. It could be the case that negative symptoms are context-dependent. OBJECTIVES: The present study examined speech elicited under conditions demonstrated to exacerbate thought disorder. METHODS: The Rorschach Test was administered to 36 outpatients with schizophrenia and 25 nonpatient controls. Replies to separate "perceptual" and "memory" phases were analyzed using validated acoustic analytic methods. RESULTS: Compared to nonpatient controls, schizophrenia patients did not display abnormal speech expression on objective measure of blunted vocal affect or alogia. Moreover, clinical ratings of negative symptoms were not significantly correlated with objective measures. CONCLUSIONS: These findings suggest that in patients with schizophrenia, vocal affect/alogia is generally unremarkable under ambiguous conditions. Clarifying the nature of blunted vocal affect and alogia, and how objective measures correspond to what clinicians attend to when making clinical ratings are important directions for future research.

Cognitive functioning in schizotypy through the lens of the accessibility model.

INTRODUCTION: Individuals with schizotypy self-report subjective cognitive complaints commensurate with deficits reported by individuals with schizophrenia. In contrast to schizophrenia, objective deficits in memory are modest in individuals with schizotypy, as compared to their self-reported cognitive complaints. It has been proposed that abnormalities in semantic memory systems may underlie this dysjunction. METHODS: This study employed a modified verbal memory paradigm in a sample of 87 individuals with psychometrically defined schizotypy. Appraisals of memory performance were evaluated across global (i.e. drawing on semantic memory systems and assessing perceived typical performance) and situation-specific (i.e. drawing on episodic memory systems) epochs. Objective memory performance was assessed using a verbal recall paradigm. RESULTS: Individuals with schizotypy did not differ in situation-specific appraisals or in objective memory performance. Global appraisals of memory performance predicted negative and disorganised schizotypy scores. No other measure of memory performance predicted any facet of schizotypy. Individuals with schizotypy appraised their global memory performance higher than controls at a medium effect. CONCLUSIONS: Higher order global appraisals of cognitive performance, subsumed within semantic networks, may be important in the subjective-objective paradox in schizotypy, suggesting the importance of considering demand characteristics when assessing measures of neurocognitive performance in individuals with schizotypy.

Vocal expression in schizophrenia: Less than meets the ear.

Abnormalities in nonverbal communication are a hallmark of schizophrenia. Results from studies using symptom rating scales suggest that these abnormalities are profound (i.e., 3-5 SDs) and occur across virtually every channel of vocal expression. Computerized acoustic analytic technologies, used to overcome practical and psychometric limitations with symptom rating scales, have found much more benign and isolated abnormalities. To better understand vocal deficits in schizophrenia and to advance acoustic analytic technologies for clinical and research applications, we examined archived speech samples from 5 separate studies, each using different speaking tasks (patient N = 309; control N = 117). We sought to: (a) use Principal Component Analysis (PCA) to identify independent vocal expression measures from a large set of variables, (b) quantify how patients with schizophrenia are abnormal with respect to these variables, (c) evaluate the impact of demographic and contextual factors (e.g., study site, speaking task), and (d) examine the relationship between clinically-rated psychiatric symptoms and vocal variables. PCA identified 7 independent markers of vocal expression. Most of these vocal variables varied considerably as a function of context and many were associated with demographic factors. After controlling for context and demographics, there were no meaningful differences in vocal expression between patients and controls. Within patients, vocal variables were associated with a range of psychiatric symptoms-though only pause length was significantly associated with clinically rated negative symptoms. The discussion centers on explaining the apparent discordance between clinical and computerized speech measures.

A psychometric investigation of "macroscopic" speech measures for clinical and psychological science.

The analysis of vocal expression is a critical endeavor for psychological and clinical sciences and is an increasingly popular application for computer-human interfaces. Despite this, and despite advances in the efficiency, affordability, and sophistication of vocal analytic technologies, there is considerable variability across studies regarding what aspects of vocal expression are studied. Vocal signals can be quantified in a myriad of ways, and their underlying structure, at least with respect to "macroscopic" measures from extended speech, is presently unclear. To address this issue, we evaluated the psychometric properties-notably, the structural and construct validity-of a systematically defined set of global vocal features. Our analytic strategy focused on (a) identifying redundant variables among this set, (b) employing principal components analysis (PCA) to identify nonoverlapping domains of vocal expression, (c) examining the degrees to which the vocal variables are modulated as a function of changes in speech task, and (d) evaluating the relationship between the vocal variables and cognitive (i.e., verbal fluency) and clinical (i.e., depression, anxiety, and hostility) variables. Spontaneous speech samples from 11 independent studies of young adults (>60 s in length), employing one of three different speaking tasks, were examined (N = 1,350). Confounding variables (i.e., sex, ethnicity) were statistically controlled for. The PCA identified six distinct domains of vocal expression. Collectively, vocal expression (defined in terms of these domains) was modulated as a function of speech task and was related to the cognitive and clinical variables. These findings provide empirically grounded implications for the study of vocal expression in psychological and clinical sciences.

A temporal examination of co-activated emotion valence networks in schizophrenia and schizotypy.

Emotional abnormalities are prominent across the schizophrenia spectrum. To better define these abnormalities, we examined state emotional functions across opposing ends of the spectrum, notably in chronic outpatients with schizophrenia (Study 1) and college students with psychometrically defined schizotypy (Study 2). In line with existing studies, we predicted that individuals with schizophrenia would show unusually co-activated positive and negative emotions while college students with schizotypy would show abnormally low positive and abnormally high negative emotions. Drawing from the affective science literature, we employed continuous emotion ratings in response to a dynamic and evocatively "bittersweet" stimulus. Participants included 27 individuals with schizophrenia, 39 individuals with psychometrically defined schizotypy and 26 community and 35 college control participants. Participants continuously rated their state happiness and sadness throughout a six-minute clip from a tragicomic film (i.e., Life is Beautiful). In contrast to expectations as well as the extant literature, there were no state emotional abnormalities noted from either schizophrenia-spectrum group. Of particular note, neither individuals with schizophrenia nor individuals with schizotypy were abnormal in their experience of state negative, positive or coactivated emotions. Conversely, abnormalities in trait emotion were observed in both groups relative to their respective control groups. These results help confirm that the schizophrenia-spectrum is not characterized by deficits in state emotional experience and suggest that sadness is not abnormally co-activated with pleasant emotions. These results are critical for clarifying the "chronometry" of emotional dysfunctions across the schizophrenia-spectrum.

What do we really know about blunted vocal affect and alogia? A meta-analysis of objective assessments.

Deficits in nonverbal vocal expression (e.g., blunted vocal affect, alogia) are a hallmark of schizophrenia and are a focus of the Research Domain Criteria initiative from the National Institute of Mental Health. Results from studies using symptom rating scales suggest that these deficits are profound; on the order of four to six standard deviations. To complement this endeavor, we conducted a meta-analysis of studies employing objective analysis of natural speech in patients with schizophrenia and nonpsychiatric controls. Thirteen studies, collectively including 480 patients with schizophrenia and 326 nonpsychiatric controls, were identified. There was considerable variability across studies in which aspects of vocal communication were examined and in the magnitudes of deficit. Overall, speech production (reflecting alogia) was impaired at a large effects size level (d=-.80; k=13), whereas speech variability (reflecting blunted affect) was much more modest (d=-.36; k=2). Regarding the former, this was largely driven by measures of pause behavior, as opposed to other aspects of speech (e.g., number of words/utterances). On the other hand, ratings of negative symptoms across these studies suggested profound group differences (d=3.54; k=4). These data suggest that only certain aspects of vocal expression are affected in schizophrenia, and highlight major discrepancies between symptom rating and objective-based measures. The discussion centers on advancing objective analysis for understanding vocal expression in schizophrenia and for identifying and defining more homogenous patient subsets for study.