Identifying Splitting Through Sentiment Analysis.

In Kernerg's Object Relations Theory model of personality pathology, splitting, the mutual polarization of aspects of experience, is thought to result in a failure of identity integration. The authors sought to identify a clinician-independent, automated measure of splitting by examining 54 subjects' natural speech. Splitting in these individuals, recruited from the community, was investigated and evaluated with a shortened version of the Structured Interview of Personality Organization (STIPO-R). A type of automated sentiment textual analysis called VADER was applied to transcripts from the section of the STIPO-R that probes identity integration. Higher variability in speech valence, more negative minimum valence, and more frequent shifts in valence polarity were associated with more severe identity disturbance. The authors concluded that the degree of splitting elicited during the description of self and others is related to the degree of identity disturbance, and to the degree of negativity and instability of these descriptions of self and others.

Acoustic and Facial Features From Clinical Interviews for Machine Learning-Based Psychiatric Diagnosis: Algorithm Development.

BACKGROUND: In contrast to all other areas of medicine, psychiatry is still nearly entirely reliant on subjective assessments such as patient self-report and clinical observation. The lack of objective information on which to base clinical decisions can contribute to reduced quality of care. Behavioral health clinicians need objective and reliable patient data to support effective targeted interventions. OBJECTIVE: We aimed to investigate whether reliable inferences-psychiatric signs, symptoms, and diagnoses-can be extracted from audiovisual patterns in recorded evaluation interviews of participants with schizophrenia spectrum disorders and bipolar disorder. METHODS: We obtained audiovisual data from 89 participants (mean age 25.3 years; male: 48/89, 53.9%; female: 41/89, 46.1%): individuals with schizophrenia spectrum disorders (n=41), individuals with bipolar disorder (n=21), and healthy volunteers (n=27). We developed machine learning models based on acoustic and facial movement features extracted from participant interviews to predict diagnoses and detect clinician-coded neuropsychiatric symptoms, and we assessed model performance using area under the receiver operating characteristic curve (AUROC) in 5-fold cross-validation. RESULTS: The model successfully differentiated between schizophrenia spectrum disorders and bipolar disorder (AUROC 0.73) when aggregating face and voice features. Facial action units including cheek-raising muscle (AUROC 0.64) and chin-raising muscle (AUROC 0.74) provided the strongest signal for men. Vocal features, such as energy in the frequency band 1 to 4 kHz (AUROC 0.80) and spectral harmonicity (AUROC 0.78), provided the strongest signal for women. Lip corner-pulling muscle signal discriminated between diagnoses for both men (AUROC 0.61) and women (AUROC 0.62). Several psychiatric signs and symptoms were successfully inferred: blunted affect (AUROC 0.81), avolition (AUROC 0.72), lack of vocal inflection (AUROC 0.71), asociality (AUROC 0.63), and worthlessness (AUROC 0.61). CONCLUSIONS: This study represents advancement in efforts to capitalize on digital data to improve diagnostic assessment and supports the development of a new generation of innovative clinical tools by employing acoustic and facial data analysis.

Parkinson's disease medication state and severity assessment based on coordination during walking.

Walking is a complex motor function requiring coordination of all body parts. Parkinson's disease (PD) motor signs such as rigidity, bradykinesia, and impaired balance affect movements including walking. Here, we propose a computational method to objectively assess the effects of Parkinson's disease pathology on coordination between trunk, shoulder and limbs during the gait cycle to assess medication state and disease severity. Movements during a scripted walking task were extracted from wearable devices placed at six different body locations in participants with PD and healthy participants. Three-axis accelerometer data from each device was synchronized at the beginning of either left or right steps. Canonical templates of movements were then extracted from each body location. Movements projected on those templates created a reduced dimensionality space, where complex movements are represented as discrete values. These projections enabled us to relate the body coordination in people with PD to disease severity. Our results show that the velocity profile of the right wrist and right foot during right steps correlated with the participant's total score on the gold standard Unified Parkinson's Disease Rating Scale (UPRDS) with an r2 up to 0.46. Left-right symmetry of feet, trunk and wrists also correlated with the total UPDRS score with an r2 up to 0.3. In addition, we demonstrate that binary dopamine replacement therapy medication states (self-reported 'ON' or 'OFF') can be discriminated in PD participants. In conclusion, we showed that during walking, the movement of body parts individually and in coordination with one another changes in predictable ways that vary with disease severity and medication state.

Automated Computer Vision Assessment of Hypomimia in Parkinson Disease: Proof-of-Principle Pilot Study.

BACKGROUND: Facial expressions require the complex coordination of 43 different facial muscles. Parkinson disease (PD) affects facial musculature leading to "hypomimia" or "masked facies." OBJECTIVE: We aimed to determine whether modern computer vision techniques can be applied to detect masked facies and quantify drug states in PD. METHODS: We trained a convolutional neural network on images extracted from videos of 107 self-identified people with PD, along with 1595 videos of controls, in order to detect PD hypomimia cues. This trained model was applied to clinical interviews of 35 PD patients in their on and off drug motor states, and seven journalist interviews of the actor Alan Alda obtained before and after he was diagnosed with PD. RESULTS: The algorithm achieved a test set area under the receiver operating characteristic curve of 0.71 on 54 subjects to detect PD hypomimia, compared to a value of 0.75 for trained neurologists using the United Parkinson Disease Rating Scale-III Facial Expression score. Additionally, the model accuracy to classify the on and off drug states in the clinical samples was 63% (22/35), in contrast to an accuracy of 46% (16/35) when using clinical rater scores. Finally, each of Alan Alda's seven interviews were successfully classified as occurring before (versus after) his diagnosis, with 100% accuracy (7/7). CONCLUSIONS: This proof-of-principle pilot study demonstrated that computer vision holds promise as a valuable tool for PD hypomimia and for monitoring a patient's motor state in an objective and noninvasive way, particularly given the increasing importance of telemedicine.

Using an unbiased symbolic movement representation to characterize Parkinson's disease states.

Unconstrained human movement can be broken down into a series of stereotyped motifs or 'syllables' in an unsupervised fashion. Sequences of these syllables can be represented by symbols and characterized by a statistical grammar which varies with external situational context and internal neurological state. By first constructing a Markov chain from the transitions between these syllables then calculating the stationary distribution of this chain, we estimate the overall severity of Parkinson's symptoms by capturing the increasingly disorganized transitions between syllables as motor impairment increases. Comparing stationary distributions of movement syllables has several advantages over traditional neurologist administered in-clinic assessments. This technique can be used on unconstrained at-home behavior as well as scripted in-clinic exercises, it avoids differences across human evaluators, and can be used continuously without requiring scripted tasks be performed. We demonstrate the effectiveness of this technique using movement data captured with commercially available wrist worn sensors in 35 participants with Parkinson's disease in-clinic and 25 participants monitored at home.

Wearable Nail Deformation Sensing for Behavioral and Biomechanical Monitoring and Human-Computer Interaction.

The dynamics of the human fingertip enable haptic sensing and the ability to manipulate objects in the environment. Here we describe a wearable strain sensor, associated electronics, and software to detect and interpret the kinematics of deformation in human fingernails. Differential forces exerted by fingertip pulp, rugged connections to the musculoskeletal system and physical contact with the free edge of the nail plate itself cause fingernail deformation. We quantify nail warpage on the order of microns in the longitudinal and lateral axes with a set of strain gauges attached to the nail. The wearable device transmits raw deformation data to an off-finger device for interpretation. Simple motions, gestures, finger-writing, grip strength, and activation time, as well as more complex idioms consisting of multiple grips, are identified and quantified. We demonstrate the use of this technology as a human-computer interface, clinical feature generator, and means to characterize workplace tasks.