Class-Level Spectral Features for Emotion Recognition.

The most common approaches to automatic emotion recognition rely on utterance level prosodic features. Recent studies have shown that utterance level statistics of segmental spectral features also contain rich information about expressivity and emotion. In our work we introduce a more fine-grained yet robust set of spectral features: statistics of Mel-Frequency Cepstral Coefficients computed over three phoneme type classes of interest-stressed vowels, unstressed vowels and consonants in the utterance. We investigate performance of our features in the task of speaker-independent emotion recognition using two publicly available datasets. Our experimental results clearly indicate that indeed both the richer set of spectral features and the differentiation between phoneme type classes are beneficial for the task. Classification accuracies are consistently higher for our features compared to prosodic or utterance-level spectral features. Combination of our phoneme class features with prosodic features leads to even further improvement. Given the large number of class-level spectral features, we expected feature selection will improve results even further, but none of several selection methods led to clear gains. Further analyses reveal that spectral features computed from consonant regions of the utterance contain more information about emotion than either stressed or unstressed vowel features. We also explore how emotion recognition accuracy depends on utterance length. We show that, while there is no significant dependence for utterance-level prosodic features, accuracy of emotion recognition using class-level spectral features increases with the utterance length.

Smooth functional and structural maps on the neocortex via orthonormal bases of the Laplace-Beltrami operator.

Functional and structural maps, such as a curvature, cortical thickness, and functional magnetic resonance imaging (MRI) maps, indexed over the local coordinates of the cortical manifold play an important role in neuropsychiatric studies. Due to the highly convoluted nature of the cerebral cortex and image quality, these functions are generally uninterpretable without proper methods of association and smoothness onto the local coordinate system. In this paper, we generalized the spline smoothing problem (Wahba, 1990) from a sphere to any arbitrary two-dimensional (2-D) manifold with boundaries. We first seek a numerical solution to orthonormal basis functions of the Laplace-Beltrami (LB) operator with Neumann boundary conditions for a 2-D manifold M then solve the spline smoothing problem in a reproducing kernel Hilbert space (r.k.h.s.) of real-valued functions on manifold M with kernel constructed from the basis functions. The explicit discrete LB representation is derived using the finite element method calculated directly on the manifold coordinates so that finding discrete LB orthonormal basis functions is equivalent to solving an algebraic eigenvalue problem. And then smoothed functions in r.k.h.s can be represented as a linear combination of the basis functions. We demonstrate numerical solutions of spherical harmonics on a unit sphere and brain orthonormal basis functions on a planum temporale manifold. Then synthetic data is used to quantify the goodness of the smoothness compared with the ground truth and discuss how many basis functions should be incorporated in the smoothing. We present applications of our approach to smoothing sulcal mean curvature, cortical thickness, and functional statistical maps on submanifolds of the neocortex.

Clutter invariant ATR.

One of the central problems in Automated Target Recognition is to accommodate the infinite variety of clutter in real military environments. The principle focus of our paper is on the construction of metric spaces where the metric measures the distance between objects of interest invariant to the infinite variety of clutter. Such metrics are formulated using second-order random field models. Our results indicate that this approach significantly improves detection/classification rates of targets in clutter.