Kinematic Motor Synergy Analysis to Understand Lock Dance Choreographies.

Lock dance, or locking, is one of the popular old-school street dance styles featuring sharp, sudden, and isolated body movements through intricate control and coordination of joints and muscles. This work aims to understand the complex lock dance motions based on kinematic motor synergy analysis. Lock dance motions performed by three experienced dancers were measured with a markerless human motion capture technique. The motor synergies were identified and summarized using principle component analysis (PCA). The motion complexity, joint contributions, and motor coordination of ten basic lock dance choreographies were analyzed based on the synergy patterns and their activations. The results enhance our understanding of complex dance motions and serve as a step toward future applications to, e.g. dance skill or injury risk assessments.

Cognitive Dynamics Estimation: A whole-brain spatial regression paradigm for extracting the temporal dynamics of cognitive processes.

Functional MRI (fMRI) has been instrumental in understanding how cognitive processes are spatially mapped in the brain, yielding insights about brain regions and functions. However, in case the orthogonality of behavioral or stimulus timing is not guaranteed, the estimated brain maps fail to dissociate each cognitive process, and the resultant maps become unstable. Also, the brain mapping exercise can not provide temporal information on the cognitive process. Here we propose a qualitatively different approach to fMRI analysis, named Cognitive Dynamics Estimation (CDE), that estimates how multiple cognitive processes change over time even when behavior or stimulus logs are unavailable. This method transposes the conventional brain mapping; the brain activity pattern at each time point is subject to regression analysis with data-driven maps of cognitive processes as regressors, resulting in the time series of cognitive processes. The estimated time series captured the fluctuation of intensity and timing of cognitive processes on a trial-by-trial basis, which conventional analysis could not capture. Notably, the estimated time series predicted participants' cognitive ability to perform each psychological task. As an addition to our fMRI analytic toolkit, these results suggest the potential for CDE to elucidate underexplored cognitive phenomena, especially in the temporal domain.

Asymmetric directed functional connectivity within the frontoparietal motor network during motor imagery and execution.

Both imagery and execution of motor control consist of interactions within a neuronal network, including frontal motor-related and posterior parietal regions. To reveal neural representation in the frontoparietal motor network, two approaches have been proposed thus far: one is decoding of actions/modes related to motor control from the spatial pattern of brain activity; and the other is estimating directed functional connectivity (a directed association between two brain regions within motor areas). However, directed connectivity among multiple regions of the frontoparietal motor network during motor imagery (MI) or motor execution (ME) has not been investigated. Here, we attempted to characterize the directed functional connectivity representing the MI and ME conditions. We developed a delayed sequential movement and imagery task to evoke brain activity associated with ME and MI, which can be recorded by functional magnetic resonance imaging. We applied a causal discovery approach, a linear non-Gaussian acyclic causal model, to identify directed functional connectivity among the frontoparietal motor-related brain regions for each condition. We demonstrated higher directed functional connectivity from the contralateral dorsal premotor cortex (dPMC) to the primary motor cortex (M1) in ME than in MI. We further identified significant direct effects of the dPMC and ventral premotor cortex (vPMC) to the parietal regions. In particular, connectivity from the dPMC to the superior parietal lobule (SPL) in the same hemisphere showed significant positive effects across all conditions, while interlateral connectivities from the vPMC to the SPL showed significantly negative effects across all conditions. Finally, we found positive effects from A1 to M1, that is, the audio-motor pathway, in the same hemisphere. These results indicate that the sources of motor command originating in the d/vPMC influenced the M1 and parietal regions for achieving ME and MI. Additionally, sequential sounds may functionally facilitate temporal motor processes.

On the interpretation of linear Riemannian tangent space model parameters in M/EEG.

Riemannian tangent space methods offer state-of-the-art performance in magnetoencephalography (MEG) and electroencephalography (EEG) based applications such as brain-computer interfaces and biomarker development. One limitation, particularly relevant for biomarker development, is limited model interpretability compared to established component-based methods. Here, we propose a method to transform the parameters of linear tangent space models into interpretable patterns. Using typical assumptions, we show that this approach identifies the true patterns of latent sources, encoding a target signal. In simulations and two real MEG and EEG datasets, we demonstrate the validity of the proposed approach and investigate its behavior when the model assumptions are violated. Our results confirm that Riemannian tangent space methods are robust to differences in the source patterns across observations. We found that this robustness property also transfers to the associated patterns.

State-unspecific patterns of whole-brain functional connectivity from resting and multiple task states predict stable individual traits.

An increasing number of functional magnetic resonance imaging (fMRI) studies have revealed potential neural substrates of individual differences in diverse types of brain function and dysfunction. Although most previous studies have inherently focused on state-specific characterizations of brain networks and their functions, several recent studies reported on the potential state-unspecific nature of functional brain networks, such as global similarities across different experimental conditions or states, including both task and resting states. However, no previous studies have carried out direct, systematic characterizations of state-unspecific brain networks, or their functional implications. Here, we quantitatively identified several modes of state-unspecific individual variations in whole-brain functional connectivity patterns, called "Common Neural Modes" (CNMs), from a large-scale fMRI database including eight task/resting states. Furthermore, we tested how CNMs accounted for variability in individual cognitive measures. The results revealed that three CNMs were robustly extracted under various dimensions of features used. Each of these CNMs was preferentially correlated with different aspects of representative cognitive measures, reflecting stable individual traits. Importantly, the association between CNMs and cognitive measures emerged from brain connectivity data alone ("unsupervised"), whereas previous related studies have explicitly used both connectivity and cognitive measures to build their prediction models ("supervised"). The three CNMs were also able to predict several life outcomes, including income and life satisfaction, and achieved the highest level of performance when combined with a conventional cognitive measure. Our findings highlight the importance of state-unspecific brain networks in characterizing fundamental individual variation.

Characterizing Variability of Modular Brain Connectivity with Constrained Principal Component Analysis.

Characterizing the variability of resting-state functional brain connectivity across subjects and/or over time has recently attracted much attention. Principal component analysis (PCA) serves as a fundamental statistical technique for such analyses. However, performing PCA on high-dimensional connectivity matrices yields complicated "eigenconnectivity" patterns, for which systematic interpretation is a challenging issue. Here, we overcome this issue with a novel constrained PCA method for connectivity matrices by extending the idea of the previously proposed orthogonal connectivity factorization method. Our new method, modular connectivity factorization (MCF), explicitly introduces the modularity of brain networks as a parametric constraint on eigenconnectivity matrices. In particular, MCF analyzes the variability in both intra- and inter-module connectivities, simultaneously finding network modules in a principled, data-driven manner. The parametric constraint provides a compact module-based visualization scheme with which the result can be intuitively interpreted. We develop an optimization algorithm to solve the constrained PCA problem and validate our method in simulation studies and with a resting-state functional connectivity MRI dataset of 986 subjects. The results show that the proposed MCF method successfully reveals the underlying modular eigenconnectivity patterns in more general situations and is a promising alternative to existing methods.

Orthogonal Connectivity Factorization: Interpretable Decomposition of Variability in Correlation Matrices.

In many multivariate time series, the correlation structure is nonstationary, that is, it changes over time. The correlation structure may also change as a function of other cofactors, for example, the identity of the subject in biomedical data. A fundamental approach for the analysis of such data is to estimate the correlation structure (connectivities) separately in short time windows or for different subjects and use existing machine learning methods, such as principal component analysis (PCA), to summarize or visualize the changes in connectivity. However, the visualization of such a straightforward PCA is problematic because the ensuing connectivity patterns are much more complex objects than, say, spatial patterns. Here, we develop a new framework for analyzing variability in connectivities using the PCA approach as the starting point. First, we show how to analyze and visualize the principal components of connectivity matrices by a tailor-made rank-two matrix approximation in which we use the outer product of two orthogonal vectors. This leads to a new kind of transformation of eigenvectors that is particularly suited for this purpose and often enables interpretation of the principal component as connectivity between two groups of variables. Second, we show how to incorporate the orthogonality and the rank-two constraint in the estimation of PCA itself to improve the results. We further provide an interpretation of these methods in terms of estimation of a probabilistic generative model related to blind separation of dependent sources. Experiments on brain imaging data give very promising results.

Unifying Blind Separation and Clustering for Resting-State EEG/MEG Functional Connectivity Analysis.

Unsupervised analysis of the dynamics (nonstationarity) of functional brain connectivity during rest has recently received a lot of attention in the neuroimaging and neuroengineering communities. Most studies have used functional magnetic resonance imaging, but electroencephalography (EEG) and magnetoencephalography (MEG) also hold great promise for analyzing nonstationary functional connectivity with high temporal resolution. Previous EEG/MEG analyses divided the problem into two consecutive stages: the separation of neural sources and then the connectivity analysis of the separated sources. Such nonoptimal division into two stages may bias the result because of the different prior assumptions made about the data in the two stages. We propose a unified method for separating EEG/MEG sources and learning their functional connectivity (coactivation) patterns. We combine blind source separation (BSS) with unsupervised clustering of the activity levels of the sources in a single probabilistic model. A BSS is performed on the Hilbert transforms of band-limited EEG/MEG signals, and coactivation patterns are learned by a mixture model of source envelopes. Simulation studies show that the unified approach often outperforms conventional two-stage methods, indicating further the benefit of using Hilbert transforms to deal with oscillatory sources. Experiments on resting-state EEG data, acquired in conjunction with a cued motor imagery or nonimagery task, also show that the states (clusters) obtained by the proposed method often correlate better with physiologically meaningful quantities than those obtained by a two-stage method.

Learning a common dictionary for subject-transfer decoding with resting calibration.

Brain signals measured over a series of experiments have inherent variability because of different physical and mental conditions among multiple subjects and sessions. Such variability complicates the analysis of data from multiple subjects and sessions in a consistent way, and degrades the performance of subject-transfer decoding in a brain-machine interface (BMI). To accommodate the variability in brain signals, we propose 1) a method for extracting spatial bases (or a dictionary) shared by multiple subjects, by employing a signal-processing technique of dictionary learning modified to compensate for variations between subjects and sessions, and 2) an approach to subject-transfer decoding that uses the resting-state activity of a previously unseen target subject as calibration data for compensating for variations, eliminating the need for a standard calibration based on task sessions. Applying our methodology to a dataset of electroencephalography (EEG) recordings during a selective visual-spatial attention task from multiple subjects and sessions, where the variability compensation was essential for reducing the redundancy of the dictionary, we found that the extracted common brain activities were reasonable in the light of neuroscience knowledge. The applicability to subject-transfer decoding was confirmed by improved performance over existing decoding methods. These results suggest that analyzing multisubject brain activities on common bases by the proposed method enables information sharing across subjects with low-burden resting calibration, and is effective for practical use of BMI in variable environments.

Brain-machine interfaces for assistive smart homes: A feasibility study with wearable near-infrared spectroscopy.

Smart houses for elderly or physically challenged people need a method to understand residents' intentions during their daily-living behaviors. To explore a new possibility, we here developed a novel brain-machine interface (BMI) system integrated with an experimental smart house, based on a prototype of a wearable near-infrared spectroscopy (NIRS) device, and verified the system in a specific task of controlling of the house's equipments with BMI. We recorded NIRS signals of three participants during typical daily-living actions (DLAs), and classified them by linear support vector machine. In our off-line analysis, four DLAs were classified at about 70% mean accuracy, significantly above the chance level of 25%, in every participant. In an online demonstration in the real smart house, one participant successfully controlled three target appliances by BMI at 81.3% accuracy. Thus we successfully demonstrated the feasibility of using NIRS-BMI in real smart houses, which will possibly enhance new assistive smart-home technologies.

Simultaneous blind separation and clustering of coactivated EEG/MEG sources for analyzing spontaneous brain activity.

Analysis of the dynamics (non-stationarity) of functional connectivity patterns has recently received a lot of attention in the neuroimaging community. Most analysis has been using functional magnetic resonance imaging (fMRI), partly due to the inherent technical complexity of the electro- or magnetoencephalography (EEG/MEG) signals, but EEG/MEG holds great promise in analyzing fast changes in connectivity. Here, we propose a method for dynamic connectivity analysis of EEG/MEG, combining blind source separation with dynamic connectivity analysis in a single probabilistic model. Blind source separation is extremely useful for interpretation of the connectivity changes, and also enables rejection of artifacts. Dynamic connectivity analysis is performed by clustering the coactivation patterns of separated sources by modeling their variances. Experiments on resting-state EEG show that the obtained clusters correlate with physiologically meaningful quantities.

Markov and Semi-Markov switching of source appearances for nonstationary independent component analysis.

Independent component analysis (ICA) is currently the most popularly used approach to blind source separation (BSS), the problem of recovering unknown source signals when their mixtures are observed but the actual mixing process is unknown. Many ICA algorithms assume that a fixed set of source signals consistently exists in mixtures throughout the time-series to be examined. However, real-world signals often have such difficult nonstationarity that each source signal abruptly appears or disappears, thus the set of active sources dynamically changes with time. In this paper, we propose switching ICA (SwICA), which focuses on such situations. The proposed approach is based on the noisy ICA formulated as a generative model. We employ a special type of hidden Markov model (HMM) to represent such prior knowledge that the source may abruptly appear or disappear with time. The special HMM setting t hen provides an effect ofvariable selection in a dynamic way. We use the variational Bayes (VB) method to derive an effective approximation of Bayesian inference for this model. In simulation experiments using artificial and realistic source signals, the proposed method exhibited performance superior to existing methods, especially in the presence of noise. The compared methods include the natural-gradient ICA with a nonholonomic constraint, and the existing ICA method incorporating an HMM source model, which aims to deal with general nonstationarities that may exist in source signals. In addition, the proposed method could successfully recover the source signals even when the total number of true sources was overestimated or was larger than that of mixtures. We also propose a modification of the basic Markov model into a semi-Markov model, and show that the semi-Markov one is more effective for robust estimation of the source appearance.