A Novel Experimental and Analytical Approach to the Multimodal Neural Decoding of Intent During Social Interaction in Freely-behaving Human Infants.

Understanding typical and atypical development remains one of the fundamental questions in developmental human neuroscience. Traditionally, experimental paradigms and analysis tools have been limited to constrained laboratory tasks and contexts due to technical limitations imposed by the available set of measuring and analysis techniques and the age of the subjects. These limitations severely limit the study of developmental neural dynamics and associated neural networks engaged in cognition, perception and action in infants performing "in action and in context". This protocol presents a novel approach to study infants and young children as they freely organize their own behavior, and its consequences in a complex, partly unpredictable and highly dynamic environment. The proposed methodology integrates synchronized high-density active scalp electroencephalography (EEG), inertial measurement units (IMUs), video recording and behavioral analysis to capture brain activity and movement non-invasively in freely-behaving infants. This setup allows for the study of neural network dynamics in the developing brain, in action and context, as these networks are recruited during goal-oriented, exploration and social interaction tasks.

Neural decoding of expressive human movement from scalp electroencephalography (EEG).

Although efforts to characterize human movement through electroencephalography (EEG) have revealed neural activities unique to limb control that can be used to infer movement kinematics, it is still unknown the extent to which EEG can be used to discern the expressive qualities that influence such movements. In this study we used EEG and inertial sensors to record brain activity and movement of five skilled and certified Laban Movement Analysis (LMA) dancers. Each dancer performed whole body movements of three Action types: movements devoid of expressive qualities ("Neutral"), non-expressive movements while thinking about specific expressive qualities ("Think"), and enacted expressive movements ("Do"). The expressive movement qualities that were used in the "Think" and "Do" actions consisted of a sequence of eight Laban Effort qualities as defined by LMA-a notation system and language for describing, visualizing, interpreting and documenting all varieties of human movement. We used delta band (0.2-4 Hz) EEG as input to a machine learning algorithm that computed locality-preserving Fisher's discriminant analysis (LFDA) for dimensionality reduction followed by Gaussian mixture models (GMMs) to decode the type of Action. We also trained our LFDA-GMM models to classify all the possible combinations of Action Type and Laban Effort quality (giving a total of 17 classes). Classification accuracy rates were 59.4 ± 0.6% for Action Type and 88.2 ± 0.7% for Laban Effort quality Type. Ancillary analyses of the potential relations between the EEG and movement kinematics of the dancer's body, indicated that motion-related artifacts did not significantly influence our classification results. In summary, this research demonstrates that EEG has valuable information about the expressive qualities of movement. These results may have applications for advancing the understanding of the neural basis of expressive movements and for the development of neuroprosthetics to restore movements.

Decoding of intentional actions from scalp electroencephalography (EEG) in freely-behaving infants.

The mirror neuron system (MNS) in humans is thought to enable an individual's understanding of the meaning of actions performed by others and the potential imitation and learning of those actions. In humans, electroencephalographic (EEG) changes in sensorimotor a-band at central electrodes, which desynchronizes both during execution and observation of goal-directed actions (i.e., µ suppression), have been considered an analog to MNS function. However, methodological and developmental issues, as well as the nature of generalized µ suppression to imagined, observed, and performed actions, have yet to provide a mechanistic relationship between EEG µ-rhythm and MNS function, and the extent to which EEG can be used to infer intent during MNS tasks remains unknown. In this study we present a novel methodology using active EEG and inertial sensors to record brain activity and behavioral actions from freely-behaving infants during exploration, imitation, attentive rest, pointing, reaching and grasping, and interaction with an actor. We used 5-band (1-4Hz) EEG as input to a dimensionality reduction algorithm (locality-preserving Fisher's discriminant analysis, LFDA) followed by a neural classifier (Gaussian mixture models, GMMs) to decode the each MNS task performed by freely-behaving 6-24 month old infants during interaction with an adult actor. Here, we present results from a 20-month male infant to illustrate our approach and show the feasibility of EEG-based classification of freely occurring MNS behaviors displayed by an infant. These results, which provide an alternative to the µ-rhythm theory of MNS function, indicate the informative nature of EEG in relation to intentionality (goal) for MNS tasks which may support action-understanding and thus bear implications for advancing the understanding of MNS function.