Using virtual reality to induce multi-trial inattentional blindness despite trial-by-trial measures of awareness.

Unconscious processing has been widely examined using diverse and well-controlled methodologies. However, the extent to which these findings are relevant to real-life instances of information processing without awareness is limited. Here, we present a novel inattentional blindness (IB) paradigm in virtual reality (VR). In three experiments, we managed to repeatedly induce IB while participants foveally viewed salient stimuli for prolonged durations. The effectiveness of this paradigm demonstrates the close relationship between top-down attention and subjective experience. Thus, this method provides an ecologically valid setup to examine processing without awareness.

Differential contribution of between and within-brain coupling to movement synchronization.

A fundamental characteristic of the human brain that supports behavior is its capacity to create connections between brain regions. A promising approach holds that during social behavior, brain regions not only create connections with other brain regions within a brain, but also coordinate their activity with other brain regions of an interaction partner. Here we ask whether between-brain and within-brain coupling contribute differentially to movement synchronization. We focused on coupling between the inferior frontal gyrus (IFG), a brain region associated with the observation-execution system, and the dorsomedial prefrontal cortex (dmPFC), a region associated with error-monitoring and prediction. Participants, randomly divided into dyads, were simultaneously scanned with functional near infra-red spectroscopy (fNIRS) while performing an open-ended 3D hand movement task consisting of three conditions: back-to-back movement, free movement, or intentional synchronization. Results show that behavioral synchrony was higher in the intentional synchrony compared with the back-to-back and free movement conditions. Between-brain coupling in the IFG and dmPFC was evident in the free movement and intentional synchrony conditions but not in the back-to-back condition. Importantly, between-brain coupling was found to positively predict intentional synchrony, while within-brain coupling was found to predict synchronization during free movement. These results indicate that during intentional synchronization, brain organization changes such that between-brain networks, but not within-brain connections, contribute to successful communication, pointing to shift from a within-brain feedback loop to a two-brains feedback loop.

The benefits of learning movement sequences in social interactions.

Although we frequently acquire knowledge and skills through social interactions, the focus of most research on learning is on individual learning. Here we characterize Interaction Based Learning (IBL), which represents the acquisition of knowledge or skill through social interactions, and compare it to Observational Learning (OL)-learning by observation. To that end, we designed a movement synchronization paradigm whereby participants learned Tai-Chi inspired movement sequences from trained teachers in two separated sessions. We used a motion capture system to track the movement of 40 dyads comprised of a teacher and learner, who were randomly divided into OL or IBL groups, and calculated time-varying synchrony of three-dimensional movement velocity. While in the IBL group both the learner and the teacher could see each other through a transparent glass, in the OL group dyads interacted through a one-way mirror, such that the learners observed the teacher, but the teacher could not see the learners. Results show that although the number of movements recalled was not different between groups, we found improved movement smoothness in the IBL compared to the OL group, indicating movement acquisition was better in the IBL group. In addition, we found that motor synchronization levels in dyads improved over time, indicating that movement synchronization can be learned and retained. In the first session, the IBL group, but not the OL group, showed a significant improvement in synchronization. This suggests that dyadic interaction is important for learning movement sequences, and that bidirectional communication of signals and mutual feedback are essential for the consolidation of motor learning.

Shared mechanisms underlie mental imagery and motor planning.

Many studies have associated mental imagery with motor control mechanisms by showing mutually active brain areas and functions, as well as similar temporal patterns of imagining and executing the same motor actions. One of the main conjectured mutual mechanisms is the Cerebellar forward-model, commonly believed to generate sensory predictions as part of both motor control and mental imagery processes. Nevertheless, trials to associate one's overall individual mental and motor capacities have shown only mild and inconsistent correlations, hence challenging the mutual mechanism assumption. We hypothesized that one cause to this inconsistency is the forward-model's dominance in the motor-planning stage only when adapting to novel sensorimotor environments, while the inverse-model is gradually taking the lead along the adaptation, and therefore biasing most attempts to measure motor-mental overlapping functions and correlate these measurements under regular circumstances. Our current study aimed to tackle and explore this gap using immersive virtual embodiment, by applying an experience of a fundamental sensorimotor conflict, thereby manipulating the sensory prediction mechanism, and presumably forcing an increased involvement of the forward-model in the motor planning stage throughout the experiment. In the study, two groups of subjects (n = 48) performed mental and manual rotation within an immersive, motion-captured, virtual reality environment, while the sensorimotor dynamics of only the test group were altered by physical-virtual speed re-mapping making the virtual hand move twice as fast as the physical hand controlling it. Individual mental imagery capacities were assessed before and after three blocks of manual-rotation, where motor planning durations were measured as the time until motion onset. The results show that virtual sensorimotor alteration extremely increases the correlation of mental imagery and motor planning (r = 0.9, p < .0001) and leads to higher mental imagery performance improvement following the physical blocks. We particularly show that virtual embodiment manipulation affects the motor planning stage to change and functionally overlap with imagery mechanisms, rather than the other way around, which supports our conjecture of an increased sensory-prediction forward-model involvement. Our results shed new light on the embodied nature of mental imagery, support the view of the predictive forward-model as a key mechanism mutually underlying motor control and imagery, and suggest virtual sensorimotor alteration as a novel methodology to increase physical-mental convergence. These findings also suggest the applicability of using existing motion-tracked virtual environments for continuous cognitive evaluation and treatment, through kinematic analysis of ongoing natural motor behaviors.

How Long Is Too Long: An Individual Time-Window for Motor Planning.

Human motor response time (RT) is determined by the matureness of the preceding neural motor planning process. In the current study, we characterize the temporal boundaries required for the motor planning process, and its impact on the overall motor RT. In particular, we contrasted short and long planning times by measuring the resulting differences in motor RTs, in an attempt to find whether an optimal planning time for minimal RT exists. Using a "Timed Response" paradigm, we presented participants with varying planning intervals prior to a requested motor response and studied their effect on the timing of initiation of the following movement. We found that, as expected, reaction time shortens as more planning time is provided, yet only until reaching a minimal RT, after which additional planning time increases the motor RT, thus creating a U-shaped behavioral function. Furthermore, since the minimal RT was found to be an individual characteristic, we suggest that there is an individual time window for motor planning.

A Time-Varying Measure of Dyadic Synchrony for Three-Dimensional Motion.

We propose a novel approach to the analysis of synchronized three-dimensional motion in dyads. Motion recorded at high time resolution, as with a gaming device, is preprocessed in each of the three spatial dimensions by spline smoothing. Synchrony is then defined, at each time point, as the cosine between the two individuals' estimated velocity vectors. The approach is extended to allow a time lag, allowing for the analysis of leader-follower dynamics. Mean square cosine over the time range is proposed as a scalar summary of dyadic synchrony, and this measure is found to be positively associated with cognitive empathy.