The Neural Correlates of Embodied L2 Learning: Does Embodied L2 Verb Learning Affect Representation and Retention?

We investigated how naturalistic actions in a highly immersive, multimodal, interactive 3D virtual reality (VR) environment may enhance word encoding by recording EEG in a pre/post-test learning paradigm. While behavior data have shown that coupling word encoding with gestures congruent with word meaning enhances learning, the neural underpinnings of this effect have yet to be elucidated. We coupled EEG recording with VR to examine whether embodied learning improves learning and creates linguistic representations that produce greater motor resonance. Participants learned action verbs in an L2 in two different conditions: specific action (observing and performing congruent actions on virtual objects) and pointing (observing actions and pointing to virtual objects). Pre- and post-training participants performed a match-mismatch task as we measured EEG (variation in the N400 response as a function of match between observed actions and auditory verbs) and a passive listening task while we measured motor activation (mu [8-13 Hz] and beta band [13-30 Hz] desynchronization during auditory verb processing) during verb processing. Contrary to our expectations, post-training results revealed neither semantic nor motor effects in either group when considered independently of learning success. Behavioral results showed a great deal of variability in learning success. When considering performance, low performance learners showed no semantic effect and high performance learners exhibited an N400 effect for mismatch versus match trials post-training, independent of the type of learning. Taken as a whole, our results suggest that embodied processes can play an important role in L2 learning.

Car drivers coping with hazardous events in real versus simulated situations: Declarative, behavioral and physiological data used to assess drivers' feeling of presence.

More than 1.3 million people lose their lives every year in traffic accidents. Improving road safety requires designing better vehicles and investigating drivers' abilities more closely. Driving simulators are constantly being used for this purpose, but the question which often arises as to their validity tends to be a barrier to developments in this field. Here we studied the validity of a simulator, defined as how closely users' behavior under simulated conditions resembles their behavior on the road, based on the concept of drivers' feeling of presence. For this purpose, the driving behavior, physiological state and declarative data of 41 drivers were tested in the Sherpa2 simulator and in a real vehicle on a track while driving at a constant speed. During each trial, drivers had to cope with an unexpected hazardous event (a one-meter diameter gym ball crossing the road right in front of the vehicle), which occurred twice. During the speed-maintenance task, the simulator showed absolute validity, in terms of the driving and physiological parameters recorded. During the first hazardous event, the physiological parameters showed that the level of arousal (Low Heart Rate/High Heart Rate ratio x10) increased up to the end of the drive. On the other hand, the drivers' behavioral (braking) responses were 20% more frequent in the simulator than in the real vehicle, and the physiological state parameters showed that stress reactions occurred only in the real vehicle (+5 beats per minute, +2 breaths per minute and the phasic skin conductance increased by 2). In the subjects' declarative data, several feeling of presence sub-scales were lower under simulated conditions. These results suggest that the validity of motion based simulators for testing drivers coping with hazards needs to be questioned.

Viewpoint oscillation improves the perception of distance travelled in static observers but not during treadmill walking.

Optic flow has been found to be a significant cue for static observers' perception of distance travelled. In previous research conducted in a large-scale immersive display (CAVE), adding viewpoint oscillations to a radial optic flow simulating forward self-motion was found to modulate this perception. In the present two experiments, we investigated (1) whether the improved distance travelled perceptions observed with an oscillating viewpoint in a CAVE were also obtained when the subjects were wearing a head mounted display (HMD, an Oculus Rift) and (2) whether the absence of viewpoint oscillations during treadmill walking was liable to affect the subjects' perception of self-motion. In Experiment 1, static observers performed a distance travelled estimation task while facing either a purely linear visual simulation of self-motion (in depth) or the same flow in addition to viewpoint oscillations based on the subjects' own head oscillations previously recorded during treadmill walking. Results show that the benefits of viewpoint oscillations observed in a CAVE persisted when the participants were wearing an HMD. In Experiment 2, participants had to carry out the same task while walking on a treadmill under two different visual conditions simulating self-motion in depth: the one with and the other without the visual consequences of their head translations. Results showed that viewpoint oscillations did not improve the accuracy of subjects' distance travelled estimations. A comparison between the two experiments showed that adding internal dynamic information about actual self-motion to visual information did not allow participants better estimates.

Improved GaLV-TR Glycoproteins to Pseudotype Lentiviral Vectors: Impact of Viral Protease Activity in the Production of LV Pseudotypes.

Lentiviral vectors (LVs) are excellent tools for gene transfer into mammalian cells. It is noteworthy that the first gene therapy treatment using LVs was approved for commercialization in 2017. The G glycoprotein from rhabdovirus vesicular stomatitis virus (VSV-G) is the glycoprotein most used to pseudotype LVs, due to its high efficiency in transducing several cell types and its resistance to viral vector purification and storage conditions. However, VSV-G expression induces cytotoxicity, which limits LV production to short periods. As alternative to VSV-G, γ-retrovirus glycoproteins (4070A derived, GaLV derived, and RD114 derived) have been used to pseudotype both γ-retroviral vectors (RVs) and LVs. These glycoproteins do not induce cytotoxicity, allowing the development of stable LV producer cells. Additionally, these LV pseudotypes present higher transduction efficiencies of hematopoietic stem cells when compared to VSV-G. Here, new 4070A-, RD114-TR-, and GaLV-TR-derived glycoproteins were developed with the aim of improving its cytoplasmic tail R-peptide cleavage and thus increase LV infectious titers. The new glycoproteins were tested in transient LV production using the wild-type or the less active T26S HIV-1 protease. The GaLV-TR-derived glycoproteins were able to overcome titer differences observed between LV production using wild-type and T26S protease. Additionally, these glycoproteins were even able to increase LV titers, evidencing its potential as an alternative glycoprotein to pseudotype LVs.

Motor resonance during linguistic processing as shown by EEG in a naturalistic VR environment.

Embodied cognition studies have shown motor resonance during action language processing, indicating that linguistic representations are at least partially multimodal. However, constraints of this activation linked to linguistic and extra-linguistic context, function and timing have not yet been fully explored. Importantly, embodied cognition binds social and physical contexts to cognition, suggesting that more ecologically valid contexts will yield more valid measures of cognitive processing. Herein, we measured cortical motor activation during language processing in a fully immersive Cave automatic virtual environment (CAVE). EEG was recorded while participants engaged in a Go/No-Go task. They heard action verbs and, for Go trials, performed a corresponding action on a virtual object. ERSP (event-related spectral perturbation) was calculated during verb processing, corresponding to the pattern of power suppression (event-related desynchronization - ERD) and enhancement (event-related synchronization - ERS) relative to the reference interval. Significant ERD emerged during verb processing in both the µ (8-13 Hz) and beta band (20-30 Hz) for both Go and No-Go trials. µ ERD emerged in the 400-500 msec time window, associated with lexical-semantic processing. Greater µ ERD emerged for Go compared to No-Go trials. The present results provide compelling evidence in a naturalistic setting of how motor and linguistic processes interact.

Brain metabolism and related connectivity in patients with acrophobia treated by virtual reality therapy: an 18F-FDG PET pilot study sensitized by virtual exposure.

BACKGROUND: The aim of this pilot study is to investigate the impact of virtual reality exposure therapy (VRET) on brain metabolism and connectivity. Eighteen patients with acrophobia were assessed by an 18F-FDG PET scan sensitized by virtual exposure before treatment, and nine of them were assessed again after eight sessions of VRET. Statistical Parametric Mapping was used to study the correlations between metabolism and pretherapeutic clinical scores and to compare metabolism before and after VRET (p voxel < 0.005, corrected for cluster volume). Metabolic connectivity was evaluated through interregional correlation analysis. RESULTS: Before therapy, a positive correlation was found between scores on the behavioural avoidance test and left occipital metabolism (BA17-18). After VRET, patients presented increased metabolism in the left frontal superior gyri and the left precentral gyrus, which showed increased metabolic connectivity with bilateral occipital areas (BA17-18-19), concomitant with clinical recovery. CONCLUSIONS: This study highlights the exciting opportunity to use brain PET imaging to investigate metabolism during virtual exposure and reports the involvement of the visual-motor control system in the treatment of acrophobia by VRET.

Cannabis smoking impairs driving performance on the simulator and real driving: a randomized, double-blind, placebo-controlled, crossover trial.

Driving experiments in real conditions are considered as a 'gold standard' to evaluate the effects of drugs on driving performance. Several constraints are difficult to manage in these conditions, so driving simulation appears as the best alternative. A preliminary comparison is crucial before being able to use driving simulation as a valid evaluation method. The aim of this study was to design a driving simulation method for assessing drug effects on driving. We used cannabis (THC) as a positive control and assessed whether THC affects driving performance in simulation conditions and whether these effects are consistent with performance in real driving conditions. A double-blind, placebo-controlled, two successive two-way crossover design was performed using cigarettes containing 20 mg of THC. Healthy occasional users of THC, aged 25-35 years, who had a consistent driving experience were included. The first two sessions were realized in simulation conditions, and the last two sessions were in real driving conditions. Driving performance was estimated through inappropriate line crossings (ILC) and the standard deviation of the vehicle's lateral position. Participants felt significantly drowsier and more tired after THC, whatever the driving condition. Driving stability was significantly impaired after THC, both in simulated and real driving conditions. We also found that ILC were significantly more numerous in driving simulation conditions, as compared to real driving. In conclusion, the driving simulator was proven to be more sensitive for demonstrating THC-induced effects on driving performances. Driving simulation appears to be a good qualitative predictor of driving safety after drug intake.

The relative contributions of various viewpoint oscillation frequencies to the perception of distance traveled.

Humans and most animals are able to navigate in their environment, which generates sensorial information of various kinds, such as proprioceptive cues and optic flow. Previous research focusing on the visual effects of walking (bob, sway, and lunge head motion) has shown that the perception of forward self-motion experienced by static observers can be modulated by adding simulated viewpoint oscillations to the radial flow. In three experimental studies, we examined the effects of several viewpoint oscillation frequencies on static observers' perception of the distance traveled, assuming the assessment of distance traveled to be part of the path integration process. Experiment 1 showed that observers' estimates depended on the frequency of the viewpoint oscillations. In Experiment 2, increasing the viewpoint oscillation frequency actually led to an increase in the global retinal flow. It also emerged that simulated viewpoint oscillations enhance the sensation of self-motion: In a specific low-frequency range (<4 Hz), they improved subjects' estimates of the distances traveled. Lastly, in Experiment 3, observers were presented with two different simulated viewpoint oscillation patterns, both involving the same amount of global retinal motion, but in one case, the pattern simulated the visual effects of natural walking, and in the other case, the pattern was not biologically realistic. Contrary to the predictions of a previous ecological hypothesis, the subjects gave similar responses under both conditions. The global retinal motion may be mainly responsible for these effects, which were found to be optimal in a specific fairly low-oscillation frequency range.

Viewpoint oscillation improves the perception of distance travelled based on optic flow.

When static observers are presented with a visual simulation of forward self-motion, they generally misestimate distance travelled relative to a previously seen distant target: It has been suggested that this finding can be accounted for by a "leaky path integration" model. In the present study, using a similar experimental procedure, this result was confirmed. It was also established that combining the translational optical flow with simulated head oscillations (similar to those during natural walking) improved the subjects' perception of the distance travelled in comparison with a purely translational flow. This improvement may be attributable to the fact that an optic flow pattern resembling that associated with walking enhances the path integration process. In a subsequent experiment, we investigated whether it was the biological or the rhythmical characteristics of the simulation that enhanced the subjects' estimates of the distance travelled. The results obtained confirm that adding rhythmic components to the optic flow pattern improved the accuracy of subjects' perception of the distance travelled. However, no significant differences between biological and rhythmical oscillations were detected. These results relate to recent studies on the effects of smooth and jittering optic flows on vection onset and strength. One possible conclusion is that oscillations may increase the global retinal motion and thus improve the vection and path integration processes. Another possibility is that the nonmonotonous pattern of retinal motion induced by oscillatory inputs may maintain optimum sensitivity to the optic flow over time and thus improve the accuracy of subjects' perception of the distance travelled.

Do not get lost in translation: The role of egocentric heading in spatial orientation.

Much is known about how different spatial reference frames continually interact to support spatial navigation, but less explored is whether it is more crucial to process object-to-object information or egocentric heading information for effective orientation in a cluttered environment. To address this question, we evaluated the possible influence on spatial performance of an interactive aerial view of different scale (small vs. large) comprising an arrow indicating participants' egocentric heading. Results revealed that the presence of a small interactive aerial view including a visualized larger arrow facilitated the retrieval of stored spatial layout. These data are consistent with recent studies revealing the role of retrosplenial cortex in translating between different spatial reference frames, and may contribute to elucidate the continuous synchronization between the inter-object direction information in the environment with respect to egocentric current heading.

Being Present In Space: The Role Of Allocentric And Egocentric Reference Frames.

The general aim of the present study was to investigate the effect of an interactive aerial view of the experienced environment during the encoding and retrieving of spatial information on the feeling of presence. Our findings showed that this real-time interactive aerial view (both small and large) during the encoding and retrieval of spatial information seems to led to a greater sense of presence. It is argued that the use of this aerial view, which provides a real-time allocentric viewpoint-dependent spatial representation, would ease the translation of a stored allocentric representation into an egocentric one, and this process, consequently, would help individuals to feel present in space.

Combined influence of visual scene and body tilt on arm pointing movements: gravity matters!

Performing accurate actions such as goal-directed arm movements requires taking into account visual and body orientation cues to localize the target in space and produce appropriate reaching motor commands. We experimentally tilted the body and/or the visual scene to investigate how visual and body orientation cues are combined for the control of unseen arm movements. Subjects were asked to point toward a visual target using an upward movement during slow body and/or visual scene tilts. When the scene was tilted, final pointing errors varied as a function of the direction of the scene tilt (forward or backward). Actual forward body tilt resulted in systematic target undershoots, suggesting that the brain may have overcompensated for the biomechanical movement facilitation arising from body tilt. Combined body and visual scene tilts also affected final pointing errors according to the orientation of the visual scene. The data were further analysed using either a body-centered or a gravity-centered reference frame to encode visual scene orientation with simple additive models (i.e., 'combined' tilts equal to the sum of 'single' tilts). We found that the body-centered model could account only for some of the data regarding kinematic parameters and final errors. In contrast, the gravity-centered modeling in which the body and visual scene orientations were referred to vertical could explain all of these data. Therefore, our findings suggest that the brain uses gravity, thanks to its invariant properties, as a reference for the combination of visual and non-visual cues.

Lorazepam impairs highway driving performance more than heavy alcohol consumption.

While research indicates that benzodiazepine (BZD)-like drugs impair driving performance, it remains unclear (i) how far BZDs affect lane-keeping performance, compared with alcohol and (ii) to what extent this impact can realistically be measured in a simulated environment. To clarify these issues, 16 healthy male drivers who had never previously taken BZDs underwent a randomized, crossover, double-blind, placebo-controlled driving paradigm (with the BZD lorazepam) in both real-world and simulated settings. Two lane-keeping variables, namely inappropriate line crossings (ILCs) and standard deviation of lateral position (SDLP), were recorded during the driving sessions. Analyses revealed that (i) a single lorazepam dose (2 mg given by mouth) caused higher SDLP increases than a blood alcohol concentration of above 0.05%, and that (ii) this BZD effect was amplified in the simulated driving setting, mainly for ILCs. As a consequence, we recommend that physicians be made more aware of BZD-related risks and that researchers make a clear distinction between the effects of BZD intake per se and the impact of simulated driving settings.

Effect of temporal organization of the visuo-locomotor coupling on the predictive steering.

Studies on the direction of a driver's gaze while taking a bend show that the individual looks toward the tangent-point of the inside curve. Mathematically, the direction of this point in relation to the car enables the driver to predict the curvature of the road. In the same way, when a person walking in the street turns a corner, his/her gaze anticipates the rotation of the body. A current explanation for the visuo-motor anticipation over the locomotion would be that the brain, involved in a steering behavior, executes an internal model of the trajectory that anticipates the completion of the path, and not the contrary. This paper proposes to test this hypothesis by studying the effect of an artificial manipulation of the visuo-locomotor coupling on the trajectory prediction. In this experiment, subjects remotely control a mobile robot with a pan-tilt camera. This experimental paradigm is chosen to manipulate in an easy and precise way the temporal organization of the visuo-locomotor coupling. The results show that only the visuo-locomotor coupling organized from the visual sensor to the locomotor organs enables (i) a significant smoothness of the trajectory and (ii) a velocity-curvature relationship that follows the "2/3 Power Law." These findings are consistent with the theory of an anticipatory construction of an internal model of the trajectory. This mental representation used by the brain as a forward prediction of the formation of the path seems conditioned by the motor program. The overall results are discussed in terms of the sensorimotor scheme bases of the predictive coding.

Path curvature discrimination: dependence on gaze direction and optical flow speed.

Many experimental approaches to the control of steering rely on the tangent point (TP) as major source of information. The TP is a good candidate to control self-motion. It corresponds to a singular and salient point in the subject's visual field, and its location depends on the road geometry, the direction of self-motion relative to the road and the position of the driver on the road. However, the particular status of the TP in the optical flow, as a local minimum of flow speed, has often been left aside. We therefore assume that the TP is actually an optimal location in the dynamic optical array to perceive a change in the trajectory curvature. In this study, we evaluated the ability of human observers to detect variations in their path curvature from optical flow patterns, as a function of their gaze direction in a virtual environment. We simulated curvilinear self-motion parallel to a ground plane. Using random-dot optic flow stimuli of brief duration and a two-alternative forced-choice adaptive procedure, we determined path curvature discrimination thresholds, as a function of gaze direction. The discrimination thresholds are minimal for a gaze directed toward a local minimum of optical flow speed. A model based on Weber fraction of the foveal velocities (ΔV/V) correctly predicts the relationship between experimental thresholds and local flow velocities. This model was also tested for an optical flow computation integrating larger circular areas in central vision. Averaging the flow over five degrees leads to an even better fit of the model to experimental thresholds. We also found that the minimal optical flow speed direction corresponds to a maximal sensitivity of the visual system, as predicted by our model. The spontaneous gazing strategies observed during driving might thus correspond to an optimal selection of relevant information in the optical flow field.

Virtual reality and exercise: behavioral and psychological effects of visual feedback.

We herein report an experimental study examining the potential positive effects of Virtual Reality (VR) feedback during an indoor bicycling exercise. Using a regular bike coupled to a VR system, we compared conditions of no VR feedback, VR feedback and VR feedback with the presence of a virtual coach, acting as a pacer. In VR feedback conditions, we observed a decreased level of perceived exertion and an increased level of enjoyment of physical activity, when compared to a regular exercise situation (no VR feedback). We also observed a shift in the subjects' attentional focus, from association (in the absence of VR feedback) to dissociation (in VR feedback conditions). Moreover, the presence of a virtual coach in the VR environment triggered a systematic regulation of the (virtual) displacement speed, whose relationship with perceived enjoyment and exertion require further work.

Optokinetic nystagmus is elicited by curvilinear optic flow during high speed curve driving.

When analyzing gaze behavior during curve driving, it is commonly accepted that gaze is mostly located in the vicinity of the tangent point, being the point where gaze direction tangents the curve inside edge. This approach neglects the fact that the tangent point is actually motionless only in the limit case when the trajectory precisely follows the curve's geometry. In this study, we measured gaze behavior during curve driving, with the general hypothesis that gaze is not static, when exposed to a global optical flow due to self-motion. In order to study spatio-temporal aspects of gaze during curve driving, we used a driving simulator coupled to a gaze recording system. Ten participants drove seven runs on a track composed of eight curves of various radii (50, 100, 200 and 500m), with each radius appearing in both right and left directions. Results showed that average gaze position was, as previously described, located in the vicinity of the tangent point. However, analysis also revealed the presence of a systematic optokinetic nystagmus (OKN) around the tangent point position. The OKN slow phase direction does not match the local optic flow direction, while slow phase speed is about half of the local speed. Higher directional gains are observed when averaging the entire optical flow projected on the simulation display, whereas the best speed gain is obtained for a 2° optic flow area, centered on the instantaneous gaze location. The present study confirms that the tangent point is a privileged feature in the dynamic visual scene during curve driving, and underlines a contribution of the global optical flow to gaze behavior during active self-motion.

Bayesian networks and information theory for audio-visual perception modeling.

Thanks to their different senses, human observers acquire multiple information coming from their environment. Complex cross-modal interactions occur during this perceptual process. This article proposes a framework to analyze and model these interactions through a rigorous and systematic data-driven process. This requires considering the general relationships between the physical events or factors involved in the process, not only in quantitative terms, but also in term of the influence of one factor on another. We use tools from information theory and probabilistic reasoning to derive relationships between the random variables of interest, where the central notion is that of conditional independence. Using mutual information analysis to guide the model elicitation process, a probabilistic causal model encoded as a Bayesian network is obtained. We exemplify the method by using data collected in an audio-visual localization task for human subjects, and we show that it yields a well-motivated model with good predictive ability. The model elicitation process offers new prospects for the investigation of the cognitive mechanisms of multisensory perception.

Interaction between reference frames during subjective vertical estimates in a tilted immersive virtual environment.

Numerous studies highlighted the influence of a tilted visual frame on the perception of the visual vertical ('rod-and-frame effect' or RFE). Here, we investigated whether this influence can be modified in a virtual immersive environment (CAVE-like) by the structure of the visual scene and by the adjustment mode allowing visual or visuo-kinaesthetic control (V and VK mode, respectively). The way this influence might dynamically evolve throughout the adjustment was also investigated in two groups of subjects with the head unrestrained or restrained upright. RFE observed in the immersive environment was qualitatively comparable to that obtained in a real display (portable rod-and-frame test; Oltman 1968, Perceptual and Motor Skills 26 503-506). Moreover, RFE in the immersive environment appeared significantly influenced by the structure of the visual scene and by the adjustment mode: the more geometrical and meaningful 3-D features the visual scene contained, the greater the RFE. The RFE was also greater when the subjective vertical was assessed under visual control only, as compared to visuo-kinaesthetic control. Furthermore, the results showed a significant RFE increase throughout the adjustment, indicating that the influence of the visual scene upon subjective vertical might dynamically evolve over time. The latter effect was more pronounced for structured visual scenes and under visuo-kinaesthetic control. On the other hand, no difference was observed between the two groups of subjects having the head restrained or unrestrained. These results are discussed in terms of dynamic combination between coexisting reference frames for spatial orientation.