Weightlessness alters up/down asymmetries in the perception of self-motion.

In the present study, we investigated the effect of weightlessness on the ability to perceive and remember self-motion when passing through virtual 3D tunnels that curve in different direction (up, down, left, right). We asked cosmonaut subjects to perform the experiment before, during and after long-duration space flight aboard the International Space Station (ISS), and we manipulated vestibular versus haptic cues by having subjects perform the task either in a rigidly fixed posture with respect to the space station or during free-floating, in weightlessness. Subjects were driven passively at constant speed through the virtual 3D tunnels containing a single turn in the middle of a linear segment, either in pitch or in yaw, in increments of 12.5°. After exiting each tunnel, subjects were asked to report their perception of the turn's angular magnitude by adjusting, with a trackball, the angular bend in a rod symbolizing the outside view of the tunnel. We demonstrate that the strong asymmetry between downward and upward pitch turns observed on Earth showed an immediate and significant reduction when free-floating in weightlessness and a delayed reduction when the cosmonauts were firmly in contact with the floor of the station. These effects of weightlessness on the early processing stages (vestibular and optokinetics) that underlie the perception of self-motion did not stem from a change in alertness or any other uncontrolled factor in the ISS, as evidenced by the fact that weightlessness had no effect on the perception of yaw turns. That the effects on the perception of pitch may be partially overcome by haptic cues reflects the fusion of multisensory cues and top-down influences on visual perception.

Central processes amplify and transform anisotropies of the visual system in a test of visual-haptic coordination.

The CNS may use multimodal reference frames to combine proprioceptive, visual, and gravitational information. Indeed, spatial information could be encoded simultaneously with respect to egocentric and allocentric references such as the body axis and gravity, respectively. It has further been proposed that gravity might serve to align reference frames between different sensory modalities. We performed a series of experiments in which human subjects matched the orientation of a visual stimulus to a visual reference (visual-visual), a haptic stimulus to a haptic reference (haptic-haptic), or a visual stimulus to a haptic reference (visual-haptic). These tests were performed in a normal upright posture, with the body tilted with respect to gravity, and in the weightless environment of Earth orbit. We found systematic patterns of errors in the matching of stimulus orientations. For an upright posture on Earth, a classic oblique effect appeared in the visual-visual comparison, which was then amplified in the haptic-visual task. Leftward or rightward whole-body tilt on Earth abolished both of these effects, yet each persisted in the absence of gravity. Leftward and rightward tilt also produced asymmetric biases in the visual-haptic but not in the visual-visual or haptic-haptic responses. These results illustrate how spatial anisotropy can be molded by sensorimotor transformations in the CNS. Furthermore, the results indicate that gravity plays a significant, but nonessential role in defining the reference frames for these tasks. These results provide insight into how the nervous system processes spatial information between different sensory modalities.

Two reference frames for visual perception in two gravity conditions.

The processing and storage of visual information concerning the orientation of objects in space is carried out in anisotropic reference frames in which all orientations are not treated equally. The perceptual anisotropies, and the implicit reference frames that they define, are evidenced by the observation of 'oblique effects' in which performance on a given perceptual task is better for horizontally and vertically oriented stimuli. The question remains how the preferred horizontal and vertical reference frames are defined. In these experiments cosmonaut subjects reproduced the remembered orientation of a visual stimulus in 1g (on the ground) and in 0g, both attached to a chair and while free-floating within the International Space Station. Results show that while the remembered orientation of a visual stimulus may be stored in a multimodal reference frame that includes gravity, an egocentric reference is sufficient to elicit the oblique effect when all gravitational and haptic cues are absent.

Gravity and spatial orientation in virtual 3D-mazes.

In order to bring new insights into the processing of 3D spatial information, we conducted experiments on the capacity of human subjects to memorize 3D-structured environments, such as buildings with several floors or the potentially complex 3D structure of an orbital space station. We had subjects move passively in one of two different exploration modes, through a visual virtual environment that consisted of a series of connected tunnels. In upright displacement, self-rotation when going around corners in the tunnels was limited to yaw rotations. For horizontal translations, subjects faced forward in the direction of motion. When moving up or down through vertical segments of the 3D tunnels, however, subjects facing the tunnel wall, remaining upright as if moving up and down in a glass elevator. In the unconstrained displacement mode, subjects would appear to climb or dive face-forward when moving vertically; thus, in this mode subjects could experience visual flow consistent with rotations about any of the 3 canonical axes. In a previous experiment, subjects were asked to determine whether a static, outside view of a test tunnel corresponded or not to the tunnel through which they had just passed. Results showed that performance was better on this task for the upright than for the unconstrained displacement mode; i.e. when subjects remained "upright" with respect to the virtual environment as defined by subject's posture in the first segment. This effect suggests that gravity may provide a key reference frame used in the shift between egocentric and allocentric representations of the 3D virtual world. To check whether it is the polarizing effects of gravity that leads to the favoring of the upright displacement mode, the experimental paradigm was adapted for orbital flight and performed by cosmonauts onboard the International Space Station. For these flight experiments the previous recognition task was replaced by a computerized reconstruction task, which proved to be more efficient in terms of the time required to achieve reliable results. Suppressing gravity did not immediately affect relative performance between the two modes, indicating that on-line graviceptor information is not directly responsible for this differential effect. Trends in the evolution of responses over the course of a 10-day mission, however, suggest that human subjects might adapt their ability to represent internally complex 3D displacements.