Does belief in free will influence biological motion perception?

Previous research suggests that belief in free will correlates with intentionality attribution. However, whether belief in free will is also related to more basic social processes is unknown. Based on evidence that biological motion contains intentionality cues that observers spontaneously extract, we investigate whether people who believe more in free will, or in related constructs, such as dualism and determinism, would be better at picking up such cues and therefore at detecting biological agents hidden in noise, or would be more inclined to detect intentionality cues and therefore to detect biological agents even when there are none. Signal detection theory was used to measure participants' ability to detect biological motion from scrambled background noise (d') and their response bias (c) in doing so. In two experiments, we found that belief in determinism and belief in dualism, but not belief in free will, were associated with biological motion perception. However, no causal effect was found when experimentally manipulating free will-related beliefs. In sum, our results show that biological motion perception, a low-level social process, is related to high-level beliefs about dualism and determinism.

Depth from motion parallax: Deictic consistency, eye contact, and a serious problem with Zoom.

The dynamics of head and eye gaze between two or more individuals displayed during verbal and nonverbal face-to-face communication contains a wealth of information and is used for both volitionary and unconscious signaling. Current video communication systems convey visual signals about gaze behavior and other directional cues, but the information they carry is often spurious and potentially misleading. I discuss the consequences of this situation, identify the source of the problem as a more general lack of deictic consistency, and demonstrate that using display technologies that simulate motion parallax are both necessary and sufficient to alleviate it. I then devise an avatar-based remote communication solution that achieves deictic consistency and provides natural, dynamic eye contact for computer-mediated audiovisual communication.

Movement markers of schizophrenia: a detailed analysis of patients' gait patterns.

Motor abnormalities occur in the majority of persons with schizophrenia but are generally neglected in clinical care. Psychiatric diagnostics fail to include quantifiable motor variables and few assessment tools examine full-body movement. We assessed full-body movement during gait of 20 patients and 20 controls with motion capture technology, symptom load (PANSS, BPRS) and Neurological Soft Signs (NSS). In a data-driven analysis, participants' motion patterns were quantified and compared between groups. Resulting movement markers (MM) were correlated with the clinical assessment. We identified 16 quantifiable MM of schizophrenia. While walking, patients and controls display significant differences in movement patterns related to posture, velocity, regularity of gait as well as sway, flexibility and integration of body parts. Specifically, the adjustment of body sides, limbs and movement direction were affected. The MM remain significant when controlling for medication load. They are systematically related to NSS. Results add assessment tools, analysis methods as well as theory-independent MM to the growing body of research on motor abnormalities in schizophrenia.

The role of binocular disparity and active motion parallax in cybersickness.

Cybersickness is an enduring problem for users of virtual environments. While it is generally assumed that cybersickness is caused by discrepancies in perceived self-motion between the visual and vestibular systems, little is known about the relative contribution of active motion parallax and binocular disparity to the occurrence of cybersickness. We investigated the role of these two depth cues in cybersickness by simulating a roller-coaster ride using a head-mounted display. Participants could see the tracks via a virtual frame placed at the front of the roller-coaster cart. We manipulated the state of the frame, so it behaved like: (1) a window into the virtual scene, (2) a 2D screen, (3) and (4) a window for one of the two depth cues, and a 2D screen for the other. Participants completed the Simulator Sickness Questionnaire before and after the experiment, and verbally reported their level of discomfort at repeated intervals during the ride. Additionally, participants' electrodermal activity (EDA) was recorded. The results of the questionnaire and the continuous ratings revealed the largest increase in cybersickness when the frame behaved like a window, and least increase when the frame behaved like a 2D screen. Cybersickness scores were at an intermediate level for the conditions where the frame simulated only one depth cue. This suggests that neither active motion parallax nor binocular disparity had a more prominent effect on the severity of cybersickness. The EDA responses increased at about the same rate in all conditions, suggesting that EDA is not necessarily coupled with subjectively experienced cybersickness.

Does co-presence affect the way we perceive and respond to emotional interactions?

This study compared how two virtual display conditions of human body expressions influenced explicit and implicit dimensions of emotion perception and response behavior in women and men. Two avatars displayed emotional interactions (angry, sad, affectionate, happy) in a "pictorial" condition depicting the emotional interactive partners on a screen within a virtual environment and a "visual" condition allowing participants to share space with the avatars, thereby enhancing co-presence and agency. Subsequently to stimulus presentation, explicit valence perception and response tendency (i.e. the explicit tendency to avoid or approach the situation) were assessed on rating scales. Implicit responses, i.e. postural and autonomic responses towards the observed interactions were measured by means of postural displacement and changes in skin conductance. Results showed that self-reported presence differed between pictorial and visual conditions, however, it was not correlated with skin conductance responses. Valence perception was only marginally influenced by the virtual condition and not at all by explicit response behavior. There were gender-mediated effects on postural response tendencies as well as gender differences in explicit response behavior but not in valence perception. Exploratory analyses revealed a link between valence perception and preferred behavioral response in women but not in men. We conclude that the display condition seems to influence automatic motivational tendencies but not higher level cognitive evaluations. Moreover, intragroup differences in explicit and implicit response behavior highlight the importance of individual factors beyond gender.

Heritable aspects of biological motion perception and its covariation with autistic traits.

The ability to detect biological motion (BM) and decipher the meaning therein is essential to human survival and social interaction. However, at the individual level, we are not equally equipped with this ability. In particular, impaired BM perception and abnormal neural responses to BM have been observed in autism spectrum disorder (ASD), a highly heritable neurodevelopmental disorder characterized by devastating social deficits. Here, we examined the underlying sources of individual differences in two abilities fundamental to BM perception (i.e., the abilities to process local kinematic and global configurational information of BM) and explored whether BM perception shares a common genetic origin with autistic traits. Using the classical twin method, we found reliable genetic influences on BM perception and revealed a clear dissociation between its two components-whereas genes account for about 50% of the individual variation in local BM processing, global BM processing is largely shaped by environment. Critically, participants' sensitivity to local BM cues was negatively correlated with their autistic traits through the dimension of social communication, with the covariation largely mediated by shared genetic effects. These findings demonstrate that the ability to process BM, especially with regard to its inherent kinetics, is heritable. They also advance our understanding of the sources of the linkage between autistic symptoms and BM perception deficits, opening up the possibility of treating the ability to process local BM information as a distinct hallmark of social cognition.

Spatial coding for memory-guided reaching in visual and pictorial spaces.

An essential difference between pictorial space displayed as paintings, photographs, or computer screens, and the visual space experienced in the real world is that the observer has a defined location, and thus valid information about distance and direction of objects, in the latter but not in the former. Thus egocentric information should be more reliable in visual space, whereas allocentric information should be more reliable in pictorial space. The majority of studies relied on pictorial representations (images on a computer screen), leaving it unclear whether the same coding mechanisms apply in visual space. Using a memory-guided reaching task in virtual reality, we investigated allocentric coding in both visual space (on a table in virtual reality) and pictorial space (on a monitor that is on the table in virtual reality). Our results suggest that the brain uses allocentric information to represent objects in both pictorial and visual space. Contrary to our hypothesis, the influence of allocentric cues was stronger in visual space than in pictorial space, also after controlling for retinal stimulus size, confounding allocentric cues, and differences in presentation depth. We discuss possible reasons for stronger allocentric coding in visual than in pictorial space.

Cortical and subcortical responses to biological motion.

Using fMRI and multivariate analyses we sought to understand the neural representations of articulated body shape and local kinematics in biological motion. We show that in addition to a cortical network that includes areas identified previously for biological motion perception, including the posterior superior temporal sulcus, inferior frontal gyrus, and ventral body areas, the ventral lateral nucleus, a presumably motoric thalamic area is sensitive to both form and kinematic information in biological motion. Our findings suggest that biological motion perception is not achieved as an end-point of segregated cortical form and motion networks as often suggested, but instead involves earlier parts in the visual system including a subcortical network.

Motion processing after sight restoration: No competition between visual recovery and auditory compensation.

The present study tested whether or not functional adaptations following congenital blindness are maintained in humans after sight-restoration and whether they interfere with visual recovery. In permanently congenital blind individuals both intramodal plasticity (e.g. changes in auditory cortex) as well as crossmodal plasticity (e.g. an activation of visual cortex by auditory stimuli) have been observed. Both phenomena were hypothesized to contribute to improved auditory functions. For example, it has been shown that early permanently blind individuals outperform sighted controls in auditory motion processing and that auditory motion stimuli elicit activity in typical visual motion areas. Yet it is unknown what happens to these behavioral adaptations and cortical reorganizations when sight is restored, that is, whether compensatory auditory changes are lost and to which degree visual motion processing is reinstalled. Here we employed a combined behavioral-electrophysiological approach in a group of sight-recovery individuals with a history of a transient phase of congenital blindness lasting for several months to several years. They, as well as two control groups, one with visual impairments, one normally sighted, were tested in a visual and an auditory motion discrimination experiment. Task difficulty was manipulated by varying the visual motion coherence and the signal to noise ratio, respectively. The congenital cataract-reversal individuals showed lower performance in the visual global motion task than both control groups. At the same time, they outperformed both control groups in auditory motion processing suggesting that at least some compensatory behavioral adaptation as a consequence of a complete blindness from birth was maintained. Alpha oscillatory activity during the visual task was significantly lower in congenital cataract reversal individuals and they did not show ERPs modulated by visual motion coherence as observed in both control groups. In contrast, beta oscillatory activity in the auditory task, which varied as a function of SNR in all groups, was overall enhanced in congenital cataract reversal individuals. These results suggest that intramodal plasticity elicited by a transient phase of blindness was maintained and might mediate the prevailing auditory processing advantages in congenital cataract reversal individuals. By contrast, auditory and visual motion processing do not seem to compete for the same neural resources. We speculate that incomplete visual recovery is due to impaired neural network turning which seems to depend on early visual input. The present results demonstrate a privilege of the first arriving input for shaping neural circuits mediating both auditory and visual functions.

Cognition modulates action-to-perception transfer in ambiguous perception.

Can cognition penetrate action-to-perception transfer? Participants observed a structure-from-motion cylinder of ambiguous rotation direction. Beforehand, they experienced one of two mechanical models: An unambiguous cylinder was connected to a rod by either a belt (cylinder and rod rotating in the same direction) or by gears (both rotating in opposite directions). During ambiguous cylinder presentation, mechanics and rod were invisible, making both conditions visually identical. Observers inferred the rod's direction from their moment-by-moment subjective perceptual interpretation of the ambiguous cylinder. They reported the (hidden) rod's direction by rotating a manipulandum in either the same or the opposite direction. With respect to their effect on perceptual stability, the resulting match/nonmatch between perceived cylinder rotation and manipulandum rotation showed a significant interaction with the cognitive model they had previously been biased with. For the "belt" model, congruency between cylinder perception and manual action is induced by same-direction report. Here, we found that same-direction movement stabilized the perceived motion direction, replicating a known congruency effect. For the "gear" model, congruency between perception and action is-in contrast-induced by opposite-direction report. Here, no effect of perception-action congruency was found: Perceptual congruency and cognitive model nullified each other. Hence, an observer's internal model of a machine's operation guides action-to-perception transfer.

Pigeons use distinct stop phases to control pecking.

Pecking at small targets requires accurate spatial coordination of the head. Planning of the peck has been proposed to occur in two distinct stop phases, but although this idea has now been around for a long time, the specific functional roles of these stop phases remain unsolved. Here, we investigated the characteristics of the two stop phases using high-speed motion capture and examined their functions with two experiments. In experiment 1, we tested the hypothesis that the second stop phase is used to pre-program the final approach to a target and analyzed head movements while pigeons (Columba livia) pecked at targets of different size. Our results show that the duration of both stop phases significantly increased as stimulus size decreased. We also found significant positive correlations between stimulus size and the distances of the beaks to the stimulus during both stop phases. In experiment 2, we used a two-alternative forced choice task with different levels of difficulty to test the hypothesis that the first stop phase is used to decide between targets. The results indicate that the characteristics of the stop phases do not change with an increasing difficulty between the two choices. Therefore, we conclude that the first stop phase is not exclusively used to decide upon a target to peck at, but also contributes to the function of the second stop phase, which is improving pecking accuracy and planning the final approach to the target.

Functional characterisation of the chromatically antagonistic photosensitive mechanism of erythrophores in the tilapia Oreochromis niloticus.

Non-visual photoreceptors with diverse photopigments allow organisms to adapt to changing light conditions. Whereas visual photoreceptors are involved in image formation, non-visual photoreceptors mainly undertake various non-image-forming tasks. They form specialised photosensory systems that measure the quality and quantity of light and enable appropriate behavioural and physiological responses. Chromatophores are dermal non-visual photoreceptors directly exposed to light and they not only receive ambient photic input but also respond to it. These specialised photosensitive pigment cells enable animals to adjust body coloration to fit environments, and play an important role in mate choice, camouflage and ultraviolet (UV) protection. However, the signalling pathway underlying chromatophore photoresponses and the physiological importance of chromatophore colour change remain under-investigated. Here, we characterised the intrinsic photosensitive system of red chromatophores (erythrophores) in tilapia. Like some non-visual photoreceptors, tilapia erythrophores showed wavelength-dependent photoresponses in two spectral regions: aggregations of inner pigment granules under UV and short-wavelengths and dispersions under middle- and long-wavelengths. The action spectra curve suggested that two primary photopigments exert opposite effects on these light-driven processes: SWS1 (short-wavelength sensitive 1) for aggregations and RH2b (rhodopsin-like) for dispersions. Both western blot and immunohistochemistry showed SWS1 expression in integumentary tissues and erythrophores. The membrane potential of erythrophores depolarised under UV illumination, suggesting that changes in membrane potential are required for photoresponses. These results suggest that SWS1 and RH2b play key roles in mediating intrinsic erythrophore photoresponses in different spectral ranges and this chromatically dependent antagonistic photosensitive mechanism may provide an advantage to detect subtle environmental photic change.

What causes the facing-the-viewer bias in biological motion?

Orthographically projected biological motion point-light displays are generally ambiguous with respect to their orientation in depth, yet observers consistently prefer the facing-the-viewer interpretation. There has been discussion as to whether this bias can be attributed to the social relevance of biological motion stimuli or relates to local, low-level stimulus properties. In the present study we address this question. In Experiment 1, we compared the facing-the-viewer bias produced by a series of four stick figures and three human silhouettes that differed in posture, gender, and the presence versus absence of walking motion. Using a paradigm in which we asked observers to indicate the spinning direction of these figures, we found no bias when participants observed silhouettes, whereas a pronounced degree of bias was elicited by most stick figures. We hypothesized that the ambiguous surface normals on the lines and dots that comprise stick figures are prone to a visual bias that assumes surfaces to be convex. The local surface orientations of the occluding contours of silhouettes are unambiguous, and as such the convexity bias does not apply. In Experiment 2, we tested the role of local features in ambiguous surface perception by adding dots to the elbows and knees of silhouettes. We found biases consistent with the facing directions implied by a convex body surface. The results unify a number of findings regarding the facing-the-viewer bias. We conclude that the facing-the-viewer bias is established at the level of surface reconstruction from local image features rather than on a semantic level.

High complexity of aquatic irradiance may have driven the evolution of four-dimensional colour vision in shallow-water fish.

Humans use three cone photoreceptor classes for colour vision, yet many birds, reptiles and shallow-water fish are tetrachromatic and use four cone classes. Screening pigments, which narrow the spectrum of photoreceptors in birds and diurnal reptiles, render visual systems with four cone classes more efficient. To date, however, the question of tetrachromacy in shallow-water fish that, like humans, lack screening pigments, is still unsolved. We raise the possibility that tetrachromacy in fish has evolved in response to higher spectral complexity of underwater light. We compared the dimensionality of colour vision in humans and fish by examining the spectral complexity of the colour signal reflected from objects into their eyes. We show that fish require four to six cone classes to reconstruct the colour signal of aquatic objects at the accuracy level achieved by humans viewing terrestrial objects. This is because environmental light, which alters the colour signals, is more complex and contains more spectral fluctuations underwater than on land. We further show that fish cones are better suited than human cones to detect these spectral fluctuations, suggesting that the capability of fish cones to detect high-frequency fluctuations in the colour signal confers an advantage. Taken together, we propose that tetrachromacy in fish has evolved to enhance the reconstruction of complex colour signals in shallow aquatic environments. Of course, shallow-water fish might possess fewer than four cone classes; however, this would come with the inevitable loss in accuracy of signal reconstruction.

Adapting to inversion of the visual field: a new twist on an old problem.

While sensorimotor adaptation to prisms that displace the visual field takes minutes, adapting to an inversion of the visual field takes weeks. In spite of a long history of the study, the basis of this profound difference remains poorly understood. Here, we describe the computational issue that underpins this phenomenon and presents experiments designed to explore the mechanisms involved. We show that displacements can be mastered without altering the updated rule used to adjust the motor commands. In contrast, inversions flip the sign of crucial variables called sensitivity derivatives-variables that capture how changes in motor commands affect task error and therefore require an update of the feedback learning rule itself. Models of sensorimotor learning that assume internal estimates of these variables are known and fixed predicted that when the sign of a sensitivity derivative is flipped, adaptations should become increasingly counterproductive. In contrast, models that relearn these derivatives predict that performance should initially worsen, but then improve smoothly and remain stable once the estimate of the new sensitivity derivative has been corrected. Here, we evaluated these predictions by looking at human performance on a set of pointing tasks with vision perturbed by displacing and inverting prisms. Our experimental data corroborate the classic observation that subjects reduce their motor errors under inverted vision. Subjects' accuracy initially worsened and then improved. However, improvement was jagged rather than smooth and performance remained unstable even after 8 days of continually inverted vision, suggesting that subjects improve via an unknown mechanism, perhaps a combination of cognitive and implicit strategies. These results offer a new perspective on classic work with inverted vision.

Zoom disrupts eye contact behaviour: problems and solutions.

Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.

Life Detection From Biological Motion.

Life motion, the active movements of people and other animals, contains a wealth of information that is potentially accessible to the visual system of an observer. Biological-motion point-light displays have been widely used to study both the information contained in life motion stimuli and the visual mechanisms that make use of it. Biological motion conveys motion-mediated dynamic shape, which in turn can be used for identification and recognition of the agent, but it also contains local visual invariants that humans and other animals use as a general detection system that signals the presence of other agents in the visual environment. Here, we review recent research on behavioral, neurophysiological, and genetic aspects of this life-detection system and discuss its functional significance in the light of earlier hypotheses.

Electrophysiological and behavioral indicators of musical knowledge about unfamiliar music.

Most listeners possess sophisticated knowledge about the music around them without being aware of it or its intricacies. Previous research shows that we develop such knowledge through exposure. This knowledge can then be assessed using behavioral and neurophysiological measures. It remains unknown however, which neurophysiological measures accompany the development of musical long-term knowledge. In this series of experiments, we first identified a potential ERP marker of musical long-term knowledge by comparing EEG activity following musically unexpected and expected tones within the context of known music (n = 30). We then validated the marker by showing that it does not differentiate between such tones within the context of unknown music (n = 34). In a third experiment, we exposed participants to unknown music (n = 40) and compared EEG data before and after exposure to explore effects of time. Although listeners' behavior indicated musical long-term knowledge, we did not find any effects of time on the ERP marker. Instead, the relationship between behavioral and EEG data suggests musical long-term knowledge may have formed before we could confirm its presence through behavioral measures. Listeners are thus not only knowledgeable about music but seem to also be incredibly fast music learners.

Human (but not animal) motion can be recognized at first sight - After treatment for congenital blindness.

The long-standing nativist vs. empiricist debate asks a foundational question in epistemology - does our knowledge arise through experience or is it available innately? Studies that probe the sensitivity of newborns and patients recovering from congenital blindness are central in informing this dialogue. One of the most robust sensitivities our visual system possesses is to 'biological motion' - the movement patterns of humans and other vertebrates. Various biological motion perception skills (such as distinguishing between movement of human and non-human animals, or between upright and inverted human movement) become evident within the first months of life. The mechanisms of acquiring these capabilities, and specifically the contribution of visual experience to their development, are still under debate. We had the opportunity to directly examine the role of visual experience in biological motion perception, by testing what level of sensitivity is present immediately upon onset of sight following years of congenital visual deprivation. Two congenitally blind patients who underwent sight-restorative cataract-removal surgery late in life (at the ages of 7 and 20 years) were tested before and after sight restoration. The patients were shown displays of walking humans, pigeons, and cats, and asked to describe what they saw. Visual recognition of movement patterns emerged immediately upon eye-opening following surgery, when the patients spontaneously began to identify human, but not animal, biological motion. This recognition ability was evident contemporaneously for upright and inverted human displays. These findings suggest that visual recognition of human motion patterns may not critically depend on visual experience, as it was evident upon first exposure to un-obstructed sight in patients with very limited prior visual exposure, and furthermore, was not limited to the typical (upright) orientation of humans in real-life settings.