Perception, as you make it.

The main question that Firestone & Scholl (F&S) pose is whether "what and how we see is functionally independent from what and how we think, know, desire, act, and so forth" (sect. 2, para. 1). We synthesize a collection of concerns from an interdisciplinary set of coauthors regarding F&S's assumptions and appeals to intuition, resulting in their treatment of visual perception as context-free.

Meaningful sounds enhance visual sensitivity to human gait regardless of synchrony.

Previous research demonstrates that meaningfully related sounds enhance visual sensitivity to point-light displays of human movement. Here we report two psychophysical studies that investigated whether, and if so when, this facilitation is modulated by the temporal relationship between auditory and visual stimuli. In Experiment 1, participants detected point-light walkers in masks while listening to footsteps that were either synchronous or out-of-phase with point-light footfalls. The relative timing of auditory and visual walking did not impact performance. Experiment 2 further tested the importance of multisensory timing by disrupting the rhythm of the auditory and visual streams. Participants detected point-light walkers while listening to footstep or tone sounds that were either synchronous or temporally random with regards to point-light footfalls. Heard footsteps improved visual sensitivity over heard tones regardless of timing. Taken together, these results suggest that during the detection of others' actions, the perceptual system makes use of meaningfully related sounds whether or not they are synchronous. These results are discussed in relation to the unity assumption theory as well as recent empirical data that suggest that temporal correspondence is not always a critical factor in multisensory perception and integration.

Expecting to lift a box together makes the load look lighter.

The action abilities of an individual observer modulate his or her perception of spatial properties of the environment and of objects. The present study investigated how joint action abilities shape perception. Four experiments examined how the intention to lift an object with another individual affects perceived weight. In Experiments 1, 2a, and 2b, participants judged the perceived weight of boxes while expecting to lift them either alone or with a co-actor. In Experiment 3, the co-actor was healthy or injured. Participants intending to lift a box with a co-actor perceived the box as lighter than participants intending to lift the same box alone, provided that the co-actor appeared healthy and therefore capable of helping. These findings suggest that anticipated effort modulates the perception of object properties in the context of joint action. We discuss implications for the role of action prediction and action simulation processes in social interaction.

Lesions to the motor system affect action perception.

Several studies have shown that the motor system is involved in action perception, suggesting that action concepts are represented through sensory-motor processes. Such conclusions imply that motor system impairments should diminish action perception. To test this hypothesis, a group of 10 brain-damaged patients with hemiplegia (specifically, a lesion at the motor system that affected the contralesional arm) viewed point-light displays of arm gestures and attempted to name each gesture. To create the dynamic stimuli, patients individually performed simple gestures with their unaffected arm while being videotaped. The videotapes were converted into point-light animations. Each action was presented as it had been performed, that is, as having been produced by the observer's unaffected arm, and in its mirror reversed orientation, that is, as having been produced by the observer's hemiplegic arm. Action recognition accuracy by patients with hemiplegia was compared with that by 8 brain-damaged patients without any motor deficit and by 10 healthy controls. Overall, performance was better in control observers than in patients. Most importantly, performance by hemiplegic patients, but not by nonhemiplegic patients and controls, varied systematically as a function of the observed limb. Action recognition was best when hemiplegic patients viewed actions that appeared to have been performed by their unaffected arm. Action recognition performance dropped significantly when hemiplegic patients viewed actions that appeared to have been produced with their hemiplegic arm or the corresponding arm of another person. The results of a control study involving the recognition of point-light defined animals in motion indicate that a generic deficit to visual and cognitive functions cannot account for this laterality-specific deficit in action recognition. Taken together, these results suggest that motor cortex impairment decreases visual sensitivity to human action. Specifically, when a cortical lesion renders an observer incapable of performing an observed action, action perception is compromised, possibly by a failure to map the observed action onto the observer's contralesional hemisoma.

I can see you better if I can hear you coming: action-consistent sounds facilitate the visual detection of human gait.

Observers are remarkably sensitive to point-light displays of human movement. The Superior Temporal Sulcus (STS) and premotor cortex are implicated in the visual perception of point-light human actions and the integration of perceptual signals across modalities. These neurophysiological findings suggest that auditory information might impact visual sensitivity to point-light displays of human actions. Previous research has demonstrated that coincident, action-consistent sounds enhance visual sensitivity to the presence of coherent point-light displays of human movement. Here we ask whether visual detection sensitivity is modulated specifically by the meaningfulness of sounds that are coincident with observed point-light actions. To test this hypothesis, two psychophysical studies were conducted wherein participants detected the presence of coherent point-light walkers in a mask under unimodal or audiovisual conditions. Participants in audiovisual conditions heard either tones or actual footfalls coincident with the seen walkers' footsteps. Detection sensitivity increased when visual displays were paired with veridical auditory cues (footfalls), but not when paired with simple tones. The footfall advantage disappeared when the visual stimuli were inverted. These results suggest that the visual system makes use of auditory cues during the visual analysis of human action when there is a meaningful match between the auditory and visual cues.

Viewpoint and the recognition of people from their movements.

Observers can recognize other people from their movements. What is interesting is that observers are best able to recognize their own movements. Enhanced visual sensitivity to self-generated movement may reflect the contribution of motor planning processes to the visual analysis of human action. An alternative view is that enhanced visual sensitivity to self-motion results from extensive experience seeing one's own limbs move. To investigate this alternative explanation, participants viewed point-light actors from first-person egocentric and third-person allocentric viewpoints. Although observers routinely see their own actions from the first-person view, participants were unable to identify egocentric views of their own actions. Conversely, with little real-world experience seeing themselves from third-person views, participants readily identified their own actions from allocentric views. When viewing allocentric displays, participants accurately identified both front and rear views of their own actions. Because people have little experience observing themselves from behind or from third-person views, these findings suggest that visual learning cannot account for enhanced visual sensitivity to self-generated action.

Detecting deception in a bluffing body: the role of expertise.

Studies of deception detection traditionally have focused on verbal communication. Nevertheless, people commonly deceive others through nonverbal cues. Previous research has shown that intentions can be inferred from the ways in which people move their bodies. Furthermore, motor expertise within a given domain has been shown to increase visual sensitivity to other people's movements within that domain. Does expertise also enhance deception detection from bodily movement? In two psychophysical studies, experienced basketball players and novices attempted to distinguish deceptive intentions (fake passes) and veridical intentions (true passes) from an observed individual's actions. Whereas experts and novices performed similarly with postural cues, only experts could detect deception from kinematics alone. These results demonstrate a link between action expertise and the detection of nonverbal deception.

Neural activity involved in the perception of human and meaningful object motion.

We characterized magnetoencephalographic responses during observation of point-light displays of human and object motion. Time courses of grand-mean source estimates were computed and time frequency maps were calculated. For both conditions, activity began in the posterior occipital and mid-parietal areas. Further, late peaks were observed in the parietal, sensory-motor and left temporal regions. Only observation of human motion resulted in activation of the right temporal area. Both viewing conditions resulted in alpha and beta event-related desynchronization over the parietal, sensory-motor and temporal areas. A significant increase in beta activity was seen in the posterior temporal region in the human motion condition. The visual analyses of human and object motion appear to involve both overlapping and divergent patterns of neural activity.

Perceptual-motor deficits in children with Down syndrome: implications for intervention.

Early intervention approaches for facilitating motor development in infants and children with Down syndrome have traditionally emphasised the acquisition of motor milestones. As increasing evidence suggests that motor milestones have limited predictive power for long-term motor outcomes, researchers have shifted their focus to understanding the underlying perceptual-motor competencies that influence motor behaviour in Down syndrome. This paper outlines a series of studies designed to evaluate the nature and extent of perceptual-motor impairments present in children with Down syndrome. 12 children with Down syndrome between the ages of 8-15 years with adaptive ages between 3-7 years (mean age = 5.6 years +/- 1.45 years) and a group of 12 typically developing children between the ages of 4-8 years (mean age = 5.4 +/- 1.31 years) were tested on their ability to make increasingly complex perceptual discriminations of motor behaviours. The results indicate that children with Down syndrome are able to make basic perceptual discriminations but show impairments in the perception of complex visual motion cues. The implications of these results for early intervention are discussed.

Impaired perception of biological motion in Parkinson's disease.

OBJECTIVE: We examined biological motion perception in Parkinson's disease (PD). Biological motion perception is related to one's own motor function and depends on the integrity of brain areas affected in PD, including posterior superior temporal sulcus. If deficits in biological motion perception exist, they may be specific to perceiving natural/fast walking patterns that individuals with PD can no longer perform, and may correlate with disease-related motor dysfunction. METHOD: Twenty-six nondemented individuals with PD and 24 control participants viewed videos of point-light walkers and scrambled versions that served as foils, and indicated whether each video depicted a human walking. Point-light walkers varied by gait type (natural, parkinsonian) and speed (0.5, 1.0, 1.5 m/s). Participants also completed control tasks (object motion, coherent motion perception), a contrast sensitivity assessment, and a walking assessment. RESULTS: The PD group demonstrated significantly less sensitivity to biological motion than the control group (p < .001, Cohen's d = 1.22), regardless of stimulus gait type or speed, with a less substantial deficit in object motion perception (p = .02, Cohen's d = .68). There was no group difference in coherent motion perception. Although individuals with PD had slower walking speed and shorter stride length than control participants, gait parameters did not correlate with biological motion perception. Contrast sensitivity and coherent motion perception also did not correlate with biological motion perception. CONCLUSION: PD leads to a deficit in perceiving biological motion, which is independent of gait dysfunction and low-level vision changes, and may therefore arise from difficulty perceptually integrating form and motion cues in posterior superior temporal sulcus. (PsycINFO Database Record

An attentional bias for thin bodies and its relation to body dissatisfaction.

Research suggests that humans have an attentional bias for the rapid detection of emotionally valenced stimuli, and that such a bias might be shaped by clinical psychological states. The current research extends this work to examine the relation between body dissatisfaction and an attentional bias for thin/idealized body shapes. Across two experiments, undergraduates completed a gender-consistent body dissatisfaction measure, and a dot-probe paradigm to measure attentional biases for thin versus heavy bodies. Results indicated that men (n=21) and women (n=18) show an attentional bias for bodies that correspond to their own gender (Experiment 1), and that high body dissatisfaction among men (n=69) and women (n=89) predicts an attentional bias for thin same-gender bodies after controlling for body mass index (BMI) (Experiment 2). This research provides a new direction for studying the attentional and cognitive underpinnings of the relation between body dissatisfaction and eating disorders.

Walking perception by walking observers.

People frequently analyze the actions of other people for the purpose of action coordination. To understand whether such self-relative action perception differs from other-relative action perception, the authors had observers either compare their own walking speed with that of a point-light walker or compare the walking speeds of 2 point-light walkers. In Experiment 1, observers walked, bicycled, or stood while performing a gait-speed discrimination task. Walking observers demonstrated the poorest sensitivity to walking speed, suggesting that perception and performance of the same action alters visual-motion processes. Experiments 2-6 demonstrated that the processes used during self-relative and other-relative action perception differ significantly in their dependence on observers' previous motor experience, current motor effort, and potential for action coordination. These results suggest that the visual analysis of human motion during traditional laboratory studies can differ substantially from the visual analysis of human movement under more realistic conditions.

Recognizing people from their movement.

Human observers demonstrate impressive visual sensitivity to human movement. What defines this sensitivity? If motor experience influences the visual analysis of action, then observers should be most sensitive to their own movements. If view-dependent visual experience determines visual sensitivity to human movement, then observers should be most sensitive to the movements of their friends. To test these predictions, participants viewed sagittal displays of point-light depictions of themselves, their friends, and strangers performing various actions. In actor identification and discrimination tasks, sensitivity to one's own motion was highest. Visual sensitivity to friends', but not strangers', actions was above chance. Performance was action dependent. Control studies yielded chance performance with inverted and static displays, suggesting that form and low-motion cues did not define performance. These results suggest that both motor and visual experience define visual sensitivity to human action.

Experience, context, and the visual perception of human movement.

Why are human observers particularly sensitive to human movement? Seven experiments examined the roles of visual experience and motor processes in human movement perception by comparing visual sensitivities to point-light displays of familiar, unusual, and impossible gaits across gait-speed and identity discrimination tasks. In both tasks, visual sensitivity to physically possible gaits was superior to visual sensitivity to physically impossible gaits, supporting perception-action coupling theories of human movement perception. Visual experience influenced walker-identity perception but not gait-speed discrimination. Thus, both motor experience and visual experience define visual sensitivity to human movement. An ecological perspective can be used to define the conditions necessary for experience-dependent sensitivity to human movement.

Socially tuned: brain responses differentiating human and animal motion.

Typical adult observers demonstrate enhanced behavioral sensitivity to human movement compared to animal movement. Yet, the neural underpinnings of this effect are unknown. We examined the tuning of brain mechanisms for the perception of biological motion to the social relevance of this category of motion by comparing neural response to human and non-human biological motion. In particular, we tested the hypothesis that the response of the right posterior superior temporal sulcus (pSTS) varies according to the social relevance of the motion, responding most strongly to those biological motions with the greatest social relevance (human > dog). During a functional magnetic resonance imaging (fMRI) session, typical adults viewed veridical point-light displays of human, dog, and tractor motions created from motion capture data. A conjunction analysis identified regions of significant activation during biological motion perception relative to object motion. Within each of these regions, only one brain area, the right pSTS, revealed an enhanced response to human motion relative to dog motion. This finding demonstrates that the pSTS response is sensitive to the social relevance of a biological motion stimulus.

People watching: visual, motor, and social processes in the perception of human movement.

Successful social behavior requires the accurate perception and interpretation of other peoples' actions. In the last decade, significant progress has been made in understanding how the human visual system analyzes bodily motion. Neurophysiological studies have identified two neural areas, the superior temporal sulcus (STS) and the premotor cortex, which play key roles in the visual perception of human movement. Patterns of neural activity in these areas are reflective of psychophysical measures of visual sensitivity to human movement. Both vary as a function of stimulus orientation and global stimulus structure. Human observers and STS responsiveness share some developmental similarities as both exhibit sensitivities that become increasingly tuned for upright, human movement. Furthermore, the observer's own visual and motor experience with an action as well as the social and emotional content of that action influence behavioral measures of visual sensitivity and patterns of neural activity in the STS and premotor cortex. Finally, dysfunction of motor processes, such as hemiplegia, and dysfunction of social processes, such as Autism, systematically impact visual sensitivity to human movement. In sum, a convergence of visual, motor, and social processes underlies our ability to perceive and interpret the actions of other people. WIREs Cogn Sci 2011 2 68-78 DOI: 10.1002/wcs.88 For further resources related to this article, please visit the WIREs website.

Comparison of visual sensitivity to human and object motion in autism spectrum disorder.

Successful social behavior requires the accurate detection of other people's movements. Consistent with this, typical observers demonstrate enhanced visual sensitivity to human movement relative to equally complex, nonhuman movement [e.g., Pinto & Shiffrar, 2009]. A psychophysical study investigated visual sensitivity to human motion relative to object motion in observers with autism spectrum disorder (ASD). Participants viewed point-light depictions of a moving person and, for comparison, a moving tractor and discriminated between coherent and scrambled versions of these stimuli in unmasked and masked displays. There were three groups of participants: young adults with ASD, typically developing young adults, and typically developing children. Across masking conditions, typical observers showed enhanced visual sensitivity to human movement while observers in the ASD group did not. Because the human body is an inherently social stimulus, this result is consistent with social brain theories [e.g., Pelphrey & Carter, 2008; Schultz, 2005] and suggests that the visual systems of individuals with ASD may not be tuned for the detection of socially relevant information such as the presence of another person. Reduced visual sensitivity to human movements could compromise important social behaviors including, for example, gesture comprehension.

The visual perception of human and animal motion in point-light displays.

Mounting neurophysiological evidence indicates that the visual analysis of human movement differs from the visual analysis of other categories of complex movement. If different patterns of neural activity underlie visual percepts of human and nonhuman movement, then psychophysical measures should elucidate different patterns of visual sensitivity to human movement and similarly complex, but nonhuman movement. To test this prediction, two psychophysical studies compared visual sensitivity to human and animal motions. Using a simultaneous masking paradigm, observers performed a coherent motion detection task with point-light displays of human and horse gait, presented upright and inverted. While task performance indicated the use of configural processing during the detection of both human and horse motion, observers demonstrated greater visual sensitivity to coherent human motion than coherent horse motion. Recent experience influenced orientation dependence for both types of motion. Together with previous neurophysiological findings, these psychophysical results suggest that the visual perception of human movement is both distinct from and shares commonalities with the visual perception of similarly complex, nonhuman movement.

The visual perception of motion by observers with autism spectrum disorders: a review and synthesis.

Traditionally, psychological research on autism spectrum disorder (ASD) has focused on social and cognitive abilities. Vision provides an important input channel to both of these processes, and, increasingly, researchers are investigating whether observers with ASD differ from typical observers in their visual percepts. Recently, significant controversies have arisen over whether observers with ASD differ from typical observers in their visual analyses of movement. Initial studies suggested that observers with ASD experience significant deficits in their visual sensitivity to coherent motion in random dot displays but not to point-light displays of human motion. More recent evidence suggests exactly the opposite: that observers with ASD do not differ from typical observers in their visual sensitivity to coherent motion in random dot displays, but do differ from typical observers in their visual sensitivity to human motion. This review examines these apparently conflicting results, notes gaps in previous findings, suggests a potentially unifying hypothesis, and identifies areas ripe for future research.

Rolling perception without rolling motion.

The texture of a rolling circle depicts the translational and rotational components of its motion. In the case of a homogeneous circle, however, visual cues to the rotational component of motion are absent. To examine how the visual system resolves undetermined motion cues, optically neutral circles were displaced so that changes in their orientation were invisible. Contextual cues systematically triggered the perception of illusory rotation, suggesting that the visual system uses contextual cues along with intrinsic surface cues to compute percepts of rolling objects. This might also explain why people rarely experience the perception of ambiguous motion.