Three-Dimensional Representations of Objects in Dorsal Cortex are Dissociable from Those in Ventral Cortex.

An established conceptualization of visual cortical function is one in which ventral regions mediate object perception while dorsal regions support spatial information processing and visually guided action. This division has been contested by evidence showing that dorsal regions are also engaged in the representation of object shape, even when actions are not required. The critical question is whether these dorsal, object-based representations are dissociable from ventral representations, and whether they play a functional role in object recognition. We examined the neural and behavioral profile of patients with impairments in object recognition following ventral cortex damage. In a functional magnetic resonanace imaging experiment, the blood oxygen level-dependent response in the ventral, but not dorsal, cortex of the patients evinced less sensitivity to object 3D structure compared with that of healthy controls. Consistently, in psychophysics experiments, the patients exhibited significant impairments in object perception, but still revealed residual sensitivity to object-based structural information. Together, these findings suggest that, although in the intact system there is considerable crosstalk between dorsal and ventral cortices, object representations in dorsal cortex can be computed independently from those in ventral cortex. While dorsal representations alone are unable to support normal object perception, they can, nevertheless, support a coarse description of object structural information.

Impossible expectations: fMRI adaptation in the lateral occipital complex (LOC) is modulated by the statistical regularities of 3D structural information.

fMRI adaptation (fMRIa), the attenuation of fMRI signal which follows repeated presentation of a stimulus, is a well-documented phenomenon. Yet, the underlying neural mechanisms supporting this effect are not fully understood. Recently, short-term perceptual expectations, induced by specific experimental settings, were shown to play an important modulating role in fMRIa. Here we examined the role of long-term expectations, based on 3D structural statistical regularities, in the modulation of fMRIa. To this end, human participants underwent fMRI scanning while performing a same-different task on pairs of possible (regular, expected) objects and spatially impossible (irregular, unexpected) objects. We hypothesized that given the spatial irregularity of impossible objects in relation to real-world visual experience, the visual system would always generate a prediction which is biased to the possible version of the objects. Consistently, fMRIa effects in the lateral occipital cortex (LOC) were found for possible, but not for impossible objects. Additionally, in alternating trials the order of stimulus presentation modulated LOC activity. That is, reduced activation was observed in trials in which the impossible version of the object served as the prime object (i.e. first object) and was followed by the possible version compared to the reverse order. These results were also supported by the behavioral advantage observed for trials that were primed by possible objects. Together, these findings strongly emphasize the importance of perceptual expectations in object representation and provide novel evidence for the role of real-world statistical regularities in eliciting fMRIa.

Increased visual interest and affective responses to impossible figures in early infancy.

This research evaluated infants' facial expressions as they viewed pictures of possible and impossible objects on a TV screen. Previous studies in our lab demonstrated that four-month-old infants looked longer at the impossible figures and fixated to a greater extent within the problematic region of the impossible shape, suggesting they were sensitive to novel or unusual object geometry. Our work takes studies of looking time data a step further, determining if increased looking co-occurs with facial expressions associated with increased visual interest and curiosity, or even puzzlement and surprise. We predicted that infants would display more facial expressions consistent with either "interest" or "surprise" when viewing the impossible objects relative to possible ones, which would provide further evidence of increased perceptual processing due to incompatible spatial information. Our results showed that the impossible cubes evoked both longer looking times and more reactive expressions in the majority of infants. Specifically, the data revealed significantly greater frequency of raised eyebrows, widened eyes and returns to looking when viewing impossible figures with the most robust effects occurring after a period of habituation. The pattern of facial expressions were consistent with the "interest" family of facial expressions and appears to reflect infants' ability to perceive systematic differences between matched pairs of possible and impossible objects as well as recognize novel geometry found in impossible objects. Therefore, as young infants are beginning to register perceptual discrepancies in visual displays, their facial expressions may reflect heightened attention and increased information processing associated with identifying irreconcilable contours in line drawings of objects. This work further clarifies the ongoing formation and development of early mental representations of coherent 3D objects.

Evidence for similar early but not late representation of possible and impossible objects.

The perceptual processes that mediate the ability to efficiently represent object 3D structure are still not fully understood. The current study was aimed to shed light on these processes by utilizing spatially possible and impossible objects that could not be created in real 3D space. Despite being perceived as exceptionally unusual, impossible objects still possess fundamental Gestalt attributes and valid local depth cues that may support their initial successful representation. Based on this notion and on recent findings from our lab, we hypothesized that the initial representation of impossible objects would involve common mechanisms to those mediating typical object perception while the perceived differences between possible and impossible objects would emerge later along the processing hierarchy. In Experiment 1, participants preformed same/different classifications of two markers superimposed on a display containing two objects (possible or impossible). Faster reaction times were observed for displays in which the markers were superimposed on the same object ("object-based benefit"). Importantly, this benefit was similar for possible and impossible objects, suggesting that the representations of the two object categories rely on similar perceptual organization processes. Yet, responses for impossible objects were slower compared to possible objects. Experiment 2 was designed to examine the origin of this effect. Participants classified the location of two markers while exposure duration was manipulated. A similar pattern of performance was found for possible and impossible objects for the short exposure duration, with differences in accuracy between these two types of objects emerging only for longer exposure durations. Overall, these findings provide evidence that the representation of object structure relies on a multi-level process and that object impossibility selectively impairs the rendering of fine-detailed description of object structure.

Drawing skill is related to the efficiency of encoding object structure.

Accurate drawing calls on many skills beyond simple motor coordination. A good internal representation of the target object's structure is necessary to capture its proportion and shape in the drawing. Here, we assess two aspects of the perception of object structure and relate them to participants' drawing accuracy. First, we assessed drawing accuracy by computing the geometrical dissimilarity of their drawing to the target object. We then used two tasks to evaluate the efficiency of encoding object structure. First, to examine the rate of temporal encoding, we varied presentation duration of a possible versus impossible test object in the fovea using two different test sizes (8° and 28°). More skilled participants were faster at encoding an object's structure, but this difference was not affected by image size. A control experiment showed that participants skilled in drawing did not have a general advantage that might have explained their faster processing for object structure. Second, to measure the critical image size for accurate classification in the periphery, we varied image size with possible versus impossible object tests centered at two different eccentricities (3° and 8°). More skilled participants were able to categorise object structure at smaller sizes, and this advantage did not change with eccentricity. A control experiment showed that the result could not be attributed to differences in visual acuity, leaving attentional resolution as a possible explanation. Overall, we conclude that drawing accuracy is related to faster encoding of object structure and better access to crowded details.

Holistic processing of impossible objects: evidence from Garner's speeded-classification task.

Holistic processing, the decoding of the global structure of a stimulus while the local parts are not explicitly represented, is a basic characteristic of object perception. The current study was aimed to test whether such a representation could be created even for objects that violate fundamental principles of spatial organization, namely impossible objects. Previous studies argued that these objects cannot be represented holistically in long-term memory because they lack coherent 3D structure. Here, we utilized Garner's speeded classification task to test whether the perception of possible and impossible objects is mediated by similar holistic processing mechanisms. To this end, participants were asked to make speeded classifications of one object dimension while an irrelevant dimension was kept constant (baseline condition) or when this dimension varied (filtering condition). It is well accepted that ignoring the irrelevant dimension is impossible when holistic perception is mandatory, thus the extent of Garner interference in performance between the baseline and filtering conditions serves as an index of holistic processing. Critically, in Experiment 1, similar levels of Garner interference were found for possible and impossible objects implying holistic perception of both object types. Experiment 2 extended these results and demonstrated that even when depth information was explicitly processed, participants were still unable to process one dimension (width/depth) while ignoring the irrelevant dimension (depth/width, respectively). The results of Experiment 3 replicated the basic pattern found in Experiments 1 and 2 using a novel set of object exemplars. In Experiment 4, we used possible and impossible versions of the Penrose triangles in which information about impossibility is embedded in the internal elements of the objects which participant were explicitly asked to judge. As in Experiments 1-3, similar Garner interference was found for possible and impossible objects. Taken together, these findings emphasize the centrality of holistic processing style in object perception and suggest that it applies even for atypical stimuli such as impossible objects.

Oculomotor Exploration of Impossible Figures in Early Infancy.

Previous studies with young infants revealed that young infants can distinguish between displays of possible or impossible figures, which may require detection of inconsistent depth relations among local line junctions that disrupt global object configurations. Here, we used an eye-tracking paradigm to record eye movements in young infants during an object discrimination task with matched pairs of possible and impossible figures. Our goal was to identify differential patterns of oculomotor activity as infants viewed pictures of possible and impossible objects. We predicted that infants would actively attend to specific pictorial depth cues that denote shape (e.g., T-junctions), and in the context of an impossible figure that they would fixate to a greater extent in anomalous regions of the display relative to other parts. By the age of 4 months, infants fixated reliably longer overall on displays of impossible vs. possible cubes, specifically within the critical region where the incompatible lines and irreconcilable depth relations were located, implying an early capacity for selective attention to critical line junction information and integration of local depth cues necessary to perceive object coherence.