Metacognitive bias resulting from trade-off between local and global motion signals.

Visual confidence generally depends on performance in targeted perceptual tasks. However, it remains unclear how factors unrelated to performance affect confidence. Given the hierarchical nature of visual processing, both local and global stimulus features can influence confidence, but their strengths of influence remain unknown. To address this question, we independently manipulated the local contrast signals and the global coherence signals in a multiple-aperture motion pattern. The drifting-Gabor elements were individually manipulated to give rise to a coherent global motion percept. In both dichotomous direction-discrimination task (Experiment 1) and analog direction-judgment task (Experiment 2), we found stimulus-dependent biases in metacognition despite matched perceptual performance. Specifically, participants systematically gave higher confidence ratings to an incoherent pattern with clear elements (i.e., strong local but weak global signals) than a coherent pattern with noisy elements (i.e., weak local but strong global signals). We did not find any systematic effects of local/global stimulus features on metacognitive sensitivity. Model comparisons show that variation in local/global signals in the stimulus should be considered a factor influencing confidence, even after controlling for the effects of performance. Our results suggest that the metacognitive system, when generating confidence for a perceptual task, puts more weights on local than global signals.

Face masks are less effective than sunglasses in masking face identity.

The effect of covering faces on face identification is recently garnering interest amid the COVID-19 pandemic. Here, we investigated how face identification performance was affected by two types of face disguise: sunglasses and face masks. Observers studied a series of faces; then judged whether a series of test faces, comprising studied and novel faces, had been studied before or not. Face stimuli were presented either without coverings (full faces), wearing sunglasses covering the upper region (eyes, eyebrows), or wearing surgical masks covering the lower region (nose, mouth, chin). We found that sunglasses led to larger reductions in sensitivity (d') to face identity than face masks did, while both disguises increased the tendency to report faces as studied before, a bias that was absent for full faces. In addition, faces disguised during either study or test only (i.e. study disguised faces, test with full faces; and vice versa) led to further reductions in sensitivity from both studying and testing with disguised faces, suggesting that congruence between study and test is crucial for memory retrieval. These findings implied that the upper region of the face, including the eye-region features, is more diagnostic for holistic face-identity processing than the lower face region.

Incongruence in Lighting Impairs Face Identification.

The effect of uniform lighting on face identity processing is little understood, despite its potential influence on our ability to recognize faces. Here, we investigated how changes in uniform lighting level affected face identification performance during face memory tests. Observers were tasked with learning a series of faces, followed by a memory test where observers judged whether the faces presented were studied before or novel. Face stimuli were presented under uniform bright or dim illuminations, and lighting across the face learning and the memory test sessions could be the same ("congruent") or different ("incongruent"). This led to four experimental conditions: (1) Bright/Dim (learning bright faces, testing on dim faces); (2) Bright/Bright; (3) Dim/Bright; and (4) Dim/Dim. Our results revealed that incongruent lighting levels across sessions (Bright/Dim and Dim/Bright) significantly reduced sensitivity (d') to faces and introduced conservative biases compared to congruent lighting levels (Bright/Bright and Dim/Dim). No significant differences in performance were detected between the congruent lighting conditions (Bright/Bright vs. Dim/Dim) and between the incongruent lighting conditions (Bright/Dim vs. Dim/Bright). Thus, incongruent lighting deteriorated performance in face identification. These findings implied that the level of uniform lighting should be considered in an illumination-specific face representation and potential applications such as eyewitness testimony.

The roles of gaze and head orientation in face categorization during rapid serial visual presentation.

Little is known about how perceived gaze direction and head orientation may influence human categorization of visual stimuli as faces. To address this question, a sequence of unsegmented natural images, each containing a random face or a non-face object, was presented in rapid succession (stimulus duration: 91.7 ms per image) during which human observers were instructed to respond immediately to every face presentation. Faces differed in gaze and head orientation in 7 combinations - full-front views with perceived gaze (1) directed to the observer, (2) averted to the left, or (3) averted to the right, left ¾ side views with (4) direct gaze or (5) averted gaze, and right ¾ side views with (6) direct gaze or (7) averted gaze - were presented randomly throughout the sequence. We found highly accurate and rapid behavioural responses to all kinds of faces. Crucially, both perceived gaze direction and head orientation had comparable, non-interactive effects on response times, where direct gaze was responded faster than averted gaze by 48 ms and full-front view faster than ¾ side view also by 48 ms on average. Presentations of full-front faces with direct gaze led to an additive speed advantage of 96 ms to ¾ faces with averted gaze. The results reveal that the effects of perceived gaze direction and head orientation on the speed of face categorization probably depend on the degree of social relevance of the face to the viewer.

Does automatic human face categorization depend on head orientation?

Whether human categorization of visual stimuli as faces is optimal for full-front views, best revealing diagnostic features but lacking depth cues, remains largely unknown. To address this question, we presented 16 human observers with unsegmented natural images of different living and non-living objects at a fast rate (f = 12 Hz), with natural face images appearing at f/9 = 1.33 Hz. Faces posing all full-front or at ¾ side view angles appeared in separate sequences. Robust frequency-tagged 1.33 Hz (and harmonic) occipito-temporal electroencephalographic (EEG) responses reflecting face-selective neural activity did not differ in overall amplitude between full-front and ¾ side views. Despite this, alternating between full-front and ¾ side views within a sequence led to significant responses at specific harmonics of .67 Hz (f/18), objectively isolating view-dependent face-selective responses over occipito-temporal regions. Critically, a time-domain analysis showed that these view-dependent face-selective responses reflected only an earlier response to full-front than ¾ side views by 8-13 ms. Overall, these findings indicate that the face-selective neural representation is as robust for ¾ side faces as for full-front faces in the human brain, but full-front views provide a slightly earlier processing-time advantage as compared to rotated face views.

The contribution of color information to rapid face categorization in natural scenes.

Color's contribution to rapid categorization of natural images is debated. We examine its effect on high-level face categorization responses using fast periodic visual stimulation (Rossion et al., 2015). A high-density electroencephalogram (EEG) was recorded during presentation of sequences of natural object images every 83 ms (i.e., at F = 12.0 Hz). Natural face images were embedded in the sequence at a fixed interval of F/9 (1.33 Hz). There were four conditions: (a) full-color images; (b) grayscale images; and (c) and (d) phase-scrambled images from Conditions 1 and 2, respectively, making faces and objects unrecognizable. Observers' task was to respond to color changes of the fixation cross (Experiment 1). We found face-categorization responses at 1.33 Hz and its harmonics (2.67 Hz, etc.) over occipitotemporal areas, with right-hemisphere dominance; responses to color images were not significantly different from those to grayscale images. Behavioral analysis revealed longer response times when images contained color, despite nearly-all-correct performance in all conditions, suggesting that color change in the task might detract from color's contribution to face categorization. We subsequently changed the task to responding to fixation shape changes so that such response-time differences were eliminated (Experiment 2). The aggregate face-categorization response became 21.6% stronger to color than to grayscale images. This color advantage occurred late, at 290-415 ms after stimulus onset. Our results suggest that the color advantage for face categorization interacts with behavior, and that color only has a moderate and relatively late contribution to rapid face categorization in natural images.

Detection of periodic motion trajectories: Effects of frequency and radius.

Periodic trajectories are an important component of biological motion. Or, Thabet, Wilkinson, and Wilson (2011) studied radial frequency (RF) motion trajectory detection and concluded that, for RF2-5 trajectories, the threshold function paralleled that of static RF patterns. We have extended Or et al.'s (2011) findings to a broader range of RFs (three to 24 cycles) and across a 4-fold range of radii (1°-4°). We report that (a) thresholds for RF trajectories decrease as a power function of RF for low RF trajectories (three to six cycles) before approaching an asymptote at high RFs (12-24 cycles); (b) detection thresholds for RF trajectories scale proportionally with radius; and (c) there is no lower versus upper field advantage in the parafoveal field for stimuli displaced from fixation on the vertical midline. The results are compared to earlier findings for static RF thresholds, and we argue that our findings support the existence of parallel spatial and temporal processing channels that may contribute to both action perception and production.

Initial eye movements during face identification are optimal and similar across cultures.

Culture influences not only human high-level cognitive processes but also low-level perceptual operations. Some perceptual operations, such as initial eye movements to faces, are critical for extraction of information supporting evolutionarily important tasks such as face identification. The extent of cultural effects on these crucial perceptual processes is unknown. Here, we report that the first gaze location for face identification was similar across East Asian and Western Caucasian cultural groups: Both fixated a featureless point between the eyes and the nose, with smaller between-group than within-group differences and with a small horizontal difference across cultures (8% of the interocular distance). We also show that individuals of both cultural groups initially fixated at a slightly higher point on Asian faces than on Caucasian faces. The initial fixations were found to be both fundamental in acquiring the majority of information for face identification and optimal, as accuracy deteriorated when observers held their gaze away from their preferred fixations. An ideal observer that integrated facial information with the human visual system's varying spatial resolution across the visual field showed a similar information distribution across faces of both races and predicted initial human fixations. The model consistently replicated the small vertical difference between human fixations to Asian and Caucasian faces but did not predict the small horizontal leftward bias of Caucasian observers. Together, the results suggest that initial eye movements during face identification may be driven by brain mechanisms aimed at maximizing accuracy, and less influenced by culture. The findings increase our understanding of the interplay between the brain's aims to optimally accomplish basic perceptual functions and to respond to sociocultural influences.

Implicit face prototype learning from geometric information.

There is evidence that humans implicitly learn an average or prototype of previously studied faces, as the unseen face prototype is falsely recognized as having been learned (Solso & McCarthy, 1981). Here we investigated the extent and nature of face prototype formation where observers' memory was tested after they studied synthetic faces defined purely in geometric terms in a multidimensional face space. We found a strong prototype effect: The basic results showed that the unseen prototype averaged from the studied faces was falsely identified as learned at a rate of 86.3%, whereas individual studied faces were identified correctly 66.3% of the time and the distractors were incorrectly identified as having been learned only 32.4% of the time. This prototype learning lasted at least 1 week. Face prototype learning occurred even when the studied faces were further from the unseen prototype than the median variation in the population. Prototype memory formation was evident in addition to memory formation of studied face exemplars as demonstrated in our models. Additional studies showed that the prototype effect can be generalized across viewpoints, and head shape and internal features separately contribute to prototype formation. Thus, implicit face prototype extraction in a multidimensional space is a very general aspect of geometric face learning.

Increment thresholds for radial frequency trajectories produce a dipper function.

Radial frequency (RF) trajectories are a new class of stimuli that have been developed to study the visual perception of periodic motion (Or et al., 2011). These stimuli are described by a moving dot that traces a distorted path through space with periodic radial deformations whose frequency, amplitude, and phase can be independently specified. Here, we extend Or et al.'s findings by investigating how the discrimination of RF amplitude changes as a function of different reference amplitudes in a two-interval forced choice task. Using an RF3 trajectory (a pattern with three cycles of deformation along its trajectory), increment thresholds were measured at six different reference amplitudes: Detection (discriminating a circle from RF3), 1X (discriminating a pair of RF3 patterns, with the amplitude of one member of this pair set to (1X) threshold obtained from the detection condition), 2.5X, 5X, 10X, and 15X. Data show that sensitivity to changes in amplitude improves at 2.5X by a factor of about 2, recovers to detection threshold levels at 5X, and continues to rise at 10X and 15X. These results generalize across both radial frequency and the angular speed of the trajectory, and persist with low contrast trajectories. Our findings point to the existence of a neural mechanism that is sensitive to deviations from circular motion trajectories.

Oriented texture detection: ideal observer modelling and classification image analysis.

Perception of visual texture flows contributes to object segmentation, shape perception, and object recognition. To better understand the visual mechanisms underlying texture flow perception, we studied the factors limiting detection of simple forms of texture flows composed of local dot dipoles (Glass patterns) and related stimuli. To provide a benchmark for human performance, we derived an ideal observer for this task. We found that human detection thresholds were 8.0 times higher than ideal. We considered three factors that might account for this performance gap: (1) false matches between dipole dots (correspondence errors), (2) loss of sensitivity with increasing eccentricity, and (3) local orientation bandwidth. To estimate the effect of correspondence errors, we compared detection of Glass patterns with detection of matched line-segment stimuli, where no correspondence uncertainty exists. We found that eliminating correspondence errors reduced human thresholds by a factor of 1.8. We used a novel form of classification image analysis to directly estimate loss of sensitivity with eccentricity and local orientation bandwidth. Incorporating the eccentricity effects into the ideal observer model increased ideal thresholds by a factor of 2.9. Interestingly, estimated orientation bandwidth increased ideal thresholds by only 8%. Taking all three factors into account, human thresholds were only 58% higher than model thresholds. Our findings suggest that correspondence errors and eccentricity losses account for the great majority of the perceptual loss in the visual processing of Glass patterns.

Discrimination and identification of periodic motion trajectories.

Humans are extremely sensitive to radial deformations of static circular contours (F. Wilkinson, H. R. Wilson, & C. Habak, 1998). Here, we investigate detection and identification of periodic motion trajectories defined by these radial frequency (RF) patterns over a range of radial frequencies of 2-5 cycles. We showed that the average detection thresholds for RF trajectories range from 1 to 4 min of arc and performance improves as a power-law function of radial frequency. RF trajectories are also detected for a range of speeds. We also showed that spatiotemporal global processing is involved in trajectory detection, as improvement in detection performance with increasing radial deformation displayed cannot be accounted for by local probability summation. Finally, identification of RF trajectories is possible over this RF range. Overall thresholds are about 6 times higher than previously reported for static stimuli. These novel stimuli should be a useful tool to investigate motion trajectory learning and discrimination in humans and other primates.

Moving Glass patterns: asymmetric interaction between motion and form.

The perceived motion direction of a moving Glass pattern is influenced by the orientation of the dot pairs (dipoles) that generate the pattern (Krekelberg et al, 2003 Nature 424 674-677; Ross, 2004 Vision Research 44 441-448). Here, we investigate how the motion vector and the dipole orientation of moving Glass patterns influence the perceived orientation of each. We employed 1 s movie presentations of sequences of linear Glass patterns, each consisting of 200 dot pairs. Signal pairs, aligned in a common orientation, moved in a common direction. The observer's task was to indicate either the perceived direction of motion, or the perceived dipole orientation of Glass patterns that consisted of either same-polarity dipoles, or opposite-polarity dipoles. Perceived orientation or motion direction was measured as a function of the angular difference between the orientation and the motion direction of the dipoles. We found that the apparent global direction of motion was attracted by approximately 4 degrees towards the dipole orientation for small (15 degrees, 23 degrees) angular differences between dipole motion-direction and dipole orientation, regardless of dipole polarity. However, under the same stimulus conditions, the apparent global orientation was much less affected by the direction of motion, suggesting that motion and form interact asymmetrically Global form influences global motion-direction perception more powerfully than global motion influences global form perception.

Face recognition: Are viewpoint and identity processed after face detection?

Previous research has suggested that an object's category is retrieved as soon as it is detected (Grill-Spector & Kanwisher, 2005). Here we examined whether face views and identities are likewise treated as categories. We measured behavioural performance on three tasks: face detection, recognition of face view within identity, and within-view face identification, by using the method of constant stimuli combined with a two-alternative forced-choice (2AFC) paradigm. Stimulus duration was varied between 13 ms and 133 ms in order to estimate the time required for 75%-correct discrimination in each task. The results showed, respectively, 24- and 31-ms shorter threshold durations for face detection than for viewpoint recognition and face identification, while similar threshold durations for viewpoint recognition and face identification. We demonstrated that face view and identity are retrieved after face detection, and importantly, the view-based categorical analysis takes almost as long as the face identification process. Thus, additional processing is essential for viewpoint and identity extraction as opposed to face detection.

The role of luminance contrast in the detection of global structure in static and dynamic, same- and opposite-polarity, Glass patterns.

Perception of global structure conveyed in static Glass patterns is difficult, though not impossible, when the constituent dipoles are formed by partnering opposite polarity dots. We investigate whether the addition of motion signals to opposite-polarity Glass patterns can act to restore the perception of global structure. The stimuli were concentric Glass patterns consisting of 200 dipoles concentrically orientated, or oriented at random orientations, placed on a grey background. For each dipole, one luminance-increment dot (Weber contrast of 1) was paired with another dot set to a contrast ranging between luminance increment and luminance decrement (i.e., a Weber contrast range of approximately -1 to 1). Dipoles were either stationary (Experiment 1), or randomly re-positioned at 17Hz (Experiment 2), on each frame transition. A two-interval forced-choice paradigm, in conjunction with an adaptive staircase, was used to obtain Glass-pattern detection thresholds. The task required observers to identify the interval that contained concentric Glass structure; the other interval contained randomly orientated dipoles. Generally, lower global form thresholds were observed for dynamic and same-polarity Glass patterns than for static and opposite-polarity Glass patterns. In particular, for dynamic presentations improvement in sensitivity was more evident for opposite-polarity than for same-polarity Glass patterns. These findings suggest that motion plays an important role in the detection of global structure in dynamic Glass patterns.