Color constancy in real-world settings.

Color constancy denotes the ability to assign a particular and stable color percept to an object, irrespective of its surroundings and illumination. The light reaching the eye confounds illumination and spectral reflectance of the object, making the recovery of constant object color an ill-posed problem. How good the visual system is at accomplishing this task is still a matter of heated debate, despite more than a 100 years of research. Depending on the laboratory task and the specific cues available to observers, color constancy was found to be at levels ranging between 15% and 80%, which seems incompatible with the relatively stable color appearance of objects around us and the consistent usage of color names in real life. Here, we show close-to-perfect color constancy using real objects in a natural task and natural environmental conditions, chosen to mimic the role of color constancy in everyday life. Participants had to identify the color of a (non-present) item familiar to them in an office room under five different experimental illuminations. They mostly selected the same colored Munsell chip as their match to the absent object, even though the light reaching the eye in each case differed substantially. Our results demonstrate that color constancy under ideal conditions in the real world can indeed be exceptionally good. We found it to be as good as visual memory permits and not generally compromised by sensory uncertainty.

Ambiguity in high definition: Gaze determines physical interpretation of ambiguous rotation even in the absence of a visual context.

Physical interactions between objects, or between an object and the ground, are amongst the most biologically relevant for live beings. Prior knowledge of Newtonian physics may play a role in disambiguating an object's movement as well as foveation by increasing the spatial resolution of the visual input. Observers were shown a virtual 3D scene, representing an ambiguously rotating ball translating on the ground. The ball was perceived as rotating congruently with friction, but only when gaze was located at the point of contact. Inverting or even removing the visual context had little influence on congruent judgements compared with the effect of gaze. Counterintuitively, gaze at the point of contact determines the solution of perceptual ambiguity, but independently of visual context. We suggest this constitutes a frugal strategy, by which the brain infers dynamics locally when faced with a foveated input that is ambiguous.

Relative contributions to vergence eye movements of two binocular cues for motion-in-depth.

When we track an object moving in depth, our eyes rotate in opposite directions. This type of "disjunctive" eye movement is called horizontal vergence. The sensory control signals for vergence arise from multiple visual cues, two of which, changing binocular disparity (CD) and inter-ocular velocity differences (IOVD), are specifically binocular. While it is well known that the CD cue triggers horizontal vergence eye movements, the role of the IOVD cue has only recently been explored. To better understand the relative contribution of CD and IOVD cues in driving horizontal vergence, we recorded vergence eye movements from ten observers in response to four types of stimuli that isolated or combined the two cues to motion-in-depth, using stimulus conditions and CD/IOVD stimuli typical of behavioural motion-in-depth experiments. An analysis of the slopes of the vergence traces and the consistency of the directions of vergence and stimulus movements showed that under our conditions IOVD cues provided very little input to vergence mechanisms. The eye movements that did occur coinciding with the presentation of IOVD stimuli were likely not a response to stimulus motion, but a phoria initiated by the absence of a disparity signal.

Asymmetries between achromatic and chromatic extraction of 3D motion signals.

Motion in depth (MID) can be cued by high-resolution changes in binocular disparity over time (CD), and low-resolution interocular velocity differences (IOVD). Computational differences between these two mechanisms suggest that they may be implemented in visual pathways with different spatial and temporal resolutions. Here, we used fMRI to examine how achromatic and S-cone signals contribute to human MID perception. Both CD and IOVD stimuli evoked responses in a widespread network that included early visual areas, parts of the dorsal and ventral streams, and motion-selective area hMT+. Crucially, however, we measured an interaction between MID type and chromaticity. fMRI CD responses were largely driven by achromatic stimuli, but IOVD responses were better driven by isoluminant S-cone inputs. In our psychophysical experiments, when S-cone and achromatic stimuli were matched for perceived contrast, participants were equally sensitive to the MID in achromatic and S-cone IOVD stimuli. In comparison, they were relatively insensitive to S-cone CD. These findings provide evidence that MID mechanisms asymmetrically draw on information in precortical pathways. An early opponent motion signal optimally conveyed by the S-cone pathway may provide a substantial contribution to the IOVD mechanism.

Sensitivity to Velocity- and Disparity-Based Cues to Motion-In-Depth With and Without Spared Stereopsis in Binocular Visual Impairment.

Purpose: Two binocular sources of information serve motion-in-depth (MID) perception: changes in disparity over time (CD), and interocular velocity differences (IOVD). While CD requires the computation of small spatial disparities, IOVD could be computed from a much lower-resolution signal. IOVD signals therefore might still be available under conditions of binocular vision impairment (BVI) with limited or no stereopsis, for example, amblyopia. Methods: Sensitivity to CD and IOVD was measured in adults who had undergone therapy to correct optical misalignment or amblyopia in childhood (n = 16), as well as normal vision controls with good stereoacuity (n = 8). Observers discriminated the interval containing a smoothly oscillating MID "test" stimulus from a "control" stimulus in a two-interval forced choice paradigm. Results: Of the BVI observers with no static stereoacuity (n = 9), one displayed evidence for sensitivity to IOVD only, while there was otherwise no sensitivity for either CD or IOVD in the group. Generally, BVI observers with measurable stereoacuity (n = 7) displayed a pattern resembling the control group: showing a similar sensitivity for both cues. A neutral density filter placed in front of the fixing eye in a subset of BVI observers did not improve performance. Conclusions: In one BVI observer there was preserved sensitivity to IOVD but not CD, though overall only those BVI observers with at least gross stereopsis were able to detect disparity- or velocity-based cues to MID. The results imply that these logically distinct information sources are somehow coupled, and in some cases BVI observers with no stereopsis may still retain sensitivity to IOVD.

Prevalence of, and risk factors for, presenting visual impairment: findings from a vision screening programme based on UK NSC guidance in a multi-ethnic population.

PURPOSE: To determine presenting visual acuity levels and explore the factors associated with failing vision screening in a multi-ethnic population of UK children aged 4-5 years. METHODS: Visual acuity (VA) using the logMAR Crowded Test was measured in 16,541 children in a population-based vision screening programme. Referral for cycloplegic examination was based on national recommendations (>0.20logMAR in one or both eyes). Presenting visual impairment (PVI) was defined as VA >0.3logMAR in the better eye. Multivariable logistic regression was used to assess the association of ethnicity, maternal, and early-life factors with failing vision screening and PVI in participants of the Born in Bradford birth cohort. RESULTS: In total, 2467/16,541 (15%) failed vision screening, 732 (4.4%) had PVI. Children of Pakistani (OR: 2.49; 95% CI: 1.74-3.60) and other ethnicities (OR: 2.00; 95% CI: 1.28-3.12) showed increased odds of PVI compared to white children. Children born to older mothers (OR: 1.63; 95% CI: 1.19-2.24) and of low birth weight (OR: 1.52; 95% CI: 1.00-2.34) also showed increased odds. Follow-up results were available for 1068 (43.3%) children, 993 (93%) were true positives; 932 (94%) of these had significant refractive error. Astigmatism (>1DC) (44%) was more common in children of Pakistani ethnicity and hypermetropia (>3.0DS) (27%) in white children (Fisher's exact, p < 0.001). CONCLUSIONS: A high prevalence of PVI is reported. Failing vision screening and PVI were highly associated with ethnicity. The positive predictive value of the vision screening programme was good, with only 7% of children followed up confirmed as false positives.

The effect of adherence to spectacle wear on early developing literacy: a longitudinal study based in a large multiethnic city, Bradford, UK.

OBJECTIVES: To determine the impact of adherence to spectacle wear on visual acuity (VA) and developing literacy following vision screening at age 4-5 years. DESIGN: Longitudinal study nested within the Born in Bradford birth cohort. SETTING AND PARTICIPANTS: Observation of 944 children: 432 had failed vision screening and were referred (treatment group) and 512 randomly selected (comparison group) who had passed (<0.20 logarithm of the minimum angle of resolution (logMAR) in both eyes). Spectacle wear was observed in school for 2 years following screening and classified as adherent (wearing spectacles at each assessment) or non-adherent. MAIN OUTCOME MEASURES: Annual measures of VA using a crowded logMAR test. Literacy was measured by Woodcock Reading Mastery Tests-Revised subtest: letter identification. RESULTS: The VA of all children improved with increasing age, -0.009 log units per month (95% CI -0.011 to -0.007) (worse eye). The VA of the adherent group improved significantly more than the comparison group, by an additional -0.008 log units per month (95% CI -0.009 to -0.007) (worse eye) and -0.004 log units per month (95% CI -0.005 to -0.003) in the better eye.Literacy was associated with the VA, letter identification (ID) reduced by -0.9 (95% CI -1.15 to -0.64) for every one line (0.10 logMAR) fall in VA (better eye). This association remained after adjustment for socioeconomic and demographic factors (-0.33, 95% CI -0.54 to -0.12). The adherent group consistently demonstrated higher letter-ID scores compared with the non-adherent group, with the greatest effect size (0.11) in year 3. CONCLUSIONS: Early literacy is associated with the level of VA; children who adhere to spectacle wear improve their VA and also have the potential to improve literacy. Our results suggest failure to adhere to spectacle wear has implications for the child's vision and education.

Investigating Human Visual Sensitivity to Binocular Motion-in-Depth for Anti- and De-Correlated Random-Dot Stimuli.

Motion-in-depth can be detected by using two different types of binocular cues: change of disparity (CD) and inter-ocular velocity differences (IOVD). To investigate the underlying detection mechanisms, stimuli can be constructed that isolate these cues or contain both (FULL cue). Two different methods to isolate the IOVD cue can be employed: anti-correlated (aIOVD) and de-correlated (dIOVD) motion signals. While both types of stimuli have been used in studies investigating the perception of motion-in-depth, for the first time, we explore whether both stimuli isolate the same mechanism and how they differ in their relative efficacy. Here, we set out to directly compare aIOVD and dIOVD sensitivity by measuring motion coherence thresholds. In accordance with previous results by Czuba et al. (2010), we found that motion coherence thresholds were similar for aIOVD and FULL cue stimuli for most participants. Thresholds for dIOVD stimuli, however, differed consistently from thresholds for the two other cues, suggesting that aIOVD and dIOVD stimuli could be driving different visual mechanisms.

Bias effects of short- and long-term color memory for unique objects.

Are objects remembered with a more saturated color? Some of the evidence supporting this statement comes from research using "memory colors"-the typical colors of particular objects, for example, the green of grass. The problematic aspect of these findings is that many different exemplars exist, some of which might exhibit a higher saturation than the one measured by the experimenter. Here we avoid this problem by using unique personal items and comparing long- and short-term color memory matches (in hue, value, and chroma) with those obtained with the object present. Our results, on average, confirm that objects are remembered as more saturated than they are.

The many colours of 'the dress'.

There has been an intense discussion among the public about the colour of a dress, shown in a picture posted originally on Tumblr (http://swiked.tumblr.com/post/112073818575/guys-please-help-me-is-this-dress-white-and; accessed on 10:56 am GMT on Tue 24 Mar 2015). Some people argue that they see a white dress with golden lace, while others describe the dress as blue with black lace. Here we show that the question "what colour is the dress?" has more than two answers. In fact, there is a continuum of colour percepts across different observers. We measured colour matches on a calibrated screen for two groups of observers who had reported different percepts of the dress. Surprisingly, differences between the two groups arose mainly from differences in lightness, rather than chromaticity of the colours they adjusted to match the dress. We speculate that the ambiguity arises in the case of this particular image because the distribution of colours within the dress closely matches the distribution of natural daylights. This makes it more difficult to disambiguate illumination changes from those in reflectance.

Interactions between luminance and color signals: effects on shape.

Although luminance and color are thought to be processed independently at early stages of visual processing, there is evidence that they interact at later stages. For example, chromatic information has been shown to enhance or suppress depth from luminance depending on whether chromatic edges are aligned or orthogonal with luminance edges. Here we explored more generally how chromatic information interacts with luminance information that specifies shape from shading. Using a depth-matching task, we measured perceived depth in sinusoidal and square-wave gratings (specifying close-to sinusoidal and triangle-wave depth profiles, respectively) in three conditions. In the first, as we varied luminance contrast in the presence of an orthogonal chromatic grating, perceived depth increased (consistent with classical shape from shading). When we held the luminance at a fixed contrast and varied the chromatic grating in the other two conditions (orthogonal or aligned), we found large and inconsistent individual differences. Some participants exhibited the expected pattern of enhancement and suppression, but most did not, either for the sinusoidal or square-wave stimuli. Our results cast doubt on the idea that the interaction demonstrates a single high-level heuristic linked to depth perception. Instead, we speculate that interactions are more likely due to early cross-channel masking.

Learning to use illumination gradients as an unambiguous cue to three dimensional shape.

The luminance and colour gradients across an image are the result of complex interactions between object shape, material and illumination. Using such variations to infer object shape or surface colour is therefore a difficult problem for the visual system. We know that changes to the shape of an object can affect its perceived colour, and that shading gradients confer a sense of shape. Here we investigate if the visual system is able to effectively utilise these gradients as a cue to shape perception, even when additional cues are not available. We tested shape perception of a folded card object that contained illumination gradients in the form of shading and more subtle effects such as inter-reflections. Our results suggest that observers are able to use the gradients to make consistent shape judgements. In order to do this, observers must be given the opportunity to learn suitable assumptions about the lighting and scene. Using a variety of different training conditions, we demonstrate that learning can occur quickly and requires only coarse information. We also establish that learning does not deliver a trivial mapping between gradient and shape; rather learning leads to the acquisition of assumptions about lighting and scene parameters that subsequently allow for gradients to be used as a shape cue. The perceived shape is shown to be consistent for convex and concave versions of the object that exhibit very different shading, and also similar to that delivered by outline, a largely unrelated cue to shape. Overall our results indicate that, although gradients are less reliable than some other cues, the relationship between gradients and shape can be quickly assessed and the gradients therefore used effectively as a visual shape cue.

Optimal integration of shading and binocular disparity for depth perception.

We explore the relative utility of shape from shading and binocular disparity for depth perception. Ray-traced images either featured a smooth surface illuminated from above (shading-only) or were defined by small dots (disparity-only). Observers judged which of a pair of smoothly curved convex objects had most depth. The shading cue was around half as reliable as the rich disparity information for depth discrimination. Shading- and disparity-defined cues where combined by placing dots in the stimulus image, superimposed upon the shaded surface, resulting in veridical shading and binocular disparity. Independently varying the depth delivered by each channel allowed creation of conflicting disparity-defined and shading-defined depth. We manipulated the reliability of the disparity information by adding disparity noise. As noise levels in the disparity channel were increased, perceived depths and variances shifted toward those of the now more reliable shading cue. Several different models of cue combination were applied to the data. Perceived depths and variances were well predicted by a classic maximum likelihood estimator (MLE) model of cue integration, for all but one observer. We discuss the extent to which MLE is the most parsimonious model to account for observer performance.

Visualizing the surface of a living human brain.

A proposed method visualizes the surface appearance of living human brain tissue. The goal is to investigate whether realistic models of living anatomy are possible and, if so, whether they provide added value to anatomy education and training simulators. From calibrated photography of exposed brain tissue and suitable alternatives, experiments provided data for a bidirectional reflectance distribution function, which was then used for rendering. Employing a GPU, real-time visualization of the brain's surface supported ambient occlusion, advanced texturing, subsurface scattering, and specularity.

Realistic visualization of living brain tissue.

This paper presents an advanced method of visualizing the surface appearance of living brain tissue. We have been granted access to the operating theatre during neurosurgical procedures to obtain colour data via calibrated photography of exposed brain tissue. The specular reflectivity of the brain's surface is approximated by analyzing a gelatine layer applied to animal flesh. This provides data for a bidirectional reflectance distribution function (BRDF) that is then used the rendering process. Rendering is achieved in realtime by utilizing the GPU, and includes support for ambient occlusion, advanced texturing, sub surface scattering and specularity. Our goal is to investigate whether realistic visualizations of living anatomy can be produced and so provide added value to anatomy education.

Basic colour names for 2D samples: effects of presentation media and illuminants.

We have previously shown (Bloj et al., 2008; Abstracts Materials & Sensations 2008) that under particular conditions colour memory is independent of presentation media, and of the illuminants under which colours are viewed. In the present study we investigate whether colour naming is also unaffected by these two factors. Forty-eight colour samples from the Natural Colour System (NCS) collection were presented as real paper samples or as accurate computer simulations displayed on a calibrated monitor. The colour swatches could be presented under a daylight illuminant - two intensities, 85 ('D1') or 60 cd m(-2) ('D2') - or a purple illuminant, 45 cd m(-2) ('Lily'). The colour samples were shown in arrays of 16 (4 × 4 layout) and the observer's task was to assign one of the eleven basic colour terms to each of the samples. Six observers repeated this colour naming task five times for each presentation medium and illuminant. On average, in 73% of the cases the same colour term was assigned to surface and display colours. This level of agreement was highest for colour samples under daylight (D1-82%, D2-73%) and poor for Lily (65%). Although colour memory is unaffected by the nature of the colour stimulus, here we show that there are limitations to cross-media agreement in colour naming.

Real and predicted influence of image manipulations on eye movements during scene recognition.

In this paper, we investigate how controlled changes to image properties and orientation affect eye movements for repeated viewings of images of natural scenes. We make changes to images by manipulating low-level image content (such as luminance or chromaticity) and/or inverting the image. We measure the effects of these manipulations on human scanpaths (the spatial and chronological path of fixations), additionally comparing these effects to those predicted by a widely used saliency model (L. Itti & C. Koch, 2000). Firstly we find that repeated viewing of a natural image does not significantly modify the previously known repeatability (S. A. Brandt & L. W. Stark, 1997; D. Noton & L. Stark, 1971) of scanpaths. Secondly we find that manipulating image features does not necessarily change the repeatability of scanpaths, but the removal of luminance information has a measurable effect. We also find that image inversion appears to affect scene perception and recognition and may alter fixation selection (although we only find an effect on scanpaths with the additional removal of luminance information). Additionally we confirm that visual saliency as defined by L. Itti and C. Koch's (2000) model is a poor predictor of real observer scanpaths and does not predict the small effects of our image manipulations on scanpaths.

Color constancy improves for real 3D objects.

In this study human color constancy was tested for two-dimensional (2D) and three-dimensional (3D) setups with real objects and lights. Four different illuminant changes, a natural selection task and a wide choice of target colors were used. We found that color constancy was better when the target color was learned as a 3D object in a cue-rich 3D scene than in a 2D setup. This improvement was independent of the target color and the illuminant change. We were not able to find any evidence that frequently experienced illuminant changes are better compensated for than unusual ones. Normalizing individual color constancy hit rates by the corresponding color memory hit rates yields a color constancy index, which is indicative of observers' true ability to compensate for illuminant changes.

Sensitivity to luminance and chromaticity gradients in a complex scene.

Image gradients--smooth changes in color and luminance--may be caused by intrinsic surface reflectance properties or extrinsic illumination phenomena, including shading, shadowing, and inter-reflections. In turn, image gradients may provide the visual system with information concerning the origin of these factors, such as the orientation of surfaces with respect to the light source. Color gradients induced by mutual illumination (MI) may play a similar role to that of luminance gradients in shape-from-shading algorithms; it has been shown that 3D shape perception modulates the influence of MI on surface color perception (M. G. Bloj, D. Kersten, & A. C. Hurlbert, 1999). In this study, we assess human sensitivity to changes in color and luminance gradients that arise from changes in the light source position, within a complex scene. In Experiment 1, we tested whether observers were able to discriminate between gradients due to different light source positions. We found that observers reliably detected a change in the gradient information when the light source position differed by only 4 deg from the reference scene. This sensitivity was mainly based on the luminance information in the gradient (Experiments 2 and 3). Some observers make use of the spatial distribution of chromaticity and luminance values within gradients when discriminating between them (Experiment 4). The high sensitivity to gradient differences supports the notion that gradients contain information that may assist in the recovery of 3D shape and scene configuration properties.

Creating physically accurate visual stimuli for free: spectral rendering with RADIANCE.

Visual psychophysicists, who study object, color, and light perception, have a demand for software that produces complex but, at the same time, physically accurate stimuli for their experiments. The number of computer graphic packages that simulate the physical interaction of light and surfaces is limited, and mostly they require the purchase of a license. RADIANCE (Ward, 1994), however, is freely available and popular in the visual perception community, making it a prime candidate. We have shown previously that RADIANCE's simulation accuracy is greatly improved when color is coded by spectra, rather than by the originally envisaged RGB triplets (Ruppertsberg & Bloj, 2006). Here, we present a method for spectral rendering with RADIANCE to generate hyperspectral images that can be converted to XYZ images (CIE 1931 system) and then to machine-dependent RGB images. Generating XYZ stimuli has the added advantage of making stimulus images independent of display devices and, thereby, facilitating the process of reproducing results across different labs. Materials associated with this article may be downloaded from www.psychonomic.org.