How many surfaces can you distinguish by color? Real environmental lighting increases discriminability of surface colors.

Color supports object identification. However, two objects that differ in color under one light can appear indiscriminable under a second light, a phenomenon known as illuminant metamerism. Past studies evaluated the frequency of illuminant metamerism only under single, uniform illuminants. Here we used computer-graphics techniques to simulate a pair of planar surfaces placed under newly measured hyperspectral illumination maps that quantify the directional variability of real-world lighting environments. We counted the instances of illuminant metamerism that can be solved simply by viewing surfaces tilted to a different direction. Results show that most instances of illuminant metamerism can in theory be resolved for both trichromatic and dichromatic observers, suggesting that the physical directional variability available in natural lighting environments substantially mitigates the biological limitations of trichromacy or dichromacy.

How do (perceptual) distracters distract?

When a target stimulus occurs in the presence of distracters, decisions are less accurate. But how exactly do distracters affect choices? Here, we explored this question using measurement of human behaviour, psychophysical reverse correlation and computational modelling. We contrasted two models: one in which targets and distracters had independent influence on choices (independent model) and one in which distracters modulated choices in a way that depended on their similarity to the target (interaction model). Across three experiments, participants were asked to make fine orientation judgments about the tilt of a target grating presented adjacent to an irrelevant distracter. We found strong evidence for the interaction model, in that decisions were more sensitive when target and distracter were consistent relative to when they were inconsistent. This consistency bias occurred in the frame of reference of the decision, that is, it operated on decision values rather than on sensory signals, and surprisingly, it was independent of spatial attention. A normalization framework, where target features are normalized by the expectation and variability of the local context, successfully captures the observed pattern of results.

Modeling surface color discrimination under different lighting environments using image chromatic statistics and convolutional neural networks.

We modeled discrimination thresholds for object colors under different lighting environments [J. Opt. Soc. Am. 35, B244 (2018)]. First, we built models based on chromatic statistics, testing 60 models in total. Second, we trained convolutional neural networks (CNNs), using 160,280 images labeled by either the ground-truth or human responses. No single chromatic statistics model was sufficient to describe human discrimination thresholds across conditions, while human-response-trained CNNs nearly perfectly predicted human thresholds. Guided by region-of-interest analysis of the network, we modified the chromatic statistics models to use only the lower regions of the objects, which substantially improved performance.

Task-dependent extraction of information from videos of iridescent and glossy samples.

We present an exploratory study on iridescence that revealed systematic differences in the perceptual clustering of glossy and iridescent samples that was driven by instructions to focus on either the material or the color properties of the samples. Participants' similarity ratings of pairs of video stimuli, showing the samples from multiple views, were analyzed using multidimensional scaling (MDS), and differences between the MDS solutions for the two tasks were consistent with flexible weighting of information from different views of the samples. These findings point to ecological implications for how viewers perceive and interact with the color-changing properties of iridescent objects.

Color and gloss constancy under diverse lighting environments.

When we look at an object, we simultaneously see how glossy or matte it is, how light or dark, and what color. Yet, at each point on the object's surface, both diffuse and specular reflections are mixed in different proportions, resulting in substantial spatial chromatic and luminance variations. To further complicate matters, this pattern changes radically when the object is viewed under different lighting conditions. The purpose of this study was to simultaneously measure our ability to judge color and gloss using an image set capturing diverse object and illuminant properties. Participants adjusted the hue, lightness, chroma, and specular reflectance of a reference object so that it appeared to be made of the same material as a test object. Critically, the two objects were presented under different lighting environments. We found that hue matches were highly accurate, except for under a chromatically atypical illuminant. Chroma and lightness constancy were generally poor, but these failures correlated well with simple image statistics. Gloss constancy was particularly poor, and these failures were only partially explained by reflection contrast. Importantly, across all measures, participants were highly consistent with one another in their deviations from constancy. Although color and gloss constancy hold well in simple conditions, the variety of lighting and shape in the real world presents significant challenges to our visual system's ability to judge intrinsic material properties.

Demonstrating a multi-primary high dynamic range display system for vision experiments.

We describe the design, construction, calibration, and characterization of a multi-primary high dynamic range (MPHDR) display system for use in vision research. The MPHDR display is the first system to our knowledge to allowfor spatially controllable, high dynamic range stimulus generation using multiple primaries.We demonstrate the high luminance, high dynamic range, and wide color gamut output of the MPHDR display. During characterization, the MPHDR display achieved a maximum luminance of 3200 cd=m2, a maximum contrast range of 3; 240; 000 V 1, and an expanded color gamut tailored to dedicated vision research tasks that spans beyond traditional sRGB displays. We discuss how the MPHDR display could be optimized for psychophysical experiments with photoreceptor isolating stimuli achieved through the method of silent substitution. We present an example case of a range of metameric pairs of melanopsin isolating stimuli across different luminance levels, from an available melanopsin contrast of117%at 75 cd=m2 to a melanopsin contrast of23%at 2000 cd=m2.

Hyperspectral environmental illumination maps: characterizing directional spectral variation in natural environments.

Objects placed in real-world scenes receive incident light from every direction, and the spectral content of this light may vary from one direction to another. In computer graphics, environmental illumination is approximated using maps that specify illumination at a point as a function of incident angle. However, to-date, existing public databases of environmental illumination specify only three colour channels (RGB). We have captured a new set of 12 environmental illumination maps (eight outdoor scenes; four indoor scenes) using a hyperspectral imaging system with 33 spectral channels. The data reveal a striking directional variation of spectral distribution of lighting in natural environments. We discuss limitations of using daylight models to describe natural environmental illumination.

Hand-Foot Coupling: An Advantage for Crossed Legs.

It is difficult to perform distinct, simultaneous motor actions with the ipsilateral hand and foot; for example, clockwise circles with the right hand and counter-clockwise circles with the right foot. By chance, we discovered that this hand-foot coupling task is easier when seated with legs crossed. We consider various explanations. First, that there are reduced demands on the contralateral hemisphere when the motor programme of the right foot is executed on the left side of the body. Second, that the legs-crossed scenario is easier because movements are symmetrical with respect to body midline. By considering related motor actions, we conclude that neither of these explanations provides a full account. Thus, we suggest a third explanation, which is that coupling effects are reduced by virtue of increased postural stability and reduced anticipatory postural adjustments.

Discrimination of spectral reflectance under environmental illumination.

Color constancy is the ability to recover a stable perceptual estimate of surface reflectance, regardless of the lighting environment. However, we know little about how observers make judgments of the surface color of glossy objects, particularly in complex lighting environments that introduce complex spatial patterns of chromatic variation across an object's surface. To address this question, we measured thresholds for reflectance discrimination using computer-rendered stimuli under environmental illumination. In Experiment 1, we found that glossiness and shape had small effects on discrimination thresholds. Importantly, discrimination ellipses extended along the direction in which the chromaticities in the environmental illumination spread. In Experiment 2, we also found that the observers' abilities to judge surface colors were worse in lighting environments with an atypical chromatic distribution.

Are hue and saturation carried in different neural channels?

Chromatic discrimination data show that a smaller physical stimulus change is required to detect a change in hue than to detect a change in saturation [Palette30, 21 (1968); Proc. R. Soc. London Ser. B283, 20160164 (2016)PRLBA40080-464910.1098/rspb.2016.0164], and, on this basis, it has been suggested that hue and saturation are carried in different neural channels [Color Space and Its Divisions: Color Order from Antiquity to the Present (Wiley, 2003), p. 311]. We used an adaptation paradigm to test explicitly for separate mechanisms, measuring hue and saturation detection thresholds before and after adaptation to hue and saturation stimuli. Within-condition adaptation did not elevate detection thresholds significantly more than between-condition adaptation. We therefore did not find psychophysical evidence for a neural channel that extracts hue thresholds more effectively than the neural channel or channels that determine saturation thresholds.

Beyond scattering and absorption: Perceptual unmixing of translucent liquids.

Is perception of translucence based on estimations of scattering and absorption of light or on statistical pseudocues associated with familiar materials? We compared perceptual performance with real and computer-generated stimuli. Real stimuli were glasses of milky tea. Milk predominantly scatters light and tea absorbs it, but since the tea absorbs less as the milk concentration increases, the effects of milkiness and strength on scattering and absorption are not independent. Conversely, computer-generated stimuli were glasses of "milky tea" in which absorption and scattering were independently manipulated. Observers judged tea concentrations regardless of milk concentrations, or vice versa. Maximum-likelihood conjoint measurement was used to estimate the contributions of each physical component-concentrations of milk and tea, or amounts of scattering and absorption-to perceived milkiness or tea strength. Separability of the two physical dimensions was better for real than for computer-generated teas, suggesting that interactions between scattering and absorption were correctly accounted for in perceptual unmixing, but unmixing was always imperfect. Since the real and rendered stimuli represent different physical processes and therefore differ in their image statistics, perceptual judgments with these stimuli allowed us to identify particular pseudocues (presumably learned with real stimuli) that explain judgments with both stimulus sets.

Delayed S-cone sensitivity losses following the onset of intense yellow backgrounds linked to the lifetime of a photobleaching product?

Thirty years ago, Mollon, Stockman, & Polden (1987) reported that after the onset of intense yellow 581-nm backgrounds, S-cone threshold rose unexpectedly for several seconds before recovering to the light-adapted steady-state value-an effect they called: "transient-tritanopia of the second kind" (TT2). Given that 581-nm lights have little direct effect on S-cones, TT2 must arise indirectly from the backgrounds' effects on the L- and M-cones. We attribute the phenomenon to the action of an unknown L- and M-cone photobleaching product, X, which acts at their outputs like an "equivalent" background light that then inhibits S-cones at a cone-opponent, second-site. The time-course of TT2 is similar in form to the lifetime of X in a two-stage, first-order biochemical reaction A→X→C with successive best-fitting time-constants of 3.09 ± 0.35 and 7.73 ± 0.70 s. Alternatively, with an additional slowly recovering exponential "restoring-force" with a best-fitting time-constant 23.94 ± 1.42 s, the two-stage best-fitting time-constants become 4.15 ± 0.62 and 6.79 ± 1.00 s. Because the time-constants are roughly independent of the background illumination, and thus the rate of photoisomerization, A→X is likely to be a reaction subsidiary to the retinoid cycle, perhaps acting as a buffer when the bleaching rate is too high. X seems to be logarithmically related to S-cone threshold, which may result from the logarithmic cone-opponent, second-site response compression after multiplicative first-site adaptation. The restoring-force may be the same cone-opponent force that sets the rate of S-cone recovery following the unusual threshold increase following the offset of dimmer yellow backgrounds, an effect known as "transient-tritanopia" (TT1).

Bow-shaped caustics from conical prisms: a 13th-century account of rainbow formation from Robert Grosseteste's De iride.

The rainbow has been the subject of discussion across a variety of historical periods and cultures, and numerous optical explanations have been suggested. Here, we further explore the scientific treatise De iride [On the Rainbow] written by Robert Grosseteste in the 13th century. Attempting to account for the shape of the rainbow, Grosseteste bases his explanation on the optical properties of transparent cones, which he claims can give rise to arc-shaped projections through refraction. By stating that atmospheric phenomena are reducible to the geometric optics of a conical prism, the De iride lays out a coherent and testable hypothesis. Through both physical experiment and physics-based simulation, we present a novel characterization of cone-light interactions, demonstrating that transparent cones do indeed give rise to bow-shaped caustics-a nonintuitive phenomenon that suggests Grosseteste's theory of the rainbow is likely to have been grounded in observation.

Hue shifts produced by temporal asymmetries in chromatic signals.

Observers viewed M- or L-cone-isolating stimuli and compared slowly-on and slowly-off sawtooth waveforms of the same mean chromaticity and luminance. Between 6 and 13 Hz, the mean hue of slowly-on L-cone and slowly-off M-cone sawtooth flicker appeared redder, and the mean hue of slowly-off L-cone and slowly-on M-cone sawtooth stimuli appeared greener-despite all the waveforms' having the same mean, near-yellow-appearing chromaticity. We measured the effect of the modulation depth and the slope of the sawtooth on the mean hue shifts as a function of temporal frequency. The results are complex but show that discriminability depended mainly on the second harmonic of the waveforms. We considered several models with combinations of linear and nonlinear stages. First, we considered models in which a nonlinear stage limits the rate of change of hue and restricts the steep slope of the sawtooth waveform more than its shallow slope, thus shifting the mean hue in the direction of the shallower slope (such a nonlinearity is also known as a slew-rate limit). Second, we considered saturation models in which the nonlinear stage compresses hue signals and thus shifts the mean of asymmetrical waveforms with or without differentiation before the nonlinearity. Overall, our modeling and results suggest that the hue shift occurs at some nonlinear mechanism in the chromatic pathway; and that, in terms of the Fourier components of the various waveforms, the effect of the nonlinearity depends crucially on the timing of the second harmonic relative to the first.

Low levels of specularity support operational color constancy, particularly when surface and illumination geometry can be inferred.

We tested whether surface specularity alone supports operational color constancy-the ability to discriminate changes in illumination or reflectance. Observers viewed short animations of illuminant or reflectance changes in rendered scenes containing a single spherical surface and were asked to classify the change. Performance improved with increasing specularity, as predicted from regularities in chromatic statistics. Peak performance was impaired by spatial rearrangements of image pixels that disrupted the perception of illuminated surfaces but was maintained with increased surface complexity. The characteristic chromatic transformations that are available with nonzero specularity are useful for operational color constancy, particularly if accompanied by appropriate perceptual organization.

S-cone psychophysics.

We review the features of the S-cone system that appeal to the psychophysicist and summarize the celebrated characteristics of S-cone mediated vision. Two factors are emphasized: First, the fine stimulus control that is required to isolate putative visual mechanisms and second, the relationship between physiological data and psychophysical approaches. We review convergent findings from physiology and psychophysics with respect to asymmetries in the retinal wiring of S-ON and S-OFF visual pathways, and the associated treatment of increments and decrements in the S-cone system. Beyond the retina, we consider the lack of S-cone projections to superior colliculus and the use of S-cone stimuli in experimental psychology, for example to address questions about the mechanisms of visually driven attention. Careful selection of stimulus parameters enables psychophysicists to produce entirely reversible, temporary, "lesions," and to assess behavior in the absence of specific neural subsystems.

Color-coordinate system from a 13th-century account of rainbows.

We present a new analysis of Robert Grosseteste's account of color in his treatise De iride (On the Rainbow), dating from the early 13th century. The work explores color within the 3D framework set out in Grosseteste's De colore [see J. Opt. Soc. Am. A29, A346 (2012)], but now links the axes of variation to observable properties of rainbows. We combine a modern understanding of the physics of rainbows and of human color perception to resolve the linguistic ambiguities of the medieval text and to interpret Grosseteste's key terms.

Adaptive optics scanning laser ophthalmoscopy in a heterogenous cohort with Stargardt disease.

Image based cell-specific biomarkers will play an important role in monitoring treatment outcomes of novel therapies in patients with Stargardt (STGD1) disease and may provide information on the exact mechanism of retinal degeneration. This study reports retinal image features from conventional clinical imaging and from corresponding high-resolution imaging with a confocal adaptive optics scanning laser ophthalmoscope (AOSLO) in a heterogenous cohort of patients with Stargardt (STGD1) disease. This is a prospective observational study in which 16 participants with clinically and molecularly confirmed STGD1, and 7 healthy controls underwent clinical assessment and confocal AOSLO imaging. Clinical assessment included short-wavelength and near-infrared fundus autofluorescence, spectral-domain optical coherence tomography, and macular microperimetry. AOSLO images were acquired over a range of retinal eccentricities (0°-20°) and mapped to areas of interest from the clinical images. A regular photoreceptor mosaic was identified in areas of normal or near normal retinal structure on clinical images. Where clinical imaging indicated areas of retinal degeneration, the photoreceptor mosaic was disorganised and lacked unambiguous cones. Discrete hyper-reflective foci were identified in 9 participants with STGD1 within areas of retinal degeneration. A continuous RPE cell mosaic at the fovea was identified in one participant with an optical gap phenotype. The clinical heterogeneity observed in STGD1 is reflected in the findings on confocal AOSLO imaging.

Extended-period AOSLO imaging in the living human retina without pupil dilation: a feasibility study.

In vivo imaging using an adaptive optics scanning laser ophthalmoscope (AOSLO) is challenging, especially over extended periods. Pharmacological agents, administered as eye drops, are commonly used to dilate the pupil and paralyse accommodation, to improve image quality. However, they are contraindicated in some scenarios. Here, we evaluate the feasibility and reproducibility of performing AOSLO imaging without pharmacological pupil dilation over 1.5 hours with visual stimulation. Through statistical analysis and theoretical modelling using a dataset of retinal and pupil images collected from six healthy, young, near-emmetropic participants between the ages of 20-30 years, we validate that the retinal image quality does not change significantly with time in the experimental session (p = 0.33), and that pupil size has a strong effect on image quality but is not the only contributing factor.