How do (perceptual) distracters distract?

When a target stimulus occurs in the presence of distracters, decisions are less accurate. But how exactly do distracters affect choices? Here, we explored this question using measurement of human behaviour, psychophysical reverse correlation and computational modelling. We contrasted two models: one in which targets and distracters had independent influence on choices (independent model) and one in which distracters modulated choices in a way that depended on their similarity to the target (interaction model). Across three experiments, participants were asked to make fine orientation judgments about the tilt of a target grating presented adjacent to an irrelevant distracter. We found strong evidence for the interaction model, in that decisions were more sensitive when target and distracter were consistent relative to when they were inconsistent. This consistency bias occurred in the frame of reference of the decision, that is, it operated on decision values rather than on sensory signals, and surprisingly, it was independent of spatial attention. A normalization framework, where target features are normalized by the expectation and variability of the local context, successfully captures the observed pattern of results.

Modeling surface color discrimination under different lighting environments using image chromatic statistics and convolutional neural networks.

We modeled discrimination thresholds for object colors under different lighting environments [J. Opt. Soc. Am. 35, B244 (2018)]. First, we built models based on chromatic statistics, testing 60 models in total. Second, we trained convolutional neural networks (CNNs), using 160,280 images labeled by either the ground-truth or human responses. No single chromatic statistics model was sufficient to describe human discrimination thresholds across conditions, while human-response-trained CNNs nearly perfectly predicted human thresholds. Guided by region-of-interest analysis of the network, we modified the chromatic statistics models to use only the lower regions of the objects, which substantially improved performance.

Task-dependent extraction of information from videos of iridescent and glossy samples.

We present an exploratory study on iridescence that revealed systematic differences in the perceptual clustering of glossy and iridescent samples that was driven by instructions to focus on either the material or the color properties of the samples. Participants' similarity ratings of pairs of video stimuli, showing the samples from multiple views, were analyzed using multidimensional scaling (MDS), and differences between the MDS solutions for the two tasks were consistent with flexible weighting of information from different views of the samples. These findings point to ecological implications for how viewers perceive and interact with the color-changing properties of iridescent objects.

Color and gloss constancy under diverse lighting environments.

When we look at an object, we simultaneously see how glossy or matte it is, how light or dark, and what color. Yet, at each point on the object's surface, both diffuse and specular reflections are mixed in different proportions, resulting in substantial spatial chromatic and luminance variations. To further complicate matters, this pattern changes radically when the object is viewed under different lighting conditions. The purpose of this study was to simultaneously measure our ability to judge color and gloss using an image set capturing diverse object and illuminant properties. Participants adjusted the hue, lightness, chroma, and specular reflectance of a reference object so that it appeared to be made of the same material as a test object. Critically, the two objects were presented under different lighting environments. We found that hue matches were highly accurate, except for under a chromatically atypical illuminant. Chroma and lightness constancy were generally poor, but these failures correlated well with simple image statistics. Gloss constancy was particularly poor, and these failures were only partially explained by reflection contrast. Importantly, across all measures, participants were highly consistent with one another in their deviations from constancy. Although color and gloss constancy hold well in simple conditions, the variety of lighting and shape in the real world presents significant challenges to our visual system's ability to judge intrinsic material properties.

Demonstrating a multi-primary high dynamic range display system for vision experiments.

We describe the design, construction, calibration, and characterization of a multi-primary high dynamic range (MPHDR) display system for use in vision research. The MPHDR display is the first system to our knowledge to allowfor spatially controllable, high dynamic range stimulus generation using multiple primaries.We demonstrate the high luminance, high dynamic range, and wide color gamut output of the MPHDR display. During characterization, the MPHDR display achieved a maximum luminance of 3200 cd=m2, a maximum contrast range of 3; 240; 000 V 1, and an expanded color gamut tailored to dedicated vision research tasks that spans beyond traditional sRGB displays. We discuss how the MPHDR display could be optimized for psychophysical experiments with photoreceptor isolating stimuli achieved through the method of silent substitution. We present an example case of a range of metameric pairs of melanopsin isolating stimuli across different luminance levels, from an available melanopsin contrast of117%at 75 cd=m2 to a melanopsin contrast of23%at 2000 cd=m2.

Hyperspectral environmental illumination maps: characterizing directional spectral variation in natural environments.

Objects placed in real-world scenes receive incident light from every direction, and the spectral content of this light may vary from one direction to another. In computer graphics, environmental illumination is approximated using maps that specify illumination at a point as a function of incident angle. However, to-date, existing public databases of environmental illumination specify only three colour channels (RGB). We have captured a new set of 12 environmental illumination maps (eight outdoor scenes; four indoor scenes) using a hyperspectral imaging system with 33 spectral channels. The data reveal a striking directional variation of spectral distribution of lighting in natural environments. We discuss limitations of using daylight models to describe natural environmental illumination.

Hand-Foot Coupling: An Advantage for Crossed Legs.

It is difficult to perform distinct, simultaneous motor actions with the ipsilateral hand and foot; for example, clockwise circles with the right hand and counter-clockwise circles with the right foot. By chance, we discovered that this hand-foot coupling task is easier when seated with legs crossed. We consider various explanations. First, that there are reduced demands on the contralateral hemisphere when the motor programme of the right foot is executed on the left side of the body. Second, that the legs-crossed scenario is easier because movements are symmetrical with respect to body midline. By considering related motor actions, we conclude that neither of these explanations provides a full account. Thus, we suggest a third explanation, which is that coupling effects are reduced by virtue of increased postural stability and reduced anticipatory postural adjustments.

Discrimination of spectral reflectance under environmental illumination.

Color constancy is the ability to recover a stable perceptual estimate of surface reflectance, regardless of the lighting environment. However, we know little about how observers make judgments of the surface color of glossy objects, particularly in complex lighting environments that introduce complex spatial patterns of chromatic variation across an object's surface. To address this question, we measured thresholds for reflectance discrimination using computer-rendered stimuli under environmental illumination. In Experiment 1, we found that glossiness and shape had small effects on discrimination thresholds. Importantly, discrimination ellipses extended along the direction in which the chromaticities in the environmental illumination spread. In Experiment 2, we also found that the observers' abilities to judge surface colors were worse in lighting environments with an atypical chromatic distribution.

Are hue and saturation carried in different neural channels?

Chromatic discrimination data show that a smaller physical stimulus change is required to detect a change in hue than to detect a change in saturation [Palette30, 21 (1968); Proc. R. Soc. London Ser. B283, 20160164 (2016)PRLBA40080-464910.1098/rspb.2016.0164], and, on this basis, it has been suggested that hue and saturation are carried in different neural channels [Color Space and Its Divisions: Color Order from Antiquity to the Present (Wiley, 2003), p. 311]. We used an adaptation paradigm to test explicitly for separate mechanisms, measuring hue and saturation detection thresholds before and after adaptation to hue and saturation stimuli. Within-condition adaptation did not elevate detection thresholds significantly more than between-condition adaptation. We therefore did not find psychophysical evidence for a neural channel that extracts hue thresholds more effectively than the neural channel or channels that determine saturation thresholds.

Beyond scattering and absorption: Perceptual unmixing of translucent liquids.

Is perception of translucence based on estimations of scattering and absorption of light or on statistical pseudocues associated with familiar materials? We compared perceptual performance with real and computer-generated stimuli. Real stimuli were glasses of milky tea. Milk predominantly scatters light and tea absorbs it, but since the tea absorbs less as the milk concentration increases, the effects of milkiness and strength on scattering and absorption are not independent. Conversely, computer-generated stimuli were glasses of "milky tea" in which absorption and scattering were independently manipulated. Observers judged tea concentrations regardless of milk concentrations, or vice versa. Maximum-likelihood conjoint measurement was used to estimate the contributions of each physical component-concentrations of milk and tea, or amounts of scattering and absorption-to perceived milkiness or tea strength. Separability of the two physical dimensions was better for real than for computer-generated teas, suggesting that interactions between scattering and absorption were correctly accounted for in perceptual unmixing, but unmixing was always imperfect. Since the real and rendered stimuli represent different physical processes and therefore differ in their image statistics, perceptual judgments with these stimuli allowed us to identify particular pseudocues (presumably learned with real stimuli) that explain judgments with both stimulus sets.

Delayed S-cone sensitivity losses following the onset of intense yellow backgrounds linked to the lifetime of a photobleaching product?

Thirty years ago, Mollon, Stockman, & Polden (1987) reported that after the onset of intense yellow 581-nm backgrounds, S-cone threshold rose unexpectedly for several seconds before recovering to the light-adapted steady-state value-an effect they called: "transient-tritanopia of the second kind" (TT2). Given that 581-nm lights have little direct effect on S-cones, TT2 must arise indirectly from the backgrounds' effects on the L- and M-cones. We attribute the phenomenon to the action of an unknown L- and M-cone photobleaching product, X, which acts at their outputs like an "equivalent" background light that then inhibits S-cones at a cone-opponent, second-site. The time-course of TT2 is similar in form to the lifetime of X in a two-stage, first-order biochemical reaction A→X→C with successive best-fitting time-constants of 3.09 ± 0.35 and 7.73 ± 0.70 s. Alternatively, with an additional slowly recovering exponential "restoring-force" with a best-fitting time-constant 23.94 ± 1.42 s, the two-stage best-fitting time-constants become 4.15 ± 0.62 and 6.79 ± 1.00 s. Because the time-constants are roughly independent of the background illumination, and thus the rate of photoisomerization, A→X is likely to be a reaction subsidiary to the retinoid cycle, perhaps acting as a buffer when the bleaching rate is too high. X seems to be logarithmically related to S-cone threshold, which may result from the logarithmic cone-opponent, second-site response compression after multiplicative first-site adaptation. The restoring-force may be the same cone-opponent force that sets the rate of S-cone recovery following the unusual threshold increase following the offset of dimmer yellow backgrounds, an effect known as "transient-tritanopia" (TT1).

Bow-shaped caustics from conical prisms: a 13th-century account of rainbow formation from Robert Grosseteste's De iride.

The rainbow has been the subject of discussion across a variety of historical periods and cultures, and numerous optical explanations have been suggested. Here, we further explore the scientific treatise De iride [On the Rainbow] written by Robert Grosseteste in the 13th century. Attempting to account for the shape of the rainbow, Grosseteste bases his explanation on the optical properties of transparent cones, which he claims can give rise to arc-shaped projections through refraction. By stating that atmospheric phenomena are reducible to the geometric optics of a conical prism, the De iride lays out a coherent and testable hypothesis. Through both physical experiment and physics-based simulation, we present a novel characterization of cone-light interactions, demonstrating that transparent cones do indeed give rise to bow-shaped caustics-a nonintuitive phenomenon that suggests Grosseteste's theory of the rainbow is likely to have been grounded in observation.

Hue shifts produced by temporal asymmetries in chromatic signals.

Observers viewed M- or L-cone-isolating stimuli and compared slowly-on and slowly-off sawtooth waveforms of the same mean chromaticity and luminance. Between 6 and 13 Hz, the mean hue of slowly-on L-cone and slowly-off M-cone sawtooth flicker appeared redder, and the mean hue of slowly-off L-cone and slowly-on M-cone sawtooth stimuli appeared greener-despite all the waveforms' having the same mean, near-yellow-appearing chromaticity. We measured the effect of the modulation depth and the slope of the sawtooth on the mean hue shifts as a function of temporal frequency. The results are complex but show that discriminability depended mainly on the second harmonic of the waveforms. We considered several models with combinations of linear and nonlinear stages. First, we considered models in which a nonlinear stage limits the rate of change of hue and restricts the steep slope of the sawtooth waveform more than its shallow slope, thus shifting the mean hue in the direction of the shallower slope (such a nonlinearity is also known as a slew-rate limit). Second, we considered saturation models in which the nonlinear stage compresses hue signals and thus shifts the mean of asymmetrical waveforms with or without differentiation before the nonlinearity. Overall, our modeling and results suggest that the hue shift occurs at some nonlinear mechanism in the chromatic pathway; and that, in terms of the Fourier components of the various waveforms, the effect of the nonlinearity depends crucially on the timing of the second harmonic relative to the first.

Low levels of specularity support operational color constancy, particularly when surface and illumination geometry can be inferred.

We tested whether surface specularity alone supports operational color constancy-the ability to discriminate changes in illumination or reflectance. Observers viewed short animations of illuminant or reflectance changes in rendered scenes containing a single spherical surface and were asked to classify the change. Performance improved with increasing specularity, as predicted from regularities in chromatic statistics. Peak performance was impaired by spatial rearrangements of image pixels that disrupted the perception of illuminated surfaces but was maintained with increased surface complexity. The characteristic chromatic transformations that are available with nonzero specularity are useful for operational color constancy, particularly if accompanied by appropriate perceptual organization.

S-cone psychophysics.

We review the features of the S-cone system that appeal to the psychophysicist and summarize the celebrated characteristics of S-cone mediated vision. Two factors are emphasized: First, the fine stimulus control that is required to isolate putative visual mechanisms and second, the relationship between physiological data and psychophysical approaches. We review convergent findings from physiology and psychophysics with respect to asymmetries in the retinal wiring of S-ON and S-OFF visual pathways, and the associated treatment of increments and decrements in the S-cone system. Beyond the retina, we consider the lack of S-cone projections to superior colliculus and the use of S-cone stimuli in experimental psychology, for example to address questions about the mechanisms of visually driven attention. Careful selection of stimulus parameters enables psychophysicists to produce entirely reversible, temporary, "lesions," and to assess behavior in the absence of specific neural subsystems.

Color-coordinate system from a 13th-century account of rainbows.

We present a new analysis of Robert Grosseteste's account of color in his treatise De iride (On the Rainbow), dating from the early 13th century. The work explores color within the 3D framework set out in Grosseteste's De colore [see J. Opt. Soc. Am. A29, A346 (2012)], but now links the axes of variation to observable properties of rainbows. We combine a modern understanding of the physics of rainbows and of human color perception to resolve the linguistic ambiguities of the medieval text and to interpret Grosseteste's key terms.

Different aberrations raise contrast thresholds for single-letter identification in line with their effect on cross-correlation-based confusability.

We previously showed that different types of aberration defocus, coma, and secondary astigmatism affect reading performance via different mechanisms. In this paper, we show the contrary result that, for identification of isolated letters, the effects of rendering different types of aberration can be described by a single cross-correlation-based metric. Aberrations reduce the effective resolution of an optical system, quantified by the high-frequency fall-off of the modulation transfer function. They additionally cause spatial-frequency-dependent phase and contrast changes, which have a size-dependent effect on letter forms. We used contrast threshold as our performance measure, instead of distance acuity, to separate the effects of form alterations from those of resolution limits. This measure is additionally appropriate in comparing single-letter-based performance to reading at a fixed distance. The relationship between a cross-correlation-based measure of letter confusability and performance was the same for all three types of aberration. For reading, we had found a different relationship for coma than for defocus and secondary astigmatism. We conclude that even when two tasks--letter identification and reading--use the same component stimulus set, the combination of multiple letters in a reading task produces functional differences between the effects of these aberrations that are not present for isolated letters.

Bright-light distractions and visual performance.

Visual distractions pose a significant risk to transportation safety, with laser attacks against aircraft pilots being a common example. This study used a research-grade High Dynamic Range (HDR) display to produce bright-light distractions for 12 volunteer participants performing a combined visual task across central and peripheral visual fields. The visual scene had an average luminance of 10 cd∙m-2 with targets of approximately 0.5° angular size, while the distractions had a maximum luminance of 9,000 cd∙m-2 and were 3.6° in size. The dependent variables were the mean fixation duration during task execution (representative of information processing time), and the critical stimulus duration required to support a target level of performance (representative of task efficiency). The experiment found a statistically significant increase in mean fixation duration, rising from 192 ms without distractions to 205 ms with bright-light distractions (p = 0.023). This indicates a decrease in visibility of the low contrast targets or an increase in cognitive workload that required greater processing time for each fixation in the presence of the bright-light distractions. Mean critical stimulus duration was not significantly affected by the distraction conditions used in this study. Future experiments are suggested to replicate driving and/or piloting tasks and employ bright-light distractions based on real-world data, and we advocate the use of eye-tracking metrics as sensitive measures of changes in performance.

Modulation of the face- and body-selective visual regions by the motion and emotion of point-light face and body stimuli.

Neural regions selective for facial or bodily form also respond to facial or bodily motion in highly form-degraded point-light displays. Yet it is unknown whether these face-selective and body-selective regions are sensitive to human motion regardless of stimulus type (faces and bodies) or to the specific motion-related cues characteristic of their proprietary stimulus categories. Using fMRI, we show that facial and bodily motions activate selectively those populations of neurons that code for the static structure of faces and bodies. Bodily (vs. facial) motion activated body-selective EBA bilaterally and right but not left FBA, irrespective of whether observers judged the emotion or color-change in point-light angry, happy and neutral stimuli. Facial (vs. bodily) motion activated face-selective right and left FFA, but only during emotion judgments for right FFA. Moreover, the strength of responses to point-light bodies vs. faces positively correlated with voxelwise selectivity for static bodies but not faces, whereas the strength of responses to point-light faces positively correlated with voxelwise selectivity for static faces but not bodies. Emotional content carried by point-light form-from-motion cues was sufficient to enhance the activity of several regions, including bilateral EBA and right FFA and FBA. However, although the strength of emotional modulation in right and left EBA by point-light body movements was related to the degree of voxelwise selectivity to static bodies but not static faces, there was no evidence that emotional modulation in fusiform cortex occurred in a similarly stimulus category-selective manner. This latter finding strongly constrains the claim that emotionally expressive movements modulate precisely those neuronal populations that code for the viewed stimulus category.