Measuring perceived differences in surface texture due to changes in higher order statistics.

We investigate the ability of humans to perceive changes in the appearance of images of surface texture caused by the variation of their higher order statistics. We incrementally randomize their phase spectra while holding their first and second order statistics constant in order to ensure that the change in the appearance is due solely to changes in third and other higher order statistics. Stimuli comprise both natural and synthetically generated naturalistic images, with the latter being used to prevent observers from making pixel-wise comparisons. A difference scaling method is used to derive the perceptual scales for each observer, which show a sigmoidal relationship with the degree of randomization. Observers were maximally sensitive to changes within the 20%-60% randomization range. In order to account for this behavior we propose a biologically plausible model that computes the variance of local measurements of phase congruency.

Testing limits on matte surface color perception in three-dimensional scenes with complex light fields.

We investigated limits on the human visual system's ability to discount directional variation in complex lights field when estimating Lambertian surface color. Directional variation in the light field was represented in the frequency domain using spherical harmonics. The bidirectional reflectance distribution function of a Lambertian surface acts as a low-pass filter on directional variation in the light field. Consequently, the visual system needs to discount only the low-pass component of the incident light corresponding to the first nine terms of a spherical harmonics expansion [Basri, R., Jacobs, D. (2001). Lambertian reflectance and linear subspaces. In: International Conference on Computer Vision II, pp. 383-390; Ramamoorthi, R., Hanrahan, P., (2001). An efficient representation for irradiance environment maps. SIGGRAPH 01. New York: ACM Press, pp. 497-500] to accurately estimate surface color. We test experimentally whether the visual system discounts directional variation in the light field up to this physical limit. Our results are consistent with the claim that the visual system can compensate for all of the complexity in the light field that affects the appearance of Lambertian surfaces.

The slope of the psychometric function at different wavelengths.

Many current models of visual detection predict that the slope of psychometric functions for detection will be independent of the spectral power distribution of the test light once the spatial and temporal characteristics of the light are fixed. This article examines reports that the slope of the psychometric function depends on the wavelength of a spectrally-narrowband test light of fixed size and duration. Three sources of difficulty that any experimental measurement of slope must encounter are addressed: (1) the different spatial distributions of the photoreceptor classes across the retina; (2) possible variations in threshold over the course of the experiment; and (3) the large variability of estimates of slope and the need for a method of assessing this variability. Measurements of slope with 2 and 4 deg test flashes against a bright 510 nm field show no significant trend with the wavelength of the test. A novel statistical test bounds the magnitude of possible variations in slope across the visible spectrum.

A video-input device that displays high-luminance, high-resolution color images.

We describe the design and performance of a bright, full-color, video-input display monitor that can produce image luminances as high as 50,000 cd/m2 for images 15 x 10 deg in size. We have constructed this device by rearranging the components of a commercially available projection television. Our display device allows an experimenter to evaluate human visual responses to complex spectro-spatio-temporal patterns presented at naturally occurring light levels.

A model of a single visual channel's response to weak test lights.

We describe a model of the response of a single visual channel to weak test lights. We assume that the initial channel response may be approximated as a linear filter whose output is sampled at random times. At each sample time there is some probability (increasing with the size of the filter response) that a detection event is generated. The detection events form the basis of the observer's detection and duration discrimination judgments. We derive the statistics of the detection events and empirical tests of the model. Assuming the probability of a detection event to be negligible in the absence of a signal, we derive an exact prediction of the form of the psychometric function for detection. Second, assuming that duration discrimination of weak test lights is based solely on the temporal separation of detection events, we predict the exact form of detection/discrimination performance. Third, assuming that the observer's response is initiated by the first detection event, we derive the form of the cumulative reaction time distribution.

Testing the indeterminacy of linear color mechanisms from color discrimination data.

It have previously been reported that, for some choices of the fixed spatial and temporal characteristics of test stimuli, it was possible to estimate the spectral sensitivities of chromatic mechanisms from chromatic discrimination data alone. If mechanism sensitivities could be reliably estimated for any choice of test stimuli characteristics, the influence of spatial and temporal factors on chromatic discrimination performance could be directly measured. Previous studies, using test stimuli with other spatio-temporal characteristics, have found equi-discrimination contours whose ellipsoidal shapes seem to preclude estimation of mechanisms. Since there is no commonly-accepted method for testing the adequacy of ellipsoidal fits of chromatic equi-discrimination contours, it is possible that alternative psychophysical procedures combined with more powerful statistical tests could detect the pattern of deviations from ellipticality reported previously. In this paper, we described psychophysical tests and statistical analyses that, taken together, provide a more powerful test of the indeterminacy of mechanisms than previous methods. We develop a method based on analysis of residuals for detecting the pattern of deviations from ellipticality. We apply these tests under fixed experimental conditions similar to those in which other researchers have found ellipsoidal equi-discrimination contours. For these conditions, for any of the tests performed, we do not reject the hypothesis that equi-discrimination surfaces are ellipsoidal.

Illuminant cues in surface color perception: tests of three candidate cues.

Many recent computational models of surface color perception presuppose information about illumination in scenes. The models differ primarily in the physical process each makes use of as a cue to the illuminant. We evaluated whether the human visual system makes use of any of three of the following candidate illuminant cues: (1) specular highlight, (2) full surface specularity [Lee, H. C. (1986). Method for computing the scene-illuminant chromaticity from specular highlights. Journal of the Optical Society of America A, 3(10), 1694-1699; D'Zmura, M., & Lennie, P. (1986). Mechanisms of color constancy. Journal of the Optical Society of America A, 3(10), 1662-1672], and (3) uniform background. Observers viewed simulated scenes binocularly in a computer-controlled Wheatstone stereoscope. All simulated scenes contained a uniform background plane perpendicular to the observer's line of sight and a small number of specular, colored spheres resting on the uniform background. Scenes were rendered under either standard illuminant D65 or standard illuminant A. Observers adjusted the color of a small, simulated test patch to appear achromatic. In a series of experiments we perturbed the illuminant color signaled by each candidate cue and looked for an influence of the changed cue on achromatic settings. We found that the specular highlight cue had a significant influence, but that the influence was asymmetric: greater when the base illuminant, CIE standard Illuminant A, was perturbed in the direction of Illuminant D65 than vice versa. Neither the full surface specularity cue nor the background cue had any observable influence. The lack of influence of the background cue is likely due to the placement of the test patch in front of the background rather than, as is typical, embedded in the background.

Proximity judgments in color space: tests of a Euclidean color geometry.

We describe two tests of the hypothesis that human judgments of the proximity of colors are consistent with a Euclidean geometry on color matching space. The first test uses proximity judgments to measure the angle between any two intersecting lines in color space. Pairwise estimates of the angles between three lines in a plane were made in order to test the additivity of angles. Three different color proximity tasks were considered. Additivity failed for each of the three proximity tasks. Secondly, we tested a prediction concerning the growth of the variability of judgments of similarity with the distance between the test and reference stimuli. The Euclidean hypothesis was also rejected by this test. The results concerning the growth of variability are consistent with the assumption that observers use a city-block metric when judging the proximity of colored lights.

Measurement and modeling of depth cue combination: in defense of weak fusion.

Various visual cues provide information about depth and shape in a scene. When several of these cues are simultaneously available in a single location in the scene, the visual system attempts to combine them. In this paper, we discuss three key issues relevant to the experimental analysis of depth cue combination in human vision: cue promotion, dynamic weighting of cues, and robustness of cue combination. We review recent psychophysical studies of human depth cue combination in light of these issues. We organize the discussion and review as the development of a model of the depth cue combination process termed modified weak fusion (MWF). We relate the MWF framework to Bayesian theories of cue combination. We argue that the MWF model is consistent with previous experimental results and is a parsimonious summary of these results. While the MWF model is motivated by normative considerations, it is primarily intended to guide experimental analysis of depth cue combination in human vision. We describe experimental methods, analogous to perturbation analysis, that permit us to analyze depth cue combination in novel ways. In particular these methods allow us to investigate the key issues we have raised. We summarize recent experimental tests of the MWF framework that use these methods.

A perturbation analysis of depth perception from combinations of texture and motion cues.

We examined how depth information from two different cue types (object motion and texture gradient) is integrated into a single estimate in human vision. Two critical assumptions of a recent model of depth cue combination (termed modified weak fusion) were tested. The first assumption is that the overall depth estimate is a weighted linear combination of the estimates derived from the individual cues, after initial processing needed to bring them to a common format. The second assumption is that the weight assigned to a cue reflects the apparent reliability of that cue in a particular scene. By this account, the depth combination rule is linear and dynamic, changing in a predictable fashion in response to the particular scene and viewing conditions. A novel procedure was used to measure the weights assigned to the texture and motion cues across experimental conditions. This procedure uses a type of perturbation analysis. The results are consistent with the weighted linear combination rule. In addition, when either cue is corrupted by added noise, the weighted linear combination rule shifts in favor of the uncontaminated cue.

The effect of perceived surface orientation on perceived surface albedo in binocularly viewed scenes.

We examined how observers discount perceived surface orientation in estimating perceived albedo (lightness). Observers viewed complex rendered scenes binocularly. The orientation of a test patch was defined by depth cues of binocular disparity and linear perspective. On each trial, observers first estimated the orientation of the test patch in the scene by means of a gradient probe and then matched its perceived albedo to a reference scale. We found that observers' perception of orientation was nearly veridical and that they substantially discounted perceived orientation in estimating perceived albedo.

Past trials influence perception of ambiguous motion quartets through pattern completion.

There are many celebrated examples of ambiguous perceptual configurations such as the Necker cube that abruptly and repeatedly "switch" among possible perceptual states. When such ambiguous configurations are presented intermittently, observers tend to see the same perceptual state on successive trials. The outcome of each trial apparently serves to "prime" the outcome of the following. We sought to determine how long the influence of a past trial persists by using ambiguous motion quartets as stimuli. We found large, significant effects of all four most recent trials, but the results were not consistent with any priming model. The results could be explained instead as perceptual completion of two kinds of temporal patterns, repeating and alternating. We conclude that the visual system does not passively remember perceptual state: it analyzes recent perceptual history and attempts to predict what will come next. These predictions can alter what is seen.

Evaluation of linear models of surface spectral reflectance with small numbers of parameters.

Recent computational models of color vision demonstrate that it is possible to achieve exact color constancy over a limited range of lights and surfaces described by linear models. The success of these computational models hinges on whether any sizable range of surface spectral reflectances can be described by a linear model with about three parameters. In the first part of this paper, I analyze two large sets of empirical surface spectral reflectances and examine three conjectures concerning constraints on surface reflectance: that empirical surface reflectances fall within a linear model with a small number of parameters, that empirical surface reflectances fall within a linear model composed of band-limited functions with a small number of parameters, and that the shape of the spectral-sensitivity curves of human vision enhance the fit between empirical surface reflectances and a linear model. I conclude that the first and second conjectures hold for the two sets of spectral reflectances analyzed but that the number of parameters required to model the spectral reflectances is five to seven, not three. A reanalysis of the empirical data that takes human visual sensitivity into account gives more promising results. The linear models derived provide excellent fits to the data with as few as three or four parameters, confirming the third conjecture. The results suggest that constraints on possible surface-reflectance functions and the "filtering" properties of the shapes of the spectral-sensitivity curves of photoreceptors can both contribute to color constancy. In the last part of the paper I derive the relation between the number of photoreceptor classes present in vision and the "filtering" properties of each class. The results of this analysis reverse a conclusion reached by Barlow: the "filtering" properties of human photoreceptors are consistent with a trichromatic visual system that is color constant.

Confidence intervals for the parameters of psychometric functions.

A Monte Carlo method for computing the bias and standard deviation of estimates of the parameters of a psychometric function such as the Weibull/Quick is described. The method, based on Efron's parametric bootstrap, can also be used to estimate confidence intervals for these parameters. The method's ability to predict bias, standard deviation, and confidence intervals is evaluated in two ways. First, its predictions are compared to the outcomes of Monte Carlo simulations of psychophysical experiments. Second, its predicted confidence intervals were compared with the actual variability of human observers in a psychophysical task. Computer programs implementing the method are available from the author.

Color constancy: a method for recovering surface spectral reflectance.

Human and machine visual sensing is enhanced when surface properties of objects in scenes, including color, can be reliably estimated despite changes in the ambient lighting conditions. We describe a computational method for estimating surface spectral reflectance when the spectral power distribution of the ambient light is not known.

Daylight, biochrome surfaces, and human chromatic response in the Fourier domain.

We first report Fourier analyses of a collection of 348 daylight spectral power distributions and 1,695 biochrome surface reflectance functions. The power spectra of the daylights are low pass with more than 99% of spectral power below 1 cycle/300 nm and 99.9% below 3 cycles/300 nm. The power spectra of reflectance functions are also low pass with more than 99% of spectral power below 4 cycles/300 nm and 99.9% below 11 cycles/300 nm. Consequently, the resulting color signals are typically low pass with, for our samples, an estimated frequency cutoff of 5 cycles/300 nm. Theoretical and experimental data concerning human chromatic response in the frequency domain show that this limit corresponds to the highest frequency that the color system can resolve. The implications for normal and abnormal human color vision are discussed.

An assessment of the semantic network in patients with Alzheimer's disease.

Abstract The present study employed multidimensional scaling and ADDTREE clustering analyses to derive the cognitive maps and clustering representations of normal elderly controls (NC), patients with Alzheimer's disease (AD), and patients with Hun-tington's disease (HD); the analyses were performed on subjects' responses in a category fluency task that involved generating animal names for 60 sec. A measure of the proximity of animal names was used as an index of associational strength; MDS and ADDTREE estimates were based on this measure. A comparison of the NC, AD, and HD subjects' cognitive maps suggests that the semantic network of AD patients is abnormal in two ways. First, the organization of the semantic network is disrupted. Second, new abnormal associations and clusterings are formed. These results support the notion that AD is characterized by a breakdown in the structure of semantic knowledge and not primarily by a deficiency in the accessibility of semantic information.