What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Visual Tracking in Amblyopia: A Continuous Psychophysical Approach.

Purpose: This study aimed to explore the underlying mechanisms of the observed visuomotor deficit in amblyopia. Methods: Twenty-four amblyopic (25.8 ± 3.8 years; 15 males) and 22 normal participants (25.8 ± 2.1 years; 8 males) took part in the study. The participants were instructed to continuously track a randomly moving Gaussian target on a computer screen using a mouse. In experiment 1, the participants performed the tracking task at six different target sizes. In experiments 2 and 3, they were asked to track a target with the contrast adjusted to individual's threshold. The tracking performance was represented by the kernel function calculated as the cross-correlation between the target and mouse displacements. The peak, latency, and width of the kernel were extracted and compared between the two groups. Results: In experiment 1, target size had a significant effect on the kernel peak (F(1.649, 46.170) = 200.958, P = 4.420 × 10-22). At the smallest target size, the peak in the amblyopic group was significantly lower than that in the normal group (0.089 ± 0.023 vs. 0.107 ± 0.020, t(28) = -2.390, P = 0.024) and correlated with the contrast sensitivity function (r = 0.739, P = 0.002) in the amblyopic eyes. In experiments 2 and 3, with equally visible stimuli, there were still differences in the kernel between the two groups (all Ps < 0.05). Conclusions: When stimulus visibility was compensated, amblyopic participants still showed significantly poorer tracking performance.

Numerical values modulate size perception.

The link between various codes of magnitude and their interactions has been studied extensively for many years. In the current study, we examined how the physical and numerical magnitudes of digits are mapped into a combined mental representation. In two psychophysical experiments, participants reported the physically larger digit among two digits. In the identical condition, participants compared digits of an identical value (e.g., "2" and "2"); in the different condition, participants compared digits of distinct numerical values (i.e., "2" and "5"). As anticipated, participants overestimated the physical size of a numerically larger digit and underestimated the physical size of a numerically smaller digit. Our results extend the shared-representation account of physical and numerical magnitudes.

Peripheral vision and crowding in mental maze-solving.

Solving a maze effectively relies on both perception and cognition. Studying maze-solving behavior contributes to our knowledge about these important processes. Through psychophysical experiments and modeling simulations, we examine the role of peripheral vision, specifically visual crowding in the periphery, in mental maze-solving. Experiment 1 measured gaze patterns while varying maze complexity, revealing a direct relationship between visual complexity and maze-solving efficiency. Simulations of the maze-solving task using a peripheral vision model confirmed the observed crowding effects while making an intriguing prediction that saccades provide a conservative measure of how far ahead observers can perceive the path. Experiment 2 confirms that observers can judge whether a point lies on the path at considerably greater distances than their average saccade. Taken together, our findings demonstrate that peripheral vision plays a key role in mental maze-solving.

Surround masking reveals binocular adding and differencing channels.

Recent studies suggest that binocular adding S+ and differencing S- channels play an important role in binocular vision. To test for such a role in the context of binocular contrast detection and binocular summation, we employed a surround masking paradigm consisting of a central target disk surrounded by a mask annulus. All stimuli were horizontally oriented 0.5c/d sinusoidal gratings. Correlated stimuli were identical in interocular spatial phase while anticorrelated stimuli were opposite in interocular spatial phase. There were four target conditions: monocular left eye, monocular right eye, binocular correlated and binocular anticorrelated, and three surround mask conditions: no surround, binocularly correlated and binocularly anticorrelated. We observed consistent elevation of detection thresholds for monocular and binocular targets across the two binocular surround mask conditions. In addition, we found an interaction between the type of surround and the type of binocular target: both detection and summation were relatively enhanced by surround masks and targets with opposite interocular phase relationships and reduced by surround masks and targets with the same interocular phase relationships. The data were reasonably well accounted for by a model of binocular combination termed MAX (S+S-), in which the decision variable is the probability summation of modeled S+ and S- channel responses, with a free parameter determining the relative gains of the two channels. Our results support the existence of two channels involved in binocular combination, S+ and S-, whose relative gains are adjustable by surround context.

An Automated Visual Psychophysics Method to Measure Visual Function in Swine Preclinical Animal Model.

Purpose: The aim of this study was to develop and validate a test to assess visual function in pigs using the visual psychophysics contrast sensitivity function. Methods: We utilized a touchscreen along with a pellet reward dispenser to train three Göttingen pigs on a visual psychophysics test and determined their contrast sensitivity function. Images with different contrast resolutions were used as visual stimuli and presented against a control image in a two-choice test. Following animals' acclimatization and the first phase of training, the system was arranged such that animals could self-run multiple consecutive trials without human intervention. Results: All animals were trained within a week and remembered the task with 1 day of reinforcement when tested 1 month after the last visual assessment. All trained animals performed well during the trial with minimal screen side bias, especially at contrast threshold above 40%. Conclusions: Göttingen pigs are trainable for a visual psychophysics test and able to self-run the trial without human intervention. Translational Relevance: Contrast sensitivity is one of the key parameters to assess visual function in humans. The possibility of measuring the same parameters in a large animal model allows for a better translation and understanding of drug safety and efficacy in preclinical ophthalmology.

Are ipRGCs involved in human color vision? Hints from physiology, psychophysics, and natural image statistics.

Human photoreceptors consist of cones, rods, and melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs). First studied in circadian regulation and pupillary control, ipRGCs project to a variety of brain centers suggesting a broader involvement beyond non-visual functions. IpRGC responses are stable, long-lasting, and with a particular codification of photoreceptor signals. In comparison with the transient and adaptive nature of cone and rod signals, ipRGCs' signaling might provide an ecological advantage to different attributes of color vision. Previous studies have indicated melanopsin's influence on visual responses yet its contribution to color perception in humans remains debated. We summarized evidence and hypotheses (from physiology, psychophysics, and natural image statistics) about direct and indirect involvement of ipRGCs in human color vision, by first briefly assessing the current knowledge about the role of melanopsin and ipRGCs in vision and codification of spectral signals. We then approached the question about melanopsin activation eliciting a color percept, discussing studies using the silent substitution method. Finally, we explore various avenues through which ipRGCs might impact color perception indirectly, such as through involvement in peripheral color matching, post-receptoral pathways, color constancy, long-term chromatic adaptation, and chromatic induction. While there is consensus about the role of ipRGCs in brightness perception, confirming its direct contribution to human color perception requires further investigation. We proposed potential approaches for future research, emphasizing the need for empirical validation and methodological thoroughness to elucidate the exact role of ipRGCs in human color vision.

Motion-Acuity Test for Visual Field Acuity Measurement with Motion-Defined Shapes.

The standard visual acuity measurements rely on stationary stimuli, either letters (Snellen charts), vertical lines (vernier acuity) or grating charts, processed by those regions of the visual system most sensitive to the stationary stimulation, receiving visual input from the central part of the visual field. Here, an acuity measurement is proposed based on discrimination of simple shapes, that are defined by motion of the dots in the random dot kinematograms (RDK) processed by visual regions sensitive to motion stimulation and receiving input also from the peripheral visual field. In the motion-acuity test, participants are asked to distinguish between a circle and an ellipse, with matching surfaces, built from RDKs, and separated from the background RDK either by coherence, direction, or velocity of dots. The acuity measurement is based on ellipse detection, which with every correct response becomes more circular until reaching the acuity threshold. The motion-acuity test can be presented in negative contrast (black dots on white background) or in positive contrast (white dots on black background). The motion defined shapes are located centrally within 8 visual degrees and are surrounded by RDK background. To test the influence of visual peripheries on centrally measured acuity, a mechanical narrowing of the visual field to 10 degrees is proposed, using opaque goggles with centrally located holes. This easy and replicable narrowing system is suitable for MRI protocols, allowing further investigations of the functions of the peripheral visual input. Here, a simple measurement of shape and motion perception simultaneously is proposed. This straightforward test assesses vision impairments depending on the central and peripheral visual field inputs. The proposed motion-acuity test advances the capability of standard tests to reveal spare or even strengthened vision functions in patients with injured visual system, that until now remained undetected.

The psychophysics of home plate umpire calls.

We analyze the visual perception task that home plate umpires (N = 121) perform calling balls and strikes (N = 3,001,019) in baseball games, focusing on the topics of perceptual learning and bias in decision-making. In the context of perceptual learning, our results show that monitoring, training, and feedback improve skill over time. In addition, we document two other aspects of umpires' improvement that are revealing with respect to the nature of their perceptual expertise. First, we show that biases in umpires' decision-making persist even as their overall accuracy improves. This suggests that bias and accuracy are orthogonal and that reduction of bias in decision-making requires interventions aimed specifically at this goal. Second, we measure a distinct difference in the rate of skill improvement between older and younger umpires. Younger umpires improve more quickly, suggesting that the decision task umpires engage in becomes routinized over time.

Over- and underweighting of extreme values in decisions from sequential samples.

People routinely make decisions based on samples of numerical values. A common conclusion from the literature in psychophysics and behavioral economics is that observers subjectively compress magnitudes, such that extreme values have less sway over people's decisions than prescribed by a normative model (underweighting). However, recent studies have reported evidence for anti-compression, that is, the relative overweighting of extreme values. Here, we investigate potential reasons for this discrepancy in findings and propose that it might reflect adaptive responses to different task requirements. We performed a large-scale study (n = 586) of sequential numerical integration, manipulating (a) the task requirement (averaging a single stream or comparing two interleaved streams of numbers), (b) the distribution of sample values (uniform or Gaussian), and (c) their range (1-9 or 100-900). The data showed compression of subjective values in the averaging task, but anticompression in the comparison task. This pattern held for both distribution types and for both ranges. In model simulations, we show that either compression or anticompression can be beneficial for noisy observers, depending on the sample-level processing demands imposed by the task. This suggests that the empirically observed patterns of over- and underweighting might reflect adaptive responses. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Theoretical and Technical Issues Concerning the Measurement of Alpha Frequency and the Application of Signal Detection Theory: Comment on Buergers and Noppeney (2022).

Classical and recent evidence has suggested that alpha oscillations play a critical role in temporally discriminating or binding successively presented items. Challenging this view, Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022] found that by combining EEG, psychophysics, and signal detection theory, neither prestimulus nor resting-state alpha frequency influences perceptual sensitivity and bias in the temporal binding task. We propose the following four points that should be considered when interpreting the role of alpha oscillations, and especially their frequency, on perceptual temporal binding: (1) Multiple alpha components can be contaminated in conventional EEG analysis; (2) the effect of alpha frequency on perception will interact with alpha power; (3) prestimulus and resting-state alpha frequency can be different from poststimulus alpha frequency, which is the frequency during temporal binding and should be more directly related to temporal binding; and (4) when applying signal detection theory under the assumption of equal variance, the assumption is often incomplete and can be problematic (e.g., the magnitude relationships between individuals in parametric sensitivity may change when converted into nonparametric sensitivity). Future directions, including solutions to each of the issues, are discussed.

Mission impossible? Spatial context relearning following a target relocation event depends on cue predictiveness.

Visual search for a target is faster when the spatial layout of distractors is repeatedly encountered, illustrating that statistical learning of contextual invariances facilitates attentional guidance (contextual cueing; Chun & Jiang, 1998, Cognitive Psychology, 36, 28-71). While contextual learning is usually relatively efficient, relocating the target to an unexpected location (within an otherwise unchanged search layout) typically abolishes contextual cueing and the benefits deriving from invariant contexts recover only slowly with extensive training (Zellin et al., 2014, Psychonomic Bulletin & Review, 21(4), 1073-1079). However, a recent study by Peterson et al. (2022, Attention, Perception, & Psychophysics, 84(2), 474-489) in fact reported rather strong adaptation of spatial contextual memories following target position changes, thus contrasting with prior work. Peterson et al. argued that previous studies may have been underpowered to detect a reliable recovery of contextual cueing after the change. However, their experiments also used a specific display design that frequently presented the targets at the same locations, which might reduce the predictability of the contextual cues thereby facilitating its flexible relearning (irrespective of statistical power). The current study was a (high-powered) replication of Peterson et al., taking into account both statistical power and target overlap in context-memory adaptation. We found reliable contextual cueing for the initial target location irrespective of whether the targets shared their location across multiple displays, or not. However, contextual adaptation following a target relocation event occurred only when target locations were shared. This suggests that cue predictability modulates contextual adaptation, over and above a possible (yet negligible) influence of statistical power.

Examining Increment thresholds as a function of pedestal contrast under hypothetical parvo- and magnocellular-biased conditions.

Theoretically, the pulsed- and steady-pedestal paradigms are thought to track contrast-increment thresholds (ΔC) as a function of pedestal contrast (C) for the parvocellular (P) and magnocellular (M) systems, respectively, yielding linear ΔC versus C functions for the pulsed- and nonlinear functions for the steady-pedestal paradigm. A recent study utilizing these paradigms to isolate the P and M systems reported no evidence of the M system being suppressed by red light, contrary to previous physiological and psychophysical findings. Curious as to why this may have occurred, we examined how ΔC varies with C for the P and M systems using the pulsed- and steady-pedestal paradigms and stimuli biased towards the P or M systems based on their sensitivity to spatial frequency (SF) and color. We found no effect of color and little influence of SF. To explain this lack of color effects, we used a quantitative model of ΔC (as it changes with C) to obtain Csat and contrast-gain values. The contrast-gain values (i) contradicted the hypothesis that the steady-pedestal paradigm tracks the M-system response, and (ii) our obtained Csat values indicated strongly that both pulsed- and steady-pedestal paradigms track primarily the P-system response.

Responding, fast and slow: Visual detection and localization performance is unaffected by retrieval.

According to action control theories, responding to a stimulus leads to the binding of the response and stimulus features into an event file. Repeating any component of the latter retrieves previous information, affecting ongoing performance. Based on years of attentional orienting research, recent boundaries of such binding theories have been proposed as binding effects are fully absent in visual detection (e.g., Schöpper et al., 2020, Attention, Perception, & Psychophysics, 82(4), 2085-2097) and localization (e.g., Schöpper & Frings, 2022; Visual Cognition, 30(10), 641-658) performance. While this can be attributed to specific task demands, the possibility remains that retrieval of previous event files is hampered in such tasks due to overall fast responding. In the current study we instructed participants to signal the detection (Experiment 1) and location (Experiment 2) of dots orthogonally repeating or changing their nonspatial identity and location. Crucially, the dots were either hard or easy to perceive. As expected, making targets hard to perceive drastically slowed down detection and localization response speed. Importantly, binding effects were absent irrespective of perceptibility. In contrast, discriminating the nonspatial identity of targets (Experiment 3) showed strong binding effects. These results highlight the impact of task-dependence for binding approaches in action control.

Psychophysics may be the game-changer for deep neural networks (DNNs) to imitate the human vision.

Psychologically faithful deep neural networks (DNNs) could be constructed by training with psychophysics data. Moreover, conventional DNNs are mostly monocular vision based, whereas the human brain relies mainly on binocular vision. DNNs developed as smaller vision agent networks associated with fundamental and less intelligent visual activities, can be combined to simulate more intelligent visual activities done by the biological brain.

Introspective inference counteracts perceptual distortion.

Introspective agents can recognize the extent to which their internal perceptual experiences deviate from the actual states of the external world. This ability, also known as insight, is critically required for reality testing and is impaired in psychosis, yet little is known about its cognitive underpinnings. We develop a Bayesian modeling framework and a psychophysics paradigm to quantitatively characterize this type of insight while people experience a motion after-effect illusion. People can incorporate knowledge about the illusion into their decisions when judging the actual direction of a motion stimulus, compensating for the illusion (and often overcompensating). Furthermore, confidence, reaction-time, and pupil-dilation data all show signatures consistent with inferential adjustments in the Bayesian insight model. Our results suggest that people can question the veracity of what they see by making insightful inferences that incorporate introspective knowledge about internal distortions.

The psychophysics of human three-dimensional active visuospatial problem-solving.

Our understanding of how visual systems detect, analyze and interpret visual stimuli has advanced greatly. However, the visual systems of all animals do much more; they enable visual behaviours. How well the visual system performs while interacting with the visual environment and how vision is used in the real world is far from fully understood, especially in humans. It has been suggested that comparison is the most primitive of psychophysical tasks. Thus, as a probe into these active visual behaviours, we use a same-different task: Are two physical 3D objects visually the same? This task is a fundamental cognitive ability. We pose this question to human subjects who are free to move about and examine two real objects in a physical 3D space. The experimental design is such that all behaviours are directed to viewpoint change. Without any training, our participants achieved a mean accuracy of 93.82%. No learning effect was observed on accuracy after many trials, but some effect was seen for response time, number of fixations and extent of head movement. Our probe task, even though easily executed at high-performance levels, uncovered a surprising variety of complex strategies for viewpoint control, suggesting that solutions were developed dynamically and deployed in a seemingly directed hypothesize-and-test manner tailored to the specific task. Subjects need not acquire task-specific knowledge; instead, they formulate effective solutions right from the outset, and as they engage in a series of attempts, those solutions progressively refine, becoming more efficient without compromising accuracy.

Motion direction is represented as a bimodal probability distribution in the human visual cortex.

Humans infer motion direction from noisy sensory signals. We hypothesize that to make these inferences more precise, the visual system computes motion direction not only from velocity but also spatial orientation signals - a 'streak' created by moving objects. We implement this hypothesis in a Bayesian model, which quantifies knowledge with probability distributions, and test its predictions using psychophysics and fMRI. Using a probabilistic pattern-based analysis, we decode probability distributions of motion direction from trial-by-trial activity in the human visual cortex. Corroborating the predictions, the decoded distributions have a bimodal shape, with peaks that predict the direction and magnitude of behavioral errors. Interestingly, we observe similar bimodality in the distribution of the observers' behavioral responses across trials. Together, these results suggest that observers use spatial orientation signals when estimating motion direction. More broadly, our findings indicate that the cortical representation of low-level visual features, such as motion direction, can reflect a combination of several qualitatively distinct signals.

Poster Session: Achromatic increments and decrements are different: the relationship between scaling and discrimination.

A basic problem in psychophysics is to relate the internal representation of a stimulus to its physical intensity. In this study, we measured perceptual scales for achromatic contrast with Maximum Likelihood Difference Scaling (MLDS), using squares against a mid-grey background. Observers compared two stimulus pairs and chose the more different pair. All four squares were either achromatic increments (A+), or achromatic decrements (A-). The MLDS result was then compared with 2AFC achromatic pedestal discrimination, with pedestals and tests that were all combinations of A+ and A-. The main result is not novel: A+ and A- obey different rules. A Naka-Rushton saturating function describes the A+ MLDS result well, and the derivative of that function is proportional to the A+ pedestal discrimination for some (but not all) observers. A- MLDS and discrimination results are more complicated and are reminiscent of the classic findings of Whittle (1986, 1992). The sensitivity of A- is a cubic polynomial function of pedestal contrast. These findings will be compared with a similar study of S-cone contrast (reported at VSS 2022), which found a different type of asymmetry between S+ and S-. Presumably these increment/decrement asymmetries are due to underlying differences between ON and OFF neural pathways. One implication is that using stimuli that include both contrast signs, such as gratings and flicker, may obscure important asymmetries in the processing of contrast.