Representational geometry of perceptual decisions in the monkey parietal cortex.

Lateral intraparietal (LIP) neurons represent formation of perceptual decisions involving eye movements. In circuit models for these decisions, neural ensembles that encode actions compete to form decisions. Consequently, representation and readout of the decision variables (DVs) are implemented similarly for decisions with identical competing actions, irrespective of input and task context differences. Further, DVs are encoded as partially potentiated action plans through balance of activity of action-selective ensembles. Here, we test those core principles. We show that in a novel face-discrimination task, LIP firing rates decrease with supporting evidence, contrary to conventional motion-discrimination tasks. These opposite response patterns arise from similar mechanisms in which decisions form along curved population-response manifolds misaligned with action representations. These manifolds rotate in state space based on context, indicating distinct optimal readouts for different tasks. We show similar manifolds in lateral and medial prefrontal cortices, suggesting similar representational geometry across decision-making circuits.

Neural Correlates of Crowding in Macaque Area V4.

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Many psychophysical studies have investigated this phenomenon and proposed alternative models for the underlying mechanisms. One prominent hypothesis, albeit with mixed psychophysical support, posits that crowding arises from the loss of information due to pooled encoding of features from target and distractor stimuli in the early stages of cortical visual processing. However, neurophysiological studies have not rigorously tested this hypothesis. We studied the responses of single neurons in macaque (one male, one female) area V4, an intermediate stage of the object-processing pathway, to parametrically designed crowded displays and texture statistics-matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters-number, distance, and position of distractors-influence human psychophysical performance and V4 shape selectivity. Importantly, we also found that enhancing the salience of a target stimulus could alleviate crowding effects in highly cluttered scenes, and this could be temporally protracted reflecting a dynamical process. Thus, a pooled encoding of nearby stimuli cannot explain the observed responses, and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays. Overall, we conclude that the magnitude of crowding effects is determined not just by the number of distractors and target-distractor separation but also by the relative salience of targets versus distractors based on their feature attributes-the similarity of distractors and the contrast between target and distractor stimuli.

Theoretical and Technical Issues Concerning the Measurement of Alpha Frequency and the Application of Signal Detection Theory: Comment on Buergers and Noppeney (2022).

Classical and recent evidence has suggested that alpha oscillations play a critical role in temporally discriminating or binding successively presented items. Challenging this view, Buergers and Noppeney [Buergers, S., & Noppeney, U. The role of alpha oscillations in temporal binding within and across the senses. Nature Human Behaviour, 6, 732-742, 2022] found that by combining EEG, psychophysics, and signal detection theory, neither prestimulus nor resting-state alpha frequency influences perceptual sensitivity and bias in the temporal binding task. We propose the following four points that should be considered when interpreting the role of alpha oscillations, and especially their frequency, on perceptual temporal binding: (1) Multiple alpha components can be contaminated in conventional EEG analysis; (2) the effect of alpha frequency on perception will interact with alpha power; (3) prestimulus and resting-state alpha frequency can be different from poststimulus alpha frequency, which is the frequency during temporal binding and should be more directly related to temporal binding; and (4) when applying signal detection theory under the assumption of equal variance, the assumption is often incomplete and can be problematic (e.g., the magnitude relationships between individuals in parametric sensitivity may change when converted into nonparametric sensitivity). Future directions, including solutions to each of the issues, are discussed.

Olfactory-trigeminal integration in the primary olfactory cortex.

Humans naturally integrate signals from the olfactory and intranasal trigeminal systems. A tight interplay has been demonstrated between these two systems, and yet the neural circuitry mediating olfactory-trigeminal (OT) integration remains poorly understood. Using functional magnetic resonance imaging (fMRI), combined with psychophysics, this study investigated the neural mechanisms underlying OT integration. Fifteen participants with normal olfactory function performed a localization task with air-puff stimuli, phenylethyl alcohol (PEA; rose odor), or a combination thereof while being scanned. The ability to localize PEA to either nostril was at chance. Yet, its presence significantly improved the localization accuracy of weak, but not strong, air-puffs, when both stimuli were delivered concurrently to the same nostril, but not when different nostrils received the two stimuli. This enhancement in localization accuracy, exemplifying the principles of spatial coincidence and inverse effectiveness in multisensory integration, was associated with multisensory integrative activity in the primary olfactory (POC), orbitofrontal (OFC), superior temporal (STC), inferior parietal (IPC) and cingulate cortices, and in the cerebellum. Multisensory enhancement in most of these regions correlated with behavioral multisensory enhancement, as did increases in connectivity between some of these regions. We interpret these findings as indicating that the POC is part of a distributed brain network mediating integration between the olfactory and trigeminal systems. PRACTITIONER POINTS: Psychophysical and neuroimaging study of olfactory-trigeminal (OT) integration. Behavior, cortical activity, and network connectivity show OT integration. OT integration obeys principles of inverse effectiveness and spatial coincidence. Behavioral and neural measures of OT integration are correlated.

A model of colour appearance based on efficient coding of natural images.

An object's colour, brightness and pattern are all influenced by its surroundings, and a number of visual phenomena and "illusions" have been discovered that highlight these often dramatic effects. Explanations for these phenomena range from low-level neural mechanisms to high-level processes that incorporate contextual information or prior knowledge. Importantly, few of these phenomena can currently be accounted for in quantitative models of colour appearance. Here we ask to what extent colour appearance is predicted by a model based on the principle of coding efficiency. The model assumes that the image is encoded by noisy spatio-chromatic filters at one octave separations, which are either circularly symmetrical or oriented. Each spatial band's lower threshold is set by the contrast sensitivity function, and the dynamic range of the band is a fixed multiple of this threshold, above which the response saturates. Filter outputs are then reweighted to give equal power in each channel for natural images. We demonstrate that the model fits human behavioural performance in psychophysics experiments, and also primate retinal ganglion responses. Next, we systematically test the model's ability to qualitatively predict over 50 brightness and colour phenomena, with almost complete success. This implies that much of colour appearance is potentially attributable to simple mechanisms evolved for efficient coding of natural images, and is a well-founded basis for modelling the vision of humans and other animals.

Attention facilitates initiation of perceptual decision making: a combined psychophysical and electroencephalography study.

Humans can selectively process information and make decisions by directing their attention to desired locations in their daily lives. Numerous studies have shown that attention increases the rate of correct responses and shortens reaction time, and it has been hypothesized that this phenomenon is caused by an increase in sensitivity of the sensory signals to which attention is directed. The present study employed psychophysical methods and electroencephalography (EEG) to test the hypothesis that attention accelerates the onset of information accumulation. Participants were asked to discriminate the motion direction of one of two random dot kinematograms presented on the left and right sides of the visual field, one of which was cued by an arrow in 80% of the trials. The drift-diffusion model was applied to the percentage of correct responses and reaction times in the attended and unattended fields of view. Attention primarily increased sensory sensitivity and shortened the time unrelated to decision making. Next, we measured centroparietal positivity (CPP), an EEG measure associated with decision making, and found that CPP latency was shorter in attended trials than in unattended trials. These results suggest that attention not only increases sensory sensitivity but also accelerates the initiation of decision making.

A paradigm for characterizing motion misperception in people with typical vision and low vision.

PURPOSE: We aimed to develop a paradigm that can efficiently characterize motion percepts in people with low vision and compare their responses with well-known misperceptions made by people with typical vision when targets are hard to see. METHODS: We recruited a small cohort of individuals with reduced acuity and contrast sensitivity (n = 5) as well as a comparison cohort with typical vision (n = 5) to complete a psychophysical study. Study participants were asked to judge the motion direction of a tilted rhombus that was either high or low contrast. In a series of trials, the rhombus oscillated vertically, horizontally, or diagonally. Participants indicated the perceived motion direction using a number wheel with 12 possible directions, and statistical tests were used to examine response biases. RESULTS: All participants with typical vision showed systematic misperceptions well predicted by a Bayesian inference model. Specifically, their perception of vertical or horizontal motion was biased toward directions orthogonal to the long axis of the rhombus. They had larger biases for hard-to-see (low contrast) stimuli. Two participants with low vision had a similar bias, but with no difference between high- and low-contrast stimuli. The other participants with low vision were unbiased in their percepts or biased in the opposite direction. CONCLUSIONS: Our results suggest that some people with low vision may misperceive motion in a systematic way similar to people with typical vision. However, we observed large individual differences. Future work will aim to uncover reasons for such differences and identify aspects of vision that predict susceptibility.

The neural basis for violations of Weber's law in self-motion perception.

A prevailing view is that Weber's law constitutes a fundamental principle of perception. This widely accepted psychophysical law states that the minimal change in a given stimulus that can be perceived increases proportionally with amplitude and has been observed across systems and species in hundreds of studies. Importantly, however, Weber's law is actually an oversimplification. Notably, there exist violations of Weber's law that have been consistently observed across sensory modalities. Specifically, perceptual performance is better than that predicted from Weber's law for the higher stimulus amplitudes commonly found in natural sensory stimuli. To date, the neural mechanisms mediating such violations of Weber's law in the form of improved perceptual performance remain unknown. Here, we recorded from vestibular thalamocortical neurons in rhesus monkeys during self-motion stimulation. Strikingly, we found that neural discrimination thresholds initially increased but saturated for higher stimulus amplitudes, thereby causing the improved neural discrimination performance required to explain perception. Theory predicts that stimulus-dependent neural variability and/or response nonlinearities will determine discrimination threshold values. Using computational methods, we thus investigated the mechanisms mediating this improved performance. We found that the structure of neural variability, which initially increased but saturated for higher amplitudes, caused improved discrimination performance rather than response nonlinearities. Taken together, our results reveal the neural basis for violations of Weber's law and further provide insight as to how variability contributes to the adaptive encoding of natural stimuli with continually varying statistics.

What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Peripheral vision and crowding in mental maze-solving.

Solving a maze effectively relies on both perception and cognition. Studying maze-solving behavior contributes to our knowledge about these important processes. Through psychophysical experiments and modeling simulations, we examine the role of peripheral vision, specifically visual crowding in the periphery, in mental maze-solving. Experiment 1 measured gaze patterns while varying maze complexity, revealing a direct relationship between visual complexity and maze-solving efficiency. Simulations of the maze-solving task using a peripheral vision model confirmed the observed crowding effects while making an intriguing prediction that saccades provide a conservative measure of how far ahead observers can perceive the path. Experiment 2 confirms that observers can judge whether a point lies on the path at considerably greater distances than their average saccade. Taken together, our findings demonstrate that peripheral vision plays a key role in mental maze-solving.

What we don't know about what babies know: Reconsidering psychophysics, exploration, and infant behavior.

Researchers must infer "what babies know" based on what babies do. Thus, to maximize information from doing, researchers should use tasks and tools that capture the richness of infants' behaviors. We clarify Gibson's views about the richness of infants' behavior and their exploration in the service of guiding action - what Gibson called "learning about affordances."

A horizon for haptic perception.

The spatial limits of sensory acquisition (its sensory horizon) are a fundamental property of any sensorimotor system. In the present study, we sought to determine whether there is a sensory horizon for the human haptic modality. At first blush, it seems obvious that the haptic system is bounded by the space where the body can interact with the environment (e.g., the arm span). However, the human somatosensory system is exquisitely tuned to sensing with tools-blind-cane navigation being a classic example of this. The horizon of haptic perception therefore extends beyond body space, but to what extent is unknown. We first used neuromechanical modeling to determine the theoretical horizon, which we pinpointed as 6 m. We then used a psychophysical localization paradigm to behaviorally confirm that humans can haptically localize objects using a 6-m rod. This finding underscores the incredible flexibility of the brain's sensorimotor representations, as they can be adapted to sense an object many times longer than the user's own body.NEW & NOTEWORTHY There are often spatial limits to where an active sensory system can sample information from the environment. Hand-held tools can extend human haptic perception beyond the body, but the limits of this extension are unknown. We used theoretical modeling and psychophysics to determine these spatial limits. We find that the ability to spatially localize objects through a tool extends at least 6 m beyond the user's body.

Preferential Attraction Effects With Visual Stimuli: The Role of Quantitative Versus Qualitative Visual Attributes.

Offering an inferior and rarely chosen third (decoy) option to decision makers choosing between two options has a paradoxical effect: It increases the choice share of the option most similar to the decoy. This attraction effect is robust when options are numeric but rarely occurs in humans when options are visual, even though it occurs in animals. Building on psychophysics, we examined two types of visual attributes: quantitative and qualitative. Quantitative visual attributes (e.g., different bottle volumes) can be perceived as magnitudes. Qualitative visual attributes (e.g., different colors), however, do not fall onto a magnitude scale. One can perceive that a bottle's volume is twice that of another bottle but not that a green bottle's color is twice that of a red bottle. We observed robust attraction effects for quantitative visual attributes (4,602 adults, 237 college-age participants), which reversed to repulsion effects when the visual attributes were qualitative (6,005 adults).

An initial 'snapshot' of sensory information biases the likelihood and speed of subsequent changes of mind.

We often need to rapidly change our mind about perceptual decisions in order to account for new information and correct mistakes. One fundamental, unresolved question is whether information processed prior to a decision being made ('pre-decisional information') has any influence on the likelihood and speed with which that decision is reversed. We investigated this using a luminance discrimination task in which participants indicated which of two flickering greyscale squares was brightest. Following an initial decision, the stimuli briefly remained on screen, and participants could change their response. Using psychophysical reverse correlation, we examined how moment-to-moment fluctuations in stimulus luminance affected participants' decisions. This revealed that the strength of even the very earliest (pre-decisional) evidence was associated with the likelihood and speed of later changes of mind. To account for this effect, we propose an extended diffusion model in which an initial 'snapshot' of sensory information biases ongoing evidence accumulation.

Contrast sensitivity functions measured using simple optics and computer testing.

PURPOSE: Contrast sensitivity function (CSF) testing is a common approach to assessing clinical changes to specific aspects of spatial vision. Different stimulus presentations and testing procedures, however, yield significant differences in CSF curves that are more a feature of the method than the observer. In this study, we designed a simple optical device for measuring CSF that could be directly calibrated and compared with a commonly used computer-based system. METHODS: Twenty-one participants (M = 28.95 ± 10.34 years; 66.7% female; 81.0% non-Hispanic White; best corrected visual acuity 6/9 or better) provided photopic CSFs (from measurements at 1.6, 3.2, 8, 16 and 24 cycles per degree, with spatial frequency presentation randomised) using both the Metropsis test platform and a simple optical device over two test sessions (one session/method, randomised, counterbalanced) separated by 1-7 days. The optical system used 520 nm lasers that were made Lambertian using two integrating spheres with a 3.5° circular exit port. These beams were combined with a beam splitter that allowed constant measurement of light output and contrast modulation using sine-wave gratings on glass. In Metropsis, 2° Gabor stimuli were presented for 0.5 s with either a vertical or a horizontal orientation via a two-alternative forced choice paradigm with contrast modulated until four (first) and eight (last) reversals were complete. RESULTS: Both methods took approximately the same amount of time to generate a CSF and yielded curves that were consistent with past studies using similar methods but different from each other. The optical system showed a 3.5 times higher maximum sensitivity and yielded higher test-retest reliability. CONCLUSIONS: Using simple optics to measure CSF yields low noise, high sensitivity and reliability. The ability to calibrate the stimuli directly is an advantage over computer-based methods.

Psychophysics of Pain: A Methodological Introduction.

For over 100 years, psychophysics ..÷ the scientific study between physical stimuli and sensation ... has been successfully employed in numerous scientific and healthcare disciplines, as an objective measure of sensory phenomena. This manuscript provides an overview of fundamental psychophysical concepts, emphasizing pain and research application..÷defining common terms, methods, and procedures.Psychophysics can provide systematic and objective measures of sensory perception that can be used by nursing scientists to explore complex, subjective phenomena..÷such as pain perception. While there needs to be improved standardization of terms and techniques, psychophysical approaches are diverse and may be tailored to address or augment current research paradigms. The interdisciplinary nature of psychophysics..÷like nursing..÷provides a unique lens for understanding how our perceptions are influenced by measurable sensations. While the quest to understand human perception is far from complete, nursing science has an opportunity to contribute to pain research by using the techniques and methods available through psychophysical procedures.

Poster Session: Achromatic increments and decrements are different: the relationship between scaling and discrimination.

A basic problem in psychophysics is to relate the internal representation of a stimulus to its physical intensity. In this study, we measured perceptual scales for achromatic contrast with Maximum Likelihood Difference Scaling (MLDS), using squares against a mid-grey background. Observers compared two stimulus pairs and chose the more different pair. All four squares were either achromatic increments (A+), or achromatic decrements (A-). The MLDS result was then compared with 2AFC achromatic pedestal discrimination, with pedestals and tests that were all combinations of A+ and A-. The main result is not novel: A+ and A- obey different rules. A Naka-Rushton saturating function describes the A+ MLDS result well, and the derivative of that function is proportional to the A+ pedestal discrimination for some (but not all) observers. A- MLDS and discrimination results are more complicated and are reminiscent of the classic findings of Whittle (1986, 1992). The sensitivity of A- is a cubic polynomial function of pedestal contrast. These findings will be compared with a similar study of S-cone contrast (reported at VSS 2022), which found a different type of asymmetry between S+ and S-. Presumably these increment/decrement asymmetries are due to underlying differences between ON and OFF neural pathways. One implication is that using stimuli that include both contrast signs, such as gratings and flicker, may obscure important asymmetries in the processing of contrast.

Poster Session: A unifying framework for perceptual decision-making.

Perceptual decision making (PDM) has been studied using two approaches. Threshold measurement is predominant used in psychophysics, while reaction times (RT) with associated models have been used to estimate components of PDM (i.e., drift rate). To test if these two approaches reflect overlapping mechanisms, we conducted 3 experiments: a motion, a static orientation, and a dynamic orientation task. DT is the shortest stimulus presentation time sufficient to make accurate perceptual decisions. RTs and choices were fitted by a drift diffusion model (DDM). We expected a close relationship between DTs and drift rates, allowing us to accurately predict DTs from RT. In the motion task, we found a close relation between the empirical DTs and the DTs predicted by the DDM. Surprisingly, in the static task, there was little correlation between the two; DTs, improved monotonically with higher contrast, but drift rates saturated at 6%. We hypothesize that this mismatch is due to the information being available immediately in the static task, without needing to accumulate new evidence. Thus, we developed a novel dynamic orientation task that mimics the dynamic nature of the motion task and found a similar relation between DTs and drift rates. In summary, we show a close link between DTs and drift rate for the two dynamic tasks. This result supports the conceptualization of drift rate as a proxy for perceptual sensitivity but only for task where new information becomes available over time.

Psychophysics may be the game-changer for deep neural networks (DNNs) to imitate the human vision.

Psychologically faithful deep neural networks (DNNs) could be constructed by training with psychophysics data. Moreover, conventional DNNs are mostly monocular vision based, whereas the human brain relies mainly on binocular vision. DNNs developed as smaller vision agent networks associated with fundamental and less intelligent visual activities, can be combined to simulate more intelligent visual activities done by the biological brain.