Integrated Perceptual Decisions Rely on Parallel Evidence Accumulation.

The ability to make accurate and timely decisions, such as judging when it is safe to cross the road, is the foundation of adaptive behavior. While the computational and neural processes supporting simple decisions on isolated stimuli have been well characterized, decision-making in the real world often requires integration of discrete sensory events over time and space. Most previous experimental work on perceptual decision-making has focused on tasks that involve only a single, task-relevant source of sensory input. It remains unclear, therefore, how such integrative decisions are regulated computationally. Here we used psychophysics, electroencephalography, and computational modeling to understand how the human brain combines visual motion signals across space in the service of a single, integrated decision. To that purpose, we presented two random-dot kinematograms in the left and the right visual hemifields. Coherent motion signals were shown briefly and concurrently in each location, and healthy adult human participants of both sexes reported the average of the two motion signals. We directly tested competing predictions arising from influential serial and parallel accounts of visual processing. Using a biologically plausible model of motion filtering, we found evidence in favor of parallel integration as the fundamental computational mechanism regulating integrated perceptual decisions.

Neural Correlates of Crowding in Macaque Area V4.

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Many psychophysical studies have investigated this phenomenon and proposed alternative models for the underlying mechanisms. One prominent hypothesis, albeit with mixed psychophysical support, posits that crowding arises from the loss of information due to pooled encoding of features from target and distractor stimuli in the early stages of cortical visual processing. However, neurophysiological studies have not rigorously tested this hypothesis. We studied the responses of single neurons in macaque (one male, one female) area V4, an intermediate stage of the object-processing pathway, to parametrically designed crowded displays and texture statistics-matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters-number, distance, and position of distractors-influence human psychophysical performance and V4 shape selectivity. Importantly, we also found that enhancing the salience of a target stimulus could alleviate crowding effects in highly cluttered scenes, and this could be temporally protracted reflecting a dynamical process. Thus, a pooled encoding of nearby stimuli cannot explain the observed responses, and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays. Overall, we conclude that the magnitude of crowding effects is determined not just by the number of distractors and target-distractor separation but also by the relative salience of targets versus distractors based on their feature attributes-the similarity of distractors and the contrast between target and distractor stimuli.

Olfactory-trigeminal integration in the primary olfactory cortex.

Humans naturally integrate signals from the olfactory and intranasal trigeminal systems. A tight interplay has been demonstrated between these two systems, and yet the neural circuitry mediating olfactory-trigeminal (OT) integration remains poorly understood. Using functional magnetic resonance imaging (fMRI), combined with psychophysics, this study investigated the neural mechanisms underlying OT integration. Fifteen participants with normal olfactory function performed a localization task with air-puff stimuli, phenylethyl alcohol (PEA; rose odor), or a combination thereof while being scanned. The ability to localize PEA to either nostril was at chance. Yet, its presence significantly improved the localization accuracy of weak, but not strong, air-puffs, when both stimuli were delivered concurrently to the same nostril, but not when different nostrils received the two stimuli. This enhancement in localization accuracy, exemplifying the principles of spatial coincidence and inverse effectiveness in multisensory integration, was associated with multisensory integrative activity in the primary olfactory (POC), orbitofrontal (OFC), superior temporal (STC), inferior parietal (IPC) and cingulate cortices, and in the cerebellum. Multisensory enhancement in most of these regions correlated with behavioral multisensory enhancement, as did increases in connectivity between some of these regions. We interpret these findings as indicating that the POC is part of a distributed brain network mediating integration between the olfactory and trigeminal systems. PRACTITIONER POINTS: Psychophysical and neuroimaging study of olfactory-trigeminal (OT) integration. Behavior, cortical activity, and network connectivity show OT integration. OT integration obeys principles of inverse effectiveness and spatial coincidence. Behavioral and neural measures of OT integration are correlated.

Attention facilitates initiation of perceptual decision making: a combined psychophysical and electroencephalography study.

Humans can selectively process information and make decisions by directing their attention to desired locations in their daily lives. Numerous studies have shown that attention increases the rate of correct responses and shortens reaction time, and it has been hypothesized that this phenomenon is caused by an increase in sensitivity of the sensory signals to which attention is directed. The present study employed psychophysical methods and electroencephalography (EEG) to test the hypothesis that attention accelerates the onset of information accumulation. Participants were asked to discriminate the motion direction of one of two random dot kinematograms presented on the left and right sides of the visual field, one of which was cued by an arrow in 80% of the trials. The drift-diffusion model was applied to the percentage of correct responses and reaction times in the attended and unattended fields of view. Attention primarily increased sensory sensitivity and shortened the time unrelated to decision making. Next, we measured centroparietal positivity (CPP), an EEG measure associated with decision making, and found that CPP latency was shorter in attended trials than in unattended trials. These results suggest that attention not only increases sensory sensitivity but also accelerates the initiation of decision making.

A paradigm for characterizing motion misperception in people with typical vision and low vision.

PURPOSE: We aimed to develop a paradigm that can efficiently characterize motion percepts in people with low vision and compare their responses with well-known misperceptions made by people with typical vision when targets are hard to see. METHODS: We recruited a small cohort of individuals with reduced acuity and contrast sensitivity (n = 5) as well as a comparison cohort with typical vision (n = 5) to complete a psychophysical study. Study participants were asked to judge the motion direction of a tilted rhombus that was either high or low contrast. In a series of trials, the rhombus oscillated vertically, horizontally, or diagonally. Participants indicated the perceived motion direction using a number wheel with 12 possible directions, and statistical tests were used to examine response biases. RESULTS: All participants with typical vision showed systematic misperceptions well predicted by a Bayesian inference model. Specifically, their perception of vertical or horizontal motion was biased toward directions orthogonal to the long axis of the rhombus. They had larger biases for hard-to-see (low contrast) stimuli. Two participants with low vision had a similar bias, but with no difference between high- and low-contrast stimuli. The other participants with low vision were unbiased in their percepts or biased in the opposite direction. CONCLUSIONS: Our results suggest that some people with low vision may misperceive motion in a systematic way similar to people with typical vision. However, we observed large individual differences. Future work will aim to uncover reasons for such differences and identify aspects of vision that predict susceptibility.

What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

Peripheral vision and crowding in mental maze-solving.

Solving a maze effectively relies on both perception and cognition. Studying maze-solving behavior contributes to our knowledge about these important processes. Through psychophysical experiments and modeling simulations, we examine the role of peripheral vision, specifically visual crowding in the periphery, in mental maze-solving. Experiment 1 measured gaze patterns while varying maze complexity, revealing a direct relationship between visual complexity and maze-solving efficiency. Simulations of the maze-solving task using a peripheral vision model confirmed the observed crowding effects while making an intriguing prediction that saccades provide a conservative measure of how far ahead observers can perceive the path. Experiment 2 confirms that observers can judge whether a point lies on the path at considerably greater distances than their average saccade. Taken together, our findings demonstrate that peripheral vision plays a key role in mental maze-solving.

What we don't know about what babies know: Reconsidering psychophysics, exploration, and infant behavior.

Researchers must infer "what babies know" based on what babies do. Thus, to maximize information from doing, researchers should use tasks and tools that capture the richness of infants' behaviors. We clarify Gibson's views about the richness of infants' behavior and their exploration in the service of guiding action - what Gibson called "learning about affordances."

Over- and underweighting of extreme values in decisions from sequential samples.

People routinely make decisions based on samples of numerical values. A common conclusion from the literature in psychophysics and behavioral economics is that observers subjectively compress magnitudes, such that extreme values have less sway over people's decisions than prescribed by a normative model (underweighting). However, recent studies have reported evidence for anti-compression, that is, the relative overweighting of extreme values. Here, we investigate potential reasons for this discrepancy in findings and propose that it might reflect adaptive responses to different task requirements. We performed a large-scale study (n = 586) of sequential numerical integration, manipulating (a) the task requirement (averaging a single stream or comparing two interleaved streams of numbers), (b) the distribution of sample values (uniform or Gaussian), and (c) their range (1-9 or 100-900). The data showed compression of subjective values in the averaging task, but anticompression in the comparison task. This pattern held for both distribution types and for both ranges. In model simulations, we show that either compression or anticompression can be beneficial for noisy observers, depending on the sample-level processing demands imposed by the task. This suggests that the empirically observed patterns of over- and underweighting might reflect adaptive responses. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The psychophysics of home plate umpire calls.

We analyze the visual perception task that home plate umpires (N = 121) perform calling balls and strikes (N = 3,001,019) in baseball games, focusing on the topics of perceptual learning and bias in decision-making. In the context of perceptual learning, our results show that monitoring, training, and feedback improve skill over time. In addition, we document two other aspects of umpires' improvement that are revealing with respect to the nature of their perceptual expertise. First, we show that biases in umpires' decision-making persist even as their overall accuracy improves. This suggests that bias and accuracy are orthogonal and that reduction of bias in decision-making requires interventions aimed specifically at this goal. Second, we measure a distinct difference in the rate of skill improvement between older and younger umpires. Younger umpires improve more quickly, suggesting that the decision task umpires engage in becomes routinized over time.

Aesthetic valence: Psychophysical perspectives.

Comparisons of aesthetic valence and of sensory magnitude are subject to similar order effects, indicating an evolved mechanism that sharpens also aesthetic discrimination. As the foundation of pleasantness and aesthetic valence of an object, an optimal level of evoked arousal or, in more recent research, of information load, has been proposed. According to discrepancy theory, this evoked effect is modulated by the object's deviation from the current adaptation level (AL). The AL is built up and updated by pooling recent stimulation. A model based on these concepts is proposed here, and it is illustrated by results of empirical studies by the author's students. For everyday objects such as cars and ladies' clothes, rated beauty was related by a U-shaped function to rated modernity. Minimal beauty occurred for intermediate modernity. For ladies' clothes, this minimum was situated higher on the modernity scale for females and extraverts. As modernity can be seen as the amount of deviation from the AL which represents the usual, this shift could be explained by faster upward adjustment of the AL. In contrast, for paintings the relation between modernity and beauty was inversely U-shaped. This could be due to paintings intrinsically carrying more information than other objects, as indicated by ratings of hard-to-access, with which rated beauty had an inverse U-shaped relation. In a factor-analytic study of preference for 42 paintings four orthogonal factors were extracted, interpreted as High and Low modernity, and High and Low information content. This could yield a rudimentary empirical typology of art.

The sands of time: Discontinuity in time production, or inadequacy of psychophysical fit?

In a recent study employing time production, a number of participants presented aberrant data, which normally would have marked them as being outliers. Given the ongoing discussion in the literature regarding the illusory nature of the flow of time, in this paper we consider whether their data may indicate discontinuity in time perception. We analyze the log-log plots for these outliers, investigating to what degree linearity is preserved for all the data points, as opposed to achieving a better fit using bisegmental regression. The current results, though preliminary, can contribute to the debate regarding the non-linearity of subjective time. It would seem that with longer target durations, the ongoing experience of time can be either one of a subjective slowing down of time (longer time units, increase in slope), or of a subjective speeding up of time (shorter time units, decrease in slope).

An Automated Visual Psychophysics Method to Measure Visual Function in Swine Preclinical Animal Model.

Purpose: The aim of this study was to develop and validate a test to assess visual function in pigs using the visual psychophysics contrast sensitivity function. Methods: We utilized a touchscreen along with a pellet reward dispenser to train three Göttingen pigs on a visual psychophysics test and determined their contrast sensitivity function. Images with different contrast resolutions were used as visual stimuli and presented against a control image in a two-choice test. Following animals' acclimatization and the first phase of training, the system was arranged such that animals could self-run multiple consecutive trials without human intervention. Results: All animals were trained within a week and remembered the task with 1 day of reinforcement when tested 1 month after the last visual assessment. All trained animals performed well during the trial with minimal screen side bias, especially at contrast threshold above 40%. Conclusions: Göttingen pigs are trainable for a visual psychophysics test and able to self-run the trial without human intervention. Translational Relevance: Contrast sensitivity is one of the key parameters to assess visual function in humans. The possibility of measuring the same parameters in a large animal model allows for a better translation and understanding of drug safety and efficacy in preclinical ophthalmology.

Motion-Acuity Test for Visual Field Acuity Measurement with Motion-Defined Shapes.

The standard visual acuity measurements rely on stationary stimuli, either letters (Snellen charts), vertical lines (vernier acuity) or grating charts, processed by those regions of the visual system most sensitive to the stationary stimulation, receiving visual input from the central part of the visual field. Here, an acuity measurement is proposed based on discrimination of simple shapes, that are defined by motion of the dots in the random dot kinematograms (RDK) processed by visual regions sensitive to motion stimulation and receiving input also from the peripheral visual field. In the motion-acuity test, participants are asked to distinguish between a circle and an ellipse, with matching surfaces, built from RDKs, and separated from the background RDK either by coherence, direction, or velocity of dots. The acuity measurement is based on ellipse detection, which with every correct response becomes more circular until reaching the acuity threshold. The motion-acuity test can be presented in negative contrast (black dots on white background) or in positive contrast (white dots on black background). The motion defined shapes are located centrally within 8 visual degrees and are surrounded by RDK background. To test the influence of visual peripheries on centrally measured acuity, a mechanical narrowing of the visual field to 10 degrees is proposed, using opaque goggles with centrally located holes. This easy and replicable narrowing system is suitable for MRI protocols, allowing further investigations of the functions of the peripheral visual input. Here, a simple measurement of shape and motion perception simultaneously is proposed. This straightforward test assesses vision impairments depending on the central and peripheral visual field inputs. The proposed motion-acuity test advances the capability of standard tests to reveal spare or even strengthened vision functions in patients with injured visual system, that until now remained undetected.

Sensory perception is a holistic inference process.

Sensory perception is widely considered an inference process that reflects the best guess of a stimulus feature based on uncertain sensory information. Here we challenge this reductionist view and propose that perception is rather a holistic inference process that operates not only at the feature but jointly across all levels of the representational hierarchy. We test this hypothesis in the context of a commonly used psychophysical matching task in which subjects are asked to report their perceived orientation of a test stimulus by adjusting a probe stimulus (method-of-adjustment). We introduce a holistic matching model that assumes that subjects' reports reflect an optimal match between the test and probe stimulus, both in terms of their inferred feature (orientation) and also their higher level representation (orientation category). Validation against several existing data sets demonstrates that the model accurately and comprehensively predicts subjects' response behavior and outperforms previous models both qualitatively and quantitatively. Moreover, the model generalizes to other feature domains and offers an alternative account for categorical color perception. Our results suggest that categorical effects in sensory perception are ubiquitous and can be parsimoniously explained as optimal behavior based on holistic sensory representations. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Limited information-processing capacity in vision explains number psychophysics.

Humans and other animals are able to perceive and represent a number of objects present in a scene, a core cognitive ability thought to underlie the development of mathematics. However, the perceptual mechanisms that underpin this capacity remain poorly understood. Here, we show that our visual sense of number derives from a visual system designed to efficiently encode the location of objects in scenes. Using a mathematical model, we demonstrate that an efficient but information-limited encoding of objects' locations can explain many key aspects of number psychophysics, including subitizing, Weber's law, underestimation, and effects of exposure time. In two experiments (N = 100 each), we find that this model of visual encoding captures human performance in both a change-localization task and a number estimation task. In a third experiment (N = 100), we find that individual differences in change-localization performance are highly predictive of differences in number estimation, both in terms of overall performance and inferred model parameters, with participants having numerically indistinguishable inferred information capacities across tasks. Our results therefore indicate that key psychophysical features of numerical cognition do not arise from separate modules or capacities specific to number, but rather as by-products of lower level constraints on perception. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A Bayesian hierarchical model for the analysis of visual analogue scaling tasks.

In psychophysics and psychometrics, an integral method to the discipline involves charting how a person's response pattern changes according to a continuum of stimuli. For instance, in hearing science, Visual Analog Scaling tasks are experiments in which listeners hear sounds across a speech continuum and give a numeric rating between 0 and 100 conveying whether the sound they heard was more like word "a" or more like word "b" (i.e. each participant is giving a continuous categorization response). By taking all the continuous categorization responses across the speech continuum, a parametric curve model can be fit to the data and used to analyze any individual's response pattern by speech continuum. Standard statistical modeling techniques are not able to accommodate all of the specific requirements needed to analyze these data. Thus, Bayesian hierarchical modeling techniques are employed to accommodate group-level non-linear curves, individual-specific non-linear curves, continuum-level random effects, and a subject-specific variance that is predicted by other model parameters. In this paper, a Bayesian hierarchical model is constructed to model the data from a Visual Analog Scaling task study of mono-lingual and bi-lingual participants. Any nonlinear curve function could be used and we demonstrate the technique using the 4-parameter logistic function. Overall, the model was found to fit particularly well to the data from the study and results suggested that the magnitude of the slope was what most defined the differences in response patterns between continua.

A role of rectangularity in perceiving a 3D shape of an object.

Rectangularity and perpendicularity of contours are important properties of 3D shape for the visual system and the visual system can use them asa prioriconstraints for perceivingshape veridically. The presentarticle provides a comprehensive review ofpriorstudiesofthe perception of rectangularity and perpendicularity anditdiscussestheir effects on3D shape perception from both theoretical and empiricalapproaches. It has been shown that the visual system is biased to perceive a rectangular 3D shape from a 2D image. We thought that this bias might be attributable to the likelihood of a rectangular interpretation but this hypothesis is not supported by the results of our psychophysical experiment. Note that the perception ofa rectangular shape cannot be explained solely on the basis of geometry. A rectangular shape is perceived from an image that is inconsistent with a rectangular interpretation. To address thisissue, we developed a computational model that can recover a rectangular shape from an image of a parallelopiped. The model allows the recovered shape to be slightly inconsistent so that the recovered shape satisfies the a priori constraints of maximum compactness and minimal surface area. This model captures someof thephenomenaassociated withthe perception of the rectangular shape that were reported inpriorstudies. This finding suggests that rectangularity works for shape perception by incorporatingitwith someadditionalconstraints.

Standard models of spatial vision mispredict edge sensitivity at low spatial frequencies.

One well-established characteristic of early visual processing is the contrast sensitivity function (CSF) which describes how sensitivity varies with the spatial frequency (SF) content of the visual input. The CSF prompted the development of a now standard model of spatial vision. It represents the visual input by activity in orientation- and SF selective channels which are nonlinearly recombined to predict a perceptual decision. The standard spatial vision model has been extensively tested with sinusoidal gratings at low contrast because their narrow SF spectra isolate the underlying SF selective mechanisms. It is less studied how well these mechanisms account for sensitivity to more behaviourally relevant stimuli such as sharp edges at high contrast (i.e. object boundaries) which abound in the natural environment and have broader SF spectra. Here, we probe sensitivity to edges (2-AFC, edge localization) in the presence of broadband and narrowband noises. We use Cornsweet luminance profiles with peak frequencies at 0.5, 3 and 9 cpd as edge stimuli. To test how well mechanisms underlying sinusoidal contrast sensitivity can account for edge sensitivity, we implement a single- and a multi-scale model building upon standard spatial vision model components. Both models account for most of the data but also systematically deviate in their predictions, particularly in the presence of pink noise and for the lowest SF edge. These deviations might indicate a transition from contrast- to luminance-based detection at low SFs. Alternatively, they might point to a missing component in current spatial vision models.