A simple psychophysical procedure separates representational and noise components in impairments of speech prosody perception after right-hemisphere stroke.

After a right hemisphere stroke, more than half of the patients are impaired in their capacity to produce or comprehend speech prosody. Yet, and despite its social-cognitive consequences for patients, aprosodia following stroke has received scant attention. In this report, we introduce a novel, simple psychophysical procedure which, by combining systematic digital manipulations of speech stimuli and reverse-correlation analysis, allows estimating the internal sensory representations that subtend how individual patients perceive speech prosody, and the level of internal noise that govern behavioral variability in how patients apply these representations. Tested on a sample of N = 22 right-hemisphere stroke survivors and N = 21 age-matched controls, the representation + noise model provides a promising alternative to the clinical gold standard for evaluating aprosodia (MEC): both parameters strongly associate with receptive, and not expressive, aprosodia measured by MEC within the patient group; they have better sensitivity than MEC for separating high-functioning patients from controls; and have good specificity with respect to non-prosody-related impairments of auditory attention and processing. Taken together, individual differences in either internal representation, internal noise, or both, paint a potent portrait of the variety of sensory/cognitive mechanisms that can explain impairments of prosody processing after stroke.

What we don't know about what babies know: Reconsidering psychophysics, exploration, and infant behavior.

Researchers must infer "what babies know" based on what babies do. Thus, to maximize information from doing, researchers should use tasks and tools that capture the richness of infants' behaviors. We clarify Gibson's views about the richness of infants' behavior and their exploration in the service of guiding action - what Gibson called "learning about affordances."

Testing the validity of online psychophysical measurement of body image perception.

This body image study tests the viability of transferring a complex psychophysical paradigm from a controlled in-person laboratory task to an online environment. 172 female participants made online judgements about their own body size when viewing images of computer-generated female bodies presented in either in front-view or at 45-degrees in a method of adjustment (MOA) paradigm. The results of these judgements were then compared to the results of two laboratory-based studies (with 96 and 40 female participants respectively) to establish three key findings. Firstly, the results show that the accuracy of online and in-lab estimates of body size are comparable, secondly that the same patterns of visual biases in judgements are shown both in-lab and online, and thirdly online data shows the same view-orientation advantage in accuracy in body size judgements as the laboratory studies. Thus, this study suggests that that online sampling potentially represents a rapid and accurate way of collecting reliable complex behavioural and perceptual data from a more diverse range of participants than is normally sampled in laboratory-based studies. It also offers the potential for designing stratified sampling strategies to construct a truly representative sample of a target population.

The Use of a Just Noticeable Difference Approach to Improve Perceptual Acuity Ability in Male Runners.

We were interested in micro-variations in an athlete's psychophysical state that separate peak exertion from physiological collapse. Thus, we measured perceptual acuity in runners using a classic psychophysical approach, the just noticeable difference (JND) on two standard stimuli runs at treadmill speed corresponding to 70%VO2max and 80%VO2max. Thirty-four male runners (M age = 35.26, SD = 7.33 years) first performed a maximal treadmill test to determine the speed of a standard exercise bout for the JND trials. The JND trials consisted of four 5-minute running bouts on a treadmill with 5-minute rests between bouts. For bouts 1 and 3, participants ran at the standard stimuli pace, but for bouts 2 and 4, they adjusted their speeds to achieve a level of exertion at a JND above/below the SS. They achieved differences in the final 30 seconds of the VO2 between each JND bout and the previous standard stimuli at just above (JND-A) and just below (JND-B) the JND perceived exertions. We used a Generalized Linear Model analysis to compare the JND-A and JND-B within and between ventilatory threshold groups (lower/higher) in absolute and relative VO2 and in terms of the total JND magnitude. The magnitude of JND-A was greater than that of JND-B at 70%VO2max and 80%VO2max in absolute units (70%VO2 Δ = 2.62; SE = 0.37; p < .001; 80%VO2 Δ = 1.67; SE = 0.44; p = .002) and in relative units (70%VO2max Δ = 4.70; SE = 0.66; p < .001; 80%VO2max Δ = 2.96; SE = 0.80; p = .002). The total magnitude was greater in the 70%VO2max trial than 80%VO2max in absolute units (70%VO2 M = 3.78, SE = 0.31 mL·kg-1·min-1; 80%VO2 M = 2.62, SE = 0.37 mL·kg-1·min-1; p = .020) and in relative units (70%VO2max M = 6.57, SE = 0.53%VO2max; 80%VO2max M = 4.71, SE = 0.64%VO2max; p = .030). The JND range narrowed when physiologic demand increased, for both physical (speed) and psychological (RPE) variables.

Continuous psychophysics shows millisecond-scale visual processing delays are faithfully preserved in movement dynamics.

Image differences between the eyes can cause interocular discrepancies in the speed of visual processing. Millisecond-scale differences in visual processing speed can cause dramatic misperceptions of the depth and three-dimensional direction of moving objects. Here, we develop a monocular and binocular continuous target-tracking psychophysics paradigm that can quantify such tiny differences in visual processing speed. Human observers continuously tracked a target undergoing Brownian motion with a range of luminance levels in each eye. Suitable analyses recover the time course of the visuomotor response in each condition, the dependence of visual processing speed on luminance level, and the temporal evolution of processing differences between the eyes. Importantly, using a direct within-observer comparison, we show that continuous target-tracking and traditional forced-choice psychophysical methods provide estimates of interocular delays that agree on average to within a fraction of a millisecond. Thus, visual processing delays are preserved in the movement dynamics of the hand. Finally, we show analytically, and partially confirm experimentally, that differences between the temporal impulse response functions in the two eyes predict how lateral target motion causes misperceptions of motion in depth and associated tracking responses. Because continuous target tracking can accurately recover millisecond-scale differences in visual processing speed and has multiple advantages over traditional psychophysics, it should facilitate the study of temporal processing in the future.

What Fechner could not do: Separating perceptual encoding and decoding with difference scaling.

A key question in perception research is how stimulus variations translate into perceptual magnitudes, that is, the perceptual encoding process. As experimenters, we cannot probe perceptual magnitudes directly, but infer the encoding process from responses obtained in a psychophysical experiment. The most prominent experimental technique to measure perceptual appearance is matching, where observers adjust a probe stimulus to match a target in its appearance along the dimension of interest. The resulting data quantify the perceived magnitude of the target in physical units of the probe, and are thus an indirect expression of the underlying encoding process. In this paper, we show analytically and in simulation that data from matching tasks do not sufficiently constrain perceptual encoding functions, because there exist an infinite number of pairs of encoding functions that generate the same matching data. We use simulation to demonstrate that maximum likelihood conjoint measurement (Ho, Landy, & Maloney, 2008; Knoblauch & Maloney, 2012) does an excellent job of recovering the shape of ground truth encoding functions from data that were generated with these very functions. Finally, we measure perceptual scales and matching data for White's effect (White, 1979) and show that the matching data can be predicted from the estimated encoding functions, down to individual differences.

Visual Tracking in Amblyopia: A Continuous Psychophysical Approach.

Purpose: This study aimed to explore the underlying mechanisms of the observed visuomotor deficit in amblyopia. Methods: Twenty-four amblyopic (25.8 ± 3.8 years; 15 males) and 22 normal participants (25.8 ± 2.1 years; 8 males) took part in the study. The participants were instructed to continuously track a randomly moving Gaussian target on a computer screen using a mouse. In experiment 1, the participants performed the tracking task at six different target sizes. In experiments 2 and 3, they were asked to track a target with the contrast adjusted to individual's threshold. The tracking performance was represented by the kernel function calculated as the cross-correlation between the target and mouse displacements. The peak, latency, and width of the kernel were extracted and compared between the two groups. Results: In experiment 1, target size had a significant effect on the kernel peak (F(1.649, 46.170) = 200.958, P = 4.420 × 10-22). At the smallest target size, the peak in the amblyopic group was significantly lower than that in the normal group (0.089 ± 0.023 vs. 0.107 ± 0.020, t(28) = -2.390, P = 0.024) and correlated with the contrast sensitivity function (r = 0.739, P = 0.002) in the amblyopic eyes. In experiments 2 and 3, with equally visible stimuli, there were still differences in the kernel between the two groups (all Ps < 0.05). Conclusions: When stimulus visibility was compensated, amblyopic participants still showed significantly poorer tracking performance.

Peripheral vision and crowding in mental maze-solving.

Solving a maze effectively relies on both perception and cognition. Studying maze-solving behavior contributes to our knowledge about these important processes. Through psychophysical experiments and modeling simulations, we examine the role of peripheral vision, specifically visual crowding in the periphery, in mental maze-solving. Experiment 1 measured gaze patterns while varying maze complexity, revealing a direct relationship between visual complexity and maze-solving efficiency. Simulations of the maze-solving task using a peripheral vision model confirmed the observed crowding effects while making an intriguing prediction that saccades provide a conservative measure of how far ahead observers can perceive the path. Experiment 2 confirms that observers can judge whether a point lies on the path at considerably greater distances than their average saccade. Taken together, our findings demonstrate that peripheral vision plays a key role in mental maze-solving.

Contrast sensitivity functions measured using simple optics and computer testing.

PURPOSE: Contrast sensitivity function (CSF) testing is a common approach to assessing clinical changes to specific aspects of spatial vision. Different stimulus presentations and testing procedures, however, yield significant differences in CSF curves that are more a feature of the method than the observer. In this study, we designed a simple optical device for measuring CSF that could be directly calibrated and compared with a commonly used computer-based system. METHODS: Twenty-one participants (M = 28.95 ± 10.34 years; 66.7% female; 81.0% non-Hispanic White; best corrected visual acuity 6/9 or better) provided photopic CSFs (from measurements at 1.6, 3.2, 8, 16 and 24 cycles per degree, with spatial frequency presentation randomised) using both the Metropsis test platform and a simple optical device over two test sessions (one session/method, randomised, counterbalanced) separated by 1-7 days. The optical system used 520 nm lasers that were made Lambertian using two integrating spheres with a 3.5° circular exit port. These beams were combined with a beam splitter that allowed constant measurement of light output and contrast modulation using sine-wave gratings on glass. In Metropsis, 2° Gabor stimuli were presented for 0.5 s with either a vertical or a horizontal orientation via a two-alternative forced choice paradigm with contrast modulated until four (first) and eight (last) reversals were complete. RESULTS: Both methods took approximately the same amount of time to generate a CSF and yielded curves that were consistent with past studies using similar methods but different from each other. The optical system showed a 3.5 times higher maximum sensitivity and yielded higher test-retest reliability. CONCLUSIONS: Using simple optics to measure CSF yields low noise, high sensitivity and reliability. The ability to calibrate the stimuli directly is an advantage over computer-based methods.

Object Image Size Is a Fundamental Coding Dimension in Human Vision: New Insights and Model.

In previous psychophysical work we found that luminance contrast is integrated over retinal area subject to contrast gain control. If different mechanisms perform this operation for a range of superimposed retinal regions of different sizes, this could provide the basis for size-coding. To test this idea we included two novel features in a standard adaptation paradigm to discount more pedestrian accounts of repulsive size-aftereffects. First, we used spatially jittering luminance-contrast adaptors to avoid simple contour displacement aftereffects. Second, we decoupled adaptor and target spatial frequency to avoid the well-known spatial frequency shift aftereffect. Empirical results indicated strong evidence of a bidirectional size adaptation aftereffect. We show that the textbook population model is inappropriate for our results, and develop our existing model of contrast perception to include multiple size mechanisms with divisive surround-suppression from the largest mechanism. For a given stimulus patch, this delivers a blurred step-function of responses across the population, with contrast and size encoded by the height and lateral position of the step. Unlike for textbook population coding schemes, our human results (N = 4 male, N = 4 female) displayed two asymmetries: (i) size aftereffects were greatest for targets smaller than the adaptor, and (ii) on that side of the function, results did not return to baseline, even when targets were 25% of adaptor diameter. Our results and emergent model properties provide evidence for a novel dimension of visual coding (size) and a novel strategy for that coding, consistent with previous results on contrast detection and discrimination for various stimulus sizes.

Changes in length judgments caused by rotation of the contextual distractor.

In the present study, we tested the applicability of the computational model of the illusion of interrupted spatial extent (Bulatov, Marma, & Bulatova, Attention, Perception, & Psychophysics, 82, 2714-2727, 2020) to account for the psychophysical data collected with three-dot stimuli containing a cross-shaped contextual distractor. In different series of experiments, the illusion magnitude changes caused by the rotation of distractors with different values of the internal angle (45°, 75°, and 90°) were quantitatively determined. It was shown that the data obtained for all modifications of stimuli can be rather well approximated by model functions proportional to the sum of the absolute values of cosines. A good agreement between theoretical calculations and experimental results supports the suggestion that the perceptual displacement of the stimulus terminators, which occurs due to the processes of local integration of neural activity, may be one of the main causes of the illusion investigated.

Empirical validation of QUEST+ in PSE and JND estimations in visual discrimination tasks.

One of the most precise methods to establish psychometric functions and estimate threshold and slope parameters is the constant stimuli procedure. The large distribution of predetermined stimulus values presented to observers enables the psychometric functions to be fully developed, but makes this procedure time-consuming. Adaptive procedures enable reliable threshold estimation while reducing the number of trials by concentrating stimulus presentations around observers' supposed threshold. Here, the stimulus value for the next trial depends on observer's responses to the previous trials. One recent improvement of these procedures is to also estimate the slope (related to discrimination sensitivity). The Bayesian QUEST+ procedure (Watson Journal of Vision, 17(3), 10, 2017), a generalization and extension of the QUEST procedure, includes this refinement. Surprisingly, this procedure is barely used. Our goal was to empirically assess its precision to evaluate size, orientation, or temporal perception, in three yes/no discrimination tasks that increase in demands. In 72 adult participants in total, we compared points of subjective equivalence (PSEs) or simultaneity (PSSs) as well as discrimination sensitivity obtained with the QUEST+, constant stimuli, and simple up-down staircase procedures. While PSEs did not differ between procedures, sensitivity estimates obtained with the 64-trials QUEST+ procedure were overestimated (i.e., just-noticeable differences, or JNDs, were underestimated). Overall, agreement between procedures was good, and was at its best for the easiest tasks. This study empirically confirmed that the QUEST+ procedure can be considered as a method of choice to accelerate PSE estimation, while keeping in mind that sensitivity estimation should be handled with caution.

Putting perception into action with inverse optimal control for continuous psychophysics.

Psychophysical methods are a cornerstone of psychology, cognitive science, and neuroscience where they have been used to quantify behavior and its neural correlates for a vast range of mental phenomena. Their power derives from the combination of controlled experiments and rigorous analysis through signal detection theory. Unfortunately, they require many tedious trials and preferably highly trained participants. A recently developed approach, continuous psychophysics, promises to transform the field by abandoning the rigid trial structure involving binary responses and replacing it with continuous behavioral adjustments to dynamic stimuli. However, what has precluded wide adoption of this approach is that current analysis methods do not account for the additional variability introduced by the motor component of the task and therefore recover perceptual thresholds that are larger compared to equivalent traditional psychophysical experiments. Here, we introduce a computational analysis framework for continuous psychophysics based on Bayesian inverse optimal control. We show via simulations and previously published data that this not only recovers the perceptual thresholds but additionally estimates subjects' action variability, internal behavioral costs, and subjective beliefs about the experimental stimulus dynamics. Taken together, we provide further evidence for the importance of including acting uncertainties, subjective beliefs, and, crucially, the intrinsic costs of behavior, even in experiments seemingly only investigating perception.

Humans often perceive the world around them subjectively. Factors like light brightness, the speed of a moving object, or an individual's interpretation of facial expressions may influence perception. Understanding how humans perceive the world can provide valuable insights into neuroscience, psychology, and even people's spending habits, making human perception studies important. However, these so-called psychophysical studies often consist of thousands of simple yes or no questions, which are tedious for adult volunteers, and nearly impossible for children. A new approach called 'continuous psychophysics' makes perception studies shorter, easier, and more fun for participants. Instead of answering yes or no questions (like in classical psychophysics experiments), the participants follow an object on a screen with their fingers or eyes. One question about this new approach is whether it accounts for differences that affect how well participants follow the object. For example, some people may have jittery hands, while others may be unmotivated to complete the task. To overcome this issue, Straub and Rothkopf have developed a mathematical model that can correct for differences between participants in the variability of their actions, their internal costs of actions, and their subjective beliefs about how the target moves. Accounting for these factors in a model can lead to more reliable study results. Straub and Rothkopf used data from three previous continuous psychophysics studies to construct a mathematical model that could best predict the experimental results. To test their model, they then used it on data from a continuous psychophysics study conducted alongside a classical psychophysics study. The model was able to correct the results of the continuous psychophysics study so they were more consistent with the results of the classical study. This new technique may enable wider use of continuous psychophysics to study a range of human behavior. It will allow larger, more complex studies that would not have been possible with conventional approaches, as well as enable research on perception in infants and children. Brain scientists may also use this technique to understand how brain activity relates to perception.

Decision-making psychology and method under zero-knowledge context.

For a certain kind of decision event, the decision maker does not know the internal mechanism and knowledge information of the decision events.When this kind of decision events gives multiple selection branches, it is found that there is a decision psychological tendency to find the most common features by comparing the selection branches. Based on this, a zero-knowledge decision making (ZKDM) method is proposed. By defining the feature points and feature sets of the selection branches of the decision events, the characteristic moments of the system are constructed and the branch with the most common characteristics is obtained. It is observed that through the findings of investigation the probability of arriving at the correct choice based on the ZKDM method is high. The effectiveness of the ZKDM method may be related to the fact that the designers of decision events usually determine the correct selection branch first, before changing it to design other branches. A questionnaire survey of 279 respondents reveals that more than half of them actually adopt such a design idea. Furthermore, a separate questionnaire survey of 465 decision-makers reveal that 19.14% of the respondents clearly adopt ZKDM.

A Joint Lateral Motion-Stereo Constraint.

Purpose: We developed a stereo task that is based on a motion direction discrimination to examine the role that depth can play in disambiguating motion direction. Methods: In this study, we quantified normal adults' static and dynamic (i.e., laterally moving) stereoscopic performance using a psychophysical task, where we dichoptically presented randomly arranged, limited lifetime Gabor elements at two depth planes (one plane was at the fixation plane and the other at an uncrossed disparity relative to the fixation plane). Each plane contained half of the elements. For the dynamic condition, all elements were vertically oriented and moved to the left in one plane and to the right in another plane; for the static condition, the elements were horizontally oriented in one plane and vertically oriented in another plane. Results: For the range of motion speed that we measured (from 0.17°/s to 5.33°/s), we observed clear speed tuning of the stereo sensitivity (P = 3.0 × 10-5). The shape of this tuning did not significantly change with different spatial frequencies. We also found a significant difference in stereo sensitivity between stereopsis with static and laterally moving stimuli (speed = 0.67°/s; P = 0.004). Such difference was not evident when we matched the task between the static and moving stimuli. Conclusions: We report that lateral motion modulates human global depth perception. This motion/stereo constraint is related to motion velocity not stimulus temporal frequency. We speculate that the processing of motion-based stereopsis of the kind reported here occurs in dorsal extrastriate cortex.

Elucidation of a lingual detection mechanism for high-viscosity solutions in humans.

While perception of high-viscosity solutions (η > 1000 cP) is speculated to be linked to filiform papillae deformation, this has not been demonstrated psychophysically. Presently, just-noticeable-viscosity-difference thresholds were determined using the forced-choice staircase method and high-viscosity solutions (η = 4798-12260 cP) with the hypotheses that the tongue would be chiefly responsible for viscosity perception in the oral cavity, and that individuals with more, longer, narrower filiform papillae would show a greater acuity for viscosity perception. Subjects (n = 59) evaluated solutions in a normal, "unblocked" condition as well as in a "palate blocked" condition which isolated the tongue so that only perceptual mechanisms on the lingual tissue were engaged. Optical profiling was used to characterize papillary length, diameter, and density in tongue biopsies of a subset (n = 45) of participants. Finally, psychophysical and anatomical data were used to generate a novel model of the tongue surface as porous media to predict papillary deformation as a strain-detector for viscosity perception. Results suggest that viscosity thresholds are governed by filiform papillae features. Indeed, anatomical characterization of filiform papillae suggests sensitivity to high-viscosity solutions is associated with filiform papillae length and density (r = 0.68, p < 0.00001), but not with diameter. Modelling indicated this is likely due to a reciprocal interaction between papillae diameter and fluid shear stress. Papillae with larger diameters would result in higher viscous shear stress due to a narrower gap and stronger fluid-structure interaction, but a larger-diameter papilla would also deform less easily.

The role of spatial frequencies for facial pain categorization.

Studies on low-level visual information underlying pain categorization have led to inconsistent findings. Some show an advantage for low spatial frequency information (SFs) and others a preponderance of mid SFs. This study aims to clarify this gap in knowledge since these results have different theoretical and practical implications, such as how far away an observer can be in order to categorize pain. This study addresses this question by using two complementary methods: a data-driven method without a priori expectations about the most useful SFs for pain recognition and a more ecological method that simulates the distance of stimuli presentation. We reveal a broad range of important SFs for pain recognition starting from low to relatively high SFs and showed that performance is optimal in a short to medium distance (1.2-4.8 m) but declines significantly when mid SFs are no longer available. This study reconciles previous results that show an advantage of LSFs over HSFs when using arbitrary cutoffs, but above all reveal the prominent role of mid-SFs for pain recognition across two complementary experimental tasks.

Shrinking Bouma's window: How to model crowding in dense displays.

In crowding, perception of a target deteriorates in the presence of nearby flankers. Traditionally, it is thought that visual crowding obeys Bouma's law, i.e., all elements within a certain distance interfere with the target, and that adding more elements always leads to stronger crowding. Crowding is predominantly studied using sparse displays (a target surrounded by a few flankers). However, many studies have shown that this approach leads to wrong conclusions about human vision. Van der Burg and colleagues proposed a paradigm to measure crowding in dense displays using genetic algorithms. Displays were selected and combined over several generations to maximize human performance. In contrast to Bouma's law, only the target's nearest neighbours affected performance. Here, we tested various models to explain these results. We used the same genetic algorithm, but instead of selecting displays based on human performance we selected displays based on the model's outputs. We found that all models based on the traditional feedforward pooling framework of vision were unable to reproduce human behaviour. In contrast, all models involving a dedicated grouping stage explained the results successfully. We show how traditional models can be improved by adding a grouping stage.

Unsupervised learning predicts human perception and misperception of gloss.

Reflectance, lighting and geometry combine in complex ways to create images. How do we disentangle these to perceive individual properties, such as surface glossiness? We suggest that brains disentangle properties by learning to model statistical structure in proximal images. To test this hypothesis, we trained unsupervised generative neural networks on renderings of glossy surfaces and compared their representations with human gloss judgements. The networks spontaneously cluster images according to distal properties such as reflectance and illumination, despite receiving no explicit information about these properties. Intriguingly, the resulting representations also predict the specific patterns of 'successes' and 'errors' in human perception. Linearly decoding specular reflectance from the model's internal code predicts human gloss perception better than ground truth, supervised networks or control models, and it predicts, on an image-by-image basis, illusions of gloss perception caused by interactions between material, shape and lighting. Unsupervised learning may underlie many perceptual dimensions in vision and beyond.