A Step to VAR: The Vision Science of Offside Calls by Video Assistant Referees.

The Video Assistant Referee (VAR) system has had a major impact on decision-making in professional association football. However, offside decisions remain a major area of dispute and debate, with over 34 goals ruled out in the first season of VAR in the Premier League. Evidence in vision science points toward two problems with the application of the offside law in VAR, due to their use of a live TV video feed in reviews. First, due to physical and perceptual limits on spatial resolution, there is a significant probability that the spatial positions of the ball and players as judged by VAR will be several centimetres to one side of their true positions. Second, the 50 Hz TV update rate means that judgements of the time-of-contact between player and ball will on average be 10 ms too late, which translates into an increased likelihood of offside calls in fast-moving play. Suggestions are made for how to compensate for these problems during decision-making.

Limited Attention Diminishes Spatial Suppression From Large Field Glass Patterns.

Glass patterns (GPs) consist of randomly distributed dot pairs (dipoles) whose orientations are determined by specific geometric transforms. We investigated the role of visuospatial attention in the processing of global form from GPs by measuring the effect of distraction on adaptation to GPs. In the nondistracted condition, observers were adapted to coherent GPs. After the adaptation period, they were presented with a test GP divided in two halves along the vertical and were required to judge which side of the test GP was more coherent. In the attention-distracted condition, a high-load rapid serial visual presentation task was performed during the adapting period. The magnitude of the form after-effect was measured using a technique that measures the coherence level at which the test GP appears random. The rationale was that if attention has a modulatory effect on the spatial summation of dipoles, in the attention-distracted condition, we should expect a weaker form after-effect. However, the results showed stronger form after-effect in the attention-distracted condition than in the nondistracted condition, suggesting that distraction during adaptation increases the strength of form adaptation. Additional experiments suggested that distraction may reduce the spatial suppression from large-scale textures, strengthening the spatial summation of local-oriented signals.

The neural basis of form and form-motion integration from static and dynamic translational Glass patterns: A rTMS investigation.

A long-held view of the visual system is that form and motion are independently analysed. However, there is physiological and psychophysical evidence of early interaction in the processing of form and motion. In this study, we used a combination of Glass patterns (GPs) and repetitive Transcranial Magnetic Stimulation (rTMS) to investigate in human observers the neural mechanisms underlying form-motion integration. GPs consist of randomly distributed dot pairs (dipoles) that induce the percept of an oriented stimulus. GPs can be either static or dynamic. Dynamic GPs have both a form component (i.e., orientation) and a non-directional motion component along the orientation axis. GPs were presented in two temporal intervals and observers were asked to discriminate the temporal interval containing the most coherent GP. rTMS was delivered over early visual area (V1/V2) and over area V5/MT shortly after the presentation of the GP in each interval. The results showed that rTMS applied over early visual areas affected the perception of static GPs, but the stimulation of area V5/MT did not affect observers' performance. On the other hand, rTMS was delivered over either V1/V2 or V5/MT strongly impaired the perception of dynamic GPs. These results suggest that early visual areas seem to be involved in the processing of the spatial structure of GPs, and interfering with the extraction of the global spatial structure also affects the extraction of the motion component, possibly interfering with early form-motion integration. However, visual area V5/MT is likely to be involved only in the processing of the motion component of dynamic GPs. These results suggest that motion and form cues may interact as early as V1/V2.

The interaction between orientation and motion signals in moving oriented Glass patterns.

Previous psychophysical evidence suggests that motion and orientation processing systems interact asymmetrically in the human visual system, with orientation information having a stronger influence on the perceived motion direction than vice versa. To investigate the mechanisms underlying this motion-form interaction we used moving and oriented Glass patterns (GPs), which consist of randomly distributed dot pairs (dipoles) that induce the percept of an oriented texture. In Experiment 1 we varied the angle between dipole orientation and motion direction (conflict angle). In separate sessions participants either judged the orientation or motion direction of the GP. In addition, the spatiotemporal characteristics of dipole motion were manipulated as a way to limit (Experiment 1) or favor (Experiment 2) the availability of orientation signals from motion (motion streaks). The results of Experiment 1 showed that apparent GP motion direction is attracted toward dipole orientation, and apparent GP orientation is repulsed from GP motion. The results of Experiment 2 showed stronger repulsion effects when judging the GP orientation, but stronger motion streaks from the GP motion can dominate over the signals provided by conflicting dipole orientation. These results are consistent with the proposal that two separate mechanisms contribute to our perception of stimuli which contain conflicting orientation and motion information: (i) perceived GP motion is mediated by spatial motion-direction sensors, in which signals from motion sensors are combined with excitatory input from orientation-tuned sensors tuned to orientations parallel to the axis of GP motion, (ii) perceived GP orientation is mediated by orientation-tuned sensors which mutually inhibit each other. The two mechanisms are revealed by the different effects of conflict angle and dipole lifetime on perceived orientation and motion direction.

Modelling fast forms of visual neural plasticity using a modified second-order motion energy model.

The Adelson-Bergen motion energy sensor is well established as the leading model of low-level visual motion sensing in human vision. However, the standard model cannot predict adaptation effects in motion perception. A previous paper Pavan et al.(Journal of Vision 10:1-17, 2013) presented an extension to the model which uses a first-order RC gain-control circuit (leaky integrator) to implement adaptation effects which can span many seconds, and showed that the extended model's output is consistent with psychophysical data on the classic motion after-effect. Recent psychophysical research has reported adaptation over much shorter time periods, spanning just a few hundred milliseconds. The present paper further extends the sensor model to implement rapid adaptation, by adding a second-order RC circuit which causes the sensor to require a finite amount of time to react to a sudden change in stimulation. The output of the new sensor accounts accurately for psychophysical data on rapid forms of facilitation (rapid visual motion priming, rVMP) and suppression (rapid motion after-effect, rMAE). Changes in natural scene content occur over multiple time scales, and multi-stage leaky integrators of the kind proposed here offer a computational scheme for modelling adaptation over multiple time scales.

The perceived beauty of art is not strongly calibrated to the statistical regularities of real-world scenes.

Aesthetic judgements are partly predicted by image statistics, although the extent to which they are calibrated to the statistics of real-world scenes and the 'visual diet' of daily life is unclear. Here, we investigated the extent to which the beauty ratings of Western oil paintings from the JenAesthetics dataset can be accounted for by real-world scene statistics. We computed spatial and chromatic image statistics for the paintings and a set of real-world scenes captured by a head-mounted camera as participants went about daily lives. Partial least squares regression (PLSR) indicated that 6-15% of the variance in beauty ratings of the art can be accounted for by the art's image statistics. The luminance contrast of paintings made an important contribution to the PLSR models: paintings were perceived as more beautiful the greater the variation in luminance. PLSR models which expressed the art's image statistics relative to real-world scene statistics explained a similar amount of variance to models using the art's image statistics. The importance of an image statistic to perceived beauty was not related to how closely art reproduces the value from the real world. The findings suggest that beauty judgements of art are not strongly calibrated to the scene statistics of the real world.

Motion-form interactions beyond the motion integration level: evidence for interactions between orientation and optic flow signals.

Motion and form encoding are closely coupled in the visual system. A number of physiological studies have shown that neurons in the striate and extrastriate cortex (e.g., V1 and MT) are selective for motion direction parallel to their preferred orientation, but some neurons also respond to motion orthogonal to their preferred spatial orientation. Recent psychophysical research (Mather, Pavan, Bellacosa, & Casco, 2012) has demonstrated that the strength of adaptation to two fields of transparently moving dots is modulated by simultaneously presented orientation signals, suggesting that the interaction occurs at the level of motion integrating receptive fields in the extrastriate cortex. In the present psychophysical study, we investigated whether motion-form interactions take place at a higher level of neural processing where optic flow components are extracted. In Experiment 1, we measured the duration of the motion aftereffect (MAE) generated by contracting or expanding dot fields in the presence of either radial (parallel) or concentric (orthogonal) counterphase pedestal gratings. To tap the stage at which optic flow is extracted, we measured the duration of the phantom MAE (Weisstein, Maguire, & Berbaum, 1977) in which we adapted and tested different parts of the visual field, with orientation signals presented either in the adapting (Experiment 2) or nonadapting (Experiments 3 and 4) sectors. Overall, the results showed that motion adaptation is suppressed most by orientation signals orthogonal to optic flow direction, suggesting that motion-form interactions also take place at the global motion level where optic flow is extracted.

Correction: Mather, G. Aesthetic Image Statistics Vary with Artistic Genre. Vision 2020, 4, 10.

The author wishes to make the following corrections to the paper [...].

Ensemble coding of crowd speed using biological motion.

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined.

Spatial and Temporal Selectivity of Translational Glass Patterns Assessed With the Tilt After-Effect.

Glass patterns (GPs) have been widely employed to investigate the mechanisms underlying processing of global form from locally oriented cues. The current study aimed to psychophysically investigate the level at which global orientation is extracted from translational GPs using the tilt after-effect (TAE) and manipulating the spatiotemporal properties of the adapting pattern. We adapted participants to translational GPs and tested with sinewave gratings. In Experiment 1, we investigated whether orientation-selective units are sensitive to the temporal frequency of the adapting GP. We used static and dynamic translational GPs, with dynamic GPs refreshed at different temporal frequencies. In Experiment 2, we investigated the spatial frequency selectivity of orientation-selective units by manipulating the spatial frequency content of the adapting GPs. The results showed that the TAE peaked at a temporal frequency of ∼30 Hz, suggesting that orientation-selective units responding to translational GPs are sensitive to high temporal frequencies. In addition, TAE from translational GPs peaked at lower spatial frequencies than the dipoles' spatial constant. These effects are consistent with form-motion integration at low and intermediate levels of visual processing.

Aesthetic Image Statistics Vary with Artistic Genre.

Research to date has not found strong evidence for a universal link between any single low-level image statistic, such as fractal dimension or Fourier spectral slope, and aesthetic ratings of images in general. This study assessed whether different image statistics are important for artistic images containing different subjects and used partial least squares regression (PLSR) to identify the statistics that correlated most reliably with ratings. Fourier spectral slope, fractal dimension and Shannon entropy were estimated separately for paintings containing landscapes, people, still life, portraits, nudes, animals, buildings and abstracts. Separate analyses were performed on the luminance and colour information in the images. PLSR fits showed shared variance of up to 75% between image statistics and aesthetic ratings. The most important statistics and image planes varied across genres. Variation in statistics may reflect characteristic properties of the different neural sub-systems that process different types of image.

Is the perception of intent by association football officials influenced by video playback speed?

Recent research on motion perception indicates that when we view actions in slow-motion, the perceived degree of intent behind those actions can increase. Slow-motion replays are widely used in the checking and review of refereeing decisions by video assistant referees (VAR) in association football. To test whether the decisions of referees are subject to such a bias, 80 elite English professional football officials made decisions about 60 incidents recorded in professional European leagues (recorded as fouls, yellow-card offences or red-card offences by the on-field referee). Both real-time (1×) and slow-motion (0.25×) playback speeds were used. Participants had no prior knowledge of the incidents, playback speeds or disciplinary sanctions relating to each clip. Three judgements were made about each incident: extent of contact, degree of intent, and disciplinary sanction. Results showed an effect of playback speed on decision-making, but not a consistent bias due to slow-motion. Instead the distinction between yellow-card and red-card offences was clearer: Under slow-motion, yellow-card incidents were judged as less severe, and red-card incidents are judged as more severe, thus enhancing the distinction between these offences. These results are inconsistent with previous scientific reports that perceived intent is heightened by slow video playback speed.

The motion aftereffect reloaded.

The motion aftereffect is a robust illusion of visual motion resulting from exposure to a moving pattern. There is a widely accepted explanation of it in terms of changes in the response of cortical direction-selective neurons. Research has distinguished several variants of the effect. Converging recent evidence from different experimental techniques (psychophysics, single-unit recording, brain imaging, transcranial magnetic stimulation, visual evoked potentials and magnetoencephalography) reveals that adaptation is not confined to one or even two cortical areas, but occurs at multiple levels of processing involved in visual motion analysis. A tentative motion-processing framework is described, based on motion aftereffect research. Recent ideas on the function of adaptation see it as a form of gain control that maximises the efficiency of information transmission at multiple levels of the visual pathway.

Psychophysical properties of two-stroke apparent motion.

In two-stroke apparent movement, repeated presentation of a two-frame pattern displacement followed by a brief inter-stimulus interval (ISI) can create an impression of continuous forward motion (G. Mather, 2006). Does the ISI in two-stroke motion just break the connection between adjacent frames, switching off the motion signal they normally generate, or does it actually generate a reversed motion signal? Reversed apparent motion in two-frame stimuli separated by a brief ISI has been reported in several previous papers (ISI reversal), which found that the effect is optimal at short, mean-luminance ISIs, and is abolished at scotopic luminances. A series of five experiments compared two-stroke apparent motion with ISI reversal using the same stimulus display. The two effects show the same dependence on ISI duration and luminance and are both abolished at low mean luminance. Results therefore support the conclusion that the ISI in two-stroke apparent motion does contribute a reversed motion signal and constrain theoretical explanations of two-stroke apparent motion.

Modulatory mechanisms underlying high-frequency transcranial random noise stimulation (hf-tRNS): A combined stochastic resonance and equivalent noise approach.

BACKGROUND: High-frequency transcranial random noise stimulation (hf-tRNS) is a neuromodulatory technique consisting of the application of alternating current at random intensities and frequencies. hf-tRNS induces random neural activity in the system that may boost the sensitivity of neurons to weak inputs. Stochastic resonance is a nonlinear phenomenon whereby the addition of an optimal amount of noise results in performance enhancement, whereas further noise increments impair signal detection or discrimination. OBJECTIVE: The aim of the study was to assess whether modulatory effects of hf-tRNS rely on the stochastic resonance phenomenon, and what is the specific neural mechanism producing stochastic resonance. METHOD: Observers performed a two-interval forced choice motion direction discrimination task in which they had to report whether two moving patches presented in two temporal intervals had the same or different motion directions. hf-tRNS was administered at five intensity levels (0.5, 0.75, 1.0, 1.5, and 2.25 mA). RESULTS: The results showed a significant improvement in performance when hf-tRNS was applied at 1.5 mA, representing the optimal level of external noise. However, stimulation intensity at 2.25 mA significantly impaired direction discrimination performance. An equivalent noise (EN) analysis, used to assess how hf-tRNS modulates the mechanisms underlying global motion processing, showed an increment in motion signal integration with the optimal current intensity, but reduced motion signal integration at 2.25 mA. CONCLUSION: These results indicate that hf-tRNS-induced noise modulates neural signal-to-noise ratio in a way that is compatible with the stochastic resonance phenomenon.

Perceptual uncertainty and line-call challenges in professional tennis.

Fast-moving sports such as tennis require both players and match officials to make rapid accurate perceptual decisions about dynamic events in the visual world. Disagreements arise regularly, leading to disputes about decisions such as line calls. A number of factors must contribute to these disputes, including lapses in concentration, bias and gamesmanship. Fundamental uncertainty or variability in the sensory information supporting decisions must also play a role. Modern technological innovations now provide detailed and accurate physical information that can be compared against the decisions of players and officials. The present paper uses this psychophysical data to assess the significance of perceptual limitations as a contributor to real-world decisions in professional tennis. A detailed analysis is presented of a large body of data on line-call challenges in professional tennis tournaments over the last 2 years. Results reveal that the vast majority of challenges can be explained in a direct highly predictable manner by a simple model of uncertainty in perceptual information processing. Both players and line judges are remarkably accurate at judging ball bounce position, with a positional uncertainty of less than 40mm. Line judges are more reliable than players. Judgements are more difficult for balls bouncing near base and service lines than those bouncing near side and centre lines. There is no evidence for significant errors in localization due to image motion.

Adaptation reveals sensory and decision components in the visual estimation of locomotion speed.

Locomotion speed provides important social information about an individual's fitness, mood and intent. Visual estimation of locomotion speed is a complex task for the visual system because viewing distance must be taken into account, and the estimate has to be calibrated by recent experience of typical speeds. Little is known about how locomotion speed judgements are made. Previous research indicates that the human visual system possesses neurons that respond specifically to moving human forms. This research used point-light walker (PLW) displays that are known to activate these cells, in order to investigate the process mediating locomotion speed judgements. The results of three adaptation experiments show that these judgements involve both a low-level sensory component and a high-level decision component. A simple theoretical scheme is proposed, in which neurons sensitive to image flicker rate (temporal frequency) provide a sensory speed code, and a benchmark 'norm' value of the speed code, based on prevailing locomotion speeds, is used to make decisions about objective speed. The output of a simple computational model of the scheme successfully captured variations in locomotion speed in the stimuli used in the experiments. The theory offers a biologically-motivated account of how locomotion speed can be visually estimated.

The effects of high-frequency transcranial random noise stimulation (hf-tRNS) on global motion processing: An equivalent noise approach.

BACKGROUND: High frequency transcranial random noise stimulation (hf-tRNS) facilitates performance in several perceptual and cognitive tasks, however, little is known about the underlying modulatory mechanisms. OBJECTIVE: In this study we compared the effects of hf-tRNS to those of anodal and cathodal tDCS in a global motion direction discrimination task. An equivalent noise (EN) paradigm was used to assess how hf-tRNS modulates the mechanisms underlying local and global motion processing. METHOD: Motion coherence threshold and slope of the psychometric function were estimated using an 8AFC task in which observers had to discriminate the motion direction of a random dot kinematogram presented either in the left or right visual hemi-field. During the task hf-tRNS, anodal and cathodal tDCS were delivered over the left hMT+. In a subsequent experiment we implemented an EN paradigm in order to investigate the effects of hf-tRNS on the mechanisms involved in visual motion integration (i.e., internal noise and sampling). RESULTS: hf-tRNS reduced the motion coherence threshold but did not affect the slope of the psychometric function, suggesting no modulation of stimulus discriminability. Anodal and cathodal tDCS did not produce any modulatory effects. EN analysis in the last experiment found that hf-tRNS modulates sampling but not internal noise, suggesting that hf-tRNS modulates the integration of local motion cues. CONCLUSION: hf-tRNS interacts with the output neurons tuned to directions near to the directional signal, incrementing the signal-to-noise ratio and the pooling of local motion cues and thus increasing the sensitivity for global moving stimuli.

Turbine Blade Illusion.

In January 2017, a large wind turbine blade was installed temporarily in a city square as a public artwork. At first sight, media photographs of the installation appeared to be fakes - the blade looks like it could not really be part of the scene. Close inspection of the object shows that its paradoxical visual appearance can be attributed to unconscious assumptions about object shape and light source direction.

Visual adaptation alters the apparent speed of real-world actions.

The apparent physical speed of an object in the field of view remains constant despite variations in retinal velocity due to viewing conditions (velocity constancy). For example, people and cars appear to move across the field of view at the same objective speed regardless of distance. In this study a series of experiments investigated the visual processes underpinning judgements of objective speed using an adaptation paradigm and video recordings of natural human locomotion. Viewing a video played in slow-motion for 30 seconds caused participants to perceive subsequently viewed clips played at standard speed as too fast, so playback had to be slowed down in order for it to appear natural; conversely after viewing fast-forward videos for 30 seconds, playback had to be speeded up in order to appear natural. The perceived speed of locomotion shifted towards the speed depicted in the adapting video ('re-normalisation'). Results were qualitatively different from those obtained in previously reported studies of retinal velocity adaptation. Adapting videos that were scrambled to remove recognizable human figures or coherent motion caused significant, though smaller shifts in apparent locomotion speed, indicating that both low-level and high-level visual properties of the adapting stimulus contributed to the changes in apparent speed.