Classification images for aerial images capture visual expertise for binocular disparity and a prior for lighting from above.

Using a novel approach to classification images (CIs), we investigated the visual expertise of surveyors for luminance and binocular disparity cues simultaneously after screening for stereoacuity. Stereoscopic aerial images of hedges and ditches were classified in 10,000 trials by six trained remote sensing surveyors and six novices. Images were heavily masked with luminance and disparity noise simultaneously. Hedge and ditch images had reversed disparity on around half the trials meaning hedges became ditch-like and vice versa. The hedge and ditch images were also flipped vertically on around half the trials, changing the direction of the light source and completing a 2 × 2 × 2 stimulus design. CIs were generated by accumulating the noise textures associated with "hedge" and "ditch" classifications, respectively, and subtracting one from the other. Typical CIs had a central peak with one or two negative side-lobes. We found clear differences in the amplitudes and shapes of perceptual templates across groups and noise-type, with experts prioritizing binocular disparity and using this more effectively. Contrariwise, novices used luminance cues more than experts meaning that task motivation alone could not explain group differences. Asymmetries in the luminance CIs revealed individual differences for lighting interpretation, with experts less prone to assume lighting from above, consistent with their training on aerial images of UK scenes lit by a southerly sun. Our results show that (i) dual noise in images can be used to produce simultaneous CI pairs, (ii) expertise for disparity cues does not depend on stereoacuity, (iii) CIs reveal the visual strategies developed by experts, (iv) top-down perceptual biases can be overcome with long-term learning effects, and (v) CIs have practical potential for directing visual training.

Accuracy and Precision of a Novel Photogate System to Measure Toe Clearance on Stairs.

Background: Toe clearance on stairs is typically measured using optoelectronic systems, though these are often constrained to the laboratory, due to their complex setups. Here we measured stair toe clearance through a novel prototype photogate setup and compared this to optoelectronic measurements. Methods: Twelve participants (age 22 ± 3 years) completed 25 stair ascent trials, each on a seven-step staircase. Toe clearance over the fifth step edge was measured using Vicon and the photogates. Twenty-two photogates were created in rows through laser diodes and phototransistors. The height of the lowest photogate broken at step-edge crossing was used to determine photogate toe clearance. A limits of agreement analysis and Pearson's correlation coefficient compared the accuracy, precision and relationship between systems. Results: We found a mean difference of -1.5 mm (accuracy) between the two measurement systems, with upper and lower limits (precision) of 10.7 mm and -13.8 mm, respectively. A strong positive correlation was also found (r = 70, n = 12, p = 0.009) between the systems. Discussion: The results suggest that photogates could be an option for measuring real-world stair toe clearances, where optoelectronic systems are not routinely used. Improvements to the design and measurement factors may help to improve the precision of the photogates.

The missing N1 or jittered P2: Electrophysiological correlates of pattern glare in the time and frequency domain.

Excessive sensitivity to certain visual stimuli (cortical hyperexcitability) is associated with a number of neurological disorders including migraine, epilepsy, multiple sclerosis, autism and possibly dyslexia. Others show disruptive sensitivity to visual stimuli with no other obvious pathology or symptom profile (visual stress) which can extend to discomfort and nausea. We used event-related potentials (ERPs) to explore the neural correlates of visual stress and headache proneness. We analysed ERPs in response to thick (0.37 cycles per degree [c/deg]), medium (3 c/deg) and thin (12 c/deg) gratings, using mass univariate analysis, considering three factors in the general population: headache proneness, visual stress and discomfort. We found relationships between ERP features and the headache and discomfort factors. Stimulus main effects were driven by the medium stimulus regardless of participant characteristics. Participants with high discomfort ratings had larger P1 components for the initial presentation of medium stimuli, suggesting initial cortical hyperexcitability that is later suppressed. The participants with high headache ratings showed atypical N1-P2 components for medium stripes relative to the other stimuli. This effect was present only after repeated stimulus presentation. These effects were also explored in the frequency domain, suggesting variations in intertrial theta band phase coherence. Our results suggest that discomfort and headache in response to striped stimuli are related to different neural processes; however, more exploration is needed to determine whether the results translate to a clinical migraine population.

Reduced sensitivity for visual textures affects judgments of shape-from-shading and step-climbing behaviour in older adults.

Falls on stairs are a major hazard for older adults. Visual decline in normal ageing can affect step-climbing ability, altering gait and reducing toe clearance. Here we show that a loss of fine-grained visual information associated with age can affect the perception of surface undulations in patterned surfaces. We go on to show that such cues affect the limb trajectories of young adults, but due to their lack of sensitivity, not that of older adults. Interestingly neither the perceived height of a step nor conscious awareness is altered by our visual manipulation, but stepping behaviour is, suggesting that the influence of shape perception on stepping behaviour is via the unconscious, action-centred, dorsal visual pathway.

Perceptual integration for qualitatively different 3-D cues in the human brain.

The visual system's flexibility in estimating depth is remarkable: We readily perceive 3-D structure under diverse conditions from the seemingly random dots of a "magic eye" stereogram to the aesthetically beautiful, but obviously flat, canvasses of the Old Masters. Yet, 3-D perception is often enhanced when different cues specify the same depth. This perceptual process is understood as Bayesian inference that improves sensory estimates. Despite considerable behavioral support for this theory, insights into the cortical circuits involved are limited. Moreover, extant work tested quantitatively similar cues, reducing some of the challenges associated with integrating computationally and qualitatively different signals. Here we address this challenge by measuring fMRI responses to depth structures defined by shading, binocular disparity, and their combination. We quantified information about depth configurations (convex "bumps" vs. concave "dimples") in different visual cortical areas using pattern classification analysis. We found that fMRI responses in dorsal visual area V3B/KO were more discriminable when disparity and shading concurrently signaled depth, in line with the predictions of cue integration. Importantly, by relating fMRI and psychophysical tests of integration, we observed a close association between depth judgments and activity in this area. Finally, using a cross-cue transfer test, we found that fMRI responses evoked by one cue afford classification of responses evoked by the other. This reveals a generalized depth representation in dorsal visual cortex that combines qualitatively different information in line with 3-D perception.

What surprises the Mona Lisa? The relative importance of the eyes and eyebrows for detecting surprise in briefly presented face stimuli.

The classification image (CI) technique has been used to derive templates for judgements of facial emotion and reveal which facial features inform specific emotional judgements. For example, this method has been used to show that detecting an up- or down-turned mouth is a primary strategy for discriminating happy versus sad expressions. We explored the detection of surprise using CIs, expecting widened eyes, raised eyebrows, and open mouths to be dominant features. We briefly presented a photograph of a female face with a neutral expression embedded in random visual noise, which modulated the appearance of the face on a trial-by-trial basis. In separate sessions, we showed this face with or without eyebrows to test the importance of the raised eyebrow element of surprise. Noise samples were aggregated into CIs based on participant responses. Results show that the eye-region was most informative for detecting surprise. Unless attention was specifically directed to the mouth, we found no effects in the mouth region. The eye effect was stronger when the eyebrows were absent, but the eyebrow region was not itself informative and people did not infer eyebrows when they were missing. A follow-up study was conducted in which participants rated the emotional valence of the neutral images combined with their associated CIs. This verified that CIs for 'surprise' convey surprised expressions, while also showing that CIs for 'not surprise' convey disgust. We conclude that the eye-region is important for the detection of surprise.

Two operational modes in the perception of shape from shading revealed by the effects of edge information in slant settings.

The perception of shape from shading (SFS) has been an active research topic for more than two decades, yet its quantitative description remains poorly specified. One obstacle is the variability typically found between observers during SFS tasks. In this study, we take a different view of these inconsistencies, attributing them to uncertainties associated with human SFS. By identifying these uncertainties, we are able to probe the underlying computation behind SFS in humans. We introduce new experimental results that have interesting implications for SFS. Our data favor the idea that human SFS operates in at least two distinct modes. In one mode, perceived slant is linear to luminance or close to linear with some perturbation. Whether or not the linear relationship is achieved is influenced by the relative contrasts of edges bounding the luminance variation. This mode of operation is consistent with collimated lighting from an oblique angle. In the other mode, recovered surface height is indicative of a surface under lighting that is either diffuse or collimated and frontal. Shape estimates under this mode are partially accounted for by the "dark-is-deep" rule (height ∝ luminance). Switching between these two modes appears to be driven by the sign of the edges at the boundaries of the stimulus. Linear shading was active when the boundary edges had the same contrast polarity. Dark-is-deep was active when the boundary edges had opposite contrast polarity. When both same-sign and opposite-sign edges were present, observers preferred linear shading but could adopt a combination of the two computational modes.

Second-order texture gratings produce overestimation of height in depictions of rectangles and steps.

The horizontal-vertical illusion (HVI) has been proposed as a method to increase the perceived height of steps, increase toe clearance and prevent falls. High contrast vertical stripes are placed on the step riser abutting a horizontal edge-highlighter creating 'T' junctions which are thought to promote the illusion. Various configurations of the HVI were tested including luminance gratings (L) and second-order modulations of contrast (CM), spatial frequency (FM) and orientation (OM). Observers were asked to compare the apparent height of gratings with that of either filled, unmodulated rectangles or unfilled rectangles. Rectangles were presented alone or as part of a step with a highlighter. In some conditions highlighters matched the properties of the grating; in others or not. In one critical experiment, the HVI was compared for steps with highlighters that were separated from the riser by a thin line and those where the risers and highlighters were continuous. All gratings except FM appeared taller when presented in the step configuration with a continuous, matching highlighter. This effect was greatly reduced when a thin line separated the grating from the highlighter and abolished for mis-matched highlighters and risers. In the rectangle conditions, all cues appeared taller than blank rectangles and L and CM appeared taller than filled-unmodulated rectangles. In conclusion, second-order cues may be useful for inducing the HVI onto steps. However, the ability of vertical stripes and edge-highlighters to accentuate perceived step height may be due to aggregation of the highlighter into the grating rather than the normal horizontal-vertical illusion.

Observing separate spin and charge Fermi seas in a strongly correlated one-dimensional conductor.

An electron is usually considered to have only one form of kinetic energy, but could it have more, for its spin and charge, by exciting other electrons? In one dimension (1D), the physics of interacting electrons is captured well at low energies by the Tomonaga-Luttinger model, yet little has been observed experimentally beyond this linear regime. Here, we report on measurements of many-body modes in 1D gated wires using tunneling spectroscopy. We observe two parabolic dispersions, indicative of separate Fermi seas at high energies, associated with spin and charge excitations, together with the emergence of two additional 1D "replica" modes that strengthen with decreasing wire length. The interaction strength is varied by changing the amount of 1D intersubband screening by more than 45%. Our findings not only demonstrate the existence of spin-charge separation in the whole energy band outside the low-energy limit of the Tomonaga-Luttinger model but also set a constraint on the validity of the newer nonlinear Tomonaga-Luttinger theory.

Quantum criticality.

As we mark the centenary of Albert Einstein's seminal contribution to both quantum mechanics and special relativity, we approach another anniversary--that of Einstein's foundation of the quantum theory of solids. But 100 years on, the same experimental measurement that puzzled Einstein and his contemporaries is forcing us to question our understanding of how quantum matter transforms at ultra-low temperatures.

The next step in optimising the stair horizontal-vertical illusion: Does a perception-action link exist in older adults?

INTRODUCTION: Tripping on stairs results from insufficient foot to step edge clearance and can often lead to a fall in older adults. A stair horizontal-vertical illusion is suggested to increase the perceived riser height of a step and increase foot clearance when stepping up. However, this perception-action link has not been empirically determined in older adults. Previous findings suggesting a perception-action effect have also been limited to a single step or a three-step staircase. On larger staircases, somatosensory learning of step heights may be greater which could override the illusory effect on the top step. Furthermore, the striped nature of the existing stair horizontal-vertical illusion is associated with visual stress and may not be aesthetically suitable for use on public stairs. These issues need resolving before potential future implementation on public stairs. METHODS: Experiment 1. A series of four computer-based perception tests were conducted in older (N = 14: 70 ± 6 years) and young adults (N = 42: 24 ± 3 years) to test the influence of different illusion designs on stair riser height estimation. Participants compared images of stairs, with horizontal-vertical illusions or arbitrary designs on the bottom step, to a plain stair with different bottom step riser heights and selected the stair they perceived to have the tallest bottom riser. Horizontal-vertical illusions included a previously developed design and versions with modified spatial frequencies and mark space ratios. Perceived riser height differences were assessed between designs and between age groups. Experiment 2. To assess the perception-action link, sixteen older (70 ± 7 years) and fifteen young (24 ± 3 years) adults ascended a seven-step staircase with and without horizontal-vertical illusions tested in experiment 1 placed onto steps one and seven. Foot clearances were measured over each step. To determine whether changes in perception were linked to changes in foot clearance, perceived riser heights for each horizontal-vertical illusion were assessed using the perception test from experiment 1 before and after stair ascent. Additional measures to characterise stair safety included vertical foot clearance, margins of stability, foot overhang, stair speed, and gaze duration, which were assessed over all seven steps. RESULTS: Experiment 1. All horizontal-vertical illusion designs led to significant increases in the perceived riser height in both young and older adults (12-19% increase) with no differences between age groups. Experiment 2. On step 7, each horizontal-vertical illusion led to an increase in vertical foot clearance for young (up to 0.8 cm) and older adults (up to 2.1 cm). On step 1 significant increases in vertical foot clearance were found for a single horizontal-vertical illusion when compared to plain (1.19 cm increase). The horizontal-vertical illusions caused significant increases in the perceived riser height (young; 13% increase, older; 11% increase) with no differences between illusion design, group or before and after stair ascent. No further differences were found for the remaining variables and steps. CONCLUSION: Results indicate a perception-action link between perceived riser height and vertical foot clearance in response to modified versions of the horizontal-vertical illusion in both young and older adults. This was shown with no detriment to additional stair safety measures. Further evaluating these illusions on private/public stairs, especially those with inconsistently taller steps, may be beneficial to help improve stair safety for older adults.

Using a stair horizontal-vertical illusion to increase foot clearance over an inconsistently taller stair-riser.

INTRODUCTION: Stair falls can be caused by inconsistent stair dimensions. During ascent, inconsistently taller stair risers lead to reduced foot clearances as the inconsistency goes unnoticed. A stair horizontal-vertical illusion increases perceived riser heights and foot clearance and could offset reduced foot clearances over inconsistently taller risers, though this might impact other stair safety measures. METHOD: Twelve participants (age: 22 (3) years) ascended a seven-step staircase under three conditions: i) all steps consistent in riser height (consistent), ii) a 1cm increase in step 5 riser height (inconsistent) and iii) a 1cm increase in step 5 riser height, superimposed with a stair horizontal-vertical illusion (illusion). Vertical foot clearance, foot overhang, and margins of stability were assessed over step 4, 5 and 6. Perceived riser height due to the illusion was determined through a computer perception test. A One-Way Repeated Measures ANOVA compared biomechanical variables between conditions. A One Sample t test compared perceived riser height to the true height. RESULTS: Over the inconsistent step 5, foot clearance reduced by 0.8cm compared to consistent. Illusion increased foot clearance by 1.1cm and decreased foot overhang by 4% compared to inconsistent. On step 4 the illusion led to more anterior instability compared to inconsistent. Illusion and inconsistent led to more mediolateral stability compared to consistent. The illusion increased perceived riser height by 12%. DISCUSSION: Foot clearance reductions over inconsistently taller risers can be offset by a stair horizontal-vertical illusion. Additional benefits included a safer foot overhang and unaffected stability over the inconsistent riser. Changes to step 4 stability might have resulted from leaning forward to look at the step 5 illusion. The stair horizontal-vertical illusion could be a practical solution for inconsistently taller stair risers, where a rebuild is usually the only solution.

What is second-order vision for? Discriminating illumination versus material changes.

The human visual system is sensitive to second-order modulations of the local contrast (CM) or amplitude (AM) of a carrier signal. Second-order cues are detected independently of first-order luminance signals; however, it is not clear why vision should benefit from second-order sensitivity. Analysis of the first- and second-order contents of natural images suggests that these cues tend to occur together, but their phase relationship varies. We have shown that in-phase combinations of LM and AM are perceived as a shaded corrugated surface whereas the anti-phase combination can be seen as corrugated when presented alone or as a flat material change when presented in a plaid containing the in-phase cue. We now extend these findings using new stimulus types and a novel haptic matching task. We also introduce a computational model based on initially separate first- and second-order channels that are combined within orientation and subsequently across orientation to produce a shading signal. Contrast gain control allows the LM + AM cue to suppress responses to the LM - AM when presented in a plaid. Thus, the model sees LM - AM as flat in these circumstances. We conclude that second-order vision plays a key role in disambiguating the origin of luminance changes within an image.

A tale of two agnosias: distinctions between form and integrative agnosia.

The performance of two patients with visual agnosia was compared across a number of tests examining visual processing. The patients were distinguished by having dorsal and medial ventral extrastriate lesions. While inanimate objects were disadvantaged for the patient with a dorsal extrastriate lesion, animate items are disadvantaged for the patient with the medial ventral extrastriate lesion. The patients also showed contrasting patterns of performance on the Navon Test: The patient with a dorsal extrastriate lesion demonstrated a local bias while the patient with a medial ventral extrastriate lesion had a global bias. We propose that the dorsal and medial ventral visual pathways may be characterized at an extrastriate level by differences in local relative to more global visual processing and that this can link to visually based category-specific deficits in processing.

Asymmetric transfer of the dynamic motion aftereffect between first- and second-order cues and among different second-order cues.

Recent work on motion processing has suggested a distinction between first-order cues (such as luminance modulation [LM]) and second-order cues (such as local contrast modulation [CM]). We studied interactions between moving LM, CM, and orientation modulation (OM) first comparing their spatial- and temporal-frequency sensitivity. We then tested for the transfer of the dynamic motion aftereffect (dMAE) between the three cues, matched for visibility. Observers adapted to moving, 0.5-c/deg horizontal modulations for 2 min (with 10 s top-ups). Relatively strong dMAEs were found when the adaptation and test patterns were defined by the same cue (i.e., both LM, both CM, or both OM); these effects were tuned for spatial frequency in the case of LM and CM. There was a partial transfer of the dMAE from LM to CM and OM; this transferred effect seemed to lose its tuning. The aftereffect transferred well from CM to OM and retained its tuning. There was little or no transfer from CM to LM or from OM to CM or LM. This asymmetric transfer of the dMAE between first- and second-order cues and between the second-order cues suggests some degree of separation between the mechanisms that process them.

Local luminance amplitude modulates the interpretation of shape-from-shading in textured surfaces.

The pattern of illumination on an undulating surface can be used to infer its 3-D form (shape-from-shading). But the recovery of shape would be invalid if the luminance changes actually arose from changes in reflectance. So how does vision distinguish variation in illumination from variation in reflectance to avoid illusory depth? When a corrugated surface is painted with an albedo texture, the variation in local mean luminance (LM) due to shading is accompanied by a similar modulation in local luminance amplitude (AM). This is not so for reflectance variation, nor for roughly textured surfaces. We used depth mapping and paired comparison methods to show that modulations of local luminance amplitude play a role in the interpretation of shape-from-shading. The shape-from-shading percept was enhanced when LM and AM co-varied (in-phase) and was disrupted when they were out of phase or (to a lesser degree) when AM was absent. The perceptual differences between cue types (in-phase vs out-of-phase) were enhanced when the two cues were present at different orientations within a single image. Our results suggest that when LM and AM co-vary (in-phase) this indicates that the source of variation is illumination (caused by undulations of the surface), rather than surface reflectance. Hence, the congruence of LM and AM is a cue that supports a shape-from-shading interpretation.

Oscillatory motion induces change blindness.

Change blindness is the relative inability of normally sighted observers to detect large changes in scenes when the low-level signals associated with those changes are either masked or of extremely low magnitude. Change detection can be inhibited by saccadic eye movements, artificial saccades or blinks, and 'mud splashes'. We now show that change detection is also inhibited by whole image motion in the form of sinusoidal oscillations. The degree of disruption depends upon the frequency of oscillation, which at 3 Hz is equivalent to that produced by artificial blinks. Image motion causes the retinal image to be blurred and this is known to affect object recognition. However, our results are inconsistent with good change detection followed by a delay due to poor recognition of the changing object. Oscillatory motion can induce eye movements that potentially mask or inhibit the low-level signals related to changes in the scene, but we show that eye movements promote rather than inhibit change detection when the image is moving.

Binocular functional architecture for detection of contrast-modulated gratings.

Combination of signals from the two eyes is the gateway to stereo vision. To gain insight into binocular signal processing, we studied binocular summation for luminance-modulated gratings (L or LM) and contrast-modulated gratings (CM). We measured 2AFC detection thresholds for a signal grating (0.75c/deg, 216ms) shown to one eye, both eyes, or both eyes out-of-phase. For LM and CM, the carrier noise was in both eyes, even when the signal was monocular. Mean binocular thresholds for luminance gratings (L) were 5.4dB better than monocular thresholds - close to perfect linear summation (6dB). For LM and CM the binocular advantage was again 5-6dB, even when the carrier noise was uncorrelated, anti-correlated, or at orthogonal orientations in the two eyes. Binocular combination for CM probably arises from summation of envelope responses, and not from summation of these conflicting carrier patterns. Antiphase signals produced no binocular advantage, but thresholds were about 1-3dB higher than monocular ones. This is not consistent with simple linear summation, which should give complete cancellation and unmeasurably high thresholds. We propose a three-channel model in which noisy monocular responses to the envelope are binocularly combined in a contrast-weighted sum, but also remain separately available to perception via a max operator. Vision selects the largest of the three responses. With in-phase gratings the binocular channel dominates, but antiphase gratings cancel in the binocular channel and the monocular channels mediate detection. The small antiphase disadvantage might be explained by a subtle influence of background responses on binocular and monocular detection.

Sensitivity to contrast modulation: the spatial frequency dependence of second-order vision.

We consider the overall shape of the second-order modulation sensitivity function (MSF). Because second-order modulations of local contrast or orientation require a carrier signal, it is necessary to evaluate modulation sensitivity against a variety of carriers before reaching a general conclusion about second-order sensitivity. Here we present second-order sensitivity functions for new carrier types (low pass (1/f) noise, and high pass noise) and demonstrate that, when first-order artefacts have been accounted for, the shape of the resulting MSFs are similar to one another and to those for white and broad band noise. They are all low pass with a likely upper frequency limit in the range 10-20 c/deg, suggesting that detection of second-order stimuli is relatively insensitive to the structure of the carrier signal. This result contrasts strongly with that found for (first-order) luminance modulations of the same noise types. Here the noise acts as mask and each noise type masks most those frequencies that are dominant in its spectrum. Thus the shape of second-order MSFs are largely independent of the spectrum of their noise carrier, but first-order CSFs depend on the spectrum of an additive noise mask. This provides further evidence for the separation of first- and second-order vision and characterises second-order vision as a low pass mechanism.