Are visual processes causally involved in "perceptual simulation" effects in the sentence-picture verification task?

Many studies have shown that sentences implying an object to have a certain shape produce a robust reaction time advantage for shape-matching pictures in the sentence-picture verification task. Typically, this finding has been interpreted as evidence for perceptual simulation, i.e., that access to implicit shape information involves the activation of modality-specific visual processes. It follows from this proposal that disrupting visual processing during sentence comprehension should interfere with perceptual simulation and obliterate the match effect. Here we directly test this hypothesis. Participants listened to sentences while seeing either visual noise that was previously shown to strongly interfere with basic visual processing or a blank screen. Experiments 1 and 2 replicated the match effect but crucially visual noise did not modulate it. When an interference technique was used that targeted high-level semantic processing (Experiment 3) however the match effect vanished. Visual noise specifically targeting high-level visual processes (Experiment 4) only had a minimal effect on the match effect. We conclude that the shape match effect in the sentence-picture verification paradigm is unlikely to rely on perceptual simulation.

Saccade trajectories reveal dynamic interactions of semantic and spatial information during the processing of implicitly spatial words.

Implicit up/down words, such as bird and foot, systematically influence performance on visual tasks involving immediately following targets in compatible versus incompatible locations. Recent studies have observed that the semantic relation between prime words and target pictures can strongly influence the size and even the direction of the effect: Semantically related targets are processed faster in congruent versus incongruent locations (location-specific priming), whereas unrelated targets are processed slower in congruent locations. Here, we used eye-tracking to investigate the moment-to-moment processes underlying this pattern. Our reaction time (RT) results for related targets replicated the location-specific priming effect and showed a trend toward interference for unrelated targets. We then used growth curve analysis to test how up/down words and their match versus mismatch with immediately following targets in terms of semantics and vertical location influence concurrent saccadic eye movements. There was a strong main effect of spatial association on linear growth, with up words biasing changes in y-coordinates over time upward relative to down words (and vice versa). Similar to the case with the RT data, this effect was strongest for semantically related targets and reversed for unrelated targets. It is intriguing that all conditions showed a bias in the congruent direction in the initial stage of the saccade. Then, at around halfway into the saccade the effect kept increasing in the semantically related condition and reversed in the unrelated condition. These results suggest that online processing of up/down words triggers direction-specific oculomotor processes that are dynamically modulated by the semantic relation between prime words and targets. (PsycINFO Database Record (c) 2018 APA, all rights reserved).