Multidimensional regularity processing in music: an examination using redundant signals effect.

Music is based on various regularities, ranging from the repetition of physical sounds to theoretically organized harmony and counterpoint. How are multidimensional regularities processed when we listen to music? The present study focuses on the redundant signals effect (RSE) as a novel approach to untangling the relationship between these regularities in music. The RSE refers to the occurrence of a shorter reaction time (RT) when two or three signals are presented simultaneously than when only one of these signals is presented, and provides evidence that these signals are processed concurrently. In two experiments, chords that deviated from tonal (harmonic) and acoustic (intensity and timbre) regularities were presented occasionally in the final position of short chord sequences. The participants were asked to detect all deviant chords while withholding their responses to non-deviant chords (i.e., the Go/NoGo task). RSEs were observed in all double- and triple-deviant combinations, reflecting processing of multidimensional regularities. Further analyses suggested evidence of coactivation by separate perceptual modules in the combination of tonal and acoustic deviants, but not in the combination of two acoustic deviants. These results imply that tonal and acoustic regularities are different enough to be processed as two discrete pieces of information. Examining the underlying process of RSE may elucidate the relationship between multidimensional regularity processing in music.

Saliency maps for finding changes in visual scenes?

Sudden changes in the environment reliably summon attention. This rapid change detection appears to operate in a similar fashion as pop-out in visual search, the phenomenon that very salient stimuli are directly attended, independently of the number of distracting objects. Pop-out is usually explained by the workings of saliency maps, i.e., map-like representations that code for the conspicuity at each location of the visual field. While past research emphasized similarities between pop-out search and change detection, our study highlights differences between the saliency computations in the two tasks: in contrast to pop-out search, saliency computation in change detection (i) operates independently across different stimulus properties (e.g., color and orientation), and (ii) is little influenced by trial history. These deviations from pop-out search are not due to idiosyncrasies of the stimuli or task design, as evidenced by a replication of standard findings in a comparable visual-search design. To explain these results, we outline a model of change detection involving the computation of feature-difference maps, which explains the known similarities and differences with visual search.