Visual-proprioceptive intermodal perception using point light displays.

Three experiments explored 5- and 7-month-old infants' intermodal coordination of proprioceptive information produced by leg movements, and visual movement information specifying these same motions. The visual information took the form of point light information for leg and feet movements, with visual displays presented in upright, ego-centered on-joint (Experiment 1, N = 48); upright, ego-centered off-joint (Experiment 2, N = 48); and inverted, observer-centered off-joint (Experiment 3, N = 48) orientations. Measures of preferential looking indicated intermodal perception in infants of both ages while seeing on-joint, ego-centered orientations, and for 7-month-olds (and possibly 5-month-olds) while seeing off-joint, ego-centered displays; neither age group demonstrated intermodal perception for off-joint, observer-centered displays. These results suggest that coordination of visual and proprioceptive inputs is constrained by infants' information processing of the displays, and have implications for infants' growing understanding of their self-movement and the development of knowledge of the self.

The role of visual and body movement information in infant search.

Three experiments investigated the use of visual input and body movement input arising from movement through the world on spatial orientation. Infants between 9 1/2 and 18 months participated in a search task in which they searched for a toy hidden in 1 of 2 containers. Prior to beginning search, either the infants or the containers were rotated 180 degrees; these rotations occurred in a lit or dark environment. These experiments were distinguished by the environmental cues for object location; Experiment 1 used a position cue, Experiment 2 a color cue, and Experiment 3 both position and color cues. Accuracy was better in Experiments 2 and 3 than in Experiment 1. All studies found that search was best after infant movement in the light; all other conditions led to equivalently worse performance. These results are discussed relative to a theoretical characterization of spatial coding focusing on the uses of spatial information.

Interkey timing in piano performance and typing.

In typing, when the fingers executing two successive movements are on the same hand, the time between keystrokes is longer than when the fingers are on different hands. Biomechanical limitations of the hands are thought to account for this difference. The generality of this finding was explored by investigating skilled pianists' performance of two successive notes. Experiment 1 failed to find comparable differences in timing as a function of the hands involved. Experiment 2, employing both a piano production and a typing task, replicated the previous piano performance results, and revealed that the timing differences in typing were limited to letter sequences requiring fore-aft and lateral finger movements. Experiment 3 extended this finding to piano performance. Together, these findings clarify the nature of biomechanical constraints on skilled manual performance.

The McGurk effect in infants.

In the McGurk effect, perceptual identification of auditory speech syllables is influenced by simultaneous presentation of discrepant visible speech syllables. This effect has been found in subjects of different ages and with various native language backgrounds. But no McGurk tests have been conducted with prelinguistic infants. In the present series of experiments, 5-month-old English-exposed infants were tested for the McGurk effect. Infants were first gaze-habituated to an audiovisual /va/. Two different dishabituation stimuli were then presented: audio /ba/-visual /va/ (perceived by adults as /va/), and audio /da/-visual /va/ (perceived by adults as /da/). The infants showed generalization from the audiovisual /va/ to the audio /ba/-visual /va/ stimulus but not to the audio /da/-visual /va/ stimulus. Follow-up experiments revealed that these generalization differences were not due to a general preference for the audio /da/-visual /va/ stimulus or to the auditory similarity of /ba/ to /va/ relative to /da/. These results suggest that the infants were visually influenced in the same way as English-speaking adults are visually influenced.

Phrasing influences the recognition of melodies.

One critical step in the processing of complex auditory information (i.e., language and music) involves organizing such information into hierarchical units, such as phrases. In this study, musically trained and untrained listeners' recognition memory for short, naturalistic melodies varying in their phrase structure was tested. For musically trained subjects, memory for information preceding a phrase boundary was disrupted and memory for information subsequent to a phrase boundary was enhanced relative to memory in similar temporal locations for excerpts not containing a phrase boundary. Musically untrained listeners, in contrast, showed no such differences as a function of the phrasing of the melody. These findings conform with previous results in both psycholinguistics and musical cognition and suggest that the phrase serves as a functional unit in musical processing, guiding the parsing of musical sequences during perception, along with the structuring of memory for musical passages.

Expectancy effects in memory for melodies.

Two experiments explored the relation between melodic expectancy and melodic memory. In Experiment 1, listeners rated the degree to which different endings confirmed their expectations for a set of melodies. After providing these expectancy ratings, listeners received a recognition memory test in which they discriminated previously heard melodies from new melodies. Recognition memory in this task positively correlated with perceived expectancy, and was related to the estimated tonal coherence of these melodies. Experiment 2 extended these results, demonstrating better recognition memory for high expectancy melodies, relative to medium and low expectancy melodies. This experiment also observed asymmetrical memory confusions as a function of perceived expectancy. These findings fit with a model of musical memory in which schematically central events are better remembered than schematically peripheral events.

Harmonic and rhythmic influences on musical expectancy.

The effects of harmony and rhythm on expectancy formation were studied in two experiments. In both studies, we generated musical passages consisting of a melodic line accompanied by four harmonic (chord) events. These sequences varied in their harmonic content, the rhythmic periodicity of the three context chords prior to the final chord, and the ending time of the final chord itself. In Experiment 1, listeners provided ratings for how well the final chord in a chord sequence fit their expectations for what was to come next; analyses revealed subtle changes in ratings as a function of both harmonic and rhythmic variation. Experiment 2 extended these results; listeners made a speeded reaction time judgment on whether the final chord of a sequence belonged with its set of context chords. Analysis of the reaction time data suggested that harmonic and rhythmic variation also influenced the speed of musical processing. These results are interpreted with reference to current models of music cognition, and they highlight the need for rhythmical weighting factors within the psychological representation of tonal/pitch information.

Infants' perception of kinetic depth and stereokinetic displays.

Studies examined infants' perceptions of 3-dimensional form, using a kinetic depth effect (KDE) display and displays containing subsets of the motion present in the KDE display. One subset consisted of "between-contour" motion, and the second consisted of "within-contour" motion. Research with adults has suggested that only between-contour motion leads to a compelling depth percept. In Experiments 1 and 2, infants generalized habituation from a KDE display to the between-contour but not the within-contour changes. In Experiments 3 and 4, infants generalized habituation from a KDE display to the between-contour display viewed from a novel orientation but not to the within-contour display viewed from the original orientation. Results indicate sensitivity to between-contour but not within-contour information, suggesting that infants perceive the 3-dimensional form of these displays.

The perception of natural contour.

The observation that natural curves and surfaces are often fractal suggests that people may be sensitive to their statistical properties. The perceptual protocols that underlie discrimination between fractals and between other types of random contour and fractals are examined. Discrimination algorithms that have precisely the same sensitivities as human observers are constructed. These algorithms do not recognize the integrated scale hierarchy intrinsic to fractal form and operate by imposing a metatheory of structure that is based on a signal-noise distinction. The success of the algorithms implies that (a) self-affinity in random fractals is not perceptually recovered and (b) people have a natural disposition to view contour in terms of signal and noise. The authors propose that this disposition be understood as a principle of perceptual organization.

Auditory perception of fractal contours.

A series of experiments examined auditory contour formation, investigating listeners' sensitivities to a family of random fractals known as fractional Brownian noises. Experiments 1A and 1B looked at identification of contours when 3 different noises were portrayed using variations in the pitch, duration, or loudness of successive notes of a sequence. Listeners could categorize pitch and loudness encodings, but not duration mappings. Experiment 2 looked at the effect of simultaneous presentation of pitch and loudness information, finding that these dimensions combined additively to increase identification of the noise distributions. Experiment 3 looked at discrimination of pitch contours as a function of changing fractal dimension. Discrimination curves approximated an inverted U shape, a finding that is not understandable in terms of sensitivity to differences in fractal dimension per se, nor in terms of "tuned" perceptual sensitivity to statistical regularities of the environment.

Detection of the traversability of surfaces by crawling and walking infants.

In four studies we investigated the perception of the affordance for traversal of a supporting surface. The surface presented was either rigid or deformable, and this property was specified either optically, haptically, or both. In Experiment 1A, crawling and walking infants were presented with two surfaces in succession: a standard surface that both looked and felt rigid and a deforming surface that both looked and felt nonrigid. Latency to initiate locomotion, duration of visual and haptic exploration, and displacement activity were coded from videotapes. Compared with the standard, the deforming surface elicited longer latency, more exploratory behavior, and more displacement in walkers, but not in crawlers, suggesting that typical mode of locomotion influences perceived traversability. These findings were replicated in Experiment 1B, in which the infant was presented with a dual walkway, forcing a choice between the two surfaces. Experiments 2, 3A and B, and 4A and B investigated the use of optical and haptic information in detecting traversability of rigid and nonrigid surfaces. Patterns of exploration varied with the information presented and differed for crawlers and walkers in the case of a deformable surface, as an affordance theory would predict.

Use of central and peripheral optical flow in stance and locomotion in young walkers.

Young walkers (up to 5 years of age) were presented with optical flow in a moving room. Flow was global or was restricted to either the center or the periphery of the visible optic array. On standing trials the response rate was greatest when peripheral flow was available. The availability of central flow had a smaller effect on standing, and the younger children showed greater response rates to frontal flow than did the older ones. There was a strong negative correlation between age and response rate for all conditions. Flow also affected stability during locomotion. Response rate was again related to the location of the available flow. It is concluded that children show the same relative sensitivity for flow in the periphery of the dynamic structure of the optic array as has been observed in adults, but that this differentiation of different areas of optical structure is not yet fully developed when children learn to stand.