Movement and perceptual strategies to intercept virtual sound sources.

To intercept a moving object, one needs to be in the right place at the right time. In order to do this, it is necessary to pick up and use perceptual information that specifies the time to arrival of an object at an interception point. In the present study, we examined the ability to intercept a laterally moving virtual sound object by controlling the displacement of a sliding handle and tested whether and how the interaural time difference (ITD) could be the main source of perceptual information for successfully intercepting the virtual object. The results revealed that in order to accomplish the task, one might need to vary the duration of the movement, control the hand velocity and time to reach the peak velocity (speed coupling), while the adjustment of movement initiation did not facilitate performance. Furthermore, the overall performance was more successful when subjects employed a time-to-contact (tau) coupling strategy. This result shows that prospective information is available in sound for guiding goal-directed actions.

Refreshing Refreshable Braille Displays.

The increased access to books afforded to blind people via e-publishing has given them long-sought independence for both recreational and educational reading. In most cases, blind readers access materials using speech output. For some content such as highly technical texts, music, and graphics, speech is not an appropriate access modality as it does not promote deep understanding. Therefore blind braille readers often prefer electronic braille displays. But, these are prohibitively expensive. The search is on, therefore, for a low-cost refreshable display that would go beyond current technologies and deliver graphical content as well as text. And many solutions have been proposed, some of which reduce costs by restricting the number of characters that can be displayed, even down to a single braille cell. In this paper, we demonstrate that restricting tactile cues during braille reading leads to poorer performance in a letter recognition task. In particular, we show that lack of sliding contact between the fingertip and the braille reading surface results in more errors and that the number of errors increases as a function of presentation speed. These findings suggest that single cell displays which do not incorporate sliding contact are likely to be less effective for braille reading.

(Dis-)Harmony in movement: effects of musical dissonance on movement timing and form.

While the origins of consonance and dissonance in terms of acoustics, psychoacoustics and physiology have been debated for centuries, their plausible effects on movement synchronization have largely been ignored. The present study aimed to address this by investigating whether, and if so how, consonant/dissonant pitch intervals affect the spatiotemporal properties of regular reciprocal aiming movements. We compared movements synchronized either to consonant or to dissonant sounds and showed that they were differentially influenced by the degree of consonance of the sound presented. Interestingly, the difference was present after the sound stimulus was removed. In this case, the performance measured after consonant sound exposure was found to be more stable and accurate, with a higher percentage of information/movement coupling (tau coupling) and a higher degree of movement circularity when compared to performance measured after the exposure to dissonant sounds. We infer that the neural resonance representing consonant tones leads to finer perception/action coupling which in turn may help explain the prevailing preference for these types of tones.

Auditory observation of stepping actions can cue both spatial and temporal components of gait in Parkinson׳s disease patients.

OBJECTIVES: A common behavioural symptom of Parkinson׳s disease (PD) is reduced step length (SL). Whilst sensory cueing strategies can be effective in increasing SL and reducing gait variability, current cueing strategies conveying spatial or temporal information are generally confined to the use of either visual or auditory cue modalities, respectively. We describe a novel cueing strategy using ecologically-valid 'action-related' sounds (footsteps on gravel) that convey both spatial and temporal parameters of a specific action within a single cue. METHODS: The current study used a real-time imitation task to examine whether PD affects the ability to re-enact changes in spatial characteristics of stepping actions, based solely on auditory information. In a second experimental session, these procedures were repeated using synthesized sounds derived from recordings of the kinetic interactions between the foot and walking surface. A third experimental session examined whether adaptations observed when participants walked to action-sounds were preserved when participants imagined either real recorded or synthesized sounds. RESULTS: Whilst healthy control participants were able to re-enact significant changes in SL in all cue conditions, these adaptations, in conjunction with reduced variability of SL were only observed in the PD group when walking to, or imagining the recorded sounds. CONCLUSIONS: The findings show that while recordings of stepping sounds convey action information to allow PD patients to re-enact and imagine spatial characteristics of gait, synthesis of sounds purely from gait kinetics is insufficient to evoke similar changes in behaviour, perhaps indicating that PD patients have a higher threshold to cue sensorimotor resonant responses.

Synthesis of walking sounds for alleviating gait disturbances in Parkinson's disease.

Managing gait disturbances in people with Parkinson's disease is a pressing challenge, as symptoms can contribute to injury and morbidity through an increased risk of falls. While drug-based interventions have limited efficacy in alleviating gait impairments, certain nonpharmacological methods, such as cueing, can also induce transient improvements to gait. The approach adopted here is to use computationally-generated sounds to help guide and improve walking actions. The first method described uses recordings of force data taken from the steps of a healthy adult which in turn were used to synthesize realistic gravel-footstep sounds that represented different spatio-temporal parameters of gait, such as step duration and step length. The second method described involves a novel method of sonifying, in real time, the swing phase of gait using real-time motion-capture data to control a sound synthesis engine. Both approaches explore how simple but rich auditory representations of action based events can be used by people with Parkinson's to guide and improve the quality of their walking, reducing the risk of falls and injury. Studies with Parkinson's disease patients are reported which show positive results for both techniques in reducing step length variability. Potential future directions for how these sound approaches can be used to manage gait disturbances in Parkinson's are also discussed.

Time to get a move on: overcoming bradykinetic movement in Parkinson's disease with artificial sensory guidance generated from biological motion.

Paradoxical kinesia describes the motor improvement in Parkinson's disease (PD) triggered by the presence of external sensory information relevant for the movement. This phenomenon has been puzzling scientists for over 60 years, both in neurological and motor control research, with the underpinning mechanism still being the subject of fierce debate. In this paper we present novel evidence supporting the idea that the key to understanding paradoxical kinesia lies in both spatial and temporal information conveyed by the cues and the coupling between perception and action. We tested a group of 7 idiopathic PD patients in an upper limb mediolateral movement task. Movements were performed with and without a visual point light display, travelling at 3 different speeds. The dynamic information presented in the visual point light display depicted three different movement speeds of the same amplitude performed by a healthy adult. The displays were tested and validated on a group of neurologically healthy participants before being tested on the PD group. Our data show that the temporal aspects of the movement (kinematics) in PD can be moderated by the prescribed temporal information presented in a dynamic environmental cue. Patients demonstrated a significant improvement in terms of movement time and peak velocity when executing movement in accordance with the information afforded by the point light display, compared to when the movement of the same amplitude and direction was performed without the display. In all patients we observed the effect of paradoxical kinesia, with a strong relationship between the perceptual information prescribed by the biological motion display and the observed motor performance of the patients.

Timekeeping strategies operate independently from spatial and accuracy demands in beat-interception movements.

The prevailing paradigm for researching sensorimotor synchronisation in humans involves finger tapping and temporal accuracy measures. However, many successful sensorimotor synchronisation actions require not only to be 'in time', but also to be in a predefined spatial position. Reaching this spatial position in many everyday actions often exceeds the average amplitude of a finger movement. The aim of this study is to address how people coordinate their movement to be in the right place at the right time when the scale of the movement varies. Does the scale of the movement and accuracy demands of the movement change the ability to accurately synchronise? To address these questions, a sensorimotor synchronisation task with three different inter-beat intervals, two different movement amplitudes and two different target widths was used. Our experiment demonstrated that people use different timing strategies--employing either a movement strategy (varying movement time) or a waiting strategy (keeping movement time constant) for large-scale movements. Those two strategies were found to be equally successful in terms of temporal accuracy and variability (spread of errors). With longer interval durations (2.5 and 3.5 s), variability of sensorimotor synchronisation performance increased (measured as the spread of errors). Analysing the data using the Vorberg and Wing (Handbook of perception and action. Academic Press, New York, pp 181-262, 1996) model shows a need to develop further existing timing models of sensorimotor synchronisation so that they could apply to large-scale movements, where different movement strategies naturally emerge.

Expertise is perceived from both sound and body movement in musical performance.

Music is a rich form of nonverbal communication, in which the movements that expert musicians make during performance can influence the perception of expressive and structural features of the music. Whether the actual skill of a musician is perceivable from vision of movement was examined. In Experiment 1, musicians and non-musicians rated performances by novice, intermediate and expert clarinettists from point-light animations of their movements, sound recordings, or both. Performances by clarinettists of more advanced skill level were rated significantly higher from vision of movements, although this effect was stronger when sound was also presented. In Experiment 2, movements and sound from the novice and expert clarinettists' performances were switched for half the presentations, and were matched for the rest. Ratings of novice music were significantly higher when presented with expert movements, although the opposite was not found for expert sound presented with novice movements. No perceptual effect of raters' own level of musicianship was found in either experiment. These results suggest that expertise is perceivable from vision of musicians' body movements, although perception of skill from sound is dominant. The results from Experiment 2 further indicate a cross-modal effect of vision and audition on the perception of musical expertise.

Timing movements to interval durations specified by discrete or continuous sounds.

Understanding how the timing of motor output is coupled to sensory temporal information is largely based on synchronisation of movements through small motion gaps (finger taps) to mostly empty sensory intervals (discrete beats). This study investigated synchronisation of movements between target barriers over larger motion gaps when closing time gaps of intervals were presented as either continuous, dynamic sounds, or discrete beats. Results showed that although synchronisation errors were smaller for discrete sounds, the variability of errors was lower for continuous sounds. Furthermore, finger movement between targets was found to be more sinusoidal when continuous sensory information was presented during intervals compared to discrete. When movements were made over larger amplitudes, synchronisation errors tended to be more positive and movements between barriers more sinusoidal, than for movements over shorter amplitudes. These results show that the temporal control of movement is not independent from the form of the sensory information that specifies time gaps or the magnitude of the movement required for synchronisation.