RESUMO
Research shows that high- and low-pitch sounds can be associated with various meanings. For example, high-pitch sounds are associated with small concepts, whereas low-pitch sounds are associated with large concepts. This study presents three experiments revealing that high-pitch sounds are also associated with open concepts and opening hand actions, while low-pitch sounds are associated with closed concepts and closing hand actions. In Experiment 1, this sound-meaning correspondence effect was shown using the two-alternative forced-choice task, while Experiments 2 and 3 used reaction time tasks to show this interaction. In Experiment 2, high-pitch vocalizations were found to facilitate opening hand gestures, and low-pitch vocalizations were found to facilitate closing hand gestures, when performed simultaneously. In Experiment 3, high-pitched vocalizations were produced particularly rapidly when the visual target stimulus presented an open object, and low-pitched vocalizations were produced particularly rapidly when the target presented a closed object. These findings are discussed concerning the meaning of intonational cues. They are suggested to be based on cross-modally representing conceptual spatial knowledge in sensory, motor, and affective systems. Additionally, this pitch-opening effect might share cognitive processes with other pitch-meaning effects.
Assuntos
Tempo de Reação , Humanos , Masculino , Feminino , Adulto Jovem , Adulto , Percepção da Altura Sonora/fisiologia , Percepção Espacial/fisiologia , Gestos , Som , Estimulação Acústica , Sinais (Psicologia)RESUMO
Previous research has revealed congruency effects between different spatial dimensions such as right and up. In the audiovisual context, high-pitched sounds are associated with the spatial dimensions of up/above and front, while low-pitched sounds are associated with the spatial dimensions of down/below and back. This opens the question of whether there could also be a spatial association between above and front and/or below and back. Participants were presented with a high- or low-pitch stimulus at the time of the onset of the visual stimulus. In one block, participants responded according to the above/below location of the visual target stimulus if the target appeared in front of the reference object, and in the other block, they performed these above/below responses if the target appeared at the back of the reference. In general, reaction times revealed an advantage in processing the target location in the front-above and back-below locations. The front-above/back-below effect was more robust concerning the back-below component of the effect, and significantly larger in reaction times that were slower rather than faster than the median value of a participant. However, the pitch did not robustly influence responding to front/back or above/below locations. We propose that this effect might be based on the conceptual association between different spatial dimensions.
Assuntos
Tempo de Reação , Percepção Espacial , Humanos , Masculino , Feminino , Percepção Espacial/fisiologia , Adulto Jovem , Adulto , Tempo de Reação/fisiologia , Estimulação Luminosa , Estimulação Acústica , Percepção Visual/fisiologia , Percepção da Altura Sonora/fisiologiaRESUMO
It has been suggested that actions can provide a fruitful conceptual context for sound symbolism phenomena, and that tight interaction between manual and articulatory processes might cause that hand actions, in particular, are sound-symbolically associated with specific speech sounds. Experiment 1 investigated whether novel words, built from speech sounds that have been previously linked to precision or power grasp responses, are implicitly associated with perceived actions that present precision manipulation or whole-hand grasp tool-use or the corresponding utilisation pantomimes. In the two-alternative forced-choice task, the participants were more likely to match novel words to tool-use actions and corresponding pantomimes that were sound-symbolically congruent with the words. Experiment 2 showed that the same or even larger sound-action symbolism effect can be observed when the pantomimes present unfamiliar utilisation actions. Based on this we propose that the sound-action symbolism might originate from the same sensorimotor mechanisms that process the meaning of iconic gestural signs. The study presents a novel sound-action phenomenon and supports the view that hand-mouth interaction might manifest itself by associating specific speech sounds with grasp-related utilisations.
Assuntos
Fonética , Simbolismo , Humanos , Mãos , Gestos , Força da MãoRESUMO
Previous investigations have shown various interactions between spatial concepts and speech sounds. For instance, the front-high vowel [i] is associated with the concept of forward, and the back-high vowel [o] is associated with the concept of backward. Three experiments investigated whether the concepts of forward/front and backward/back are associated with high- and low-pitched vocalizations, respectively, in Finnish. In Experiments 1 and 2, the participants associated the high-pitched vocalization with the forward-directed movement and the low-pitched vocalizations with the backward-directed movement. In Experiment 3, the same effect was observed in relation to the concepts of front of and back of. We propose that these observations present a novel sound-space symbolism phenomenon in which spatial concepts of forward/front and backward/back are iconically associated with high- and low-pitched speech sounds. This observation is discussed in relation to the grounding of semantic knowledge of these spatial concepts in the movements of articulators such as relative front/back-directed movements of the tongue.
RESUMO
Grasping and mouth movements have been proposed to be integrated anatomically, functionally and evolutionarily. In line with this, we have shown that there is a systematic interaction between particular speech units and grip performance. For example, when the task requires pronouncing a speech unit simultaneously with grasp response, the speech units [i] and [t] are associated with relatively rapid and accurate precision grip responses, while [É] and [k] are associated with power grip responses. This study is aimed at complementing the picture about which vowels and consonants are associated with these grasp types. The study validated our view that the high-front vowels and the alveolar consonants are associated with precision grip responses, while low and high-back vowels as well as velar consonants or those whose articulation involves the lowering of the tongue body are associated with power grip responses. This paper also proposes that one reason why small/large concepts are associated with specific speech sounds in the sound-magnitude symbolism is because articulation of these sounds is programmed within the overlapping mechanisms of precision or power grasping.
Assuntos
Força da Mão , Fonética , Força da Mão/fisiologia , Tempo de Reação/fisiologia , Fala/fisiologia , Língua/fisiologiaRESUMO
Recent evidence has shown linkages between actions and segmental elements of speech. For instance, close-front vowels are sound symbolically associated with the precision grip, and front vowels are associated with forward-directed limb movements. The current review article presents a variety of such sound-action effects and proposes that they compose a category of sound symbolism that is based on grounding a conceptual knowledge of a referent in articulatory and manual action representations. In addition, the article proposes that even some widely known sound symbolism phenomena such as the sound-magnitude symbolism can be partially based on similar sensorimotor grounding. It is also discussed that meaning of suprasegmental speech elements in many instances is similarly grounded in body actions. Sound symbolism, prosody, and body gestures might originate from the same embodied mechanisms that enable a vivid and iconic expression of a meaning of a referent to the recipient.
RESUMO
Even though some individuals subjectively associate various symptoms with infrasound, there are very few systematic studies on the contribution of infrasound to the perception, annoyance, and physiological reactions elicited by wind turbine sound. In this study, sound samples were selected among long-term measurement data from wind power plant and residential areas, both indoors and outdoors, and used in laboratory experiments. In the experiments, the detectability and annoyance of both inaudible and audible characteristics of wind turbine noise were determined, as well as autonomic nervous system responses: heart rate, heart rate variability, and skin conductance response. The participants were divided into two groups based on whether they reported experiencing wind turbine infrasound related symptoms or not. The participants did not detect infrasonic contents of wind turbine noise. The presence of infrasound had no influence on the reported annoyance nor the measured autonomic nervous system responses. No differences were observed between the two groups. These findings suggest that the levels of infrasound in the current study did not affect perception and annoyance or autonomic nervous system responses, even though the experimental conditions corresponded acoustically to real wind power plant areas.
Assuntos
Ruído , Centrais Elétricas , Humanos , PercepçãoRESUMO
This study is devoted to investigating mechanisms that inhibit habituated response associated with affordance of a non-target while executing action directed to a target. In four experiments, a paradigm was used that required a rapid left- or right-hand response according to the direction of the target arrow presented simultaneously or in close temporal proximity to a non-target whose handle position afforded grasping with the left or right hand. In general, responding was decelerated and more erroneous when the handle position was compatible with the responding hand. This effect of response inhibition was removed when the delay between the non-target offset and target onset was longer than 200 ms, and reversed into response facilitation when the target onset was delayed for 400-600 ms. The study suggests that processes that control withholding habitual response associated with affordance of a non-target utilise response inhibition mechanisms overlapping with those involved in behavioural control of the stop-signal task. This response inhibition is triggered automatically and directly by affordance of a non-target without preceding response excitation associated with this affordance cue.
Assuntos
Objetivos , Desempenho Psicomotor , Força da Mão , Humanos , Inibição Psicológica , Tempo de ReaçãoRESUMO
Previous research shows that simultaneously executed grasp and vocalization responses are faster when the precision grip is performed with the vowel [i] and the power grip is performed with the vowel [É]. Research also shows that observing an object that is graspable with a precision or power grip can activate the grip congruent with the object. Given the connection between vowel articulation and grasping, this study explores whether grasp-related size of observed objects can influence not only grasp responses but also vowel pronunciation. The participants had to categorize small and large objects into natural and manufactured categories by pronouncing the vowel [i] or [É]. As predicted, [i] was produced faster when the object's grasp-related size was congruent with the precision grip while [É] was produced faster when the size was congruent with the power grip (Experiment 1). The effect was not, however, observed when the participants were presented with large objects that are not typically grasped by the power grip (Experiment 2). This study demonstrates that vowel production is systematically influenced by grasp-related size of a viewed object, supporting the account that sensory-motor processes related to grasp planning and representing grasp-related properties of viewed objects interact with articulation processes. The paper discusses these findings in the context of size-sound symbolism, suggesting that mechanisms that transform size-grasp affordances into corresponding grasp- and articulation-related motor programs might provide a neural basis for size-sound phenomena that links small objects with closed-front vowels and large objects with open-back vowels.
Assuntos
Força da Mão , Fonética , Fala , Adulto , Feminino , Humanos , Masculino , Som , Adulto JovemRESUMO
It has been shown recently that when participants are required to pronounce a vowel at the same time with the hand movement, the vocal and manual responses are facilitated when a front vowel is produced with forward-directed hand movements and a back vowel is produced with backward-directed hand movements. This finding suggests a coupling between spatial programing of articulatory tongue movements and hand movements. The present study revealed that the same effect can be also observed in relation to directional leg movements. The study suggests that the effect operates within the common directional processes of movement planning including at least tongue, hand and leg movements, and these processes might contribute sound-to-meaning mappings to the semantic concepts of 'forward' and 'backward'.
Assuntos
Desempenho Psicomotor/fisiologia , Fala/fisiologia , Adulto , Feminino , Humanos , Masculino , Adulto JovemRESUMO
Mounting evidence shows interaction between manipulative hand movements and movements of tongue, lips and mouth in a vocal and non-vocal context. The current article reviews this evidence and discusses its contribution to perspectives of development and evolution of speech. In particular, the article aims to present novel insight on how processes controlling the two primary grasp components of manipulative hand movements, the precision and power grip, might be systematically connected to motor processes involved in producing certain articulatory gestures. This view assumes that due to these motor overlaps between grasping and articulation, development of these grip types in infancy can facilitate development of specific articulatory gestures. In addition, the hand-mouth connections might have even boosted the evolution of some articulatory gestures. This account also proposes that some semantic sound-symbolic pairings between a speech sound and a referent concept might be partially based on these hand-mouth interactions.
Assuntos
Encéfalo/fisiologia , Gestos , Mãos/fisiologia , Boca/fisiologia , Movimento , Fala , Animais , Evolução Biológica , Força da Mão , Humanos , Neurônios/fisiologia , Desempenho PsicomotorRESUMO
Research has shown connections between articulatory mouth actions and manual actions. This study investigates whether forward-backward hand movements could be associated with vowel production processes that programme tongue fronting/backing, lip rounding/spreading (Experiment 1), and/or consonant production processes that programme tongue tip and tongue dorsum actions (Experiment 2). The participants had to perform either forward or backward hand movement and simultaneously pronounce different vowels or consonants. The results revealed a response benefit, measured in vocal and manual reaction times, when the responses consisted of front vowels and forward hand movements. Conversely, back vowels were associated with backward hand movements. Articulation of rounded versus unrounded vowels or coronal versus dorsal consonants did not produce the effect. In contrast, when the manual responses of forward-backward hand movements were replaced by precision and power grip responses, the coronal consonants [t] and [r] were associated with the precision grip, whereas the dorsal consonant [k] was associated with the power grip. We propose that the movements of the tongue body, operating mainly for vowel production, share the directional action planning processes with the hand movements. Conversely, the tongue articulators related to tongue tip and dorsum movements, operating mainly for consonant production, share the action planning processes with the precision and power grip, respectively.
Assuntos
Gestos , Força da Mão/fisiologia , Mãos , Movimento/fisiologia , Desempenho Psicomotor/fisiologia , Língua/fisiologia , Adulto , Análise de Variância , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Tempo de Reação/fisiologia , Língua/inervação , Adulto JovemRESUMO
Visual performance is asymmetric across the visual field, but locational biases that occur during dichoptic viewing are not well understood. In this study, we characterized horizontal, vertical and naso-temporal biases in visual target detection during dichoptic stimulation and explored whether the detection was facilitated by non-spatial auditory tones associated with the target's location. The detection time for single monocular targets that were suppressed from view with a 10 Hz dynamic noise mask presented to the other eye was measured at the 4° intercardinal location of each eye with the breaking Continuous Flash Suppression (b-CFS) technique. Each target was either combined with a sound (i.e., high or low pitch tone) that was congruent or incongruent with its vertical location (i.e., upper or lower visual field) or presented without a sound. The results indicated faster detection of targets in the upper rather than lower visual field and faster detection of targets in the nasal than temporal hemifield of each eye. Sounds generally accelerated target detection, but the tone pitch-elevation congruency did not further enhance performance. These findings suggest that visual detection during dichoptic viewing differs from standard viewing conditions with respect to location-related perceptual biases and crossmodal modulation of visual perception. These differences should be carefully considered in experimental designs employing dichoptic stimulation techniques and in display applications that utilize dichoptic viewing.
Assuntos
Percepção Auditiva/fisiologia , Retina/fisiologia , Percepção Visual/fisiologia , Adulto , Feminino , Humanos , Masculino , Estimulação Luminosa , Retina/anatomia & histologia , Córtex Visual/fisiologiaRESUMO
Past studies have revealed connections in directional programming between hands. The present study investigated whether there could also be interaction in programming proximal and distal components of a prehensile hand action. In Experiment 1, the participants performed simultaneously either a push or pull response with the left hand and the grip closure or opening with the right hand. In Experiment 2, the push and pull responses of the left hand were performed together with the precision or power grip responses of the right hand. The participants showed preference, measured in reaction times, to couple the push response with the grip opening and the precision grip, whereas the pull response was associated with the grip closure and the power grip. The study shows for the first time a systematic interaction in proximal and distal prehensile components between two hands. We propose that these effects reflect inter- and intra-limb connections between the representations that prepare the arm extension for the outward reaching, the finger extension for the grip opening, and the motor processes that prepare the precision grip. Conversely, there appear to be connections between the representations that prepare the arm flexion for the inward directed hand movements, the flexion of the thumb and the fingers for the grip closure, and flexion of four fingers for the power grip.
Assuntos
Mãos/fisiologia , Atividade Motora/fisiologia , Desempenho Psicomotor/fisiologia , Adulto , Feminino , Humanos , Masculino , Adulto JovemRESUMO
Manual actions and speech are connected: for example, grip execution can influence simultaneous vocalizations and vice versa. Our previous studies show that the consonant [k] is associated with the power grip and the consonant [t] with the precision grip. Here we studied whether the interaction between speech sounds and grips could operate already at a pre-attentive stage of auditory processing, reflected by the mismatch-negativity (MMN) component of the event-related potential (ERP). Participants executed power and precision grips according to visual cues while listening to syllable sequences consisting of [ke] and [te] utterances. The grips modulated the MMN amplitudes to these syllables in a systematic manner so that when the deviant was [ke], the MMN response was larger with a precision grip than with a power grip. There was a converse trend when the deviant was [te]. These results suggest that manual gestures and speech can interact already at a pre-attentive processing level of auditory perception, and show, for the first time that manual actions can systematically modulate the MMN.
Assuntos
Córtex Cerebral/fisiologia , Potenciais Evocados , Força da Mão , Fonética , Desempenho Psicomotor , Percepção da Fala/fisiologia , Adulto , Eletroencefalografia , Feminino , Humanos , Masculino , Adulto JovemRESUMO
We have recently shown in Finnish speakers that articulation of certain vowels and consonants has a systematic influence on simultaneous grasp actions as well as on forward and backward hand movements. Here we studied whether these effects generalize to another language, namely Czech. We reasoned that if the results generalized to another language environment, it would suggest that the effects arise through other processes than language-dependent semantic associations. Rather, the effects would be likely to arise through language-independent interactions between processes that plan articulatory gestures and hand movements. Participants were presented with visual stimuli specifying articulations to be uttered (e.g., A or I), and they were required to produce a manual response concurrently with the articulation. In Experiment 1 they responded with a precision or a power grip, whereas in Experiment 2 they responded with a forward or a backward hand movement. The grip congruency effect was fully replicated: the consonant [k] and the vowel [α] were associated with power grip responses, while the consonant [t] and the vowel [i] were associated with precision grip responses. The forward/backward congruency effect was replicated with vowels [α], [o], which were associated with backward movement and with [i], which was associated with forward movement, but not with consonants [k] and [t]. These findings suggest that the congruency effects mostly reflect interaction between processes that plan articulatory gestures and hand movements with an exception that the forward/backward congruency effect might only work with vowel articulation.
RESUMO
Previous research has shown that precision and power grip performance is consistently influenced by simultaneous articulation. For example, power grip responses are performed relatively fast with the open-back vowel [a], whereas precision grip responses are performed relatively fast with the close-front vowel [i]. In the present study, the participants were presented with a picture of a hand shaped to the precision or power grip. They were required to pronounce speech sounds according to the front/above perspective of the hand. The results showed that not only the grip performance is affected by simultaneously pronouncing the speech sound but also the production of speech sound can be affected by viewing an image of a grip. The precision grip stimulus triggered relatively rapid production of the front-close vowel [i]. In contrast, the effect related to the power grip stimulus was mostly linked to the vertical dimension of the pronounced vowel since this stimulus triggered relatively rapid production of the back-open vowel [a] and back-mid-open vowel [o] while production of the back-close vowel [u] was not influenced by it. The fact that production of the dorsal consonant [k] or coronal consonant [t] were not influenced by these stimuli suggests that the effect was not associated with a relative front-back tongue shape of the articulation in the absence of changes in any vertical articulatory components. These findings provide evidence for an intimate interaction between certain articulatory gestures and grip types, suggesting that an overlapping visuomotor network operates for planning articulatory gestures and grasp actions.
Assuntos
Força da Mão/fisiologia , Fala/fisiologia , Estimulação Acústica , Adulto , Feminino , Gestos , Mãos , Humanos , Masculino , Fonética , Estimulação Luminosa , Desempenho Psicomotor/fisiologia , Tempo de Reação/fisiologia , Testes de Articulação da Fala , Percepção da Fala/fisiologia , Medida da Produção da Fala , Adulto JovemRESUMO
Contraction of a muscle modulates not only the corticospinal excitability (CSE) of the contracting muscle but also that of different muscles. We investigated to what extent the CSE of a hand muscle is modulated during preparation and execution of teeth clenching and ipsilateral foot dorsiflexion either separately or in combination. Hand-muscle CSE was estimated based on motor evoked potentials (MEPs) elicited by transcranial magnetic stimulation (TMS) and recorded from the first dorsal interosseous (FDI) muscle. We found higher excitability during both preparation and execution of all the motor tasks than during mere observation of a fixation cross. As expected, the excitability was greater during the execution phase than the preparation one. Furthermore, both execution and preparation of combined motor tasks led to higher excitability than individual tasks. These results extend our current understanding of the neural interactions underlying simultaneous contraction of muscles in different body parts.
Assuntos
Pé/fisiologia , Mãos/fisiologia , Contração Muscular/fisiologia , Músculo Esquelético/fisiologia , Tratos Piramidais/fisiologia , Dente/fisiologia , Potencial Evocado Motor/fisiologia , Feminino , Humanos , Masculino , Adulto JovemRESUMO
Previous studies have shown a congruency effect between manual grasping and syllable articulation. For instance, a power grip is associated with syllables whose articulation involves the tongue body and/or large mouth aperture ([kÉ]) whereas a precision grip is associated with articulations that involve the tongue tip and/or small mouth aperture ([ti]). Previously, this effect has been observed in manual reaction times. The primary aim of the current study was to investigate whether this congruency effect also takes place in vocal responses and to investigate involvement of action selection processes in the effect. The congruency effect was found in vocal and manual responses regardless of whether or not the syllable or grip was known a priori, suggesting that the effect operates with minimal or absent action selection processes. In addition, the effect was observed in vocal responses even when the grip was only prepared but not performed, suggesting that merely planning a grip response primes the corresponding articulatory response. These results support the view that articulation and grasping are processed in a partially overlapping network.
Assuntos
Força da Mão/fisiologia , Desempenho Psicomotor/fisiologia , Acústica da Fala , Fala/fisiologia , Adolescente , Adulto , Feminino , Gestos , Humanos , Masculino , Estimulação Luminosa , Tempo de Reação , Língua , Adulto JovemRESUMO
It is known that articulating different syllables is linked to different grasp actions, e.g. [ti] is linked to precision grip, and [kÉ] to power grip. The aim of the present study was to test whether articulating or hearing these syllables would result in an increased activity in the representation of hand muscles involved in these two actions in a muscle-specific manner. To this end, we used transcranial magnetic stimulation (TMS) to investigate changes in the excitability of the left primary motor cortex (M1) innervating hand muscles while participants articulated or listened to meaningless syllables, listened to a metronome, or observed a fixation cross. The motor-evoked potentials of two hand muscles associated with either a precision or power grip exhibited significantly greater amplitudes during articulation than in passive listening, metronome, and fixation cross conditions. Moreover, these muscles exhibited similar patterns of excitability during articulation regardless of which syllable was articulated. The increased excitability of the left M1 hand area during articulation, but not during perception of the syllables, might be due to the cortico-cortical interaction between the motor representations of oral organs with the hand area.