Embodied gestalts: Unstable visual phenomena become stable when they are stimuli for competitive action selection.

An animal's environment is rich with affordances. Different possible actions are specified by visual information while competing for dominance over neural dynamics. Affordance competition models account for this in terms of winner-takes-all cross-inhibition dynamics. Multistable phenomena also reveal how the visual system deals with ambiguity. Their key property is spontaneous instability, in forms such as alternating dominance in binocular rivalry. Theoretical models of self-inhibition or self-organized instability posit that the instability is tied to some kind of neural adaptation and that its functional significance is to enable flexible perceptual transitions. We hypothesized that the two perspectives are interlinked. Spontaneous instability is an intrinsic property of perceptual systems, but it is revealed when they are stripped from the constraints of possibilities for action. To test this, we compared a multistable gestalt phenomenon against its embodied version and estimated the neural adaptation and competition parameters of an affordance transition dynamic model. Wertheimer's (Zeitschrift fur Psychologie 61, 161-265, 1912) optimal (ß) and pure (φ) forms of apparent motion from a stroboscopic point-light display were endowed with action relevance by embedding the display in a visual object-tracking task. Thus, each mode was complemented by its action, because each perceptual mode uniquely enabled different ways of tracking the target. Perceptual judgment of the traditional apparent motion exhibited spontaneous instabilities, in the form of earlier switching when the frame rate was changed stepwise. In contrast, the embodied version exhibited hysteresis, consistent with affordance transition studies. Consistent with our predictions, the parameter for competition between modes in the affordance transition model increased, and the parameter for self-inhibition vanished.

Bernstein's levels of movement construction: A contemporary perspective.

Explanation of how goal-directed movements are made manifest is the ultimate aim of the field classically referred to as "motor control". Essential to the sought-after explanation is comprehension of the supporting functional architecture. Seven decades ago, the Russian physiologist and movement scientist Nikolai A. Bernstein proposed a hierarchical model to explain the construction of movements. In his model, the levels of the hierarchy share a common language (i.e., they are commensurate) and perform complementing functions to bring about dexterous movements. The science of the control and coordination of movement in the phylum Craniata has made considerable progress in the intervening seven decades. The contemporary body of knowledge about each of Bernstein's hypothesized functional levels is both more detailed and more sophisticated. A natural consequence of this progress, however, is the relatively independent theoretical development of a given level from the other levels. In this essay, we revisit each level of Bernstein's hierarchy from the joint perspectives of (a) the ecological approach to perception-action and (b) dynamical systems theory. We review a substantial and relevant body of literature produced in different areas of study that are accommodated by this ecological-dynamical version of Bernstein's levels. Implications for the control and coordination of movement and the challenges to producing a unified theory are discussed.

Effects of visual and auditory guidance on bimanual coordination complexity.

Perceptual guidance of movement with simple visual or temporal information can facilitate performance of difficult coordination patterns. Guidance may override coordination constraints that usually limit stability of bimanual coordination to only in-phase and anti-phase. Movement dynamics, however, might not have the same characteristics with and without perceptual guidance. Do visual and auditory guidance produce qualitatively different dynamical organization of movement? An anti-phase wrist flexion and extension coordination task was performed under no specific perceptual guidance, under temporal guidance with a metronome, and under visual guidance with a Lissajous plot. For the time series of amplitudes, periods and relative phases, temporal correlations were measured with Detrended Fluctuation Analysis and complexity levels were measured with multiscale entropy. Temporal correlations of amplitudes and relative phases deviated from the typical 1/f variation towards more random variation under visual guidance. The same was observed for the series of periods under temporal guidance. Complexity levels for all time series were lower in visual guidance, but higher for periods under temporal guidance. Perceptual simplification of the task's goal may produce enhancement of performance, but it is accompanied by changes in the details of movement organization that may be relevant to explain dependence and poor retention after practice under guidance.

Anticipation in manual tracking with multiple delays.

Two experiments are reported showing that behavior exhibited in manual tracking is consistent with behavior predicted by a dynamical systems phenomenon known as anticipating synchronization (Voss, 2000). They extend a prior investigation of the effect of delay on anticipatory manual tracking (Stepp, 2009) by also manipulating coupling strength. The coupling scheme in Experiment 1 and that in Experiment 2 go beyond the single delayed feedback coupling used in previous research and articulations of anticipating synchronization. These advanced coupling arrangements are addressed using an extended formulation which allows for multiple feedback delays, a continuous range of delay, or even coupling to real future values. The latter case is specifically investigated in Experiment 2, which utilizes a navigation task that provides a natural way to speak about coupling to future values. (PsycINFO Database Record

Non-obvious influences on perception-action abilities.

The sciences of development and learning have been slow to acknowledge that absence of an identifiable experience that relates straightforwardly to a given perception-action ability need not mean that experience per se is irrelevant to the emergence of that ability. A recent study reveals that a difference in diet (plain vs. energy rich) leads to a difference in how rats navigate (use of geometry vs. use of features, respectively). It is a good example of how a seemingly unrelated experience (e.g., what the rats eat) can be a non-obvious yet crucial determiner of perception-action modes. We situate this finding in the broader context of the related conceptions of Schneirla's and Lehrman's Developmental Systems Theory, Gottlieb's Probabilistic Epigenesis, and Bolles's Structure of Learning (see article for references). In doing so we highlight that such phenomena may be the norm, both in development and learning, rather than the exception.

Size and distance are perceived independently in an optical tunnel: Evidence for direct perception.

The historical but questionable size-distance invariance hypothesis (SDIH) features computation over geometric, oculomotor, and binocular cues and the coupling of percepts-perceived size, S', is mediated by perceived distance, D'. A contemporary non-mediational hypothesis holds that S' and D' are specific to distinct optical variables. We report two experiments with an optical tunnel, an arrangement of alternating black and white concentric rings, that allows systematic manipulation of the optic array at a point of observation while controlling a variety of size and depth cues. Participants viewed targets of different sizes at different distances monocularly, reporting S' and D' via magnitude production. In Experiment 1, the target was either placed in a continuous tunnel (extending 164cm) or in a tunnel that truncated at the target's location. Experiment 2 included a third tunnel, one that was truncated with a flat depiction of the posterior surface structure that would have been visible in the continuous tunnel. In both experiments, S' decreased with D but D' was unaffected by S. Partial correlation analyses showed that the relationship between S' and D' was not significant when the contributions of other variables were removed. Importantly, S' and D' were affected differently by manipulations of the optical tunnel's continuity while computationally obvious visual cues were controlled. These outcomes suggest that D' is not a mediator of S'. Rather S' and D' are independently determined with correlated but different optical bases, results that support the direct model.

Affordance-based perception-action dynamics: A model of visually guided braking.

Behavioral dynamics is a framework for understanding adaptive behavior as arising from the self-organizing interaction between animal and environment. The methods of nonlinear dynamics provide a language for describing behavior that is both stable and flexible. Behavioral dynamics has been criticized for ignoring the animal's sensitivity to its own capabilities, leading to the development of an alternative framework: affordance-based control. Although it is theoretically sound and empirically motivated, affordance-based control has resisted characterization in terms of nonlinear dynamics. Here, we provide a dynamical description of affordance-based control, extending behavioral dynamics to meet its criticisms. We propose a general modeling strategy consistent with both theories. We use visually guided braking as a representative behavior and construct a novel dynamical model. This model demonstrates the possibility of understanding visually guided action as respecting the limits of the actor's capabilities, while still being guided by informational variables associated with desired states of affairs. In addition to such "hard" constraints on behavior, our framework allows for the influence of "soft" constraints such as preference and comfort, opening a new area of inquiry in perception-action dynamics.

Haptic perceptual intent in quiet standing affects multifractal scaling of postural fluctuations.

Research on dynamic touch has shown that when a rod strapped to the shoulders is wielded via axial rotations, flexions-extensions, and lateral bending of the trunk, participants can selectively perceive whole rod length and partial rod length (e.g., a leftward segment) with precision comparable to wielding by hand (Palatinus, Carello & Turvey, 2011). The present research addressed whether this haptic ability is preserved in quiet standing, when postural control is limited to center of pressure (COP) fluctuations at the mm/ms scale, and, if so, whether the intentions ("perceive partial," "perceive whole") are distinguishable within the fluctuations. Given standard manipulations of rod length and attached mass, participants provided significantly distinct, appropriately scaled, whole and partial estimates of rod length. COP displacement time series were subjected to multifractal, detrended fluctuation analysis. The resultant spectrum of fractal scaling exponents for gradually different-sized fluctuations revealed that "perceive partial" was manifest as larger exponents for progressively smaller fluctuations than "perceive whole." Our results indicate (a) that the significant mechanical variables for haptically perceiving object extent are available in the small scale of normal body sway, and (b) that these seemingly "passive" movements reflect the intention of the perceiver.

The medium of haptic perception: a tensegrity hypothesis.

For any given animal, the sources of mechanical disturbances inducing tissue deformation define environment from the perspective of the animal's haptic perceptual system. The system's achievements include perceiving the body, attachments to the body, and the surfaces and substances adjacent to the body. Among the perceptual systems, it stands alone in having no defined medium. There is no articulated functional equivalent to air and water, the media that make possible the energy transmissions and diffusions underpinning the other perceptual systems. To identify the haptic system's medium the authors focus on connective tissue and the conjunction of muscular, connective tissue net, and skeletal (MCS) as the body's proper characterization. The challenge is a biophysical formulation of MCS as a continuum that, similar to air and water, is homogeneous and isotropic. The authors hypothesized a multifractal tensegrity (MFT) with the shape and stability of the constituents of each scale, from individual cell to whole body, derivative of continuous tension and discontinuous compression. Each component tensegrity of MFT is an adjustive-receptive unit, and the array of tensions in MFT is information about MCS. The authors extend the MFT hypothesis to body-brain linkages, and to limb perception phenomena attendant to amputation, vibration, anesthesia, neuropathy, and microgravity.

Balance affects prism adaptation: evidence from the latent aftereffect.

In prism adaptation experiments, the effect on throwing to a target is reduced (primary aftereffect is smaller) when the throwing condition with prisms removed (first test phase) is different from the throwing condition with prisms (the training phase). The missing adaptation, however, can be revealed through further testing (second test phase) in which the throwing condition during training is fully reinstated. We studied throwing underhand to a target flush with the floor. During training, participants wore left-shifting prism glasses while standing on the floor (Group 1) or on a balance board (Groups 2 and 3). Tests 1 and 2 following training involved the same underhand throwing. For Group 2, Test 1 was on the balance board and Test 2 on the ground; for Group 3, the order was reversed; and for Group 1, both tests were on the ground. The Group 3 Test 1 aftereffect was smaller, and the Test 2 aftereffect was larger than the respective tests for Groups 1 and 2, with the aftereffect sum the same for all three groups. A parallel was noted between prism adaptation and implicit memory: whether given training (study) conditions lead to better or poorer persistence of adaptation (memory performance) at test depends on the fit between the conditions at test relative to the conditions at training (study). In the general memory case, those conditions will involve nonobvious contributors to memory performance, analogous to the support for upright standing in the adaptation of the visual system to prismatic distortion investigated in the present research.

Negative hysteresis in the behavioral dynamics of the affordance "graspable".

One commonly perceives whether a visible object will afford grasping with one hand or with both hands. In experiments in which differently sized objects of a fixed type are presented, the transition from using one of these manual modes to the other depends on the ratio of object size to hand span and on the presentation sequence, with size increasing versus decreasing. Conventional positive hysteresis (i.e., a larger transition ratio for the increasing sequence) can be accommodated by the order parameter dynamics that typify self-organizing systems (Lopresti-Goodman, Turvey, and Frank, Attention, Perception, & Psychophysics 73:1948-1965, 2011). Here we identified and addressed conditions of unconventional negative hysteresis (i.e., a larger transition ratio for the decreasing sequence). They suggest a second control parameter in the self-organization of affordance perception, one that is seemingly regulated by inhibitory dynamics occurring in the agent-task-environment system. Our experimental results and modeling extend the investigation of affordance perception within dynamical systems theory.

Symmetry breaking analysis of prism adaptation's latent aftereffect.

The effect of prism adaptation on movement is typically reduced when the movement at test (prisms off) differs on some dimension from the movement at training (prisms on). Some adaptation is latent, however, and only revealed through further testing in which the movement at training is fully reinstated. Applying a nonlinear attractor dynamic model (Frank, Blau, & Turvey, 2009) to available data (Blau, Stephen, Carello, & Turvey, 2009), we provide evidence for a causal link between the latent (or secondary) aftereffect and an additive force term that is known to account for symmetry breaking. The evidence is discussed in respect to the hypothesis that recalibration aftereffects reflect memory principles (encoding specificity, transfer-appropriate processing) oriented to time-translation invariance-when later testing conserves the conditions of earlier training. Forgetting or reduced adaptation effects follow from the loss of this invariance and are reversed by its reinstatement.

The role of haptic information in shaping coordination dynamics: inertial frame of reference hypothesis.

Current research suggests that non-visual perception of the spatial orientation of body segments is tied to vectors representative of their mass moment distribution (v(mm)). Our question was whether the relative orientation of v(mm) of right and left hands (Δv(mm)=v(mm) left-v(mm) right) constitutes haptic information supporting bimanual coordination and, if so, how it contributes to coordination dynamics. Blindfolded participants coordinated the motions of a pair of cross-shaped, hand-held pendulums that were either symmetrically loaded (Δv(mm)=0) or asymmetrically loaded (Δv(mm)≠0). The sign and magnitude of Δv(mm), in particular of the first moment vector, systematically affected the pattern of coordination (indexed by mean relative phase ϕ), but not its stability. These results suggest that (1) Δv(mm) specifies a frame of reference about which coordination is organized; and (2) that the changes in pattern were a function of the experimentally induced biases in this perceptual frame of reference and not a function of a functional asymmetry akin to detuning. The implications of the findings to the understanding of perceptual regulation of interlimb coordination were discussed.

Behavioral dynamics of the affordance "graspable".

On a daily basis, one perceives whether an object affords grasping with one hand or with both hands. In experiments in which differently sized objects of a fixed type have been presented, the transition from using one manual mode to the other has depended on both the ratio of object size to hand span and the presentation sequence-that is, size increasing versus decreasing. The transitions and their observed hysteresis (i.e., a transition ratio larger for the increasing sequence) can be accommodated by the order parameter dynamics typifying self-organizing systems. Here, we show that hysteresis magnitude depends on (a) the interaction between the attractors (one hand vs. two hands) and (b) the strength of the two-hands attractor. Through modeling and experimental results, we extend the investigation of affordance perception within dynamical-systems theory.

Philosophy for the rest of cognitive science.

Cognitive science has always included multiple methodologies and theoretical commitments. The philosophy of cognitive science should embrace, or at least acknowledge, this diversity. Bechtel's (2009a) proposed philosophy of cognitive science, however, applies only to representationalist and mechanist cognitive science, ignoring the substantial minority of dynamically oriented cognitive scientists. As an example of nonrepresentational, dynamical cognitive science, we describe strong anticipation as a model for circadian systems (Stepp & Turvey, 2009). We then propose a philosophy of science appropriate to nonrepresentational, dynamical cognitive science.

Place learning by mechanical contact.

For some animals (e.g. the night-active wandering spider) the encounters with the habitat that result in place learning are predominantly mechanical. We asked whether place learning limited to mechanical contact, like place learning in general, entails vectors tied to individual landmarks and relations between landmarks. We constructed minimal environments for blindfolded human participants. Landmarks were raised steps. 'Home' was a mechanically indistinct location. Travel was linear. The mechanical contacts were those of walking, stepping, and probing with a soft-tipped cane. Home-orienting activities preceded tests of finding home from a given location with landmarks unchanged or (unbeknown to participants) shifted. In a one-landmark environment, perceived home shifted in the same direction, with the same magnitude, as the shifted landmark. In an environment of two landmarks located in the same direction from home, shifting the further landmark toward home resulted in a change in home's perceived location that preserved the original ratio of distances separating home, nearer landmark, and further landmark. Both findings were invariant over the travel route to the test location and repetitions of testing. It seems, therefore, that for humans (and, perhaps, for wandering spiders), mechanical contact can reveal the vectors and relations specifying places.

Human odometer is gait-symmetry specific.

In 1709, Berkeley hypothesized of the human that distance is measurable by 'the motion of his body, which is perceivable by touch'. To be sufficiently general and reliable, Berkeley's hypothesis must imply that distance measured by legged locomotion approximates actual distance, with the measure invariant to gait, speed and number of steps. We studied blindfolded human participants in a task in which they travelled by legged locomotion from a fixed starting point A to a variable terminus B, and then reproduced, by legged locomotion from B, the A-B distance. The outbound ('measure') and return ('report') gait could be the same or different, with similar or dissimilar step sizes and step frequencies. In five experiments we manipulated bipedal gait according to the primary versus secondary distinction revealed in symmetry group analyses of locomotion patterns. Berkeley's hypothesis held only when the measure and report gaits were of the same symmetry class, indicating that idiothetic distance measurement is gait-symmetry specific. Results suggest that human odometry (and perhaps animal odometry more generally) entails variables that encompass the limbs in coordination, such as global phase, and not variables at the level of the single limb, such as step length and step number, as traditionally assumed.

Dispersion of response times reveals cognitive dynamics.

Trial-to-trial variation in word-pronunciation times exhibits 1/f scaling. One explanation is that human performances are consequent on multiplicative interactions among interdependent processes-interaction dominant dynamics. This article describes simulated distributions of pronunciation times in a further test for multiplicative interactions and interdependence. Individual participant distributions of approximately 1,100 word-pronunciation times were successfully mimicked for each participant in combinations of lognormal and power-law behavior. Successful hazard function simulations generalized these results to establish interaction dominant dynamics, in contrast with component dominant dynamics, as a likely mechanism for cognitive activity.