The effect of robot speed on comfortable passing distances.

Robots navigate ever more often in close proximity to people. In the current work, we focused on two distinctive navigational scenarios: passing and overtaking a person who is walking. In the first experiment, we compared nine different passing distances for a humanoid robot and found that human comfort increased with passing distance and that their relationship could be described by an inverted Gaussian. In the second experiment, we validated this relationship for an industrial autonomous robot and extended the study to also include overtaking distances and different robot moving speeds. The results showed that overtaking was considered to be less comfortable than passing but that the overtaking distance had a similar relationship with human comfort. Human comfort decreases with a higher robot movement speed. Results obtained through location trackers furthermore showed that people actively take a larger distance from the robot when it starts its trajectory closer to them. The current results can be used to quantify human comfort in environments where humans and robots co-exist and they can be used as input for human-aware navigational models for autonomous robots.

Optimal illumination for local contrast enhancement based on the human visual system.

The observed color of an object is influenced by the spectral distribution of an illuminant impinging upon it. Here we explored a method to obtain optimal illumination spectra for local contrast enhancement based on human vision. First, multispectral imaging was used to measure the spectral reflectance of the sample and color segmentation was used to extract its color features. Then we obtained the target-specific optimal illumination by maximizing the color differences of mutual colors in our sample tissue. To verify the effectiveness of this method, simulated images under the optimized illumination were compared to illumination with the standard illuminant D65 and a cool white light-emitting diode (5500 K). Results showed that the sample under the optimized illumination had a better perceptual color contrast.

Intra- and interpersonal movement coordination in jointly moving a rocking board.

In this study, we investigate how two persons (dyads) coordinate their movements when performing cyclical motion patterns on a rocking board. In keeping with the Leading Joint Hypothesis (Dounskaia, 2005), the movement dynamics of the collaborating participants were expected to display features of a prime mover with low movement variability. Fourteen subject pairs performed the task in nine amplitude-frequency combinations that were presented in the form of a to-be-tracked stimulus on a computer display. Participants were asked to track the stimulus by jointly rocking the Board sideways while receiving continuous visual feedback of its rotations. Displacements of 28 IREDS that were attached to the rocking board, both ankles, knees, hips, shoulders and heads of both actors, were sampled at 75 Hz by means of a 3D-motion tracking system. From these data, we derived body-segment angular excursions as well as the continuous relative phase and time-lagged cross-correlations between relevant joint excursions. The results show that, at the intrapersonal level, knee rotations initially led all other joints in time while the antiphase coordination between the knees displayed relative low variability. At the interpersonal level, dyads adopted a leader-follower strategy with respect to the coordination demands of the task. We take that knee rotations create a dynamic foundation at both intra-and interpersonal levels involving subordination of individual action to joint performance thereby allowing for low-dimensional control of joint action in a high-dimensional, repetitive motor task.

The role of inferior frontal and parietal areas in differentiating meaningful and meaningless object-directed actions.

Over the past two decades single cell recordings in primates and neuroimaging experiments in humans have uncovered the key properties of visuo-motor mirror neurons located in monkey premotor cortex and parietal cortices as well as homologous areas in the human inferior frontal and inferior parietal cortices which presumably house neurons with similar response properties. One of the most interesting claims regarding the human mirror neuron system (MNS) is that its activity reflects high-level action understanding. If this was the case, one would expect signal in the MNS to differentiate between meaningful and meaningless actions. In the current experiment we tested this prediction using a novel paradigm. Functional magnetic resonance images were collected while participants viewed (i) short films of object-directed actions (ODAs) which were either semantically meaningful, i.e. a hand pressed a stapler or semantically meaningless, i.e. a foot pressed a stapler, (ii) short films of pantomimed actions and (iii) static pictures of objects. Consistent with the notion that the MNS represents high-level action understanding, meaningful and meaningless actions elicited BOLD signal differences at bilateral sites in the supramarginal gyrus (SMG) of the inferior parietal lobule (IPL) where we observed a double dissociation between BOLD response and meaningfullness of actions. Comparison of superadditive responses in the inferior frontal gyrus (IFG) and IPL (supramarginal) regions revealed differential contributions to action understanding. These data further specify the role of specific components of the MNS in understanding object-directed actions.

Joint action: neurocognitive mechanisms supporting human interaction.

Humans are experts in cooperating with each other when trying to accomplish tasks they cannot achieve alone. Recent studies of joint action have shown that when performing tasks together people strongly rely on the neurocognitive mechanisms that they also use when performing actions individually, that is, they predict the consequences of their co-actor's behavior through internal action simulation. Context-sensitive action monitoring and action selection processes, however, are relatively underrated but crucial ingredients of joint action. In the present paper, we try to correct the somewhat simplified view on joint action by reviewing recent studies of joint action simulation, monitoring, and selection while emphasizing the intricate interrelationships between these processes. We complement our review by defining the contours of a neurologically plausible computational framework of joint action.

Consistent haptic feedback is required but it is not enough for natural reaching to virtual cylinders.

In virtual reality it is easy to control the visual cues that tell us about an object's shape. However, it is much harder to provide realistic virtual haptic feedback when grasping virtual objects. In this study we examined the role of haptic feedback when grasping (virtual) cylinders with an elliptical circumference. In Experiment 1 we placed the same circular cylinder at the simulated location of virtual elliptical cylinders of varying shape, so that the haptic feedback did not change when the visually specified shape changed. We found that the scaling of maximum grip aperture with the diameter of the nearest principal axis (.14+/-.04) was much weaker than when grasping real cylinders (.54+/-.04, Cuijpers, Brenner, & Smeets, 2006 Grasping reveals visual misjudgements of shape. Experimental Brain Research, 175, 32-44). For the scaling of grip orientation with the orientation of the cylinder we found large individual differences: the range is .07-.82 (average .42+/-.07) as compared to .55-.79 (average .67+/-.03) for grasping real cylinders. In Experiment 2 we provided consistent haptic feedback by placing real cylinders that matched the location, shape and orientation of the virtual cylinders. The scaling gains of both maximum grip aperture (.39+/-.04) and grip orientation (.56+/-.08) were substantially higher than in Experiment 1, but still lower than for grasps to real cylinders. The variability between participants for the scaling of grip orientation was also much reduced. These results showed that although haptic feedback must be consistent with visual information, it is not sufficient for natural prehension. We discuss the implications of these findings in terms of the integration of visual information with haptic feedback.

Grasping reveals visual misjudgements of shape.

There are many conditions in which the visually perceived shape of an object differs from its true shape. We here show that one can reveal such errors by studying grasping. Nine subjects were asked to grasp and lift elliptical cylinders that were placed vertically at eye height. We varied the cylinder's aspect ratios, orientations about the vertical axis and distances from the subject. We found that the subjects' grip orientations deviated systematically from the orientations that would give the mechanically optimal grip. That this is largely due to misjudging the cylinder's shape (rather than to selecting a comfortable posture) follows from the fact that the grip aperture was initially more strongly correlated with the maximal grip aperture (which is related to the expected contact positions) than with the final grip aperture (which is determined by the real contact positions). The correlation with the maximal grip aperture drops from 0.8 to 0.6 in the last 1% of the traversed distance (11% of movement time), showing that the grip aperture was anticipated incorrectly (it is automatically "corrected" at contact). The grip orientation was already strongly correlated with the grip orientation at the time of maximal grip aperture, half way through the movement (R > or = 0.7), showing that the suboptimal grip orientations were planned that way. We conclude that subjects plan their grasps using information that is based on the misperceived shape.

Goals and means in action observation: a computational approach.

Many of our daily activities are supported by behavioural goals that guide the selection of actions, which allow us to reach these goals effectively. Goals are considered to be important for action observation since they allow the observer to copy the goal of the action without the need to use the exact same means. The importance of being able to use different action means becomes evident when the observer and observed actor have different bodies (robots and humans) or bodily measurements (parents and children), or when the environments of actor and observer differ substantially (when an obstacle is present or absent in either environment). A selective focus on the action goals instead of the action means furthermore circumvents the need to consider the vantage point of the actor, which is consistent with recent findings that people prefer to represent the actions of others from their own individual perspective. In this paper, we use a computational approach to investigate how knowledge about action goals and means are used in action observation. We hypothesise that in action observation human agents are primarily interested in identifying the goals of the observed actor's behaviour. Behavioural cues (e.g. the way an object is grasped) may help to disambiguate the goal of the actor (e.g. whether a cup is grasped for drinking or handing it over). Recent advances in cognitive neuroscience are cited in support of the model's architecture.

On the relation between object shape and grasping kinematics.

Despite the many studies on the visual control of grasping, little is known about how and when small variations in shape affect grasping kinematics. In the present study we asked subjects to grasp elliptical cylinders that were placed 30 and 60 cm in front of them. The cylinders' aspect ratio was varied systematically between 0.4 and 1.6, and their orientation was varied in steps of 30 degrees. Subjects picked up all noncircular cylinders with a hand orientation that approximately coincided with one of the principal axes. The probability of selecting a given principal axis was the highest when its orientation was equal to the preferred orientation for picking up a circular cylinder at the same location. The maximum grip aperture was scaled to the length of the selected principal axis, but the maximum grip aperture was also larger when the length of the axis orthogonal to the grip axis was longer than that of the grip axis. The correlation between the grip aperture--or the hand orientation--at a given instant, and its final value, increased monotonically with the traversed distance. The final hand orientation could already be inferred from its value after 30% of the movement distance with a reliability that explains 50% of the variance. For the final grip aperture, this was only so after 80% of the movement distance. The results indicate that the perceived shape of the cylinder is used for selecting appropriate grasping locations before or early in the movement and that the grip aperture and orientation are gradually attuned to these locations during the movement.

Illusions in action: consequences of inconsistent processing of spatial attributes.

Many authors have performed experiments in which subjects grasp objects in illusory surroundings. The vast majority of these studies report that illusions affect the maximum grip aperture less than they affect the perceived size. This observation has frequently been regarded as experimental evidence for separate visual systems for perception and action. In order to make this conclusion, one assumes that the grip aperture is based on a visual estimate of the object's size. We believe that it is not, and that this is why size illusions fail to influence grip aperture. Illusions generally do not affect all aspects of space perception in a consistent way, but mainly affect the perception of specific spatial attributes. This applies not only to object size, but also to other spatial attributes such as position, orientation, displacement, speed, and direction of motion. Whether an illusion influences the execution of a task will therefore depend on which spatial attributes are used rather than on whether the task is perceptual or motor. To evaluate whether illusions affect actions when they influence the relevant spatial attributes we review experimental results on various tasks with inconsistent spatial processing in mind. Doing so shows that many actions are susceptible to visual illusions. We argue that the frequently reported differential effect of illusions on perceptual judgements and goal-directed action is caused by failures to ensure that the same spatial attributes are used in the two tasks. Illusions only affect those aspects of a task that are based on the spatial attributes that are affected by the illusion.