Information-theory analysis of mouse string-pulling agrees with Fitts's Law: Increasing task difficulty engages multiple sensorimotor modalities in a dual oscillator behavior.

Mouse string pulling, in which a mouse reels in a string with hand-over-hand movements, can provide insights into skilled motor behavior, neurological status, and cognitive function. The task involves two oscillatory movements connected by a string. The snout oscillates to track the pendulum movement of the string produced by hand-over-hand oscillations of pulling, and so the snout guides the hands to grasp the string. The present study examines the allocation of time required to pull strings of varying diameter. Movement is also described with end-point measures, string-pulling topography with 2D markerless pose estimates based on transfer learning with deep neural networks, and Mat-lab image-segmentation and heuristic algorithms for object tracking. With reduced string diameter, mice took longer to pull 60 cm long strings. They also made more pulling cycles, misses, and mouth engagements, and displayed changes in the amplitude and frequency of pull cycles. The time measures agree with Fitts's law in showing that increased task difficulty slows behavior and engages multiple compensatory sensorimotor modalities. The analysis reveals that time is a valuable resource in skilled motor behavior and information-theory can serve as a measure of its effective use.

Many preschoolers do not distinguish the possible from the impossible in a marble-catching task.

Do preschoolers differentiate events that might and might not happen from events that cannot happen? The current study modified Redshaw & Suddendorf's "Y-shaped tube task" to test how the ability to distinguish mere possibilities from impossibilities emerges over ontogenesis. In the Y-shaped tube task, the experimenter holds a ball above a tube shaped like an upside-down "Y" and asks a participant to catch it. A participant who identifies the two possible paths the ball can take should cover both exits at the bottom of the Y. But children might cover both exits without identifying both possibilities. For example, there are two good places to put hands, so they might just put one hand in each place. This does not require checking whether there is a path from the entrance to each exit. If children cover both exits because they have identified two possible paths for the ball, then they should differentiate exits where it is possible for the ball to come out from impossible exits, where there is no path from the entrance to the exit. In total, 24 36-month-olds and 24 48-month-olds were tested. Less than 20% of 36-month-olds and only about half of 48-month-olds distinguished between possible and impossible exits. Children who do not distinguish the possible from the impossible might not be evaluating possibilities at all. Results converge with existing literature suggesting that action planning that is sensitive to incompatible possibilities often emerges after the fourth birthday.

Actions are characterized by 'canonical moments' in a sequence of movements.

Understanding what others are doing is an essential aspect of social cognition that depends on our ability to quickly recognize and categorize their actions. To effectively study action recognition we need to understand how actions are bounded, where they start and where they end. Here we borrow a conceptual approach - the notion of 'canonicality' - introduced by Palmer and colleagues in their study of object recognition and apply it to the study of action recognition. Using a set of 50 video clips sourced from stock photography sites, we show that many everyday actions - transitive and intransitive, social and non-social, communicative - are characterized by 'canonical moments' in a sequence of movements that are agreed by participants to 'best represent' a named action, as indicated in a forced choice (Exp 1, n = 142) and a free choice (Exp 2, n = 125) paradigm. In Exp 3 (n = 102) we confirm that canonical moments from action sequences are more readily named as depicting specific actions and, mirroring research in object recognition, that such canonical moments are privileged in memory (Exp 4, n = 95). We suggest that 'canonical moments', being those that convey maximal information about human actions, are integral to the representation of human action.1.

Automated system for training and assessing reaching and grasping behaviors in rodents.

BACKGROUND: Reaching, grasping, and pulling behaviors are studied across species to investigate motor control and problem solving. String pulling is a distinct reaching and grasping behavior that is rapidly learned, requires bimanual coordination, is ethologically grounded, and has been applied across species and disease conditions. NEW METHOD: Here we describe the PANDA system (Pulling And Neural Data Analysis), a hardware and software system that integrates a continuous string loop connected to a rotary encoder, feeder, microcontroller, high-speed camera, and analysis software for the assessment and training of reaching, grasping, and pulling behaviors and synchronization with neural data. RESULTS: We demonstrate this system in rats implanted with electrodes in motor cortex and hippocampus and show how it can be used to assess relationships between reaching, pulling, and grasping movements and single-unit and local-field activity. Furthermore, we found that automating the shaping procedure significantly improved performance over manual training, with rats pulling > 100 m during a 15-minute session. COMPARISON WITH EXISTING METHODS: String-pulling is typically shaped by tying food reward to the string and visually scoring behavior. The system described here automates training, streamlines video assessment with deep learning, and automatically segments reaching movements into distinct reach/pull phases. No system, to our knowledge, exists for the automated shaping and assessment of this behavior. CONCLUSIONS: This system will be of general use to researchers investigating motor control, motivation, sensorimotor integration, and motor disorders such as Parkinson's disease and stroke.

Field-based longitudinal evaluation of multimodal worker fatigue assessments in offshore shiftwork.

Fatigue in offshore environments is a critical safety hazard, yet the utility of daily fatigue assessments has not been longitudinally examined in these environments. The aim of this exploratory longitudinal field study across two drillships in the Gulf of Mexico was to determine the changes in subjective, performance-based, and physiological fatigue measures over time across different shift types (day, night, and swing) and to identify correlations between these multimodal fatigue assessments. Repeated measures correlation analyses of daily fatigue data from seventy offshore workers revealed that while total sleep time remained unaffected by time on rig, workers' performances on the psychomotor vigilance test (PVT) deteriorated over time across all shift types. Several correlations between the various multimodal measures were consistent with the extant literature on worker fatigue symptoms and perceptual and physiological manifestations. These findings emphasize the utility of PVT and single item self-reports to capture worker fatigue in offshore shiftwork.

The functional role of visual information and fixation stillness in the quiet eye.

The final fixation to a target in far-aiming tasks, known as the quiet eye, has been consistently identified as an important perceptual-cognitive variable for task execution. Yet, despite a number of proposed mechanisms it remains unclear whether the fixation itself is driving performance effects or is simply an emergent property of underpinning cognitions. Across two pre-registered studies, novice golfers (n = 127) completed a series of golf putts in a virtual reality simulation to examine the function of the quiet eye in the absence of visual information. In experiment 1 participants maintained a quiet eye fixation even when all visual information was occluded. Visual occlusion did significantly disrupt motor skill accuracy, but the effect was relatively small (89cm vs 105cm radial error, std. beta = 0.25). In experiment 2, a 'noisy eye' was induced using covertly moving fixation points, which disrupted skill execution (p = .04, BF = 318.07, std. beta = -0.25) even though visual input was equivalent across conditions. Overall, the results showed that performers persist with a long pre-shot fixation even in the absence of visual information, and that the stillness of this fixation confers a functional benefit that is not merely related to improved information extraction.

Grip Force Dynamics During Exoskeleton-Assisted and Virtual Grasping.

The grip force dynamics during grasping and lifting of diversely weighted objects are highly informative about an individual's level of sensorimotor control and potential neurological condition. Therefore, grip force profiles might be used for assessment and bio-feedback training during neurorehabilitation therapy. Modern neurorehabilitation methods, such as exoskeleton-assisted grasping and virtual-reality-based hand function training, strongly differ from classical grasp-and-lift experiments which might influence the sensorimotor control of grasping and thus the characteristics of grip force profiles. In this feasibility study with six healthy participants, we investigated the changes in grip force profiles during exoskeleton-assisted grasping and grasping of virtual objects. Our results show that a light-weight and highly compliant hand exoskeleton is able to assist users during grasping while not removing the core characteristics of their grip force dynamics. Furthermore, we show that when participants grasp objects with virtual weights, they adapt quickly to unknown virtual weights and choose efficient grip forces. Moreover, predictive overshoot forces are produced that match inertial forces which would originate from a physical object of the same weight. In summary, these results suggest that users of advanced neurorehabilitation methods employ and adapt their prior internal forward models for sensorimotor control of grasping. Incorporating such insights about the grip force dynamics of human grasping in the design of neurorehabilitation methods, such as hand exoskeletons, might improve their usability and rehabilitative function.

Breakdown of category-specific word representations in a brain-constrained neurocomputational model of semantic dementia.

The neurobiological nature of semantic knowledge, i.e., the encoding and storage of conceptual information in the human brain, remains a poorly understood and hotly debated subject. Clinical data on semantic deficits and neuroimaging evidence from healthy individuals have suggested multiple cortical regions to be involved in the processing of meaning. These include semantic hubs (most notably, anterior temporal lobe, ATL) that take part in semantic processing in general as well as sensorimotor areas that process specific aspects/categories according to their modality. Biologically inspired neurocomputational models can help elucidate the exact roles of these regions in the functioning of the semantic system and, importantly, in its breakdown in neurological deficits. We used a neuroanatomically constrained computational model of frontotemporal cortices implicated in word acquisition and processing, and adapted it to simulate and explain the effects of semantic dementia (SD) on word processing abilities. SD is a devastating, yet insufficiently understood progressive neurodegenerative disease, characterised by semantic knowledge deterioration that is hypothesised to be specifically related to neural damage in the ATL. The behaviour of our brain-based model is in full accordance with clinical data-namely, word comprehension performance decreases as SD lesions in ATL progress, whereas word repetition abilities remain less affected. Furthermore, our model makes predictions about lesion- and category-specific effects of SD: our simulation results indicate that word processing should be more impaired for object- than for action-related words, and that degradation of white matter should produce more severe consequences than the same proportion of grey matter decay. In sum, the present results provide a neuromechanistic explanatory account of cortical-level language impairments observed during the onset and progress of semantic dementia.

Post-stroke deficits in the anticipatory control and bimanual coordination during naturalistic cooperative bimanual action.

BACKGROUND: Unilateral stroke leads to asymmetric deficits in movement performance; yet its effects on naturalistic bimanual actions, a key aspect of everyday functions, are understudied. Particularly, how naturalistic bimanual actions that require the two hands to cooperatively interact with each other while manipulating a single common object are planned, executed, and coordinated after stroke is not known. In the present study, we compared the anticipatory planning, execution, and coordination of force between individuals with left and right hemisphere stroke and neurotypical controls in a naturalistic bimanual common-goal task, lifting a box. METHOD: Thirty-three individuals with chronic stroke (15 LCVA, 18 RCVA) and 8 neurotypical age-matched controls used both hands to lift a box fitted with force transducers under unweighted and weighted conditions. Primary dependent variables included measures of anticipation (peak grip and load force rate), execution (peak grip force, load force), and measures of within-hand (grip-load force coordination) and between-hand coordination (force rate cross-correlations). Primary analyses were performed using linear mixed effects modeling. Exploratory backward stepwise regression examined predictors of individual variability within participants with stroke. RESULTS: Participants with stroke, particularly the RCVA group, showed impaired scaling of grip and load force rates with the addition of weight, indicating deficits in anticipatory control. While there were no group differences in peak grip force, participants with stroke showed significant impairments in peak load force and in grip-load force coordination with specific deficits in the evolution of load force prior to object lift-off. Finally, there were differences in spatial coordination of load force rates for participants with stroke, and especially the RCVA group, as compared to controls. Unimanual motor performance of the paretic arm and hemisphere of lesion (right hemisphere) were the key predictors of impairments in anticipatory planning of grip force and bimanual coordination among participants with stroke. CONCLUSIONS: These results suggest that individuals with stroke, particularly those with right hemisphere damage, have impairments in anticipatory planning and interlimb coordination of symmetric cooperative bimanual tasks.

Temporal hierarchy of observed goal-directed actions.

During social interactions, we continuously integrate current and previous information over varying timescales to infer other people's action intentions. Motor cognition theories argue for a hierarchical organization of goal-directed actions based on temporal scales. Accordingly, transient motor primitives are represented at lower levels of the hierarchy, a combination of primitives building motor sequences at subordinate levels, and more stable overarching action goals at superordinate levels. A neural topography of hierarchal timescales for information accumulation was previously shown in the visual and auditory domains. However, whether such a temporal hierarchy can also account for observed goal-directed action representations in motor pathways remains to be determined. Thus, the current study examined the neural architecture underlying the processing of observed goal-directed actions using inter-subject correlation (ISC) of fMRI activity. Observers (n = 24) viewed sequential hand movements presented in their intact order or piecewise scrambled at three timescales pertaining to goal-directed action evolution (Primitives: ± 1.5 s, Sub-Goals: ± 4 s, and High-Goals: ± 10 s). The results revealed differential intrinsic temporal capacities for integrating goal-directed action information across brain areas engaged in action observation. Longer timescales (> ± 10 s) were found in the posterior parietal and dorsal premotor compared to the ventral premotor (± 4 s) and anterior parietal (± 1.5 s) cortex. Moreover, our results revealed a hemispheric bias with more extended timescales in the right MT+, primary somatosensory, and early visual cortices compared to their homotopic regions in the left hemisphere. Our findings corroborate a hierarchical neural mapping of observed actions based on temporal scales of goals and provide further support for a ubiquitous time-dependent neural organization of information processing across multiple modalities.

Observation and imitation of object-directed hand movements in Parkinson's disease.

Action observation and imitation may facilitate movement in Parkinson's disease (PD). People with PD have been found to imitate intransitive actions similarly to neurologically healthy older adults, but their imitation of object-directed hand movements has not previously been investigated using kinematic measures. The present study examined observation and imitation of object-directed hand movements in 18 participants with PD and 21 neurologically healthy age-matched control participants. Participants observed and immediately imitated sequences showing a human hand reaching for and transferring an object between horizontal positions. Both groups significantly modulated their finger movements, showing higher vertical amplitude when imitating elevated compared to direct trajectories. In addition, movements were lower in vertical amplitude and higher in velocity when imitating the reaching segment than the transfer segment. Eye-tracking revealed that controls made smaller saccades when observing predictable than unpredictable elevated movements, but no effects of predictability on eye movements were found for the PD group. This study provides quantitative evidence that people with mild to moderate PD can imitate object-directed hand movement kinematics, although their prediction of such movements may be reduced. These findings suggest that interventions targeting object-directed actions may capitalize on the ability of people with PD to imitate kinematic parameters of a demonstrated movement.

Interpersonal coordination analysis in bat-and-ball sports under a real game situation: Asymmetric interaction and delayed coupling.

This study investigated the interpersonal coordination between the pitcher and the batter in bat-and-ball sports. Although the importance of interpersonal coordination is widely accepted in many sports, no studies have investigated it in bat-and-ball sports because the dominant task constraints surrounding the interaction between pitcher and batter make it difficult to apply conventional analytic techniques. To address the issue, this study proposes a new analytical framework to investigate interpersonal coordination in bat-and-ball sports under a real game situation with two main characteristics: asymmetric interaction and delayed coupling. First, the dynamic time warping technique was used to evaluate the stability of the head movement pattern of the pitcher and batter, and cross-correlation analysis was used to quantify the temporal relationship between them. We found that the head movement pattern of batters was significantly more unstable than that of pitchers, and approximately 60% of the variance of the change in the head movement pattern of batters could be explained by that of the pitchers. Moreover, expert batters followed a pitcher's movements with a specific time delay of approximately 250 ms. These findings highlight the characteristics of interpersonal coordination in bat-and-ball sports: the pitcher can make a pre-patterned stable motion, whereas the batter needs to follow and adjust their movement to it. Although the effects of prediction ability need to be investigated to understand its detailed mechanism, the contribution of this study is that it revealed the existence of the interpersonal coordination between the pitcher and batter of bat-and-ball sports under a real game situation.

The Effect of Feedback Modality When Learning a Novel Wrist Sensorimotor Transformation Through a Body-Machine Interface.

Body-Machine Interfaces (BoMIs) are promising assistive and rehabilitative tools for helping individuals with impaired motor abilities regain independence. When operating a BoMI, the user has to learn a novel sensorimotor transformation between the movement of certain body parts and the output of the device. In this study, we investigated how different feedback modalities impacted learning to operate a BoMI. Forty-seven able-bodied participants learned to control the velocity of a 1D cursor using the 3D rotation of their dominant wrist to reach as many targets as possible in a given amount of time. The map was designed to maximize cursor speed for movements around a predefined axis of wrist rotation. We compared the user's performance and control efficiency under three feedback modalities: i) visual feedback of the cursor position, ii) proprioceptive feedback of the cursor position delivered by a wrist manipulandum, iii) both i) and ii). We found that visual feedback led to a greater number of targets reached than proprioceptive feedback alone. Conversely, proprioceptive feedback yielded greater alignment between the axis of rotation of the wrist and the optimal axis represented by the map. These results suggest that proprioceptive feedback may be preferable over visual feedback when information about intrinsic task components, i.e. joint configurations, is of interest as in rehabilitative interventions aiming to promote more effective learning strategies.

The microstructure of intra- and interpersonal coordination.

Movements are naturally composed of submovements, i.e. recurrent speed pulses (2-3 Hz), possibly reflecting intermittent feedback-based motor adjustments. In visuomotor (unimanual) synchronization tasks, partners alternate submovements over time, indicating mutual coregulation. However, it is unclear whether submovement coordination is organized differently between and within individuals. Indeed, different types of information may be variably exploited for intrapersonal and interpersonal coordination. Participants performed a series of bimanual tasks alone or in pairs, with or without visual feedback (solo task only). We analysed the relative timing of submovements between their own hands or between their own hands and those of their partner. Distinct coordinative structures emerged at the submovement level depending on the relevance of visual feedback. Specifically, the relative timing of submovements (between partners/effectors) shifts from alternation to simultaneity and a mixture of both when coordination is achieved using vision (interpersonal), proprioception/efference-copy only (intrapersonal, without vision) or all information sources (intrapersonal, with vision), respectively. These results suggest that submovement coordination represents a behavioural proxy for the adaptive weighting of different sources of information within action-perception loops. In sum, the microstructure of movement reveals common principles governing the dynamics of sensorimotor control to achieve both intra- and interpersonal coordination.

Auditory rhythm complexity affects cardiac dynamics in perception and synchronization.

Accurate perception and production of auditory rhythms are key for human behaviors such as speech and music. Auditory rhythms in music range in their complexity: complex rhythms (based on non-integer ratios between successive tone durations) are more difficult to perceive and produce than simple rhythms (based on integer ratios). The physiological activity supporting this behavioral difference is not well understood. In a within-subjects design, we addressed how rhythm complexity affects cardiac dynamics during auditory perception and production. Musically trained adults listened to and synchronized with simple and complex auditory rhythms while their cardiac activity was recorded. Participants identified missing tones in the rhythms during the Perception condition and tapped on a keyboard to synchronize with the rhythms in the Synchronization condition. Participants were equally accurate at identifying missing tones in simple and complex rhythms during the Perception condition. Tapping synchronization was less accurate and less precise with complex rhythms than with simple rhythms. Linear cardiac analyses showed a slower mean heart rate and greater heart rate variability during perception than synchronization for both simple and complex rhythms; only nonlinear recurrence quantification analyses reflected cardiac differences between simple and complex auditory rhythms. Nonlinear cardiac dynamics were also more deterministic (predictable) during rhythm perception than synchronization. Individual differences during tapping showed that greater heart rate variability was correlated with poorer synchronization. Overall, these findings suggest that linear measures of musicians' cardiac activity reflect global task variability while nonlinear measures additionally reflect stimulus rhythm complexity.

Proactive cues facilitate faster action reprogramming, but not stopping, in a response-selective stop signal task.

The ability to stop simple ongoing actions has been extensively studied using the stop signal task, but less is known about inhibition in more complex scenarios. Here we used a task requiring bimanual responses to go stimuli, but selective inhibition of only one of those responses following a stop signal. We assessed how proactive cues affect the nature of both the responding and stopping processes, and the well-documented stopping delay (interference effect) in the continuing action following successful stopping. In this task, estimates of the speed of inhibition based on a simple-stopping model are inappropriate, and have produced inconsistent findings about the effects of proactive control on motor inhibition. We instead used a multi-modal approach, based on improved methods of detecting and interpreting partial electromyographical responses and the recently proposed SIS (simultaneously inhibit and start) model of selective stopping behaviour. Our results provide clear and converging evidence that proactive cues reduce the stopping delay effect by slowing bimanual responses and speeding unimanual responses, with a negligible effect on the speed of the stopping process.

Proprioceptive short-term memory in passive motor learning.

A physical trainer often physically guides a learner's limbs to teach an ideal movement, giving the learner proprioceptive information about the movement to be reproduced later. This instruction requires the learner to perceive kinesthetic information and store the instructed information temporarily. Therefore, (1) proprioceptive acuity to accurately perceive the taught kinesthetics and (2) short-term memory to store the perceived information are two critical functions for reproducing the taught movement. While the importance of proprioceptive acuity and short-term memory has been suggested for active motor learning, little is known about passive motor learning. Twenty-one healthy adults (mean age 25.6 years, range 19-38 years) participated in this study to investigate whether individual learning efficiency in passively guided learning is related to these two functions. Consequently, learning efficiency was significantly associated with short-term memory capacity. In particular, individuals who could recall older sensory stimuli showed better learning efficiency. However, no significant relationship was observed between learning efficiency and proprioceptive acuity. A causal graph model found a direct influence of memory on learning and an indirect effect of proprioceptive acuity on learning via memory. Our findings suggest the importance of a learner's short-term memory for effective passive motor learning.

Use of variable online visual feedback to optimize sensorimotor coding and learning of a motor sequence.

The present study characterized the impact of reliable and/or unreliable online visual feedback and their order of presentation on the coding and learning of a motor sequence. Participants practiced a 12-element motor sequence 200 times. During this acquisition phase, two groups received a single type (i.e., either reliable or unreliable) of online visual feedback, two other groups encountered both types of feedback: either reliable first then unreliable, or unreliable first then reliable. Delayed retention tests and intermanual transfer tests (visuospatial and motor) were administered 24 hours later. Results showed that varying the reliability of online visual information during the acquisition phase allowed participants to use different task coding modalities without damaging their long-term sequence learning. Moreover, starting with reliable visual feedback, replaced halfway through with unreliable feedback promoted motor coding, which is seldom observed. This optimization of motor coding opens up interesting perspectives, as it is known to promote better learning of motor sequences.

Active production and passive observation of hand movements shift visual hand location.

Which factors influence the perception of our hand location is a matter of current debate. Here, we test if sensorimotor processing contributes to the perception of hand location. We developed a novel visuomotor adaptation procedure to measure whether actively performing hand movements or passively observing them, influences visual perception of hand location. Participants had to point with a handheld controller to a briefly presented visual target. When they reached the remembered position of the target, the controller presented a tactile buzz. In adaptation trials, the tactile buzz was presented when the hand had not yet reached the target. Over the course of trials, participants adapted to the manipulation and pointed to a location between the visual target and the tactile buzz. We measured the perceived location of the hand by flashing a virtual pair of left and right hands before and after adaptation. Participants had to judge which hand they perceived closer to their body on the fronto-parallel plane. After adaptation, they judged the right hand, that corresponded to the hand used during adaptation, to be located further away from the body. We conclude that sensorimotor prediction of the consequences of hand movements shape sensory processing of hand location.

A common timing mechanism across different millisecond domains: evidence from perceptual and motor tasks.

Temporal information processing (TIP) constitutes a complex construct that underlies many cognitive functions and operates in a few hierarchically ordered time domains. This study aimed to verify the relationship between the tens of milliseconds and hundreds of milliseconds domains, referring to perceptual and motor timing, respectively. Sixty four young healthy individuals participated in this study. They underwent two auditory temporal order judgement tasks to assess their performance in the tens of milliseconds domain; on this basis, groups of high-level performers (HLP) and low-level performers (LLP) were identified. Then, a maximum tapping task was used to evaluate performance in the hundreds of milliseconds domain. The most remarkable result was that HLP achieved a faster tapping rate and synchronised quicker with their "internal clock" during the tapping task than did LLP. This result shows that there is a relationship between accuracy in judging temporally asynchronous stimuli and ability to achieve and maintain the pace of a movement adequate to one's internal pacemaker. This could indicate the strong contribution of a common timing mechanism, responsible for temporal organisation and coordination of behaviours across different millisecond domains.