SmartDetector: Automatic and vision-based approach to point-light display generation for human action perception.

Over the past four decades, point-light displays (PLD) have been integrated into psychology and psychophysics, providing a valuable means to probe human perceptual skills. Leveraging the inherent kinematic information and controllable display parameters, researchers have utilized this technique to examine the mechanisms involved in learning and rehabilitation. However, classical PLD generation methods (e.g., motion capture) are difficult to apply for behavior analysis in real-world situations, such as patient care or sports activities. Therefore, there is a demand for automated and affordable tools that enable efficient and real-world-compatible generation of PLDs for psychological research. In this paper, we propose SmartDetector, a new artificial intelligence (AI)-based tool for automatic PLD creation from RGB videos. To evaluate humans' perceptual skills for processing PLD building with SmartDetector, 126 participants were randomly assigned to recognition, discrimination, or detection tasks. Results demonstrated that, irrespective of the task, PLDs generated by SmartDetector exhibited commendable perceptual performance in terms of accuracy and response times compared to literature findings. Moreover, to enhance usability and broaden accessibility, we developed an intuitive web interface for our method, making it available to a wider audience. The resulting application is available at https://plavimop.prd.fr/index.php/en/automatic-creation-pld . SmartDetector offers interesting possibilities for using PLD in research and makes the use of PLD more accessible for nonacademic applications.

PLAViMoP database: A new continuously assessed and collaborative 3D point-light display dataset.

It was more than 45 years ago that Gunnar Johansson invented the point-light display technique. This showed for the first time that kinematics is crucial for action recognition, and that humans are very sensitive to their conspecifics' movements. As a result, many of today's researchers use point-light displays to better understand the mechanisms behind this recognition ability. In this paper, we propose PLAViMoP, a new database of 3D point-light displays representing everyday human actions (global and fine-motor control movements), sports movements, facial expressions, interactions, and robotic movements. Access to the database is free, at https://plavimop.prd.fr/en/motions . Moreover, it incorporates a search engine to facilitate action retrieval. In this paper, we describe the construction, functioning, and assessment of the PLAViMoP database. Each sequence was analyzed according to four parameters: type of movement, movement label, sex of the actor, and age of the actor. We provide both the mean scores for each assessment of each point-light display, and the comparisons between the different categories of sequences. Our results are discussed in the light of the literature and the suitability of our stimuli for research and applications.

The Added Value of Point-Light Display Observation in Total Knee Arthroplasty Rehabilitation Program: A Prospective Randomized Controlled Pilot Study.

Background and Objectives: The present study aimed to assess the potential benefit of the observation of rehabilitation-related point-light display in addition to a conventional 3-week rehabilitation program, the objective being to improve functional capacity in patients having undergone total knee arthroplasty. Materials and Methods: Patients randomized in the control group had conventional rehabilitation treatment with two sessions per day 5 days a week of physical therapy (90 min), whereas patients in the experimental group had a program of conventional rehabilitation combined with a point-light display observation two times per day (5 min) and 3 days a week. Results: The patients of both groups had improved their performances by the end of the program, and the pre- and post-test improvement were superior for the experimental group over the control group concerning the total WOMAC score (p = 0.04), the functional WOMAC score (p = 0.03), and correct recognition of point-light displays (p = 0.003). Conclusions: These findings provide new insight favoring systematic point-light display observation to improve functional recovery in patients with total knee arthroplasty.

Physical and observational practices of unusual actions prime action verb processing.

Numerous studies have highlighted a strong relationship between language and sensorimotor processes, showing, for example, that perceiving an action influences subsequent language processing. Moreover, previous studies have demonstrated that the context in which actions are perceived is crucial to enable this action-language relationship. In particular, action verb processing is facilitated when an action is perceived in its usual context (e.g., someone watering a plant) but not in an unusual context (e.g., someone watering a computer). This difference could be explained in terms of experience; because people always practice actions in accordance with the context, they have no (visual or motor) experience related to the unusual context. The aim of the present study was to test this assumption by assessing and comparing the effect of physical practice and observational learning on the action-language relationship. The results of two experiments showed a facilitation effect of both training methods. Whereas usual actions systematically prime action verb processing, the link between action and language appears for unusual actions only after training by practicing (experiment 1, physical practice) or observing (experiment 2, observational learning). Overall, these findings support the role of experience in the activation of sensorimotor representations during action verb processing.

Evaluative Threat Increases Effort Expenditure in a Cycling Exercise: An Exploratory Study.

Research shows that negative or threatening emotional stimuli can foster movement velocity and force. However, less is known about how evaluative threat may influence movement parameters in endurance exercise. Based on social self-preservation theory, the authors predicted that evaluative threat would facilitate effort expenditure in physical exercise. In an exploratory study, 27 young men completed a bogus intelligence test and received either low-intelligence-quotient feedback (evaluative threat) or no feedback (control). Next, they were asked to pedal on a stationary bicycle for 30 min at a constant cadence. After 10 min (calibration period), the cadence display was hidden. Findings show that participants under evaluative threat increased cadence more than control participants during the subsequent 20-min critical period. These findings underline the potential importance of unrelated evaluative threat on physical performance.

PLAViMoP: How to standardize and simplify the use of point-light displays.

The study of biological point-light displays (PLDs) has fascinated researchers for more than 40 years. However, the mechanisms underlying PLD perception remain unclear, partly due to difficulties with precisely controlling and transforming PLD sequences. Furthermore, little agreement exists regarding how transformations are performed. This article introduces a new free-access program called PLAViMoP (Point-Light Display Visualization and Modification Platform) and presents the algorithms for PLD transformations actually included in the software. PLAViMoP fulfills two objectives. First, it standardizes and makes clear many classical spatial and kinematic transformations described in the PLD literature. Furthermore, given its optimized interface, PLAViMOP makes these transformations easy and fast to achieve. Overall, PLAViMoP could directly help scientists avoid technical difficulties and make possible the use of PLDs for nonacademic applications.

Reliability of on-line visual feedback influences learning of continuous motor task of healthy young adults.

A continuous task was used to determine how the reliability of on-line visual feedback during acquisition impacts motor learning. Participants performed a right hand pointing task of a repeated sequence with a visual cursor that was either reliable, moderately unreliable, or largely unreliable. Delayed retention tests were administered 24 h later, as well as intermanual transfer tests (performed with the left hand). A visuospatial transfer test was performed with the same targets' sequence (same visuospatial configuration) while a motor transfer test was performed with the visual mirror of the targets' sequence (same motor patterns). Results showed that pointing was slower and long-term learning disrupted in the largely unreliable visual cursor condition, compared with the reliable and moderately unreliable conditions. Also, analysis of transfers revealed classically better performance on visuospatial transfer than on motor transfer for the reliable condition. However, here we first show that such difference disappears when the cursor was moderately or largely unreliable. Interestingly, these results indicated a difference in the type of sequence coding, depending on the reliability of the on-line visual feedback. This recourse to mixed coding opens up interesting perspectives, as it is known to promote better learning of motor sequences.

Use of variable online visual feedback to optimize sensorimotor coding and learning of a motor sequence.

The present study characterized the impact of reliable and/or unreliable online visual feedback and their order of presentation on the coding and learning of a motor sequence. Participants practiced a 12-element motor sequence 200 times. During this acquisition phase, two groups received a single type (i.e., either reliable or unreliable) of online visual feedback, two other groups encountered both types of feedback: either reliable first then unreliable, or unreliable first then reliable. Delayed retention tests and intermanual transfer tests (visuospatial and motor) were administered 24 hours later. Results showed that varying the reliability of online visual information during the acquisition phase allowed participants to use different task coding modalities without damaging their long-term sequence learning. Moreover, starting with reliable visual feedback, replaced halfway through with unreliable feedback promoted motor coding, which is seldom observed. This optimization of motor coding opens up interesting perspectives, as it is known to promote better learning of motor sequences.

Feedback and intention during motor-skill learning: a connection with prospective memory.

The intention to complete an action in the future can improve the learning of this action, but it is unknown whether this effect persists when feedback is manipulated during encoding. In experiment 1, participants were instructed to learn a motor skill with or without intending to reproduce this learning in the future, and feedback on their movements was administrated by self-decision, that is, participants asked for feedback whenever they wanted it. The results showed that intention increased the frequency with which feedback was requested, but did not improve motor performance. In experiment 2, participants had to learn the task with high or few feedbacks, which they could not control. In these conditions, intention was beneficial in promoting motor learning only for a low feedback schedule. We suggest that the beneficial effect of intention on learning can be overshadowed or emphasised by the feedback processing during encoding. These findings are discussed in light of theories surrounding prospective memory.

Practice makes transfer of motor skills imperfect.

We investigated the practice-effects on motor skill transfer and the associated representational memory changes that occur during the within-practice and between-practice phases. In two experiments, participants produced extension-flexion movements with their dominant right arm for a limited or prolonged practice session arranged in either a single- or multi-session format. We tested the ability of participants to transfer the original pattern (extrinsic transformation) or the mirrored one (intrinsic transformation) to the non-dominant left arm, 10 min and 24 h after the practice sessions. Results showed that practice induces rapid motor skill improvements that are non-transferable irrespective of the amount of acquisition trials. Furthermore, the extrinsic component of the skill develops early and remains the dominant coding system during practice. Conversely, we found distinct between-practice memory changes: a limited practice induces an off-line development of the extrinsic component, whereas a prolonged practice session subserves the off-line development of the intrinsic component (experiment 2). We provided further evidence that the long-term representation of the motor skill also depends on the nature of the practice session itself: the parsing of practice into multiple sessions narrows the effector-transfer capacities in comparison to a single session (experiment 1). These findings yield theoretical and practical implications that are discussed in the context of recent motor skill learning models.

On the role of imagery modalities on motor learning.

In the present study, we examine specifically how the sensory conditions available during physical practice of a task might influence the subsequent use of motor imagery. First, as a pre-test, participants had to physically reproduce knee joint positions with or without vision. Second, they practised motor imagery (15 and 150 trials) with visual, kinaesthetic or visuo-kinaesthetic imagery. A control group with no imagery was included. Post-tests were then performed 10 min and 24 h after each imagery session in a sensory condition similar to that used in the pre-test. Results showed that efficient motor imagery instructions have to take account of the sensory information available during physical experience of the task: kinaesthetic or visuo-kinaesthetic imagery in a no-vision condition, and visual imagery or, to a lesser extent, visuo-kinaesthetic imagery in a vision condition. Discussion focuses on the role of sensory motor memory on motor prediction to simulate a specific movement, and on the similarities between physical and mental practice in the development of sensory-specific movement representation.

Specificity of practice: interaction between concurrent sensory information and terminal feedback.

In 2 experiments, the authors investigated a potential interaction involving the processing of concurrent feedback using design features from the specificity of practice literature and the processing of terminal feedback using a manipulation from the guidance hypothesis literature. In Experiment 1, participants produced (198 trials) flexion-extension movements to reproduce a specific pattern of displacement over time with or without vision of the limb position and with 100% or 33% knowledge of results (KR) frequency. The transfer test was performed without vision and KR. In Experiment 2, the authors assessed whether sensory information processing was modulated by the amount of practice. Participants performed 54 or 396 trials under a 100% or a 33% KR frequency with vision before being transferred to a no-vision condition without KR. Results of both experiments indicated that the Vision-33% condition suffered a larger detrimental effect of withdrawing visual information than the Vision-100% condition. Experiment 2 indicated that this detrimental effect increased with practice. These results indicated the reduction in terminal feedback prompted participants to more deeply process the concurrent visual information thus reinforcing their dependency on the visual information.

The influence of eye-movements on the development of a movement sequence representation during observational and physical practice.

An experiment was conducted to examine the development of a movement sequence representation and the role of eye-movements during observational and physical practice. The task was to reproduce a 1300ms spatial-temporal pattern of a sequence of elbow flexions and extensions. An inter-manual transfer design with a retention and two effector transfer tests (contralateral limb) was used. The mirror transfer test required the same pattern of homologous muscle activation and a sequence of joint angles as experienced during the acquisition phase, and the non-mirror transfer test required the same visual-spatial pattern as performed or observed during acquisition. Participants were randomly assigned to one of four groups differing in eye-movements (free to use their eyes vs. instruction to fixate) and the practice type (observational practice vs. physical practice). The results indicated that permitting to use eye-movements facilitates sequence learning. This advantage was found on both practice types. The results of the transfer tests indicated that participants of the physical practice group who were permitted to use their eyes demonstrated superior transfer performance in the mirror transfer test, while participants in the observational practice group demonstrated better performance on the non-mirror transfer test. These findings indicated that eye-movements enhanced the development of a visual-spatial representation during observational practice as well as a motor representation during physical practice.

The intention superiority effect in motor skill learning.

Three experiments were conducted to determine if the intention to perform motor sequences in the future results in similar patterns of activation and inhibition as observed for verbal scripts. In Experiments 1 and 2, intention was induced by informing one group that they would be tested on the tasks following acquisition; the other group was not informed of the retention test. Recognition tests administered prior to and after the retention test indicated a strong intention superiority effect. However, intention instructions provided either at the end of acquisition (Experiment 1) or before acquisition (Experiment 2) failed to impact acquisition or retention performance of the motor sequences, but did influence the latency of responding on the retention test. Experiment 3 was designed to replicate the results of Experiments 1 and 2 using a within-subjects design and extend these findings to observation. The results indicated that intention instructions resulted in a strong intention superiority effect for both the physical and observational practice participants, but the performance on the intentional tasks was enhanced only for the observational practice group.

Magnifying visual target information and the role of eye movements in motor sequence learning.

An experiment investigated the influence of eye movements on learning a simple motor sequence task when the visual display was magnified. The task was to reproduce a 1300 ms spatial-temporal pattern of elbow flexions and extensions. The spatial-temporal pattern was displayed in front of the participants. Participants were randomly assigned to four groups differing on eye movements (free to use their eyes/instructed to fixate) and the visual display (small/magnified). All participants had to perform a pre-test, an acquisition phase, a delayed retention test, and a transfer test. The results indicated that participants in each practice condition increased their performance during acquisition. The participants who were permitted to use their eyes in the magnified visual display outperformed those who were instructed to fixate on the magnified visual display. When a small visual display was used, the instruction to fixate induced no performance decrements compared to participants who were permitted to use their eyes during acquisition. The findings demonstrated that a spatial-temporal pattern can be learned without eye movements, but being permitting to use eye movements facilitates the response production when the visual angle is increased.

Specificity of learning in a video-aiming task: modifying the salience of dynamic visual cues.

The authors investigated whether the salience of dynamic visual information in a video-aiming task mediates the specificity of practice. Thirty participants practiced video-aiming movements in a full-vision, a weak-vision, or a target-only condition before being transferred to the target-only condition without knowledge of results. The full- and weak-vision conditions resulted in less endpoint bias and variability in acquisition than did the target-only condition. Going from acquisition to transfer resulted in a large increase in endpoint variability for the full-vision group but not for the weak-vision or target-only groups. Kinematic analysis revealed that weak dynamic visual cues do not mask the processing of other sources of afferent information; unlike strong visual cues, weak visual cues help individuals calibrate less salient sources of afferent information, such as proprioception.

The role of eye movements in motor sequence learning.

An experiment that utilized a 16-element movement sequence was designed to determine the impact of eye movements on sequence learning. The participants were randomly assigned to two experimental groups: a group that was permitted to use eye movements (FREE) and a second group (FIX) that was instructed to fixate on a marker during acquisition (ACQ). A retention test (RET) was designed to provide a measure of learning, and two transfer tests were designed to determine the extent to which eye movements influenced sequence learning. The results demonstrated that both groups decreased the response time to produce the sequence, but the participants in the FREE group performed the sequence more quickly than participants of the FIX group during the ACQ, RET and the two transfer tests. Furthermore, continuous visual control of response execution was reduced over the course of learning. The results of the transfer tests indicated that oculomotor information regarding the sequence can be stored in memory and enhances response production.

The role of knowledge of results frequency in learning through observation.

The authors examined whether reduced knowledge of results (KR) frequency during observation of a model's performance enhances learning. As they viewed a timing task, observers (n = 54) received KR about the model's performance on each trial (100% KR) or on 1 out of 3 trials (33% KR). Controls (n = 18) received only physical practice; they did not take part in the observation session. The authors also wanted to dissociate the guidance effect of KR during physical practice from the guidance role played by the representation acquired during observation. Therefore, following the observation phase, participants physically performed the task with either the same or a different KR frequency than that experienced during observation. The effects of observation and physical practice on learning were assessed in delayed retention tests. The beneficial effect of reduced KR frequency during observation continued for the following physical practice phases. Possible explanations as to why KR influences observational learning are discussed.

Conscious awareness of action potentiates sensorimotor learning.

Many everyday skills are unconsciously learned through repetitions of the same behaviour by binding independent motor acts into unified sets of actions. However, our ability to be consciously aware of producing newly and highly trained motor skills raises the question of the role played by conscious awareness of action upon skill acquisition. In this study we strengthened conscious awareness of self-produced sequential finger movements by way of asking participants to judge their performance in terms of maximal fluency after each trial. Control conditions in which participants did not make any judgment or performance-unrelated judgments were also included. Findings indicate that conscious awareness of action, enhanced via subjective appraisal of motor efficiency, potentiates sensorimotor learning and skilful motor production in optimising the processing and sequencing of action units, as compared to the control groups. The current work lends support to the claim that the learning and skilful expression of sensorimotor behaviours might be grounded upon our ability to be consciously aware of our own motor capability and efficiency.

Retrieval practice in motor learning.

In this study we sought to determine whether testing promotes the generalization of motor skills during the process of encoding and/or consolidation. We used a dynamic arm movement task that required participants to reproduce a spatial-temporal pattern of elbow extensions and flexions with their dominant right arm. Generalization of motor learning was tested by the ability to transfer the original pattern (extrinsic transformation) or the mirrored pattern (intrinsic transformation) to the unpractised left arm. To investigate the testing effects during both encoding and consolidation processing, participants were administered an initial testing session during early practice before being evaluated on a post-practice testing session administered either 10min (Testing-Encoding group) or 24hr apart (Testing-Consolidation group), respectively. Control groups were required to perform a post-practice testing session administered after either a 10-min (Control-Encoding group) or 24-hr delay (Control-Consolidation group). The findings revealed that testing produced rapid, within-practice skill improvements, yielding better effector transfer at the 10-min testing for the Testing-Encoding group on both extrinsic and intrinsic transformation tests when compared with the Control-Encoding group. Furthermore, we found better performance for the Testing-Consolidation group at the 24-hr testing for extrinsic and intrinsic transformations of the movement pattern when compared with the Control-Consolidation group. However, our results did not indicate any significant testing advantage on the latent, between-session development of the motor skill representation (i.e., from the 10-min to the 24-hr testing). The testing benefits expressed at the 10-min testing were stabilised but did not extend during the period of consolidation. This indicates that testing contributes to the generalisation of motor skills during encoding but not consolidation.