Intersecting kinematic encoding and readout of intention in autism.

Observers with autism spectrum disorders (ASDs) find it difficult to read intentions from movements. However, the computational bases of these difficulties are unknown. Do these difficulties reflect an intention readout deficit, or are they more likely rooted in kinematic (dis-)similarities between typical and ASD kinematics? We combined motion tracking, psychophysics, and computational analyses to uncover single-trial intention readout computations in typically developing (TD) children (n = 35) and children with ASD (n = 35) who observed actions performed by TD children and children with ASD. Average intention discrimination performance was above chance for TD observers but not for ASD observers. However, single-trial analysis showed that both TD and ASD observers read single-trial variations in movement kinematics. TD readers were better able to identify intention-informative kinematic features during observation of TD actions; conversely, ASD readers were better able to identify intention-informative features during observation of ASD actions. Crucially, while TD observers were generally able to extract the intention information encoded in movement kinematics, those with autism were unable to do so. These results extend existing conceptions of mind reading in ASD by suggesting that intention reading difficulties reflect both an interaction failure, rooted in kinematic dissimilarity between TD and ASD kinematics (at the level of feature identification), and an individual readout deficit (at the level of information extraction), accompanied by an overall reduced sensitivity of intention readout to single-trial variations in movement kinematics.

Morphology, Connectivity, and Encoding Features of Tactile and Motor Representations of the Fingers in the Human Precentral and Postcentral Gyrus.

Despite the tight coupling between sensory and motor processing for fine manipulation in humans, it is not yet totally clear which specific properties of the fingers are mapped in the precentral and postcentral gyrus. We used fMRI to compare the morphology, connectivity, and encoding of the motor and tactile finger representations (FRs) in the precentral and postcentral gyrus of 25 5-fingered participants (8 females). Multivoxel pattern and structural and functional connectivity analyses demonstrated the existence of distinct motor and tactile FRs within both the precentral and postcentral gyrus, integrating finger-specific motor and tactile information. Using representational similarity analysis, we found that the motor and tactile FRs in the sensorimotor cortex were described by the perceived structure of the hand better than by the actual hand anatomy or other functional models (finger kinematics, muscles synergies). We then studied a polydactyly individual (i.e., with a congenital 6-fingered hand) showing superior manipulation abilities and divergent anatomic-functional hand properties. The perceived hand model was still the best model for tactile representations in the precentral and postcentral gyrus, while finger kinematics better described motor representations in the precentral gyrus. We suggest that, under normal conditions (i.e., in subjects with a standard hand anatomy), the sensorimotor representations of the 5 fingers in humans converge toward a model of perceived hand anatomy, deviating from the real hand structure, as the best synthesis between functional and structural features of the hand.SIGNIFICANCE STATEMENT Distinct motor and tactile finger representations exist in both the precentral and postcentral gyrus, supported by a finger-specific pattern of anatomic and functional connectivity across modalities. At the representational level, finger representations reflect the perceived structure of the hand, which might result from an adapting process harmonizing (i.e., uniformizing) the encoding of hand function and structure in the precentral and postcentral gyrus. The same analyses performed in an extremely rare polydactyly subject showed that the emergence of such representational geometry is also found in neuromechanical variants with different hand anatomy and function. However, the harmonization process across the precentral and postcentral gyrus might not be possible because of divergent functional-structural properties of the hand and associated superior manipulation abilities.

Pursuing occupants' health and well-being in building management: Definition of new metrics based on indoor air parameters.

The spread of COVID-19 has affected the lives of millions of people. Pandemic has made people more sensitive to health issues. In particular, the growing concern for the virus spread in confined spaces has promoted the necessity to improve indoor air quality. Literature is stressing how buildings must be designed and operated pursuing occupants' health and well-being, with a particular attention for indoor air parameters. This poses the challenge of monitoring and assessing these aspects through proper metrics. In this paper the approach towards a multi-step assessment procedure embedding in buildings assessment health and well-being related variables and indicators is elaborated. They are intended to inform a building manager of the potential influence of air conditions on human health and well-being. Moreover, a set of monetary metrics (i.e., impacts) is proposed to translate energy and indoor air related building performances into euros, putting the basis for a comprehensive economic evaluation. The application of the set of proposed metrics to an Italian hotel (i.e., Italian pilot of H2020 MOBISTYLE project), enabled to map some indoor air conditions causing health concerns, and to identify clusters of guests with best and worst indoor air conditions, to be targeted by new management strategies. Despite case study specific limitations, the application exemplified how the methodology can expand the traditional energy-based performance assessment for building management towards indoor air domain and the related economic impacts, with implication on results in terms of overall economic performance of the building from both a private and public perspective.

Movement kinematics drive chain selection toward intention detection.

The ability to understand intentions based on another's movements is crucial for human interaction. This ability has been ascribed to the so-called motor chaining mechanism: anytime a motor chain is activated (e.g., grasp-to-drink), the observer attributes to the agent the corresponding intention (i.e., to drink) from the first motor act (i.e., the grasp). However, the mechanisms by which a specific chain is selected in the observer remain poorly understood. In the current study, we investigate the possibility that in the absence of discriminative contextual cues, slight kinematic variations in the observed grasp inform mapping to the most probable chain. Chaining of motor acts predicts that, in a sequential grasping task (e.g., grasp-to-drink), electromyographic (EMG) components that are required for the final act [e.g., the mouth-opening mylohyoid (MH) muscle] show anticipatory activation. To test this prediction, we used MH EMG, transcranial magnetic stimulation (TMS; MH motor-evoked potentials), and predictive models of movement kinematics to measure the level and timing of MH activation during the execution (Experiment 1) and the observation (Experiment 2) of reach-to-grasp actions. We found that MH-related corticobulbar excitability during grasping observation varied as a function of the goal (to drink or to pour) and the kinematics of the observed grasp. These results show that subtle changes in movement kinematics drive the selection of the most probable motor chain, allowing the observer to link an observed act to the agent's intention.

Costs and benefits of communicating vigor.

Why do we run toward people we love, but only walk toward others? One reason is to let them know we love them. In this commentary, we elaborate on how subjective utility information encoded in vigor is read out by others. We consider the potential implications for understanding and modeling the link between movements and decisions in social environments.

Action Observation Areas Represent Intentions From Subtle Kinematic Features.

Mirror neurons have been proposed to underlie humans' ability to understand others' actions and intentions. Despite 2 decades of research, however, the exact computational and neuronal mechanisms implied in this ability remain unclear. In the current study, we investigated whether, in the absence of contextual cues, regions considered to be part of the human mirror neuron system represent intention from movement kinematics. A total of 21 participants observed reach-to-grasp movements, performed with either the intention to drink or to pour while undergoing functional magnetic resonance imaging. Multivoxel pattern analysis revealed successful decoding of intentions from distributed patterns of activity in a network of structures comprising the inferior parietal lobule, the superior parietal lobule, the inferior frontal gyrus, and the middle frontal gyrus. Consistent with the proposal that parietal regions play a key role in intention understanding, classifier weights were higher in the inferior parietal region. These results provide the first demonstration that putative mirror neuron regions represent subtle differences in movement kinematics to read the intention of an observed motor act.

PredPsych: A toolbox for predictive machine learning-based approach in experimental psychology research.

Recent years have seen an increased interest in machine learning-based predictive methods for analyzing quantitative behavioral data in experimental psychology. While these methods can achieve relatively greater sensitivity compared to conventional univariate techniques, they still lack an established and accessible implementation. The aim of current work was to build an open-source R toolbox - "PredPsych" - that could make these methods readily available to all psychologists. PredPsych is a user-friendly, R toolbox based on machine-learning predictive algorithms. In this paper, we present the framework of PredPsych via the analysis of a recently published multiple-subject motion capture dataset. In addition, we discuss examples of possible research questions that can be addressed with the machine-learning algorithms implemented in PredPsych and cannot be easily addressed with univariate statistical analysis. We anticipate that PredPsych will be of use to researchers with limited programming experience not only in the field of psychology, but also in that of clinical neuroscience, enabling computational assessment of putative bio-behavioral markers for both prognosis and diagnosis.

When Far Becomes Near.

On many occasions, people spontaneously or deliberately take the perspective of a person facing them rather than their own perspective. How is this done? Using a spatial perspective task in which participants were asked to identify objects at specific locations, we found that self-perspective judgments were faster for objects presented to the right, rather than the left, and for objects presented closer to the participants' own bodies. Strikingly, taking the opposing perspective of another person led to a reversal (i.e., remapping) of these effects, with reference to the other person's position (Experiment 1). A remapping of spatial relations was also observed when an empty chair replaced the other person (Experiment 2), but not when access to the other viewpoint was blocked (Experiment 3). Thus, when the spatial scene allows a physically feasible but opposing point of view, people respond as if their own bodies were in that place. Imagination can thus overcome perception.

Beyond Autism: Introducing the Dialectical Misattunement Hypothesis and a Bayesian Account of Intersubjectivity.

Drawing on sociocultural theories and Bayesian accounts of brain function, in this article we construe psychiatric conditions as disorders of social interaction to fully account for their complexity and dynamicity across levels of description and temporal scales. After an introduction of the theoretical underpinnings of our integrative approach, we take autism spectrum conditions (ASC) as a paradigm example and discuss how neurocognitive hypotheses can be translated into a Bayesian formulation, i.e., in terms of predictive processing and active inference. We then argue that consideration of individuals (even within a Bayesian framework) will not be enough for a comprehensive understanding of psychiatric conditions and consequently put forward the dialectical misattunement hypothesis, which views psychopathology not merely as disordered function within single brains but also as a dynamic interpersonal mismatch that encompasses various levels of description. Moving from a mere comparison of groups, i.e., "healthy" persons versus "patients," to a fine-grained analysis of social interactions within dyads and groups of individuals will open new avenues and may allow to avoid an overly neurocentric scope in psychiatric research as well as help to reduce social exclusion.

Temporal perception in joint action: This is MY action.

Here we investigated the temporal perception of self- and other-generated actions during sequential joint actions. Participants judged the perceived time of two events, the first triggered by the participant and the second by another agent, during a cooperative or competitive interaction, or by an unspecified mechanical cause. Results showed that participants perceived self-generated events as shifted earlier in time (anticipation temporal judgment bias) and non-self-generated events as shifted later in time (repulsion temporal judgment bias). This latter effect was observed independently from the kind of cause (i.e., agentive or mechanical) or interaction (i.e., cooperative or competitive). We suggest that this might represent a mental process which allows discriminating events that cannot plausibly be linked to one's own action. When an event immediately follows a self-generated one, temporal judgment biases operate as self-serving biases in order to separate self-generated events from events of another physical causality.

The Role of Perspective in Mental Time Travel.

Recent years have seen accumulating evidence for the proposition that people process time by mapping it onto a linear spatial representation and automatically "project" themselves on an imagined mental time line. Here, we ask whether people can adopt the temporal perspective of another person when travelling through time. To elucidate similarities and differences between time travelling from one's own perspective or from the perspective of another person, we asked participants to mentally project themselves or someone else (i.e., a coexperimenter) to different time points. Three basic properties of mental time travel were manipulated: temporal location (i.e., where in time the travel originates: past, present, and future), motion direction (either backwards or forwards), and temporal duration (i.e., the distance to travel: one, three, or five years). We found that time travels originating in the present lasted longer in the self- than in the other-perspective. Moreover, for self-perspective, but not for other-perspective, time was differently scaled depending on where in time the travel originated. In contrast, when considering the direction and the duration of time travelling, no dissimilarities between the self- and the other-perspective emerged. These results suggest that self- and other-projection, despite some differences, share important similarities in structure.

Communicative interactions in point-light displays: Choosing among multiple response alternatives.

Vision scientists are increasingly relying on the point-light technique as a way to investigate the perception of human motion. Unfortunately, the lack of standardized stimulus sets has so far limited the use of this technique for studying social interaction. Here, we describe a new tool to study the interaction between two agents starting from point-light displays: the Communicative Interaction Database - 5AFC format (CID-5). The CID-5 consists of 14 communicative and seven non-communicative individual actions performed by two agents. Stimuli were constructed by combining motion capture techniques and 3-D animation software to provide precise control over the computer-generated actions. For each action stimulus, we provide coordinate files and movie files depicting the action as seen from four different perspectives. Furthermore, the archive contains a text file with a list of five alternative action descriptions to construct forced-choice paradigms. In order to validate the CID-5 format, we provide normative data collected to assess action identification within a 5AFC tasks. The CID-5 archive is freely downloadable from http://bsb-lab.org/research/ and from the supplementary materials of this article.

When gaze opens the channel for communication: Integrative role of IFG and MPFC.

Recent advances in the field of cognitive neuroscience have revealed that direct gaze modulates activity in cortical and subcortical key regions of the 'social brain network', including the inferior frontal gyrus (IFG) and the anterior rostral medial prefrontal cortex (arMPFC). However, very little is known about how direct gaze is processed during live interaction with a real partner. Here, for the first time we used an experimental setup allowing the participant inside an MRI scanner to interact face-to-face with a partner located in the scanner room. Depending on condition, the participant and the partner were instructed either to look at each other in the eyes or to direct their gaze away from the other. As control conditions, participants gazed at their own eyes, reflected in a mirror, or gazed at a picture of the partner's eyes. Results revealed that direct gaze by the partner was associated with activity in areas involved in production and comprehension of language and action, including the IFG, the premotor cortex (PM), and the supplementary motor area (SMA). Activations in these areas were observed regardless of the participant's gaze behavior. In contrast, increased activity in arMPFC, an area involved in inference of other mental states during social interaction and communication, was only observed when the participant reciprocated the partner's direct gaze so as to establish mutual gaze. Psychophysiological interaction (PPI) analysis revealed effective connectivity between the IFG and the arMPFC during mutual gaze. This suggests that, within a larger network concerned with the processing of social gaze, mutual gaze with a real partner is established by an increased coupling between areas involved in the detection of communicative intentions, language, and social interaction.

Stopping movements: when others slow us down.

Previous research has shown that performing joint actions can lead to the representation of both one's own and others' actions. In the present study we explored the influence of co-representation on response stopping. Are joint actions more difficult to stop than solo actions? Using a variation of the stop-signal task, we found that participants needed more time to stop a planned joint action compared with a planned solo action (Experiment 1). This effect was not observed when participants performed the task in the presence of a passive observer (Experiment 2). A third transcranial magnetic stimulation experiment (Experiment 3) demonstrated that joint stopping recruited a more selective suppression mechanism than solo stopping. Taken together, these results suggest that participants used a global inhibition mechanism when acting alone; however, they recruited a more selective and slower suppression mechanism when acting with someone else.

Action prediction in psychosis.

Aberrant motor-sensory predictive functions have been linked to symptoms of psychosis, particularly reduced attenuation of self-generated sensations and misattribution of self-generated actions. Building on the parallels between prediction of self- and other-generated actions, this study aims to investigate whether individuals with psychosis also demonstrate abnormal perceptions and predictions of others' actions. Patients with psychosis and matched controls completed a two-alternative object size discrimination task. In each trial, they observed reaching actions towards a small and a large object, with varying levels of temporal occlusion ranging from 10% to 80% of movement duration. Their task was to predict the size of the object that would be grasped. We employed a novel analytic approach to examine how object size information was encoded and read out across progressive levels of occlusion with single-trial resolution. Patients with psychosis exhibited an overall pattern of reduced and discontinuous evidence integration relative to controls, characterized by a period of null integration up to 20% of movement duration, during which they did not read any size information. Surprisingly, this drop in accuracy in the initial integration period was not accompanied by a reduction in confidence. Difficulties in action prediction were correlated with the severity of negative symptoms and impaired functioning in social relationships.

Testing theory of mind in large language models and humans.

At the core of what defines us as humans is the concept of theory of mind: the ability to track other people's mental states. The recent development of large language models (LLMs) such as ChatGPT has led to intense debate about the possibility that these models exhibit behaviour that is indistinguishable from human behaviour in theory of mind tasks. Here we compare human and LLM performance on a comprehensive battery of measurements that aim to measure different theory of mind abilities, from understanding false beliefs to interpreting indirect requests and recognizing irony and faux pas. We tested two families of LLMs (GPT and LLaMA2) repeatedly against these measures and compared their performance with those from a sample of 1,907 human participants. Across the battery of theory of mind tests, we found that GPT-4 models performed at, or even sometimes above, human levels at identifying indirect requests, false beliefs and misdirection, but struggled with detecting faux pas. Faux pas, however, was the only test where LLaMA2 outperformed humans. Follow-up manipulations of the belief likelihood revealed that the superiority of LLaMA2 was illusory, possibly reflecting a bias towards attributing ignorance. By contrast, the poor performance of GPT originated from a hyperconservative approach towards committing to conclusions rather than from a genuine failure of inference. These findings not only demonstrate that LLMs exhibit behaviour that is consistent with the outputs of mentalistic inference in humans but also highlight the importance of systematic testing to ensure a non-superficial comparison between human and artificial intelligences.

Goal or movement? Action representation within the primary motor cortex.

Although facilitation of the cortico-spinal system during action observation is widely accepted, it remains controversial whether this facilitation reflects a replica of the observed movements or the goal of the observed motor acts. In the present transcranial magnetic stimulation study, we recorded motor evoked potentials from two hand muscles (first dorsal interosseous and abductor digiti minimi) while 22 healthy participants observed a hand reaching towards and grasping a bottle. To test for alternative coding levels (goal vs. movement), three relevant aspects were systematically manipulated: the type of observed movement (precision grip or whole hand grasping), situational context (bottle positioned in front of or behind a wall-like barrier), and processing stage (transcranial magnetic stimulation pulse delivered at the onset of the movement or at the moment of contact between the fingers and the object). At movement onset, motor evoked potential responses reflected the program necessary to achieve the action goal within the situational context. During movement observation, however, the type of observed movement was taken into account and a transition towards a movement-related modulation was observed. These results suggest that, rather than being exclusive alternatives, goal coding and movement coding may relate to different processing stages.

Grasping with tools: corticospinal excitability reflects observed hand movements.

Although facilitation of the corticospinal system during action observation is widely accepted, it remains controversial whether this facilitation reflects a replica of the observed movements or the goal of the observed motor acts. In the present study, we asked whether, when an object is grasped by using a tool, corticospinal facilitation represents 1) the movements of the hand, 2) the movements of the tool, or 3) the distal goal of the action. To address this question, we recorded motor-evoked potentials (MEPs) to transcranial magnetic stimulation while participants observed a hand reaching and grasping a mothball by using 3 types of pliers, requiring different hand-tool movements to achieve the same goal (grasping the object). We found that MEPs recorded from the opponens pollicis and from the first dorsal interosseous reflected the observed hand movements rather than the movements of the tool or the distal goal of the action. These results suggest that during observation of tool actions, detailed motor matching recruits online the same muscles as those used in the observed action.

Kinematic priming of action predictions.

The ability to anticipate what others will do next is crucial for navigating social, interactive environments. Here, we develop an experimental and analytical framework to measure the implicit readout of prospective intention information from movement kinematics. Using a primed action categorization task, we first demonstrate implicit access to intention information by establishing a novel form of priming, which we term kinematic priming: subtle differences in movement kinematics prime action prediction. Next, using data collected from the same participants in a forced-choice intention discrimination task 1 h later, we quantify single-trial intention readout-the amount of intention information read by individual perceivers in individual kinematic primes-and assess whether it can be used to predict the amount of kinematic priming. We demonstrate that the amount of kinematic priming, as indexed by both response times (RTs) and initial fixations to a given probe, is directly proportional to the amount of intention information read by the individual perceiver at the single-trial level. These results demonstrate that human perceivers have rapid, implicit access to intention information encoded in movement kinematics and highlight the potential of our approach to reveal the computations that permit the readout of this information with single-subject, single-trial resolution.

Neural network-based Bluetooth synchronization of multiple wearable devices.

Bluetooth-enabled wearables can be linked to form synchronized networks to provide insightful and representative data that is exceptionally beneficial in healthcare applications. However, synchronization can be affected by inevitable variations in the component's performance from their ideal behavior. Here, we report an application-level solution that embeds a Neural network to analyze and overcome these variations. The neural network examines the timing at each wearable node, recognizes time shifts, and fine-tunes a virtual clock to make them operate in unison and thus achieve synchronization. We demonstrate the integration of multiple Kinematics Detectors to provide synchronized motion capture at a high frequency (200 Hz) that could be used for performing spatial and temporal interpolation in movement assessments. The technique presented in this work is general and independent from the physical layer used, and it can be potentially applied to any wireless communication protocol.