The kleineWeltentdecker App - A smartphone-based developmental diary.

Today, a vast number of tools exist to measure development in early childhood in a variety of domains such as cognition, language, or motor, cognition. These tools vary in different aspects. Either children are examined by a trained experimenter, or caregivers fill out questionnaires. The tools are applied in the controlled setting of a laboratory or in the children's natural environment. While these tools provide a detailed picture of the current state of children's development, they are at the same time subject to several constraints. Furthermore, the measurement of an individual child's change of different skills over time requires not only one measurement but high-density longitudinal assessments. These assessments are time-consuming, and the breadth of developmental domains assessed remains limited. In this paper, we present a novel tool to assess the development of skills in different domains, a smartphone-based developmental diary app (the kleineWeltentdecker App, henceforth referred to as the APP (The German expression "kleine Weltentdecker" can be translated as "young world explorers".)). By using the APP, caregivers can track changes in their children's skills during development. Here, we report the construction and validation of the questionnaires embedded in the APP as well as the technical details. Empirical validations with children of different age groups confirmed the robustness of the different measures implemented in the APP. In addition, we report preliminary findings, for example, on children's communicative development by using existing APP data. This substantiates the validity of the assessment. With the APP, we put a portable tool for the longitudinal documentation of individual children's development in every caregiver's pocket, worldwide.

The influence of scene and object orientation on the scene consistency effect.

Contextual regularities help us make sense of our visual environment. In scenes, semantically consistent objects are typically better recognized than inconsistent ones (e.g., a toaster vs. printer in a kitchen). What is the role of object and scene orientation in this so-called scene consistency effect? We presented consistent and inconsistent objects either upright (Experiment 1) or inverted (rotated 180°; Experiment 2) on upright, inverted, and scrambled background scenes. In Experiment 1, on upright scenes, consistent objects were recognized with higher accuracy than inconsistent ones, and we observed N300/N400 event-related potentials (ERPs) reflecting object-scene semantic processing. No such effects were observed for inverted or scrambled scenes. In Experiment 2, on both upright and inverted scenes, consistent objects were recognized with higher accuracy than inconsistent ones. Moreover, inconsistent objects on upright scenes triggered N300/N400 responses. Interestingly, no N300 but only an N400 deflection was found for inconsistent objects on inverted scenes. No effects were observed for scrambled scenes. These data suggest that while upright scenes modulate recognition irrespective of object orientation, inverted scenes only modulate the recognition of inverted objects. In ERPs, we found further evidence that inverted scenes can affect semantic object processing, with contextual influences occurring later in time, possibly driven by delayed or impaired scene gist processing. Mere object inversion does not seem to explain the later emergence of contextual influences. Taken together, the results suggest that the orientation of objects and scenes as well as their relationship to each other can influence ongoing object identification.

Role of sensorimotor areas in early detection of motor errors: An EEG and TMS study.

Action execution is prone to errors and, while engaged in interaction, our brain is tuned to detect deviations from what one expects from other's action. Prior research has shown that Event-Related-Potentials (ERPs) are specifically modulated by the observation of action mistakes interfering with goal achievement. However, in complex and modular actions, embedded motor errors do not necessarily produce an immediate effect on the global goal. Here we dissociate embedded motor goals from global action goals by asking subjects to observe familiar but untrained knotting actions. During knotting an embedded motor error (i.e. the rope is inserted top-down instead of bottom-up during the formation of a loop) while not producing any immediate mistake, may strongly affect the final result. We found that embedded errors elicit in the observer specific early fronto-central negativity (120-180 ms). In a second experiment, we online administered exicitatory transcranial magnetic stimulation (TMS) over central (C3) or occipital (Oz) scalp locations, at the timing of the ERP components observed in the first experiment. C3 stimulation produced a significant improvement in embedded error discrimination performance. These results show that sensorimotor areas are instrumental in the early detection of embedded motor errors. We conclude that others' embedded errors provide fundamental cues which, inserted within a complex hierarchical action plan, might be used by the observer to anticipate whether an action will eventually fail.

Motor cortex compensates for lack of sensory and motor experience during auditory speech perception.

Listening to speech has been shown to activate motor regions, as measured by corticobulbar excitability. In this experiment, we explored if motor regions are also recruited during listening to non-native speech, for which we lack both sensory and motor experience. By administering Transcranial Magnetic Stimulation (TMS) over the left motor cortex we recorded corticobulbar excitability of the lip muscles when Italian participants listened to native-like and non-native German vowels. Results showed that lip corticobulbar excitability increased for a combination of lip use during articulation and non-nativeness of the vowels. Lip corticobulbar excitability was further related to measures obtained in perception and production tasks showing a negative relationship with nativeness ratings and a positive relationship with the uncertainty of lip movement during production of the vowels. These results suggest an active and compensatory role of the motor system during listening to perceptually/articulatory unfamiliar phonemes.

Syntactical regularities of action sequences in the infant brain: when structure matters.

Throughout life, actions and language are inherent to social interactions. A long-standing research question in cognitive neuroscience concerns the interrelation between verbal and non-verbal forms of social interactions, that is, language and action. Perceiving how actions are performed and why they are performed in a certain way is crucial for the observer to anticipate the actor's goal and to prepare an appropriate response. It is suggested that predicting upcoming events in a given action sequence can be compared to the way we process the language information flow. Goal-directed actions can be sequenced in small units, which are organized according to a hierarchical plan, resembling the hierarchical organization of language. Research on adults suggests that manipulating the action structure (i.e., action syntax) leads to analogous cortical signatures as a similar manipulation of a sentence structure (i.e., language syntax). Whereas in adults language and action knowledge are based on life-time experience, in infants both domains are still developing. The current study examined the neural processing of structural violations of observed goal-directed action sequences in infants at 6-7 months, using event-related potentials (ERPs). Results showed that a structural violation of the action sequence elicited bilateral frontal positivity effects. This suggests that infants capture structural regularities, and it adds a crucial element to the understanding of general syntactic regularities and their violation from an ontogenetic perspective.

Beta rhythm modulation by speech sounds: somatotopic mapping in somatosensory cortex.

During speech listening motor regions are somatotopically activated, resembling the activity that subtends actual speech production, suggesting that motor commands can be retrieved from sensory inputs. Crucially, the efficient motor control of the articulators relies on the accurate anticipation of the somatosensory reafference. Nevertheless, evidence about somatosensory activities elicited by auditory speech processing is sparse. The present work looked for specific interactions between auditory speech presentation and somatosensory cortical information processing. We used an auditory speech identification task with sounds having different place of articulation (bilabials and dentals). We tested whether coupling the auditory task with a peripheral electrical stimulation of the lips would affect the pattern of sensorimotor electroencephalographic rhythms. Peripheral electrical stimulation elicits a series of spectral perturbations of which the beta rebound reflects the return-to-baseline stage of somatosensory processing. We show a left-lateralized and selective reduction in the beta rebound following lip somatosensory stimulation when listening to speech sounds produced with the lips (i.e. bilabials). Thus, the somatosensory processing could not return to baseline due to the recruitment of the same neural resources by speech stimuli. Our results are a clear demonstration that heard speech sounds are somatotopically mapped onto somatosensory cortices, according to place of articulation.

Generalization of motor resonance during the observation of hand, mouth, and eye movements.

Transcranial magnetic stimulation (TMS) of the motor cortex shows that hand action observation (AO) modulates corticospinal excitability (CSE). CSE modulation alternatively maps low-level kinematic characteristics or higher-level features, like object-directed action goals. However, action execution is achieved through the control of muscle synergies, consisting of coordinated patterns of muscular activity during natural movements, rather than single muscles or object-directed goals. This synergistic organization of action execution also underlies the ability to produce the same functional output (i.e., grasping an object) using different effectors. We hypothesize that motor system activation during AO may rely on similar principles. To investigate this issue, we recorded both hand CSE and TMS-evoked finger movements which provide a much more complete description of coordinated patterns of muscular activity. Subjects passively watched hand, mouth and eyelid opening or closing, which are performing non-object-directed (intransitive) actions. Hand and mouth share the same potential to grasp objects, whereas eyelid does not allow object-directed (transitive) actions. Hand CSE modulation generalized to all effectors, while TMS evoked finger movements only to mouth AO. Such dissociation suggests that the two techniques may have different sensitivities to fine motor modulations induced by AO. Differently from evoked movements, which are sensitive to the possibility to achieve object-directed action, CSE is generically modulated by "opening" vs. "closing" movements, independently of which effector was observed. We propose that motor activities during AO might exploit the same synergistic mechanisms shown for the neural control of movement and organized around a limited set of motor primitives.

Grasping synergies: a motor-control approach to the mirror neuron mechanism.

The discovery of mirror neurons revived interest in motor theories of perception, fostering a number of new studies as well as controversies. In particular, the degree of motor specificity with which others' actions are simulated is highly debated. Human corticospinal excitability studies support the conjecture that a mirror mechanism encodes object-directed goals or low-level kinematic features of others' reaching and grasping actions. These interpretations lead to different experimental predictions and implications for the functional role of the simulation of others' actions. We propose that the representational granularity of the mirror mechanism cannot be any different from that of the motor system during action execution. Hence, drawing from motor control models, we propose that the building blocks of the mirror mechanism are the relatively few motor synergies explaining the variety of hand functions. The recognition of these synergies, from action observation, can be potentially very robust to visual noise and thus demonstrate a clear advantage of using motor knowledge for classifying others' action.

Vision of tongue movements bias auditory speech perception.

Audiovisual speech perception is likely based on the association between auditory and visual information into stable audiovisual maps. Conflicting audiovisual inputs generate perceptual illusions such as the McGurk effect. Audiovisual mismatch effects could be either driven by the detection of violations in the standard audiovisual statistics or via the sensorimotor reconstruction of the distal articulatory event that generated the audiovisual ambiguity. In order to disambiguate between the two hypotheses we exploit the fact that the tongue is hidden to vision. For this reason, tongue movement encoding can solely be learned via speech production but not via others׳ speech perception alone. Here we asked participants to identify speech sounds while matching or mismatching visual representations of tongue movements which were shown. Vision of congruent tongue movements facilitated auditory speech identification with respect to incongruent trials. This result suggests that direct visual experience of an articulator movement is not necessary for the generation of audiovisual mismatch effects. Furthermore, we suggest that audiovisual integration in speech may benefit from speech production learning.

Representing tools as hand movements: early and somatotopic visuomotor transformations.

The term affordance defines a property of objects, which relates to the possible interactions that an agent can carry out on that object. In monkeys, canonical neurons encode both the visual and the motor properties of objects with high specificity. However, it is not clear if in humans exists a similarly fine-grained description of these visuomotor transformations. In particular, it has not yet been proven that the processing of visual features related to specific affordances induces both specific and early visuomotor transformations, given that complete specificity has been reported to emerge quite late (300-450ms). In this study, we applied an adaptation-stimulation paradigm to investigate early cortico-spinal facilitation and hand movements׳ synergies evoked by the observation of tools. We adapted, through passive observation of finger movements, neuronal populations coding either for precision or power grip actions. We then presented the picture of one tool affording one of the two grasps types and applied single-pulse Transcranial Magnetic Stimulation (TMS) to the hand primary motor cortex, 150ms after image onset. Cortico-spinal excitability of the Abductor Digiti Minimi and Abductor Pollicis Brevis showed a detailed pattern of modulations, matching tools׳ affordances. Similarly, TMS-induced hand movements showed a pattern of grip-specific whole hand synergies. These results offer a direct proof of the emergence of an early visuomotor transformation when tools are observed, that maintains the same amount of synergistic motor details as the actions we can perform on them.