Motor adaptation in deaf and hearing native signers.

Previous studies have suggested that deafness could lead to deficits in motor skills and other body-related abilities. However, the literature regarding motor skills in deaf adults is scarce and existing studies often included participants with heterogeneous language backgrounds and deafness etiologies, thus making it difficult to delineate the effects of deafness. In this study, we investigated motor learning in deaf native signers and hearing nonsigners. To isolate the effects of deafness and those of acquiring a signed language, we additionally tested a group of hearing native signers. Two well-established paradigms of motor learning were employed, in which participants had to adapt their hand movements to a rotation of the visual feedback (Experiment 1) or to the introduction of a force field (Experiment 2). Proprioceptive estimates were assessed before and after adaptation. Like hearing nonsigners, deaf and hearing signers showed robust adaptation in both motor adaptation paradigms. No significant differences in motor adaptation and memory were observed between deaf signers and hearing nonsigners, as well as between hearing signers and hearing nonsigners. Moreover, no discernible group differences in proprioceptive accuracy were observed. These findings challenge the prevalent notion that deafness leads to deficits in motor skills and other body-related abilities.

Developmental experiences alter the temporal processing characteristics of the visual cortex: Evidence from deaf and hearing native signers.

To date, the extent to which early experience shapes the functional characteristics of neural circuits is still a matter of debate. In the present study, we tested whether congenital deafness and/or the acquisition of a sign language alter the temporal processing characteristics of the visual system. Moreover, we investigated whether, assuming cross-modal plasticity in deaf individuals, the temporal processing characteristics of possibly reorganised auditory areas resemble those of the visual cortex. Steady-state visual evoked potentials (SSVEPs) were recorded in congenitally deaf native signers, hearing native signers, and hearing nonsigners. The luminance of the visual stimuli was periodically modulated at 12, 21, and 40 Hz. For hearing nonsigners, the optimal driving rate was 12 Hz. By contrast, for the group of hearing signers, the optimal driving rate was 12 and 21 Hz, whereas for the group of deaf signers, the optimal driving rate was 21 Hz. We did not observe evidence for cross-modal recruitment of auditory cortex in the group of deaf signers. These results suggest a higher preferred neural processing rate as a consequence of the acquisition of a sign language.

Neural correlates of semantic and syntactic processing in German Sign Language.

The study of deaf and hearing native users of signed languages can offer unique insights into how biological constraints and environmental input interact to shape the neural bases of language processing. Here, we use functional magnetic resonance imaging (fMRI) to address two questions: (1) Do semantic and syntactic processing in a signed language rely on anatomically and functionally distinct neural substrates as it has been shown for spoken languages? and (2) Does hearing status affect the neural correlates of these two types of linguistic processing? Deaf and hearing native signers performed a sentence judgement task on German Sign Language (Deutsche Gebärdensprache: DGS) sentences which were correct or contained either syntactic or semantic violations. We hypothesized that processing of semantic and syntactic violations in DGS relies on distinct neural substrates as it has been shown for spoken languages. Moreover, we hypothesized that effects of hearing status are observed within auditory regions, as deaf native signers have been shown to activate auditory areas to a greater extent than hearing native signers when processing a signed language. Semantic processing activated low-level visual areas and the left inferior frontal gyrus (IFG), suggesting both modality-dependent and independent processing mechanisms. Syntactic processing elicited increased activation in the right supramarginal gyrus (SMG). Moreover, psychophysiological interaction (PPI) analyses revealed a cluster in left middle occipital regions showing increased functional coupling with the right SMG during syntactic relative to semantic processing, possibly indicating spatial processing mechanisms that are specific to signed syntax. Effects of hearing status were observed in the right superior temporal cortex (STC): deaf but not hearing native signers showed greater activation for semantic violations than for syntactic violations in this region. Taken together, the present findings suggest that the neural correlates of language processing are partly determined by biological constraints, but that they may additionally be influenced by the unique processing demands of the language modality and different sensory experiences.

[Ethics review in psychological research]. / Ethikvoten in der psychologischen Forschung.

Psychology, as a fundamental and applied science, studies the behavior of humans with empirical and experimental methods. To this end, volunteers are recruited who reveal information about themselves in either natural or experimental settings. Like medical research, psychological research must obey strict ethical principles (according to the Declaration of Helsinki), because it concerns the self-determination, mental, and physical integrity and privacy of the participants.An assessment of psychological research projects according to ethical criteria is therefore mandatory. Research projects must (i) respect the autonomy and dignity of a person, (ii) promise a substantial gain in knowledge, and (iii) maximize the benefits of the research by minimizing possible disadvantages for the participants; (iv) researchers - committed to their social responsibility - must anticipate the social implications of research findings (possibilities of "dual use").Local ethics committees (LECs) for research projects in psychology work on behalf of a university or faculty. They are to be set up as an independent body. The assessment of ethical safety requires the scientific quality of a research project, but must take into account additional considerations. In this respect, it seems sensible that projects that are to be funded by a third-party funder first establish the scientific eligibility and only then the ethical safety by a LEC.

Neural correlates of maintaining generated images in visual working memory.

How are images that have been assembled from their constituting elements maintained as a coherent representation in visual working memory (vWM)? Here, we compared two conditions of vWM maintenance that only differed in how vWM contents had been created. Participants maintained images that they either had to assemble from single features or that they had perceived as complete objects. Object complexity varied between two and four features. We analyzed electroencephalogram phase coupling as a measure of cortical connectivity in a time interval immediately before a probe stimulus appeared. We assumed that during this time both groups maintained essentially the same images, but that images constructed from their elements would require more neural coupling than images based on a complete percept. Increased coupling between frontal and parietal-to-occipital cortical sources was found for the maintenance of constructed in comparison to nonconstructed objects in the theta, alpha, beta, and gamma frequency bands. A similar pattern was found for an increase in vWM load (2 vs. 4 features) for nonconstructed objects. Under increased construction load (2 vs. 4 features for constructed images), the pattern was restricted to fronto-parietal couplings, suggesting that the fronto-parietal attention network is coping with the higher attentional demands involved in maintaining constructed images, but without increasing the communication with the occipital visual buffer in which the visual representations are assumed to be stored. We conclude from these findings that the maintenance of constructed images in vWM requires additional attentional processes to keep object elements together as a coherent representation. Hum Brain Mapp 37:4349-4362, 2016. © 2016 Wiley Periodicals, Inc.

Brain responses to world knowledge violations: a comparison of stimulus- and fixation-triggered event-related potentials and neural oscillations.

Recent research has shown that brain potentials time-locked to fixations in natural reading can be similar to brain potentials recorded during rapid serial visual presentation (RSVP). We attempted two replications of Hagoort, Hald, Bastiaansen, and Petersson [Hagoort, P., Hald, L., Bastiaansen, M., & Petersson, K. M. Integration of word meaning and world knowledge in language comprehension. Science, 304, 438-441, 2004] to determine whether this correspondence also holds for oscillatory brain responses. Hagoort et al. reported an N400 effect and synchronization in the theta and gamma range following world knowledge violations. Our first experiment (n = 32) used RSVP and replicated both the N400 effect in the ERPs and the power increase in the theta range in the time-frequency domain. In the second experiment (n = 49), participants read the same materials freely while their eye movements and their EEG were monitored. First fixation durations, gaze durations, and regression rates were increased, and the ERP showed an N400 effect. An analysis of time-frequency representations showed synchronization in the delta range (1-3 Hz) and desynchronization in the upper alpha range (11-13 Hz) but no theta or gamma effects. The results suggest that oscillatory EEG changes elicited by world knowledge violations are different in natural reading and RSVP. This may reflect differences in how representations are constructed and retrieved from memory in the two presentation modes.

Trial-to-trial dynamics of selective long-term-memory retrieval with continuously changing retrieval targets.

How do we control the successive retrieval of behaviorally relevant information from long-term memory (LTM) without being distracted by other potential retrieval targets associated to the same retrieval cues? Here, we approach this question by investigating the nature of trial-by-trial dynamics of selective LTM retrieval, i.e., in how far retrieval in one trial has detrimental or facilitatory effects on selective retrieval in the following trial. Participants first learned associations between retrieval cues and targets, with one cue always being linked to three targets, forming small associative networks. In successive trials, participants had to access either the same or a different target belonging to either the same or a different cue. We found that retrieval times were faster for targets that had already been relevant in the previous trial, with this facilitatory effect being substantially weaker when the associative network changed in which the targets were embedded. Moreover, staying within the same network still had a facilitatory effect even if the target changed, which became evident in a relatively higher memory performance in comparison to a network change. Furthermore, event-related brain potentials (ERPs) showed topographically and temporally dissociable correlates of these effects, suggesting that they result from combined influences of distinct processes that aid memory retrieval when relevant and irrelevant targets change their status from trial to trial. Taken together, the present study provides insight into the different processing stages of memory retrieval when fast switches between retrieval targets are required.

Mental effort during mindless reading? Pupil fluctuations indicate internal processing during levels of inattention.

Mind wandering, an experience characterized by a reduced external focus of attention and an increased internal focus, has seen significant theoretical advancement in understanding its underlying cognitive processes. The levels-of-inattention hypothesis posits that in mind wandering, external attention is reduced in a graded fashion, reflecting different levels of weak versus deep attentional decoupling. However, it has remained unclear whether internal processing during mind wandering, and mindless reading in particular, requires effort and, if so, whether it is graded or distinct. To address this, we analyzed pupil size as a measure of cognitive load in the sustained-attention-to-stimulus task during text reading. We examined whether decoupled external attention is linked to an overall reduction in workload and whether internal focus of attention is graded or represents a distinct cognitive process. Overall, overlooking errors in the text was associated with a small pupil size, indicating reduced effortful processing. However, this effect varied with error type: overlooking high- or medium-level errors (weak decoupling) resulted in reduced pupil size, while overlooking low-level errors (deep decoupling) had no effect on pupil size. Moreover, detecting an error (at any processing level) elicited a task-evoked pupillary response, which was absent when it was overlooked. These findings suggest that weak decoupling reduces internal resource-demanding processing and are in line with the hypothesis that large pupils during deep decoupling may be associated with distinct states of effortful internal processing. They further support both the levels-of-inattention hypothesis and the notion that internal focus is a distinct mode of deeply decoupled processing. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Spatial updating depends on gaze direction even after loss of vision.

Direction of gaze (eye angle + head angle) has been shown to be important for representing space for action, implying a crucial role of vision for spatial updating. However, blind people have no access to vision yet are able to perform goal-directed actions successfully. Here, we investigated the role of visual experience for localizing and updating targets as a function of intervening gaze shifts in humans. People who differed in visual experience (late blind, congenitally blind, or sighted) were briefly presented with a proprioceptive reach target while facing it. Before they reached to the target's remembered location, they turned their head toward an eccentric direction that also induced corresponding eye movements in sighted and late blind individuals. We found that reaching errors varied systematically as a function of shift in gaze direction only in participants with early visual experience (sighted and late blind). In the late blind, this effect was solely present in people with moveable eyes but not in people with at least one glass eye. Our results suggest that the effect of gaze shifts on spatial updating develops on the basis of visual experience early in life and remains even after loss of vision as long as feedback from the eyes and head is available.

Electrophysiological evidence for the continuous processing of linguistic categories of regular and irregular verb inflection in German.

A central question concerning word recognition is whether linguistic categories are processed in continuous or categorical ways, in particular, whether regular and irregular inflection is stored and processed by the same or by distinct systems. Here, we contribute to this issue by contrasting regular (regular stem, regular suffix) with semi-irregular (regular stem, irregular suffix) and irregular (irregular stem, irregular suffix) participle formation in a visual priming experiment on German verb inflection. We measured ERPs and RTs and manipulated the inflectional and meaning relatedness between primes and targets. Inflected verb targets (e.g., leite, "head") were preceded either by themselves, by their participle (geleitet, "headed"), by a semantically related verb in the same inflection as the target (führe, "guide") or in the participle form (geführt, "guided"), or by an unrelated verb in the same inflection (nenne, "name"). Results showed that behavioral and ERP priming effects were gradually affected by verb regularity. Regular participles produced a widely distributed frontal and parietal effect, irregular participles produced a small left parietal effect, and semi-irregular participles yielded an effect in-between these two in terms of amplitude and topography. The behavioral and ERP effects further showed that the priming because of participles differs from that because of semantic associates for all verb types. These findings argue for a single processing system that generates participle priming effects for regular, semi-irregular, and irregular verb inflection. Together, the findings provide evidence that the linguistic categories of verb inflection are processed continuously. We present a single-system model that can adequately account for such graded effects.

Understanding the Effects of Constraint and Predictability in ERP.

Intuitively, strongly constraining contexts should lead to stronger probabilistic representations of sentences in memory. Encountering unexpected words could therefore be expected to trigger costlier shifts in these representations than expected words. However, psycholinguistic measures commonly used to study probabilistic processing, such as the N400 event-related potential (ERP) component, are sensitive to word predictability but not to contextual constraint. Some research suggests that constraint-related processing cost may be measurable via an ERP positivity following the N400, known as the anterior post-N400 positivity (PNP). The PNP is argued to reflect update of a sentence representation and to be distinct from the posterior P600, which reflects conflict detection and reanalysis. However, constraint-related PNP findings are inconsistent. We sought to conceptually replicate Federmeier et al. (2007) and Kuperberg et al. (2020), who observed that the PNP, but not the N400 or the P600, was affected by constraint at unexpected but plausible words. Using a pre-registered design and statistical approach maximising power, we demonstrated a dissociated effect of predictability and constraint: strong evidence for predictability but not constraint in the N400 window, and strong evidence for constraint but not predictability in the later window. However, the constraint effect was consistent with a P600 and not a PNP, suggesting increased conflict between a strong representation and unexpected input rather than greater update of the representation. We conclude that either a simple strong/weak constraint design is not always sufficient to elicit the PNP, or that previous PNP constraint findings could be an artifact of smaller sample size.

Controlling conflict from interfering long-term memory representations.

Remembering is more than an activation of a memory trace. As retrieval cues are often not uniquely related to one specific memory, cognitive control should come into play to guide selective memory retrieval by focusing on relevant while ignoring irrelevant information. Here, we investigated, by means of EEG and fMRI, how the memory system deals with retrieval interference arising when retrieval cues are associated with two material types (faces and spatial positions), but only one is task-relevant. The topography of slow EEG potentials and the fMRI BOLD signal in posterior storage areas indicated that in such situations not only the relevant but also the irrelevant material becomes activated. This results in retrieval interference that triggers control processes mediated by the medial and lateral PFC, which are presumably involved in biasing target representations by boosting the task-relevant material. Moreover, memory-based conflict was found to be dissociable from response conflict that arises when the relevant and irrelevant materials imply different responses. The two types of conflict show different activations in the medial frontal cortex, supporting the claim of domain-specific prefrontal control systems.

Some unsettled problems in behavioral neuroscience research.

The goal of behavioral neuroscience is to map psychological concepts onto physiological and anatomical concepts and vice versa. The present paper reflects on some of the hidden obstacles that have to be overcome in order to find unique psychophysiological relationships. These are, among others: (1) the different status of concepts which are defined in the two domains (ontological subjectivity in psychology and ontological objectivity in physiology); (2) the distinct hierarchical levels to which concepts from the two domains may belong; (3) ambiguity of concepts, because-due to limited measurement resolution or definitional shortcomings-they sometimes do not cover unique states or processes; (4) ignored context dependencies. Moreover, it is argued that due to the gigantic number of states and state changes, which are possible in a nervous system, it seems unlikely that neuroscience can provide exact causal explanations and predictions of behavior. Rather, as in statistical thermodynamics the transition from the microlevel of explanations to the macrolevel is only possible with probabilistic uncertainty.

Memory-based decision-making with heuristics: evidence for a controlled activation of memory representations.

Many of our daily decisions are memory based, that is, the attribute information about the decision alternatives has to be recalled. Behavioral studies suggest that for such decisions we often use simple strategies (heuristics) that rely on controlled and limited information search. It is assumed that these heuristics simplify decision-making by activating long-term memory representations of only those attributes that are necessary for the decision. However, from behavioral studies alone, it is unclear whether using heuristics is indeed associated with limited memory search. The present study tested this assumption by monitoring the activation of specific long-term-memory representations with fMRI while participants made memory-based decisions using the "take-the-best" heuristic. For different decision trials, different numbers and types of information had to be retrieved and processed. The attributes consisted of visual information known to be represented in different parts of the posterior cortex. We found that the amount of information required for a decision was mirrored by a parametric activation of the dorsolateral PFC. Such a parametric pattern was also observed in all posterior areas, suggesting that activation was not limited to those attributes required for a decision. However, the posterior increases were systematically modulated by the relative importance of the information for making a decision. These findings suggest that memory-based decision-making is mediated by the dorsolateral PFC, which selectively controls posterior storage areas. In addition, the systematic modulations of the posterior activations indicate a selective boosting of activation of decision-relevant attributes.

Working memory maintenance of grasp-target information in the human posterior parietal cortex.

Event-related functional magnetic resonance imaging was applied to identify cortical areas involved in maintaining target information in working memory used for an upcoming grasping action. Participants had to grasp with their thumb and index finger of the dominant right hand three-dimensional objects of different size and orientation. Reaching-to-grasp movements were performed without visual feedback either immediately after object presentation or after a variable delay of 2-12 s. The right inferior parietal cortex demonstrated sustained neural activity throughout the delay, which overlapped with activity observed during encoding of the grasp target. Immediate and delayed grasping activated similar motor-related brain areas and showed no differential activity. The results suggest that the right inferior parietal cortex plays an important functional role in working memory maintenance of grasp-related information. Moreover, our findings confirm the assumption that brain areas engaged in maintaining information are also involved in encoding the same information, and thus extend previous findings on working memory function of the posterior parietal cortex in saccadic behavior to reach-to-grasp movements.

Frontal and parietal contributions to arithmetic fact retrieval: a parametric analysis of the problem-size effect.

The goal of the present study was to investigate the neuroanatomical basis of arithmetic fact retrieval. The rationale was that areas playing a crucial role in arithmetic fact retrieval should show a systematic increase of activation with increasing retrieval effort. To achieve this goal, we utilized the problem-size effect as this is known to be systematically related to retrieval effort. In contrast to many previous studies, we here took a parametric approach to account for the continuous increase of retrieval effort with problem size. BOLD signals were modeled with problem size as parametric regressor and negative slow waves of the EEG were categorized into six levels of problem size. The fMRI data showed that activation in the angular gyrus and ACC/SMA increased parametrically with problem size. The ERP data showed a systematic amplitude increase with increasing problem size, especially at fronto-central electrodes. Consistent with the fMRI data, source modeling localized this effect to the ACC. While these findings support previous notions about the crucial role of the angular gyrus during fact retrieval, they also provide evidence that the medial frontal cortex is involved when single-digit multiplications are solved. Thus, both parietal and frontal structures seem to be integral parts of a system that enables and controls arithmetic fact retrieval.

Testing the limits of optimal integration of visual and proprioceptive information of path trajectory.

Many studies provide evidence that information from different modalities is integrated following the maximum likelihood estimation model (MLE). For instance, we recently found that visual and proprioceptive path trajectories are optimally combined (Reuschel et al. in Exp Brain Res 201:853-862, 2010). However, other studies have failed to reveal optimal integration of such dynamic information. In the present study, we aim to generalize our previous findings to different parts of the workspace (central, ipsilateral, or contralateral) and to different types of judgments (relative vs. absolute). Participants made relative judgments by judging whether an angular path was acute or obtuse, or they made absolute judgments by judging whether a one-segmented straight path was directed to left or right. Trajectories were presented in the visual, proprioceptive, or combined visual-proprioceptive modality. We measured the bias and the variance of these estimates and predicted both parameters using the MLE. In accordance with the MLE model, participants linearly combined and weighted the unimodal angular path information by their reliabilities irrespective of the side of workspace. However, the precision of bimodal estimates was not greater than that for unimodal estimates, which is inconsistent with the MLE. For the absolute judgment task, participants' estimates were highly accurate and did not differ across modalities. Thus, we were unable to test whether the bimodal percept resulted as a weighted average of the visual and proprioceptive input. Additionally, participants were not more precise in the bimodal compared with the unimodal conditions, which is inconsistent with the MLE. Current findings suggest that optimal integration of visual and proprioceptive information of path trajectory only applies in some conditions.

Early visual deprivation impairs multisensory interactions in humans.

Animal studies have shown that visual deprivation during the first months of life permanently impairs the interactions between sensory systems. Here we report an analogous effect for humans who had been deprived of pattern vision for at least the first five months of their life as a result of congenital binocular cataracts. These patients showed reduced audio-visual interactions in later life, although their visual performance in control tasks was unimpaired. Thus, adequate (multisensory) input during the first months of life seems to be a prerequisite in humans, as well as in animals, for the full development of cross-modal interactions.

The interaction of the visuo-spatial and the vestibular system depends on sensory experience in development.

In hearing individuals, vestibular and visuo-spatial functions seem to be functionally linked. Previous studies have suggested that congenitally deaf individuals are at a higher risk for vestibular problems, which in hearing adults have often been found to be associated with impairments in visuo-spatial processing. However, communicating in a sign language provides extensive practice in visuo-spatial processing, which might counteract negative effects of vestibular impairments. Here, we investigated whether the functional link between vestibular and visuo-spatial functions is mandatory, that is whether it is impenetrable to experience or context, or whether it is dependent on specific sensory and cognitive experiences. To this end, we tested a group of congenitally deaf native signers and a group of hearing nonsigners on mental rotation and balance tasks. Compared to hearing nonsigners, mental rotation was superior in the deaf signers in conditions crucial for sign language comprehension. By contrast, the balance performance of the group of deaf signers was impaired. While in the group of hearing nonsigners, balance skills correlated with mental rotation abilities, no such relationship was observed in the group of deaf signers. These results suggest that the link between vestibular and visuo-spatial functions is not fixed but can be altered or even cancelled out by certain sensory or cognitive experiences, such as the acquisition of a sign language.

Interaction between gaze and visual and proprioceptive position judgements.

There is considerable evidence that targets for action are represented in a dynamic gaze-centered frame of reference, such that each gaze shift requires an internal updating of the target. Here, we investigated the effect of eye movements on the spatial representation of targets used for position judgements. Participants had their hand passively placed to a location, and then judged whether this location was left or right of a remembered visual or remembered proprioceptive target, while gaze direction was varied. Estimates of position of the remembered targets relative to the unseen position of the hand were assessed with an adaptive psychophysical procedure. These positional judgements significantly varied relative to gaze for both remembered visual and remembered proprioceptive targets. Our results suggest that relative target positions may also be represented in eye-centered coordinates. This implies similar spatial reference frames for action control and space perception when positions are coded relative to the hand.