Distinct Patterns of Connectivity between Brain Regions Underlie the Intra-Modal and Cross-Modal Value-Driven Modulations of the Visual Cortex.

Past reward associations may be signaled from different sensory modalities; however, it remains unclear how different types of reward-associated stimuli modulate sensory perception. In this human fMRI study (female and male participants), a visual target was simultaneously presented with either an intra- (visual) or a cross-modal (auditory) cue that was previously associated with rewards. We hypothesized that, depending on the sensory modality of the cues, distinct neural mechanisms underlie the value-driven modulation of visual processing. Using a multivariate approach, we confirmed that reward-associated cues enhanced the target representation in early visual areas and identified the brain valuation regions. Then, using an effective connectivity analysis, we tested three possible patterns of connectivity that could underlie the modulation of the visual cortex: a direct pathway from the frontal valuation areas to the visual areas, a mediated pathway through the attention-related areas, and a mediated pathway that additionally involved sensory association areas. We found evidence for the third model demonstrating that the reward-related information in both sensory modalities is communicated across the valuation and attention-related brain regions. Additionally, the superior temporal areas were recruited when reward was cued cross-modally. The strongest dissociation between the intra- and cross-modal reward-driven effects was observed at the level of the feedforward and feedback connections of the visual cortex estimated from the winning model. These results suggest that, in the presence of previously rewarded stimuli from different sensory modalities, a combination of domain-general and domain-specific mechanisms are recruited across the brain to adjust the visual perception.SIGNIFICANCE STATEMENT Reward has a profound effect on perception, but it is not known whether shared or disparate mechanisms underlie the reward-driven effects across sensory modalities. In this human fMRI study, we examined the reward-driven modulation of the visual cortex by visual (intra-modal) and auditory (cross-modal) reward-associated cues. Using a model-based approach to identify the most plausible pattern of inter-regional effective connectivity, we found that higher-order areas involved in the valuation and attentional processing were recruited by both types of rewards. However, the pattern of connectivity between these areas and the early visual cortex was distinct between the intra- and cross-modal rewards. This evidence suggests that, to effectively adapt to the environment, reward signals may recruit both domain-general and domain-specific mechanisms.

Effects of sensory modality and task relevance on omitted stimulus potentials.

Omitted stimulus potentials (OSPs) occur when a sensory stimulus is unexpectedly omitted. They are thought to reflect predictions about upcoming sensory events. The present study examined how OSPs differ across the sensory modalities of predicted stimuli. Twenty-nine university students were asked to press a mouse button at a regular interval of 1-2 s, which was immediately followed by either a visual or auditory stimulus in different blocks. The stimuli were sometimes omitted (p = 0.2), to which event-related potentials (ERPs) were recorded. The results showed that stimulus omissions in both modalities elicited ERP waveforms consisting of three components, oN1, oN2, and oP3. The peak latencies of these components were shorter in the auditory modality than in the visual modality. The amplitudes of OSPs were larger when participants were told that the omission indicated their poor performance (i.e., they pressed a button at an irregular interval) than when it was irrelevant to their performance. These findings suggest that OSPs occur from around 100 ms in a modality-specific manner and increase in amplitude depending on the task relevance of stimulus omissions.

Response Inhibitory Control Varies with Different Sensory Modalities.

Response inhibition plays an essential role in preventing anticipated and unpredictable events in our daily lives. It is divided into proactive inhibition, where subjects postpone responses to an upcoming signal, and reactive inhibition, where subjects stop an impending movement based on the presentation of a signal. Different types of sensory input are involved in both inhibitions; however, differences in proactive and reactive inhibition with differences in sensory modalities remain unclear. This study compared proactive and reactive inhibitions induced by visual, auditory, and somatosensory signals using the choice reaction task (CRT) and stop-signal task (SST). The experiments showed that proactive inhibitions were significantly higher in the auditory and somatosensory modalities than in the visual modality, whereas reactive inhibitions were not. Examining the proactive inhibition-associated neural processing, the auditory and somatosensory modalities showed significant decreases in P3 amplitudes in Go signal-locked event-related potentials (ERPs) in SST relative to those in CRT; this might reflect a decreasing attentional resource on response execution in SST in both modalities. In contrast, we did not find significant differences in the reactive inhibition-associated ERPs. These results suggest that proactive inhibition varies with different sensory modalities, whereas reactive inhibition does not.

Enhancing allocation of visual attention with emotional cues presented in two sensory modalities.

BACKGROUND: Responses to a visual target stimulus in an exogenous spatial cueing paradigm are usually faster if cue and target occur in the same rather than in different locations (i.e., valid vs. invalid), although perceptual conditions for cue and target processing are otherwise equivalent. This cueing validity effect can be increased by adding emotional (task-unrelated) content to the cue. In contrast, adding a secondary non-emotional sensory modality to the cue (bimodal), has not consistently yielded increased cueing effects in previous studies. Here, we examined the interplay of bimodally presented cue content (i.e., emotional vs. neutral), by using combined visual-auditory cues. Specifically, the current ERP-study investigated whether bimodal presentation of fear-related content amplifies deployment of spatial attention to the cued location. RESULTS: A behavioral cueing validity effect occurred selectively in trials in which both aspects of the cue (i.e., face and voice) were related to fear. Likewise, the posterior contra-ipsilateral P1-activity in valid trials was significantly larger when both cues were fear-related than in all other cue conditions. Although the P3a component appeared uniformly increased in invalidly cued trials, regardless of cue content, a positive LPC deflection, starting about 450 ms after target onset, was, again, maximal for the validity contrast in trials associated with bimodal presentation of fear-related cues. CONCLUSIONS: Simultaneous presentation of fear-related stimulus information in the visual and auditory modality appears to increase sustained visual attention (impairing disengagement of attention from the cued location) and to affect relatively late stages of target processing.

Exploratory Research on Sweetness Perception: Decision Trees to Study Electroencephalographic Data and Its Relationship with the Explicit Response to Sweet Odor, Taste, and Flavor.

Using implicit responses to determine consumers' response to different stimuli is becoming a popular approach, but research is still needed to understand the outputs of the different technologies used to collect data. During the present research, electroencephalography (EEG) responses and self-reported liking and emotions were collected on different stimuli (odor, taste, flavor samples) to better understand sweetness perception. Artificial intelligence analytics were used to classify the implicit responses, identifying decision trees to discriminate the stimuli by activated sensory system (odor/taste/flavor) and by nature of the stimuli ('sweet' vs. 'non-sweet' odors; 'sweet-taste', 'sweet-flavor', and 'non-sweet flavor'; and 'sweet stimuli' vs. 'non-sweet stimuli'). Significant differences were found among self-reported-liking of the stimuli and the emotions elicited by the stimuli, but no clear relationship was identified between explicit and implicit data. The present research sums interesting data for the EEG-linked research as well as for EEG data analysis, although much is still unknown about how to properly exploit implicit measurement technologies and their data.

Gestural communication in olive baboons (Papio anubis): repertoire and intentionality.

Gesturing is a widespread phenomenon in the animal kingdom, as well as an important facet of human language. As such, studying the communicative gestures of our close phylogenetic relatives is essential to better understand its evolution. While recent studies have shown that ape gestural communication shares some properties with human language, very little is known about the properties of gestural communication in monkeys. The aims of this study were to establish the first quantitative repertoire of gestural communication in a species of old-world monkeys, the olive baboon Papio anubis, and to determine its properties in terms of variability, flexibility, and intentionality. Gestural communication was continuously recorded on 47 captive olive baboons over 1 year. Their gestural repertoire was composed of 67 visual, tactile, and audible gestures, which were used flexibly across different contexts, indicating means-ends dissociation. We found that the use of gestures was variable across individuals and ages, notably with repertoire size decreasing with age. Baboons used their gestures intentionally; gesturers looked at the recipient, waited for a response, and took into account the attentional state of their recipient. Particularly, they actively adjusted the modality of their gesture to the recipient's visual attention, using more visual gestures when the recipient was attending and more tactile gestures when the recipient was not. Thus, the gestural communicative system of olive baboons possesses properties which are similar to the ones of apes and to human language. These intentional features of gestural communication, that may constitute a prerequisite of language evolution, may have been present in the common ancestor of baboons and humans, around 30-40 million years ago.

Visual and Auditory Interference Control of Attention in Developmental Dyslexia.

An accumulating body of evidence highlights the contribution of general cognitive processes, such as attention, to language-related skills. OBJECTIVE: The purpose of the present study was to explore how interference control (a subcomponent of selective attention) is affected in developmental dyslexia (DD) by means of control over simple stimulus-response mappings. Furthermore, we aimed to examine interference control in adults with DD across sensory modalities. METHODS: The performance of 14 dyslexic adults and 14 matched controls was compared on visual/auditory Simon tasks, in which conflict was presented in terms of an incongruent mapping between the location of a visual/auditory stimulus and the appropriate motor response. RESULTS: In the auditory task, dyslexic participants exhibited larger Simon effect costs; namely, they showed disproportionately larger reaction times (RTs)/errors costs when the auditory stimulus and response were incongruent relative to RT/errors costs of non-impaired readers. In the visual Simon task, both groups presented Simon effect costs to the same extent. CONCLUSION: These results indicate that the ability to control auditory selective attention is carried out less effectively in those with DD compared with visually controlled processing. The implications of this impaired process for the language-related skills of individuals with DD are discussed.

Does hypnotic assessment predict the functional equivalence between motor imagery and action?

Motor imagery is influenced by individual and contextual factors. We investigated whether the psychophysiological trait of hypnotisability modulates its subjective experience and cortical correlates similarly to what was previously shown for head postures mental images. EEG was acquired in 18 high (highs) and 15 low (lows) hypnotizable subjects (Stanford Hypnotic Susceptibility Scale, A). The experimental conditions were: baseline, a complex arm/hand movement, visual (1st person) and kinesthetic imagery of the movement. After each imagery condition, participants scored the vividness and easeness of their performance and their ability to mantain the requested modality of imagery. Subjective reports, chronometric visual/kinesthetic indices, absolute beta and fronto-central midline alpha powers were analyzed. Findings confirmed earlier reports of better kinestetic imagery ability in highs than in lows and better visual than kinesthetic imagery in lows, as well as smaller restructuring of the cortical activity in highs than in lows, during all tasks. Also, they show that hypnotisability accounts for most of the correlations between brain regions for both alpha and beta changes. Thus, imagined and actual movements were less demanding processes in highs at subjective and cortical levels. Finally, hypnotic assessment assists to plan personalized mental training for neuro-rehabilitation and sports and predict their efficacy.

Pain and Distraction According to Sensory Modalities: Current Findings and Future Directions.

BACKGROUND: This review discusses the findings in the literature on pain and distraction tasks according to their sensory modality. Distraction tasks have been shown to reduce (experimentally induced) acute pain and chronic pain. This can be influenced by nature and by the sensory modalities used in the distraction tasks. Yet the effect on reducing pain according to the sensory modality of the distraction task has received little attention. METHODS: A bibliographic search was performed in different databases. The studies will be systematized according to the sensory modality in which the distraction task was applied. RESULTS: The analyzed studies with auditory distractors showed a reduction of acute pain in adults. However, these are not effective at healthy children and in adults with chronic pain. Visual distractors showed promising results in acute pain in adults and children. Similarly, tactile and mixed distractors decreased acute pain in adults. CONCLUSION: Distraction tasks by diverse sensory modalities have a positive effect on decreasing the perception of acute pain in adults. Future studies are necessary given the paucity of research on this topic, particularly with tactile distractors (there is only one study). Finally, the most rigorous methodology and the use of ecological contexts are encouraged in future research.

New Breakthroughs in Understanding the Role of Functional Interactions between the Neocortex and the Claustrum.

Almost all areas of the neocortex are connected with the claustrum, a nucleus located between the neocortex and the striatum, yet the functions of corticoclaustral and claustrocortical connections remain largely obscure. As major efforts to model the neocortex are currently underway, it has become increasingly important to incorporate the corticoclaustral system into theories of cortical function. This Mini-Symposium was motivated by a series of recent studies which have sparked new hypotheses regarding the function of claustral circuits. Anatomical, ultrastructural, and functional studies indicate that the claustrum is most highly interconnected with prefrontal cortex, suggesting important roles in higher cognitive processing, and that the organization of the corticoclaustral system is distinct from the driver/modulator framework often used to describe the corticothalamic system. Recent findings supporting roles in detecting novel sensory stimuli, directing attention and setting behavioral states, were the subject of the Mini-Symposium at the 2017 Society for Neuroscience Annual Meeting.

Bumblebees distinguish floral scent patterns, and can transfer these to corresponding visual patterns.

Flowers act as multisensory billboards to pollinators by using a range of sensory modalities such as visual patterns and scents. Different floral organs release differing compositions and quantities of the volatiles contributing to floral scent, suggesting that scent may be patterned within flowers. Early experiments suggested that pollinators can distinguish between the scents of differing floral regions, but little is known about how these potential scent patterns might influence pollinators. We show that bumblebees can learn different spatial patterns of the same scent, and that they are better at learning to distinguish between flowers when the scent pattern corresponds to a matching visual pattern. Surprisingly, once bees have learnt the spatial arrangement of a scent pattern, they subsequently prefer to visit novel unscented flowers that have an identical arrangement of visual marks, suggesting that multimodal floral signals may exploit the mechanisms by which learnt information is stored by the bee.

Ergodicity and parameter estimates in auditory neural circuits.

This paper discusses ergodic properties and circular statistical characteristics in neuronal spike trains. Ergodicity means that the average taken over a long time period and over smaller population should equal the average in less time and larger population. The objectives are to show simple examples of design and validation of a neuronal model, where the ergodicity assumption helps find correspondence between variables and parameters. The methods used are analytical and numerical computations, numerical models of phenomenological spiking neurons and neuronal circuits. Results obtained using these methods are the following. They are: a formula to calculate vector strength of neural spike timing dependent on the spike train parameters, description of parameters of spike train variability and model of output spiking density based on assumption of the computation realized by sound localization neural circuit. Theoretical results are illustrated by references to experimental data. Examples of neurons where spike trains have and do not have the ergodic property are then discussed.

The role of the SMART and WHIM in behavioural assessment of disorders of consciousness: clinical utility and scope for a symbiotic relationship.

As the prevalence and incidence of disorders of consciousness (DoC) increase, researchers and clinicians are tasked with developing best practice assessment techniques. Neurobehavioural assessment remains the most clinically available method of measuring consciousness. Neuroimaging and other physiological measurements are demonstrating promise in supporting this assessment but many of these techniques require further research and are not widely available in sub-acute and long-term care settings. No study to date has explored in-depth complementary use of multiple neurobehavioural assessments in aiding beside assessment of consciousness. This paper describes and proposes complementary use of two commonly used standardised neurobehavioural assessments. The Sensory Modality Assessment and Rehabilitation Technique (SMART) and the Wessex Head Injury Matrix (WHIM) both have specific aims and play an important role in behavioural assessment across the care continuum. This paper proposes that when used together appropriately these two assessments promote best practice and strengthen behavioural assessment of consciousness by providing increased opportunities to capture awareness. Further research into use of more than one neurobehavioural tool is highlighted as an important area of inquiry for this heterogeneous population not only in clinical practice but also in research.

Do you remember where sounds, pictures and words came from? The role of the stimulus format in object location memory.

Contrasting results in visual and auditory spatial memory stimulate the debate over the role of sensory modality and attention in identity-to-location binding. We investigated the role of sensory modality in the incidental/deliberate encoding of the location of a sequence of items. In 4 separated blocks, 88 participants memorised sequences of environmental sounds, spoken words, pictures and written words, respectively. After memorisation, participants were asked to recognise old from new items in a new sequence of stimuli. They were also asked to indicate from which side of the screen (visual stimuli) or headphone channel (sounds) the old stimuli were presented in encoding. In the first block, participants were not aware of the spatial requirement while, in blocks 2, 3 and 4 they knew that their memory for item location was going to be tested. Results show significantly lower accuracy of object location memory for the auditory stimuli (environmental sounds and spoken words) than for images (pictures and written words). Awareness of spatial requirement did not influence localisation accuracy. We conclude that: (a) object location memory is more effective for visual objects; (b) object location is implicitly associated with item identity during encoding and

Effects of preference and sensory modality on behavioural reaction in patients with disorders of consciousness.

BACKGROUND: Reliable evaluation of patients with unresponsive wakefulness syndrome (UWS) or in a minimally conscious state (MCS) remains a major challenge. It has been suggested that the expression of residual cerebral function could be improved by allowing patients to listen to their favourite music. However, the potential effect of music on behavioural responsiveness, as well as the effect of preferred stimuli in other sensory modalities (e.g. olfaction), remain poorly understood. OBJECTIVE: The aim of our study was to investigate the effect of sensory modality (auditory versus olfactory) and preference (preferred versus neutral) of the test stimuli on patients' subsequent performance on the Coma Recovery Scale-Revised (CRS-R). RESEARCH DESIGN: Within-subject design because of inter-individual differences between patients. METHODS AND PROCEDURES: We studied four items from the CRS-R (visual pursuit using a mirror, auditory localization of the own name and two movements to command) in 13 patients (7 MCS; 6 UWS). MAIN OUTCOMES AND RESULTS: Auditory stimuli triggered higher responsiveness compared to olfactory stimuli, and preferred stimuli were followed by higher scores than did neutral stimuli. CONCLUSIONS: Findings suggest that preferred auditory stimuli at the bedside contribute to the expression of residual function and could improve the diagnostic assessment.

Optimization of a motor learning attention-directing strategy based on an individual's motor imagery ability.

Motor learning performance has been shown to be affected by various cognitive factors such as the focus of attention and motor imagery ability. Most previous studies on motor learning have shown that directing the attention of participants externally, such as on the outcome of an assigned body movement, can be more effective than directing their attention internally, such as on body movement itself. However, to the best of our knowledge, no findings have been reported on the effect of the focus of attention selected according to the motor imagery ability of an individual on motor learning performance. We measured individual motor imagery ability assessed by the Movement Imagery Questionnaire and classified the participants into kinesthetic-dominant (n = 12) and visual-dominant (n = 8) groups based on the questionnaire score. Subsequently, the participants performed a motor learning task such as tracing a trajectory using visuomotor rotation. When the participants were required to direct their attention internally, the after-effects of the learning task in the kinesthetic-dominant group were significantly greater than those in the visual-dominant group. Conversely, when the participants were required to direct their attention externally, the after-effects of the visual-dominant group were significantly greater than those of the kinesthetic-dominant group. Furthermore, we found a significant positive correlation between the size of after-effects and the modality-dominance of motor imagery. These results suggest that a suitable attention strategy based on the intrinsic motor imagery ability of an individual can improve performance during motor learning tasks.

PowerPoint presentation in learning physiology by undergraduates with different learning styles.

PowerPoint presentations (PPTs) have become routine in medical colleges because of their flexible and varied presentation capabilities. Research indicates that students prefer PPTs over the chalk-and-talk method, and there is a lot of debate over advantages and disadvantages of PPTs. However, there is no clear evidence that PPTs improve student learning/performance. Furthermore, there are a variety of learning styles with sex differences in classrooms. It is the responsibility of teacher/facilitator and student to be aware of learning style preferences to improve learning. The present study asked the following research question: do PPTs equally affect the learning of students with different learning styles in a mixed sex classroom? After we assessed students' predominant learning style according to the sensory modality that one most prefers to use when learning, a test was conducted before and after a PPT to assess student performance. The results were analyzed using Student's t-test and ANOVA with a Bonferroni post hoc test. A z-test showed no sex differences in preferred learning styles. There was significant increase in posttest performance compared with that of the pretest in all types of learners of both sexes. There was also a nonsignificant relationship among sex, learning style, and performance after the PPT. A PPT is equally effective for students with different learning style preferences and supports mixed sex classrooms.

The spectral transmission of non-salticid spider corneas.

Although many salticid spiders have been shown to have corneas that transmit ultraviolet (UV) light, whether the corneas of non-salticid spiders transmit UV has not been previously investigated. In this study, we determined the spectral corneal transmission properties of 38 species belonging to 13 non-salticid families. We used these data to estimate the T50 transmission cut-off value, the wavelength corresponding to 50% maximal transmission for each species. The corneas of almost all species from the families Deinopidae, Lycosidae, Oxyopidae, Pisauridae, Sparassidae and Thomisidae, all of which have been reported to rely to a substantial extent on vision, transmitted short wavelength light below 400 nm, ranging from 306 to 381 nm. However, species from the families Atypidae and Ctenizidae are not known to rely substantially on vision, and the corneas of these species tended to absorb light of wavelengths below 380 nm, which may not allow UV sensitivity in these spiders. Liphistiidae, the family widely regarded as most basal among spiders, is of particular interest. The species in this family are not known to make substantial use of vision, and yet we found that liphistiid corneas transmitted UV light with a low T50 value (359 nm). T50 values of non-salticid spider corneas also varied with light habitat. Species living in dim environments tended to have UV-opaque corneas, but species inhabiting open areas had UV-transmitting corneas. However, there was no evidence of corneal transmission properties being related to whether a species is diurnal or nocturnal.

Sensory modality affects the spatiotemporal dynamics of alpha and theta oscillations associated with prospective memory.

BACKGROUND: The maintenance of an intention in memory (Prospective Memory, PM) while performing a task is associated with a cost in terms of both performance (longer response times and lower accuracy) and neurophysiological modulations, which extent depends on several features of the stimuli. AIM: This study explores the neural patterns associated with PM in different sensory modalities, to identify differences depending on this variable and discuss their functional meaning. METHOD: Data were collected using a High-Density EEG during a baseline and a PM condition, proposed in a visual and an auditory version. Theta and alpha oscillations were compared between the two conditions within each modality using a cluster-based permutation approach. RESULTS: PM conditions were associated with clusters of decreased alpha and theta activity in both modalities. However, different spatiotemporal dynamics were elicited as a function of sensory modality: alpha decreases displayed an overlapping onset between modalities, but different durations, lasting longer in the auditory modality. Conversely, the clusters of decreased theta activity presented similar durations between modalities, but different temporal and spatial onsets, appearing at different moments over the respective sensory areas. CONCLUSIONS: The similar spatiotemporal properties of alpha suppression between modalities indicate that such oscillations may represent a supramodal, top-down process, presumably reflecting the external direction of attention to successfully detect the prospective cue (strategic monitoring). In theta, the clusters showed more modality-specific differences, which temporal and spatial properties correspond to the ones necessary to perform the ongoing task, suggesting a shift in resource allocation in favor of the PM task.

Visual movement impairs duration discrimination at short intervals.

The classic advantage of audition over vision in time processing has been recently challenged by studies using continuously moving visual stimuli such as bouncing balls. Bouncing balls drive beat-based synchronisation better than static visual stimuli (flashes) and as efficiently as auditory ones (beeps). It is yet unknown how bouncing balls modulate performance in duration perception. Our previous study addressing this was inconclusive: there were no differences among bouncing balls, flashes, and beeps, but this could have been due to the fact that intervals were too long to allow sensitivity to modality (visual vs auditory). In this study, we conducted a first experiment to determine whether shorter intervals elicit cross-stimulus differences. We found that short (mean 157 ms) but not medium (326 ms) intervals made duration perception worse for bouncing balls compared with flashes and beeps. In a second experiment, we investigated whether the lower efficiency of bouncing balls was due to experimental confounds, lack of realism, or movement. We ruled out the experimental confounds and found support for the hypothesis that visual movement-be it continuous or discontinuous-impairs duration perception at short interval lengths. Therefore, unlike beat-based synchronisation, duration perception does not benefit from continuous visual movement, which may even have a detrimental effect at short intervals.