"Extended Descriptive Risk-Averse Bayesian Model" a More Comprehensive Approach in Simulating Complex Biological Motion Perception.

The ability to perceive biological motion is crucial for human survival, social interactions, and communication. Over the years, researchers have studied the mechanisms and neurobiological substrates that enable this ability. In a previous study, we proposed a descriptive Bayesian simulation model to represent the dorsal pathway of the visual system, which processes motion information. The model was inspired by recent studies that questioned the impact of dynamic form cues in biological motion perception and was trained to distinguish the direction of a soccer ball from a set of complex biological motion soccer-kick stimuli. However, the model was unable to simulate the reaction times of the athletes in a credible manner, and a few subjects could not be simulated. In this current work, we implemented a novel disremembering strategy to incorporate neural adaptation at the decision-making level, which improved the model's ability to simulate the athletes' reaction times. We also introduced receptive fields to detect rotational optic flow patterns not considered in the previous model to simulate a new subject and improve the correlation between the simulation and experimental data. The findings suggest that rotational optic flow plays a critical role in the decision-making process and sheds light on how different individuals perform at different levels. The correlation analysis of human versus simulation data shows a significant, almost perfect correlation between experimental and simulated angular thresholds and slopes, respectively. The analysis also reveals a strong relation between the average reaction times of the athletes and the simulations.

Using HVS Dual-Pathway and Contrast Sensitivity to Blindly Assess Image Quality.

Blind image quality assessment (BIQA) aims to evaluate image quality in a way that closely matches human perception. To achieve this goal, the strengths of deep learning and the characteristics of the human visual system (HVS) can be combined. In this paper, inspired by the ventral pathway and the dorsal pathway of the HVS, a dual-pathway convolutional neural network is proposed for BIQA tasks. The proposed method consists of two pathways: the "what" pathway, which mimics the ventral pathway of the HVS to extract the content features of distorted images, and the "where" pathway, which mimics the dorsal pathway of the HVS to extract the global shape features of distorted images. Then, the features from the two pathways are fused and mapped to an image quality score. Additionally, gradient images weighted by contrast sensitivity are used as the input to the "where" pathway, allowing it to extract global shape features that are more sensitive to human perception. Moreover, a dual-pathway multi-scale feature fusion module is designed to fuse the multi-scale features of the two pathways, enabling the model to capture both global features and local details, thus improving the overall performance of the model. Experiments conducted on six databases show that the proposed method achieves state-of-the-art performance.

A bio-inspired positional embedding network for transformer-based models.

Owing to the progress of transformer-based networks, there have been significant improvements in the performance of vision models in recent years. However, there is further potential for improvement in positional embeddings that play a crucial role in distinguishing information across different positions. Based on the biological mechanisms of human visual pathways, we propose a positional embedding network that adaptively captures position information by modeling the dorsal pathway, which is responsible for spatial perception in human vision. Our proposed double-stream architecture leverages large zero-padding convolutions to learn local positional features and utilizes transformers to learn global features, effectively capturing the interaction between dorsal and ventral pathways. To evaluate the effectiveness of our method, we implemented experiments on various datasets, employing differentiated designs. Our statistical analysis demonstrates that the simple implementation significantly enhances image classification performance, and the observed trends demonstrate its biological plausibility.

Speaking in gestures: Left dorsal and ventral frontotemporal brain systems underlie communication in conducting.

Conducting constitutes a well-structured system of signs anticipating information concerning the rhythm and dynamic of a musical piece. Conductors communicate the musical tempo to the orchestra, unifying the individual instrumental voices to form an expressive musical Gestalt. In a functional magnetic resonance imaging (fMRI) experiment, 12 professional conductors and 16 instrumentalists conducted real-time novel pieces with diverse complexity in orchestration and rhythm. For control, participants either listened to the stimuli or performed beat patterns, setting the time of a metronome or complex rhythms played by a drum. Activation of the left superior temporal gyrus (STG), supplementary and premotor cortex and Broca's pars opercularis (F3op) was shared in both musician groups and separated conducting from the other conditions. Compared to instrumentalists, conductors activated Broca's pars triangularis (F3tri) and the STG, which differentiated conducting from time beating and reflected the increase in complexity during conducting. In comparison to conductors, instrumentalists activated F3op and F3tri when distinguishing complex rhythm processing from simple rhythm processing. Fibre selection from a normative human connectome database, constructed using a global tractography approach, showed that the F3op and STG are connected via the arcuate fasciculus, whereas the F3tri and STG are connected via the extreme capsule. Like language, the anatomical framework characterising conducting gestures is located in the left dorsal system centred on F3op. This system reflected the sensorimotor mapping for structuring gestures to musical tempo. The ventral system centred on F3Tri may reflect the art of conductors to set this musical tempo to the individual orchestra's voices in a global, holistic way.

"Descriptive Risk-Averse Bayesian Decision-Making," a Model for Complex Biological Motion Perception in the Human Dorsal Pathway.

Biological motion perception is integral not only to survival but also to the social life of human beings. Identifying the underlying mechanisms and their associated neurobiological substrates has been a matter of investigation and debate for some time. Although, in general, it is believed that the integration of local motion and dynamic form cues in the brain empowers the visual system to perceive/recognize biological motion stimuli, some recent studies have indicated the importance of dynamic form cues in such a process. Inspired by the previous neurophysiologically plausible biological motion perception models, a new descriptive risk-averse Bayesian simulation model, capable of discerning a ball's direction from a set of complex biological motion soccer kick stimuli, is proposed. The model represents only the dorsal pathway as a motion information processing section of the visual system according to the two-stream theory. The stimuli used have been obtained from a previous psychophysical study on athletes in our lab. Furthermore, the acquired psychophysical data from that study have been used to re-enact human behavior using our simulation model. By adjusting the model parameters, the psychometric function of athlete subjects has been mimicked. A correlation analysis between human and simulation data shows a significant and robust correlation between angular thresholds and slopes of the psychometric functions of both groups. Although it is established that the visual system optimally integrates all available information in the decision-making process, the results conform to the speculations favoring motion cue importance over dynamic form by testing the limits in which biological motion perception only depends on motion information processing.

Selecting the Most Relevant Brain Regions to Classify Children with Developmental Dyslexia and Typical Readers by Using Complex Magnocellular Stimuli and Multiple Kernel Learning.

Increasing evidence supports the presence of deficits in the visual magnocellular (M) system in developmental dyslexia (DD). The M system is related to the fronto-parietal attentional network. Previous neuroimaging studies have revealed reduced/absent activation within the visual M pathway in DD, but they have failed to characterize the extensive brain network activated by M stimuli. We performed a multivariate pattern analysis on a Region of Interest (ROI) level to differentiate between children with DD and age-matched typical readers (TRs) by combining full-field sinusoidal gratings, controlled for spatial and temporal frequencies and luminance contrast, and a coherent motion (CM) sensitivity task at 6%-CML6, 15%-CML15 and 40%-CML40. ROIs spanning the entire visual dorsal stream and ventral attention network (VAN) had higher discriminative weights and showed higher act1ivation in TRs than in children with DD. Of the two tasks, CM had the greatest weight when classifying TRs and children with DD in most of the ROIs spanning these streams. For the CML6, activation within the right superior parietal cortex positively correlated with reading skills. Our approach highlighted the dorsal stream and the VAN as highly discriminative areas between children with DD and TRs and allowed for a better characterization of the "dorsal stream vulnerability" underlying DD.

Beyond Reading Modulation: Temporo-Parietal tDCS Alters Visuo-Spatial Attention and Motion Perception in Dyslexia.

Dyslexia is a neurodevelopmental disorder with an atypical activation of posterior left-hemisphere brain reading networks (i.e., temporo-occipital and temporo-parietal regions) and multiple neuropsychological deficits. Transcranial direct current stimulation (tDCS) is a tool for manipulating neural activity and, in turn, neurocognitive processes. While studies have demonstrated the significant effects of tDCS on reading, neurocognitive changes beyond reading modulation have been poorly investigated. The present study aimed at examining whether tDCS on temporo-parietal regions affected not only reading, but also phonological skills, visuo-spatial working memory, visuo-spatial attention, and motion perception in a polarity-dependent way. In a within-subjects design, ten children and adolescents with dyslexia performed reading and neuropsychological tasks after 20 min of exposure to Left Anodal/Right Cathodal (LA/RC) and Right Anodal/Left Cathodal (RA/LC) tDCS. LA/RC tDCS compared to RA/LC tDCS improved text accuracy, word recognition speed, motion perception, and modified attentional focusing in our group of children and adolescents with dyslexia. Changes in text reading accuracy and word recognition speed-after LA/RC tDCS compared to RA/LC-were related to changes in motion perception and in visuo-spatial working memory, respectively. Our findings demonstrated that reading and domain-general neurocognitive functions in a group of children and adolescents with dyslexia change following tDCS and that they are polarity-dependent.

Action Video Games Enhance Attentional Control and Phonological Decoding in Children with Developmental Dyslexia.

Reading acquisition is extremely difficult for about 5% of children because they are affected by a heritable neurobiological disorder called developmental dyslexia (DD). Intervention studies can be used to investigate the causal role of neurocognitive deficits in DD. Recently, it has been proposed that action video games (AVGs)-enhancing attentional control-could improve perception and working memory as well as reading skills. In a partial crossover intervention study, we investigated the effect of AVG and non-AVG training on attentional control using a conjunction visual search task in children with DD. We also measured the non-alphanumeric rapid automatized naming (RAN), phonological decoding and word reading before and after AVG and non-AVG training. After both video game training sessions no effect was found in non-alphanumeric RAN and in word reading performance. However, after only 12 h of AVG training the attentional control was improved (i.e., the set-size slopes were flatter in visual search) and phonological decoding speed was accelerated. Crucially, attentional control and phonological decoding speed were increased only in DD children whose video game score was highly efficient after the AVG training. We demonstrated that only an efficient AVG training induces a plasticity of the fronto-parietal attentional control linked to a selective phonological decoding improvement in children with DD.

Self-limited focal epilepsy decreased regional brain activity in sensorimotor areas.

OBJECTIVE: The fractional amplitude of low-frequency fluctuation (fALFF) method was used to identify the regional brain activity deficits of self-limited focal epilepsy with centrotemporal spikes (SLFECS) relative to normal controls (NCs). METHODS: A total of 21 SLFECS (10 females, 11 males; mean age, 8.57 ± 1.5 years) and 21 status-matched (age, sex, and education) NCs (10 females, 11 males; mean age, 8.76 ± 2.19 years) were recruited. The fALFF method was applied to identify SLFECS-related regional brain alterations. Receiver operating characteristic (ROC) curve was applied to identify the ability of these regional brain areas in distinguishing the SLFECS group from the NCs group. The relationships between the regional brain activity deficits and clinical features were evaluated by Pearson's correlation analysis. RESULTS: Self-limited focal epilepsy with centrotemporal spikes was associated with widespread regional brain activity alterations, including left cuneus with higher fALFF values, and bilateral striatum, bilateral precentral gyrus, ventral and dorsal pathway of sensory area, left dorsolateral prefrontal cortex, and left Rolandic area with lower fALFF values. ROC curve revealed excellent AUC value (0.964) of these areas in distinguishing the SLFECS group from the NCs group with high degree of sensitivity (90.5%) and specificity (95.2%). Intelligence quotient score positively correlated with the fALFF value in the left striatum (r = 0.453, p = 0.039). CONCLUSIONS: The fALFF parameter could be served as a potential biomarker to identify the SLFECS-related regional brain deficits in the sensorimotor cortex and their pathways, which may be the etiology of paresthesia in SLFECS.

Neural Selectivity for Visual Motion in Macaque Area V3A.

The processing of visual motion is conducted by dedicated pathways in the primate brain. These pathways originate with populations of direction-selective neurons in the primary visual cortex, which projects to dorsal structures like the middle temporal (MT) and medial superior temporal (MST) areas. Anatomical and imaging studies have suggested that area V3A might also be specialized for motion processing, but there have been very few studies of single-neuron direction selectivity in this area. We have therefore performed electrophysiological recordings from V3A neurons in two macaque monkeys (one male and one female) and measured responses to a large battery of motion stimuli that includes translation motion, as well as more complex optic flow patterns. For comparison, we simultaneously recorded the responses of MT neurons to the same stimuli. Surprisingly, we find that overall levels of direction selectivity are similar in V3A and MT and moreover that the population of V3A neurons exhibits somewhat greater selectivity for optic flow patterns. These results suggest that V3A should be considered as part of the motion processing machinery of the visual cortex, in both human and non-human primates.

Attentional modulation differentially affects ventral and dorsal face areas in both normal participants and developmental prosopagnosics.

Face-selective cortical areas that can be divided into a ventral stream and a dorsal stream. Previous findings indicate selective attention to particular aspects of faces have different effects on the two streams. To better understand the organization of the face network and whether deficits in attentional modulation contribute to developmental prosopagnosia (DP), we assessed the effect of selective attention to different face aspects across eight face-selective areas. Our results from normal participants found that ROIs in the ventral pathway (OFA, FFA) responded strongly when attention was directed to identity and expression, and ROIs in the dorsal pathway (pSTS-FA, IFG-FA) responded the most when attention was directed to facial expression. Response profiles generated by attention to different face aspects were comparable in DPs and normals. Our results demonstrate attentional modulation affects the ventral and dorsal steam face areas differently and indicate deficits in attentional modulation do not contribute to DP.

Inter-subject Similarity of Brain Activity in Expert Musicians After Multimodal Learning: A Behavioral and Neuroimaging Study on Learning to Play a Piano Sonata.

Human behavior is inherently multimodal and relies on sensorimotor integration. This is evident when pianists exhibit activity in motor and premotor cortices, as part of a dorsal pathway, while listening to a familiar piece of music, or when naïve participants learn to play simple patterns on the piano. Here we investigated the interaction between multimodal learning and dorsal-stream activity over the course of four weeks in ten skilled pianists by adopting a naturalistic data-driven analysis approach. We presented the pianists with audio-only, video-only and audiovisual recordings of a piano sonata during functional magnetic resonance imaging (fMRI) before and after they had learned to play the sonata by heart for a total of four weeks. We followed the learning process and its outcome with questionnaires administered to the pianists, one piano instructor following their training, and seven external expert judges. The similarity of the pianists' brain activity during stimulus presentations was examined before and after learning by means of inter-subject correlation (ISC) analysis. After learning, an increased ISC was found in the pianists while watching the audiovisual performance, particularly in motor and premotor regions of the dorsal stream. While these brain structures have previously been associated with learning simple audio-motor sequences, our findings are the first to suggest their involvement in learning a complex and demanding audiovisual-motor task. Moreover, the most motivated learners and the best performers of the sonata showed ISC in the dorsal stream and in the reward brain network.

Altered brain structures in the dorsal and ventral language pathways in individuals with and without developmental language disorder (DLD).

Developmental Language Disorder (DLD) is a neurodevelopmental disorder characterized by difficulty learning and using language, and this difficulty cannot be attributed to other developmental conditions. The aim of the current study was to examine structural differences in dorsal and ventral language pathways between adolescents and young adults with and without DLD (age range: 14-27 years) using anatomical magnetic resonance imaging (MRI) and diffusion tensor imaging (DTI). Results showed age-related structural brain differences in both dorsal and ventral pathways in individuals with DLD. These findings provide evidence for neuroanatomical correlates of persistent language deficits in adolescents/young adults with DLD, and further suggest that this brain-language relationship in DLD is better characterized by taking account the dynamic course of the disorder along development.

Differential cortical and subcortical projection targets of subfields in the core region of mouse auditory cortex.

The core region of the rodent auditory cortex has two areas: the primary auditory area (A1) and the anterior auditory field (AAF). However, the functional difference between these areas is unclear. To elucidate this issue, here we studied the projections from A1 and AAF in mice using adeno-associated virus (AAV) vectors expressing either a green fluorescent protein or a red fluorescent protein. After mapping A1 and AAF using optical imaging, we injected a distinct AAV vector into each of the two fields at a frequency-matched high-frequency location. We found that A1 and AAF projected commonly to virtually all target areas examined, but each field had its own preference for projection targets. Frontal and parietal regions were the major cortical targets: in the frontal cortex, A1 and AAF showed dominant projections to the anterior cingulate cortex Cg1 and the secondary motor cortex (M2), respectively; in the parietal cortex, A1 and AAF exhibited dense projections to the medial secondary visual cortex and the posterior parietal cortex (PPC), respectively. Although M2 and PPC received considerable input from A1 as well, A1 innervated the medial part whereas AAF innervated the lateral part of these cortical regions. A1 also projected to the orbitofrontal cortex, while AAF also projected to the primary somatosensory cortex and insular auditory cortex. As for subcortical projections, A1 and AAF projected to a common ventromedial region in the caudal striatum with a comparable strength; they also both projected to the medial geniculate body and the inferior colliculus, innervating common and distinct divisions of the nuclei. A1 also projected to visual subcortical structures, such as the superior colliculus and the lateral posterior nucleus of the thalamus, where fibres from AAF were sparse. Our results demonstrate the preference of A1 and AAF for cortical and subcortical targets, and for divisions in individual target. The preference of A1 and AAF for sensory-related structures suggest a role for A1 in providing auditory information for audio-visual association at both the cortical and subcortical level, and a distinct role of AAF in providing auditory information for association with somatomotor information in the cortex.

Going with the Flow: The Neural Mechanisms Underlying Illusions of Complex-Flow Motion.

Studying the mismatch between perception and reality helps us better understand the constructive nature of the visual brain. The Pinna-Brelstaff motion illusion is a compelling example illustrating how a complex moving pattern can generate an illusory motion perception. When an observer moves toward (expansion) or away (contraction) from the Pinna-Brelstaff figure, the figure appears to rotate. The neural mechanisms underlying the illusory complex-flow motion of rotation, expansion, and contraction remain unknown. We studied this question at both perceptual and neuronal levels in behaving male macaques by using carefully parametrized Pinna-Brelstaff figures that induce the above motion illusions. We first demonstrate that macaques perceive illusory motion in a manner similar to that of human observers. Neurophysiological recordings were subsequently performed in the middle temporal area (MT) and the dorsal portion of the medial superior temporal area (MSTd). We find that subgroups of MSTd neurons encoding a particular global pattern of real complex-flow motion (rotation, expansion, contraction) also represent illusory motion patterns of the same class. They require an extra 15 ms to reliably discriminate the illusion. In contrast, MT neurons encode both real and illusory local motions with similar temporal delays. These findings reveal that illusory complex-flow motion is first represented in MSTd by the same neurons that normally encode real complex-flow motion. However, the extraction of global illusory motion in MSTd from other classes of real complex-flow motion requires extra processing time. Our study illustrates a cascaded integration mechanism from MT to MSTd underlying the transformation from external physical to internal nonveridical flow-motion perception.SIGNIFICANCE STATEMENT The neural basis of the transformation from objective reality to illusory percepts of rotation, expansion, and contraction remains unknown. We demonstrate psychophysically that macaques perceive these illusory complex-flow motions in a manner similar to that of human observers. At the neural level, we show that medial superior temporal (MSTd) neurons represent illusory flow motions as if they were real by globally integrating middle temporal area (MT) local motion signals. Furthermore, while MT neurons reliably encode real and illusory local motions with similar temporal delays, MSTd neurons take a significantly longer time to process the signals associated with illusory percepts. Our work extends previous complex-flow motion studies by providing the first detailed analysis of the neuron-specific mechanisms underlying complex forms of illusory motion integration from MT to MSTd.

Ventral and dorsal visual pathways exhibit abnormalities of static and dynamic connectivities, respectively, in patients with schizophrenia.

Previous studies suggest that schizophrenia-related visual perceptual abnormalities are primarily attributed to deficits of the dorsal rather than ventral visual pathway. In this study, we comparatively explored changes in dorsal and ventral networks in schizophrenia patients in both static and dynamic functional connectivity (FC). Resting-state MR scans were acquired for forty schizophrenia patients and twenty-four healthy controls matched for age and gender. The dorsal and ventral visual networks were defined based on the resultant coordinates from activation likelihood estimation analyses. Static and dynamic network properties were calculated based on the full-range and segmented blood oxygen level dependent time series, respectively. The results indicated that the ventral and dorsal visual networks exhibited abnormalities in static FC and dynamic FC, respectively, in the schizophrenia group. Static FC assessments in the ventral visual network showed a significantly decreased clustering coefficient and shortened characteristic path length in patients with schizophrenia. Dynamic FC assessments in the dorsal visual network showed significantly higher mean temporal variability (p = 0.026) and higher regional FC variability of the right fusiform gyrus (p < 0.001) in patients with schizophrenia, and the latter was correlated with the total and negative scores of the Positive and Negative Syndrome Scale. In summary, this study reveals differential patterns of connectivity abnormalities of the ventral and dorsal visual networks in patients with schizophrenia. These preliminary evidences may help us better interpret the mechanisms underlying visual perceptual impairments in patients with schizophrenia and their relationship with psychosis.

Motor imagery training induces changes in brain neural networks in stroke patients.

Motor imagery is the mental representation of an action without overt movement or muscle activation. However, the effects of motor imagery on stroke-induced hand dysfunction and brain neural networks are still unknown. We conducted a randomized controlled trial in the China Rehabilitation Research Center. Twenty stroke patients, including 13 males and 7 females, 32-51 years old, were recruited and randomly assigned to the traditional rehabilitation treatment group (PP group, n = 10) or the motor imagery training combined with traditional rehabilitation treatment group (MP group, n = 10). All patients received rehabilitation training once a day, 45 minutes per session, five times per week, for 4 consecutive weeks. In the MP group, motor imagery training was performed for 45 minutes after traditional rehabilitation training, daily. Action Research Arm Test and the Fugl-Meyer Assessment of the upper extremity were used to evaluate hand functions before and after treatment. Transcranial magnetic stimulation was used to analyze motor evoked potentials in the affected extremity. Diffusion tensor imaging was used to assess changes in brain neural networks. Compared with the PP group, the MP group showed better recovery of hand function, higher amplitude of the motor evoked potential in the abductor pollicis brevis, greater fractional anisotropy of the right dorsal pathway, and an increase in the fractional anisotropy of the bilateral dorsal pathway. Our findings indicate that 4 weeks of motor imagery training combined with traditional rehabilitation treatment improves hand function in stroke patients by enhancing the dorsal pathway. This trial has been registered with the Chinese Clinical Trial Registry (registration number: ChiCTR-OCH-12002238).

Visual motion and rapid auditory processing are solid endophenotypes of developmental dyslexia.

Although a genetic component is known to have an important role in the etiology of developmental dyslexia (DD), we are far from understanding the molecular etiopathogenetic pathways. Reduced measures of neurobiological functioning related to reading (dis)ability, i.e. endophenotypes (EPs), are promising targets for gene finding and the elucidation of the underlying mechanisms. In a sample of 100 nuclear families with DD (229 offspring) and 83 unrelated typical readers, we tested whether a set of well-established, cognitive phenotypes related to DD [i.e. rapid auditory processing (RAP), rapid automatized naming (RAN), multisensory nonspatial attention and visual motion processing] fulfilled the criteria of the EP construct. Visual motion and RAP satisfied all testable criteria (i.e. they are heritable, associate with the disorder, co-segregate with the disorder within a family and represent reproducible measures) and are therefore solid EPs of DD. Multisensory nonspatial attention satisfied three of four criteria (i.e. it associates with the disorder, co-segregates with the disorder within a family and represents a reproducible measure) and is therefore a potential EP for DD. Rapid automatized naming is heritable but does not meet other criteria of the EP construct. We provide the first evidence of a methodologically and statistically sound approach for identifying EPs for DD to be exploited as a solid alternative basis to clinical phenotypes in neuroscience.