PS-Net: human perception-guided segmentation network for EM cell membrane.

MOTIVATION: Cell membrane segmentation in electron microscopy (EM) images is a crucial step in EM image processing. However, while popular approaches have achieved performance comparable to that of humans on low-resolution EM datasets, they have shown limited success when applied to high-resolution EM datasets. The human visual system, on the other hand, displays consistently excellent performance on both low and high resolutions. To better understand this limitation, we conducted eye movement and perceptual consistency experiments. Our data showed that human observers are more sensitive to the structure of the membrane while tolerating misalignment, contrary to commonly used evaluation criteria. Additionally, our results indicated that the human visual system processes images in both global-local and coarse-to-fine manners. RESULTS: Based on these observations, we propose a computational framework for membrane segmentation that incorporates these characteristics of human perception. This framework includes a novel evaluation metric, the perceptual Hausdorff distance (PHD), and an end-to-end network called the PHD-guided segmentation network (PS-Net) that is trained using adaptively tuned PHD loss functions and a multiscale architecture. Our subjective experiments showed that the PHD metric is more consistent with human perception than other criteria, and our proposed PS-Net outperformed state-of-the-art methods on both low- and high-resolution EM image datasets as well as other natural image datasets. AVAILABILITY AND IMPLEMENTATION: The code and dataset can be found at https://github.com/EmmaSRH/PS-Net.

Dyadic visual perceptual learning on orientation discrimination.

The belief that learning can be modulated by social context is mainly supported by high-level value-based learning studies. However, whether social context can even modulate low-level learning such as visual perceptual learning (VPL) is still unknown. Unlike traditional VPL studies in which participants were trained singly, here, we developed a novel dyadic VPL paradigm in which paired participants were trained with the same orientation discrimination task and could monitor each other's performance. We found that the social context (i.e., dyadic training) led to a greater behavioral performance improvement and a faster learning rate compared with the single training. Interestingly, the facilitating effects could be modulated by the performance difference between paired participants. Functional magnetic resonance imaging (fMRI) results showed that, compared with the single training, social cognition areas including bilateral parietal cortex and dorsolateral prefrontal cortex displayed a different activity pattern and enhanced functional connectivities to early visual cortex (EVC) during the dyadic training. Furthermore, the dyadic training resulted in more refined orientation representation in primary visual cortex (V1), which was closely associated with the greater behavioral performance improvement. Taken together, we demonstrate that the social context, learning with a partner, can remarkably augment the plasticity of low-level visual information process by means of reshaping the neural activities in EVC and social cognition areas, as well as their functional interplays.

Central-peripheral dichotomy: color-motion and luminance-motion binding show stronger top-down feedback in central vision.

Recently a theory (Zhaoping, Vision Research, 136, 32-49, 2017) proposed that top-down feedback from higher to lower visual cortical areas, to aid visual recognition, is stronger in the central than in the peripheral visual fields. Since top-down feedback helps feature binding, a critical visual recognition process, this theory predicts that insufficient feedback in the periphery should make feature misbinding more likely. To test this prediction, this study assessed binding between color and motion features, or between luminance and motion features, at different visual field eccentricities. We first used color-motion stimuli containing equiluminant red and green dots moving in opposite directions, for example, red dots moved leftward while green dots moved rightward. Such stimuli were shown in both a central reference strip and a peripheral test strip; participants reported whether it was the first or second interval in a trial in which the dots of each color moved in the opposite directions between the two strips. The center of the test strip was at 4° or 15° away from the gaze fixation. Participants' performance was much worse when the test strip was more peripheral, suggesting that feature misbinding occurred more frequently there. This held even when the size and density of the dots were adjusted by eccentricity-dependent cortical magnification factors, and even when red/green dots were replaced by yellow/blue dots or black/white dots to suit the retinal input sampling peripherally. Our findings support that top-down feedback is more directed to central vision, which can resolve ambiguities in feature binding at more central visual locations.

Boosting visual perceptual learning by transcranial alternating current stimulation over the visual cortex at alpha frequency.

BACKGROUND: Transcranial alternating current stimulation (tACS) has been widely used to alter ongoing brain rhythms in a frequency-specific manner to modulate relevant cognitive functions, including visual functions. Therefore, it is a useful tool for exploring the causal role of neural oscillations in cognition. Visual functions can be improved substantially by training, which is called visual perceptual learning (VPL). However, whether and how tACS can modulate VPL is still unclear. OBJECTIVE: This work aims to explore how tACS modulates VPL and the role of neural oscillations in VPL. METHODS: A between-subjects design was adopted. Subjects were assigned to six groups and undertook five daily training sessions to execute an orientation discrimination task. During training, five groups received occipital tACS stimulation at 6, 10, 20, 40, and sham 10 Hz respectively, and one group was stimulated at the sensorimotor regions by 10 Hz tACS. RESULTS: Compared with the sham stimulation, occipital tACS at 10 Hz, but not at other frequencies, accelerated perceptual learning and increased the performance improvement. However, these modulatory effects were absent when 10 Hz tACS was delivered to the sensorimotor areas. Moreover, the tACS-induced performance improvement lasted at least two months after the end of training. CONCLUSION: TACS can facilitate orientation discrimination learning in a frequency- and location-specific manner. Our findings provide strong evidence for a pivotal role of alpha oscillations in boosting VPL and shed new light on the design of effective neuromodulation protocols that can facilitate rehabilitation for patients with neuro-ophthalmological disorders.