Neural Correlates of Crowding in Macaque Area V4.

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Many psychophysical studies have investigated this phenomenon and proposed alternative models for the underlying mechanisms. One prominent hypothesis, albeit with mixed psychophysical support, posits that crowding arises from the loss of information due to pooled encoding of features from target and distractor stimuli in the early stages of cortical visual processing. However, neurophysiological studies have not rigorously tested this hypothesis. We studied the responses of single neurons in macaque (one male, one female) area V4, an intermediate stage of the object-processing pathway, to parametrically designed crowded displays and texture statistics-matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters-number, distance, and position of distractors-influence human psychophysical performance and V4 shape selectivity. Importantly, we also found that enhancing the salience of a target stimulus could alleviate crowding effects in highly cluttered scenes, and this could be temporally protracted reflecting a dynamical process. Thus, a pooled encoding of nearby stimuli cannot explain the observed responses, and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays. Overall, we conclude that the magnitude of crowding effects is determined not just by the number of distractors and target-distractor separation but also by the relative salience of targets versus distractors based on their feature attributes-the similarity of distractors and the contrast between target and distractor stimuli.

Neural correlates of object identity and reward outcome in the sensory cortical-hippocampal hierarchy: coding of motivational information in perirhinal cortex.

Neural circuits support behavioral adaptations by integrating sensory and motor information with reward and error-driven learning signals, but it remains poorly understood how these signals are distributed across different levels of the corticohippocampal hierarchy. We trained rats on a multisensory object-recognition task and compared visual and tactile responses of simultaneously recorded neuronal ensembles in somatosensory cortex, secondary visual cortex, perirhinal cortex, and hippocampus. The sensory regions primarily represented unisensory information, whereas hippocampus was modulated by both vision and touch. Surprisingly, the sensory cortices and the hippocampus coded object-specific information, whereas the perirhinal cortex did not. Instead, perirhinal cortical neurons signaled trial outcome upon reward-based feedback. A majority of outcome-related perirhinal cells responded to a negative outcome (reward omission), whereas a minority of other cells coded positive outcome (reward delivery). Our results highlight a distributed neural coding of multisensory variables in the cortico-hippocampal hierarchy. Notably, the perirhinal cortex emerges as a crucial region for conveying motivational outcomes, whereas distinct functions related to object identity are observed in the sensory cortices and hippocampus.

Visual periodicity reveals distinct attentional signatures for face and non-face categories.

Observers can selectively deploy attention to regions of space, moments in time, specific visual features, individual objects, and even specific high-level categories-for example, when keeping an eye out for dogs while jogging. Here, we exploited visual periodicity to examine how category-based attention differentially modulates selective neural processing of face and non-face categories. We combined electroencephalography with a novel frequency-tagging paradigm capable of capturing selective neural responses for multiple visual categories contained within the same rapid image stream (faces/birds in Exp 1; houses/birds in Exp 2). We found that the pattern of attentional enhancement and suppression for face-selective processing is unique compared to other object categories: Where attending to non-face objects strongly enhances their selective neural signals during a later stage of processing (300-500 ms), attentional enhancement of face-selective processing is both earlier and comparatively more modest. Moreover, only the selective neural response for faces appears to be actively suppressed by attending towards an alternate visual category. These results underscore the special status that faces hold within the human visual system, and highlight the utility of visual periodicity as a powerful tool for indexing selective neural processing of multiple visual categories contained within the same image sequence.

Perovskite-Doped Modulated Color-Selective Photosynaptic Transistors for Target Object Recognition.

The processing of multicolor noisy images in visual neuromorphic devices requires selective absorption at specific wavelengths; however, it is difficult to achieve this because the spectral absorption range of the device is affected by the type of material. Surprisingly, the absorption range of perovskite materials can be adjusted by doping. Herein, a CdCl2 co-doped CsPbBr3 nanocrystal-based photosensitive synaptic transistor (PST) is reported. By decreasing the doping concentration, the response of the PST to short-wavelength light is gradually enhanced, and even weak light of 40 µW·cm-2 can be detected. Benefiting from the excellent color selectivity of the PST device, the device array is applied to feature extraction of target blue items and removal of red and green noise, which results in the recognition accuracy of 95% for the noisy MNIST data set. This work provides new ideas for the application of novel transistors integrating sensors and storage computing.

Contribution of low-level image statistics to EEG decoding of semantic content in multivariate and univariate models with feature optimization.

Spatio-temporal patterns of evoked brain activity contain information that can be used to decode and categorize the semantic content of visual stimuli. However, this procedure can be biased by low-level image features independently of the semantic content present in the stimuli, prompting the need to understand the robustness of different models regarding these confounding factors. In this study, we trained machine learning models to distinguish between concepts included in the publicly available THINGS-EEG dataset using electroencephalography (EEG) data acquired during a rapid serial visual presentation paradigm. We investigated the contribution of low-level image features to decoding accuracy in a multivariate model, utilizing broadband data from all EEG channels. Additionally, we explored a univariate model obtained through data-driven feature selection applied to the spatial and frequency domains. While the univariate models exhibited better decoding accuracy, their predictions were less robust to the confounding effect of low-level image statistics. Notably, some of the models maintained their accuracy even after random replacement of the training dataset with semantically unrelated samples that presented similar low-level content. In conclusion, our findings suggest that model optimization impacts sensitivity to confounding factors, regardless of the resulting classification performance. Therefore, the choice of EEG features for semantic decoding should ideally be informed by criteria beyond classifier performance, such as the neurobiological mechanisms under study.

It's all in the timing: delayed feedback in autism may weaken predictive mechanisms during contour integration.

Humans rely on predictive and integrative mechanisms during visual processing to efficiently resolve incomplete or ambiguous sensory signals. Although initial low-level sensory data are conveyed by feedforward connections, feedback connections are believed to shape sensory processing through automatic conveyance of statistical probabilities based on prior exposure to stimulus configurations. Individuals with autism spectrum disorder (ASD) show biases in stimulus processing toward parts rather than wholes, suggesting their sensory processing may be less shaped by statistical predictions acquired through prior exposure to global stimulus properties. Investigations of illusory contour (IC) processing in neurotypical (NT) adults have established a well-tested marker of contour integration characterized by a robust modulation of the visually evoked potential (VEP)-the IC-effect-that occurs over lateral occipital scalp during the timeframe of the visual N1 component. Converging evidence strongly supports the notion that this IC-effect indexes a signal with significant feedback contributions. Using high-density VEPs, we compared the IC-effect in 6- to 17-yr-old children with ASD (n = 32) or NT development (n = 53). Both groups of children generated an IC-effect that was equivalent in amplitude. However, the IC-effect notably onset 21 ms later in ASD, even though initial VEP afference was identical across groups. This suggests that feedforward information predominated during perceptual processing for 15% longer in ASD compared with NT children. This delay in the feedback-dependent IC-effect, in the context of known developmental differences between feedforward and feedback fibers, suggests a potential pathophysiological mechanism of visual processing in ASD, whereby ongoing stimulus processing is less shaped by visual feedback.NEW & NOTEWORTHY Children with autism often present with an atypical visual perceptual style that emphasizes parts or details over the whole. Using electroencephalography (EEG), this study identifies delays in the visual feedback from higher-order sensory brain areas to primary sensory regions. Because this type of visual feedback is thought to carry information about prior sensory experiences, individuals with autism may have difficulty efficiently using prior experience or putting together parts into a whole to help make sense of incoming new visual information. This provides empirical neural evidence to support theories of disrupted sensory perception mechanisms in autism.

A role of frontal association cortex in long-term object recognition memory of objects with complex features in rats.

Perirhinal cortex is a brain area that has been considered crucial for the object recognition memory (ORM). However, with the use of an ORM enhancer named RGS14414 as gain-in-function tool, we show here that frontal association cortex and not the Perirhinal cortex is essential for the ORM of objects with complex features that consisted of detailed drawing on the object surface (complex ORM). An expression of RGS14414, in rat brain frontal association cortex, induced the formation of long-term complex ORM, whereas the expression of the same memory enhancer in Perirhinal cortex failed to produce this effect. Instead, RGS14414 expression in Perirhinal cortex caused the formation of ORM of objects with simple features that consisted of the shape of object (simple ORM). Further, a selective elimination of frontal association cortex neurons by treatment with an immunotoxin Ox7-SAP completely abrogated the formation of complex ORM. Thus, our results suggest that frontal association cortex plays a key role in processing of a high-order recognition memory information in brain.

Crebinostat facilitates memory formation.

Protein modifications importantly contribute to memory formation. Protein acetylation is a post-translational modification of proteins that regulates memory formation. Acetylation level is determined by the relative activities of acetylases and deacetylases. Crebinostat is a histone deacetylase inhibitor. Here we show that in an object recognition task, crebinostat facilitates memory formation by a weak training. Further, this compound enhances acetylation of α-tubulin, and reduces the level of histone deacetylase 6, an α-tubulin deacetylase. The results suggest that enhanced acetylation of α-tubulin by crebinostat contributes to its facilitatory effect on memory formation.

Object Recognition Memory Deficits in ADHD: A Meta-analysis.

Object recognition memory allows us to identify previously seen objects. This type of declarative memory is a primary process for learning. Despite its crucial role in everyday life, object recognition has received far less attention in ADHD research compared to verbal recognition memory. In addition to the existence of a small number of published studies, the results have been inconsistent, possibly due to the diversity of tasks used to assess recognition memory. In the present meta-analysis, we have collected studies from Web of Science, Scopus, PubMed, and Google Scholar databases up to May 2023. We have compiled studies that assessed visual object recognition memory with specific visual recognition tests (sample-match delayed tasks) in children and adolescents diagnosed with ADHD. A total of 28 studies with 1619 participants diagnosed with ADHD were included. The studies were assessed for risk of bias using the Quadas-2 tool and for each study, Cohen's d was calculated to estimate the magnitude of the difference in performance between groups. As a main result, we have found a worse recognition memory performance in ADHD participants when compared to their matched controls (overall Cohen's d ~ 0.492). We also observed greater heterogeneity in the magnitude of this deficit among medicated participants compared to non-medicated individuals, as well as a smaller deficit in studies with a higher proportion of female participants. The magnitude of the object recognition memory impairment in ADHD also seems to depend on the assessment method used.

Cutting Through the Noise: Auditory Scenes and Their Effects on Visual Object Processing.

Despite the intuitive feeling that our visual experience is coherent and comprehensive, the world is full of ambiguous and indeterminate information. Here we explore how the visual system might take advantage of ambient sounds to resolve this ambiguity. Young adults (ns = 20-30) were tasked with identifying an object slowly fading in through visual noise while a task-irrelevant sound played. We found that participants demanded more visual information when the auditory object was incongruent with the visual object compared to when it was not. Auditory scenes, which are only probabilistically related to specific objects, produced similar facilitation even for unheard objects (e.g., a bench). Notably, these effects traverse categorical and specific auditory and visual-processing domains as participants performed across-category and within-category visual tasks, underscoring cross-modal integration across multiple levels of perceptual processing. To summarize, our study reveals the importance of audiovisual interactions to support meaningful perceptual experiences in naturalistic settings.

G protein-coupled estrogen receptor (GPER) in the dorsal hippocampus regulates memory consolidation in gonadectomized male mice, likely via different signaling mechanisms than in female mice.

Studies in ovariectomized (OVX) female rodents suggest that G protein-coupled estrogen receptor (GPER) is a key regulator of memory, yet little is known about its importance to memory in males or the cellular mechanisms underlying its mnemonic effects in either sex. In OVX mice, bilateral infusion of the GPER agonist G-1 into the dorsal hippocampus (DH) enhances object recognition and spatial memory consolidation in a manner dependent on rapid activation of c-Jun N-terminal kinase (JNK) signaling, cofilin phosphorylation, and actin polymerization in the DH. However, the effects of GPER on memory consolidation and DH cell signaling in males are unknown. Thus, the present study first assessed effects of DH infusion of G-1 or the GPER antagonist G-15 on object recognition and spatial memory consolidation in gonadectomized (GDX) male mice. As in OVX mice, immediate post-training bilateral DH infusion of G-1 enhanced, whereas G-15 impaired, memory consolidation in the object recognition and object placement tasks. However, G-1 did not increase levels of phosphorylated JNK (p46, p54) or cofilin in the DH 5, 15, or 30 min after infusion, nor did it affect phosphorylation of ERK (p42, p44), PI3K, or Akt. Levels of phospho-cAMP-responsive element binding protein (CREB) were elevated in the DH 30 min following G-1 infusion, indicating that GPER in males activates a yet unknown signaling mechanism that triggers CREB-mediated gene transcription. Our findings show for the first time that GPER in the DH regulates memory consolidation in males and suggests sex differences in underlying signaling mechanisms.

The decanoate esters of nandrolone, testosterone, and trenbolone induce steroid specific memory impairment and somatic effects in the male rat.

Long-term use of anabolic androgenic steroids (AAS) in supratherapeutic doses is associated with severe adverse effects, including physical, mental, and behavioral alterations. When used for recreational purposes several AAS are often combined, and in scientific studies of the physiological impact of AAS either a single compound or a cocktail of several steroids is often used. Because of this, steroid-specific effects have been difficult to define and are not fully elucidated. The present study used male Wistar rats to evaluate potential somatic and behavioral effects of three different AAS; the decanoate esters of nandrolone, testosterone, and trenbolone. The rats were exposed to 15 mg/kg of nandrolone decanoate, testosterone decanoate, or trenbolone decanoate every third day for 24 days. Body weight gain and organ weights (thymus, liver, kidney, testis, and heart) were measured together with the corticosterone plasma levels. Behavioral effects were studied in the novel object recognition-test (NOR-test) and the multivariate concentric square field-test (MCSF-test). The results conclude that nandrolone decanoate, but neither testosterone decanoate nor trenbolone decanoate, caused impaired recognition memory in the NOR-test, indicating an altered cognitive function. The behavioral profile and stress hormone level of the rats were not affected by the AAS treatments. Furthermore, the study revealed diverse AAS-induced somatic effects i.e., reduced body weight development and changes in organ weights. Of the three AAS included in the study, nandrolone decanoate was identified to cause the most prominent impact on the male rat, as it affected body weight development, the weights of multiple organs, and caused an impaired memory function.

Figure-ground segmentation based on motion in the archerfish.

Figure-ground segmentation is a fundamental process in visual perception that involves separating visual stimuli into distinct meaningful objects and their surrounding context, thus allowing the brain to interpret and understand complex visual scenes. Mammals exhibit varying figure-ground segmentation capabilities, ranging from primates that can perform well on figure-ground segmentation tasks to rodents that perform poorly. To explore figure-ground segmentation capabilities in teleost fish, we studied how the archerfish, an expert visual hunter, performs figure-ground segmentation. We trained archerfish to discriminate foreground objects from the background, where the figures were defined by motion as well as by discontinuities in intensity and texture. Specifically, the figures were defined by grating, naturalistic texture, and random noise moving in counterphase with the background. The archerfish performed the task well and could distinguish between all three types of figures and grounds. Their performance was comparable to that of primates and outperformed rodents. These findings suggest the existence of a complex visual process in the archerfish visual system that enables the delineation of figures as distinct from backgrounds, and provide insights into object recognition in this animal.

Multiple mechanisms of visual prediction as revealed by the timecourse of scene-object facilitation.

Not only semantic, but also recently learned arbitrary associations have the potential to facilitate visual processing in everyday life-for example, knowledge of a (moveable) object's location at a specific time may facilitate visual processing of that object. In our prior work, we showed that previewing a scene can facilitate processing of recently associated objects at the level of visual analysis (Smith and Federmeier in Journal of Cognitive Neuroscience, 32(5):783-803, 2020). In the current study, we assess how rapidly this facilitation unfolds by manipulating scene preview duration. We then compare our results to studies using well-learned object-scene associations in a first-pass assessment of whether systems consolidation might speed up high-level visual prediction. In two ERP experiments (N = 60), we had participants study categorically organized novel object-scene pairs in an explicit paired associate learning task. At test, we varied contextual pre-exposure duration, both between (200 vs. 2500 ms) and within subjects (0-2500 ms). We examined the N300, an event-related potential component linked to high-level visual processing of objects and scenes and found that N300 effects of scene congruity increase with longer scene previews, up to approximately 1-2 s. Similar results were obtained for response times and in a separate component-neutral ERP analysis of visual template matching. Our findings contrast with prior evidence that scenes can rapidly facilitate visual processing of commonly associated objects. This raises the possibility that systems consolidation might mediate different kinds of predictive processing with different temporal profiles.

The development of visual cognition: The emergence of spatial congruency bias.

In adults, spatial location plays a special role in visual object processing. People are more likely to judge two sequentially presented objects as being identical when they appear in the same location compared to in different locations (a phenomenon referred to as Spatial Congruency Bias [SCB]). However, no comparable Identity Congruency Bias (ICB) is found, suggesting an asymmetric location-identity relationship in object binding. What gives rise to this asymmetric congruency bias? This paper considered two possible hypotheses. Hypothesis 1 suggests that the asymmetric congruency bias results from an inherently special role of location in the visual system. In contrast, Hypothesis 2 suggests that the asymmetric congruency bias is a product of development, reflecting people's experience with the world. To distinguish the two hypotheses, we tested both adults' and 5-year-old children's SCB and ICB by Identity Judgment Experiments and Spatial Judgment Experiments, respectively. The study found that adults only exhibited a SCB, but no ICB. However, young children exhibited both SCB and ICB, suggesting a symmetric congruency bias and reciprocal influences between location and identity in early development. The results indicate that the asymmetric location-identity relationship develops as object identity's influence on location gets pruned away, while location's influence on identity is preserved, possibly due to people's gained experiences with regularities of the world. RESEARCH HIGHLIGHTS: Adults exhibit Spatial Congruency Bias-an asymmetric location-identity relationship with location biasing their judgment of object identities, but not vice versa. Asymmetric congruency bias may result from an inherently special role of location in visual system (Hypothesis 1) or accumulated experiences with the world (Hypothesis 2). To distinguish the two hypotheses, the study investigated the Spatial Congruency Bias and Identity Congruency Bias in both adults and 5-year-old children. Unlike adults who exhibited only Spatial Congruency Bias, 5-year-old children exhibited both Spatial Congruency Bias and Identity Congruency Bias.

Single-dose methamphetamine administration impairs ORM retrieval in mice via excessive DA-mediated inhibition of PrLGlu activity.

Methamphetamine (METH), an abused psychostimulant, impairs cognition through prolonged or even single-dose exposure, but animal experiments have shown contradictory effects on memory deficits. In this study we investigated the effects and underlying mechanisms of single-dose METH administration on the retrieval of object recognition memory (ORM) in mice. We showed that single-dose METH administration (2 mg/kg, i.p.) significantly impaired ORM retrieval in mice. Fiber photometry recording in METH-treated mice revealed that the activity of prelimbic cortex glutamatergic neurons (PrLGlu) was significantly reduced during ORM retrieval. Chemogenetic activation of PrLGlu or glutamatergic projections from ventral CA1 to PrL (vCA1Glu-PrL) rescued ORM retrieval impairment. Fiber photometry recording revealed that dopamine (DA) levels in PrL of METH-treated mice were significantly increased, and micro-infusion of the D2 receptor (D2R) antagonist sulpiride (0.25 µg/side) into PrL rescued ORM retrieval impairment. Whole-cell recordings in brain slices containing the PrL revealed that PrLGlu intrinsic excitability and basal glutamatergic synaptic transmission were significantly reduced in METH-treated mice, and the decrease in intrinsic excitability was reversed by micro-infusion of Sulpiride into PrL in METH-treated mice. Thus, the impaired ORM retrieval caused by single-dose METH administration may be attributed to reduced PrLGlu activity, possibly due to excessive DA activity on D2R. Selective activation of PrLGlu or vCA1Glu-PrL may serve as a potential therapeutic strategy for METH-induced cognitive dysfunction.

Child development and the role of visual experience in the use of spatial and non-spatial features in haptic object perception.

Previous work has suggested a different developmental timeline and role of visual experience for the use of spatial and non-spatial features in haptic object recognition. To investigate this conjecture, we used a haptic ambiguous odd-one-out task in which one object needed to be selected as being different from two other objects. The odd-one-out could be selected based on four characteristics: size, shape (spatial), texture, and weight (non-spatial). We tested sighted children from 4 to 12 years of age; congenitally blind, late blind, and adult participants with low vision; and normally sighted adults. Given the protracted developmental time course for spatial perception, we expected a shift from a preference for non-spatial features toward spatial features during typical development. Due to the dominant influence of vision for spatial perception, we expected congenitally blind adults to show a similar preference for non-spatial features as the youngest children. The results confirmed our first hypothesis; the 4-year-olds demonstrated a lower dominance for spatial features for object classification compared with older children and sighted adults. In contrast, our second hypothesis was not confirmed; congenitally blind adults' preferred categorization criteria were indistinguishable from those of sighted controls. These findings suggest an early development, but late maturation, of spatial processing in haptic object recognition independent of visual experience.

The importance of multisensory-motor learning on subsequent visual recognition.

Speed of visual object recognition is facilitated after active manual exploration of objects relative to passive visual processing alone. Manual exploration allows viewers to select important information about object structure that may facilitate recognition. Viewpoints where the objects' axis of elongation is perpendicular or parallel to the line of sight are selected more during exploration, recognized faster than other viewpoints, and afford the most information about structure when object movement is controlled by the viewer. Prior work used virtual object exploration in active and passive viewing conditions, limiting multisensory structural object information. Adding multisensory information to encoding may change accuracy of overall recognition, viewpoint selection, and viewpoint recognition. We tested whether the known active advantage for object recognition would change when real objects were studied, affording visual and haptic information. Participants interacted with 3D novel objects during manual exploration or passive viewing of another's object interactions. Object recognition was tested using several viewpoints of rendered objects. We found that manually explored objects were recognized more accurately than objects studied through passive exploration and that recognition of viewpoints differed from previous work.

A Hybrid System for Defect Detection on Rail Lines through the Fusion of Object and Context Information.

Defect detection on rail lines is essential for ensuring safe and efficient transportation. Current image analysis methods with deep neural networks (DNNs) for defect detection often focus on the defects themselves while ignoring the related context. In this work, we propose a fusion model that combines both a targeted defect search and a context analysis, which is seen as a multimodal fusion task. Our model performs rule-based decision-level fusion, merging the confidence scores of multiple individual models to classify rail-line defects. We call the model "hybrid" in the sense that it is composed of supervised learning components and rule-based fusion. We first propose an improvement to existing vision-based defect detection methods by incorporating a convolutional block attention module (CBAM) in the you only look once (YOLO) versions 5 (YOLOv5) and 8 (YOLOv8) architectures for the detection of defects and contextual image elements. This attention module is applied at different detection scales. The domain-knowledge rules are applied to fuse the detection results. Our method demonstrates improvements over baseline models in vision-based defect detection. The model is open for the integration of modalities other than an image, e.g., sound and accelerometer data.

The Implementation of a Gesture Recognition System with a Millimeter Wave and Thermal Imager.

During the COVID-19 pandemic, the number of cases continued to rise. As a result, there was a growing demand for alternative control methods to traditional buttons or touch screens. However, most current gesture recognition technologies rely on machine vision methods. However, this method can lead to suboptimal recognition results, especially in situations where the camera is operating in low-light conditions or encounters complex backgrounds. This study introduces an innovative gesture recognition system for large movements that uses a combination of millimeter wave radar and a thermal imager, where the multi-color conversion algorithm is used to improve palm recognition on the thermal imager together with deep learning approaches to improve its accuracy. While the user performs gestures, the mmWave radar captures point cloud information, which is then analyzed through neural network model inference. It also integrates thermal imaging and palm recognition to effectively track and monitor hand movements on the screen. The results suggest that this combined method significantly improves accuracy, reaching a rate of over 80%.