"Leap before you look": Conditions that suppress explicit, knowledge-based learning during visuomotor adaptation.

When learning a novel visuomotor mapping (e.g., mirror writing), accuracy can improve quickly through explicit, knowledge-based learning (e.g., aim left to go right), but after practice, implicit or procedural learning takes over, producing fast, natural movements. This procedural learning occurs automatically, whereas it has recently been found that knowledge-based learning can be suppressed by the gradual introduction of the novel mapping when participants must make fast movements and visuomotor perturbations are small (e.g., 30° rotations). We explored the range of task instructions, perturbation parameters, and feedback that preclude or encourage this suppression. Using a reaching task with a rotation between screen position and movement direction, we found that knowledge-based learning could be suppressed even for an extreme 90° rotation, but only if it was introduced gradually and only under instructions to move quickly. If the rotation was introduced abruptly or if instructions emphasized accuracy over speed, knowledge-based learning occurred. A second experiment indicated that knowledge-based learning always occurred in the absence of continuous motion feedback, evidenced by the time course of learning, the aftereffects of learning when the rotation was abruptly removed, and the outcome of formal model comparison between a dual-state (procedural and knowledge-based) versus a single-state (procedural only) learning model of the data. A third experiment replicated the findings and verified that the knowledge-based component of the dual-state model corresponded to explicit aiming, whereas the procedural component was slow to unlearn. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

The push-pull of serial dependence effects: Attraction to the prior response and repulsion from the prior stimulus.

In the "serial dependence" effect, responses to visual stimuli appear biased toward the last trial's stimulus. However, several kinds of serial dependence exist, with some reflecting prior stimuli and others reflecting prior responses. One-factor analyses consider the prior stimulus alone or the prior response alone and can consider both variables only via separate analyses. We demonstrate that one-factor analyses are potentially misleading and can reach conclusions that are opposite from the truth if both dependencies exist. To address this limitation, we developed two-factor analyses (model comparison with hierarchical Bayesian modeling and an empirical "quadrant analysis"), which consider trial-by-trial combinations of prior response and prior stimulus. Two-factor analyses can tease apart the two dependencies if applied to a sufficiently large dataset. We applied these analyses to a new study and to four previously published studies. When applying a model that included the possibility of both dependencies, there was no evidence of attraction to the prior stimulus in any dataset, but there was evidence of attraction to the prior response in all datasets. Two of the datasets contained sufficient constraint to determine that both dependencies were needed to explain the results. For these datasets, the dependency on the prior stimulus was repulsive rather than attractive. Our results are consistent with the claim that both dependencies exist in most serial dependence studies (the two-dependence model was not ruled out for any dataset) and, furthermore, that the two dependencies work against each other.

Do cultural differences emerge at different levels of representational hierarchy?

In prior research, Eastern and Western culture groups differ in memory specificity for objects. However, these studies used concrete object stimuli, which carry semantic information that may be confounded with culture. Additionally, the perceptual properties of the stimuli were not tightly controlled. Therefore, it cannot be precisely determined whether the observed cross-cultural differences are generalizable across different stimulus types and memory task demands. In prior studies, Americans demonstrated higher memory specificity than East Asians, but this may be due to Americans being more attuned to the low-level features that distinguish studied items from similar lures, rather than general memory differences. To determine whether this pattern of cross-cultural memory differences emerges irrespective of stimulus properties, we tested American and East Asian young adults using a recognition memory task employing abstract stimuli for which attention to conjunctions of features was critical for discrimination. Additionally, in order to more precisely determine the influence of stimulus and task on culture differences, participants also completed a concrete objects memory task identical to the one used in prior research. The results of the abstract objects task mirror the pattern seen in prior studies with concrete objects: Americans showed generally higher levels of recognition memory performance than East Asians for studied abstract items, whether discriminating them from similar or entirely new items. Results from the current concrete object task generally replicated this pattern. This suggests cross-cultural memory differences generalize across stimulus types and task demands, rather than reflecting differential sensitivity to low-level features or higher-level conjunctions.

Gestalt formation promotes awareness of suppressed visual stimuli during binocular rivalry.

Continuous flash suppression leverages binocular rivalry to render observers unaware of a static image for several seconds. To achieve this effect, rapidly flashing noise masks are presented to the dominant eye while a static stimulus is presented to the non-dominant eye. Eventually "breakthrough" occurs, wherein awareness shifts to the static image shown to the non-dominant eye. We tested the hypothesis that Gestalt formation can promote breakthrough. In two experiments, we presented pacman-shaped objects that might or might not align to form illusory Kanizsa objects. To measure the inception of breakthrough, observers were instructed to press a key at the moment of partial breakthrough. After pressing the key, which stopped the trial, observers reported how many pacmen were seen and where they were located. Supporting the Gestalt hypothesis, breakthrough was faster when the pacmen were aligned and observers more often reported pairs of pacmen if they were aligned. To address whether these effects reflected illusory shape perception, a computational model was applied to the pacman report distributions and breakthrough times for an experiment with four pacmen. A full account of the data required an increased joint probability of reporting all four pacmen, suggesting an influence of a perceived illusory cross.

The locus of recognition memory signals in human cortex depends on the complexity of the memory representations.

According to a "Swiss Army Knife" model of the brain, cognitive functions such as episodic memory and face perception map onto distinct neural substrates. In contrast, representational accounts propose that each brain region is best explained not by which specialized function it performs, but by the type of information it represents with its neural firing. In a functional magnetic resonance imaging study, we asked whether the neural signals supporting recognition memory fall mandatorily within the medial temporal lobes (MTL), traditionally thought the seat of declarative memory, or whether these signals shift within cortex according to the content of the memory. Participants studied objects and scenes that were unique conjunctions of pre-defined visual features. Next, we tested recognition memory in a task that required mnemonic discrimination of both simple features and complex conjunctions. Feature memory signals were strongest in posterior visual regions, declining with anterior progression toward the MTL, while conjunction memory signals followed the opposite pattern. Moreover, feature memory signals correlated with feature memory discrimination performance most strongly in posterior visual regions, whereas conjunction memory signals correlated with conjunction memory discrimination most strongly in anterior sites. Thus, recognition memory signals shifted with changes in memory content, in line with representational accounts.

A modeling framework for determining modulation of neural-level tuning from non-invasive human fMRI data.

Many neuroscience theories assume that tuning modulation of individual neurons underlies changes in human cognition. However, non-invasive fMRI lacks sufficient resolution to visualize this modulation. To address this limitation, we developed an analysis framework called Inferring Neural Tuning Modulation (INTM) for "peering inside" voxels. Precise specification of neural tuning from the BOLD signal is not possible. Instead, INTM compares theoretical alternatives for the form of neural tuning modulation that might underlie changes in BOLD across experimental conditions. The most likely form is identified via formal model comparison, with assumed parametric Normal tuning functions, followed by a non-parametric check of conclusions. We validated the framework by successfully identifying a well-established form of modulation: visual contrast-induced multiplicative gain for orientation tuned neurons. INTM can be applied to any experimental paradigm testing several points along a continuous feature dimension (e.g., direction of motion, isoluminant hue) across two conditions (e.g., with/without attention, before/after learning).

Boosting confidence without boosting performance: item strength creates the illusion of source accuracy.

People often express high confidence for misremembered sources. Starns and Ksander ([2016]. Item strength influences source confidence and alters source memory zROC slopes. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(3), 351-365; hereafter SK16) found that this happens more often when a person is highly confident in memory for the item itself, and that simply increasing item memory can increase high-confidence source errors. Under the decision heuristic account, this pattern emerges because strong item memories contaminate source judgments by promoting high confidence responses even when source evidence is relatively weak. Consequently, strengthening item memory is predicted to increase confidence for both correct and incorrect source responses; however, SK16 could not assess this key prediction because their item-strength manipulation also impaired source memory. We report two experiments with new item-strengthening manipulations designed to minimise source memory impairments. Results replicated the evidence for the decision heuristic account reported by SK16 and provided additional support by showing a boost in source confidence for both correct and error responses when item memory was strengthened without accompanying source impairments .

Visual and semantic similarity norms for a photographic image stimulus set containing recognizable objects, animals and scenes.

We collected visual and semantic similarity norms for a set of photographic images comprising 120 recognizable objects/animals and 120 indoor/outdoor scenes. Human observers rated the similarity of pairs of images within four categories of stimuli-inanimate objects, animals, indoor scenes and outdoor scenes-via Amazon's Mechanical Turk. We performed multidimensional scaling (MDS) on the collected similarity ratings to visualize the perceived similarity for each image category, for both visual and semantic ratings. The MDS solutions revealed the expected similarity relationships between images within each category, along with intuitively sensible differences between visual and semantic similarity relationships for each category. Stress tests performed on the MDS solutions indicated that the MDS analyses captured meaningful levels of variance in the similarity data. These stimuli, associated norms and naming data are made available to all researchers, and should provide a useful resource for researchers of vision, memory and conceptual knowledge wishing to run experiments using well-parameterized stimulus sets.

Mechanisms of memory: An intermediate level of analysis and organization.

Research in the last five years has made great strides toward mechanistic explanations of how the brain enables memory. This progress builds upon decades of research from two complementary strands: a Levels of Analysis approach and a Levels of Organization approach. We review how research in cognitive psychology and cognitive neuroscience under these two approaches has recently converged on mechanistic, brain-based theories, couched at the optimal level for explaining cognitive phenomena - the intermediate level. Furthermore, novel empirical and data analysis techniques are now providing ways to test these theories' predictions, a crucial step in unraveling the mechanisms of memory.

A Roadmap for Understanding Memory: Decomposing Cognitive Processes into Operations and Representations.

Thanks to patients Phineas Gage and Henry Molaison, we have long known that behavioral control depends on the frontal lobes, whereas declarative memory depends on the medial temporal lobes (MTL). For decades, cognitive functions-behavioral control, declarative memory-have served as labels for characterizing the division of labor in cortex. This approach has made enormous contributions to understanding how the brain enables the mind, providing a systems-level explanation of brain function that constrains lower-level investigations of neural mechanism. Today, the approach has evolved such that functional labels are often applied to brain networks rather than focal brain regions. Furthermore, the labels have diversified to include both broadly-defined cognitive functions (declarative memory, visual perception) and more circumscribed mental processes (recollection, familiarity, priming). We ask whether a process-a high-level mental phenomenon corresponding to an introspectively-identifiable cognitive event-is the most productive label for dissecting memory. For example, recollection conflates a neurocomputational operation (pattern completion-based retrieval) with a class of representational content (associative, high-dimensional memories). Because a full theory of memory must identify operations and representations separately, and specify how they interact, we argue that processes like recollection constitute inadequate labels for characterizing neural mechanisms. Instead, we advocate considering the component operations and representations of processes like recollection in isolation. For the organization of memory, the evidence suggests that pattern completion is recapitulated widely across the ventral visual stream and MTL, but the division of labor between sites within this pathway can be explained by representational content.

Connecting the dots without top-down knowledge: Evidence for rapidly-learned low-level associations that are independent of object identity.

Knowing the identity of an object can powerfully alter perception. Visual demonstrations of this-such as Gregory's (1970) hidden Dalmatian-affirm the existence of both top-down and bottom-up processing. We consider a third processing pathway: lateral connections between the parts of an object. Lateral associations are assumed by theories of object processing and hierarchical theories of memory, but little evidence attests to them. If they exist, their effects should be observable even in the absence of object identity knowledge. We employed Continuous Flash Suppression (CFS) while participants studied object images, such that visual details were learned without explicit object identification. At test, lateral associations were probed using a part-to-part matching task. We also tested whether part-whole links were facilitated by prior study using a part-naming task, and included another study condition (Word), in which participants saw only an object's written name. The key question was whether CFS study (which provided visual information without identity) would better support part-to-part matching (via lateral associations) whereas Word study (which provided identity without the correct visual form) would better support part-naming (via top-down processing). The predicted dissociation was found and confirmed by state-trace analyses. Thus, lateral part-to-part associations were learned and retrieved independently of object identity representations. This establishes novel links between perception and memory, demonstrating that (a) lateral associations at lower levels of the object identification hierarchy exist and contribute to object processing and (b) these associations are learned via rapid, episodic-like mechanisms previously observed for the high-level, arbitrary relations comprising episodic memories. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

A hierarchical Bayesian state trace analysis for assessing monotonicity while factoring out subject, item, and trial level dependencies.

State trace analyses assess the latent dimensionality of a cognitive process by asking whether the means of two dependent variables conform to a monotonic function across a set of conditions. Using an assumption of independence between the measures, recently proposed statistical tests address bivariate measurement error, allowing both frequentist and Bayesian analyses of monotonicity (e.g., Davis-Stober, Morey, Gretton, & Heathcote, 2016; Kalish, Dunn, Burdakov, & Sysoev, 2016). However, inference can be biased by unacknowledged dependencies between measures, particularly when the data are insufficient to overwhelm an incorrect prior assumption of independence. To address this limitation, we developed a hierarchical Bayesian model that explicitly models the separate roles of subject, item, and trial-level dependencies between two measures. Assessment of monotonicity is then performed by fitting separate models that do or do not allow a non-monotonic relation between the condition effects (i.e., same vs. different rank orders). The Widely Applicable Information Criterion (WAIC) and Pseudo Bayesian Model Averaging - cross validation measures of model fit - are used for model comparison, providing an inferential conclusion regarding the dimensionality of the latent psychological space. We validated this new state trace analysis technique using model recovery simulation studies, which assumed different ground truths regarding monotonicity and the direction/magnitude of the subject- and trial-level dependence. We also provide an example application of this new technique to a visual object learning study that compared performance on a visual retrieval task (forced choice part recognition) versus a verbal retrieval task (cued recall).

Recognition memory shielded from semantic but not perceptual interference in normal aging.

Normal aging impairs long-term declarative memory, and evidence suggests that this impairment may be driven partly by structural or functional changes in the medial temporal lobe (MTL). Theories of MTL memory function therefore make predictions for age-related memory loss. One theory - the Representational-Hierarchical account - makes two specific predictions. First, recognition memory performance in older participants should be impaired by feature-level interference, in which studied items contain many shared, and thus repeatedly appearing, perceptual features. Second, if the interference in a recognition memory task - i.e., the information that repeats across items - resides at a higher level of complexity than simple perceptual features, such as semantic gist, older adults should be less impacted by such interference than young adults. We tested these predictions using the Deese-Roediger-McDermott paradigm, by creating feature-level (i.e., perceptual) interference with phonemically/orthographically related word categories, and higher-level associative interference with semantically related word categories. We manipulated category size in order to compare the effect of less versus more interference (i.e., small versus large category size), which served to (1) avoid potential item confounds arising from systematic differences between words belonging to perceptually- versus semantically-related categories, and (2) ensure that any effect of interference was due to information encoded at study, rather than pre-experimentally. Further, we used signal detection theory (SDT) to interpret our data, rather than examining false alarm (FA) rates in isolation. The d' measure derived from SDT avoids contamination of the memory measure by response bias, and lies on an interval scale, allowing memory performance in different conditions to be compared without violating assumptions of the statistical tests. Older participants were relatively more impaired by perceptual interference and less impaired by semantic interference than young adults. This pattern is at odds with many current theories of age-related memory loss, but is in line with the Representational-Hierarchical account.

Dissociable contributions of thalamic nuclei to recognition memory: novel evidence from a case of medial dorsal thalamic damage.

The thalamic nuclei are thought to play a critical role in recognition memory. Specifically, the anterior thalamic nuclei and medial dorsal nuclei may serve as critical output structures in distinct hippocampal and perirhinal cortex systems, respectively. Existing evidence indicates that damage to the anterior thalamic nuclei leads to impairments in hippocampal-dependent tasks. However, evidence for the opposite pattern following medial dorsal nuclei damage has not yet been identified. In the present study, we investigated recognition memory in NC, a patient with relatively selective medial dorsal nuclei damage, using two object recognition tests with similar foils: a yes/no (YN) test that requires the hippocampus, and a forced choice corresponding test (FCC) that is supported by perirhinal cortex. NC performed normally in the YN test, but was impaired in the FCC test. Critically, FCC performance was impaired only when the study-test delay period was filled with interference. We interpret these results in the context of the representational-hierarchical model, which predicts that memory deficits following damage to the perirhinal system arise due to increased vulnerability to interference. These data provide the first evidence for selective deficits in a task that relies on perirhinal output following damage to the medial dorsal nuclei, providing critical evidence for dissociable thalamic contributions to recognition memory.

Hippocampal Engagement during Recall Depends on Memory Content.

The hippocampus is considered pivotal to recall, allowing retrieval of information not available in the immediate environment. In contrast, neocortex is thought to signal familiarity, contributing to recall only when called upon by the hippocampus. However, this view is not compatible with representational accounts of memory, which reject the mapping of cognitive processes onto brain regions. According to representational accounts, the hippocampus is not engaged by recall per se, rather it is engaged whenever hippocampal representations are required. To test whether hippocampus is engaged by recall when hippocampal representations are not required, we used functional imaging and a non-associative recall task, with images (objects, scenes) studied in isolation, and image patches as cues. As predicted by a representational account, hippocampal activation was modulated by the content of the recalled memory, increasing during recall of scenes-which are known to be processed by hippocampus-but not during recall of objects. Object recall instead engaged neocortical regions known to be involved in object-processing. Further supporting the representational account, effective connectivity analyses revealed that changes in functional activation during recall were driven by increased information flow from neocortical sites, rather than by the spreading of recall-related activation from hippocampus back to neocortex.

Feature-coding transitions to conjunction-coding with progression through human visual cortex.

Identifying an object and distinguishing it from similar items depends upon the ability to perceive its component parts as conjoined into a cohesive whole, but the brain mechanisms underlying this ability remain elusive. The ventral visual processing pathway in primates is organized hierarchically: Neuronal responses in early stages are sensitive to the manipulation of simple visual features, whereas neuronal responses in subsequent stages are tuned to increasingly complex stimulus attributes. It is widely assumed that feature-coding dominates in early visual cortex whereas later visual regions employ conjunction-coding in which object representations are different from the sum of their simple feature parts. However, no study in humans has demonstrated that putative object-level codes in higher visual cortex cannot be accounted for by feature-coding and that putative feature codes in regions prior to ventral temporal cortex are not equally well characterized as object-level codes. Thus the existence of a transition from feature- to conjunction-coding in human visual cortex remains unconfirmed, and if a transition does occur its location remains unknown. By employing multivariate analysis of functional imaging data, we measure both feature-coding and conjunction-coding directly, using the same set of visual stimuli, and pit them against each other to reveal the relative dominance of one vs. the other throughout cortex. Our results reveal a transition from feature-coding in early visual cortex to conjunction-coding in both inferior temporal and posterior parietal cortices. This novel method enables the use of experimentally controlled stimulus features to investigate population-level feature and conjunction codes throughout human cortex.NEW & NOTEWORTHY We use a novel analysis of neuroimaging data to assess representations throughout visual cortex, revealing a transition from feature-coding to conjunction-coding along both ventral and dorsal pathways. Occipital cortex contains more information about spatial frequency and contour than about conjunctions of those features, whereas inferotemporal and parietal cortices contain conjunction coding sites in which there is more information about the whole stimulus than its component parts.

A Computational Model of Perceptual and Mnemonic Deficits in Medial Temporal Lobe Amnesia.

Damage to the medial temporal lobe (MTL) has long been known to impair declarative memory, and recent evidence suggests that it also impairs visual perception. A theory termed the representational-hierarchical account explains such impairments by assuming that MTL stores conjunctive representations of items and events, and that individuals with MTL damage must rely upon representations of simple visual features in posterior visual cortex, which are inadequate to support memory and perception under certain circumstances. One recent study of visual discrimination behavior revealed a surprising antiperceptual learning effect in MTL-damaged individuals: With exposure to a set of visual stimuli, discrimination performance worsened rather than improved [Barense, M. D., Groen, I. I. A., Lee, A. C. H., Yeung, L. K., Brady, S. M., Gregori, M., et al. Intact memory for irrelevant information impairs perception in amnesia. Neuron, 75, 157-167, 2012]. We extend the representational-hierarchical account to explain this paradox by assuming that difficult visual discriminations are performed by comparing the relative "representational tunedness"-or familiarity-of the to-be-discriminated items. Exposure to a set of highly similar stimuli entails repeated presentation of simple visual features, eventually rendering all feature representations maximally and, thus, equally familiar; hence, they are inutile for solving the task. Discrimination performance in patients with MTL lesions is therefore impaired by stimulus exposure. Because the unique conjunctions represented in MTL do not occur repeatedly, healthy individuals are shielded from this perceptual interference. We simulate this mechanism with a neural network previously used to explain recognition memory, thereby providing a model that accounts for both mnemonic and perceptual deficits caused by MTL damage with a unified architecture and mechanism.

Distributed category-specific recognition-memory signals in human perirhinal cortex.

Evidence from a large body of research suggests that perirhinal cortex (PrC), which interfaces the medial temporal lobe with the ventral visual pathway for object identification, plays a critical role in item-based recognition memory. The precise manner in which PrC codes for the prior occurrence of objects, however, remains poorly understood. In the present functional magnetic resonance imaging (fMRI) study, we used multivoxel pattern analyses to examine whether the prior occurrence of faces is coded by distributed patterns of PrC activity that consist of voxels with decreases as well as increases in signal. We also investigated whether pertinent voxels are preferentially tuned to the specific object category to which judged stimuli belong. We found that, when no a priori constraints were imposed on the direction of signal change, activity patterns that allowed for successful classification of recognition-memory decisions included some voxels with decreases and others with increases in signal in association with perceived prior occurrence. Moreover, successful classification was obtained in the absence of a mean difference in activity across the set of voxels in these patterns. Critically, we observed a positive relationship between classifier accuracy and behavioral performance across participants. Additional analyses revealed that voxels carrying diagnostic information for classification of memory decisions showed category specificity in their tuning for faces when probed with an independent functional localizer in a nonmnemonic task context. These voxels were spatially distributed in PrC, and extended beyond the contiguous voxel clusters previously described as the anterior temporal face patch. Our findings provide support for proposals, recently raised in the neurophysiological literature, that the prior occurrence of objects is coded by distributed PrC representations. They also suggest that the stimulus category to which an item belongs shapes the organization of these distributed representations.

Norepinephrine Modulates Coding of Complex Vocalizations in the Songbird Auditory Cortex Independent of Local Neuroestrogen Synthesis.

The catecholamine norepinephrine plays a significant role in auditory processing. Most studies to date have examined the effects of norepinephrine on the neuronal response to relatively simple stimuli, such as tones and calls. It is less clear how norepinephrine shapes the detection of complex syntactical sounds, as well as the coding properties of sensory neurons. Songbirds provide an opportunity to understand how auditory neurons encode complex, learned vocalizations, and the potential role of norepinephrine in modulating the neuronal computations for acoustic communication. Here, we infused norepinephrine into the zebra finch auditory cortex and performed extracellular recordings to study the modulation of song representations in single neurons. Consistent with its proposed role in enhancing signal detection, norepinephrine decreased spontaneous activity and firing during stimuli, yet it significantly enhanced the auditory signal-to-noise ratio. These effects were all mimicked by clonidine, an α-2 receptor agonist. Moreover, a pattern classifier analysis indicated that norepinephrine enhanced the ability of single neurons to accurately encode complex auditory stimuli. Because neuroestrogens are also known to enhance auditory processing in the songbird brain, we tested the hypothesis that norepinephrine actions depend on local estrogen synthesis. Neither norepinephrine nor adrenergic receptor antagonist infusion into the auditory cortex had detectable effects on local estradiol levels. Moreover, pretreatment with fadrozole, a specific aromatase inhibitor, did not block norepinephrine's neuromodulatory effects. Together, these findings indicate that norepinephrine enhances signal detection and information encoding for complex auditory stimuli by suppressing spontaneous "noise" activity and that these actions are independent of local neuroestrogen synthesis.