Tracking Your Mind's Eye during Recollection: Decoding the Long-Term Recall of Short Audiovisual Clips.

Unlike familiarity, recollection involves the ability to reconstruct mentally previous events that results in a strong sense of reliving. According to the reinstatement hypothesis, this specific feature emerges from the reactivation of cortical patterns involved during information exposure. Over time, the retrieval of specific details becomes more difficult, and memories become increasingly supported by familiarity judgments. The multiple trace theory (MTT) explains the gradual loss of episodic details by a transformation in the memory representation, a view that is not shared by the standard consolidation model. In this study, we tested the MTT in light of the reinstatement hypothesis. The temporal dynamics of mental imagery from long-term memory were investigated and tracked over the passage of time. Participant EEG activity was recorded during the recall of short audiovisual clips that had been watched 3 weeks, 1 day, or a few hours beforehand. The recall of the audiovisual clips was assessed using a Remember/Know/New procedure, and snapshots of clips were used as recall cues. The decoding matrices obtained from the multivariate pattern analyses revealed sustained patterns that occurred at long latencies (>500 msec poststimulus onset) that faded away over the retention intervals and that emerged from the same neural processes. Overall, our data provide further evidence toward the MTT and give new insights into the exploration of our "mind's eye."

24-Month-olds and over remember novel object names after a single learning event.

In the context of word learning, it is commonly assumed that repetition is required for young children to form and maintain in memory an association between a novel word and its corresponding object. For instance, at 2 years of age, children are able to disambiguate word-related situations in one shot but are not able to further retain this newly acquired knowledge. It has been proposed that multiple fast-mapping experiences would be required to promote word retention or that the inferential reasoning needs to be accompanied by explicit labeling of the target. We hypothesized that when 2-year-olds simply encounter an unambiguous learning context, word learning may be fast and maintained in time. We also assumed that, under this condition, even a single exposure to an object would be sufficient to form a memory trace of its name that would survive a delay. To test these hypotheses, 2- and 4-year-olds were ostensively taught three arbitrary word-object pairs using a 15-s video sequence during which each object was manually displayed and labeled three times in a row. Retention was measured after a 30-min distractive period using a forced-choice procedure. Our results provide evidence that declarative memory does not need repetition to be formed and maintained, for at least a 30-min period, by children as young as 2 years. This finding suggests that the mechanisms required for extremely rapid and robust word acquisition not only are present in preschoolers with developed language and cognitive skills but also are already operative at a younger age.

Memory for Repeated Images in Rapid-Serial-Visual-Presentation Streams of Thousands of Images.

Human observers readily detect targets in stimuli presented briefly and in rapid succession. Here, we show that even without predefined targets, humans can spot repetitions in streams of thousands of images. We presented sequences of natural images reoccurring a number of times interleaved with either one or two distractors, and we asked participants to detect the repetitions and to identify the repeated images after a delay that could last for minutes. Performance improved with the number of repeated-image presentations up to a ceiling around seven repetitions and was above chance even after only two to three presentations. The task was easiest for slow streams; performance dropped with increasing image-presentation rate but stabilized above 15 Hz and remained well above chance even at 120 Hz. To summarize, we reveal that the human brain has an impressive capacity to detect repetitions in rapid-serial-visual-presentation streams and to remember repeated images over a time course of minutes.

Object categorization in visual periphery is modulated by delayed foveal noise.

Behavioral studies in humans indicate that peripheral vision can do object recognition to some extent. Moreover, recent studies have shown that some information from brain regions retinotopic to visual periphery is somehow fed back to regions retinotopic to the fovea and disrupting this feedback impairs object recognition in human. However, it is unclear to what extent the information in visual periphery contributes to human object categorization. Here, we designed two series of rapid object categorization tasks to first investigate the performance of human peripheral vision in categorizing natural object images at different eccentricities and abstraction levels (superordinate, basic, and subordinate). Then, using a delayed foveal noise mask, we studied how modulating the foveal representation impacts peripheral object categorization at any of the abstraction levels. We found that peripheral vision can quickly and accurately accomplish superordinate categorization, while its performance in finer categorization levels dramatically drops as the object presents further in the periphery. Also, we found that a 300-ms delayed foveal noise mask can significantly disturb categorization performance in basic and subordinate levels, while it has no effect on the superordinate level. Our results suggest that human peripheral vision can easily process objects at high abstraction levels, and the information is fed back to foveal vision to prime foveal cortex for finer categorizations when a saccade is made toward the target object.

DUF3380 Domain from a Salmonella Phage Endolysin Shows Potent N-Acetylmuramidase Activity.

UNLABELLED: Bacteriophage-encoded endolysins are highly diverse enzymes that cleave the bacterial peptidoglycan layer. Current research focuses on their potential applications in medicine, in food conservation, and as biotechnological tools. Despite the wealth of applications relying on the use of endolysin, little is known about the enzymatic properties of these enzymes, especially in the case of endolysins of bacteriophages infecting Gram-negative species. Automated genome annotations therefore remain to be confirmed. Here, we report the biochemical analysis and cleavage site determination of a novel Salmonella bacteriophage endolysin, Gp110, which comprises an uncharacterized domain of unknown function (DUF3380; pfam11860) in its C terminus and shows a higher specific activity (34,240 U/µM) than that of 14 previously characterized endolysins active against peptidoglycan from Gram-negative bacteria (corresponding to 1.7- to 364-fold higher activity). Gp110 is a modular endolysin with an optimal pH of enzymatic activity of pH 8 and elevated thermal resistance. Reverse-phase high-performance liquid chromatography (RP-HPLC) analysis coupled to mass spectrometry showed that DUF3380 has N-acetylmuramidase (lysozyme) activity cleaving the ß-(1,4) glycosidic bond between N-acetylmuramic acid and N-acetylglucosamine residues. Gp110 is active against directly cross-linked peptidoglycans with various peptide stem compositions, making it an attractive enzyme for developing novel antimicrobial agents. IMPORTANCE: We report the functional and biochemical characterization of the Salmonella phage endolysin Gp110. This endolysin has a modular structure with an enzymatically active domain and a cell wall binding domain. The enzymatic activity of this endolysin exceeds that of all other endolysins previously characterized using the same methods. A domain of unknown function (DUF3380) is responsible for this high enzymatic activity. We report that DUF3380 has N-acetylmuramidase activity against directly cross-linked peptidoglycans with various peptide stem compositions. This experimentally verified activity allows better classification and understanding of the enzymatic activities of endolysins, which mostly are inferred by sequence similarities. Three-dimensional structure predictions for Gp110 suggest a fold that is completely different from that of known structures of enzymes with the same peptidoglycan cleavage specificity, making this endolysin quite unique. All of these features, combined with increased thermal resistance, make Gp110 an attractive candidate for engineering novel endolysin-based antibacterials.

Finding faces, animals, and vehicles in far peripheral vision.

Neuroimaging studies have shown that faces exhibit a central visual field bias, as compared to buildings and scenes. With a saccadic choice task, Crouzet, Kirchner, and Thorpe (2010) demonstrated a speed advantage for the detection of faces with stimuli located 8° from fixation. We used the same paradigm to examine whether the face advantage, relative to other categories (animals and vehicles), extends across the whole visual field (from 10° to 80° eccentricity) or whether it is limited to the central visual field. Pairs of photographs of natural scenes (a target and a distractor) were displayed simultaneously left and right of central fixation for 1s on a panoramic screen. Participants were asked to saccade to a target stimulus (faces, animals, or vehicles). The distractors were images corresponding to the two other categories. Eye movements were recorded with a head-mounted eye tracker. Only the first saccade was measured. Experiment 1 showed that (a) in terms of speed of categorization, faces maintain their advantage over animals and vehicles across the whole visual field, up to 80° and (b) even in crowded conditions (an object embedded in a scene), performance was above chance for the three categories of stimuli at 80° eccentricity. Experiment 2 showed that, when compared to another category with a high degree of within category structural similarity (cars), faces keep their advantage at all eccentricities. These results suggest that the bias for faces is not limited to the central visual field, at least in a categorization task.

At 120 msec you can spot the animal but you don't yet know it's a dog.

Earlier studies suggested that the visual system processes information at the basic level (e.g., dog) faster than at the subordinate (e.g., Dalmatian) or superordinate (e.g., animals) levels. However, the advantage of the basic category over the superordinate category in object recognition has been challenged recently, and the hierarchical nature of visual categorization is now a matter of debate. To address this issue, we used a forced-choice saccadic task in which a target and a distractor image were displayed simultaneously on each trial and participants had to saccade as fast as possible toward the image containing animal targets based on different categorization levels. This protocol enables us to investigate the first 100-120 msec, a previously unexplored temporal window, of visual object categorization. The first result is a surprising stability of the saccade latency (median RT ∼ 155 msec) regardless of the animal target category and the dissimilarity of target and distractor image sets. Accuracy was high (around 80% correct) for categorization tasks that can be solved at the superordinate level but dropped to almost chance levels for basic level categorization. At the basic level, the highest accuracy (62%) was obtained when distractors were restricted to another dissimilar basic category. Computational simulations based on the saliency map model showed that the results could not be predicted by pure bottom-up saliency differences between images. Our results support a model of visual recognition in which the visual system can rapidly access relatively coarse visual representations that provide information at the superordinate level of an object, but where additional visual analysis is required to allow more detailed categorization at the basic level.

Auditory gist: recognition of very short sounds from timbre cues.

Sounds such as the voice or musical instruments can be recognized on the basis of timbre alone. Here, sound recognition was investigated with severely reduced timbre cues. Short snippets of naturally recorded sounds were extracted from a large corpus. Listeners were asked to report a target category (e.g., sung voices) among other sounds (e.g., musical instruments). All sound categories covered the same pitch range, so the task had to be solved on timbre cues alone. The minimum duration for which performance was above chance was found to be short, on the order of a few milliseconds, with the best performance for voice targets. Performance was independent of pitch and was maintained when stimuli contained less than a full waveform cycle. Recognition was not generally better when the sound snippets were time-aligned with the sound onset compared to when they were extracted with a random starting time. Finally, performance did not depend on feedback or training, suggesting that the cues used by listeners in the artificial gating task were similar to those relevant for longer, more familiar sounds. The results show that timbre cues for sound recognition are available at a variety of time scales, including very short ones.

Processing of short auditory stimuli: the rapid audio sequential presentation paradigm (RASP).

Human listeners seem to be remarkably able to recognise acoustic sound sources based on timbre cues. Here we describe a psychophysical paradigm to estimate the time it takes to recognise a set of complex sounds differing only in timbre cues: both in terms of the minimum duration of the sounds and the inferred neural processing time. Listeners had to respond to the human voice while ignoring a set of distractors. All sounds were recorded from natural sources over the same pitch range and equalised to the same duration and power. In a first experiment, stimuli were gated in time with a raised-cosine window of variable duration and random onset time. A voice/non-voice (yes/no) task was used. Performance, as measured by d', remained above chance for the shortest sounds tested (2 ms); d's above 1 were observed for durations longer than or equal to 8 ms. Then, we constructed sequences of short sounds presented in rapid succession. Listeners were asked to report the presence of a single voice token that could occur at a random position within the sequence. This method is analogous to the "rapid sequential visual presentation" paradigm (RSVP), which has been used to evaluate neural processing time for images. For 500-ms sequences made of 32-ms and 16-ms sounds, d' remained above chance for presentation rates of up to 30 sounds per second. There was no effect of the pitch relation between successive sounds: identical for all sounds in the sequence or random for each sound. This implies that the task was not determined by streaming or forward masking, as both phenomena would predict better performance for the random pitch condition. Overall, the recognition of familiar sound categories such as the voice seems to be surprisingly fast, both in terms of the acoustic duration required and of the underlying neural time constants.

Online spike-based recognition of digits with ultrafast microlaser neurons.

Classification and recognition tasks performed on photonic hardware-based neural networks often require at least one offline computational step, such as in the increasingly popular reservoir computing paradigm. Removing this offline step can significantly improve the response time and energy efficiency of such systems. We present numerical simulations of different algorithms that utilize ultrafast photonic spiking neurons as receptive fields to allow for image recognition without an offline computing step. In particular, we discuss the merits of event, spike-time and rank-order based algorithms adapted to this system. These techniques have the potential to significantly improve the efficiency and effectiveness of optical classification systems, minimizing the number of spiking nodes required for a given task and leveraging the parallelism offered by photonic hardware.

The lysozyme-induced peptidoglycan N-acetylglucosamine deacetylase PgdA (EF1843) is required for Enterococcus faecalis virulence.

Lysozyme is a key component of the innate immune response in humans that provides a first line of defense against microbes. The bactericidal effect of lysozyme relies both on the cell wall lytic activity of this enzyme and on a cationic antimicrobial peptide activity that leads to membrane permeabilization. Among Gram-positive bacteria, the opportunistic pathogen Enterococcus faecalis has been shown to be extremely resistant to lysozyme. This unusual resistance is explained partly by peptidoglycan O-acetylation, which inhibits the enzymatic activity of lysozyme, and partly by d-alanylation of teichoic acids, which is likely to inhibit binding of lysozyme to the bacterial cell wall. Surprisingly, combined mutations abolishing both peptidoglycan O-acetylation and teichoic acid alanylation are not sufficient to confer lysozyme susceptibility. In this work, we identify another mechanism involved in E. faecalis lysozyme resistance. We show that exposure to lysozyme triggers the expression of EF1843, a protein that is not detected under normal growth conditions. Analysis of peptidoglycan structure from strains with EF1843 loss- and gain-of-function mutations, together with in vitro assays using recombinant protein, showed that EF1843 is a peptidoglycan N-acetylglucosamine deacetylase. EF1843-mediated peptidoglycan deacetylation was shown to contribute to lysozyme resistance by inhibiting both lysozyme enzymatic activity and, to a lesser extent, lysozyme cationic antimicrobial activity. Finally, EF1843 mutation was shown to reduce the ability of E. faecalis to cause lethality in the Galleria mellonella infection model. Taken together, our results reveal that peptidoglycan deacetylation is a component of the arsenal that enables E. faecalis to thrive inside mammalian hosts, as both a commensal and a pathogen.

Crystallization and preliminary X-ray analysis of the receiver domain of a putative response regulator, BPSL0128, from Burkholderia pseudomallei.

bpsl0128, a gene encoding a putative response regulator from Burkholderia pseudomallei strain D286, has been cloned into a pETBLUE-1 vector system, overexpressed in Escherichia coli and purified. The full-length protein is degraded during purification to leave a fragment corresponding to the putative receiver domain, and crystals of this protein that diffracted to beyond 1.75 Šresolution have been grown by the hanging-drop vapour-diffusion technique using PEG 6000 as the precipitant. The crystals belonged to one of the enantiomorphic pair of space groups P3(1)21 and P3(2)21, with unit-cell parameters a = b = 65.69, c = 105.01 Šand either one or two molecules in the asymmetric unit.

Fast recognition of musical sounds based on timbre.

Human listeners seem to have an impressive ability to recognize a wide variety of natural sounds. However, there is surprisingly little quantitative evidence to characterize this fundamental ability. Here the speed and accuracy of musical-sound recognition were measured psychophysically with a rich but acoustically balanced stimulus set. The set comprised recordings of notes from musical instruments and sung vowels. In a first experiment, reaction times were collected for three target categories: voice, percussion, and strings. In a go/no-go task, listeners reacted as quickly as possible to members of a target category while withholding responses to distractors (a diverse set of musical instruments). Results showed near-perfect accuracy and fast reaction times, particularly for voices. In a second experiment, voices were recognized among strings and vice-versa. Again, reaction times to voices were faster. In a third experiment, auditory chimeras were created to retain only spectral or temporal features of the voice. Chimeras were recognized accurately, but not as quickly as natural voices. Altogether, the data suggest rapid and accurate neural mechanisms for musical-sound recognition based on selectivity to complex spectro-temporal signatures of sound sources.

The fate of visual long term memories for images across weeks in adults and children.

What is the content and the format of visual memories in Long Term Memory (LTM)? Is it similar in adults and children? To address these issues, we investigated, in both adults and 9-year-old children, how visual LTM is affected over time and whether visual vs semantic features are affected differentially. In a learning phase, participants were exposed to hundreds of meaningless and meaningful images presented once or twice for either 120 ms or 1920 ms. Memory was assessed using a recognition task either immediately after learning or after a delay of three or six weeks. The results suggest that multiple and extended exposures are crucial for retaining an image for several weeks. Although a benefit was observed in the meaningful condition when memory was assessed immediately after learning, this benefit tended to disappear over weeks, especially when the images were presented twice for 1920 ms. This pattern was observed for both adults and children. Together, the results call into question the dominant models of LTM for images: although semantic information enhances the encoding & maintaining of images in LTM when assessed immediately, this seems not critical for LTM over weeks.

Analyzing time-to-first-spike coding schemes: A theoretical approach.

Spiking neural networks (SNNs) using time-to-first-spike (TTFS) codes, in which neurons fire at most once, are appealing for rapid and low power processing. In this theoretical paper, we focus on information coding and decoding in those networks, and introduce a new unifying mathematical framework that allows the comparison of various coding schemes. In an early proposal, called rank-order coding (ROC), neurons are maximally activated when inputs arrive in the order of their synaptic weights, thanks to a shunting inhibition mechanism that progressively desensitizes the neurons as spikes arrive. In another proposal, called NoM coding, only the first N spikes of M input neurons are propagated, and these "first spike patterns" can be readout by downstream neurons with homogeneous weights and no desensitization: as a result, the exact order between the first spikes does not matter. This paper also introduces a third option-"Ranked-NoM" (R-NoM), which combines features from both ROC and NoM coding schemes: only the first N input spikes are propagated, but their order is readout by downstream neurons thanks to inhomogeneous weights and linear desensitization. The unifying mathematical framework allows the three codes to be compared in terms of discriminability, which measures to what extent a neuron responds more strongly to its preferred input spike pattern than to random patterns. This discriminability turns out to be much higher for R-NoM than for the other codes, especially in the early phase of the responses. We also argue that R-NoM is much more hardware-friendly than the original ROC proposal, although NoM remains the easiest to implement in hardware because it only requires binary synapses.

First Profile of Phenolic Compounds from Maltese Extra Virgin Olive Oils Using Liquid-Liquid Extraction and Liquid Chromatography-Mass Spectrometry.

This study presents the profile of phenolic extracts from different Extra Virgin Olive Oils (EVOOs) from Malta and is the first study that characterizes the phenolic profile of the Maltese EVOOs Bidni (B) and Malti (M) using liquid-liquid extraction (LLE) and Liquid Chromatography-Mass Spectrometry (LC-MS). The total phenolic content (TPC), ortho diphenolic content (TdPC) and flavonoid content (TFC) were determined using the Folin-Ciocalteau assay, the Arnow's assay and the Aluminium Chloride method respectively. Results show that the B variety had the highest TPC, TdPC and TFC. Using LC-MS analysis, over 30 phenolic compounds were identified belonging to different classes of phenolic compounds.

Oscillations, phase-of-firing coding, and spike timing-dependent plasticity: an efficient learning scheme.

Recent experiments have established that information can be encoded in the spike times of neurons relative to the phase of a background oscillation in the local field potential-a phenomenon referred to as "phase-of-firing coding" (PoFC). These firing phase preferences could result from combining an oscillation in the input current with a stimulus-dependent static component that would produce the variations in preferred phase, but it remains unclear whether these phases are an epiphenomenon or really affect neuronal interactions-only then could they have a functional role. Here we show that PoFC has a major impact on downstream learning and decoding with the now well established spike timing-dependent plasticity (STDP). To be precise, we demonstrate with simulations how a single neuron equipped with STDP robustly detects a pattern of input currents automatically encoded in the phases of a subset of its afferents, and repeating at random intervals. Remarkably, learning is possible even when only a small fraction of the afferents ( approximately 10%) exhibits PoFC. The ability of STDP to detect repeating patterns had been noted before in continuous activity, but it turns out that oscillations greatly facilitate learning. A benchmark with more conventional rate-based codes demonstrates the superiority of oscillations and PoFC for both STDP-based learning and the speed of decoding: the oscillation partially formats the input spike times, so that they mainly depend on the current input currents, and can be efficiently learned by STDP and then recognized in just one oscillation cycle. This suggests a major functional role for oscillatory brain activity that has been widely reported experimentally.

Ultra-rapid sensory responses in the human frontal eye field region.

Most of what we know about the human frontal eye field (FEF) is extrapolated from studies in animals. There is ample evidence that this region is crucial for eye movements. However, evidence is accumulating that this region also plays a role in sensory processing and that it belongs to a "fast brain" system. We set out to investigate these issues in humans, using intracerebral recordings in patients with drug-refractory epilepsy. Event-related potential recordings were obtained from 11 epileptic patients from within the FEF region while they passed a series of visual and auditory perceptual tests. No eye movement was required. Ultra-rapid responses were observed, with mean onset latencies at 24 ms after stimulus to auditory stimuli and 45 ms to visual stimuli. Such early responses were compatible with cortical routes as assessed with simultaneous recordings in primary auditory and visual cortices. Components were modulated very early by the sensory characteristics of the stimuli, in the 30-60 ms period for auditory stimuli and in the 45-60 ms period for visual stimuli. Although the frontal lobes in humans are generally viewed as being involved in high-level cognitive processes, these results indicate that the human FEF is a remarkably quickly activated multimodal region that belongs to a network of low-level neocortical sensory areas.

Fast saccades toward faces: face detection in just 100 ms.

Previous work has demonstrated that the human visual system can detect animals in complex natural scenes very efficiently and rapidly. In particular, using a saccadic choice task, H. Kirchner and S. J. Thorpe (2006) found that when two images are simultaneously flashed in the left and right visual fields, saccades toward the side with an animal can be initiated in as little as 120-130 ms. Here we show that saccades toward human faces are even faster, with the earliest reliable saccades occurring in just 100-110 ms, and mean reaction times of roughly 140 ms. Intriguingly, it appears that these very fast saccades are not completely under instructional control, because when faces were paired with photographs of vehicles, fast saccades were still biased toward faces even when the subject was targeting vehicles. Finally, we tested whether these very fast saccades might only occur in the simple case where the images are presented left and right of fixation by showing they also occur when the images are presented above and below fixation. Such results impose very serious constraints on the sorts of processing model that can be invoked and demonstrate that face-selective behavioral responses can be generated extremely rapidly.

Stimulus Onset Hub: an Open-Source, Low Latency, and Opto-Isolated Trigger Box for Neuroscientific Research Replicability and Beyond.

Accurate stimulus onset timing is critical to almost all behavioral research. Auditory, visual, or manual response time stimulus onsets are typically sent through wires to various machines that record data such as: eye gaze positions, electroencephalography, stereo electroencephalography, and electrocorticography. These stimulus onsets are collated and analyzed according to experimental condition. If there is variability in the temporal accuracy of the delivery of these onsets to external systems, the quality of the resulting data and scientific analyses will degrade. Here, we describe an approximately 200 dollar Arduino based system and associated open-source codebase that achieved a maximum of 4 microseconds of delay from the inputs to the outputs while electrically opto-isolating the connected external systems. Using an oscilloscope, the device is configurable for the different environmental conditions particular to each laboratory (e.g., light sensor type, screen type, speaker type, stimulus type, temperature, etc). This low-cost open-source project delivered electrically isolated digital stimulus onset Transistor-Transistor Logic triggers with an input/output delay of 4 µs, and was successfully tested with seven different external systems that record eye and neurological data.