Electrophysiological Signatures of Visual Recognition Memory across All Layers of Mouse V1.

In mouse primary visual cortex (V1), familiar stimuli evoke significantly altered responses when compared with novel stimuli. This stimulus-selective response plasticity (SRP) was described originally as an increase in the magnitude of visual evoked potentials (VEPs) elicited in layer 4 (L4) by familiar phase-reversing grating stimuli. SRP is dependent on NMDA receptors (NMDARs) and has been hypothesized to reflect potentiation of thalamocortical (TC) synapses in L4. However, recent evidence indicates that the synaptic modifications that manifest as SRP do not occur on L4 principal cells. To shed light on where and how SRP is induced and expressed in male and female mice, the present study had three related aims: (1) to confirm that NMDAR are required specifically in glutamatergic principal neurons of V1, (2) to investigate the consequences of deleting NMDAR specifically in L6, and (3) to use translaminar electrophysiological recordings to characterize SRP expression in different layers of V1. We find that knock-out (KO) of NMDAR in L6 principal neurons disrupts SRP. Current-source density (CSD) analysis of the VEP depth profile shows augmentation of short latency current sinks in layers 3, 4, and 6 in response to phase reversals of familiar stimuli. Multiunit recordings demonstrate that increased peak firing occurs in response to phase reversals of familiar stimuli across all layers, but that activity between phase reversals is suppressed. Together, these data reveal important aspects of the underlying phenomenology of SRP and generate new hypotheses for the expression of experience-dependent plasticity in V1.SIGNIFICANCE STATEMENT Repeated exposure to stimuli that portend neither reward nor punishment leads to behavioral habituation, enabling organisms to dedicate attention to novel or otherwise significant features of the environment. The neural basis of this process, which is so often dysregulated in neurologic and psychiatric disorders, remains poorly understood. Learning and memory of stimulus familiarity can be studied in mouse visual cortex by measuring electrophysiological responses to simple phase-reversing grating stimuli. The current study advances knowledge of this process by documenting changes in visual evoked potentials (VEPs), neuronal spiking activity, and oscillations in the local field potentials (LFPs) across all layers of mouse visual cortex. In addition, we identify a key contribution of a specific population of neurons in layer 6 (L6) of visual cortex.

Machine learning based DNA melt curve profiling enables automated novel genotype detection.

Surveillance for genetic variation of microbial pathogens, both within and among species, plays an important role in informing research, diagnostic, prevention, and treatment activities for disease control. However, large-scale systematic screening for novel genotypes remains challenging in part due to technological limitations. Towards addressing this challenge, we present an advancement in universal microbial high resolution melting (HRM) analysis that is capable of accomplishing both known genotype identification and novel genotype detection. Specifically, this novel surveillance functionality is achieved through time-series modeling of sequence-defined HRM curves, which is uniquely enabled by the large-scale melt curve datasets generated using our high-throughput digital HRM platform. Taking the detection of bacterial genotypes as a model application, we demonstrate that our algorithms accomplish an overall classification accuracy over 99.7% and perform novelty detection with a sensitivity of 0.96, specificity of 0.96 and Youden index of 0.92. Since HRM-based DNA profiling is an inexpensive and rapid technique, our results add support for the feasibility of its use in surveillance applications.

Prototyping a Secure and Usable User Authentication Mechanism for Mobile Passenger ID Devices for Land/Sea Border Control.

As the number of European Union (EU) visitors grows, implementing novel border control solutions, such as mobile devices for passenger identification for land and sea border control, becomes paramount to ensure the convenience and safety of passengers and officers. However, these devices, handling sensitive personal data, become attractive targets for malicious actors seeking to misuse or steal such data. Therefore, to increase the level of security of such devices without interrupting border control activities, robust user authentication mechanisms are essential. Toward this direction, we propose a risk-based adaptive user authentication mechanism for mobile passenger identification devices for land and sea border control, aiming to enhance device security without hindering usability. In this work, we present a comprehensive assessment of novelty and outlier detection algorithms and discern OneClassSVM, Local Outlier Factor (LOF), and Bayesian_GaussianMixtureModel (B_GMM) novelty detection algorithms as the most effective ones for risk estimation in the proposed mechanism. Furthermore, in this work, we develop the proposed risk-based adaptive user authentication mechanism as an application on a Raspberry Pi 4 Model B device (i.e., playing the role of the mobile device for passenger identification), where we evaluate the detection performance of the three best performing novelty detection algorithms (i.e., OneClassSVM, LOF, and B_GMM), with B_GMM surpassing the others in performance when deployed on the Raspberry Pi 4 device. Finally, we evaluate the risk estimation overhead of the proposed mechanism when the best performing B_GMM novelty detection algorithm is used for risk estimation, indicating efficient operation with minimal additional latency.

Enabling Seamless Connectivity: Networking Innovations in Wireless Sensor Networks for Industrial Application.

The wide-ranging applications of the Internet of Things (IoT) show that it has the potential to revolutionise industry, improve daily life, and overcome global challenges. This study aims to evaluate the performance scalability of mature industrial wireless sensor networks (IWSNs). A new classification approach for IoT in the industrial sector is proposed based on multiple factors and we introduce the integration of 6LoWPAN (IPv6 over low-power wireless personal area networks), message queuing telemetry transport for sensor networks (MQTT-SN), and ContikiMAC protocols for sensor nodes in an industrial IoT system to improve energy-efficient connectivity. The Contiki COOJA WSN simulator was applied to model and simulate the performance of the protocols in two static and moving scenarios and evaluate the proposed novelty detection system (NDS) for network intrusions in order to identify certain events in real time for realistic dataset analysis. The simulation results show that our method is an essential measure in determining the number of transmissions required to achieve a certain reliability target in an IWSNs. Despite the growing demand for low-power operation, deterministic communication, and end-to-end reliability, our methodology of an innovative sensor design using selective surface activation induced by laser (SSAIL) technology was developed and deployed in the FTMC premises to demonstrate its long-term functionality and reliability. The proposed framework was experimentally validated and tested through simulations to demonstrate the applicability and suitability of the proposed approach. The energy efficiency in the optimised WSN was increased by 50%, battery life was extended by 350%, duplicated packets were reduced by 80%, data collisions were reduced by 80%, and it was shown that the proposed methodology and tools could be used effectively in the development of telemetry node networks in new industrial projects in order to detect events and breaches in IoT networks accurately. The energy consumption of the developed sensor nodes was measured. Overall, this study performed a comprehensive assessment of the challenges of industrial processes, such as the reliability and stability of telemetry channels, the energy efficiency of autonomous nodes, and the minimisation of duplicate information transmission in IWSNs.

Longitudinal fNIRS and EEG metrics of habituation and novelty detection are correlated in 1-18-month-old infants.

INTRODUCTION: Habituation and novelty detection are two fundamental and widely studied neurocognitive processes. Whilst neural responses to repetitive and novel sensory input have been well-documented across a range of neuroimaging modalities, it is not yet fully understood how well these different modalities are able to describe consistent neural response patterns. This is particularly true for infants and young children, as different assessment modalities might show differential sensitivity to underlying neural processes across age. Thus far, many neurodevelopmental studies are limited in either sample size, longitudinal scope or breadth of measures employed, impeding investigations of how well common developmental trends can be captured via different methods. METHOD: This study assessed habituation and novelty detection in N = 204 infants using EEG and fNIRS measured in two separate paradigms, but within the same study visit, at 1, 5 and 18 months of age in an infant cohort in rural Gambia. EEG was acquired during an auditory oddball paradigm during which infants were presented with Frequent, Infrequent and Trial Unique sounds. In the fNIRS paradigm, infants were familiarised to a sentence of infant-directed speech, novelty detection was assessed via a change in speaker. Indices for habituation and novelty detection were extracted for both EEG and NIRS RESULTS: We found evidence for weak to medium positive correlations between responses on the fNIRS and the EEG paradigms for indices of both habituation and novelty detection at most age points. Habituation indices correlated across modalities at 1 month and 5 months but not 18 months of age, and novelty responses were significantly correlated at 5 months and 18 months, but not at 1 month. Infants who showed robust habituation responses also showed robust novelty responses across both assessment modalities. DISCUSSION: This study is the first to examine concurrent correlations across two neuroimaging modalities across several longitudinal age points. Examining habituation and novelty detection, we show that despite the use of two different testing modalities, stimuli and timescale, it is possible to extract common neural metrics across a wide age range in infants. We suggest that these positive correlations might be strongest at times of greatest developmental change.

NORHA: A NORmal Hippocampal Asymmetry Deviation Index Based on One-Class Novelty Detection and 3D Shape Features.

Radiologists routinely analyze hippocampal asymmetries in magnetic resonance (MR) images as a biomarker for neurodegenerative conditions like epilepsy and Alzheimer's Disease. However, current clinical tools rely on either subjective evaluations, basic volume measurements, or disease-specific models that fail to capture more complex differences in normal shape. In this paper, we overcome these limitations by introducing NORHA, a novel NORmal Hippocampal Asymmetry deviation index that uses machine learning novelty detection to objectively quantify it from MR scans. NORHA is based on a One-Class Support Vector Machine model learned from a set of morphological features extracted from automatically segmented hippocampi of healthy subjects. Hence, in test time, the model automatically measures how far a new unseen sample falls with respect to the feature space of normal individuals. This avoids biases produced by standard classification models, which require being trained using diseased cases and therefore learning to characterize changes produced only by the ones. We evaluated our new index in multiple clinical use cases using public and private MRI datasets comprising control individuals and subjects with different levels of dementia or epilepsy. The index reported high values for subjects with unilateral atrophies and remained low for controls or individuals with mild or severe symmetric bilateral changes. It also showed high AUC values for discriminating individuals with hippocampal sclerosis, further emphasizing its ability to characterize unilateral abnormalities. Finally, a positive correlation between NORHA and the functional cognitive test CDR-SB was observed, highlighting its promising application as a biomarker for dementia.

Power Disturbance Monitoring through Techniques for Novelty Detection on Wind Power and Photovoltaic Generation.

Novelty detection is a statistical method that verifies new or unknown data, determines whether these data are inliers (within the norm) or outliers (outside the norm), and can be used, for example, in developing classification strategies in machine learning systems for industrial applications. To this end, two types of energy that have evolved over time are solar photovoltaic and wind power generation. Some organizations around the world have developed energy quality standards to avoid known electric disturbances; however, their detection is still a challenge. In this work, several techniques for novelty detection are implemented to detect different electric anomalies (disturbances), which are k-nearest neighbors, Gaussian mixture models, one-class support vector machines, self-organizing maps, stacked autoencoders, and isolation forests. These techniques are applied to signals from real power quality environments of renewable energy systems such as solar photovoltaic and wind power generation. The power disturbances that will be analyzed are considered in the standard IEEE-1159, such as sag, oscillatory transient, flicker, and a condition outside the standard attributed to meteorological conditions. The contribution of the work consists of the development of a methodology based on six techniques for novelty detection of power disturbances, under known and unknown conditions, over real signals in the power quality assessment. The merit of the methodology is a set of techniques that allow to obtain the best performance of each one under different conditions, which constitutes an important contribution to the renewable energy systems.

A Lightweight Intelligent Network Intrusion Detection System Using One-Class Autoencoder and Ensemble Learning for IoT.

Network intrusion detection technology is key to cybersecurity regarding the Internet of Things (IoT). The traditional intrusion detection system targeting Binary or Multi-Classification can detect known attacks, but it is difficult to resist unknown attacks (such as zero-day attacks). Unknown attacks require security experts to confirm and retrain the model, but new models do not keep up to date. This paper proposes a Lightweight Intelligent NIDS using a One-Class Bidirectional GRU Autoencoder and Ensemble Learning. It can not only accurately identify normal and abnormal data, but also identify unknown attacks as the type most similar to known attacks. First, a One-Class Classification model based on a Bidirectional GRU Autoencoder is introduced. This model is trained with normal data, and has high prediction accuracy in the case of abnormal data and unknown attack data. Second, a multi-classification recognition method based on ensemble learning is proposed. It uses Soft Voting to evaluate the results of various base classifiers, and identify unknown attacks (novelty data) as the type most similar to known attacks, so that exception classification becomes more accurate. Experiments are conducted on WSN-DS, UNSW-NB15, and KDD CUP99 datasets, and the recognition rates of the proposed models in the three datasets are raised to 97.91%, 98.92%, and 98.23% respectively. The results verify the feasibility, efficiency, and portability of the algorithm proposed in the paper.

Unsupervised Learning Methods for Data-Driven Vibration-Based Structural Health Monitoring: A Review.

Structural damage detection using unsupervised learning methods has been a trending topic in the structural health monitoring (SHM) research community during the past decades. In the context of SHM, unsupervised learning methods rely only on data acquired from intact structures for training the statistical models. Consequently, they are often seen as more practical than their supervised counterpart in implementing an early-warning damage detection system in civil structures. In this article, we review publications on data-driven structural health monitoring from the last decade that relies on unsupervised learning methods with a focus on real-world application and practicality. Novelty detection using vibration data is by far the most common approach for unsupervised learning SHM and is, therefore, given more attention in this article. Following a brief introduction, we present the state-of-the-art studies in unsupervised-learning SHM, categorized by the types of used machine-learning methods. We then examine the benchmarks that are commonly used to validate unsupervised-learning SHM methods. We also discuss the main challenges and limitations in the existing literature that make it difficult to translate SHM methods from research to practical applications. Accordingly, we outline the current knowledge gaps and provide recommendations for future directions to assist researchers in developing more reliable SHM methods.

Deficient Novelty Detection and Encoding in Early Alzheimer's Disease: An ERP Study.

Patients with early Alzheimer's disease (AD) have difficulty in learning new information and in detecting novel stimuli. The underlying physiological mechanisms are not well known. We investigated the electrophysiological correlates of the early (< 400 ms), automatic phase of novelty detection and encoding in AD. We used high-density EEG Queryin patients with early AD and healthy age-matched controls who performed a continuous recognition task (CRT) involving new stimuli (New), thought to provoke novelty detection and encoding, which were then repeated up to 4 consecutive times to produce over-familiarity with the stimuli. Stimuli then reappeared after 9-15 intervening items (N-back) to be re-encoded. AD patients had substantial difficulty in detecting novel stimuli and recognizing repeated ones. Main evoked potential differences between repeated and new stimuli emerged at 180-260 ms: neural source estimations in controls revealed more extended MTL activation for N-back stimuli and anterior temporal lobe activations for New stimuli compared to highly familiar repetitions. In contrast, AD patients exhibited no activation differences between the three stimulus types. In direct comparison, healthy subjects had significantly stronger MTL activation in response to New and N-back stimuli than AD patients. These results point to abnormally weak early MTL activity as a correlate of deficient novelty detection and encoding in early AD.

Fast and Efficient Image Novelty Detection Based on Mean-Shifts.

Image novelty detection is a repeating task in computer vision and describes the detection of anomalous images based on a training dataset consisting solely of normal reference data. It has been found that, in particular, neural networks are well-suited for the task. Our approach first transforms the training and test images into ensembles of patches, which enables the assessment of mean-shifts between normal data and outliers. As mean-shifts are only detectable when the outlier ensemble and inlier distribution are spatially separate from each other, a rich feature space, such as a pre-trained neural network, needs to be chosen to represent the extracted patches. For mean-shift estimation, the Hotelling T2 test is used. The size of the patches turned out to be a crucial hyperparameter that needs additional domain knowledge about the spatial size of the expected anomalies (local vs. global). This also affects model selection and the chosen feature space, as commonly used Convolutional Neural Networks or Vision Image Transformers have very different receptive field sizes. To showcase the state-of-the-art capabilities of our approach, we compare results with classical and deep learning methods on the popular dataset CIFAR-10, and demonstrate its real-world applicability in a large-scale industrial inspection scenario using the MVTec dataset. Because of the inexpensive design, our method can be implemented by a single additional 2D-convolution and pooling layer and allows particularly fast prediction times while being very data-efficient.

Incremental Learning of Human Activities in Smart Homes.

Sensor-based human activity recognition has been extensively studied. Systems learn from a set of training samples to classify actions into a pre-defined set of ground truth activities. However, human behaviours vary over time, and so a recognition system should ideally be able to continuously learn and adapt, while retaining the knowledge of previously learned activities, and without failing to highlight novel, and therefore potentially risky, behaviours. In this paper, we propose a method based on compression that can incrementally learn new behaviours, while retaining prior knowledge. Evaluation was conducted on three publicly available smart home datasets.

Hierarchical Novelty Detection for Traffic Sign Recognition.

Recent works have made significant progress in novelty detection, i.e., the problem of detecting samples of novel classes, never seen during training, while classifying those that belong to known classes. However, the only information this task provides about novel samples is that they are unknown. In this work, we leverage hierarchical taxonomies of classes to provide informative outputs for samples of novel classes. We predict their closest class in the taxonomy, i.e., its parent class. We address this problem, known as hierarchical novelty detection, by proposing a novel loss, namely Hierarchical Cosine Loss that is designed to learn class prototypes along with an embedding of discriminative features consistent with the taxonomy. We apply it to traffic sign recognition, where we predict the parent class semantics for new types of traffic signs. Our model beats state-of-the art approaches on two large scale traffic sign benchmarks, Mapillary Traffic Sign Dataset (MTSD) and Tsinghua-Tencent 100K (TT100K), and performs similarly on natural images benchmarks (AWA2, CUB). For TT100K and MTSD, our approach is able to detect novel samples at the correct nodes of the hierarchy with 81% and 36% of accuracy, respectively, at 80% known class accuracy.

Current Only-Based Fault Diagnosis Method for Industrial Robot Control Cables.

With the growth of factory automation, deep learning-based methods have become popular diagnostic tools because they can extract features automatically and diagnose faults under various fault conditions. Among these methods, a novelty detection approach is useful if the fault dataset is imbalanced and impossible reproduce perfectly in a laboratory. This study proposes a novelty detection-based soft fault-diagnosis method for control cables using only currents flowing through the cables. The proposed algorithm uses three-phase currents to calculate the sum and ratios of currents, which are used as inputs to the diagnosis network to detect novelties caused by soft faults. Autoencoder architecture is adopted to detect novelties and calculate anomaly scores for the inputs. Applying a moving average filter to anomaly scores, a threshold is defined, by which soft faults can be properly diagnosed under environmental disturbances. The proposed method is evaluated in 11 fault scenarios. The datasets for each scenario are collected when an industrial robot is working. To induce soft fault conditions, the conductor and its insulator in the cable are damaged gradually according to the scenarios. Experiments demonstrate that the proposed method accurately diagnoses soft faults under various operating conditions and degrees of fault severity.

Combined Use of Cointegration Analysis and Robust Outlier Statistics to Improve Damage Detection in Real-World Structures.

Due to the need for controlling many ageing and complex structures, structural health monitoring (SHM) has become increasingly common over the past few decades. However, one of the main limitations for the implementation of continuous monitoring systems in real-world structures is the effect that benign influences, such as environmental and operational variations (EOVs), have on damage sensitive features. These fluctuations may mask malign changes caused by structural damages, resulting in false structural condition assessment. When damage identification is implemented as novelty detection due to the lack of known damage states, outliers may be part of the data set as the result of the benign and malign factors mentioned above. Thanks to the developments in the field of robust outlier detection, the current paper presents a new data fusion method based on the use of cointegration and minimum covariance determinant estimator (MCD), which allows us to visualize and to classify outliers in SHM data, depending on their origin. To validate the effectiveness of this technique, the recent case study of the KW51 bridge has been considered, whose natural frequencies are subjected to variations due to both EOVs and a real structural change.

Novelty Detection in Memory for Common and Uncommon Odors over Short Delays.

Odor memory is commonly believed to be very strong and long-lasting. The present study examined factors that impact odor recognition memory over short delay intervals (immediately or 30 s after target presentation) with emphasis on memory task (forced-choice vs "monadic"/single stimulus yes/no), odor category, and target/foil relationship. We explored trial-by-trial confidence as well as the effect of target familiarity, pleasantness, and intensity ratings, and odor nameability on memory for odors. Overall odor recognition memory in terms of proportion correct and sensitivity measures did not decline significantly during the 30-s delay interval in either task. However, hit rates were lower at 30 s and correct rejection rates for common odors remained consistently high. Recognition memory was better on trials in which the odor pairs were highly dissimilar, as well as on trials in which the target was an uncommon odor, particularly if it could be named. Familiarity, pleasantness, and intensity had no systematic effect on recognition memory. Whereas the results provide evidence of a fading memory trace, indicated by the decreased hit rates after a 30-s delay, the constant rates of correct rejections and high confidence ratings on those trials, even after delay, suggests that novelty detection (i.e., recognition that an odor is not one that has been encountered previously in that context) may play an important role in the memory for odors over short delays. Whether there is a separate short-term odor memory store is also addressed.

A neural data structure for novelty detection.

Novelty detection is a fundamental biological problem that organisms must solve to determine whether a given stimulus departs from those previously experienced. In computer science, this problem is solved efficiently using a data structure called a Bloom filter. We found that the fruit fly olfactory circuit evolved a variant of a Bloom filter to assess the novelty of odors. Compared with a traditional Bloom filter, the fly adjusts novelty responses based on two additional features: the similarity of an odor to previously experienced odors and the time elapsed since the odor was last experienced. We elaborate and validate a framework to predict novelty responses of fruit flies to given pairs of odors. We also translate insights from the fly circuit to develop a class of distance- and time-sensitive Bloom filters that outperform prior filters when evaluated on several biological and computational datasets. Overall, our work illuminates the algorithmic basis of an important neurobiological problem and offers strategies for novelty detection in computational systems.

Comparison of Novelty Detection Methods for Detection of Various Rotary Machinery Faults.

Condition monitoring is an indispensable element related to the operation of rotating machinery. In this article, the monitoring system for the parallel gearbox was proposed. The novelty detection approach is used to develop the condition assessment support system, which requires data collection for a healthy structure. The measured signals were processed to extract quantitative indicators sensitive to the type of damage occurring in this type of structure. The indicator's values were used for the development of four different novelty detection algorithms. Presented novelty detection models operate on three principles: feature space distance, probability distribution, and input reconstruction. One of the distance-based models is adaptive, adjusting to new data flowing in the form of a stream. The authors test the developed algorithms on experimental and simulation data with a similar distribution, using the training set consisting mainly of samples generated by the simulator. Presented in the article results demonstrate the effectiveness of the trained models on both data sets.

An Incremental Class-Learning Approach with Acoustic Novelty Detection for Acoustic Event Recognition.

Acoustic scene analysis (ASA) relies on the dynamic sensing and understanding of stationary and non-stationary sounds from various events, background noises and human actions with objects. However, the spatio-temporal nature of the sound signals may not be stationary, and novel events may exist that eventually deteriorate the performance of the analysis. In this study, a self-learning-based ASA for acoustic event recognition (AER) is presented to detect and incrementally learn novel acoustic events by tackling catastrophic forgetting. The proposed ASA framework comprises six elements: (1) raw acoustic signal pre-processing, (2) low-level and deep audio feature extraction, (3) acoustic novelty detection (AND), (4) acoustic signal augmentations, (5) incremental class-learning (ICL) (of the audio features of the novel events) and (6) AER. The self-learning on different types of audio features extracted from the acoustic signals of various events occurs without human supervision. For the extraction of deep audio representations, in addition to visual geometry group (VGG) and residual neural network (ResNet), time-delay neural network (TDNN) and TDNN based long short-term memory (TDNN-LSTM) networks are pre-trained using a large-scale audio dataset, Google AudioSet. The performances of ICL with AND using Mel-spectrograms, and deep features with TDNNs, VGG, and ResNet from the Mel-spectrograms are validated on benchmark audio datasets such as ESC-10, ESC-50, UrbanSound8K (US8K), and an audio dataset collected by the authors in a real domestic environment.

Multi-Perspective Anomaly Detection.

Anomaly detection is a critical problem in the manufacturing industry. In many applications, images of objects to be analyzed are captured from multiple perspectives which can be exploited to improve the robustness of anomaly detection. In this work, we build upon the deep support vector data description algorithm and address multi-perspective anomaly detection using three different fusion techniques, i.e., early fusion, late fusion, and late fusion with multiple decoders. We employ different augmentation techniques with a denoising process to deal with scarce one-class data, which further improves the performance (ROC AUC =80%). Furthermore, we introduce the dices dataset, which consists of over 2000 grayscale images of falling dices from multiple perspectives, with 5% of the images containing rare anomalies (e.g., drill holes, sawing, or scratches). We evaluate our approach on the new dices dataset using images from two different perspectives and also benchmark on the standard MNIST dataset. Extensive experiments demonstrate that our proposed multi-perspective approach exceeds the state-of-the-art single-perspective anomaly detection on both the MNIST and dices datasets. To the best of our knowledge, this is the first work that focuses on addressing multi-perspective anomaly detection in images by jointly using different perspectives together with one single objective function for anomaly detection.