Noise-robust text-dependent speaker identification using cochlear models.

One challenging issue in speaker identification (SID) is to achieve noise-robust performance. Humans can accurately identify speakers, even in noisy environments. We can leverage our knowledge of the function and anatomy of the human auditory pathway to design SID systems that achieve better noise-robust performance than conventional approaches. We propose a text-dependent SID system based on a real-time cochlear model called cascade of asymmetric resonators with fast-acting compression (CARFAC). We investigate the SID performance of CARFAC on signals corrupted by noise of various types and levels. We compare its performance with conventional auditory feature generators including mel-frequency cepstrum coefficients, frequency domain linear predictions, as well as another biologically inspired model called the auditory nerve model. We show that CARFAC outperforms other approaches when signals are corrupted by noise. Our results are consistent across datasets, types and levels of noise, different speaking speeds, and back-end classifiers. We show that the noise-robust SID performance of CARFAC is largely due to its nonlinear processing of auditory input signals. Presumably, the human auditory system achieves noise-robust performance via inherent nonlinearities as well.

Low-power transcutaneous current stimulator for wearable applications.

BACKGROUND: Peripheral neuropathic desensitization associated with aging, diabetes, alcoholism and HIV/AIDS, affects tens of millions of people worldwide, and there is little or no treatment available to improve sensory function. Recent studies that apply imperceptible continuous vibration or electrical stimulation have shown promise in improving sensitivity in both diseased and healthy participants. This class of interventions only has an effect during application, necessitating the design of a wearable device for everyday use. We present a circuit that allows for a low-power, low-cost and small form factor implementation of a current stimulator for the continuous application of subthreshold currents. RESULTS: This circuit acts as a voltage-to-current converter and has been tested to drive + 1 to - 1 mA into a 60 k[Formula: see text] load from DC to 1 kHz. Driving a 60 k[Formula: see text] load with a 2 mA peak-to-peak 1 kHz sinusoid, the circuit draws less than 21 mA from a 9 V source. The minimum operating current of the circuit is less than 12 mA. Voltage compliance is ± 60 V with just 1.02 mA drawn by the high voltage current drive circuitry. The circuit was implemented as a compact 46 mm × 21 mm two-layer PCB highlighting its potential for use in a body-worn device. CONCLUSIONS: No design to the best of our knowledge presents comparably low quiescent power with such high voltage compliance. This makes the design uniquely appropriate for low-power transcutaneous current stimulation in wearable applications. Further development of driving and instrumentation circuitry is recommended.

Approximate, computationally efficient online learning in Bayesian spiking neurons.

Bayesian spiking neurons (BSNs) provide a probabilistic interpretation of how neurons perform inference and learning. Online learning in BSNs typically involves parameter estimation based on maximum-likelihood expectation-maximization (ML-EM) which is computationally slow and limits the potential of studying networks of BSNs. An online learning algorithm, fast learning (FL), is presented that is more computationally efficient than the benchmark ML-EM for a fixed number of time steps as the number of inputs to a BSN increases (e.g., 16.5 times faster run times for 20 inputs). Although ML-EM appears to converge 2.0 to 3.6 times faster than FL, the computational cost of ML-EM means that ML-EM takes longer to simulate to convergence than FL. FL also provides reasonable convergence performance that is robust to initialization of parameter estimates that are far from the true parameter values. However, parameter estimation depends on the range of true parameter values. Nevertheless, for a physiologically meaningful range of parameter values, FL gives very good average estimation accuracy, despite its approximate nature. The FL algorithm therefore provides an efficient tool, complementary to ML-EM, for exploring BSN networks in more detail in order to better understand their biological relevance. Moreover, the simplicity of the FL algorithm means it can be easily implemented in neuromorphic VLSI such that one can take advantage of the energy-efficient spike coding of BSNs.

Tau-Cell-Based Analog Silicon Retina With Spatio- Temporal Filtering and Contrast Gain Control.

Developing precise artificial retinas is crucial because they hold the potential to restore vision, improve visual prosthetics, and enhance computer vision systems. Emulating the luminance and contrast adaption features of the retina is essential to improve visual perception and efficiency to provide an environment realistic representation to the user. In this article, we introduce an artificial retina model that leverages its potent adaptation to luminance and contrast to enhance vision sensing and information processing. The model has the ability to achieve the realization of both tonic and phasic cells in the simplest manner. We have implemented the retina model using 0.18 µm process technology and validated the accuracy of the hardware implementation through circuit simulation that closely matches the software retina model. Additionally, we have characterized a single pixel fabricated using the same 0.18 µm process. This pixel demonstrates an 87.7-% ratio of variance with the temporal software model and operates with a power consumption of 369 nW.

Temporal order detection and coding in nervous systems.

This letter discusses temporal order coding and detection in nervous systems. Detection of temporal order in the external world is an adaptive function of nervous systems. In addition, coding based on the temporal order of signals can be used as an internal code. Such temporal order coding is a subset of temporal coding. We discuss two examples of processing the temporal order of external events: the auditory location detection system in birds and the visual direction detection system in flies. We then discuss how somatosensory stimulus intensities are translated into a temporal order code in the human peripheral nervous system. We next turn our attention to input order coding in the mammalian cortex. We review work demonstrating the capabilities of cortical neurons for detecting input order. We then discuss research refuting and demonstrating the representation of stimulus features in the cortex by means of input order. After some general theoretical considerations on input order detection and coding, we conclude by discussing the existing and potential use of input order coding in neuromorphic engineering.

Event-driven spectrotemporal feature extraction and classification using a silicon cochlea model.

This paper presents a reconfigurable digital implementation of an event-based binaural cochlear system on a Field Programmable Gate Array (FPGA). It consists of a pair of the Cascade of Asymmetric Resonators with Fast Acting Compression (CAR-FAC) cochlea models and leaky integrate-and-fire (LIF) neurons. Additionally, we propose an event-driven SpectroTemporal Receptive Field (STRF) Feature Extraction using Adaptive Selection Thresholds (FEAST). It is tested on the TIDIGTIS benchmark and compared with current event-based auditory signal processing approaches and neural networks.

Pregnancy detection and monitoring in cattle via combined foetus electrocardiogram and phonocardiogram signal processing.

BACKGROUND: Pregnancy testing in cattle is commonly invasive requiring manual rectal palpation of the reproductive tract that presents risks to the operator and pregnancy. Alternative non-invasive tests have been developed but have not gained popularity due to poor specificity, sensitivity and the inconvenience of sample handling. Our aim is to present the pilot study and proof of concept of a new non invasive technique to sense the presence and age (limited to the closest trimester of pregnancy) of the foetus by recording the electrical and audio signals produced by the foetus heartbeat using an array of specialized sensors embedded in a stand alone handheld prototype device. The device was applied to the right flank (approximately at the intercept of a horizontal line drawn through the right mid femur region of the cow and a vertical line drawn anywhere between lumbar vertebrae 3 to 5) of more than 2000 cattle from 13 different farms, including pregnant and not pregnant, a diversity of breeds, and both dairy and beef herds. Pregnancy status response is given "on the spot" from an optimized machine learning algorithm running on the device within seconds after data collection. RESULTS: Using combined electrical and audio foetal signals we detected pregnancy with a sensitivity of 87.6% and a specificity of 74.6% for all recorded data. Those values increase to 91% and 81% respectively by removing files with excessive noise (19%).Foetus ageing was achieved by comparing the detected foetus heart-rate with published tables. However, given the challenging farm environment of a restless cow, correct foetus ageing was achieved for only 21% of the correctly diagnosed pregnant cows. CONCLUSIONS: In conclusion we have found that combining ECG and PCG measurements on the right flank of cattle provides a reliable and rapid method of pregnancy testing. The device has potential to be applied by unskilled operators. This will generate more efficient and productive management of farms. There is potential for the device to be applied to large endangered quadrupeds in captive breeding programs where early, safe and reliable pregnancy diagnosis can be imperative but currently difficult to achieve.

Martingales and the fixation time of evolutionary graphs with arbitrary dimensionality.

Evolutionary graph theory (EGT) investigates the Moran birth-death process constrained by graphs. Its two principal goals are to find the fixation probability and time for some initial population of mutants on the graph. The fixation probability of graphs has received considerable attention. Less is known about the distribution of fixation time. We derive clean, exact expressions for the full conditional characteristic functions (CCFs) of a close proxy to fixation and extinction times. That proxy is the number of times that the mutant population size changes before fixation or extinction. We derive these CCFs from a product martingale that we identify for an evolutionary graph with any number of partitions. The existence of that martingale only requires that the connections between those partitions are of a certain type. Our results are the first expressions for the CCFs of any proxy to fixation time on a graph with any number of partitions. The parameter dependence of our CCFs is explicit, so we can explore how they depend on graph structure. Martingales are a powerful approach to study principal problems of EGT. Their applicability is invariant to the number of partitions in a graph, so we can study entire families of graphs simultaneously.

Real-Time Event-Based Unsupervised Feature Consolidation and Tracking for Space Situational Awareness.

Earth orbit is a limited natural resource that hosts a vast range of vital space-based systems that support the international community's national, commercial and defence interests. This resource is rapidly becoming depleted with over-crowding in high demand orbital slots and a growing presence of space debris. We propose the Fast Iterative Extraction of Salient targets for Tracking Asynchronously (FIESTA) algorithm as a robust, real-time and reactive approach to optical Space Situational Awareness (SSA) using Event-Based Cameras (EBCs) to detect, localize, and track Resident Space Objects (RSOs) accurately and timely. We address the challenges of the asynchronous nature and high temporal resolution output of the EBC accurately, unsupervised and with few tune-able parameters using concepts established in the neuromorphic and conventional tracking literature. We show this algorithm is capable of highly accurate in-frame RSO velocity estimation and average sub-pixel localization in a simulated test environment to distinguish the capabilities of the EBC and optical setup from the proposed tracking system. This work is a fundamental step toward accurate end-to-end real-time optical event-based SSA, and developing the foundation for robust closed-form tracking evaluated using standardized tracking metrics.

Neuromorphic Engineering Needs Closed-Loop Benchmarks.

Neuromorphic engineering aims to build (autonomous) systems by mimicking biological systems. It is motivated by the observation that biological organisms-from algae to primates-excel in sensing their environment, reacting promptly to their perils and opportunities. Furthermore, they do so more resiliently than our most advanced machines, at a fraction of the power consumption. It follows that the performance of neuromorphic systems should be evaluated in terms of real-time operation, power consumption, and resiliency to real-world perturbations and noise using task-relevant evaluation metrics. Yet, following in the footsteps of conventional machine learning, most neuromorphic benchmarks rely on recorded datasets that foster sensing accuracy as the primary measure for performance. Sensing accuracy is but an arbitrary proxy for the actual system's goal-taking a good decision in a timely manner. Moreover, static datasets hinder our ability to study and compare closed-loop sensing and control strategies that are central to survival for biological organisms. This article makes the case for a renewed focus on closed-loop benchmarks involving real-world tasks. Such benchmarks will be crucial in developing and progressing neuromorphic Intelligence. The shift towards dynamic real-world benchmarking tasks should usher in richer, more resilient, and robust artificially intelligent systems in the future.

Localization in speech mixtures by listeners with hearing loss.

The ability of listeners with bilateral sensorineural hearing loss to localize a speech source in a multitalker mixture was measured. Five simultaneous words spoken by different talkers were presented over loudspeakers in a small room, and listeners localized one target word. Errors were significantly larger in this group compared to a control group with normal hearing. Localization of the target presented alone was not different between groups. The results suggest that hearing loss does not impair spatial hearing per se, but degrades the spatial representation of multiple simultaneous sounds.

Comparison of the measured and theoretical performance of a broadband circular microphone array.

The design and construction of a circular microphone array (CMA) that has a wide frequency range suitable for human hearing is presented. The design of the CMA was achieved using a technique based on simulated directivity index (DI) curves. The simulated DI curves encapsulate the critical microphone array performance limitations: spatial aliasing, measurement noise, and microphone placement errors. This paper demonstrates how the non-regularized DI curves for a given beamforming order clearly define the bandwidth of operation, in other words, the frequency band for which the beamformer has relatively constant and maximum directivity. Detailed and comprehensive experimental data that characterizes the CMA beamformer are also presented.

Martingales and the characteristic functions of absorption time on bipartite graphs.

Evolutionary graph theory investigates how spatial constraints affect processes that model evolutionary selection, e.g. the Moran process. Its principal goals are to find the fixation probability and the conditional distributions of fixation time, and show how they are affected by different graphs that impose spatial constraints. Fixation probabilities have generated significant attention, but much less is known about the conditional time distributions, even for simple graphs. Those conditional time distributions are difficult to calculate, so we consider a close proxy to it: the number of times the mutant population size changes before absorption. We employ martingales to obtain the conditional characteristic functions (CCFs) of that proxy for the Moran process on the complete bipartite graph. We consider the Moran process on the complete bipartite graph as an absorbing random walk in two dimensions. We then extend Wald's martingale approach to sequential analysis from one dimension to two. Our expressions for the CCFs are novel, compact, exact, and their parameter dependence is explicit. We show that our CCFs closely approximate those of absorption time. Martingales provide an elegant framework to solve principal problems of evolutionary graph theory. It should be possible to extend our analysis to more complex graphs than we show here.

Event Camera Simulator Improvements via Characterized Parameters.

It has been more than two decades since the first neuromorphic Dynamic Vision Sensor (DVS) sensor was invented, and many subsequent prototypes have been built with a wide spectrum of applications in mind. Competing against state-of-the-art neural networks in terms of accuracy is difficult, although there are clear opportunities to outperform conventional approaches in terms of power consumption and processing speed. As neuromorphic sensors generate sparse data at the focal plane itself, they are inherently energy-efficient, data-driven, and fast. In this work, we present an extended DVS pixel simulator for neuromorphic benchmarks which simplifies the latency and the noise models. In addition, to more closely model the behaviour of a real pixel, the readout circuitry is modelled, as this can strongly affect the time precision of events in complex scenes. Using a dynamic variant of the MNIST dataset as a benchmarking task, we use this simulator to explore how the latency of the sensor allows it to outperform conventional sensors in terms of sensing speed.

Wearable dry sensors with bluetooth connection for use in remote patient monitoring systems.

Cost reduction has become the primary theme of healthcare reforms globally. More providers are moving towards remote patient monitoring, which reduces the length of hospital stays and frees up their physicians and nurses for acute cases and helps them to tackle staff shortages. Physiological sensors are commonly used in many human specialties e.g. electrocardiogram (ECG) electrodes, for monitoring heart signals, and electroencephalogram (EEG) electrodes, for sensing the electrical activity of the brain, are the most well-known applications. Consequently there is a substantial unmet need for physiological sensors that can be simply and easily applied by the patient or primary carer, are comfortable to wear, can accurately sense parameters over long periods of time and can be connected to data recording systems using Bluetooth technology. We have developed a small, battery powered, user customizable portable monitor. This prototype is capable of recording three-axial body acceleration, skin temperature, and has up to four bio analogical front ends. Moreover, it is also able of continuous wireless transmission to any Bluetooth device including a PDA or a cellular phone. The bio-front end can use long-lasting dry electrodes or novel textile electrodes that can be embedded in clothes. The device can be powered by a standard mobile phone which has a Ni-MH 3.6 V battery, to sustain more than seven days continuous functioning when using the Bluetooth Sniff mode to reduce TX power. In this paper, we present some of the evaluation experiments of our wearable personal monitor device with a focus on ECG applications.

Correction to 'Wald's martingale and the conditional distributions of absorption time in the Moran process'.

[This corrects the article DOI: 10.1098/rspa.2020.0135.].

Event-Based Computation for Touch Localization Based on Precise Spike Timing.

Precise spike timing and temporal coding are used extensively within the nervous system of insects and in the sensory periphery of higher order animals. However, conventional Artificial Neural Networks (ANNs) and machine learning algorithms cannot take advantage of this coding strategy, due to their rate-based representation of signals. Even in the case of artificial Spiking Neural Networks (SNNs), identifying applications where temporal coding outperforms the rate coding strategies of ANNs is still an open challenge. Neuromorphic sensory-processing systems provide an ideal context for exploring the potential advantages of temporal coding, as they are able to efficiently extract the information required to cluster or classify spatio-temporal activity patterns from relative spike timing. Here we propose a neuromorphic model inspired by the sand scorpion to explore the benefits of temporal coding, and validate it in an event-based sensory-processing task. The task consists in localizing a target using only the relative spike timing of eight spatially-separated vibration sensors. We propose two different approaches in which the SNNs learns to cluster spatio-temporal patterns in an unsupervised manner and we demonstrate how the task can be solved both analytically and through numerical simulation of multiple SNN models. We argue that the models presented are optimal for spatio-temporal pattern classification using precise spike timing in a task that could be used as a standard benchmark for evaluating event-based sensory processing models based on temporal coding.

A psychophysical evaluation of near-field head-related transfer functions synthesized using a distance variation function.

A method for synthesizing near-field head-related transfer functions (HRTFs) from far-field HRTFs measured using an acoustic point-source of sound is presented. Near-field HRTFs are synthesized by applying an analytic function describing the change in the transfer function when the location of a sound source changes from the far-field to the near-field: the distance variation function (DVF). The DVF is calculated from a rigid sphere model and approximates the change in the frequency-dependent interaural level cues as a function of the change in sound source distance. Using a sound localization experiment, the fidelity of the near-field virtual auditory space (VAS) generated using this technique is compared to that obtained by simply adjusting the intensity of the VAS stimulus to simulate changes in distance. Results show improved distance perception for sounds at simulated distances of up to 60 cm using the DVF compared to simple intensity adjustment, while maintaining directional accuracy. The largest improvement for distance perception were for sound sources located to the side and within 40 cm. When intensity was removed as a cue for sound source distance from near-field sounds generated using the DVF, results showed some discrimination of sound source distances but, in general, distance perception accuracy was poor.

Low Power, CMOS-MoS2 Memtransistor based Neuromorphic Hybrid Architecture for Wake-Up Systems.

Neuromorphic architectures have become essential building blocks for next-generation computational systems, where intelligence is embedded directly onto low power, small area, and computationally efficient hardware devices. In such devices, realization of neural algorithms requires storage of weights in digital memories, which is a bottleneck in terms of power and area. We hereby propose a biologically inspired low power, hybrid architectural framework for wake-up systems. This architecture utilizes our novel high-performance, ultra-low power molybdenum disulphide (MoS2) based two-dimensional synaptic memtransistor as an analogue memory. Furthermore, it exploits random device mismatches to implement the population coding scheme. Power consumption per CMOS neuron block was found to be 3 nw in the 65 nm process technology, while the energy consumption per cycle was 0.3 pJ for potentiation and 20 pJ for depression cycles of the synaptic device. The proposed framework was demonstrated for classification and regression tasks, using both off-chip and simplified on-chip sign-based learning techniques.

Vibrotactile sensitivity of patients with HIV-related sensory neuropathy: An exploratory study.

BACKGROUND: HIV-associated distal polyneuropathy (HIV-PN) affects large and small sensory nerve fibers and can cause tactile insensitivity. This exploratory study forms part of an effort to apply subsensory electrical nerve stimulation (SENS) to improve tactile sensitivity of patients with HIV-PN. This work presented an opportunity to use a robust protocol to quantitatively describe the vibrotactile sensitivity of individuals with HIV-PN on effective antiretroviral therapy (ART) and correlate these findings with commonly used clinical vibration testing and scoring grades. METHODS: The vibration perception thresholds (VPTs) of 20 patients with HIV-PN at three vibration frequencies (25, 50, and 128 Hz) were measured. We compare the vibration perception threshold (VPT) outcomes to an age- and gender-matched control cohort. We further correlated VPT findings with 128 Hz tuning fork (TF) assessments performed on the HIV-PN participants, accrued as part of a larger study. HIV-PN was defined as having at least one distal symmetrical neuropathic sign, although 18 of 20 had at least two neuropathic signs. CONCLUSIONS: HIV-PN participants were found to have lower VPT sensitivity than controls for all three vibration frequencies, and VPT was more sensitive at higher vibration frequencies for both HIV-PN and controls. VPT sensitivity was reduced with older age. Years on ART was correlated with VPT-25 Hz but not with VPT in general. Notably, VPT sensitivity did not correlate with the clinically used 128 Hz TF severity grades. Outcomes of tests for interaction with vibration frequency suggest that HIV-PN pathology does not affect all mechanoreceptors similarly.