Vertically Stackable Ovonic Threshold Switch Oscillator Using Atomic Layer Deposited Ge0.6Se0.4 Film for High-Density Artificial Neural Networks.

Nanodevice oscillators (nano-oscillators) have received considerable attention to implement in neuromorphic computing as hardware because they can significantly improve the device integration density and energy efficiency compared to complementary metal oxide semiconductor circuit-based oscillators. This work demonstrates vertically stackable nano-oscillators using an ovonic threshold switch (OTS) for high-density neuromorphic hardware. A vertically stackable Ge0.6Se0.4 OTS-oscillator (VOTS-OSC) is fabricated with a vertical crossbar array structure by growing Ge0.6Se0.4 film conformally on a contact hole structure using atomic layer deposition. The VOTS-OSC can be vertically integrated onto peripheral circuits without causing thermal damage because the fabrication temperature is <400 °C. The fabricated device exhibits oscillation characteristics, which can serve as leaky integrate-and-fire neurons in spiking neural networks (SNNs) and coupled oscillators in oscillatory neural networks (ONNs). For practical applications, pattern recognition and vertex coloring are demonstrated with SNNs and ONNs, respectively, using semiempirical simulations. This structure increases the oscillator integration density significantly, enabling complex tasks with a large number of oscillators. Moreover, it can enhance the computational speed of neural networks due to its rapid switching speed.

A Nanoscale Bistable Resistor for an Oscillatory Neural Network.

Coupled oscillators construct an oscillatory neural network (ONN) by mimicking the interactions among neurons in the human brain. This work demonstrates a fully CMOS-based oscillator consisting of a bistable resistor (biristor), which shares a structure identical with that of a metal-oxide-semiconductor field-effect transistor, except for the use of a gate electrode. The biristor-based oscillator (birillator) generates oscillating voltage signals in the form of spikes due to a single transistor latch phenomenon. When two birillators are connected with a coupling capacitor, they become synchronized with a phase difference of 180°. These coupled oscillation characteristics are experimentally investigated for an ONN. As practical applications of the ONN with coupled birillators, edge detection and vertex coloring are conducted by encoding information into phase differences between them. The proposed fully CMOS-based birillators are advantageous for low power consumption, high CMOS compatibility, and a compact footprint area.

Linear Frequency Modulation of NbO2-Based Nanoscale Oscillator With Li-Based Electrochemical Random Access Memory for Compact Coupled Oscillatory Neural Network.

Oscillatory neural network (ONN)-based classification of clustered data relies on frequency synchronization to injected signals representing input data, showing a more efficient structure than a conventional deep neural network. A frequency tunable oscillator is a core component of the network, requiring energy-efficient, and area-scalable characteristics for large-scale hardware implementation. From a hardware viewpoint, insulator-metal transition (IMT) device-based oscillators are attractive owing to their simple structure and low power consumption. Furthermore, by introducing non-volatile analog memory, non-volatile frequency programmability can be obtained. However, the required device characteristics of the oscillator for high performance of coupled oscillator have not been identified. In this article, we investigated the effect of device parameters of IMT oscillator with non-volatile analog memory on coupled oscillators network for classification of clustered data. We confirmed that linear conductance response with identical pulses is crucial to accurate training. In addition, considering dispersed clustered inputs, a wide synchronization window achieved by controlling the hold voltage of the IMT shows resilient classification. As an oscillator that satisfies the requirements, we evaluated the NbO2-based IMT oscillator with non-volatile Li-based electrochemical random access memory (Li-ECRAM). Finally, we demonstrated a coupled oscillator network for classifying spoken vowels, achieving an accuracy of 85%, higher than that of a ring oscillator-based system. Our results show that an NbO2-based oscillator with Li-ECRAM has the potential for an area-scalable and energy-efficient network with high performance.

Mapping Hebbian Learning Rules to Coupling Resistances for Oscillatory Neural Networks.

Oscillatory Neural Network (ONN) is an emerging neuromorphic architecture with oscillators representing neurons and information encoded in oscillator's phase relations. In an ONN, oscillators are coupled with electrical elements to define the network's weights and achieve massive parallel computation. As the weights preserve the network functionality, mapping weights to coupling elements plays a crucial role in ONN performance. In this work, we investigate relaxation oscillators based on VO2 material, and we propose a methodology to map Hebbian coefficients to ONN coupling resistances, allowing a large-scale ONN design. We develop an analytical framework to map weight coefficients into coupling resistor values to analyze ONN architecture performance. We report on an ONN with 60 fully-connected oscillators that perform pattern recognition as a Hopfield Neural Network.

Coupled VO2 Oscillators Circuit as Analog First Layer Filter in Convolutional Neural Networks.

In this work we present an in-memory computing platform based on coupled VO2 oscillators fabricated in a crossbar configuration on silicon. Compared to existing platforms, the crossbar configuration promises significant improvements in terms of area density and oscillation frequency. Further, the crossbar devices exhibit low variability and extended reliability, hence, enabling experiments on 4-coupled oscillator. We demonstrate the neuromorphic computing capabilities using the phase relation of the oscillators. As an application, we propose to replace digital filtering operation in a convolutional neural network with oscillating circuits. The concept is tested with a VGG13 architecture on the MNIST dataset, achieving performances of 95% in the recognition task.

Reaction times in visual search can be explained by a simple model of neural synchronization.

We present an oscillatory neural network model that can account for reaction times in visual search experiments. The model consists of a central oscillator that represents the central executive of the attention system and a number of peripheral oscillators that represent objects in the display. The oscillators are described as generalized Kuramoto type oscillators with adapted parameters. An object is considered as being included in the focus of attention if the oscillator associated with this object is in-phase with the central oscillator. The probability for an object to be included in the focus of attention is determined by its saliency that is described in formal terms as the strength of the connection from the peripheral oscillator to the central oscillator. By computer simulations it is shown that the model can reproduce reaction times in visual search tasks of various complexities. The dependence of the reaction time on the number of items in the display is represented by linear functions of different steepness which is in agreement with biological evidence.

Effects of synaptic plasticity on phase and period locking in a network of two oscillatory neurons.

We study the effects of synaptic plasticity on the determination of firing period and relative phases in a network of two oscillatory neurons coupled with reciprocal inhibition. We combine the phase response curves of the neurons with the short-term synaptic plasticity properties of the synapses to define Poincaré maps for the activity of an oscillatory network. Fixed points of these maps correspond to the phase-locked modes of the network. These maps allow us to analyze the dependence of the resulting network activity on the properties of network components. Using a combination of analysis and simulations, we show how various parameters of the model affect the existence and stability of phase-locked solutions. We find conditions on the synaptic plasticity profiles and the phase response curves of the neurons for the network to be able to maintain a constant firing period, while varying the phase of locking between the neurons or vice versa. A generalization to cobwebbing for two-dimensional maps is also discussed.