Fully-integrated photonic tensor core for image convolutions.

Convolutions are one of the most critical signal and image processing operations. From spectral analysis to computer vision, convolutional filtering is often related to spatial information processing involving neighbourhood operations. As convolution operations are based around the product of two functions, vectors or matrices, dot products play a key role in the performance of such operations; for example, advanced image processing techniques require fast, dense matrix multiplications that typically take more than 90% of the computational capacity dedicated to solving convolutional neural networks. Silicon photonics has been demonstrated to be an ideal candidate to accelerate information processing involving parallel matrix multiplications. In this work, we experimentally demonstrate a multiwavelength approach with fully integrated modulators, tunable filters as microring resonator weight banks, and a balanced detector to perform matrix multiplications for image convolution operations. We develop a scattering matrix model that matches the experiment to simulate large-scale versions of these photonic systems with which we predict performance and physical constraints, including inter-channel cross-talk and bit resolution.

Roadmap on emerging hardware and technology for machine learning.

Recent progress in artificial intelligence is largely attributed to the rapid development of machine learning, especially in the algorithm and neural network models. However, it is the performance of the hardware, in particular the energy efficiency of a computing system that sets the fundamental limit of the capability of machine learning. Data-centric computing requires a revolution in hardware systems, since traditional digital computers based on transistors and the von Neumann architecture were not purposely designed for neuromorphic computing. A hardware platform based on emerging devices and new architecture is the hope for future computing with dramatically improved throughput and energy efficiency. Building such a system, nevertheless, faces a number of challenges, ranging from materials selection, device optimization, circuit fabrication and system integration, to name a few. The aim of this Roadmap is to present a snapshot of emerging hardware technologies that are potentially beneficial for machine learning, providing the Nanotechnology readers with a perspective of challenges and opportunities in this burgeoning field.

Photonic independent component analysis using an on-chip microring weight bank.

Independent component analysis (ICA) is a general-purpose technique for analyzing multi-dimensional data to reveal the underlying hidden factors that are maximally independent from each other. We report the first photonic ICA on mixtures of unknown signals by employing an on-chip microring (MRR) weight bank. The MRR weight bank performs so-called weighted addition (i.e., multiply-accumulate) operations on the received mixtures, and outputs a single reduced-dimensional representation of the signal of interest. We propose a novel ICA algorithm to recover independent components solely based on the statistical information of the weighted addition output, while remaining blind to not only the original sources but also the waveform information of the mixtures. We investigate both channel separability and near-far problems, and our two-channel photonic ICA experiment demonstrates our scheme holds comparable performance with the conventional software-based ICA method. Our numerical simulation validates the fidelity of the proposed approach, and studies noise effects to identify the operating regime of our method. The proposed technique could open new domains for future research in blind source separation, microwave photonics, and on-chip information processing.

Blind source separation with integrated photonics and reduced dimensional statistics.

Microwave communications have witnessed an incipient proliferation of multi-antenna and opportunistic technologies in the wake of an ever-growing demand for spectrum resources, while facing increasingly difficult network management over widespread channel interference and heterogeneous wireless broadcasting. Radio frequency (RF) blind source separation (BSS) is a powerful technique for demixing mixtures of unknown signals with minimal assumptions, but relies on frequency dependent RF electronics and prior knowledge of the target frequency band. We propose photonic BSS with unparalleled frequency agility supported by the tremendous bandwidths of photonic channels and devices. Specifically, our approach adopts an RF photonic front-end to process RF signals at various frequency bands within the same array of integrated microring resonators, and implements a novel two-step photonic BSS pipeline to reconstruct source identities from the reduced dimensional statistics of front-end output. We verify the feasibility and robustness of our approach by performing the first proof-of-concept photonic BSS experiments on mixed-over-the-air RF signals across multiple frequency bands. The proposed technique lays the groundwork for further research in interference cancellation, radio communications, and photonic information processing.

Photonic principal component analysis using an on-chip microring weight bank.

Photonic principal component analysis (PCA) enables high-performance dimensionality reduction in wideband analog systems. In this paper, we report a photonic PCA approach using an on-chip microring (MRR) weight bank to perform weighted addition operations on correlated wavelength-division multiplexed (WDM) inputs. We are able to configure the MRR weight bank with record-high accuracy and precision, and generate multi-channel correlated input signals in a controllable manner. We also consider the realistic scenario in which the PCA procedure remains blind to the waveforms of both the input signals and weighted addition output, and propose a novel PCA algorithm that is able to extract principal components (PCs) solely based on the statistical information of the weighted addition output. Our experimental demonstration of two-channel photonic PCA produces PCs holding consistently high correspondence to those computed by a conventional software-based PCA method. Our numerical simulation further validates that our scheme can be generalized to high-dimensional (up to but not limited to eight-channel) PCA with good convergence. The proposed technique could bring new solutions to problems in microwave communications, ultrafast control, and on-chip information processing.

Neuromorphic photonics with electro-absorption modulators.

Photonic neural networks benefit from both the high-channel capacity and the wave nature of light acting as an effective weighting mechanism through linear optics. Incorporating a nonlinear activation function by using active integrated photonic components allows neural networks with multiple layers to be built monolithically, eliminating the need for energy and latency costs due to external conversion. Interferometer-based modulators, while popular in communications, have been shown to require more area than absorption-based modulators, resulting in a reduced neural network density. Here, we develop a model for absorption modulators in an electro-optic fully connected neural network, including noise, and compare the network's performance with the activation functions produced intrinsically by five types of absorption modulators. Our results show the quantum well absorption modulator-based electro-optic neuron has the best performance allowing for 96% prediction accuracy with 1.7×10-12 J/MAC excluding laser power when performing MNIST classification in a 2 hidden layer feed-forward photonic neural network.

Feedback control for microring weight banks.

Microring weight banks present novel opportunities for reconfigurable, high-performance analog signal processing in photonics. Controlling microring filter response is a challenge due to fabrication variations and thermal sensitivity. Prior work showed continuous weight control of multiple wavelength-division multiplexed signals in a bank of microrings based on calibration and feedforward control. Other prior work has shown resonance locking based on feedback control by monitoring photoabsorption-induced changes in resistance across in-ring photoconductive heaters. In this work, we demonstrate continuous, multi-channel control of a microring weight bank with an effective 5.1 bits of accuracy on 2Gbps signals. Unlike resonance locking, the approach relies on an estimate of filter transmission versus photo-induced resistance changes. We introduce an estimate still capable of providing 4.2 bits of accuracy without any direct transmission measurements. Furthermore, we present a detailed characterization of this response for different values of carrier wavelength offset and power. Feedback weight control renders tractable the weight control problem in reconfigurable analog photonic networks.

Two-pole microring weight banks.

Weighted addition is an elemental multi-input to single-output operation that can be implemented with high-performance photonic devices. Microring (MRR) weight banks bring programmable weighted addition to silicon photonics. Prior work showed that their channel limits are affected by coherent inter-channel effects that occur uniquely in weight banks. We fabricate two-pole designs that exploit this inter-channel interference in a way that is robust to dynamic tuning and fabrication variation. Scaling analysis predicts a channel count improvement of 3.4-fold, which is substantially greater than predicted by incoherent analysis used in conventional MRR devices. Advances in weight bank design expand the potential of reconfigurable analog photonic networks and multivariate microwave photonics.

Simultaneous excitatory and inhibitory dynamics in an excitable laser.

Neocortical systems encode information in electrochemical spike timings, not just mean firing rates. Learning and memory in networks of spiking neurons is achieved by the precise timing of action potentials that induces synaptic strengthening (with excitation) or weakening (with inhibition). Inhibition should be incorporated into brain-inspired spike processing in the optical domain to enhance its information-processing capability. We demonstrate the simultaneous excitatory and inhibitory dynamics in an excitable (i.e., a pulsed) laser neuron, both numerically and experimentally. We investigate the bias strength effect, inhibitory strength effect, and excitatory and inhibitory input timing effect, based on the simulation platform of an integrated graphene excitable laser. We further corroborate these analyses with proof-of-principle experiments utilizing a fiber-based graphene excitable laser, where we introduce inhibition by directly modulating the gain of the laser. This technology may potentially open novel spike-processing functionality for future neuromorphic photonic systems.

Multi-channel control for microring weight banks.

We demonstrate 4-channel, 2GHz weighted addition in a silicon microring filter bank. Accurate analog weight control becomes more difficult with increasing number of channels, N, as feedback approaches become impractical and brute force feedforward approaches take O(2N) calibration measurements in the presence of inter-channel dependence. We introduce model-based calibration techniques for thermal cross-talk and cross-gain saturation, which result in a scalable O(N) calibration routine and 3.8 bit feedforward weight accuracy on every channel. Practical calibration routines are indispensible for controlling large-scale microring systems. The effect of thermal model complexity on accuracy is discussed. Weighted addition based on silicon microrings can apply the strengths of photonic manufacturing, wideband information processing, and multiwavelength networks towards new paradigms of ultrafast analog distributed processing.

SIMPEL: circuit model for photonic spike processing laser neurons.

We propose an equivalent circuit model for photonic spike processing laser neurons with an embedded saturable absorber­a simulation model for photonic excitable lasers (SIMPEL). We show that by mapping the laser neuron rate equations into a circuit model, SPICE analysis can be used as an efficient and accurate engine for numerical calculations, capable of generalization to a variety of different types of laser neurons with saturable absorber found in literature. The development of this model parallels the Hodgkin-Huxley model of neuron biophysics, a circuit framework which brought efficiency, modularity, and generalizability to the study of neural dynamics. We employ the model to study various signal-processing effects such as excitability with excitatory and inhibitory pulses, binary all-or-nothing response, and bistable dynamics.

Excitable laser processing network node in hybrid silicon: analysis and simulation.

The combination of ultrafast laser dynamics and dense on-chip multiwavelength networking could potentially address new domains of real-time signal processing that require both speed and complexity. We present a physically realistic optoelectronic simulation model of a circuit for dynamical laser neural networks and verify its behavior. We describe the physics, dynamics, and parasitics of one network node, which includes a bank of filters, a photodetector, and excitable laser. This unconventional circuit exhibits both cascadability and fan-in, critical properties for the large-scale networking of information processors based on laser excitability. In addition, it can be instantiated on a photonic integrated circuit platform and requires no off-chip optical I/O. Our proposed processing system could find use in emerging applications, including cognitive radio and low-latency control.

Demonstration of WDM weighted addition for principal component analysis.

We consider an optical technique for performing tunable weighted addition using wavelength-division multiplexed (WDM) inputs, the enabling function of a recently proposed photonic spike processing architecture [J. Lightwave Technol., 32 (2014)]. WDM weighted addition provides important advantages to performance, integrability, and networking capability that were not possible in any past approaches to optical neurocomputing. In this letter, we report a WDM weighted addition prototype used to find the first principal component of a 1Gbps, 8-channel signal. Wideband, multivariate techniques have immediate relevance to modern radio systems, and photonic spike processing networks enabled by WDM could open new domains of information processing that bring unprecedented bandwidth and intelligence to problems in radio communications, ultrafast control, and scientific computing.

Gigabit Ethernet signal transmission using asynchronous optical code division multiple access.

We propose and experimentally demonstrate a novel architecture for interfacing and transmitting a Gigabit Ethernet (GbE) signal using asynchronous incoherent optical code division multiple access (OCDMA). This is the first such asynchronous incoherent OCDMA system carrying GbE data being demonstrated to be working among multi-users where each user is operating with an independent clock/data rate and is granted random access to the network. Three major components, the GbE interface, the OCDMA transmitter, and the OCDMA receiver are discussed in detail. The performance of the system is studied and characterized through measuring eye diagrams, bit-error rate and packet loss rate in real-time file transfer. Our Letter also addresses the near-far problem and realizes asynchronous transmission and detection of signal.

Temporal phase mask encrypted optical steganography carried by amplified spontaneous emission noise.

A temporal phase mask encryption method is proposed and experimentally demonstrated to improve the security of the stealth channel in an optical steganography system. The stealth channel is protected in two levels. In the first level, the data is carried by amplified spontaneous emission (ASE) noise, which cannot be detected in either the time domain or spectral domain. In the second level, even if the eavesdropper suspects the existence of the stealth channel, each data bit is covered by a fast changing phase mask. The phase mask code is always combined with the wide band noise from ASE. Without knowing the right phase mask code to recover the stealth data, the eavesdropper can only receive the noise like signal with randomized phase.

Analog noise protected optical encryption with two-dimensional key space.

An optical encryption method based on analog noise is proposed and experimentally demonstrated. The transmitted data is encrypted with wideband analog noise. Without decrypting the data instantly at the receiver, the data is damaged by the noise and cannot be recovered by post-processing techniques. A matching condition in both phase and amplitude of the noise needs to be satisfied between the transmitter and the receiver to cancel the noise. The precise requirement of the phase and amplitude matching condition provides a large two-dimensional key space, which can be deployed in the encryption and decryption process at the transmitter and receiver.

Reconfigurable quantum photonic circuits based on quantum dots.

Quantum photonic integrated circuits, composed of linear-optical elements, offer an efficient way for encoding and processing quantum information on-chip. At their core, these circuits rely on reconfigurable phase shifters, typically constructed from classical components such as thermo- or electro-optical materials, while quantum solid-state emitters such as quantum dots are limited to acting as single-photon sources. Here, we demonstrate the potential of quantum dots as reconfigurable phase shifters. We use numerical models based on established literature parameters to show that circuits utilizing these emitters enable high-fidelity operation and are scalable. Despite the inherent imperfections associated with quantum dots, such as imperfect coupling, dephasing, or spectral diffusion, we show that circuits based on these emitters may be optimized such that these do not significantly impact the unitary infidelity. Specifically, they do not increase the infidelity by more than 0.001 in circuits with up to 10 modes, compared to those affected only by standard nanophotonic losses and routing errors. For example, we achieve fidelities of 0.9998 in quantum-dot-based circuits enacting controlled-phase and - not gates without any redundancies. These findings demonstrate the feasibility of quantum emitter-driven quantum information processing and pave the way for cryogenically-compatible, fast, and low-loss reconfigurable quantum photonic circuits.

Physics to system-level modeling of silicon-organic-hybrid nanophotonic devices.

The continuous growth in data volume has sparked interest in silicon-organic-hybrid (SOH) nanophotonic devices integrated into silicon photonic integrated circuits (PICs). SOH devices offer improved speed and energy efficiency compared to silicon photonics devices. However, a comprehensive and accurate modeling methodology of SOH devices, such as modulators corroborating experimental results, is lacking. While some preliminary modeling approaches for SOH devices exist, their reliance on theoretical and numerical methodologies, along with a lack of compatibility with electronic design automation (EDA), hinders their seamless and rapid integration with silicon PICs. Here, we develop a phenomenological, building-block-based SOH PICs simulation methodology that spans from the physics to the system level, offering high accuracy, comprehensiveness, and EDA-style compatibility. Our model is also readily integrable and scalable, lending itself to the design of large-scale silicon PICs. Our proposed modeling methodology is agnostic and compatible with any photonics-electronics co-simulation software. We validate this methodology by comparing the characteristics of experimentally demonstrated SOH microring modulators (MRMs) and Mach Zehnder modulators with those obtained through simulation, demonstrating its ability to model various modulator topologies. We also show our methodology's ease and speed in modeling large-scale systems. As an illustrative example, we use our methodology to design and study a 3-channel SOH MRM-based wavelength-division (de)multiplexer, a widely used component in various applications, including neuromorphic computing, data center interconnects, communications, sensing, and switching networks. Our modeling approach is also compatible with other materials exhibiting the Pockels and Kerr effects. To our knowledge, this represents the first comprehensive physics-to-system-level EDA-compatible simulation methodology for SOH modulators.

Roadmapping the next generation of silicon photonics.

Silicon photonics has developed into a mainstream technology driven by advances in optical communications. The current generation has led to a proliferation of integrated photonic devices from thousands to millions-mainly in the form of communication transceivers for data centers. Products in many exciting applications, such as sensing and computing, are around the corner. What will it take to increase the proliferation of silicon photonics from millions to billions of units shipped? What will the next generation of silicon photonics look like? What are the common threads in the integration and fabrication bottlenecks that silicon photonic applications face, and which emerging technologies can solve them? This perspective article is an attempt to answer such questions. We chart the generational trends in silicon photonics technology, drawing parallels from the generational definitions of CMOS technology. We identify the crucial challenges that must be solved to make giant strides in CMOS-foundry-compatible devices, circuits, integration, and packaging. We identify challenges critical to the next generation of systems and applications-in communication, signal processing, and sensing. By identifying and summarizing such challenges and opportunities, we aim to stimulate further research on devices, circuits, and systems for the silicon photonics ecosystem.

A system-on-chip microwave photonic processor solves dynamic RF interference in real time with picosecond latency.

Radio-frequency interference is a growing concern as wireless technology advances, with potentially life-threatening consequences like interference between radar altimeters and 5 G cellular networks. Mobile transceivers mix signals with varying ratios over time, posing challenges for conventional digital signal processing (DSP) due to its high latency. These challenges will worsen as future wireless technologies adopt higher carrier frequencies and data rates. However, conventional DSPs, already on the brink of their clock frequency limit, are expected to offer only marginal speed advancements. This paper introduces a photonic processor to address dynamic interference through blind source separation (BSS). Our system-on-chip processor employs a fully integrated photonic signal pathway in the analogue domain, enabling rapid demixing of received mixtures and recovering the signal-of-interest in under 15 picoseconds. This reduction in latency surpasses electronic counterparts by more than three orders of magnitude. To complement the photonic processor, electronic peripherals based on field-programmable gate array (FPGA) assess the effectiveness of demixing and continuously update demixing weights at a rate of up to 305 Hz. This compact setup features precise dithering weight control, impedance-controlled circuit board and optical fibre packaging, suitable for handheld and mobile scenarios. We experimentally demonstrate the processor's ability to suppress transmission errors and maintain signal-to-noise ratios in two scenarios, radar altimeters and mobile communications. This work pioneers the real-time adaptability of integrated silicon photonics, enabling online learning and weight adjustments, and showcasing practical operational applications for photonic processing.