Memristor-based adaptive neuromorphic perception in unstructured environments.

Efficient operation of control systems in robotics or autonomous driving targeting real-world navigation scenarios requires perception methods that allow them to understand and adapt to unstructured environments with good accuracy, adaptation, and generality, similar to humans. To address this need, we present a memristor-based differential neuromorphic computing, perceptual signal processing, and online adaptation method providing neuromorphic style adaptation to external sensory stimuli. The adaptation ability and generality of this method are confirmed in two application scenarios: object grasping and autonomous driving. In the former, a robot hand realizes safe and stable grasping through fast ( ~ 1 ms) adaptation based on the tactile object features with a single memristor. In the latter, decision-making information of 10 unstructured environments in autonomous driving is extracted with an accuracy of 94% with a 40×25 memristor array. By mimicking human low-level perception mechanisms, the electronic neuromorphic circuit-based method achieves real-time adaptation and high-level reactions to unstructured environments.

An Ultralow-Power Real-Time Machine Learning Based fNIRS Motion Artifacts Detection.

Due to iterative matrix multiplications or gradient computations, machine learning modules often require a large amount of processing power and memory. As a result, they are often not feasible for use in wearable devices, which have limited processing power and memory. In this study, we propose an ultralow-power and real-time machine learning-based motion artifact detection module for functional near-infrared spectroscopy (fNIRS) systems. We achieved a high classification accuracy of 97.42%, low field-programmable gate array (FPGA) resource utilization of 38354 lookup tables and 6024 flip-flops, as well as low power consumption of 0.021 W in dynamic power. These results outperform conventional CPU support vector machine (SVM) methods and other state-of-the-art SVM implementations. This study has demonstrated that an FPGA-based fNIRS motion artifact classifier can be exploited while meeting low power and resource constraints, which are crucial in embedded hardware systems while keeping high classification accuracy.

fNIRS-EEG BCIs for Motor Rehabilitation: A Review.

Motor impairment has a profound impact on a significant number of individuals, leading to a substantial demand for rehabilitation services. Through brain-computer interfaces (BCIs), people with severe motor disabilities could have improved communication with others and control appropriately designed robotic prosthetics, so as to (at least partially) restore their motor abilities. BCI plays a pivotal role in promoting smoother communication and interactions between individuals with motor impairments and others. Moreover, they enable the direct control of assistive devices through brain signals. In particular, their most significant potential lies in the realm of motor rehabilitation, where BCIs can offer real-time feedback to assist users in their training and continuously monitor the brain's state throughout the entire rehabilitation process. Hybridization of different brain-sensing modalities, especially functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), has shown great potential in the creation of BCIs for rehabilitating the motor-impaired populations. EEG, as a well-established methodology, can be combined with fNIRS to compensate for the inherent disadvantages and achieve higher temporal and spatial resolution. This paper reviews the recent works in hybrid fNIRS-EEG BCIs for motor rehabilitation, emphasizing the methodologies that utilized motor imagery. An overview of the BCI system and its key components was introduced, followed by an introduction to various devices, strengths and weaknesses of different signal processing techniques, and applications in neuroscience and clinical contexts. The review concludes by discussing the possible challenges and opportunities for future development.

Learning based motion artifacts processing in fNIRS: a mini review.

This paper provides a concise review of learning-based motion artifacts (MA) processing methods in functional near-infrared spectroscopy (fNIRS), highlighting the challenges of maintaining optimal contact during subject movement, which can lead to MA and compromise data integrity. Traditional strategies often result in reduced reliability of the hemodynamic response and statistical power. Recognizing the limited number of studies focusing on learning-based MA removal, we examine 315 studies, identifying seven pertinent to our focus area. We discuss the current landscape of learning-based MA correction methods and highlight research gaps. Noting the absence of standard evaluation metrics for quality assessment of MA correction, we suggest a novel framework, integrating signal and model quality considerations and employing metrics like ΔSignal-to-Noise Ratio (ΔSNR), confusion matrix, and Mean Squared Error. This work aims to facilitate the application of learning-based methodologies to fNIRS and improve the accuracy and reliability of neurovascular studies.

Low-cost, smartphone-based instant three-dimensional registration system for infant functional near-infrared spectroscopy applications.

Significance: To effectively apply functional near-infrared spectroscopy (fNIRS)/diffuse optical tomography (DOT) devices, a three-dimensional (3D) model of the position of each optode on a subject's scalp and the positions of that subject's cranial landmarks are critical. Obtaining this information accurately in infants, who rarely stop moving, is an ongoing challenge. Aim: We propose a smartphone-based registration system that can potentially achieve a full-head 3D scan of a 6-month-old infant instantly. Approach: The proposed system is remotely controlled by a custom-designed Bluetooth controller. The scanned images can either be manually or automatically aligned to generate a 3D head surface model. Results: A full-head 3D scan of a 6-month-old infant can be achieved within 2 s via this system. In testing on a realistic but static infant head model, the average Euclidean error of optode position using this device was 1.8 mm. Conclusions: This low-cost 3D registration system therefore has the potential to permit accurate and near-instant fNIRS/DOT spatial registration.

Review of recent advances in frequency-domain near-infrared spectroscopy technologies [Invited].

Over the past several decades, near-infrared spectroscopy (NIRS) has become a popular research and clinical tool for non-invasively measuring the oxygenation of biological tissues, with particular emphasis on applications to the human brain. In most cases, NIRS studies are performed using continuous-wave NIRS (CW-NIRS), which can only provide information on relative changes in chromophore concentrations, such as oxygenated and deoxygenated hemoglobin, as well as estimates of tissue oxygen saturation. Another type of NIRS known as frequency-domain NIRS (FD-NIRS) has significant advantages: it can directly measure optical pathlength and thus quantify the scattering and absorption coefficients of sampled tissues and provide direct measurements of absolute chromophore concentrations. This review describes the current status of FD-NIRS technologies, their performance, their advantages, and their limitations as compared to other NIRS methods. Significant landmarks of technological progress include the development of both benchtop and portable/wearable FD-NIRS technologies, sensitive front-end photonic components, and high-frequency phase measurements. Clinical applications of FD-NIRS technologies are discussed to provide context on current applications and needed areas of improvement. The review concludes by providing a roadmap toward the next generation of fully wearable, low-cost FD-NIRS systems.

Wearable, Integrated EEG-fNIRS Technologies: A Review.

There has been considerable interest in applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) simultaneously for multimodal assessment of brain function. EEG-fNIRS can provide a comprehensive picture of brain electrical and hemodynamic function and has been applied across various fields of brain science. The development of wearable, mechanically and electrically integrated EEG-fNIRS technology is a critical next step in the evolution of this field. A suitable system design could significantly increase the data/image quality, the wearability, patient/subject comfort, and capability for long-term monitoring. Here, we present a concise, yet comprehensive, review of the progress that has been made toward achieving a wearable, integrated EEG-fNIRS system. Significant marks of progress include the development of both discrete component-based and microchip-based EEG-fNIRS technologies; modular systems; miniaturized, lightweight form factors; wireless capabilities; and shared analogue-to-digital converter (ADC) architecture between fNIRS and EEG data acquisitions. In describing the attributes, advantages, and disadvantages of current technologies, this review aims to provide a roadmap toward the next generation of wearable, integrated EEG-fNIRS systems.

Evaluating a new generation of wearable high-density diffuse optical tomography technology via retinotopic mapping of the adult visual cortex.

Significance: High-density diffuse optical tomography (HD-DOT) has been shown to approach the resolution and localization accuracy of blood oxygen level dependent-functional magnetic resonance imaging in the adult brain by exploiting densely spaced, overlapping samples of the probed tissue volume, but the technique has to date required large and cumbersome optical fiber arrays. Aim: To evaluate a wearable HD-DOT system that provides a comparable sampling density to large, fiber-based HD-DOT systems, but with vastly improved ergonomics. Approach: We investigated the performance of this system by replicating a series of classic visual stimulation paradigms, carried out in one highly sampled participant during 15 sessions to assess imaging performance and repeatability. Results: Hemodynamic response functions and cortical activation maps replicate the results obtained with larger fiber-based systems. Our results demonstrate focal activations in both oxyhemoglobin and deoxyhemoglobin with a high degree of repeatability observed across all sessions. A comparison with a simulated low-density array explicitly demonstrates the improvements in spatial localization, resolution, repeatability, and image contrast that can be obtained with this high-density technology. Conclusions: The system offers the possibility for minimally constrained, spatially resolved functional imaging of the human brain in almost any environment and holds particular promise in enabling neuroscience applications outside of the laboratory setting. It also opens up new opportunities to investigate populations unsuited to traditional imaging technologies.

Design and validation of a mechanically flexible and ultra-lightweight high-density diffuse optical tomography system for functional neuroimaging of newborns.

Significance: Neonates are a highly vulnerable population. The risk of brain injury is greater during the first days and weeks after birth than at any other time of life. Functional neuroimaging that can be performed longitudinally and at the cot-side has the potential to improve our understanding of the evolution of multiple forms of neurological injury over the perinatal period. However, existing technologies make it very difficult to perform repeated and/or long-duration functional neuroimaging experiments at the cot-side. Aim: We aimed to create a modular, high-density diffuse optical tomography (HD-DOT) technology specifically for neonatal applications that is ultra-lightweight, low profile and provides high mechanical flexibility. We then sought to validate this technology using an anatomically accurate dynamic phantom. Approach: An advanced 10-layer rigid-flexible printed circuit board technology was adopted as the basis for the DOT modules, which allows for a compact module design that also provides the flexibility needed to conform to the curved infant scalp. Two module layouts were implemented: dual-hexagon and triple-hexagon. Using in-built board-to-board connectors, the system can be configured to provide a vast range of possible layouts. Using epoxy resin, thermochromic dyes, and MRI-derived 3D-printed moulds, we constructed an electrically switchable, anatomically accurate dynamic phantom. This phantom was used to quantify the imaging performance of our flexible, modular HD-DOT system. Results: Using one particular module configuration designed to cover the infant sensorimotor system, the device provided 36 source and 48 detector positions, and over 700 viable DOT channels per wavelength, ranging from 10 to ∼ 45 mm over an area of approximately 60 cm 2 . The total weight of this system is only 70 g. The signal changes from the dynamic phantom, while slow, closely simulated real hemodynamic response functions. Using difference images obtained from the phantom, the measured 3D localization error provided by the system at the depth of the cortex was in the of range 3 to 6 mm, and the lateral image resolution at the depth of the neonatal cortex is estimated to be as good as 10 to 12 mm. Conclusions: The HD-DOT system described is ultra-low weight, low profile, can conform to the infant scalp, and provides excellent imaging performance. It is expected that this device will make functional neuroimaging of the neonatal brain at the cot-side significantly more practical and effective.

A wide field-of-view, modular, high-density diffuse optical tomography system for minimally constrained three-dimensional functional neuroimaging.

The ability to produce high-quality images of human brain function in any environment and during unconstrained movement of the subject has long been a goal of neuroimaging research. Diffuse optical tomography, which uses the intensity of back-scattered near-infrared light from multiple source-detector pairs to image changes in haemoglobin concentrations in the brain, is uniquely placed to achieve this goal. Here, we describe a new generation of modular, fibre-less, high-density diffuse optical tomography technology that provides exceptional sensitivity, a large dynamic range, a field-of-view sufficient to cover approximately one-third of the adult scalp, and also incorporates dedicated motion sensing into each module. Using in-vivo measures, we demonstrate a noise-equivalent power of 318 fW, and an effective dynamic range of 142 dB. We describe the application of this system to a novel somatomotor neuroimaging paradigm that involves subjects walking and texting on a smartphone. Our results demonstrate that wearable high-density diffuse optical tomography permits three-dimensional imaging of the human brain function during overt movement of the subject; images of somatomotor cortical activation can be obtained while subjects move in a relatively unconstrained manner, and these images are in good agreement with those obtained while the subjects remain stationary. The scalable nature of the technology we described here paves the way for the routine acquisition of high-quality, three-dimensional, whole-cortex diffuse optical tomography images of cerebral haemodynamics, both inside and outside of the laboratory environment, which has profound implications for neuroscience.

A Scalable Optoelectronic Neural Probe Architecture With Self-Diagnostic Capability.

There is a growing demand for the development of new types of implantable optoelectronics to support both basic neuroscience and optogenetic treatments for neurological disorders. Target specification requirements include multi-site optical stimulation, programmable radiance profile, safe operation, and miniaturization. It is also preferable to have a simple serial interface rather than large numbers of control lines. This paper demonstrates an optrode structure comprising of a standard complementary metal-oxide-semiconductor process with 18 optical stimulation drivers. Furthermore, diagnostic sensing circuitry is incorporated to determine the long-term functionality of the photonic elements. A digital control system is incorporated to allow independent multisite control and serial communication with external control units.

On-Probe Neural Interface ASIC for Combined Electrical Recording and Optogenetic Stimulation.

Neuromodulation technologies are progressing from pacemaking and sensory operations to full closed-loop control. In particular, optogenetics-the genetic modification of light sensitivity into neural tissue allows for simultaneous optical stimulation and electronic recording. This paper presents a neural interface application-specified integrated circuit (ASIC) for intelligent optoelectronic probes. The architecture is designed to enable simultaneous optical neural stimulation and electronic recording. It provides four low noise (2.08  µV) recording channels optimized for recording local field potentials (LFPs) (0.1-300 Hz bandwidth, 5 mV range, sampled 10-bit@4 kHz), which are more stable for chronic applications. For stimulation, it provides six independently addressable optical driver circuits, which can provide both intensity (8-bit resolution across a 1.1 mA range) and pulse-width modulation for high-radiance light emitting diodes (LEDs). The system includes a fully digital interface using a serial peripheral interface (SPI) protocol to allow for use with embedded controllers. The SPI interface is embedded within a finite state machine (FSM), which implements a command interpreter that can send out LFP data whilst receiving instructions to control LED emission. The circuit has been implemented in a commercially available 0.35  µm CMOS technology occupying a 1.95 mm 1.10 mm footprint for mounting onto the head of a silicon probe. Measured results are given for a variety of bench-top, in vitro and in vivo experiments, quantifying system performance and also demonstrating concurrent recording and stimulation within relevant experimental models.

Review of recent progress toward a fiberless, whole-scalp diffuse optical tomography system.

The development of a whole-scalp, high sampling-density diffuse optical tomography (DOT) system is a critical next step in the evolution of the field of diffuse optics. To achieve this with optical fiber bundles is extremely challenging, simply because of the sheer number of bundles required, and the associated challenges of weight and ergonomics. Dispensing with optical fiber bundles and moving to head-mounted optoelectronics can potentially facilitate the advent of a new generation of wearable, whole-scalp technologies that will open up a range of new experimental and clinical applications for diffuse optical measurements. Here, we present a concise review of the significant progress that has been made toward achieving a wearable, fiberless, high-density, whole-scalp DOT system. We identify the key limitations of current technologies and discuss the possible opportunities for future development.

Recent Progress of Development of Optogenetic Implantable Neural Probes.

As a cell type-specific neuromodulation method, optogenetic technique holds remarkable potential for the realisation of advanced neuroprostheses. By genetically expressing light-sensitive proteins such as channelrhodopsin-2 (ChR2) in cell membranes, targeted neurons could be controlled by light. This new neuromodulation technique could then be applied into extensive brain networks and be utilised to provide effective therapies for neurological disorders. However, the development of novel optogenetic implants is still a key challenge in the field. The major requirements include small device dimensions, suitable spatial resolution, high safety, and strong controllability. In this paper, I present a concise review of the significant progress that has been made towards achieving a miniaturised, multifunctional, intelligent optogenetic implant. I identify the key limitations of current technologies and discuss the possible opportunities for future development.