Autonomous Optimization of Targeted Stimulation of Neuronal Networks.

Driven by clinical needs and progress in neurotechnology, targeted interaction with neuronal networks is of increasing importance. Yet, the dynamics of interaction between intrinsic ongoing activity in neuronal networks and their response to stimulation is unknown. Nonetheless, electrical stimulation of the brain is increasingly explored as a therapeutic strategy and as a means to artificially inject information into neural circuits. Strategies using regular or event-triggered fixed stimuli discount the influence of ongoing neuronal activity on the stimulation outcome and are therefore not optimal to induce specific responses reliably. Yet, without suitable mechanistic models, it is hardly possible to optimize such interactions, in particular when desired response features are network-dependent and are initially unknown. In this proof-of-principle study, we present an experimental paradigm using reinforcement-learning (RL) to optimize stimulus settings autonomously and evaluate the learned control strategy using phenomenological models. We asked how to (1) capture the interaction of ongoing network activity, electrical stimulation and evoked responses in a quantifiable 'state' to formulate a well-posed control problem, (2) find the optimal state for stimulation, and (3) evaluate the quality of the solution found. Electrical stimulation of generic neuronal networks grown from rat cortical tissue in vitro evoked bursts of action potentials (responses). We show that the dynamic interplay of their magnitudes and the probability to be intercepted by spontaneous events defines a trade-off scenario with a network-specific unique optimal latency maximizing stimulus efficacy. An RL controller was set to find this optimum autonomously. Across networks, stimulation efficacy increased in 90% of the sessions after learning and learned latencies strongly agreed with those predicted from open-loop experiments. Our results show that autonomous techniques can exploit quantitative relationships underlying activity-response interaction in biological neuronal networks to choose optimal actions. Simple phenomenological models can be useful to validate the quality of the resulting controllers.

Tracking axon initial segment plasticity using high-density microelectrode arrays: A computational study.

Despite being composed of highly plastic neurons with extensive positive feedback, the nervous system maintains stable overall function. To keep activity within bounds, it relies on a set of negative feedback mechanisms that can induce stabilizing adjustments and that are collectively termed "homeostatic plasticity." Recently, a highly excitable microdomain, located at the proximal end of the axon-the axon initial segment (AIS)-was found to exhibit structural modifications in response to activity perturbations. Though AIS plasticity appears to serve a homeostatic purpose, many aspects governing its expression and its functional role in regulating neuronal excitability remain elusive. A central challenge in studying the phenomenon is the rich heterogeneity of its expression (distal/proximal relocation, shortening, lengthening) and the variability of its functional role. A potential solution is to track AISs of a large number of neurons over time and attempt to induce structural plasticity in them. To this end, a promising approach is to use extracellular electrophysiological readouts to track a large number of neurons at high spatiotemporal resolution by means of high-density microelectrode arrays (HD-MEAs). However, an analysis framework that reliably identifies specific activity signatures that uniquely map on to underlying microstructural changes is missing. In this study, we assessed the feasibility of such a task and used the distal relocation of the AIS as an exemplary problem. We used sophisticated computational models to systematically explore the relationship between incremental changes in AIS positions and the specific consequences observed in simulated extracellular field potentials. An ensemble of feature changes in the extracellular fields that reliably characterize AIS plasticity was identified. We trained models that could detect these signatures with remarkable accuracy. Based on these findings, we propose a hybrid analysis framework that could potentially enable high-throughput experimental studies of activity-dependent AIS plasticity using HD-MEAs.

A modulated template-matching approach to improve spike sorting of bursting neurons.

In extracellular neural electrophysiology, individual spikes have to be assigned to their cell of origin in a procedure called "spike sorting". Spike sorting is an unsupervised problem, since no ground-truth information is generally available. Here, we focus on improving spike sorting performance, particularly during periods of high synchronous activity or so-called "bursting". Bursting entails systematic changes in spike shapes and amplitudes and remains a challenge for current spike sorting schemes. We use realistic simulated bursting recordings of high-density micro-electrode arrays (HD-MEAs) and we present a fully automated algorithm based on template matching with a focus on recovering missed spikes during bursts. To compare and benchmark spike-sorting performance after applying our method, we used ground-truth information of simulated recordings. We show that our approach can be effective in improving spike sorting performance during bursting. Further validation with experimental recordings is necessary.