Audiovisualization of real-time neuroimaging data.

Advancements in brain imaging techniques have significantly expanded the size and complexity of real-time neuroimaging and behavioral data. However, identifying patterns, trends and synchronies within these datasets presents a significant computational challenge. Here, we demonstrate an approach that can translate time-varying neuroimaging data into unique audiovisualizations consisting of audible representations of dynamic data merged with simplified, color-coded movies of spatial components and behavioral recordings. Multiple variables can be encoded as different musical instruments, letting the observer differentiate and track multiple dynamic parameters in parallel. This representation enables intuitive assimilation of these datasets for behavioral correlates and spatiotemporal features such as patterns, rhythms and motifs that could be difficult to detect through conventional data interrogation methods. These audiovisual representations provide a novel perception of the organization and patterns of real-time activity in the brain, and offer an intuitive and compelling method for complex data visualization for a wider range of applications.

Electrical Stimulation of Regenerative Peripheral Nerve Interfaces (RPNIs) Induces Referred Sensations in People With Upper Limb Loss.

Individuals with upper limb loss lack sensation of the missing hand, which can negatively impact their daily function. Several groups have attempted to restore this sensation through electrical stimulation of residual nerves. The purpose of this study was to explore the utility of regenerative peripheral nerve interfaces (RPNIs) in eliciting referred sensation. In four participants with upper limb loss, we characterized the quality and location of sensation elicited through electrical stimulation of RPNIs over time. We also measured functional stimulation ranges (sensory perception and discomfort thresholds), sensitivity to changes in stimulation amplitude, and ability to differentiate objects of different stiffness and sizes. Over a period of up to 54 months, stimulation of RPNIs elicited sensations that were consistent in quality (e.g. tingling, kinesthesia) and were perceived in the missing hand and forearm. The location of elicited sensation was partially-stable to stable in 13 of 14 RPNIs. For 5 of 7 RPNIs tested, participants demonstrated a sensitivity to changes in stimulation amplitude, with an average just noticeable difference of 45 nC. In a case study, one participant was provided RPNI stimulation proportional to prosthetic grip force. She identified four objects of different sizes and stiffness with 56% accuracy with stimulation alone and 100% accuracy when stimulation was combined with visual feedback of hand position. Collectively, these experiments suggest that RPNIs have the potential to be used in future bi-directional prosthetic systems.

Cortex-wide neural dynamics predict behavioral states and provide a neural basis for resting-state dynamic functional connectivity.

Although resting-state functional magnetic resonance imaging (fMRI) studies have observed dynamically changing brain-wide networks of correlated activity, fMRI's dependence on hemodynamic signals makes results challenging to interpret. Meanwhile, emerging techniques for real-time recording of large populations of neurons have revealed compelling fluctuations in neuronal activity across the brain that are obscured by traditional trial averaging. To reconcile these observations, we use wide-field optical mapping to simultaneously record pan-cortical neuronal and hemodynamic activity in awake, spontaneously behaving mice. Some components of observed neuronal activity clearly represent sensory and motor function. However, particularly during quiet rest, strongly fluctuating patterns of activity across diverse brain regions contribute greatly to interregional correlations. Dynamic changes in these correlations coincide with changes in arousal state. Simultaneously acquired hemodynamics depict similar brain-state-dependent correlation shifts. These results support a neural basis for dynamic resting-state fMRI, while highlighting the importance of brain-wide neuronal fluctuations in the study of brain state.