Intracortical microstimulation of human somatosensory cortex is sufficient to induce perceptual biases.

Time-order error, a psychophysical phenomenon in which the duration in between successive stimuli alters perception, has been studied for decades by neuroscientists and psychologists. To date, however, the locus of these effects is unknown. We use intracortical microstimulation of somatosensory cortex in humans as a tool to bypass initial stages of processing and restrict the possible locations that signals could be modified. We find that, using both amplitude discrimination and magnitude estimation paradigms, intracortical microstimulation reliably evoked time-order errors across all participants. Points of subjective equality were symmetrically shifted during amplitude discrimination experiments and the intensity of a successive stimulus was perceived as being more intense when compared to single stimulus trials in magnitude estimation experiments. The error was reduced for both paradigms at longer inter-stimulus intervals. These results show that direct activation of primary somatosensory cortex is sufficient to induce time-order errors.

A roadmap for implanting microelectrode arrays to evoke tactile sensations through intracortical microstimulation.

Intracortical microstimulation (ICMS) is a method for restoring sensation to people with paralysis as part of a bidirectional brain-computer interface to restore upper limb function. Evoking tactile sensations of the hand through ICMS requires precise targeting of implanted electrodes. Here we describe the presurgical imaging procedures used to generate functional maps of the hand area of the somatosensory cortex and subsequent planning that guided the implantation of intracortical microelectrode arrays. In five participants with cervical spinal cord injury, across two study locations, this procedure successfully enabled ICMS-evoked sensations localized to at least the first four digits of the hand. The imaging and planning procedures developed through this clinical trial provide a roadmap for other brain-computer interface studies to ensure successful placement of stimulation electrodes.

Restoration of sensory feedback from the foot and reduction of phantom limb pain via closed-loop spinal cord stimulation.

Restoring somatosensory feedback in individuals with lower-limb amputations would reduce the risk of falls and alleviate phantom limb pain. Here we show, in three individuals with transtibial amputation (one traumatic and two owing to diabetic peripheral neuropathy), that sensations from the missing foot, with control over their location and intensity, can be evoked via lateral lumbosacral spinal cord stimulation with commercially available electrodes and by modulating the intensity of stimulation in real time on the basis of signals from a wireless pressure-sensitive shoe insole. The restored somatosensation via closed-loop stimulation improved balance control (with a 19-point improvement in the composite score of the Sensory Organization Test in one individual) and gait stability (with a 5-point improvement in the Functional Gait Assessment in one individual). And over the implantation period of the stimulation leads, the three individuals experienced a clinically meaningful decrease in phantom limb pain (with an average reduction of nearly 70% on a visual analogue scale). Our findings support the further clinical assessment of lower-limb neuroprostheses providing somatosensory feedback.

Microstimulation of human somatosensory cortex evokes task-dependent, spatially patterned responses in motor cortex.

The primary motor (M1) and somatosensory (S1) cortices play critical roles in motor control but the signaling between these structures is poorly understood. To fill this gap, we recorded - in three participants in an ongoing human clinical trial (NCT01894802) for people with paralyzed hands - the responses evoked in the hand and arm representations of M1 during intracortical microstimulation (ICMS) in the hand representation of S1. We found that ICMS of S1 activated some M1 neurons at short, fixed latencies consistent with monosynaptic activation. Additionally, most of the ICMS-evoked responses in M1 were more variable in time, suggesting indirect effects of stimulation. The spatial pattern of M1 activation varied systematically: S1 electrodes that elicited percepts in a finger preferentially activated M1 neurons excited during that finger's movement. Moreover, the indirect effects of S1 ICMS on M1 were context dependent, such that the magnitude and even sign relative to baseline varied across tasks. We tested the implications of these effects for brain-control of a virtual hand, in which ICMS conveyed tactile feedback. While ICMS-evoked activation of M1 disrupted decoder performance, this disruption was minimized using biomimetic stimulation, which emphasizes contact transients at the onset and offset of grasp, and reduces sustained stimulation.

Tessellation of artificial touch via microstimulation of human somatosensory cortex.

When we interact with objects, we rely on signals from the hand that convey information about the object and our interaction with it. A basic feature of these interactions, the locations of contacts between the hand and object, is often only available via the sense of touch. Information about locations of contact between a brain-controlled bionic hand and an object can be signaled via intracortical microstimulation (ICMS) of somatosensory cortex (S1), which evokes touch sensations that are localized to a specific patch of skin. To provide intuitive location information, tactile sensors on the robotic hand drive ICMS through electrodes that evoke sensations at skin locations matching sensor locations. This approach requires that ICMS-evoked sensations be focal, stable, and distributed over the hand. To systematically investigate the localization of ICMS-evoked sensations, we analyzed the projected fields (PFs) of ICMS-evoked sensations - their location and spatial extent - from reports obtained over multiple years from three participants implanted with microelectrode arrays in S1. First, we found that PFs vary widely in their size across electrodes, are highly stable within electrode, are distributed over large swaths of each participant's hand, and increase in size as the amplitude or frequency of ICMS increases. Second, while PF locations match the locations of the receptive fields (RFs) of the neurons near the stimulating electrode, PFs tend to be subsumed by the corresponding RFs. Third, multi-channel stimulation gives rise to a PF that reflects the conjunction of the PFs of the component channels. By stimulating through electrodes with largely overlapping PFs, then, we can evoke a sensation that is experienced primarily at the intersection of the component PFs. To assess the functional consequence of this phenomenon, we implemented multichannel ICMS-based feedback in a bionic hand and demonstrated that the resulting sensations are more localizable than are those evoked via single-channel ICMS.

Biomimetic multi-channel microstimulation of somatosensory cortex conveys high resolution force feedback for bionic hands.

Manual interactions with objects are supported by tactile signals from the hand. This tactile feedback can be restored in brain-controlled bionic hands via intracortical microstimulation (ICMS) of somatosensory cortex (S1). In ICMS-based tactile feedback, contact force can be signaled by modulating the stimulation intensity based on the output of force sensors on the bionic hand, which in turn modulates the perceived magnitude of the sensation. In the present study, we gauged the dynamic range and precision of ICMS-based force feedback in three human participants implanted with arrays of microelectrodes in S1. To this end, we measured the increases in sensation magnitude resulting from increases in ICMS amplitude and participant's ability to distinguish between different intensity levels. We then assessed whether we could improve the fidelity of this feedback by implementing "biomimetic" ICMS-trains, designed to evoke patterns of neuronal activity that more closely mimic those in natural touch, and by delivering ICMS through multiple channels at once. We found that multi-channel biomimetic ICMS gives rise to stronger and more distinguishable sensations than does its single-channel counterpart. Finally, we implemented biomimetic multi-channel feedback in a bionic hand and had the participant perform a compliance discrimination task. We found that biomimetic multi-channel tactile feedback yielded improved discrimination over its single-channel linear counterpart. We conclude that multi-channel biomimetic ICMS conveys finely graded force feedback that more closely approximates the sensitivity conferred by natural touch.

Restoration of sensory information via bionic hands.

Individuals who have lost the use of their hands because of amputation or spinal cord injury can use prosthetic hands to restore their independence. A dexterous prosthesis requires the acquisition of control signals that drive the movements of the robotic hand, and the transmission of sensory signals to convey information to the user about the consequences of these movements. In this Review, we describe non-invasive and invasive technologies for conveying artificial sensory feedback through bionic hands, and evaluate the technologies' long-term prospects.

The neural basis of tactile texture perception.

Running our fingers across a textured surface gives rise to two types of skin deformations, each transduced by different tactile nerve fibers. Coarse features produce large-scale skin deformations whose spatial configuration is reflected in the spatial pattern of activation of some tactile fibers. Scanning a finely textured surface elicits vibrations in the skin, which in turn evoked temporally patterned responses in other fibers. These two neural codes-spatial and temporal-drive a spectrum of neural response properties in somatosensory cortex: At one extreme, neurons are sensitive to spatial patterns and encode coarse features; at the other extreme, neurons are sensitive to vibrations and encode fine features. While the texture responses of nerve fibers are dependent on scanning speed, those of cortical neurons are less so, giving rise to a speed invariant texture percept. Neurons in high-level somatosensory cortices combine information about texture with information about task variables.

Prehension kinematics in humans and macaques.

Nonhuman primates, especially rhesus macaques, have been a dominant model to study sensorimotor control of the upper limbs. Indeed, human and macaques have similar hands and homologous neural circuits to mediate manual behavior. However, few studies have systematically and quantitatively compared the manual behaviors of the two species. Such comparison is critical for assessing the validity of using the macaque sensorimotor system as a model of its human counterpart. In this study, we systematically compared the prehensile behaviors of humans and rhesus macaques using an identical experimental setup. We found human and macaque prehension kinematics to be generally similar with a few subtle differences. Although the structure of the preshaping hand postures is similar in humans and macaques, human postures are more object-specific and human joints are less intercorrelated. Conversely, monkeys demonstrate more stereotypical preshaping behaviors that are common across all objects and more variability in their postures across repeated presentations of the same object. Despite these subtle differences in manual behavior between humans and monkeys, our results bolster the use of the macaque model to understand the neural mechanisms of manual dexterity in humans.NEW & NOTEWORTHY Macaques have been a dominant animal model to study the neural mechanisms of human dexterity because they exhibit complex manual behavior. We show that the kinematics of prehension, a critical dexterous behavior, are largely similar in humans and macaques. However, human preshaping postures are more object-specific and the movement of human digits is less correlated with each other. The thumb, index, and wrist are major drivers of these interspecies differences.

Perceived timing of cutaneous vibration and intracortical microstimulation of human somatosensory cortex.

BACKGROUND: Intracortical microstimulation (ICMS) of somatosensory cortex can partially restore the sense of touch. Though ICMS bypasses much of the neuraxis, prior studies have found that conscious detection of touch elicited by ICMS lags behind the detection of cutaneous vibration. These findings may have been influenced by mismatched stimulus intensities, which can impact temporal perception. OBJECTIVE: Evaluate the relative latency at which intensity-matched vibration and ICMS are perceived by a human participant. METHODS: One person implanted with microelectrode arrays in somatosensory cortex performed reaction time and temporal order judgment (TOJ) tasks. To measure reaction time, the participant reported when he perceived vibration or ICMS. In the TOJ task, vibration and ICMS were sequentially presented and the participant reported which stimulus occurred first. To verify that the participant could distinguish between stimuli, he also performed a modality discrimination task, in which he indicated if he felt vibration, ICMS, or both. RESULTS: When vibration was matched in perceived intensity to high-amplitude ICMS, vibration was perceived, on average, 48 ms faster than ICMS. However, in the TOJ task, both sensations arose at comparable latencies, with points of subjective simultaneity not significantly different from zero. The participant could discriminate between tactile modalities above chance level but was more inclined to report feeling vibration than ICMS. CONCLUSIONS: The latencies of ICMS-evoked percepts are slower than their mechanical counterparts. However, differences in latencies are small, particularly when stimuli are matched for intensity, implying that ICMS-based somatosensory feedback is rapid enough to be effective in neuroprosthetic applications.

Texture is encoded in precise temporal spiking patterns in primate somatosensory cortex.

Humans are exquisitely sensitive to the microstructure and material properties of surfaces. In the peripheral nerves, texture information is conveyed via two mechanisms: coarse textural features are encoded in spatial patterns of activation that reflect their spatial layout, and fine features are encoded in highly repeatable, texture-specific temporal spiking patterns evoked as the skin moves across the surface. Here, we examined whether this temporal code is preserved in the responses of neurons in somatosensory cortex. We scanned a diverse set of everyday textures across the fingertip of awake macaques while recording the responses evoked in individual cortical neurons. We found that temporal spiking patterns are highly repeatable across multiple presentations of the same texture, with millisecond precision. As a result, texture identity can be reliably decoded from the temporal patterns themselves, even after information carried in the spike rates is eliminated. However, the combination of rate and timing is more informative than either code in isolation. The temporal precision of the texture response is heterogenous across cortical neurons and depends on the submodality composition of their input and on their location along the somatosensory neuraxis. Furthermore, temporal spiking patterns in cortex dilate and contract with decreases and increases in scanning speed, respectively, and this systematic relationship between speed and patterning may contribute to the observed perceptual invariance to speed. Finally, we find that the quality of a texture percept can be better predicted when these temporal patterns are taken into consideration. We conclude that high-precision spike timing complements rate-based signals to encode texture in somatosensory cortex.

Proprioceptive sensitivity to imposed finger deflections.

Hand proprioception, the sense of the posture and movements of the wrist and digits, is critical to dexterous manual behavior and to stereognosis, the ability to sense the three-dimensional structure of objects held in the hand. To better understand this sensory modality and its role in hand function, we sought to characterize the acuity with which the postures and movements of finger joints are sensed. To this end, we measured the ability of human subjects to discriminate changes in posture and speed around the three joints of the index finger. In these experiments, we isolated the sensory component by imposing the postures on an otherwise still hand, to complement other studies in which subjects made judgments on actively achieved postures. We found that subjects could reliably sense 12-16% changes in joint angle and 18-32% changes in joint speed. Furthermore, the acuity for posture and speed was comparable across the three joints of the finger. Finally, task performance was unaffected by the presence of a vibratory stimulus, calling into question the role of cutaneous cues in hand proprioception.NEW & NOTEWORTHY Manual dexterity and stereognosis are supported by two exquisite sensory systems, namely touch and proprioception. Here, we measure the sensitivity of hand proprioception and show that humans can sense the posture and movements of the fingers with great accuracy. We also show that application of a skin vibration does not impair sensitivity, suggesting that proprioceptive acuity relies primarily on receptors in the muscles (and possibly tendons) rather than the skin.

Frequency Shapes the Quality of Tactile Percepts Evoked through Electrical Stimulation of the Nerves.

Electrical stimulation of the peripheral nerves of human participants provides a unique opportunity to study the neural determinants of perceptual quality using a causal manipulation. A major challenge in the study of neural coding of touch has been to isolate the role of spike timing-at the scale of milliseconds or tens of milliseconds-in shaping the sensory experience. In the present study, we address this question by systematically varying the pulse frequency (PF) of electrical stimulation pulse trains delivered to the peripheral nerves of seven participants with upper and lower extremity limb loss via chronically implanted neural interfaces. We find that increases in PF lead to systematic increases in perceived frequency, up to ∼50 Hz, at which point further changes in PF have little to no impact on sensory quality. Above this transition frequency, ratings of perceived frequency level off, the ability to discriminate changes in PF is abolished, and verbal descriptors selected to characterize the sensation change abruptly. We conclude that sensation quality is shaped by temporal patterns of neural activation, even if these patterns are imposed on a fixed neural population, but this temporal patterning can only be resolved up to ∼50 Hz. These findings highlight the importance of spike timing in shaping the quality of a sensation and will contribute to the development of encoding strategies for conveying touch feedback through bionic hands and feet.SIGNIFICANCE STATEMENT A major challenge in the study of neural coding of touch has been to understand how temporal patterns in neuronal responses shape the sensory experience. We address this question by varying the pulse frequency (PF) of electrical pulse trains delivered through implanted nerve interfaces in seven amputees. We concomitantly vary pulse width to separate the effect of changing PF on sensory quality from its effect on perceived magnitude. We find that increases in PF lead to increases in perceived frequency, a qualitative dimension, up to ∼50 Hz, beyond which changes in PF have little impact on quality. We conclude that temporal patterning in the neuronal response can shape quality and discuss the implications for restoring touch via neural interfaces.

The science and engineering behind sensitized brain-controlled bionic hands.

Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.

Intracortical Somatosensory Stimulation to Elicit Fingertip Sensations in an Individual With Spinal Cord Injury.

BACKGROUND AND OBJECTIVES: The restoration of touch to fingers and fingertips is critical to achieving dexterous neuroprosthetic control for individuals with sensorimotor dysfunction. However, localized fingertip sensations have not been evoked via intracortical microstimulation (ICMS). METHODS: Using a novel intraoperative mapping approach, we implanted electrode arrays in the finger areas of left and right somatosensory cortex and delivered ICMS over a 2-year period in a human participant with spinal cord injury. RESULTS: Stimulation evoked tactile sensations in 8 fingers, including fingertips, spanning both hands. Evoked percepts followed expected somatotopic arrangements. The subject was able to reliably identify up to 7 finger-specific sites spanning both hands in a finger discrimination task. The size of the evoked percepts was on average 33% larger than a finger pad, as assessed via manual markings of a hand image. The size of the evoked percepts increased modestly with increased stimulation intensity, growing 21% as pulse amplitude increased from 20 to 80 µA. Detection thresholds were estimated on a subset of electrodes, with estimates of 9.2 to 35 µA observed, roughly consistent with prior studies. DISCUSSION: These results suggest that ICMS can enable the delivery of consistent and localized fingertip sensations during object manipulation by neuroprostheses for individuals with somatosensory deficits. CLINICALTRIALSGOV IDENTIFIER: NCT03161067.

Stoney vs. Histed: Quantifying the spatial effects of intracortical microstimulation.

BACKGROUND: Intracortical microstimulation (ICMS) is used to map neural circuits and restore lost sensory modalities such as vision, hearing, and somatosensation. The spatial effects of ICMS remain controversial: Stoney and colleagues proposed that the volume of somatic activation increased with stimulation intensity, while Histed et al., suggested activation density, but not somatic activation volume, increases with stimulation intensity. OBJECTIVE: We used computational modeling to quantify the spatial effects of ICMS intensity and unify the apparently paradoxical findings of Histed and Stoney. METHODS: We implemented a biophysically-based computational model of a cortical column comprising neurons with realistic morphology and representative synapses. We quantified the spatial effects of single pulses and short trains of ICMS, including the volume of activated neurons and the density of activated neurons as a function of stimulation intensity. RESULTS: At all amplitudes, the dominant mode of somatic activation was by antidromic propagation to the soma following axonal activation, rather than via transsynaptic activation. There were no occurrences of direct activation of somata or dendrites. The volume over which antidromic action potentials were initiated grew with stimulation amplitude, while the volume of somatic activation increased marginally. However, the density of somatic activation within the activated volume increased with stimulation amplitude. CONCLUSIONS: The results resolve the apparent paradox between Stoney and Histed's results by demonstrating that the volume over which action potentials are initiated grows with ICMS amplitude, consistent with Stoney. However, the volume occupied by the activated somata remains approximately constant, while the density of activated neurons within that volume increase, consistent with Histed.

Intracortical microstimulation of somatosensory cortex enables object identification through perceived sensations.

Advances in brain-machine interfaces have helped restore function and independence for individuals with sensorimotor deficits; however, providing efficient and effective sensory feedback remains challenging. Intracortical microstimulation (ICMS) of sensorimotor brain regions is a promising technique for providing bioinspired sensory feedback. In a human participant with chronically-implanted microelectrode arrays, we provided ICMS to the primary somatosensory cortex to generate tactile percepts in his hand. In a 3-choice object identification task, the participant identified virtual objects using tactile sensory feedback and no visual information. We evaluated three different stimulation paradigms, each with a different weighting of the grip force and its derivative, to explore the potential benefits of a more bioinspired stimulation strategy. In all paradigms, the participant's ability to identify the objects was above-chance, with object identification accuracy reaching 80% correct when using only sustained grip force feedback and 76.7% when using equal weighting of both sustained grip force and its derivative. These results demonstrate that bioinspired ICMS can provide sensory feedback that is functionally beneficial in sensorimotor tasks. Designing more efficient stimulation paradigms is important because it will allow us to 1) provide safer stimulation delivery methods that reduce overall injected charge without sacrificing function and 2) more effectively transmit sensory information to promote intuitive integration and usage by the human body.

Sensory computations in the cuneate nucleus of macaques.

Tactile nerve fibers fall into a few classes that can be readily distinguished based on their spatiotemporal response properties. Because nerve fibers reflect local skin deformations, they individually carry ambiguous signals about object features. In contrast, cortical neurons exhibit heterogeneous response properties that reflect computations applied to convergent input from multiple classes of afferents, which confer to them a selectivity for behaviorally relevant features of objects. The conventional view is that these complex response properties arise within the cortex itself, implying that sensory signals are not processed to any significant extent in the two intervening structures-the cuneate nucleus (CN) and the thalamus. To test this hypothesis, we recorded the responses evoked in the CN to a battery of stimuli that have been extensively used to characterize tactile coding in both the periphery and cortex, including skin indentations, vibrations, random dot patterns, and scanned edges. We found that CN responses are more similar to their cortical counterparts than they are to their inputs: CN neurons receive input from multiple classes of nerve fibers, they have spatially complex receptive fields, and they exhibit selectivity for object features. Contrary to consensus, then, the CN plays a key role in processing tactile information.

The neural mechanisms of manual dexterity.

The hand endows us with unparalleled precision and versatility in our interactions with objects, from mundane activities such as grasping to extraordinary ones such as virtuoso pianism. The complex anatomy of the human hand combined with expansive and specialized neuronal control circuits allows a wide range of precise manual behaviours. To support these behaviours, an exquisite sensory apparatus, spanning the modalities of touch and proprioception, conveys detailed and timely information about our interactions with objects and about the objects themselves. The study of manual dexterity provides a unique lens into the sensorimotor mechanisms that endow the nervous system with the ability to flexibly generate complex behaviour.