SonoMyoNet: A Convolutional Neural Network for Predicting Isometric Force from Highly Sparse Ultrasound Images.

Ultrasound imaging or sonomyography has been found to be a robust modality for measuring muscle activity due to its ability to image deep-seated muscles directly while providing superior spatiotemporal specificity compared to surface electromyography-based techniques. Quantifying the morphological changes during muscle activity involves computationally expensive approaches for tracking muscle anatomical structures or extracting features from brightness-mode (B-mode) images and amplitude-mode (A-mode) signals. This paper uses an offline regression convolutional neural network (CNN) called SonoMyoNet to estimate continuous isometric force from sparse ultrasound scanlines. SonoMyoNet learns features from a few equispaced scanlines selected from B-mode images and utilizes the learned features to estimate continuous isometric force accurately. The performance of SonoMyoNet was evaluated by varying the number of scanlines to simulate the placement of multiple single-element ultrasound transducers in a wearable system. Results showed that SonoMyoNet could accurately predict isometric force with just four scanlines and is immune to speckle noise and shifts in the scanline location. Thus, the proposed network reduces the computational load involved in feature tracking algorithms and estimates muscle force from the global features of sparse ultrasound images.

A Sonomyography-Based Muscle Computer Interface for Individuals With Spinal Cord Injury.

Impairment of hand functions in individuals with spinal cord injury (SCI) severely disrupts activities of daily living. Recent advances have enabled rehabilitation assisted by robotic devices to augment the residual function of the muscles. Traditionally, electromyography-based muscle activity sensing interfaces have been utilized to sense volitional motor intent to drive robotic assistive devices. However, the dexterity and fidelity of control that can be achieved with electromyography-based control have been limited due to inherent limitations in signal quality. We have developed and tested a muscle-computer interface (MCI) utilizing sonomyography to provide control of a virtual cursor for individuals with motor-incomplete spinal cord injury. We demonstrate that individuals with SCI successfully gained control of a virtual cursor by utilizing contractions of muscles of the wrist joint. The sonomyography-based interface enabled control of the cursor at multiple graded levels demonstrating the ability to achieve accurate and stable endpoint control. Our sonomyography-based muscle-computer interface can enable dexterous control of upper-extremity assistive devices for individuals with motor-incomplete SCI.