Mechanical processing via passive dynamic properties of the cockroach antenna can facilitate control during rapid running.

The integration of information from dynamic sensory structures operating on a moving body is a challenge for locomoting animals and engineers seeking to design agile robots. As a tactile sensor is a physical linkage mediating mechanical interactions between body and environment, mechanical tuning of the sensor is critical for effective control. We determined the open-loop dynamics of a tactile sensor, specifically the antenna of the American cockroach, Periplaneta americana, an animal that escapes predators by using its antennae during rapid closed-loop tactilely mediated course control. Geometrical measurements and static bending experiments revealed an exponentially decreasing flexural stiffness (EI) from base to tip. Quasi-static experiments with a physical model support the hypothesis that a proximodistally decreasing EI can simplify control by increasing preview distance and allowing effective mapping to a putative control variable--body-to-wall distance--compared with an antenna with constant EI. We measured the free response at the tip of the antenna following step deflections and determined that the antenna rapidly damps large deflections: over 90% of the perturbation is rejected within the first cycle, corresponding to almost one stride period during high-speed running (~50 ms). An impulse-like perturbation near the tip revealed dynamics that were characteristic of an inelastic collision, keeping the antenna in contact with an object after impact. We contend that proximodistally decreasing stiffness, high damping and inelasticity simplify control during high-speed tactile tasks by increasing preview distance, providing a one-dimensional map between antennal bending and body-to-wall distance, and increasing the reliability of tactile information.

Locomotion- and mechanics-mediated tactile sensing: antenna reconfiguration simplifies control during high-speed navigation in cockroaches.

Animals can expend energy to acquire sensory information by emitting signals and/or moving sensory structures. We propose that the energy from locomotion itself could permit control of a sensor, whereby animals use the energy from movement to reconfigure a passive sensor. We investigated high-speed, antenna-mediated tactile navigation in the cockroach Periplaneta americana. We discovered that the passive antennal flagellum can assume two principal mechanical states, such that the tip is either projecting backward or forward. Using a combination of behavioral and robotic experiments, we demonstrate that a switch in the antenna's state is mediated via the passive interactions between the sensor and its environment, and this switch strongly influences wall-tracking control. When the tip of the antenna is projected backward, the animals maintain greater body-to-wall distance with fewer body collisions and less leg-wall contact than when the tip is projecting forward. We hypothesized that distally pointing mechanosensory hairs at the tip of the antenna mediate the switch in state by interlocking with asperities in the wall surface. To test this hypothesis, we performed laser ablation of chemo-mechanosensory hairs and added artificial hairs to a robotic antenna. In both the natural and artificial systems, the presence of hairs categorically increased an antenna's probability of switching state. Antennal hairs, once thought to only play a role in sensing, are sufficient for mechanically reconfiguring the state of the entire antenna when coupled with forward motion. We show that the synergy between antennal mechanics, locomotion and the environment simplifies tactile sensing.

In situ guidance for MRI interventions using projected feedback.

PURPOSE: To develop and evaluate an augmented reality instrument guidance system for MRI-guided needle placement procedures such as musculoskeletal biopsy and arthrography. Our system guides the physician to insert a needle toward a target while looking at the insertion site without requiring special headgear. METHODS: The system is comprised of a pair of stereo cameras, a projector, and a computational unit with a touch screen. All components are designed to be used within the MRI suite (Zone 4). Multi-modality fiducial markers called VisiMARKERs, detectable in both MRI and camera images, facilitate automatic registration after the initial scan. The navigation feedback is projected directly onto the intervention site allowing the interventionalist to keep their focus on the insertion site instead of a secondary monitor which is often not in front of them. RESULTS: We evaluated the feasibility and accuracy of this system on custom-built shoulder phantoms. Two radiologists used the system to select targets and entry points on initial MRIs of these phantoms over three sessions. They performed 80 needle insertions following the projected guidance. The system targeting error was 1.09 mm, and the overall error was 2.29 mm. CONCLUSION: We demonstrated both feasibility and accuracy of this MRI navigation system. The system operated without any problems inside the MRI suite close to the MRI bore. The two radiologists were able to easily follow the guidance and place the needle close to the target without any intermediate imaging.

Wearable Mechatronic Ultrasound-integrated AR Navigation System for Lumbar Puncture Guidance.

As one of the most commonly performed spinal interventions in routine clinical practice, lumbar punctures are usually done with only hand palpation and trial-and-error. Failures can prolong procedure time and introduce complications such as cerebrospinal fluid leaks and headaches. Therefore, an effective needle insertion guidance method is desired. In this work, we present a complete lumbar puncture guidance system with the integration of (1) a wearable mechatronic ultrasound imaging device, (2) volume-reconstruction and bone surface estimation algorithms and (3) two alternative augmented reality user interfaces for needle guidance, including a HoloLens-based and a tablet-based solution. We conducted a quantitative evaluation of the end-to-end navigation accuracy, which shows that our system can achieve an overall needle navigation accuracy of 2.83 mm and 2.76 mm for the Tablet-based and the HoloLens-based solutions, respectively. In addition, we conducted a preliminary user study to qualitatively evaluate the effectiveness and ergonomics of our system on lumbar phantoms. The results show that users were able to successfully reach the target in an average of 1.12 and 1.14 needle insertion attempts for Tablet-based and HoloLens-based systems, respectively, exhibiting the potential to reduce the failure rates of lumbar puncture procedures with the proposed lumbar-puncture guidance.

Computer-assisted needle navigation for pediatric internal jugular central venous cannulation: A feasibility study.

INTRODUCTION: Vascular access for central venous catheter placement is technically challenging in children. Ultrasound guidance is recommended for pediatric central venous catheter placement, yet many practitioners rely on imprecise anatomic landmark techniques risking procedure failure due to difficulty mastering ultrasound guidance. A novel navigation system provides a visual overlay on real-time ultrasound images to depict needle trajectory and tip location during cannulation. We report the first pediatric study assessing feasibility and preliminary safety of using a computer-assisted needle navigation system to aid in central venous access. METHODS: A prospective, institutional review board-approved feasibility study was performed. All participants provided written informed consent. Ten patients (mean age: 11.4 years, five males) underwent central venous catheter placement with ultrasound and navigation system guidance. All procedures were performed by interventional radiologists expert in vascular access. Feasibility was measured through binary (yes/no) responses from participating users assessing device usability and feasibility. The number of needle passes and procedure time measures were also recorded. RESULTS: Internal jugular veins (seven right sided, three left sided) were cannulated in all patients with no complications. Users confirmed navigation system feasibility in all 10 participants. Mean vein diameter and depth was 13.3 × 9.8 ± 3.4 × 2.1 and 7.0 ± 1.7 mm, respectively. Successful cannulation occurred in all patients and required only a single needle pass in 9 of 10 patients. Mean device set-up and vascular access times were 5:31 ± 2:28 and 1:48 ± 2:35 min, respectively. CONCLUSION: This pilot study suggests that it is feasible to use a novel computer-assisted needle navigation system to safely obtain central venous access under ultrasound guidance in pediatric patients.

High-resolution behavioral mapping of electric fishes in Amazonian habitats.

The study of animal behavior has been revolutionized by sophisticated methodologies that identify and track individuals in video recordings. Video recording of behavior, however, is challenging for many species and habitats including fishes that live in turbid water. Here we present a methodology for identifying and localizing weakly electric fishes on the centimeter scale with subsecond temporal resolution based solely on the electric signals generated by each individual. These signals are recorded with a grid of electrodes and analyzed using a two-part algorithm that identifies the signals from each individual fish and then estimates the position and orientation of each fish using Bayesian inference. Interestingly, because this system involves eavesdropping on electrocommunication signals, it permits monitoring of complex social and physical interactions in the wild. This approach has potential for large-scale non-invasive monitoring of aquatic habitats in the Amazon basin and other tropical freshwater systems.

Dynamic modulation of visual and electrosensory gains for locomotor control.

Animal nervous systems resolve sensory conflict for the control of movement. For example, the glass knifefish, Eigenmannia virescens, relies on visual and electrosensory feedback as it swims to maintain position within a moving refuge. To study how signals from these two parallel sensory streams are used in refuge tracking, we constructed a novel augmented reality apparatus that enables the independent manipulation of visual and electrosensory cues to freely swimming fish (n = 5). We evaluated the linearity of multisensory integration, the change to the relative perceptual weights given to vision and electrosense in relation to sensory salience, and the effect of the magnitude of sensory conflict on sensorimotor gain. First, we found that tracking behaviour obeys superposition of the sensory inputs, suggesting linear sensorimotor integration. In addition, fish rely more on vision when electrosensory salience is reduced, suggesting that fish dynamically alter sensorimotor gains in a manner consistent with Bayesian integration. However, the magnitude of sensory conflict did not significantly affect sensorimotor gain. These studies lay the theoretical and experimental groundwork for future work investigating multisensory control of locomotion.