Closing the loop in minimally supervised human-robot interaction: formative and summative feedback.

Human instructors fluidly communicate with hand gestures, head and body movements, and facial expressions, but robots rarely leverage these complementary cues. A minimally supervised social robot with such skills could help people exercise and learn new activities. Thus, we investigated how nonverbal feedback from a humanoid robot affects human behavior. Inspired by the education literature, we evaluated formative feedback (real-time corrections) and summative feedback (post-task scores) for three distinct tasks: positioning in the room, mimicking the robot's arm pose, and contacting the robot's hands. Twenty-eight adults completed seventy-five 30-s-long trials with no explicit instructions or experimenter help. Motion-capture data analysis shows that both formative and summative feedback from the robot significantly aided user performance. Additionally, formative feedback improved task understanding. These results show the power of nonverbal cues based on human movement and the utility of viewing feedback through formative and summative lenses.

A Comparative Analysis of Smartphone and Standard Tools for Touch Perception Assessment Across Multiple Body Sites.

Tactile perception plays an important role in activities of daily living, and it can be impaired in individuals with certain medical conditions. The most common tools used to assess tactile sensation, the Semmes-Weinstein monofilaments and the 128 Hz tuning fork, have poor repeatability and resolution. Long term, we aim to provide a repeatable, high-resolution testing platform that can be used to assess vibrotactile perception through smartphones without the need for an experimenter to be present to conduct the test. We present a smartphone-based vibration perception measurement platform and compare its performance to measurements from standard monofilament and tuning fork tests. We conducted a user study with 36 healthy adults in which we tested each tool on the hand, wrist, and foot, to assess how well our smartphone-based vibration perception thresholds (VPTs) detect known trends obtained from standard tests. The smartphone platform detected statistically significant changes in VPT between the index finger and foot and also between the feet of younger adults and older adults. Our smartphone-based VPT had a moderate correlation to tuning fork-based VPT. Our overarching objective is to develop an accessible smartphone-based platform that can eventually be used to measure disease progression and regression.

Design and Evaluation of Haptic Guidance in Ultrasound-Based Needle-Insertion Procedures.

OBJECTIVE: This article presents two haptic guidance systems designed to help a clinician keep an ultrasound probe steady when completing ultrasound-assisted needle insertion tasks. These procedures demand spatial reasoning and hand-eye coordination because the clinician must align a needle with the ultrasound probe and extrapolate the needle trajectory using only a 2D ultrasound image. Past research has shown that visual guidance helps the clinician align the needle, but does not help the clinician keep the ultrasound probe steady, sometimes resulting in a failed procedure. METHODS: We created two separate haptic guidance systems to provide feedback if the user tilts the ultrasound probe away from the desired setpoint using (1) vibrotactile stimulation provided by a voice coil motor or (2) distributed tactile pressure provided by a pneumatic mechanism. RESULTS: Both systems significantly reduced probe deviation and correction time to errors during a needle insertion task. We also tested the two feedback systems in a more clinically relevant setup and showed that the perceptibility of the feedback was not affected by the addition of a sterile bag placed over the actuators and gloves worn by the user. CONCLUSION: These studies show that both types of haptic feedback are promising for helping the user keep the ultrasound probe steady during ultrasound-assisted needle insertion tasks. Survey results indicated that users preferred the pneumatic system over the vibrotactile system. SIGNIFICANCE: Haptic feedback may improve user performance in ultrasound-based needle-insertion procedures and shows promise in training for needle-insertion tasks and other medical procedures where guidance is required.

A compact DEA-based soft peristaltic pump for power and control of fluidic robots.

Fluid-driven robotic systems typically use bulky and rigid power supplies, considerably limiting their mobility and flexibility. Although various forms of low-profile soft pumps have been demonstrated, they either are limited to specific working fluids or generate limited flow rates or pressures, making them ill-suited for widespread robotics applications. In this work, we introduce a class of centimeter-scale soft peristaltic pumps for power and control of fluidic robots. An array of high power density robust dielectric elastomer actuators (DEAs) (each weighing 1.7 grams) were adopted as soft motors, operated in a programmed pattern to produce pressure waves in a fluidic channel. We investigated and optimized the dynamic performance of the pump by analyzing the interaction between the DEAs and the fluidic channel with a fluid-structure interaction finite element model. Our soft pump achieved a maximum blocked pressure of 12.5 kilopascals and a run-out flow rate of 39 milliliters per minute with a response time of less than 0.1 second. The pump can generate bidirectional flow and adjustable pressure through control of drive parameters such as voltage and phase shift. Furthermore, the use of peristalsis makes the pump compatible with various liquids. To illustrate the versatility of the pump, we demonstrate mixing a cocktail, powering custom actuators for haptic devices, and performing closed-loop control of a soft fluidic actuator. This compact soft peristaltic pump opens up possibilities for future on-board power sources for fluid-driven robots in a variety of applications, including food handling, manufacturing, and biomedical therapeutics.

Cognitive and Physical Activities Impair Perception of Smartphone Vibrations.

Vibration feedback is common in everyday devices, from virtual reality systems to smartphones. However, cognitive and physical activities may impede our ability to sense vibrations from devices. In this study, we develop and characterize a smartphone platform to investigate how a shape-memory task (cognitive activity) and walking (physical activity) impair human perception of smartphone vibrations. We measured how Apple's Core Haptics Framework parameters can be used for haptics research, namely how hapticIntensity modulates amplitudes of 230 Hz vibrations. A 23-person user study found that physical ( ) and cognitive ( p=0.012) activity increase vibration perception thresholds. Cognitive activity also increases vibration response time ( ). This work also introduces a smartphone platform that can be used for out-of-lab vibration perception testing. Researchers can use our smartphone platform and results to design better haptic devices for diverse, unique populations.

Evolution and Analysis of Hapkit: An Open-Source Haptic Device for Educational Applications.

We present the design, evolution and analysis of "Hapkit," a low-cost, open-source kinesthetic haptic device for use in educational applications. Hapkit was developed in 2013 based on the design of the Stanford Haptic Paddle, with the goal of decreasing cost and increasing accessibility for educational applications, including online teaching, K-12 school use, and college dynamic systems and control courses. In order to develop Hapkit for these purposes, we tested a variety of transmission, actuation, and structural materials. Hapkit 3.0, the latest version, uses a capstan drive, inexpensive DC motor, and 3-D printed structural materials. A frequency-domain system identification method was used to characterize Hapkit dynamics across the various designs. This method was validated using a first principles parameter measurement and a transient response analysis. This characterization shows that Hapkit 3.0 has lower damping and Coulomb friction than previous designs. We also performed a user study demonstrating that Hapkit 3.0 improves discrimination of virtual stiffness compared to previous designs. The design evolution of Hapkit resulted in a low-cost, high-performance device appropriate for open-source dissemination and educational applications.

Understanding Continuous and Pleasant Linear Sensations on the Forearm From a Sequential Discrete Lateral Skin-Slip Haptic Device.

A continuous stroking sensation on the skin can convey messages or emotion cues. We seek to induce this sensation using a combination of illusory motion and lateral stroking via a haptic device. Our system provides discrete lateral skin-slip on the forearm with rotating tactors, which independently provide lateral skin-slip in a timed sequence. We vary the sensation by changing the angular velocity and delay between adjacent tactors, such that the apparent speed of the perceived stroke ranges from 2.5 to 48.2 cm/s. We investigated which actuation parameters create the most pleasant and continuous sensations through a user study with 16 participants. On average, the sensations were rated by participants as both continuous and pleasant. The most continuous and pleasant sensations were created by apparent speeds of 7.7 and 5.1 cm/s, respectively. We also investigated the effect of spacing between contact points on the pleasantness and continuity of the stroking sensation, and found that the users experience a pleasant and continuous linear sensation even when the space between contact points is relatively large (40 mm). Understanding how sequential discrete lateral skin-slip creates continuous linear sensations can influence the design and control of future wearable haptic devices.