Mass-Manufacturable 3D Magnetic Force Sensor for Robotic Grasping and Slip Detection.

The manipulation of delicate objects remains a key challenge in the development of industrial robotic grippers. Magnetic force sensing solutions, which provide the required sense of touch, have been demonstrated in previous work. The sensors feature a magnet embedded within a deformable elastomer, which is mounted on top of a magnetometer chip. A key drawback of these sensors lies in the manufacturing process, which relies on the manual assembly of the magnet-elastomer transducer, impacting both the repeatability of measurements across sensors and the potential for a cost-effective solution through mass-manufacturing. In this paper, a magnetic force sensor solution is presented with an optimized manufacturing process that will facilitate mass production. The elastomer-magnet transducer was fabricated using injection molding, and the assembly of the transducer unit, on top of the magnetometer chip, was achieved using semiconductor manufacturing techniques. The sensor enables robust differential 3D force sensing within a compact footprint (5 mm × 4.4 mm × 4.6 mm). The measurement repeatability of these sensors was characterized over multiple samples and 300,000 loading cycles. This paper also showcases how the 3D high-speed sensing capabilities of these sensors can enable slip detection in industrial grippers.

A Simple Neural Network for Collision Detection of Collaborative Robots.

Due to the epidemic threat, more and more companies decide to automate their production lines. Given the lack of adequate security or space, in most cases, such companies cannot use classic production robots. The solution to this problem is the use of collaborative robots (cobots). However, the required equipment (force sensors) or alternative methods of detecting a threat to humans are usually quite expensive. The article presents the practical aspect of collision detection with the use of a simple neural architecture. A virtual force and torque sensor, implemented as a neural network, may be useful in a team of collaborative robots. Four different approaches are compared in this article: auto-regressive (AR), recurrent neural network (RNN), convolutional long short-term memory (CNN-LSTM) and mixed convolutional LSTM network (MC-LSTM). These architectures are analyzed at different levels of input regression (motor current, position, speed, control velocity). This sensor was tested on the original CURA6 robot prototype (Cooperative Universal Robotic Assistant 6) by Intema. The test results indicate that the MC-LSTM architecture is the most effective with the regression level set at 12 samples (at 24 Hz). The mean absolute prediction error obtained by the MC-LSTM architecture was approximately 22 Nm. The conducted external test (72 different signals with collisions) shows that the presented architecture can be used as a collision detector. The MC-LSTM collision detection f1 score with the optimal threshold was 0.85. A well-developed virtual sensor based on such a network can be used to detect various types of collisions of cobot or other mobile or stationary systems operating on the basis of human-machine interaction.

Robot Intelligent Grasp of Unknown Objects Based on Multi-Sensor Information.

Robots frequently need to work in human environments and handle many different types of objects. There are two problems that make this challenging for robots: human environments are typically cluttered, and the multi-finger robot hand needs to grasp and to lift objects without knowing their mass and damping properties. Therefore, this study combined vision and robot hand real-time grasp control action to achieve reliable and accurate object grasping in a cluttered scene. An efficient online algorithm for collision-free grasping pose generation according to a bounding box is proposed, and the grasp pose will be further checked for grasp quality. Finally, by fusing all available sensor data appropriately, an intelligent real-time grasp system was achieved that is reliable enough to handle various objects with unknown weights, friction, and stiffness. The robots used in this paper are the NTU 21-DOF five-finger robot hand and the NTU 6-DOF robot arm, which are both constructed by our Lab.

Mexican-Hat-Like Response in a Flexible Tactile Sensor Using a Magnetorheological Elastomer.

A significant challenge in robotics is providing a sense of touch to robots. Even though several types of flexible tactile sensors have been proposed, they still have various technical issues such as a large amount of deformation that fractures the sensing elements, a poor maintainability and a deterioration in the sensitivity caused by the presence of a thick and soft covering. As one solution for these issues, we proposed a flexible tactile sensor composed of a magnet, magnetic transducer and dual-layer elastomer, which consists of a magnetorheological and nonmagnetic elastomer sheet. In this study, we first investigated the sensitivity of the sensor, which was found to be high (approximately 161 mV/N with a signal-to-noise ratio of 42.2 dB); however, the sensor has a speed-dependent hysteresis in its sensor response curve. Then, we investigated the spatial response and observed the following results: (1) the sensor response was a distorted Mexican-hat-like bipolar shape, namely a negative response area was observed around the positive response area; (2) the negative response area disappeared when we used a compressible sponge sheet instead of the incompressible nonmagnetic elastomer. We concluded that the characteristic negative response in the Mexican-hat-like response is derived from the incompressibility of the nonmagnetic elastomer.

Tactile Decoding of Edge Orientation With Artificial Cuneate Neurons in Dynamic Conditions.

Generalization ability in tactile sensing for robotic manipulation is a prerequisite to effectively perform tasks in ever-changing environments. In particular, performing dynamic tactile perception is currently beyond the ability of robotic devices. A biomimetic approach to achieve this dexterity is to develop machines combining compliant robotic manipulators with neuroinspired architectures displaying computational adaptation. Here we demonstrate the feasibility of this approach for dynamic touch tasks experimented by integrating our sensing apparatus in a 6 degrees of freedom robotic arm via a soft wrist. We embodied in the system a model of spike-based neuromorphic encoding of tactile stimuli, emulating the discrimination properties of cuneate nucleus neurons based on pathways with differential delay lines. These strategies allowed the system to correctly perform a dynamic touch protocol of edge orientation recognition (ridges from 0 to 40°, with a step of 5°). Crucially, the task was robust to contact noise and was performed with high performance irrespectively of sensing conditions (sensing forces and velocities). These results are a step forward toward the development of robotic arms able to physically interact in real-world environments with tactile sensing.

Ergodic Exploration Using Binary Sensing for Nonparametric Shape Estimation.

Current methods to estimate object shape-using either vision or touch-generally depend on high-resolution sensing. Here, we exploit ergodic exploration to demonstrate successful shape estimation when using a low-resolution binary contact sensor. The measurement model is posed as a collision-based tactile measurement, and classification methods are used to discriminate between shape boundary regions in the search space. Posterior likelihood estimates of the measurement model help the system actively seek out regions where the binary sensor is most likely to return informative measurements. Results show successful shape estimation of various objects as well as the ability to identify multiple objects in an environment. Interestingly, it is shown that ergodic exploration utilizes non-contact motion to gather significant information about shape. The algorithm is extended in three dimensions in simulation and we present two dimensional experimental results using the Rethink Baxter robot.