Application of an Array of Metal-Oxide Semiconductor Gas Sensors in an Assistant Personal Robot for Early Gas Leak Detection.

This paper proposes the application of a low-cost gas sensor array in an assistant personal robot (APR) in order to extend the capabilities of the mobile robot as an early gas leak detector for safety purposes. The gas sensor array is composed of 16 low-cost metal-oxide (MOX) gas sensors, which are continuously in operation. The mobile robot was modified to keep the gas sensor array always switched on, even in the case of battery recharge. The gas sensor array provides 16 individual gas measurements and one output that is a cumulative summary of all measurements, used as an overall indicator of a gas concentration change. The results of preliminary experiments were used to train a partial least squares discriminant analysis (PLS-DA) classifier with air, ethanol, and acetone as output classes. Then, the mobile robot gas leak detection capabilities were experimentally evaluated in a public facility, by forcing the evaporation of (1) ethanol, (2) acetone, and (3) ethanol and acetone at different locations. The positive results obtained in different operation conditions over the course of one month confirmed the early detection capabilities of the proposed mobile system. For example, the APR was able to detect a gas leak produced inside a closed room from the external corridor due to small leakages under the door induced by the forced ventilation system of the building.

Design, Implementation and Validation of the Three-Wheel Holonomic Motion System of the Assistant Personal Robot (APR).

This paper presents the design, implementation and validation of the three-wheel holonomic motion system of a mobile robot designed to operate in homes. The holonomic motion system is described in terms of mechanical design and electronic control. The paper analyzes the kinematics of the motion system and validates the estimation of the trajectory comparing the displacement estimated with the internal odometry of the motors and the displacement estimated with a SLAM procedure based on LIDAR information. Results obtained in different experiments have shown a difference on less than 30 mm between the position estimated with the SLAM and odometry, and a difference in the angular orientation of the mobile robot lower than 5° in absolute displacements up to 1000 mm.

A proposal for automatic fruit harvesting by combining a low cost stereovision camera and a robotic arm.

This paper proposes the development of an automatic fruit harvesting system by combining a low cost stereovision camera and a robotic arm placed in the gripper tool. The stereovision camera is used to estimate the size, distance and position of the fruits whereas the robotic arm is used to mechanically pickup the fruits. The low cost stereovision system has been tested in laboratory conditions with a reference small object, an apple and a pear at 10 different intermediate distances from the camera. The average distance error was from 4% to 5%, and the average diameter error was up to 30% in the case of a small object and in a range from 2% to 6% in the case of a pear and an apple. The stereovision system has been attached to the gripper tool in order to obtain relative distance, orientation and size of the fruit. The harvesting stage requires the initial fruit location, the computation of the inverse kinematics of the robotic arm in order to place the gripper tool in front of the fruit, and a final pickup approach by iteratively adjusting the vertical and horizontal position of the gripper tool in a closed visual loop. The complete system has been tested in controlled laboratory conditions with uniform illumination applied to the fruits. As a future work, this system will be tested and improved in conventional outdoor farming conditions.

Two-dimensional radial laser scanning for circular marker detection and external mobile robot tracking.

This paper presents the use of an external fixed two-dimensional laser scanner to detect cylindrical targets attached to moving devices, such as a mobile robot. This proposal is based on the detection of circular markers in the raw data provided by the laser scanner by applying an algorithm for outlier avoidance and a least-squares circular fitting. Some experiments have been developed to empirically validate the proposal with different cylindrical targets in order to estimate the location and tracking errors achieved, which are generally less than 20 mm in the area covered by the laser sensor. As a result of the validation experiments, several error maps have been obtained in order to give an estimate of the uncertainty of any location computed. This proposal has been validated with a medium-sized mobile robot with an attached cylindrical target (diameter 200 mm). The trajectory of the mobile robot was estimated with an average location error of less than 15 mm, and the real location error in each individual circular fitting was similar to the error estimated with the obtained error maps. The radial area covered in this validation experiment was up to 10 m, a value that depends on the radius of the cylindrical target and the radial density of the distance range points provided by the laser scanner but this area can be increased by combining the information of additional external laser scanners.

An embedded real-time red peach detection system based on an OV7670 camera, ARM cortex-M4 processor and 3D look-up tables.

This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6) processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT) defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.

Definition of linear color models in the RGB vector color space to detect red peaches in orchard images taken under natural illumination.

This work proposes the detection of red peaches in orchard images based on the definition of different linear color models in the RGB vector color space. The classification and segmentation of the pixels of the image is then performed by comparing the color distance from each pixel to the different previously defined linear color models. The methodology proposed has been tested with images obtained in a real orchard under natural light. The peach variety in the orchard was the paraguayo (Prunus persica var. platycarpa) peach with red skin. The segmentation results showed that the area of the red peaches in the images was detected with an average error of 11.6%; 19.7% in the case of bright illumination; 8.2% in the case of low illumination; 8.6% for occlusion up to 33%; 12.2% in the case of occlusion between 34 and 66%; and 23% for occlusion above 66%. Finally, a methodology was proposed to estimate the diameter of the fruits based on an ellipsoidal fitting. A first diameter was obtained by using all the contour pixels and a second diameter was obtained by rejecting some pixels of the contour. This approach enables a rough estimate of the fruit occlusion percentage range by comparing the two diameter estimates.

Characterization of a low-cost optical flow sensor when using an external laser as a direct illumination source.

In this paper, a low cost optical flow sensor is combined with an external laser device to measure surface displacements and mechanical oscillations. The measurement system is based on applying coherent light to a diffuser surface and using an optical flow sensor to analyze the reflected and transferred light to estimate the displacement of the surface or the laser spot. This work is focused on the characterization of this measurement system, which can have the optical flow sensor placed at different angles and distances from the diffuser surface. The results have shown that the displacement of the diffuser surface is badly estimated when the optical mouse sensor is placed in front of the diffuser surface (angular orientation >150°) while the highest sensitivity is obtained when the sensor is located behind the diffuser surface and on the axis of the laser source (angular orientation 0°). In this case, the coefficient of determination of the measured displacement, R(2), was very high (>0.99) with a relative error of less than 1.29%. Increasing the distance between the surface and the sensor also increased the sensitivity which increases linearly, R(2) = 0.99. Finally, this measurement setup was proposed to measure very low frequency mechanical oscillations applied to the laser device, up to 0.01 Hz in this work. The results have shown that increasing the distance between the surface and the optical flow sensor also increases the sensitivity and the measurement range.

Measuring oscillating walking paths with a LIDAR.

This work describes the analysis of different walking paths registered using a Light Detection And Ranging (LIDAR) laser range sensor in order to measure oscillating trajectories during unsupervised walking. The estimate of the gait and trajectory parameters were obtained with a terrestrial LIDAR placed 100 mm above the ground with the scanning plane parallel to the floor to measure the trajectory of the legs without attaching any markers or modifying the floor. Three different large walking experiments were performed to test the proposed measurement system with straight and oscillating trajectories. The main advantages of the proposed system are the possibility to measure several steps and obtain average gait parameters and the minimum infrastructure required. This measurement system enables the development of new ambulatory applications based on the analysis of the gait and the trajectory during a walk.

Design and implementation of a biomimetic turtle hydrofoil for an autonomous underwater vehicle.

This paper presents the design and implementation of a turtle hydrofoil for an Autonomous Underwater Vehicle (AUV). The final design of the AUV must have navigation performance like a turtle, which has also been the biomimetic inspiration for the design of the hydrofoil and propulsion system. The hydrofoil design is based on a National Advisory Committee for Aeronautics (NACA) 0014 hydrodynamic profile. During the design stage, four different propulsion systems were compared in terms of propulsion path, compactness, sealing and required power. The final implementation is based on a ball-and-socket mechanism because it is very compact and provides three degrees of freedom (DoF) to the hydrofoil with very few restrictions on the propulsion path. The propulsion obtained with the final implementation of the hydrofoil has been empirically evaluated in a water channel comparing different motion strategies. The results obtained have confirmed that the proposed turtle hydrofoil controlled with a mechanism with three DoF generates can be used in the future implementation of the planned AUV.

Bioinspired electronic white cane implementation based on a LIDAR, a tri-axial accelerometer and a tactile belt.

This work proposes the creation of a bioinspired electronic white cane for blind people using the whiskers principle for short-range navigation and exploration. Whiskers are coarse hairs of an animal's face that tells the animal that it has touched something using the nerves of the skin. In this work the raw data acquired from a low-size terrestrial LIDAR and a tri-axial accelerometer is converted into tactile information using several electromagnetic devices configured as a tactile belt. The LIDAR and the accelerometer are attached to the user's forearm and connected with a wire to the control unit placed on the belt. Early validation experiments carried out in the laboratory are promising in terms of usability and description of the environment.

Measuring gait using a ground laser range sensor.

This paper describes a measurement system designed to register the displacement of the legs using a two-dimensional laser range sensor with a scanning plane parallel to the ground and extract gait parameters. In the proposed methodology, the position of the legs is estimated by fitting two circles with the laser points that define their contour and the gait parameters are extracted applying a step-line model to the estimated displacement of the legs to reduce uncertainty in the determination of the stand and swing phase of the gait. Results obtained in a range up to 8 m shows that the systematic error in the location of one static leg is lower than 10 mm with and standard deviation lower than 8 mm; this deviation increases to 11 mm in the case of a moving leg. The proposed measurement system has been applied to estimate the gait parameters of six volunteers in a preliminary walking experiment.

Using the optical mouse sensor as a two-euro counterfeit coin detector.

In this paper, the sensor of an optical mouse is presented as a counterfeit coin detector applied to the two-Euro case. The detection process is based on the short distance image acquisition capabilities of the optical mouse sensor where partial images of the coin under analysis are compared with some partial reference coin images for matching. Results show that, using only the vision sense, the counterfeit acceptance and rejection rates are very similar to those of a trained user and better than those of an untrained user.