Path Planning of a Mobile Delivery Robot Operating in a Multi-Story Building Based on a Predefined Navigation Tree.

Planning the path of a mobile robot that must transport and deliver small packages inside a multi-story building is a problem that requires a combination of spatial and operational information, such as the location of origin and destination points and how to interact with elevators. This paper presents a solution to this problem, which has been formulated under the following assumptions: (1) the map of the building's floors is available; (2) the position of all origin and destination points is known; (3) the mobile robot has sensors to self-localize on the floors; (4) the building is equipped with remotely controlled elevators; and (5) all doors expected in a delivery route will be open. We start by defining a static navigation tree describing the weighted paths in a multi-story building. We then proceed to describe how this navigation tree can be used to plan the route of a mobile robot and estimate the total length of any delivery route using Dijkstra's algorithm. Finally, we show simulated routing results that demonstrate the effectiveness of this proposal when applied to an autonomous delivery robot operating in a multi-story building.

SLAMICP Library: Accelerating Obstacle Detection in Mobile Robot Navigation via Outlier Monitoring following ICP Localization.

The Iterative Closest Point (ICP) is a matching technique used to determine the transformation matrix that best minimizes the distance between two point clouds. Although mostly used for 2D and 3D surface reconstruction, this technique is also widely used for mobile robot self-localization by means of matching partial information provided by an onboard LIDAR scanner with a known map of the facility. Once the estimated position of the robot is obtained, the scans gathered by the LIDAR can be analyzed to locate possible obstacles obstructing the planned trajectory of the mobile robot. This work proposes to speed up the obstacle detection process by directly monitoring outliers (discrepant points between the LIDAR scans and the full map) spotted after ICP matching instead of spending time performing an isolated task to re-analyze the LIDAR scans to detect those discrepancies. In this work, a computationally optimized ICP implementation has been adapted to return the list of outliers along with other matching metrics, computed in an optimal way by taking advantage of the parameters already calculated in order to perform the ICP matching. The evaluation of this adapted ICP implementation in a real mobile robot application has shown that the time required to perform self-localization and obstacle detection has been reduced by 36.7% when obstacle detection is performed simultaneously with the ICP matching instead of implementing a redundant procedure for obstacle detection. The adapted ICP implementation is provided in the SLAMICP library.

A Procedure for Taking a Remotely Controlled Elevator with an Autonomous Mobile Robot Based on 2D LIDAR.

Navigating between the different floors of a multistory building is a task that requires walking up or down stairs or taking an elevator or lift. This work proposes a procedure to take a remotely controlled elevator with an autonomous mobile robot based on 2D LIDAR. The application of the procedure requires ICP matching for mobile robot self-localization, a building with remotely controlled elevators, and a 2D map of the floors of the building detailing the position of the elevators. The results show that the application of the procedure enables an autonomous mobile robot to take a remotely controlled elevator and to navigate between floors based on 2D LIDAR information.

Optimal PID Control of a Brushed DC Motor with an Embedded Low-Cost Magnetic Quadrature Encoder for Improved Step Overshoot and Undershoot Responses in a Mobile Robot Application.

The development of a proportional-integral-derivative (PID) control system is a simple, practical, highly effective method used to control the angular rotational velocity of electric motors. This paper describes the optimization of the PID control of a brushed DC motor (BDCM) with an embedded low-cost magnetic quadrature encoder. This paper demonstrates empirically that the feedback provided by low-cost magnetic encoders produces some inaccuracies and control artifacts that are not usually considered in simulations, proposing a practical optimization approach in order to improve the step overshoot and undershoot controller response. This optimization approach is responsible for the motion performances of a human-sized omnidirectional mobile robot using three motorized omnidirectional wheels.

Classification of Three Volatiles Using a Single-Type eNose with Detailed Class-Map Visualization.

The use of electronic noses (eNoses) as analysis tools are growing in popularity; however, the lack of a comprehensive, visual representation of how the different classes are organized and distributed largely complicates the interpretation of the classification results, thus reducing their practicality. The new contributions of this paper are the assessment of the multivariate classification performance of a custom, low-cost eNose composed of 16 single-type (identical) MOX gas sensors for the classification of three volatiles, along with a proposal to improve the visual interpretation of the classification results by means of generating a detailed 2D class-map representation based on the inverse of the orthogonal linear transformation obtained from a PCA and LDA analysis. The results showed that this single-type eNose implementation was able to perform multivariate classification, while the class-map visualization summarized the learned features and how these features may affect the performance of the classification, simplifying the interpretation and understanding of the eNose results.

Enhancing the Sense of Attention from an Assistance Mobile Robot by Improving Eye-Gaze Contact from Its Iconic Face Displayed on a Flat Screen.

One direct way to express the sense of attention in a human interaction is through the gaze. This paper presents the enhancement of the sense of attention from the face of a human-sized mobile robot during an interaction. This mobile robot was designed as an assistance mobile robot and uses a flat screen at the top of the robot to display an iconic (simplified) face with big round eyes and a single line as a mouth. The implementation of eye-gaze contact from this iconic face is a problem because of the difficulty of simulating real 3D spherical eyes in a 2D image considering the perspective of the person interacting with the mobile robot. The perception of eye-gaze contact has been improved by manually calibrating the gaze of the robot relative to the location of the face of the person interacting with the robot. The sense of attention has been further enhanced by implementing cyclic face explorations with saccades in the gaze and by performing blinking and small movements of the mouth.

Classification of Two Volatiles Using an eNose Composed by an Array of 16 Single-Type Miniature Micro-Machined Metal-Oxide Gas Sensors.

The artificial replication of an olfactory system is currently an open problem. The development of a portable and low-cost artificial olfactory system, also called electronic nose or eNose, is usually based on the use of an array of different gas sensors types, sensitive to different target gases. Low-cost Metal-Oxide semiconductor (MOX) gas sensors are widely used in such arrays. MOX sensors are based on a thin layer of silicon oxide with embedded heaters that can operate at different temperature set points, which usually have the disadvantages of different volatile sensitivity in each individual sensor unit and also different crossed sensitivity to different volatiles (unspecificity). This paper presents and eNose composed by an array of 16 low-cost BME680 digital miniature sensors embedding a miniature MOX gas sensor proposed to unspecifically evaluate air quality. In this paper, the inherent variability and unspecificity that must be expected from the 16 embedded MOX gas sensors, combined with signal processing, are exploited to classify two target volatiles: ethanol and acetone. The proposed eNose reads the resistance of the sensing layer of the 16 embedded MOX gas sensors, applies PCA for dimensional reduction and k-NN for classification. The validation results have shown an instantaneous classification success higher than 94% two days after the calibration and higher than 70% two weeks after, so the majority classification of a sequence of measures has been always successful in laboratory conditions. These first validation results and the low-power consumption of the eNose (0.9 W) enables its future improvement and its use in portable and battery-operated applications.

Evaluation of the Path-Tracking Accuracy of a Three-Wheeled Omnidirectional Mobile Robot Designed as a Personal Assistant.

This paper presents the empirical evaluation of the path-tracking accuracy of a three-wheeled omnidirectional mobile robot that is able to move in any direction while simultaneously changing its orientation. The mobile robot assessed in this paper includes a precise onboard LIDAR for obstacle avoidance, self-location and map creation, path-planning and path-tracking. This mobile robot has been used to develop several assistive services, but the accuracy of its path-tracking system has not been specifically evaluated until now. To this end, this paper describes the kinematics and path-planning procedure implemented in the mobile robot and empirically evaluates the accuracy of its path-tracking system that corrects the trajectory. In this paper, the information gathered by the LIDAR is registered to obtain the ground truth trajectory of the mobile robot in order to estimate the path-tracking accuracy of each experiment conducted. Circular and eight-shaped trajectories were assessed with different translational velocities. In general, the accuracy obtained in circular trajectories is within a short range, but the accuracy obtained in eight-shaped trajectories worsens as the velocity increases. In the case of the mobile robot moving at its nominal translational velocity, 0.3 m/s, the root mean square (RMS) displacement error was 0.032 m for the circular trajectory and 0.039 m for the eight-shaped trajectory; the absolute maximum displacement errors were 0.077 m and 0.088 m, with RMS errors in the angular orientation of 6.27° and 7.76°, respectively. Moreover, the external visual perception generated by these error levels is that the trajectory of the mobile robot is smooth, with a constant velocity and without perceiving trajectory corrections.

Improving the Angular Velocity Measured with a Low-Cost Magnetic Rotary Encoder Attached to a Brushed DC Motor by Compensating Magnet and Hall-Effect Sensor Misalignments.

This paper proposes a method to improve the angular velocity measured by a low-cost magnetic rotary encoder attached to a brushed direct current (DC) motor. The low-cost magnetic rotary encoder used in brushed DC motors use to have a small magnetic ring attached to the rotational axis and one or more fixed Hall-effect sensors next to the magnet. Then, the Hall-effect sensors provide digital pulses with a duration and frequency proportional to the angular rotational velocity of the shaft of the encoder. The drawback of this mass produced rotary encoder is that any structural misalignment between the rotating magnetic field and the Hall-effect sensors produces asymmetric pulses that reduces the precision of the estimation of the angular velocity. The hypothesis of this paper is that the information provided by this low-cost magnetic rotary encoder can be processed and improved in order to obtain an accurate and precise estimation of the angular rotational velocity. The methodology proposed has been validated in four compact motorizations obtaining a reduction in the ripple of the estimation of the angular rotational velocity of: 4.93%, 59.43%, 76.49%, and 86.75%. This improvement has the advantage that it does not add time delays and does not increases the overall cost of the rotary encoder. These results showed the real dimension of this structural misalignment problem and the great improvement in precision that can be achieved.

Suboptimal Omnidirectional Wheel Design and Implementation.

The optimal design of an omnidirectional wheel is usually focused on the minimization of the gap between the free rollers of the wheel in order to minimize contact discontinuities with the floor in order to minimize the generation of vibrations. However, in practice, a fast, tall, and heavy-weighted mobile robot using optimal omnidirectional wheels may also need a suspension system in order to reduce the presence of vibrations and oscillations in the upper part of the mobile robot. This paper empirically evaluates whether a heavy-weighted omnidirectional mobile robot can take advantage of its passive suspension system in order to also use non-optimal or suboptimal omnidirectional wheels with a non-optimized inner gap. The main comparative advantages of the proposed suboptimal omnidirectional wheel are its low manufacturing cost and the possibility of taking advantage of the gap to operate outdoors. The experimental part of this paper compares the vibrations generated by the motion system of a versatile mobile robot using optimal and suboptimal omnidirectional wheels. The final conclusion is that a suboptimal wheel with a large gap produces comparable on-board vibration patterns while maintaining the traction and increasing the grip on non-perfect planar surfaces.

Mobile Robot Self-Localization with 2D Push-Broom LIDAR in a 2D Map.

This paper proposes mobile robot self-localization based on an onboard 2D push-broom (or tilted-down) LIDAR using a reference 2D map previously obtained with a 2D horizontal LIDAR. The hypothesis of this paper is that a 2D reference map created with a 2D horizontal LIDAR mounted on a mobile robot or in another mobile device can be used by another mobile robot to locate its location using the same 2D LIDAR tilted-down. The motivation to tilt-down a 2D LIDAR is the direct detection of holes or small objects placed on the ground that remain undetected for a fixed horizontal 2D LIDAR. The experimental evaluation of this hypothesis has demonstrated that self-localization with a 2D push-broom LIDAR is possible by detecting and deleting the ground and ceiling points from the scan data, and projecting the remaining scan points in the horizontal plane of the 2D reference map before applying a 2D self-location algorithm. Therefore, an onboard 2D push-broom LIDAR offers self-location and accurate ground supervision without requiring an additional motorized device to change the tilt of the LIDAR in order to get these two combined characteristics in a mobile robot.

Application of an Array of Metal-Oxide Semiconductor Gas Sensors in an Assistant Personal Robot for Early Gas Leak Detection.

This paper proposes the application of a low-cost gas sensor array in an assistant personal robot (APR) in order to extend the capabilities of the mobile robot as an early gas leak detector for safety purposes. The gas sensor array is composed of 16 low-cost metal-oxide (MOX) gas sensors, which are continuously in operation. The mobile robot was modified to keep the gas sensor array always switched on, even in the case of battery recharge. The gas sensor array provides 16 individual gas measurements and one output that is a cumulative summary of all measurements, used as an overall indicator of a gas concentration change. The results of preliminary experiments were used to train a partial least squares discriminant analysis (PLS-DA) classifier with air, ethanol, and acetone as output classes. Then, the mobile robot gas leak detection capabilities were experimentally evaluated in a public facility, by forcing the evaporation of (1) ethanol, (2) acetone, and (3) ethanol and acetone at different locations. The positive results obtained in different operation conditions over the course of one month confirmed the early detection capabilities of the proposed mobile system. For example, the APR was able to detect a gas leak produced inside a closed room from the external corridor due to small leakages under the door induced by the forced ventilation system of the building.

Measurement of Vibrations in Two Tower-Typed Assistant Personal Robot Implementations with and without a Passive Suspension System.

This paper presents the vibration pattern measurement of two tower-typed holonomic mobile robot prototypes: one based on a rigid mechanical structure, and the other including a passive suspension system. Specific to the tower-typed mobile robots is that the vibrations that originate in the lower part of the structure are transmitted and amplified to the higher areas of the tower, causing an unpleasant visual effect and mechanical stress. This paper assesses the use of a suspension system aimed at minimizing the generation and propagation of vibrations in the upper part of the tower-typed holonomic robots. The two robots analyzed were equipped with onboard accelerometers to register the acceleration over the X, Y, and Z axes in different locations and at different velocities. In all the experiments, the amplitude of the vibrations showed a typical Gaussian pattern which has been modeled with the value of the standard deviation. The results have shown that the measured vibrations in the head of the mobile robots, including a passive suspension system, were reduced by a factor of 16.

Chemical Source Localization Fusing Concentration Information in the Presence of Chemical Background Noise.

We present the estimation of a likelihood map for the location of the source of a chemical plume dispersed under atmospheric turbulence under uniform wind conditions. The main contribution of this work is to extend previous proposals based on Bayesian inference with binary detections to the use of concentration information while at the same time being robust against the presence of background chemical noise. For that, the algorithm builds a background model with robust statistics measurements to assess the posterior probability that a given chemical concentration reading comes from the background or from a source emitting at a distance with a specific release rate. In addition, our algorithm allows multiple mobile gas sensors to be used. Ten realistic simulations and ten real data experiments are used for evaluation purposes. For the simulations, we have supposed that sensors are mounted on cars which do not have among its main tasks navigating toward the source. To collect the real dataset, a special arena with induced wind is built, and an autonomous vehicle equipped with several sensors, including a photo ionization detector (PID) for sensing chemical concentration, is used. Simulation results show that our algorithm, provides a better estimation of the source location even for a low background level that benefits the performance of binary version. The improvement is clear for the synthetic data while for real data the estimation is only slightly better, probably because our exploration arena is not able to provide uniform wind conditions. Finally, an estimation of the computational cost of the algorithmic proposal is presented.

Design, Implementation and Validation of the Three-Wheel Holonomic Motion System of the Assistant Personal Robot (APR).

This paper presents the design, implementation and validation of the three-wheel holonomic motion system of a mobile robot designed to operate in homes. The holonomic motion system is described in terms of mechanical design and electronic control. The paper analyzes the kinematics of the motion system and validates the estimation of the trajectory comparing the displacement estimated with the internal odometry of the motors and the displacement estimated with a SLAM procedure based on LIDAR information. Results obtained in different experiments have shown a difference on less than 30 mm between the position estimated with the SLAM and odometry, and a difference in the angular orientation of the mobile robot lower than 5° in absolute displacements up to 1000 mm.

Assistant Personal Robot (APR): Conception and Application of a Tele-Operated Assisted Living Robot.

This paper presents the technical description, mechanical design, electronic components, software implementation and possible applications of a tele-operated mobile robot designed as an assisted living tool. This robotic concept has been named Assistant Personal Robot (or APR for short) and has been designed as a remotely telecontrolled robotic platform built to provide social and assistive services to elderly people and those with impaired mobility. The APR features a fast high-mobility motion system adapted for tele-operation in plain indoor areas, which incorporates a high-priority collision avoidance procedure. This paper presents the mechanical architecture, electrical fundaments and software implementation required in order to develop the main functionalities of an assistive robot. The APR uses a tablet in order to implement the basic peer-to-peer videoconference and tele-operation control combined with a tactile graphic user interface. The paper also presents the development of some applications proposed in the framework of an assisted living robot.

Vineyard yield estimation based on the analysis of high resolution images obtained with artificial illumination at night.

This paper presents a method for vineyard yield estimation based on the analysis of high-resolution images obtained with artificial illumination at night. First, this paper assesses different pixel-based segmentation methods in order to detect reddish grapes: threshold based, Mahalanobis distance, Bayesian classifier, linear color model segmentation and histogram segmentation, in order to obtain the best estimation of the area of the clusters of grapes in this illumination conditions. The color spaces tested were the original RGB and the Hue-Saturation-Value (HSV). The best segmentation method in the case of a non-occluded reddish table-grape variety was the threshold segmentation applied to the H layer, with an estimation error in the area of 13.55%, improved up to 10.01% by morphological filtering. Secondly, after segmentation, two procedures for yield estimation based on a previous calibration procedure have been proposed: (1) the number of pixels corresponding to a cluster of grapes is computed and converted directly into a yield estimate; and (2) the area of a cluster of grapes is converted into a volume by means of a solid of revolution, and this volume is converted into a yield estimate; the yield errors obtained were 16% and -17%, respectively.

A proposal for automatic fruit harvesting by combining a low cost stereovision camera and a robotic arm.

This paper proposes the development of an automatic fruit harvesting system by combining a low cost stereovision camera and a robotic arm placed in the gripper tool. The stereovision camera is used to estimate the size, distance and position of the fruits whereas the robotic arm is used to mechanically pickup the fruits. The low cost stereovision system has been tested in laboratory conditions with a reference small object, an apple and a pear at 10 different intermediate distances from the camera. The average distance error was from 4% to 5%, and the average diameter error was up to 30% in the case of a small object and in a range from 2% to 6% in the case of a pear and an apple. The stereovision system has been attached to the gripper tool in order to obtain relative distance, orientation and size of the fruit. The harvesting stage requires the initial fruit location, the computation of the inverse kinematics of the robotic arm in order to place the gripper tool in front of the fruit, and a final pickup approach by iteratively adjusting the vertical and horizontal position of the gripper tool in a closed visual loop. The complete system has been tested in controlled laboratory conditions with uniform illumination applied to the fruits. As a future work, this system will be tested and improved in conventional outdoor farming conditions.

Ambient intelligence application based on environmental measurements performed with an assistant mobile robot.

This paper proposes the use of an autonomous assistant mobile robot in order to monitor the environmental conditions of a large indoor area and develop an ambient intelligence application. The mobile robot uses single high performance embedded sensors in order to collect and geo-reference environmental information such as ambient temperature, air velocity and orientation and gas concentration. The data collected with the assistant mobile robot is analyzed in order to detect unusual measurements or discrepancies and develop focused corrective ambient actions. This paper shows an example of the measurements performed in a research facility which have enabled the detection and location of an uncomfortable temperature profile inside an office of the research facility. The ambient intelligent application has been developed by performing some localized ambient measurements that have been analyzed in order to propose some ambient actuations to correct the uncomfortable temperature profile.

An embedded real-time red peach detection system based on an OV7670 camera, ARM cortex-M4 processor and 3D look-up tables.

This work proposes the development of an embedded real-time fruit detection system for future automatic fruit harvesting. The proposed embedded system is based on an ARM Cortex-M4 (STM32F407VGT6) processor and an Omnivision OV7670 color camera. The future goal of this embedded vision system will be to control a robotized arm to automatically select and pick some fruit directly from the tree. The complete embedded system has been designed to be placed directly in the gripper tool of the future robotized harvesting arm. The embedded system will be able to perform real-time fruit detection and tracking by using a three-dimensional look-up-table (LUT) defined in the RGB color space and optimized for fruit picking. Additionally, two different methodologies for creating optimized 3D LUTs based on existing linear color models and fruit histograms were implemented in this work and compared for the case of red peaches. The resulting system is able to acquire general and zoomed orchard images and to update the relative tracking information of a red peach in the tree ten times per second.