Real-Time Three-Dimensional Pedestrian Localization System Using Smartphones.

Robust and accurate three-dimensional localization is essential for personal navigation, emergency rescue, and worker monitoring in indoor environments. For localization technology to be employed in various applications, it is necessary to reduce infrastructure dependence and limit the maximum error bound. This study aims to accurately estimate the location of various people using smartphones in a building with a cloud platform-based localization system. The proposed technology is modularized in a hierarchical structure to sequentially estimate the floor and location. This system comprises four localization modules: course level detection, fine level detection (FLD), fine location tracking (FLT), and level change detection (LCD). Each module operates organically according to the current user status. The position estimation range is defined as a total of three phases, and an appropriate location estimation module suitable for the corresponding phase operates to estimate the user's location gradually and precisely. When the user's floor is determined by an FLD, the two-dimensional position of the user is estimated by an FLT module that tracks the user's position by comparing the received signal strength indicator vector sequence and radio map. Also, LCD recognizes the user's floor change and converts the user's phase. To verify the proposed technology, various experiments were conducted in a six-story building, and an average accuracy of less than 2 m was obtained.

A Novel Online Position Estimation Method and Movement Sonification System: The Soniccup.

Existing methods to obtain position from inertial sensors typically use a combination of multiple sensors and orientation modeling; thus, obtaining position from a single inertial sensor is highly desirable given the decreased setup time and reduced complexity. The dead reckoning method is commonly chosen to obtain position from acceleration; however, when applied to upper limb tracking, the accuracy of position estimates are questionable, which limits feasibility. A new method of obtaining position estimates through the use of zero velocity updates is reported, using a commercial IMU, a push-to-make momentary switch, and a 3D printed object to house the sensors. The generated position estimates can subsequently be converted into sound through sonification to provide audio feedback on reaching movements for rehabilitation applications. An evaluation of the performance of the generated position estimates from a system labeled 'Soniccup' is presented through a comparison with the outputs from a Vicon Nexus system. The results indicate that for reaching movements below one second in duration, the Soniccup produces positional estimates with high similarity to the same movements captured through the Vicon system, corresponding to comparable audio output from the two systems. However, future work to improve the performance of longer-duration movements and reduce the system latency to produce real-time audio feedback is required to improve the acceptability of the system.

SWiLoc: Fusing Smartphone Sensors and WiFi CSI for Accurate Indoor Localization.

Dead reckoning is a promising yet often overlooked smartphone-based indoor localization technology that relies on phone-mounted sensors for counting steps and estimating walking directions, without the need for extensive sensor or landmark deployment. However, misalignment between the phone's direction and the user's actual movement direction can lead to unreliable direction estimates and inaccurate location tracking. To address this issue, this paper introduces SWiLoc (Smartphone and WiFi-based Localization), an enhanced direction correction system that integrates passive WiFi sensing with smartphone-based sensing to form Correction Zones. Our two-phase approach accurately measures the user's walking directions when passing through a Correction Zone and further refines successive direction estimates outside the zones, enabling continuous and reliable tracking. In addition to direction correction, SWiLoc extends its capabilities by incorporating a localization technique that leverages corrected directions to achieve precise user localization. This extension significantly enhances the system's applicability for high-accuracy localization tasks. Additionally, our innovative Fresnel zone-based approach, which utilizes unique hardware configurations and a fundamental geometric model, ensures accurate and robust direction estimation, even in scenarios with unreliable walking directions. We evaluate SWiLoc across two real-world environments, assessing its performance under varying conditions such as environmental changes, phone orientations, walking directions, and distances. Our comprehensive experiments demonstrate that SWiLoc achieves an average 75th percentile error of 8.89 degrees in walking direction estimation and an 80th percentile error of 1.12 m in location estimation. These figures represent reductions of 64% and 49%, respectively for direction and location estimation error, over existing state-of-the-art approaches.

Context-Aware Statistical Dead Reckoning for Localization in IoT Scenarios.

The current trends in 5G and 6G systems anticipate vast communication capabilities and the deployment of massive heterogeneous connectivity with more than a million internet of things (IoT) and other devices per square kilometer and up to ten million gadgets in 6G scenarios. In addition, the new generation of smart industries and the energy of things (EoT) context demand novel, reliable, energy-efficient network protocols involving massive sensor cooperation. Such scenarios impose new demands and opportunities to cope with the ever-growing cooperative dense ad hoc environments. Position location information (PLI) plays a crucial role as an enabler of several location-aware network protocols and applications. In this paper, we have proposed a novel context-aware statistical dead reckoning localization technique suitable for high dense cooperative sensor networks, where direct angle and distance estimations between peers are not required along the route, as in other dead reckoning-based localization approaches, but they are obtainable from the node's context information. Validation of the proposed technique was assessed in several scenarios through simulations, achieving localization errors as low as 0.072 m for the worst case analyzed.

RadarPDR: Radar-Assisted Indoor Pedestrian Dead Reckoning.

Pedestrian dead reckoning (PDR) is the critical component in indoor pedestrian tracking and navigation services. While most of the recent PDR solutions exploit in-built inertial sensors in smartphones for next step estimation, due to measurement errors and sensing drift, the accuracy of walking direction, step detection, and step length estimation cannot be guaranteed, leading to large accumulative tracking errors. In this paper, we propose a radar-assisted PDR scheme, called RadarPDR, which integrates a frequency-modulation continuous-wave (FMCW) radar to assist the inertial sensors-based PDR. We first establish a segmented wall distance calibration model to deal with the radar ranging noise caused by irregular indoor building layouts and fuse wall distance estimation with acceleration and azimuth signals measured by the inertial sensors of a smartphone. We also propose a hierarchical particle filter(PF) together with an extended Kalman filter for position and trajectory adjustment. Experiments have been conducted in practical indoor scenarios. Results demonstrate that the proposed RadarPDR is efficient and stable and outperforms the widely used inertial sensors-based PDR scheme.

Deep Neural Network-Based Fusion Localization Using Smartphones.

Indoor location-based services (LBS) have tremendous practical and social value in intelligent life due to the pervasiveness of smartphones. The magnetic field-based localization method has been an interesting research hotspot because of its temporal stability, ubiquitousness, infrastructure-free nature, and good compatibility with smartphones. However, utilizing discrete magnetic signals may result in ambiguous localization features caused by random noise and similar magnetic signals in complex symmetric and large-scale indoor environments. To address this issue, we propose a deep neural network-based fusion indoor localization system that integrates magnetic and pedestrian dead reckoning (PDR). In this system, we first propose a ResNet-GRU-LSTM neural network model to achieve magnetic localization more accurately. Afterward, we put forward a multifeatured-driven step length estimation. A hierarchy GRU (H-GRU) neural network model is proposed, and a multidimensional dataset using acceleration and a gyroscope is constructed to extract more valid characteristics. Finally, more reliable and accurate pedestrian localization can be achieved under the particle filter framework. Experiments were conducted at two trial sites with two pedestrians and four smartphones. Results demonstrate that the proposed system achieves better accuracy and robustness than other traditional localization algorithms. Moreover, the proposed system exhibits good generality and practicality in real-time localization with low cost and low computational complexity.

A Positioning and Navigation Method Combining Multimotion Features Dead Reckoning with Acoustic Localization.

Accurate location information can offer huge commercial and social value and has become a key research topic. Acoustic-based positioning has high positioning accuracy, although some anomalies that affect the positioning performance arise. Inertia-assisted positioning has excellent autonomous characteristics, but its localization errors accumulate over time. To address these issues, we propose a novel positioning navigation system that integrates acoustic estimation and dead reckoning with a novel step-length model. First, the features that include acceleration peak-to-valley amplitude difference, walk frequency, variance of acceleration, mean acceleration, peak median, and valley median are extracted from the collected motion data. The previous three steps and the maximum and minimum values of the acceleration measurement at the current step are extracted to predict step length. Then, the LASSO regularization spatial constraint under the extracted features optimizes and solves for the accurate step length. The acoustic estimation is determined by a hybrid CHAN-Taylor algorithm. Finally, the location is determined using an extended Kalman filter (EKF) merged with the improved pedestrian dead reckoning (PDR) estimation and acoustic estimation. We conducted some comparative experiments in two different scenarios using two heterogeneous devices. The experimental results show that the proposed fusion positioning navigation method achieves 8~56.28 cm localization accuracy. The proposed method can significantly migrate the cumulative error of PDR and high-robustness localization under different experimental conditions.

Improving Indoor Pedestrian Dead Reckoning for Smartphones under Magnetic Interference Using Deep Learning.

As micro-electro-mechanical systems (MEMS) technology continues its rapid ascent, a growing array of smart devices are integrating lightweight, compact, and cost-efficient magnetometers and inertial sensors, paving the way for advanced human motion analysis. However, sensors housed within smartphones frequently grapple with the detrimental effects of magnetic interference on heading estimation, resulting in diminished accuracy. To counteract this challenge, this study introduces a method that synergistically employs convolutional neural networks (CNNs) and support vector machines (SVMs) for adept interference detection. Utilizing a CNN, we automatically extract profound features from single-step pedestrian motion data that are then channeled into an SVM for interference detection. Based on these insights, we formulate heading estimation strategies aptly suited for scenarios both devoid of and subjected to magnetic interference. Empirical assessments underscore our method's prowess, boasting an impressive interference detection accuracy of 99.38%. In indoor environments influenced by such magnetic disturbances, evaluations conducted along square and equilateral triangle trajectories revealed single-step heading absolute error averages of 2.1891° and 1.5805°, with positioning errors averaging 0.7565 m and 0.3856 m, respectively. These results lucidly attest to the robustness of our proposed approach in enhancing indoor pedestrian positioning accuracy in the face of magnetic interferences.

3D Visual Reconstruction as Prior Information for First Responder Localization and Visualization.

In professional use cases like police or fire brigade missions, coordinated and systematic force management is crucial for achieving operational success during intervention by the emergency personnel. A real-time situation picture enhances the coordination of the team. This situation picture includes not only an overview of the environment but also the positions, i.e., localization, of the emergency forces. The overview of the environment can be obtained either from known situation pictures like floorplans or by scanning the environment with the aid of visual sensors. The self-localization problem can be solved outdoors using the Global Navigation Satellite System (GNSS), but it is not fully solved indoors, where the GNSS signal might not be received or might be degraded. In this paper, we propose a novel combination of an inertial localization technique based on simultaneous localization and mapping (SLAM) with 3D building scans, which are used as prior information, for geo-referencing the positions, obtaining a situation picture, and finally visualizing the results with an appropriate visualization tool. We developed a new method for converting point clouds into a hexagonal prism map specifically designed for our SLAM algorithm. With this combination, we could keep the equipment for first responders as lightweight as required. We showed that the positioning led to an average accuracy of less than 1m indoors, and the final visualization including the building layout obtained by the 3D building reconstruction will be advantageous for coordinating first responder operations.

Practical and Accurate Indoor Localization System Using Deep Learning.

Indoor localization is an important technology for providing various location-based services to smartphones. Among the various indoor localization technologies, pedestrian dead reckoning using inertial measurement units is a simple and highly practical solution for indoor localization. In this study, we propose a smartphone-based indoor localization system using pedestrian dead reckoning. To create a deep learning model for estimating the moving speed, accelerometer data and GPS values were used as input data and data labels, respectively. This is a practical solution compared with conventional indoor localization mechanisms using deep learning. We improved the positioning accuracy via data preprocessing, data augmentation, deep learning modeling, and correction of heading direction. In a horseshoe-shaped indoor building of 240 m in length, the experimental results show a distance error of approximately 3 to 5 m.

Smartphone-Based Localization for Passengers Commuting in Traffic Hubs.

Passengers commute between different modes of transportation in traffic hubs, and passenger localization is a key component for the effective functioning of these spaces. The smartphone-based localization system presented in this work is based on the 3D step and heading approach, which is adapted depending on the position of the smartphone, i.e., held in the hand or in the front pocket of the trousers. We use the accelerometer, gyroscope and barometer embedded in the smartphone to detect the steps and the direction of movement of the passenger. To correct the accumulated error, we detect landmarks, particularly staircases and elevators. To test our localization algorithm, we have recorded real-world mobility data in a test station in Munich city center where we have ground truth points. We achieve a 3D position accuracy of 12 m for a smartphone held in the hand and 10 m when the phone is placed in the front pocket of the trousers.

Indoor Spatiotemporal Contact Analytics Using Landmark-Aided Pedestrian Dead Reckoning on Smartphones.

Due to the prevalence of COVID-19, providing safe environments and reducing the risks of virus exposure play pivotal roles in our daily lives. Contact tracing is a well-established and widely-used approach to track and suppress the spread of viruses. Most digital contact tracing systems can detect direct face-to-face contact based on estimated proximity, without quantifying the exposed virus concentration. In particular, they rarely allow for quantitative analysis of indirect environmental exposure due to virus survival time in the air and constant airborne transmission. In this work, we propose an indoor spatiotemporal contact awareness framework (iSTCA), which explicitly considers the self-containing quantitative contact analytics approach with spatiotemporal information to provide accurate awareness of the virus quanta concentration in different origins at various times. Smartphone-based pedestrian dead reckoning (PDR) is employed to precisely detect the locations and trajectories for distance estimation and time assessment without the need to deploy extra infrastructure. The PDR technique we employ calibrates the accumulative error by identifying spatial landmarks automatically. We utilized a custom deep learning model composed of bidirectional long short-term memory (Bi-LSTM) and multi-head convolutional neural networks (CNNs) for extracting the local correlation and long-term dependency to recognize landmarks. By considering the spatial distance and time difference in an integrated manner, we can quantify the virus quanta concentration of the entire indoor environment at any time with all contributed virus particles. We conducted an extensive experiment based on practical scenarios to evaluate the performance of the proposed system, showing that the average positioning error is reduced to less than 0.7 m with high confidence and demonstrating the validity of our system for the virus quanta concentration quantification involving virus movement in a complex indoor environment.

Design of a "Cobot Tactile Display" for Accessing Virtual Diagrams by Blind and Visually Impaired Users.

Access to graphical information plays a very significant role in today's world. Access to this information can be particularly limiting for individuals who are blind or visually impaired (BVIs). In this work, we present the design of a low-cost, mobile tactile display that also provides robotic assistance/guidance using haptic virtual fixtures in a shared control paradigm to aid in tactile diagram exploration. This work is part of a larger project intended to improve the ability of BVI users to explore tactile graphics on refreshable displays (particularly exploration time and cognitive load) through the use of robotic assistance/guidance. The particular focus of this paper is to share information related to the design and development of an affordable and compact device that may serve as a solution towards this overall goal. The proposed system uses a small omni-wheeled robot base to allow for smooth and unlimited movements in the 2D plane. Sufficient position and orientation accuracy is obtained by using a low-cost dead reckoning approach that combines data from an optical mouse sensor and inertial measurement unit. A low-cost force-sensing system and an admittance control model are used to allow shared control between the Cobot and the user, with the addition of guidance/virtual fixtures to aid in diagram exploration. Preliminary semi-structured interviews, with four blind or visually impaired participants who were allowed to use the Cobot, found that the system was easy to use and potentially useful for exploring virtual diagrams tactually.

QuadNet: A Hybrid Framework for Quadrotor Dead Reckoning.

Quadrotor usage is continuously increasing for both civilian and military applications such as surveillance, mapping, and deliveries. Commonly, quadrotors use an inertial navigation system combined with a global navigation satellite systems receiver for outdoor applications and a camera for indoor/outdoor applications. For various reasons, such as lighting conditions or satellite signal blocking, the quadrotor's navigation solution depends only on the inertial navigation system solution. As a consequence, the navigation solution drifts in time due to errors and noises in the inertial sensor measurements. To handle such situations and bind the solution drift, the quadrotor dead reckoning (QDR) approach utilizes pedestrian dead reckoning principles. To that end, instead of flying the quadrotor in a straight line trajectory, it is flown in a periodic motion, in the vertical plane, to enable peak-to-peak (two local maximum points within the cycle) distance estimation. Although QDR manages to improve the pure inertial navigation solution, it has several shortcomings as it requires calibration before usage, provides only peak-to-peak distance, and does not provide the altitude of the quadrotor. To circumvent these issues, we propose QuadNet, a hybrid framework for quadrotor dead reckoning to estimate the quadrotor's three-dimensional position vector at any user-defined time rate. As a hybrid approach, QuadNet uses both neural networks and model-based equations during its operation. QuadNet requires only the inertial sensor readings to provide the position vector. Experimental results with DJI's Matrice 300 quadrotor are provided to show the benefits of using the proposed approach.

Upper Limb Position Tracking with a Single Inertial Sensor Using Dead Reckoning Method with Drift Correction Techniques.

Inertial sensors are widely used in human motion monitoring. Orientation and position are the two most widely used measurements for motion monitoring. Tracking with the use of multiple inertial sensors is based on kinematic modelling which achieves a good level of accuracy when biomechanical constraints are applied. More recently, there is growing interest in tracking motion with a single inertial sensor to simplify the measurement system. The dead reckoning method is commonly used for estimating position from inertial sensors. However, significant errors are generated after applying the dead reckoning method because of the presence of sensor offsets and drift. These errors limit the feasibility of monitoring upper limb motion via a single inertial sensing system. In this paper, error correction methods are evaluated to investigate the feasibility of using a single sensor to track the movement of one upper limb segment. These include zero velocity update, wavelet analysis and high-pass filtering. The experiments were carried out using the nine-hole peg test. The results show that zero velocity update is the most effective method to correct the drift from the dead reckoning-based position tracking. If this method is used, then the use of a single inertial sensor to track the movement of a single limb segment is feasible.

A Dead Reckoning Calibration Scheme Based on Optimization with an Adaptive Quantum-Inspired Evolutionary Algorithm for Vehicle Self-Localization.

Parameter calibration is critical for self-localization based on dead reckoning in the control of intelligent vehicles such as autonomous driving. Most traditional calibration methods for robotics control based on dead reckoning rely on data collection with specially designed paths. For the calibration of parameters in the control of intelligent vehicles, the design of such paths is considered impossible due to the complexity of road conditions. To solve this problem, an optimization-based dead reckoning calibration scheme is introduced in this research using the differential global positioning system to obtain the actual positions of the intelligent vehicle. In this scheme, the difference between the positions obtained through dead reckoning and the positions obtained through the differential global positioning system is selected as the optimization objective function to be minimized. An adaptive quantum-inspired evolutionary algorithm is developed to improve the quality and efficiency of optimization. Experiments with an intelligent vehicle were also conducted to demonstrate the effectiveness of the developed calibration scheme. In addition, the newly introduced adaptive quantum-inspired evolutionary algorithm is compared with the classic genetic algorithm and the classic quantum-inspired evolutionary algorithm using eight benchmark test functions considering computation quality and efficiency.

Lane Detection Aided Online Dead Reckoning for GNSS Denied Environments.

With the emerging interest of autonomous vehicles (AV), the performance and reliability of the land vehicle navigation are also becoming important. Generally, the navigation system for passenger car has been heavily relied on the existing Global Navigation Satellite System (GNSS) in recent decades. However, there are many cases in real world driving where the satellite signals are challenged; for example, urban streets with buildings, tunnels, or even underpasses. In this paper, we propose a novel method for simultaneous vehicle dead reckoning, based on the lane detection model in GNSS-denied situations. The proposed method fuses the Inertial Navigation System (INS) with learning-based lane detection model to estimate the global position of vehicle, and effectively bounds the error drift compared to standalone INS. The integration of INS and lane model is accomplished by UKF to minimize linearization errors and computing time. The proposed method is evaluated through the real-vehicle experiments on highway driving, and the comparative discussions for other dead-reckoning algorithms with the same system configuration are presented.

A Novel V2V Cooperative Collision Warning System Using UWB/DR for Intelligent Vehicles.

The collision warning system (CWS) plays an essential role in vehicle active safety. However, traditional distance-measuring solutions, e.g., millimeter-wave radars, ultrasonic radars, and lidars, fail to reflect vehicles' relative attitude and motion trends. In this paper, we proposed a vehicle-to-vehicle (V2V) cooperative collision warning system (CCWS) consisting of an ultra-wideband (UWB) relative positioning/directing module and a dead reckoning (DR) module with wheel-speed sensors. Each vehicle has four UWB modules on the body corners and two wheel-speed sensors on the rear wheels in the presented configuration. An over-constrained localization method is proposed to calculate the relative position and orientation with the UWB data more accurately. Vehicle velocities and yaw rates are measured by wheel-speed sensors. An extended Kalman filter (EKF) is applied based on the relative kinematic model to combine the UWB and DR data. Finally, the time to collision (TTC) is estimated based on the predicted vehicle collision position. Furthermore, through UWB signals, vehicles can simultaneously communicate with each other and share information, e.g., velocity, yaw rate, which brings the potential for enhanced real-time performance. Simulation and experimental results show that the proposed method significantly improves the positioning, directing, and velocity estimating accuracy, and the proposed system can efficiently provide collision warning.

A Pilot Study to Validate a Wearable Inertial Sensor for Gait Assessment in Older Adults with Falls.

The high prevalence of falls and the enormous impact they have on the elderly population is a cause for concern. We aimed to develop a walking-monitor gait pattern (G-STRIDE) for older adults based on a 6-axis inertial measurement (IMU) with the application of pedestrian dead reckoning algorithms and tested its structural and clinical validity. A cross-sectional case-control study was conducted with 21 participants (11 fallers and 10 non-fallers). We measured gait using an IMU attached to the foot while participants walked around different grounds (indoor flooring, outdoor floor, asphalt, etc.). The G-STRIDE consisted of a portable inertial device that monitored the gait pattern and a mobile app for telematic clinical analysis. G-STRIDE made it possible to measure gait parameters under normal living conditions when walking without assessing the patient in the outpatient clinic. Moreover, we verified concurrent validity with convectional outcome measures using intraclass correlation coefficients (ICCs) and analyzed the differences between participants. G-STRIDE showed high estimation accuracy for the walking speed of the elderly and good concurrent validity compared to conventional measures (ICC = 0.69; p < 0.000). In conclusion, the developed inertial-based G-STRIDE can accurately classify older people with risk to fall with a significance as high as using traditional but more subjective clinical methods (gait speed, Timed Up and Go Test).

Algorithm for Dynamic Fingerprinting Radio Map Creation Using IMU Measurements.

While a vast number of location-based services appeared lately, indoor positioning solutions are developed to provide reliable position information in environments where traditionally used satellite-based positioning systems cannot provide access to accurate position estimates. Indoor positioning systems can be based on many technologies; however, radio networks and more precisely Wi-Fi networks seem to attract the attention of a majority of the research teams. The most widely used localization approach used in Wi-Fi-based systems is based on fingerprinting framework. Fingerprinting algorithms, however, require a radio map for position estimation. This paper will describe a solution for dynamic radio map creation, which is aimed to reduce the time required to build a radio map. The proposed solution is using measurements from IMUs (Inertial Measurement Units), which are processed with a particle filter dead reckoning algorithm. Reference points (RPs) generated by the implemented dead reckoning algorithm are then processed by the proposed reference point merging algorithm, in order to optimize the radio map size and merge similar RPs. The proposed solution was tested in a real-world environment and evaluated by the implementation of deterministic fingerprinting positioning algorithms, and the achieved results were compared with results achieved with a static radio map. The achieved results presented in the paper show that positioning algorithms achieved similar accuracy even with a dynamic map with a low density of reference points.