Validation of a micro-doppler radar for measuring gait modifications during multidirectional visual perturbations.

BACKGROUND: Changes in spatio-temporal gait parameters and their variability during balance-challenging tasks are markers of motor performance linked to fall risk. Radio frequency (RF) sensors hold great promise towards achieving continuous remote monitoring of these parameters. RESEARCH QUESTIONS: To establish the concurrent validity of RF-based gait metrics extracted using micro-Doppler (µD) signatures and to determine whether these metrics are sensitive to gait modifications created by multidirectional visual perturbations. METHODS: Fifteen participants walked overground in a virtual environment (VE) and VE with medio-lateral (ML) and antero-posterior (AP) perturbations. An optoelectronic motion capture system and one RF sensor were used to extract the linear velocity of the trunk and estimate step time (ST), step velocity (SV), step length (SL), and their variability (STV, SVV, and SLV). Intra-class coefficient for consistency (ICC), mean and standard deviation of the differences (MD), 95 % limits of agreement, and Pearson correlation coefficients (r) were used to determine concurrent validity. One-way repeated-measures analysis of variance was used to analyze the main and interaction effects of visual conditions. RESULTS: All outcomes showed good to excellent reliability (r>0.795, ICC>0.886). Average gait parameters showed good to excellent agreement, with values obtained with the RF sensor systematically smaller than the values obtained with the markers (MD of 0.001 s, 0.09 m/s, and 0.06 m). Gait variability parameters showed poor to moderate agreement, with values obtained with the RF sensor systematically larger than those obtained with the markers (MD of 1.9 %-3.9 %). Both measurement systems reported decreased SL and SV during ML perturbations, but the gait variability parameters extracted with the radar were not able to detect the higher STV and SLV during this condition. SIGNIFICANCE: The radar µD signature is a valid and reliable method for the assessment of average spatio-temporal gait parameters but gait variability measures need to be viewed with caution because of the lower levels of agreement and sensitivity to ML visual perturbations. This work represents an initial investigation for the development of a low-cost system that will facilitate aging-in-place by providing remote monitoring of gait in natural settings.

EmRad: Ubiquitous Vital Sign Sensing Using Compact Continuous-Wave Radars.

In biomedical monitoring, non-intrusive and continuous tracking of vital signs is a crucial yet challenging objective. Although accurate, traditional methods, such as electrocardiography (ECG) and photoplethysmography (PPG), necessitate direct contact with the patient, posing limitations for long-term and unobtrusive monitoring. To address this challenge, we introduce the EmRad system, an innovative solution harnessing the capabilities of continuous-wave (CW) radar technology for the contactless detection of vital signs, including heart rate and respiratory rate. EmRad discerns itself by emphasizing miniaturization, performance, scalability, and its ability to generate large-scale datasets in various environments. This article explains the system's design, focusing on signal processing strategies and motion artifact reduction to ensure precise vital sign extraction. The EmRad system's versatility is showcased through various case studies, highlighting its potential to transform vital sign monitoring in research and clinical contexts.

Doppler Radar Sensor-Based Fall Detection Using a Convolutional Bidirectional Long Short-Term Memory Model.

Falls among the elderly are a common and serious health risk that can lead to physical injuries and other complications. To promptly detect and respond to fall events, radar-based fall detection systems have gained widespread attention. In this paper, a deep learning model is proposed based on the frequency spectrum of radar signals, called the convolutional bidirectional long short-term memory (CB-LSTM) model. The introduction of the CB-LSTM model enables the fall detection system to capture both temporal sequential and spatial features simultaneously, thereby enhancing the accuracy and reliability of the detection. Extensive comparison experiments demonstrate that our model achieves an accuracy of 98.83% in detecting falls, surpassing other relevant methods currently available. In summary, this study provides effective technical support using the frequency spectrum and deep learning methods to monitor falls among the elderly through the design and experimental validation of a radar-based fall detection system, which has great potential for improving quality of life for the elderly and providing timely rescue measures.

A New Method for Traffic Participant Recognition Using Doppler Radar Signature and Convolutional Neural Networks.

The latest survey results show an increase in accidents on the roads involving pedestrians and cyclists. The reasons for such situations are many, the fault actually lies on both sides. Equipping vehicles, especially autonomous vehicles, with frequency-modulated continuous-wave (FMCW) radar and dedicated algorithms for analyzing signals in the time-frequency domain as well as algorithms for recognizing objects in radar imaging through deep neural networks can positively affect safety. This paper presents a method for recognizing and distinguishing a group of objects based on radar signatures of objects and a special convolutional neural network structure. The proposed approach is based on a database of radar signatures generated on pedestrian, cyclist, and car models in a Matlab environment. The obtained results of simulations and positive tests provide a basis for the application of the system in many sectors and areas of the economy. Innovative aspects of the work include the method of discriminating between multiple objects on a single radar signature, the dedicated architecture of the convolutional neural network, and the use of a method of generating a custom input database.

Chest Wall Motion Model of Cardiac Activity for Radar-Based Vital-Sign-Detection System.

An increasing number of studies on non-contact vital sign detection using radar are now beginning to turn to data-driven neural network approaches rather than traditional signal-processing methods. However, there are few radar datasets available for deep learning due to the difficulty of acquiring and labeling the data, which require specialized equipment and physician collaboration. This paper presents a new model of heartbeat-induced chest wall motion (CWM) with the goal of generating a large amount of simulation data to support deep learning methods. An in-depth analysis of published CWM data collected by the VICON Infrared (IR) motion capture system and continuous wave (CW) radar system during respiratory hold was used to summarize the motion characteristics of each stage within a cardiac cycle. In combination with the physiological properties of the heartbeat, appropriate mathematical functions were selected to describe these movement properties. The model produced simulation data that closely matched the measured data as evaluated by dynamic time warping (DTW) and the root-mean-squared error (RMSE). By adjusting the model parameters, the heartbeat signals of different individuals were simulated. This will accelerate the application of data-driven deep learning methods in radar-based non-contact vital sign detection research and further advance the field.

Remote Emotion Recognition Using Continuous-Wave Bio-Radar System.

The Bio-Radar is herein presented as a non-contact radar system able to capture vital signs remotely without requiring any physical contact with the subject. In this work, the ability to use the proposed system for emotion recognition is verified by comparing its performance on identifying fear, happiness and a neutral condition, with certified measuring equipment. For this purpose, machine learning algorithms were applied to the respiratory and cardiac signals captured simultaneously by the radar and the referenced contact-based system. Following a multiclass identification strategy, one could conclude that both systems present a comparable performance, where the radar might even outperform under specific conditions. Emotion recognition is possible using a radar system, with an accuracy equal to 99.7% and an F1-score of 99.9%. Thus, we demonstrated that it is perfectly possible to use the Bio-Radar system for this purpose, which is able to be operated remotely, avoiding the subject awareness of being monitored and thus providing more authentic reactions.

Hand Gesture Recognition Using FSK Radar Sensors.

Hand gesture recognition, which is one of the fields of human-computer interaction (HCI) research, extracts the user's pattern using sensors. Radio detection and ranging (RADAR) sensors are robust under severe environments and convenient to use for hand gestures. The existing studies mostly adopted continuous-wave (CW) radar, which only shows a good performance at a fixed distance, which is due to its limitation of not seeing the distance. This paper proposes a hand gesture recognition system that utilizes frequency-shift keying (FSK) radar, allowing for a recognition method that can work at the various distances between a radar sensor and a user. The proposed system adopts a convolutional neural network (CNN) model for the recognition. From the experimental results, the proposed recognition system covers the range from 30 cm to 180 cm and shows an accuracy of 93.67% over the entire range.

Comparative Analysis of Audio Processing Techniques on Doppler Radar Signature of Human Walking Motion Using CNN Models.

Artificial intelligence (AI) radar technology offers several advantages over other technologies, including low cost, privacy assurance, high accuracy, and environmental resilience. One challenge faced by AI radar technology is the high cost of equipment and the lack of radar datasets for deep-learning model training. Moreover, conventional radar signal processing methods have the obstacles of poor resolution or complex computation. Therefore, this paper discusses an innovative approach in the integration of radar technology and machine learning for effective surveillance systems that can surpass the aforementioned limitations. This approach is detailed into three steps: signal acquisition, signal processing, and feature-based classification. A hardware prototype of the signal acquisition circuitry was designed for a Continuous Wave (CW) K-24 GHz frequency band radar sensor. The collected radar motion data was categorized into non-human motion, human walking, and human walking without arm swing. Three signal processing techniques, namely short-time Fourier transform (STFT), mel spectrogram, and mel frequency cepstral coefficients (MFCCs), were employed. The latter two are typically used for audio processing, but in this study, they were proposed to obtain micro-Doppler spectrograms for all motion data. The obtained micro-Doppler spectrograms were then fed to a simplified 2D convolutional neural networks (CNNs) architecture for feature extraction and classification. Additionally, artificial neural networks (ANNs) and 1D CNN models were implemented for comparative analysis on various aspects. The experimental results demonstrated that the 2D CNN model trained on the MFCC feature outperformed the other two methods. The accuracy rate of the object classification models trained on micro-Doppler features was 97.93%, indicating the effectiveness of the proposed approach.

STRIDE: Systematic Radar Intelligence Analysis for ADRD Risk Evaluation with Gait Signature Simulation and Deep Learning.

Abnormal gait is a significant non-cognitive biomarker for Alzheimer's disease (AD) and AD-related dementia (ADRD). Micro-Doppler radar, a non-wearable technology, can capture human gait movements for potential early ADRD risk assessment. In this research, we propose to design STRIDE integrating micro-Doppler radar sensors with advanced artificial intelligence (AI) technologies. STRIDE embeds a new deep learning (DL) classification framework. As a proof of concept, we develop a "digital-twin" of STRIDE, consisting of a human walking simulation model and a micro-Doppler radar simulation model, to generate a gait signature dataset. Taking established human walking parameters, the walking model simulates individuals with ADRD under various conditions. The radar model based on electromagnetic scattering and the Doppler frequency shift model is employed to generate micro-Doppler signatures from different moving body parts (e.g., foot, limb, joint, torso, shoulder, etc.). A band-dependent DL framework is developed to predict ADRD risks. The experimental results demonstrate the effectiveness and feasibility of STRIDE for evaluating ADRD risk.

Altimetry Method for an Interferometric Radar Altimeter Based on a Phase Quality Evaluation.

A radar altimeter (RA) is useful to improve autonomous functions such as landing guidance or navigation control of an aircraft. To ensure more precise and safer flights by aircraft, an interferometric RA (IRA) capable of measuring the angle of a target is required. However, the phase-comparison monopulse (PCM) technique used in IRAs has a problem in that an angular ambiguity arises with respect to a target with multiple reflection points, such as terrain. In this paper, we propose an altimetry method for IRAs that reduces the angular ambiguity by evaluating the quality of the phase. The altimetry method as introduced here is sequentially described based on synthetic aperture radar, a delay/Doppler radar altimeter, and PCM techniques. Finally, a phase quality evaluation method is proposed for use in the azimuth estimation process. Aircraft captive flight test results are presented and analyzed, and the validity of the proposed method is examined.

A Low-Cost Radar-Based IoT Sensor for Noncontact Measurements of Water Surface Velocity and Depth.

We designed an out-of-water radar water velocity and depth sensor, which is unique due to its low cost and low power consumption. The sensor is a first at a cost of less than USD 50, which is well suited to previously cost-prohibited high-resolution monitoring schemes. This use case is further supported by its out-of-water operation, which provides low-effort installations and longer maintenance-free intervals when compared with in-water sensors. The inclusion of both velocity and depth measurement capabilities allows the sensor to also be used as an all-in-one solution for flowrate measurement. We discuss the design of the sensor, which has been made freely available under open-hardware and open-source licenses. The design uses commonly available electronic components, and a 3D-printed casing makes the design easy to replicate and modify. Not before seen on a hydrology sensor, we include a 3D-printed radar lens in the casing, which boosts radar sensitivity by 21 dB. The velocity and depth-sensing performance were characterised in laboratory and in-field tests. The depth is accurate to within ±6% and ±7 mm and the uncertainty in the velocity measurements ranges from less than 30% to 36% in both laboratory and field conditions. Our sensor is demonstrated to be a feasible low-cost design which nears the uncertainty of current, yet more expensive, velocity sensors, especially when field performance is considered.

Doppler radar remote sensing of respiratory function.

Doppler radar remote sensing of torso kinematics can provide an indirect measure of cardiopulmonary function. Motion at the human body surface due to heart and lung activity has been successfully used to characterize such measures as respiratory rate and depth, obstructive sleep apnea, and even the identity of an individual subject. For a sedentary subject, Doppler radar can track the periodic motion of the portion of the body moving as a result of the respiratory cycle as distinct from other extraneous motions that may occur, to provide a spatial temporal displacement pattern that can be combined with a mathematical model to indirectly assess quantities such as tidal volume, and paradoxical breathing. Furthermore, it has been demonstrated that even healthy respiratory function results in distinct motion patterns between individuals that vary as a function of relative time and depth measures over the body surface during the inhalation/exhalation cycle. Potentially, the biomechanics that results in different measurements between individuals can be further exploited to recognize pathology related to lung ventilation heterogeneity and other respiratory diagnostics.

Multi-Layer Beam Scanning Leaky Wave Antenna for Remote Vital Signs Detection at 60 GHz.

A multi-layer beam-scanning leaky wave antenna (LWA) for remote vital sign monitoring (RVSM) at 60 GHz using a single-tone continuous-wave (CW) Doppler radar has been developed in a typical dynamic environment. The antenna's components are: a partially reflecting surface (PRS), high-impedance surfaces (HISs), and a plain dielectric slab. A dipole antenna works as a source together with these elements to produce a gain of 24 dBi, a frequency beam scanning range of 30°, and precise remote vital sign monitoring (RVSM) up to 4 m across the operating frequency range (58-66 GHz). The antenna requirements for the DR are summarised in a typical dynamic scenario where a patient is to have continuous monitoring remotely, while sleeping. During the continuous health monitoring process, the patient has the freedom to move up to one meter away from the fixed sensor position.The proposed multi-layer LWA system was placed at a distance of 2 m and 4 m from the test subject to confirm the suitability of the developed antenna for dynamic RVSM applications. A proper setting of the operating frequency range (58 to 66 GHz) enabled the detection of both heart beats and respiration rates of the subject within a 30° angular range.

Smart Spread Spectrum Modulated Tags for Detection of Vulnerable Road Users with Automotive Radar.

In recent years, there has been a significant increase in the number of collisions between vehicles and vulnerable road users such as pedestrians, cyclists, road workers and more recently scooter riders, especially in urban streets. This work studies the feasibility of enhancing the detection of these users by means of CW radars because they have a low radar cross section. Since the speed of these users is usually low, they can be confused with clutter due to the presence of large objects. To this end, this paper proposes, for the first time, a method based on a spread spectrum radio communication between vulnerable road users and the automotive radar consisting of modulating a backscatter tag, placed on the user. In addition, it is compatible with low-cost radars that use different waveforms such as CW, FSK or FMCW, and hardware modifications are not required. The prototype that has been developed is based on a commercial monolithic microwave integrated circuit (MMIC) amplifier connected between two antennas, which is modulated by switching its bias. Experimental results with a scooter, under static and moving conditions, using a low-power Doppler radar at a 24 GHz band compatible with blind spot radars, are provided.

Exploration of Effective Time-Velocity Distribution for Doppler-Radar-Based Personal Gait Identification Using Deep Learning.

Personal identification based on radar gait measurement is an important application of biometric technology because it enables remote and continuous identification of people, irrespective of the lighting conditions and subjects' outfits. This study explores an effective time-velocity distribution and its relevant parameters for Doppler-radar-based personal gait identification using deep learning. Most conventional studies on radar-based gait identification used a short-time Fourier transform (STFT), which is a general method to obtain time-velocity distribution for motion recognition using Doppler radar. However, the length of the window function that controls the time and velocity resolutions of the time-velocity image was empirically selected, and several other methods for calculating high-resolution time-velocity distributions were not considered. In this study, we compared four types of representative time-velocity distributions calculated from the Doppler-radar-received signals: STFT, wavelet transform, Wigner-Ville distribution, and smoothed pseudo-Wigner-Ville distribution. In addition, the identification accuracies of various parameter settings were also investigated. We observed that the optimally tuned STFT outperformed other high-resolution distributions, and a short length of the window function in the STFT process led to a reasonable accuracy; the best identification accuracy was 99% for the identification of twenty-five test subjects. These results indicate that STFT is the optimal time-velocity distribution for gait-based personal identification using the Doppler radar, although the time and velocity resolutions of the other methods were better than those of the STFT.

Noncontact Sleeping Heartrate Monitoring Method Using Continuous-Wave Doppler Radar Based on the Difference Quadratic Sum Demodulation and Search Algorithm.

Continuous-wave doppler radar, which has the advantages of simple structure, low cost, and low power consumption, has attracted extensive attention in the detection of human vital signs. However, while respiration and heartbeat signals are mixed in the echo phase, the amplitude difference between the two signals is so large that it becomes difficult to measure the heartrate (HR) from the interference of respiration stably and accurately. In this paper, the difference quadratic sum demodulation method is proposed. According to the mixed characteristics of respiration and heartbeat after demodulation, the heartbeat features can be extracted with the help of the easy-to-detect breathing signal; combined with the constrained nearest neighbor search algorithm, it can realize sleeping HR monitoring overnight without body movements restraint. Considering the differences in vital-sign characteristics of different individuals and the irregularity of sleep movements, 54 h of sleep data for nine nights were collected from three subjects, and then compared with ECG-based HR reference equipment. After excluding the periods of body turning over, the HR error was within 10% for more than 70% of the time. Experiments confirmed that this method, as a tool for long-term HR monitoring, can play an important role in sleeping monitoring, smart elderly care, and smart homes.

Dual-Scale Doppler Attention for Human Identification.

This paper considers a Deep Convolutional Neural Network (DCNN) with an attention mechanism referred to as Dual-Scale Doppler Attention (DSDA) for human identification given a micro-Doppler (MD) signature induced as input. The MD signature includes unique gait characteristics by different sized body parts moving, as arms and legs move rapidly, while the torso moves slowly. Each person is identified based on his/her unique gait characteristic in the MD signature. DSDA provides attention at different time-frequency resolutions to cater to different MD components composed of both fast-varying and steady. Through this, DSDA can capture the unique gait characteristic of each person used for human identification. We demonstrate the validity of DSDA on a recently published benchmark dataset, IDRad. The empirical results show that the proposed DSDA outperforms previous methods, using a qualitative analysis interpretability on MD signatures.

Multi-Criteria Decision Making to Detect Multiple Moving Targets in Radar Using Digital Codes.

Technological advancement in battlefield and surveillance applications switch the radar investigators to put more effort into it, numerous theories and models have been proposed to improve the process of target detection in Doppler tolerant radar. However, still, more effort is needed towards the minimization of the noise below the radar threshold limit to accurately detect the target. In this paper, a digital coding technique is being discussed to mitigate the noise and to create clear windows for desired target detection. Moreover, multi-criteria of digital code combinations are developed using discrete mathematics and all designed codes have been tested to investigate various target detection properties such as the auto-correlation, cross-correlation properties, and ambiguity function using mat-lab to optimize and enhance the static and moving target in presence of the Doppler in a multi-target environment.

Pedestrian and Animal Recognition Using Doppler Radar Signature and Deep Learning.

Pedestrian occurrences in images and videos must be accurately recognized in a number of applications that may improve the quality of human life. Radar can be used to identify pedestrians. When distinct portions of an object move in front of a radar, micro-Doppler signals are produced that may be utilized to identify the object. Using a deep-learning network and time-frequency analysis, we offer a method for classifying pedestrians and animals based on their micro-Doppler radar signature features. Based on these signatures, we employed a convolutional neural network (CNN) to recognize pedestrians and animals. The proposed approach was evaluated on the MAFAT Radar Challenge dataset. Encouraging results were obtained, with an AUC (Area Under Curve) value of 0.95 on the public test set and over 0.85 on the final (private) test set. The proposed DNN architecture, in contrast to more common shallow CNN architectures, is one of the first attempts to use such an approach in the domain of radar data. The use of the synthetic radar data, which greatly improved the final result, is the other novel aspect of our work.

A manifold learning approach for gesture recognition from micro-Doppler radar measurements.

A recent paper (Mhaskar (2020)) introduces a straightforward and simple kernel based approximation for manifold learning that does not require the knowledge of anything about the manifold, except for its dimension. In this paper, we examine how the pointwise error in approximation using least squares optimization based on similarly localized kernels depends upon the data characteristics and deteriorates as one goes away from the training data. The theory is presented with an abstract localized kernel, which can utilize any prior knowledge about the data being located on an unknown sub-manifold of a known manifold. We demonstrate the performance of our approach using a publicly available micro-Doppler data set, and investigate the use of different preprocessing measures, kernels, and manifold dimensions. Specifically, it is shown that the localized kernel introduced in the above mentioned paper when used with PCA components leads to a near-competitive performance to deep neural networks, and offers significant improvements in training speed and memory requirements. To demonstrate the fact that our methods are agnostic to the domain knowledge, we examine the classification problem in a simple video data set.