Bootstrap geometric ground calibration method for wide angle star sensors.

Wide angle star sensors are becoming more prevalent in aeronautics. A wide angle lens provides a greater field of view for star detection, but consequently incurs significant lens distortion. The effects of distortion complicate star identification, causing algorithms to fail or report false identifications. We address the issue of calibrating a wide angle star sensor without any specialized equipment, by analyzing two time-separated images captured from a static camera. An initial estimate of the focal length is obtained by observing the displacement of stars between the images. The focal length is subsequently used to build an initial estimate of camera intrinsics, and to identify stars in the image. A RANSAC-augmented Kabsch algorithm is implemented to determine camera orientation, while simultaneously removing false identifications. The identified stars are used to provide a precise estimate of camera focal length, before applying non-linear optimization in a radial search algorithm. The methodology was tested on two cameras, demonstrating the effectiveness of this algorithm in achieving a precise geometric calibration using real hardware, without any specialized calibration equipment.

Integrating RGB-thermal image sensors for non-contact automatic respiration rate monitoring.

Respiration rate (RR) holds significance as a human health indicator. Presently, the conventional RR monitoring system requires direct physical contact, which may cause discomfort and pain. Therefore, this paper proposes a non-contact RR monitoring system integrating RGB and thermal imaging through RGB-thermal image alignment. The proposed method employs an advanced image processing algorithm for automatic region of interest (ROI) selection. The experimental results demonstrated a close correlation and a lower error rate between measured thermal, measured RGB, and reference data. In summary, the proposed non-contact system emerges as a promising alternative to conventional contact-based approaches without the associated discomfort and pain.

Estimating the cardiac signals of chimpanzees using a digital camera: validation and application of a novel non-invasive method for primate research.

Cardiac measures such as heart rate measurements are important indicators of both physiological and psychological states. However, despite their extraordinary potential, their use is restricted in comparative psychology because traditionally cardiac measures involved the attachment of sensors to the participant's body, which, in the case of undomesticated animals such as nonhuman primates, is usually only possible during anesthesia or after extensive training. Here, we validate and apply a camera-based system that enables contact-free detection of animals' heart rates. The system automatically detects and estimates the cardiac signals from cyclic change in the hue of the facial area of a chimpanzee. In Study 1, we recorded the heart rate of chimpanzees using the new technology, while simultaneously measuring heart rate using classic PPG (photoplethysmography) finger sensors. We found that both methods were in good agreement. In Study 2, we applied our new method to measure chimpanzees' heart rate in response to seeing different types of video scenes (groupmates in an agonistic interaction, conspecific strangers feeding, nature videos, etc.). Heart rates changed during video presentation, depending on the video content: Agonistic interactions and conspecific strangers feeding lead to accelerated heart rate relative to baseline, indicating increased emotional arousal. Nature videos lead to decelerated heart rate relative to baseline, indicating a relaxing effect or heightened attention caused by these stimuli. Our results show that the new contact-free technology can reliably assess the heart rate of unrestrained chimpanzees, and most likely other primates. Furthermore, our technique opens up new avenues of research within comparative psychology and facilitates the health management of captive individuals.

Robust Instant Angle Speed Measurement for Internal Combustion Engines-A Novel Sensing Suite and Methodology.

This paper presents the development and implementation of a novel robust sensing and measurement system that achieves fine granularity and permits new insights into operation of rotational machinery. Instant angle speed measurements offer a wealth of useful information for complex machines in which the motion is the result of multidimensional, internal, and external interactions. The implementation of the proposed system was conducted on an internal combustion engine. The internal combustion engine crankshaft's angular velocity is the result of the integration of all variables of motor and resisting forces. The crankshaft angular velocity variation also reflects the interaction between the internal thermodynamic cycle of the engine and the plant it powers. To minimise the number of variables, we used for our experiments an aero piston engine for small air-vehicles-a well-made and reliable powerplant-connected to a propeller. This paper presents the need for a better sensing and measurement system. Then, we show the development of the system, the measurement protocol and process, recording and analysis of the data, and results of some experiments. We then demonstrate the possibilities this sensing suite can achieve-a deeper insight into the operation of the machine-by performing high-quality analyses of engine cycles, well beyond capabilities in the state of the art. This system can be generalised for other rotational machines and equipment.

Optimal Maneuvering for Autonomous Vehicle Self-Localization.

We consider the problem of optimal maneuvering, where an autonomous vehicle, an unmanned aerial vehicle (UAV) for example, must maneuver to maximize or minimize an objective function. We consider a vehicle navigating in a Global Navigation Satellite System (GNSS)-denied environment that self-localizes in two dimensions using angle-of-arrival (AOA) measurements from stationary beacons at known locations. The objective of the vehicle is to travel along the path that minimizes its position and heading estimation error. This article presents an informative path planning (IPP) algorithm that (i) uses the determinant of the self-localization estimation error covariance matrix of an unscented Kalman filter as the objective function; (ii) applies an l-step look-ahead (LSLA) algorithm to determine the optimal heading for a constant-speed vehicle. The novel algorithm takes into account the kinematic constraints of the vehicle and the AOA means of measurement. We evaluate the performance of the algorithm in five scenarios involving stationary and mobile beacons and we find the estimation error approaches the lower bound for the estimator. The simulations show the vehicle maneuvers to locations that allow for minimum estimation uncertainty, even when beacon placement is not conducive to accurate estimation.

Hybrid Coils-Based Wireless Power Transfer for Intelligent Sensors.

Most wearable intelligent biomedical sensors are battery-powered. The batteries are large and relatively heavy, adding to the volume of wearable sensors, especially when implanted. In addition, the batteries have limited capacity, requiring periodic charging, as well as a limited life, requiring potentially invasive replacement. This paper aims to design and implement a prototype energy harvesting technique based on wireless power transfer/magnetic resonator coupling (WPT/MRC) to overcome the battery power problem by supplying adequate power for a heart rate sensor. We optimized transfer power and efficiency at different distances between transmitter and receiver coils. The proposed MRC consists of three units: power, measurement, and monitoring. The power unit included transmitter and receiver coils. The measurement unit consisted of an Arduino Nano microcontroller, a heart rate sensor, and used the nRF24L01 wireless protocol. The experimental monitoring unit was supported by a laptop to monitor the heart rate measurement in real-time. Three coil topologies: spiral-spiral, spider-spider, and spiral-spider were implemented for testing. These topologies were examined to explore which would be the best for the application by providing the highest transfer power and efficiency. The spiral-spider topology achieved the highest transfer power and efficiency with 10 W at 87%, respectively over a 5 cm air gap between transmitter and receiver coils when a 200 Ω resistive load was considered. Whereas, the spider-spider topology accomplished 7 W and 93% transfer power and efficiency at the same airgap and resistive load. The proposed topologies were superior to previous studies in terms of transfer power, efficiency and distance.

Non-contact heart and respiratory rate monitoring of preterm infants based on a computer vision system: a method comparison study.

BACKGROUND: Non-contact heart rate (HR) and respiratory rate (RR) monitoring is necessary for preterm infants due to the potential for the adhesive electrodes of conventional electrocardiogram (ECG) to cause damage to the epidermis. This study was performed to evaluate the agreement between HR and RR measurements of preterm infants using a non-contact computer vision system with comparison to measurements obtained by the ECG. METHODS: A single-centre, cross-sectional observational study was conducted in a Neonatal Unit. Ten infants and their ECG monitors were videoed using two Nikon cameras for 10 min. HR and RR measurements obtained from the non-contact system were extracted using advanced signal processing techniques and later compared to the ECG readings using Bland-Altman analysis. RESULTS: The non-contact system was able to detect an apnoea when the ECG determined movement as respirations. Although the mean bias between both methods was relatively low, the limits of agreement for HR were -8.3 to 17.4 beats per minute (b.p.m.) and for RR, -22 to 23.6 respirations per minute (r.p.m.). CONCLUSIONS: This study provides necessary data for improving algorithms to address confounding variables common to the neonatal population. Further studies investigating the robustness of the proposed system for premature infants are therefore required.

An Advanced First Aid System Based on an Unmanned Aerial Vehicles and a Wireless Body Area Sensor Network for Elderly Persons in Outdoor Environments.

For elderly persons, a fall can cause serious injuries such as a hip fracture or head injury. Here, an advanced first aid system is proposed for monitoring elderly patients with heart conditions that puts them at risk of falling and for providing first aid supplies using an unmanned aerial vehicle. A hybridized fall detection algorithm (FDB-HRT) is proposed based on a combination of acceleration and a heart rate threshold. Five volunteers were invited to evaluate the performance of the heartbeat sensor relative to a benchmark device, and the extracted data was validated using statistical analysis. In addition, the accuracy of fall detections and the recorded locations of fall incidents were validated. The proposed FDB-HRT algorithm was 99.16% and 99.2% accurate with regard to heart rate measurement and fall detection, respectively. In addition, the geolocation error of patient fall incidents based on a GPS module was evaluated by mean absolute error analysis for 17 different locations in three cities in Iraq. Mean absolute error was 1.08 × 10-5° and 2.01 × 10-5° for latitude and longitude data relative to data from the GPS Benchmark system. In addition, the results revealed that in urban areas, the UAV succeeded in all missions and arrived at the patient's locations before the ambulance, with an average time savings of 105 s. Moreover, a time saving of 31.81% was achieved when using the UAV to transport a first aid kit to the patient compared to an ambulance. As a result, we can conclude that when compared to delivering first aid via ambulance, our design greatly reduces delivery time. The proposed advanced first aid system outperformed previous systems presented in the literature in terms of accuracy of heart rate measurement, fall detection, and information messages and UAV arrival time.

A Pilot Study for Estimating the Cardiopulmonary Signals of Diverse Exotic Animals Using a Digital Camera.

Monitoring the cardiopulmonary signal of animals is a challenge for veterinarians in conditions when contact with a conscious animal is inconvenient, difficult, damaging, distressing or dangerous to personnel or the animal subject. In this pilot study, we demonstrate a computer vision-based system and use examples of exotic, untamed species to demonstrate this means to extract the cardiopulmonary signal. Subject animals included the following species: Giant panda (Ailuropoda melanoleuca), African lions (Panthera leo), Sumatran tiger (Panthera tigris sumatrae), koala (Phascolarctos cinereus), red kangaroo (Macropus rufus), alpaca (Vicugna pacos), little blue penguin (Eudyptula minor), Sumatran orangutan (Pongo abelii) and Hamadryas baboon (Papio hamadryas). The study was done without need for restriction, fixation, contact or disruption of the daily routine of the subjects. The pilot system extracts the signal from the abdominal-thoracic region, where cardiopulmonary activity is most likely to be visible using image sequences captured by a digital camera. The results show motion on the body surface of the subjects that is characteristic of cardiopulmonary activity and is likely to be useful to estimate physiological parameters (pulse rate and breathing rate) of animals without any physical contact. The results of the study suggest that a fully controlled study against conventional physiological monitoring equipment is ethically warranted, which may lead to a novel approach to non-contact physiological monitoring and remotely sensed health assessment of animals. The method shows promise for applications in veterinary practice, conservation and game management, animal welfare and zoological and behavioral studies.

Energy-Efficient Elderly Fall Detection System Based on Power Reduction and Wireless Power Transfer.

Elderly fall detection systems based on wireless body area sensor networks (WBSNs) have increased significantly in medical contexts. The power consumption of such systems is a critical issue influencing the overall practicality of the WBSN. Reducing the power consumption of these networks while maintaining acceptable performance poses a challenge. Several power reduction techniques can be employed to tackle this issue. A human vital signs monitoring system (HVSMS) has been proposed here to measure vital parameters of the elderly, including heart rate and fall detection based on heartbeat and accelerometer sensors, respectively. In addition, the location of elderly people can be determined based on Global Positioning System (GPS) and transmitted with their vital parameters to emergency medical centers (EMCs) via the Global System for Mobile Communications (GSM) network. In this paper, the power consumption of the proposed HVSMS was minimized by merging a data-event (DE) algorithm and an energy-harvesting-technique-based wireless power transfer (WPT). The DE algorithm improved HVSMS power consumption, utilizing the duty cycle of the sleep/wake mode. The WPT successfully charged the HVSMS battery. The results demonstrated that the proposed DE algorithm reduced the current consumption of the HVSMS to 9.35 mA compared to traditional operation at 85.85 mA. Thus, an 89% power saving was achieved based on the DE algorithm and the battery life was extended to 30 days instead of 3 days (traditional operation). In addition, the WPT was able to charge the HVSMS batteries once every 30 days for 10 h, thus eliminating existing restrictions involving the use of wire charging methods. The results indicate that the HVSMS current consumption outperformed existing solutions from previous studies.

Detection of Cardiopulmonary Activity and Related Abnormal Events Using Microsoft Kinect Sensor.

Monitoring of cardiopulmonary activity is a challenge when attempted under adverse conditions, including different sleeping postures, environmental settings, and an unclear region of interest (ROI). This study proposes an efficient remote imaging system based on a Microsoft Kinect v2 sensor for the observation of cardiopulmonary-signal-and-detection-related abnormal cardiopulmonary events (e.g., tachycardia, bradycardia, tachypnea, bradypnea, and central apnoea) in many possible sleeping postures within varying environmental settings including in total darkness and whether the subject is covered by a blanket or not. The proposed system extracts the signal from the abdominal-thoracic region where cardiopulmonary activity is most pronounced, using a real-time image sequence captured by Kinect v2 sensor. The proposed system shows promising results in any sleep posture, regardless of illumination conditions and unclear ROI even in the presence of a blanket, whilst being reliable, safe, and cost-effective.

Remote monitoring of cardiorespiratory signals from a hovering unmanned aerial vehicle.

BACKGROUND: Remote physiological measurement might be very useful for biomedical diagnostics and monitoring. This study presents an efficient method for remotely measuring heart rate and respiratory rate from video captured by a hovering unmanned aerial vehicle (UVA). The proposed method estimates heart rate and respiratory rate based on the acquired signals obtained from video-photoplethysmography that are synchronous with cardiorespiratory activity. METHODS: Since the PPG signal is highly affected by the noise variations (illumination variations, subject's motions and camera movement), we have used advanced signal processing techniques, including complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and canonical correlation analysis (CCA) to remove noise under these assumptions. RESULTS: To evaluate the performance and effectiveness of the proposed method, a set of experiments were performed on 15 healthy volunteers in a front-facing position involving motion resulting from both the subject and the UAV under different scenarios and different lighting conditions. CONCLUSION: The experimental results demonstrated that the proposed system with and without the magnification process achieves robust and accurate readings and have significant correlations compared to a standard pulse oximeter and Piezo respiratory belt. Also, the squared correlation coefficient, root mean square error, and mean error rate yielded by the proposed method with and without the magnification process were significantly better than the state-of-the-art methodologies, including independent component analysis (ICA) and principal component analysis (PCA).

Transformation of a high-dimensional color space for material classification.

Images in red-green-blue (RGB) color space need to be transformed to other color spaces for image processing or analysis. For example, the well-known hue-saturation-intensity (HSI) color space, which separates hue from saturation and intensity and is similar to the color perception of humans, can aid many computer vision applications. For high-dimensional images, such as multispectral or hyperspectral images, transformation images to a color space that can separate hue from saturation and intensity would be useful; however, the related works are limited. Some methods could interpret a set of high-dimensional images to hue, saturation, and intensity, but these methods need to reduce the dimension of original images to three images and then map them to the trichromatic color space of RGB. Generally, dimension reduction could cause loss or distortion of original data, and, therefore, the transformed color spaces could not be suitable for material classification in critical conditions. This paper describes a method that can transform high-dimensional images to a color space called hyper-hue-saturation-intensity (HHSI), which is analogous to HSI in high dimensions. The transformation does not need dimension reduction, and, therefore, it can preserve the original information. Experimental results indicate that the hyper-hue is independent of saturation and intensity and it is more suitable for material classification of proximal or remote sensing images captured in a natural environment where illumination usually cannot be controlled.

Real Time Apnoea Monitoring of Children Using the Microsoft Kinect Sensor: A Pilot Study.

The objective of this study was to design a non-invasive system for the observation of respiratory rates and detection of apnoea using analysis of real time image sequences captured in any given sleep position and under any light conditions (even in dark environments). A Microsoft Kinect sensor was used to visualize the variations in the thorax and abdomen from the respiratory rhythm. These variations were magnified, analyzed and detected at a distance of 2.5 m from the subject. A modified motion magnification system and frame subtraction technique were used to identify breathing movements by detecting rapid motion areas in the magnified frame sequences. The experimental results on a set of video data from five subjects (3 h for each subject) showed that our monitoring system can accurately measure respiratory rate and therefore detect apnoea in infants and young children. The proposed system is feasible, accurate, safe and low computational complexity, making it an efficient alternative for non-contact home sleep monitoring systems and advancing health care applications.

Computer Vision Techniques Demonstrate Robust Orientation Measurement of the Milky Way Despite Image Motion.

Many species rely on celestial cues as a reliable guide for maintaining heading while navigating. In this paper, we propose a method that extracts the Milky Way (MW) shape as an orientation cue in low-light scenarios. We also tested the method on both real and synthetic images and demonstrate that the performance of the method appears to be accurate and reliable to motion blur that might be caused by rotational vibration and stabilisation artefacts. The technique presented achieves an angular accuracy between a minimum of 0.00° and a maximum 0.08° for real night sky images, and between a minimum of 0.22° and a maximum 1.61° for synthetic images. The imaging of the MW is largely unaffected by blur. We speculate that the use of the MW as an orientation cue has evolved because, unlike individual stars, it is resilient to motion blur caused by locomotion.

Simulating cardiac signals on 3D human models for photoplethysmography development.

Introduction: Image-based heart rate estimation technology offers a contactless approach to healthcare monitoring that could improve the lives of millions of people. In order to comprehensively test or optimize image-based heart rate extraction methods, the dataset should contain a large number of factors such as body motion, lighting conditions, and physiological states. However, collecting high-quality datasets with complete parameters is a huge challenge. Methods: In this paper, we introduce a bionic human model based on a three-dimensional (3D) representation of the human body. By integrating synthetic cardiac signal and body involuntary motion into the 3D model, five well-known traditional and four deep learning iPPG (imaging photoplethysmography) extraction methods are used to test the rendered videos. Results: To compare with different situations in the real world, four common scenarios (stillness, expression/talking, light source changes, and physical activity) are created on each 3D human. The 3D human can be built with any appearance and different skin tones. A high degree of agreement is achieved between the signals extracted from videos with the synthetic human and videos with a real human-the performance advantages and disadvantages of the selected iPPG methods are consistent for both real and 3D humans. Discussion: This technology has the capability to generate synthetic humans within various scenarios, utilizing precisely controlled parameters and disturbances. Furthermore, it holds considerable potential for testing and optimizing image-based vital signs methods in challenging situations where real people with reliable ground truth measurements are difficult to obtain, such as in drone rescue.

A Review of Synthetic Image Data and Its Use in Computer Vision.

Development of computer vision algorithms using convolutional neural networks and deep learning has necessitated ever greater amounts of annotated and labelled data to produce high performance models. Large, public data sets have been instrumental in pushing forward computer vision by providing the data necessary for training. However, many computer vision applications cannot rely on general image data provided in the available public datasets to train models, instead requiring labelled image data that is not readily available in the public domain on a large scale. At the same time, acquiring such data from the real world can be difficult, costly to obtain, and manual labour intensive to label in large quantities. Because of this, synthetic image data has been pushed to the forefront as a potentially faster and cheaper alternative to collecting and annotating real data. This review provides general overview of types of synthetic image data, as categorised by synthesised output, common methods of synthesising different types of image data, existing applications and logical extensions, performance of synthetic image data in different applications and the associated difficulties in assessing data performance, and areas for further research.

A Comparison of Dense and Sparse Optical Flow Techniques for Low-Resolution Aerial Thermal Imagery.

It is necessary to establish the relative performance of established optical flow approaches in airborne scenarios with thermal cameras. This study investigated the performance of a dense optical flow algorithm on 14 bit radiometric images of the ground. While sparse techniques that rely on feature matching techniques perform very well with airborne thermal data in high-contrast thermal conditions, these techniques suffer in low-contrast scenes, where there are fewer detectable and distinct features in the image. On the other hand, some dense optical flow algorithms are highly amenable to parallel processing approaches compared to those that rely on tracking and feature detection. A Long-Wave Infrared (LWIR) micro-sensor and a PX4Flow optical sensor were mounted looking downwards on a drone. We compared the optical flow signals of a representative dense optical flow technique, the Image Interpolation Algorithm (I2A), to the Lucas-Kanade (LK) algorithm in OpenCV and the visible light optical flow results from the PX4Flow in both X and Y displacements. The I2A to LK was found to be generally comparable in performance and better in cold-soaked environments while suffering from the aperture problem in some scenes.

Sparse Optical Flow Implementation Using a Neural Network for Low-Resolution Thermal Aerial Imaging.

This study is inspired by the widely used algorithm for real-time optical flow, the sparse Lucas-Kanade, by applying a feature extractor to decrease the computational requirement of optical flow based neural networks from real-world thermal aerial imagery. Although deep-learning-based algorithms have achieved state-of-the-art accuracy and have outperformed most traditional techniques, most of them cannot be implemented on a small multi-rotor UAV due to size and weight constraints on the platform. This challenge comes from the high computational cost of these techniques, with implementations requiring an integrated graphics processing unit with a powerful on-board computer to run in real time, resulting in a larger payload and consequently shorter flight time. For navigation applications that only require a 2D optical flow vector, a dense flow field computed from a deep learning neural network contains redundant information. A feature extractor based on the Shi-Tomasi technique was used to extract only appropriate features from thermal images to compute optical flow. The state-of-the-art RAFT-s model was trained with a full image and with our proposed alternative input, showing a substantial increase in speed while maintain its accuracy in the presence of high thermal contrast where features could be detected.

A Review of Modern Thermal Imaging Sensor Technology and Applications for Autonomous Aerial Navigation.

Limited navigation capabilities of many current robots and UAVs restricts their applications in GPS denied areas. Large aircraft with complex navigation systems rely on a variety of sensors including radio frequency aids and high performance inertial systems rendering them somewhat resistant to GPS denial. The rapid development of computer vision has seen cameras incorporated into small drones. Vision-based systems, consisting of one or more cameras, could arguably satisfy both size and weight constraints faced by UAVs. A new generation of thermal sensors is available that are lighter, smaller and widely available. Thermal sensors are a solution to enable navigation in difficult environments, including in low-light, dust or smoke. The purpose of this paper is to present a comprehensive literature review of thermal sensors integrated into navigation systems. Furthermore, the physics and characteristics of thermal sensors will also be presented to provide insight into challenges when integrating thermal sensors in place of conventional visual spectrum sensors.