Contactless Blood Oxygen Saturation Estimation from Facial Videos Using Deep Learning.

Blood oxygen saturation (SpO2) is an essential physiological parameter for evaluating a person's health. While conventional SpO2 measurement devices like pulse oximeters require skin contact, advanced computer vision technology can enable remote SpO2 monitoring through a regular camera without skin contact. In this paper, we propose novel deep learning models to measure SpO2 remotely from facial videos and evaluate them using a public benchmark database, VIPL-HR. We utilize a spatial-temporal representation to encode SpO2 information recorded by conventional RGB cameras and directly pass it into selected convolutional neural networks to predict SpO2. The best deep learning model achieves 1.274% in mean absolute error and 1.71% in root mean squared error, which exceed the international standard of 4% for an approved pulse oximeter. Our results significantly outperform the conventional analytical Ratio of Ratios model for contactless SpO2 measurement. Results of sensitivity analyses of the influence of spatial-temporal representation color spaces, subject scenarios, acquisition devices, and SpO2 ranges on the model performance are reported with explainability analyses to provide more insights for this emerging research field.

Identification of the human cerebral cortical hemodynamic response to passive whole-body movements using near-infrared spectroscopy.

The human vestibular system is crucial for motion perception, balance control, and various higher cognitive functions. Exploring how the cerebral cortex responds to vestibular signals is not only valuable for a better understanding of how the vestibular system participates in cognitive and motor functions but also clinically significant in diagnosing central vestibular disorders. Near-infrared spectroscopy (NIRS) provides a portable and non-invasive brain imaging technology to monitor cortical hemodynamics under physical motion. Objective: This study aimed to investigate the cerebral cortical response to naturalistic vestibular stimulation induced by real physical motion and to validate the vestibular cerebral cortex previously identified using alternative vestibular stimulation. Approach: Functional NIRS data were collected from 12 right-handed subjects when they were sitting in a motion platform that generated three types of whole-body passive translational motion (circular, lateral, and fore-and-aft). Main results: The study found that different cortical regions were activated by the three types of motion. The cortical response was more widespread under circular motion in two dimensions compared to lateral and fore-and-aft motions in one dimensions. Overall, the identified regions were consistent with the cortical areas found to be activated in previous brain imaging studies. Significance: The results provide new evidence of brain selectivity to different types of motion and validate previous findings on the vestibular cerebral cortex.

Prediction of Higher Heating Values in Bio-Oil from Solvothermal Biomass Conversion and Bio-Oil Upgrading Given Discontinuous Experimental Conditions.

Both the conversion of lignocellulosic biomass to bio-oil (BO) and the upgrading of BO have been the targets of many studies. Due to the large diversity and discontinuity seen in terms of reaction conditions, catalysts, solvents, and feedstock properties that have been used, a comparison across different publications is difficult. In this study, machine learning modeling is used for the prediction of final higher heating value (HHV) and ΔHHV for the conversion of lignocellulosic feedstocks to BO, and BO upgrading. The models achieved coefficient of determination (R2) scores ranging from 0.77 to 0.86, and the SHapley Additive exPlanations (SHAP) values were used to obtain model explainability, revealing that only a few experimental parameters are largely responsible for the outcome of the experiments. In particular, process temperature and reaction time were overwhelmingly responsible for the majority of the predictions, for both final HHV and ΔHHV. Elemental composition of the starting feedstock or BO dictated the upper possible HHV value obtained after the experiment, which is in line with what is known from previous methodologies for calculating HHV for fuels. Solvent used, initial moisture concentration in BO, and catalyst active phase showed low predicting power, within the context of the data set used. The results of this study highlight experimental conditions and variables that could be candidates for the creation of minimum reporting guidelines for future studies in such a way that machine learning can be fully harnessed.

Vection induced by a pair of patches of synchronized visual motion stimuli covering total field of views as small as 10 square-degrees.

Vection (illusion of self-motion) is known to be induced by watching large field-of-view (FOV) moving scenes. In our study, we investigated vection induced by small FOV stimuli. Three experiments were conducted in 45 sessions to analyze vection provoked by moving scenes covering total FOVs as small as 10 square-degrees. Results indicated that 88% of the participants reported vection while watching two small patches of moving dots (1° horizontal by 5° vertical, each) placed on the left and right sides of the observers. This is less than a quarter of the total visual area of two Apple Watches viewed at a distance of 40 cm. Occlusion of the visual field between the two display patches significantly increased the levels of rated vection. Similarly, increasing the speed of the moving dots of the two display patches from about 5 to 25 °/sec increased the levels of rated vection significantly. The location of the two patches in the horizontal visual field did not affect the vection perception significantly. When the two straight stripes of dots were moving in opposite directions, participants perceived circular vection. The observers connected the two stimuli in their minds and perceived them as parts of a single occluded background. The findings of this study are relevant to the design of mobile devices (e.g., smartphones) and wearable technology (e.g., smart watches) with small display areas.

Robust Heart Rate Variability Measurement from Facial Videos.

Remote Photoplethysmography (rPPG) is a contactless method that enables the detection of various physiological signals from facial videos. rPPG utilizes a digital camera to detect subtle changes in skin color to measure vital signs such as heart rate variability (HRV), an important biomarker related to the autonomous nervous system. This paper presents a novel contactless HRV extraction algorithm, WaveHRV, based on the Wavelet Scattering Transform technique, followed by adaptive bandpass filtering and inter-beat-interval (IBI) analysis. Furthermore, a novel method is introduced to preprocess noisy contact-based PPG signals. WaveHRV is bench-marked against existing algorithms and public datasets. Our results show that WaveHRV is promising and achieves the lowest mean absolute error (MAE) of 10.5 ms and 6.15 ms for RMSSD and SDNN on the UBFCrPPG dataset.

Predicting Subjective Discomfort Associated With Lens Distortion in VR Headsets During Vestibulo-Ocular Response to VR Scenes.

With advances in Virtual Reality (VR) technology, user expectation for a near-perfect experience is also increasing. The push for a wider field-of-view can increase the challenges of correcting lens distortion. Past studies on imperfect VR experiences have focused on motion sickness provoked by vection-inducing VR stimuli and discomfort due to mismatches in accommodation and binocular convergence. Disorientation and discomfort due to unintended optical flow induced by lens distortion, referred to as dynamic distortion (DD), has, to date, received little attention. This study examines and models the effects of DD during head rotations with various fixed gazes stabilized by vestibulo-ocular reflex (VOR). Increases in DD levels comparable to lens parameters from poorly designed commercial VR lenses significantly increase discomfort scores of viewers in relation to disorientation, dizziness, and eye strain. Cross-validated results indicate that the model is able to predict significant differences in subjective scores resulting from different commercial VR lenses and these predictions correlated with empirical data. The present work provides new insights to understand symptoms of discomfort in VR during user interactions with static world-locked / space-stabilized scenes and contributes to the design of discomfort-free VR headset lenses.

Blood Pressure Measurement: From Cuff-Based to Contactless Monitoring.

Blood pressure (BP) determines whether a person has hypertension and offers implications as to whether he or she could be affected by cardiovascular disease. Cuff-based sphygmomanometers have traditionally provided both accuracy and reliability, but they require bulky equipment and relevant skills to obtain precise measurements. BP measurement from photoplethysmography (PPG) signals has become a promising alternative for convenient and unobtrusive BP monitoring. Moreover, the recent developments in remote photoplethysmography (rPPG) algorithms have enabled new innovations for contactless BP measurement. This paper illustrates the evolution of BP measurement techniques from the biophysical theory, through the development of contact-based BP measurement from PPG signals, and to the modern innovations of contactless BP measurement from rPPG signals. We consolidate knowledge from a diverse background of academic research to highlight the importance of multi-feature analysis for improving measurement accuracy. We conclude with the ongoing challenges, opportunities, and possible future directions in this emerging field of research.

Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda.

Heart rate (HR) is one of the essential vital signs used to indicate the physiological health of the human body. While traditional HR monitors usually require contact with skin, remote photoplethysmography (rPPG) enables contactless HR monitoring by capturing subtle light changes of skin through a video camera. Given the vast potential of this technology in the future of digital healthcare, remote monitoring of physiological signals has gained significant traction in the research community. In recent years, the success of deep learning (DL) methods for image and video analysis has inspired researchers to apply such techniques to various parts of the remote physiological signal extraction pipeline. In this paper, we discuss several recent advances of DL-based methods specifically for remote HR measurement, categorizing them based on model architecture and application. We further detail relevant real-world applications of remote physiological monitoring and summarize various common resources used to accelerate related research progress. Lastly, we analyze the implications of research findings and discuss research gaps to guide future explorations.

Active head rolls enhance sonar-based auditory localization performance.

Animals utilize a variety of active sensing mechanisms to perceive the world around them. Echolocating bats are an excellent model for the study of active auditory localization. The big brown bat (Eptesicus fuscus), for instance, employs active head roll movements during sonar prey tracking. The function of head rolls in sound source localization is not well understood. Here, we propose an echolocation model with multi-axis head rotation to investigate the effect of active head roll movements on sound localization performance. The model autonomously learns to align the bat's head direction towards the target. We show that a model with active head roll movements better localizes targets than a model without head rolls. Furthermore, we demonstrate that active head rolls also reduce the time required for localization in elevation. Finally, our model offers key insights to sound localization cues used by echolocating bats employing active head movements during echolocation.

Motion sickness-susceptible participants exposed to coherent rotating dot patterns show excessive N2 amplitudes and impaired theta-band phase synchronization.

Visually induced motion sickness (VIMS) can occur via prolonged exposure to visual stimulation that generates the illusion of self-motion (vection). Not everyone is susceptible to VIMS and the neural mechanism underlying susceptibility is unclear. This study explored the differences of electroencephalographic (EEG) signatures between VIMS-susceptible and VIMS-resistant groups. Thirty-two-channel EEG data were recorded from 12 VIMS-susceptible and 15 VIMS-resistant university students while they were watching two patterns of moving dots: (1) a coherent rotation pattern (vection-inducing and potentially VIMS-provoking pattern), and (2) a random movement pattern (non-VIMS-provoking control). The VIMS-susceptible group exhibited a significantly larger increase in the parietal N2 response when exposed to the coherent rotating pattern than when exposed to control patterns. In members of the VIMS-resistant group, before vection onset, global connectivity from all other EEG electrodes to the right-temporal-parietal and to the right-central areas increased, whereas after vection onset the global connectivity to the right-frontal area reduced. Such changes were not observed in the susceptible group. Further, the increases in N2 amplitude and the identified phase synchronization index were significantly correlated with individual motion sickness susceptibility. Results suggest that VIMS susceptibility is associated with systematic impairment of dynamic cortical coordination as captured by the phase synchronization of cortical activities. Analyses of dynamic EEG signatures could be a means to unlock the neural mechanism of VIMS.

Adversarial relationship between combined medial olivocochlear (MOC) and middle-ear-muscle (MEM) reflexes and alarm-in-noise detection thresholds under negative signal-to-noise ratios (SNRs).

The role of auditory efferent feedback from the medial olivocochlear system (MOCS) and the middle-ear-muscle (MEM) reflex in tonal detection tasks for humans in the presence of noise is not clearly understood. Past studies have yielded inconsistent results on the relationship between efferent feedback and tonal detection thresholds. This study attempts to address this inconsistency. Fifteen human subjects with normal hearing participated in an experiment where they were asked to identify an alarm signal in the presence of 80 dBA background (pink) noise. Masked detection thresholds were estimated using the method of two-interval forced choice (2IFC). Contralateral suppression of transient-evoked otoacoustic emissions (TEOAEs) was measured to estimate the strength of auditory efferent feedback. Subsequent correlation analysis revealed that the contralateral suppression of TEOAEs was significantly negatively correlated (r = -0.526, n = 15, p = 0.0438) with alarm-in-noise (AIN) detection thresholds under negative signal-to-noise conditions. The result implies that the stronger the auditory efferent feedback, the worse the detection thresholds and thus the poorer the tonal detection performance in the presence of loud noise.

Normative Performance on the Balance Error Scoring System by Youth, High School, and Collegiate Athletes.

CONTEXT: Annually, more than 1 million youth athletes in the United States receive or are suspected of receiving a concussion. The Balance Error Scoring System (BESS) is the most commonly used clinical balance evaluation designed to provide a better understanding of the motor-control processes of individuals with concussion. Despite the widespread use of the BESS, a fundamental gap exists in applying this tool to young athletes, as normative values are lacking for this population. OBJECTIVE: To determine age- and sex-specific normative values for the BESS in youth, high school, and collegiate athletes. DESIGN: Cross-sectional study. SETTING: Local youth sport organizations, high schools, and colleges. PATIENTS OR OTHER PARTICIPANTS: Student-athletes (N = 6762) completed preseason baseline concussion testing as part of a comprehensive concussion-management program. Groups were youth males aged 5 to 13 years (n = 360), high school males aged 14 to 18 years (n = 3743), collegiate males aged 19 to 23 years (n = 497), youth females aged 5 to 13 years (n = 246), high school females aged 14 to 18 years (n = 1673), and collegiate females aged 19 to 23 years (n = 243). MAIN OUTCOME MEASURE(S): Errors according to the BESS specifications. RESULTS: Performance on the BESS was worse ( P < .01) in youth athletes than in high school and collegiate athletes. In the youth and high school cohorts, females exhibited better scores than males ( P < .05). Sex was not a factor for collegiate athletes. Data from the youth cohort were further subdivided into 4-year bins to evaluate potential motor-development differences. The error count was highest for 5- to 9-year-old males and decreased with age. CONCLUSIONS: Performance on the BESS depended on sex and age, particularly in youth athletes. These sex- and age-specific normative values provide a reference to facilitate and unify clinical decision making across multiple providers caring for youth athletes with concussions.

Allocating less attention to central vision during vection is correlated with less motion sickness.

Visually induced motion sickness (VIMS) is a common discomfort response associated with vection-provoking stimuli. It has been suggested that susceptibility to VIMS depends on the ability to regulate visual performance during vection. To test this, 29 participants, with VIMS susceptibility assessed by Motion Sickness Susceptibility Questionnaire, were recruited to undergo three series of sustained attention to response tests (SARTs) while watching dot pattern stimuli known to provoke roll-vection. In general, SARTs performance was impaired in the central visual field (CVF), but improved in peripheral visual field (PVF), suggesting the reallocation of attention during vection. Moreover, VIMS susceptibility was negatively correlated with the effect sizes, suggesting that participants who were less susceptible to VIMS showed better performance in attention re-allocation. Finally, when trained to re-allocation attention from the CVF to the PVF, participants experienced more stable vection. Findings provide a better understanding of VIMS and shed light on possible preventive measures. Practitioner Summary: Allocating less visual attention to central visual field during visual motion stimulation is associated with stronger vection and higher resistance to motion sickness. Virtual reality application designers may utilise the location of visual tasks to strengthen and stabilise vection, while reducing the potential of visually induced motion sickness.

Prevalent osteoporotic vertebral fractures more likely involve the upper endplate than the lower endplate and even more so in males.

BACKGROUND: While the importance of identifying osteoporotic vertebral endplate fracture (EPF) is being recognized; the pathophysiological understanding of EPF till now remain insufficient. In this population-based cross-sectional radiograph study, we aim to investigate the anatomic location characteristics of osteoporotic EPF. METHODS: This study analyzed the anatomical location of osteoporotic EPFs in elderly Chinese population (age ≥65 years). The T4-L4 radiographs of 1,954 elderly Chinese men (mean: 72.3 years) and 1,953 elderly Chinese women (mean: 72.5 years) were evaluated to identify EPF, and vertebral bodies were graded according to Genant's vertebral deformity criteria. RESULTS: Of the 101,582 endplates analyzed, there were 505 EPFs (males: 27.7%; females: 72.3%). Excluding those with both upper endplate and lower endplate involvements, the ratio of upper EPF to lower EPF was 9.63 for males and 4.3 for females (P<0.05). Thoracolumbar junction, particularly L1 (26.4% for males and 24.1% for females) and followed by T12 (20.7% for males and 19.7% for females), had highest prevalence of EPF. With an endplate divided into 5 segments of equal length in the anteroposterior direction and grade 0.5 & 1, grade 2 vertebral deformities analyzed, fractures occurred mostly at the middle segment (70.1% for upper endplates in males and 78.6% for upper endplates in females), followed by second anterior segment (20.9% for upper endplates in males and 14.4% for upper endplates in females). The most anterior and most posterior segments were not primarily involved in EPF. CONCLUSIONS: Osteoporotic EPFs more likely involve the upper endplate rather than lower endplate, with a trend for this effect to be greater in men than in women. These characteristics may help radiographic differential diagnosis for osteoporotic EPF.

Correlations between individual susceptibility to visually induced motion sickness and decaying time constant of after-nystagmus.

This study examines the correlations between optokinetic after-nystagmus (OKAN) parameters and individual susceptibility to visually induced motion sickness (VIMS). Twenty-seven participants were exposed to vertical black-and-white stripes drifting along the yaw axis at 60° per second for 30 min to collect individual VIMS data (Phase 1). Two weeks after the exposure, OKANs were measured (Phase 2). 19 out of 27 participants (i.e., 70%) exhibited consistent OKAN patterns. Significant correlations between the time constants of OKAN and levels of VIMS experienced by the same viewers were found. Four months later, these 27 participants were invited back for a second OKAN measurement (Phase 3). Twenty-one participants came back. Their two OKAN measurements were significantly correlated (r = 0.69, p = 0.001). Rated levels of VIMS in phase 1 significantly correlated with the time constant of OKAN in both Phase 2 (r = 0.51, p = 0.044) and Phase 3 (r = 0.74, p = 0.006). The implications of the correlation results are discussed.

Visually induced motion sickness when viewing visual oscillations of different frequencies along the fore-and-aft axis: keeping velocity versus amplitude constant.

Exposure to visual oscillations (VOs) can lead to visually induced motion sickness (VIMS). The level of VIMS among viewers has been shown to vary when the frequency of the VOs is changed either by manipulating their amplitude or velocity. The present study investigates whether the level of VIMS would change if we keep the root mean square (rms) velocity or amplitude of VOs constant while manipulating the VO frequency. A total of 25 individuals were exposed to random-dot and checkerboard VOs along the fore-and-aft axis in two experiments. Changing the amplitude (or frequency) of VOs while keeping the rms velocity constant did not affect the level of VIMS; however, increasing the rms velocity (or frequency) of VOs while keeping the amplitude constant made VIMS significantly worse. Practitioner Summary: Exposure to VOs of the same frequency can cause different levels of nausea depending on the combination of oscillation amplitude and velocity. Results suggest an opportunity for game designers to reduce symptoms of game sickness by using the correct combinations of velocity and amplitude of the visual motions.

Motion sickness, nausea and thermoregulation: The "toxic" hypothesis.

Principal symptoms of motion sickness in humans include facial pallor, nausea and vomiting, and sweating. It is less known that motion sickness also affects thermoregulation, and the purpose of this review is to present and discuss existing data related to this subject. Hypothermia during seasickness was firstly noted nearly 150 years ago, but detailed studies of this phenomenon were conducted only during the last 2 decades. Motion sickness-induced hypothermia is philogenetically quite broadly expressed as besides humans, it has been reported in rats, musk shrews and mice. Evidence from human and animal experiments indicates that the physiological mechanisms responsible for the motion sickness-induced hypothermia include cutaneous vasodilation and sweating (leading to an increase of heat loss) and reduced thermogenesis. Together, these results suggest that motion sickness triggers highly coordinated physiological response aiming to reduce body temperature. Finally, we describe potential adaptive role of this response, and describe the benefits of using it as an objective measure of motion sickness-induced nausea.

Effects of spectral manipulation on nonindividualized head-related transfer functions (HRTFs).

BACKGROUND: Directional sounds simulated using nonindividualized head-related transfer functions (HRTFs) often result in front-back confusion. OBJECTIVE: This study was designed to examine how manipulating these nonindividualized HRTF spectra can reduce front-back confusion in headphone-simulated directional sounds. METHOD: HRTFs of six ear-level directions were studied (angles of 0 degrees, 45 degrees, 135 degrees, 180 degrees, 225 degrees, and 315 degrees). The HRTF gains in each of six frequency bands (200 to 690 Hz, 690 to 2400 Hz, 2400 to 6500 Hz, 6500 to 10000 Hz, 10000 to 14000 Hz, and 14000 to 22000 Hz) were amplified or attenuated by 0, 12, or 18 dB. Each manipulated HRTF generated a directional sound stimulus. For this study, 32 participants were invited to localize the randomly ordered stimuli. RESULTS: The results indicate that a 12- or 18-dB manipulation of five of the six frequency bands produced significantly better directional accuracy, with significantly less front-back confusion. A reduction of up to 70% in localization error was obtained, along with 66% less front-back confusion. Significant interactions were found between the manipulation level and frequency. CONCLUSION: A 12-dB spectral manipulation of selected HRTF frequency bands produces better directional accuracy. APPLICATION: The results of this research could be applied to the development of tunable nonindividualized HRTFs for audio products.