The role of vision in sensory integration models for predicting motion perception and sickness.

Users of automated vehicles will engage in other activities and take their eyes off the road, making them prone to motion sickness. To resolve this, the current paper validates models predicting sickness in response to motion and visual conditions. We validate published models of vestibular and visual sensory integration that have been used for predicting motion sickness through sensory conflict. We use naturalistic driving data and laboratory motion (and vection) paradigms, such as sinusoidal translation and rotation at different frequencies, Earth-Vertical Axis Rotation, Off-Vertical Axis Rotation, Centrifugation, Somatogravic Illusion, and Pseudo-Coriolis, to evaluate different models for both motion perception and motion sickness. We investigate the effects of visual motion perception in terms of rotational velocity (visual flow) and verticality. According to our findings, the SVCI model, a 6DOF model based on the Subjective Vertical Conflict (SVC) theory, with visual rotational velocity input is effective at estimating motion sickness. However, it does not correctly replicate motion perception in paradigms such as roll-tilt perception during centrifuge, pitch perception during somatogravic illusion, and pitch perception during pseudo-Coriolis motions. On the other hand, the Multi-Sensory Observer Model (MSOM) accurately models motion perception in all considered paradigms, but does not effectively capture the frequency sensitivity of motion sickness, and the effects of vision on sickness. For both models (SVCI and MSOM), the visual perception of rotational velocity strongly affects sickness and perception. Visual verticality perception does not (yet) contribute to sickness prediction, and contributes to perception prediction only for the somatogravic illusion. In conclusion, the SVCI model with visual rotation velocity feedback is the current preferred option to design vehicle control algorithms for motion sickness reduction, while the MSOM best predicts perception. A unified model that jointly captures perception and motion sickness remains to be developed.

Validating models of sensory conflict and perception for motion sickness prediction.

The human motion perception system has long been linked to motion sickness through state estimation conflict terms. However, to date, the extent to which available perception models are able to predict motion sickness, or which of the employed perceptual mechanisms are of most relevance to sickness prediction, has not been studied. In this study, the subjective vertical model, the multi-sensory observer model and the probabilistic particle filter model were all validated for their ability to predict motion perception and sickness, across a large set of motion paradigms of varying complexity from literature. It was found that even though the models provided a good match for the perception paradigms studied, they could not be made to capture the full range of motion sickness observations. The resolution of the gravito-inertial ambiguity has been identified to require further attention, as key model parameters selected to match perception data did not optimally match motion sickness data. Two additional mechanisms that may enable better future predictive models of sickness have, however, been identified. Firstly, active estimation of the magnitude of gravity appears to be instrumental for predicting motion sickness induced by vertical accelerations. Secondly, the model analysis showed that the influence of the semicircular canals on the somatogravic effect may explain the differences in the dynamics observed for motion sickness induced by vertical and horizontal plane accelerations.

Relating individual motion sickness levels to subjective discomfort ratings.

High levels of vehicle automation are expected to increase the risk of motion sickness, which is a major detriment to driving comfort. The exact relation between motion sickness and discomfort is a matter of debate, with recent studies suggesting a relief of discomfort at the onset of nausea. In this study, we investigate whether discomfort increases monotonously with motion sickness and how the relation can best be characterized in a semantic experiment (Experiment 1) and a motion sickness experiment (Experiment 2). In Experiment 1, 15 participants performed pairwise comparisons on the subjective discomfort associated with each item on the popular MIsery SCale (MISC) of motion sickness. In Experiment 2, 17 participants rated motion sickness using the MISC during exposures to four sustained motion stimuli, and provided (1) numerical magnitude estimates of the discomfort experienced for each level of the MISC, and (2) verbal magnitude estimates with seven qualifiers, ranging between feeling 'excellent' and 'terrible'. The data of Experiment 1 show that the items of the MISC are ranked in order of appearance, with the exception of 5 ('severe dizziness, warmth, headache, stomach awareness, and sweating') and 6 ('slight nausea'), which are ranked in opposite order. However, in Experiment 2, we find that discomfort associated with each level of the MISC, as it was used to express motion sickness during exposure to a sickening stimulus, increases monotonously; following a power law with an exponent of 1.206. While the results of Experiment 1 replicate the non-linearity found in recent studies, the results of Experiment 2 suggest that the non-linearity is due to the semantic nature of Experiment 1, and that there is a positive monotonous relation between MISC and discomfort in practice. These results support the suitability of MISC to assess motion sickness.

A meta-analysis of simulator sickness as a function of simulator fidelity.

Driving simulators are an increasingly important tool to develop vehicle functionalities and to study driver or passenger responses. A major hindrance to the use and validity of such studies is Simulator Sickness (SS). Several studies have suggested a positive relation between improvements in simulator fidelity and the likelihood of sickness. We hypothesized that this relation only holds true for static (fixed-base) simulators, and that increased fidelity in fact reduces simulator sickness in dynamic (moving-base) simulators. We performed a meta-analysis investigating the relation between sickness and fidelity in static and dynamic systems. A literature search yielded a total of 41 simulator studies that varied aspects of mechanical and/or visual fidelity and assessed SS for the same driving conditions and the same or equivalent participant groups. Evaluation of a model synthesizing the findings of these studies indicates that SS decreases with visual fidelity, and suggests that this effect may be negated for static simulators. The results of the modeling efforts thereby provide some support for the hypothesis that increased fidelity can reduce SS in dynamic simulators. Based on the evaluation of the literature we also note particular shortcomings and gaps in available research. Finally, we make recommendations for specific experiments that may fill these gaps and allow definitive conclusions on the role of simulator fidelity in SS.

Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception.

OBJECTIVE: To investigate how well gaze behavior can indicate driver awareness of individual road users when related to the vehicle's road scene perception. BACKGROUND: An appropriate method is required to identify how driver gaze reveals awareness of other road users. METHOD: We developed a recognition-based method for labeling of driver situation awareness (SA) in a vehicle with road-scene perception and eye tracking. Thirteen drivers performed 91 left turns on complex urban intersections and identified images of encountered road users among distractor images. RESULTS: Drivers fixated within 2° for 72.8% of relevant and 27.8% of irrelevant road users and were able to recognize 36.1% of the relevant and 19.4% of irrelevant road users one min after leaving the intersection. Gaze behavior could predict road user relevance but not the outcome of the recognition task. Unexpectedly, 18% of road users observed beyond 10° were recognized. CONCLUSIONS: Despite suboptimal psychometric properties leading to low recognition rates, our recognition task could identify awareness of individual road users during left turn maneuvers. Perception occurred at gaze angles well beyond 2°, which means that fixation locations are insufficient for awareness monitoring. APPLICATION: Findings can be used in driver attention and awareness modelling, and design of gaze-based driver support systems.

Objective and subjective responses to motion sickness: the group and the individual.

We investigated and modeled the temporal evolution of motion sickness in a highly dynamic sickening drive. Slalom maneuvers were performed in a passenger vehicle, resulting in lateral accelerations of 0.4 g at 0.2 Hz, to which participants were subjected as passengers for up to 30 min. Subjective motion sickness was recorded throughout the sickening drive using the MISC scale. In addition, physiological and postural responses were evaluated by recording head roll, galvanic skin response (GSR) and electrocardiography (ECG). Experiment 1 compared external vision (normal view through front and side car windows) to internal vision (obscured view through front and side windows). Experiment 2 tested hypersensitivity with a second exposure a few minutes after the first drive and tested repeatability of individuals' sickness responses by measuring these two exposures three times in three successive sessions. An adapted form of Oman's model of nausea was used to quantify sickness development, repeatability, and motion sickness hypersensitivity at an individual level. Internal vision was more sickening compared to external vision with a higher mean MISC (4.2 vs. 2.3), a higher MISC rate (0.59 vs. 0.10 min-1) and more dropouts (66% vs. 33%) for whom the experiment was terminated due to reaching a MISC level of 7 (moderate nausea). The adapted Oman model successfully captured the development of sickness, with a mean model error, including the decay during rest and hypersensitivity upon further exposure, of 11.3%. Importantly, we note that knowledge of an individuals' previous motion sickness response to sickening stimuli increases individual modeling accuracy by a factor of 2 when compared to group-based modeling, indicating individual repeatability. Head roll did not vary significantly with motion sickness. ECG varied slightly with motion sickness and time. GSR clearly varied with motion sickness, where the tonic and phasic GSR increased 42.5% and 90%, respectively, above baseline at high MISC levels, but GSR also increased in time independent of motion sickness, accompanied with substantial scatter.

Individual motion perception parameters and motion sickness frequency sensitivity in fore-aft motion.

Previous literature suggests a relationship between individual characteristics of motion perception and the peak frequency of motion sickness sensitivity. Here, we used well-established paradigms to relate motion perception and motion sickness on an individual level. We recruited 23 participants to complete a two-part experiment. In the first part, we determined individual velocity storage time constants from perceived rotation in response to Earth Vertical Axis Rotation (EVAR) and subjective vertical time constants from perceived tilt in response to centrifugation. The cross-over frequency for resolution of the gravito-inertial ambiguity was derived from our data using the Multi Sensory Observer Model (MSOM). In the second part of the experiment, we determined individual motion sickness frequency responses. Participants were exposed to 30-minute sinusoidal fore-aft motions at frequencies of 0.15, 0.2, 0.3, 0.4 and 0.5 Hz, with a peak amplitude of 2 m/s2 in five separate sessions, approximately 1 week apart. Sickness responses were recorded using both the MIsery SCale (MISC) with 30 s intervals, and the Motion Sickness Assessment Questionnaire (MSAQ) at the end of the motion exposure. The average velocity storage and subjective vertical time constants were 17.2 s (STD = 6.8 s) and 9.2 s (STD = 7.17 s). The average cross-over frequency was 0.21 Hz (STD = 0.10 Hz). At the group level, there was no significant effect of frequency on motion sickness. However, considerable individual variability was observed in frequency sensitivities, with some participants being particularly sensitive to the lowest frequencies, whereas others were most sensitive to intermediate or higher frequencies. The frequency of peak sensitivity did not correlate with the velocity storage time constant (r = 0.32, p = 0.26) or the subjective vertical time constant (r = - 0.37, p = 0.29). Our prediction of a significant correlation between cross-over frequency and frequency sensitivity was not confirmed (r = 0.26, p = 0.44). However, we did observe a strong positive correlation between the subjective vertical time constant and general motion sickness sensitivity (r = 0.74, p = 0.0006). We conclude that frequency sensitivity is best considered a property unique to the individual. This has important consequences for existing models of motion sickness, which were fitted to group averaged sensitivities. The correlation between the subjective vertical time constant and motion sickness sensitivity supports the importance of verticality perception during exposure to translational sickness stimuli.

Redesigning Today's Driving Automation Toward Adaptive Backup Control With Context-Based and Invisible Interfaces.

OBJECTIVE: We investigated a driver monitoring system (DMS) designed to adaptively back up distracted drivers with automated driving. BACKGROUND: Humans are likely inadequate for supervising today's on-road driving automation. Conversely, backup concepts can use eye-tracker DMS to retain the human as the primary driver and use computerized control only if needed. A distraction DMS where perceived false alarms are minimized and the status of the backup is unannounced might reduce problems of distrust and overreliance, respectively. Experimental research is needed to assess the viability of such designs. METHODS: In a driving simulator, 91 participants either supervised driving automation (auto-hand-on-wheel vs. auto-hands-off-wheel), drove with different forms of DMS-induced backup control (eyes-only-backup vs. eyes-plus-context-backup; visible-backup vs. invisible-backup), or drove without any automation. All participants performed a visual N-back task throughout. RESULTS: Supervised driving automation increased visual distraction and hazard non-responses compared to backup and conventional driving. Auto-hand-on-wheel improved response generation compared to auto-hands-off-wheel. Across entire driving trials, the backup improved lateral performance compared to conventional driving. Without negatively impacting safety, the eyes-plus-context-backup DMS reduced unnecessary automated control compared to the eyes-only-backup DMS conditions. Eyes-only-backup produced low satisfaction ratings, whereas eyes-plus-context-backup satisfaction was on par with automated driving. There were no appreciable negative consequences attributable to the invisible-backup driving automation. CONCLUSIONS: We have demonstrated preliminary feasibility of DMS designs that incorporate driving context information for distraction assessment and suppress their status indication. APPLICATION: An appropriately designed DMS can enable benefits for automated driving as a backup.

External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions.

OBJECTIVE: In this article, we investigated the effects of external human-machine interfaces (eHMIs) on pedestrians' crossing intentions. BACKGROUND: Literature suggests that the safety (i.e., not crossing when unsafe) and efficiency (i.e., crossing when safe) of pedestrians' interactions with automated vehicles could increase if automated vehicles display their intention via an eHMI. METHODS: Twenty-eight participants experienced an urban road environment from a pedestrian's perspective using a head-mounted display. The behavior of approaching vehicles (yielding, nonyielding), vehicle size (small, medium, large), eHMI type (1. baseline without eHMI, 2. front brake lights, 3. Knightrider animation, 4. smiley, 5. text [WALK]), and eHMI timing (early, intermediate, late) were varied. For yielding vehicles, the eHMI changed from a nonyielding to a yielding state, and for nonyielding vehicles, the eHMI remained in its nonyielding state. Participants continuously indicated whether they felt safe to cross using a handheld button, and "feel-safe" percentages were calculated. RESULTS: For yielding vehicles, the feel-safe percentages were higher for the front brake lights, Knightrider, smiley, and text, as compared with baseline. For nonyielding vehicles, the feel-safe percentages were equivalent regardless of the presence or type of eHMI, but larger vehicles yielded lower feel-safe percentages. The Text eHMI appeared to require no learning, contrary to the three other eHMIs. CONCLUSION: An eHMI increases the efficiency of pedestrian-AV interactions, and a textual display is regarded as the least ambiguous. APPLICATION: This research supports the development of automated vehicles that communicate with other road users.

Trunk stabilization during sagittal pelvic tilt: from trunk-on-pelvis to trunk-in-space due to vestibular and visual feedback.

The goal of this study was to investigate the human ability to stabilize the trunk in space during pelvic tilt. Upper body sway was evoked in kneeling-seated healthy subjects by angular platform perturbations with a rotation around a virtual low-back pivot point between the L4 and L5 vertebrae. To investigate motor control modulation, variations in task instruction (balance naturally or minimize trunk sway), vision (eyes open or closed), and perturbation bandwidth (from 0.2 up to 1, 3, or 10 Hz) were applied. Cocontraction and proprioceptive muscle spindle feedback were associated with minimizing low-back flexion/extension (trunk-on-pelvis stabilization), while vestibular and visual feedback were supposed to contribute to trunk-in-space stabilization. Trunk-in-space stabilization was only observed with the minimize trunk sway task instruction, while the task instruction to balance naturally led to trunk-on-pelvis stabilization with trunk rotations even exceeding the perturbations. This indicates that vestibular feedback is used when minimizing trunk sway but has only a minor contribution during natural trunk stabilization in the sagittal plane. The eyes open condition resulted in reduced global trunk rotations and increased global trunk reflexive responses, demonstrating effective visual contributions to trunk-in-space stabilization. On the other hand, increasing perturbation bandwidth caused a decreased feedback contribution leading to deteriorated trunk-in-space stabilization.

Nonlinear 2D arm dynamics in response to continuous and pulse-shaped force perturbations.

Ample evidence exists regarding the nonlinearity of the neuromuscular system but linear models are widely applied to capture postural dynamics. This study quantifies the nonlinearity of human arm postural dynamics applying 2D continuous force perturbations (0.2-40 Hz) inducing three levels of hand displacement (5, 15, 45 mm RMS) followed by force-pulse perturbations inducing large hand displacements (up to 250 mm) in a position task (PT) and a relax task (RT) recording activity of eight shoulder and elbow muscles. The continuous perturbation data were used to analyze the 2D endpoint dynamics in the frequency domain and to identify reflexive and intrinsic parameters of a linear neuromuscular shoulder-elbow model. Subsequently, it was assessed to what extent the large displacements in response to force pulses could be predicted from the 'small amplitude' linear neuromuscular model. Continuous and pulse perturbation responses with varying amplitudes disclosed highly nonlinear effects. In PT, a larger continuous perturbation induced stiffening with a factor of 1.5 attributed to task adaptation evidenced by increased co-contraction and reflexive activity. This task adaptation was even more profound in the pulse responses where reflexes and displacements were strongly affected by the presence and amplitude of preceding continuous perturbations. In RT, a larger continuous perturbation resulted in yielding with a factor of 3.8 attributed to nonlinear mechanical properties as no significant reflexive activity was found. Pulse perturbations always resulted in yielding where a model fitted to the preceding 5-mm continuous perturbations predicted only 37% of the recorded peak displacements in RT and 79% in PT. This demonstrates that linear neuromuscular models, identified using continuous perturbations with small amplitudes, strongly underestimate displacements in pulse-shaped (e.g., impact) loading conditions. The data will be used to validate neuromuscular models including nonlinear muscular (e.g., Hill and Huxley) and reflexive components.

Effects of visual fidelity on curve negotiation, gaze behaviour and simulator discomfort.

Technological developments have led to increased visual fidelity of driving simulators. However, simplified visuals have potential advantages, such as improved experimental control, reduced simulator discomfort and increased generalisability of results. In this driving simulator study, we evaluated the effects of visual fidelity on driving performance, gaze behaviour and subjective discomfort ratings. Twenty-four participants drove a track with 90° corners in (1) a high fidelity, textured environment, (2) a medium fidelity, non-textured environment without scenery objects and (3) a low-fidelity monochrome environment that only showed lane markers. The high fidelity level resulted in higher steering activity on straight road segments, higher driving speeds and higher gaze variance than the lower fidelity levels. No differences were found between the two lower fidelity levels. In conclusion, textures and objects were found to affect steering activity and driving performance; however, gaze behaviour during curve negotiation and self-reported simulator discomfort were unaffected. PRACTITIONER SUMMARY: In a driving simulator study, three levels of visual fidelity were evaluated. The results indicate that the highest fidelity level, characterised by a textured environment, resulted in higher steering activity, higher driving speeds and higher variance of horizontal gaze than the two lower fidelity levels without textures.

Vestibulocollic reflexes in the absence of head postural control.

Percutaneous electrical vestibular stimulation evokes reflexive responses in appendicular muscles that are suppressed during tasks in which the muscles are not contributing to balance control. In neck muscles, which stabilize the head on the torso and in space, it is unclear whether similar postural task dependence shapes vestibular reflexes. We investigated whether vestibulocollic reflexes are modulated during tasks in which vestibular information is not directly relevant to maintaining the head balanced on the torso. We hypothesized that vestibulocollic reflexes would be 1) evoked when neck muscles are not involved in balancing the head on the torso and 2) invariant across synergistic neck muscle contraction tasks. Muscle activity was recorded bilaterally in sternocleidomastoid and splenius capitis muscles during head-free and head-fixed conditions while subjects were exposed to stochastic electrical vestibular stimulation (± 5 mA, 0-75 Hz). Significant vestibular reflex responses (P < 0.05) were observed during head-free and head-fixed trials. Response magnitude and timing were similar between head-free and head-fixed trials for sternocleidomastoid, but splenius capitis magnitudes decreased with the head fixed by ∼ 25% (P < 0.05). Nevertheless, this indicates that vestibulocollic responses are evoked independent of the requirement to maintain postural control of the head on the torso. Response magnitude and timing were similar across focal muscle contractions (i.e., axial rotation/flexion/extension) provided the muscle was active. In contrast, when subjects cocontracted neck muscles, vestibular-evoked responses decreased in sternocleidomastoid by ∼ 30-45% (P < 0.05) compared with focal muscle contractions but remained unchanged in splenius capitis. These results indicate robust vestibulocollic reflex coupling, which we suggest functions through its closed-loop influence on head posture to ensure cervical spine stabilization.

Frequency response of vestibular reflexes in neck, back, and lower limb muscles.

Vestibular pathways form short-latency disynaptic connections with neck motoneurons, whereas they form longer-latency disynaptic and polysynaptic connections with lower limb motoneurons. We quantified frequency responses of vestibular reflexes in neck, back, and lower limb muscles to explain between-muscle differences. Two hypotheses were evaluated: 1) that muscle-specific motor-unit properties influence the bandwidth of vestibular reflexes; and 2) that frequency responses of vestibular reflexes differ between neck, back, and lower limb muscles because of neural filtering. Subjects were exposed to electrical vestibular stimuli over bandwidths of 0-25 and 0-75 Hz while recording activity in sternocleidomastoid, splenius capitis, erector spinae, soleus, and medial gastrocnemius muscles. Coherence between stimulus and muscle activity revealed markedly larger vestibular reflex bandwidths in neck muscles (0-70 Hz) than back (0-15 Hz) or lower limb muscles (0-20 Hz). In addition, vestibular reflexes in back and lower limb muscles undergo low-pass filtering compared with neck-muscle responses, which span a broader dynamic range. These results suggest that the wider bandwidth of head-neck biomechanics requires a vestibular influence on neck-muscle activation across a larger dynamic range than lower limb muscles. A computational model of vestibular afferents and a motoneuron pool indicates that motor-unit properties are not primary contributors to the bandwidth filtering of vestibular reflexes in different muscles. Instead, our experimental findings suggest that pathway-dependent neural filtering, not captured in our model, contributes to these muscle-specific responses. Furthermore, gain-phase discontinuities in the neck-muscle vestibular reflexes provide evidence of destructive interaction between different reflex components, likely via indirect vestibular-motor pathways.

Dependency of human neck reflex responses on the bandwidth of pseudorandom anterior-posterior torso perturbations.

The vestibulocollic (VCR) and cervicocollic (CCR) reflexes are essential to stabilize the head-neck system and to deal with unexpected disturbances. This study investigates how neck reflexes contribute to stabilization and modulate with perturbation properties. We hypothesized that VCR and CCR modulate with the bandwidth of the perturbation and that this modulation is maintained across amplitudes and influenced by the eyes being open or closed. Seated subjects were perturbed in an anterior-posterior direction. The perturbations varied in bandwidth from 0.3 Hz to a maximum of 1.2, 2.0, 4.0, and 8.0 Hz, at three amplitudes, and with eyes open and closed. Frequency response functions of head kinematics and neck muscle EMG demonstrated substantial changes with bandwidth and vision and minor changes with amplitude, which through closed-loop identification were attributed to neural (reflexive) modulation. Results suggest that both reflexes were attenuated when perturbations exceeded the system's natural frequency, thereby shifting from a head-in-space to a head-on-trunk stabilization tendency. Additionally, results indicate that reflexive and mechanical stiffness marginally exceed the negative stiffness due to gravity; a stabilization strategy which minimizes effort. With eyes closed, reflexes were attenuated further, presumably due to a reduced ability to discriminate self-motion, driving the system to a head-on-trunk stabilization strategy at the highest bandwidth. We conclude that VCR and CCR modulate with perturbation bandwidth and visual feedback conditions to maintain head-upright posture, but are invariant across amplitude changes.

Neck stabilization through sensory integration of vestibular and visual motion cues.

Background: To counteract gravity, trunk motion, and other perturbations, the human head-neck system requires continuous muscular stabilization. In this study, we combine a musculoskeletal neck model with models of sensory integration (SI) to unravel the role of vestibular, visual, and muscle sensory cues in head-neck stabilization and relate SI conflicts and postural instability to motion sickness. Method: A 3D multisegment neck model with 258 Hill-type muscle elements was extended with postural stabilization using SI of vestibular (semicircular and otolith) and visual (rotation rate, verticality, and yaw) cues using the multisensory observer model (MSOM) and the subjective vertical conflict model (SVC). Dynamic head-neck stabilization was studied using empirical datasets, including 6D trunk perturbations and a 4 m/s2 slalom drive inducing motion sickness. Results: Recorded head translation and rotation are well matched when using all feedback loops with MSOM or SVC or assuming perfect perception. A basic version of the model, including muscle, but omitting vestibular and visual perception, shows that muscular feedback can stabilize the neck in all conditions. However, this model predicts excessive head rotations in conditions with trunk rotation and in the slalom. Adding feedback of head rotational velocity sensed by the semicircular canals effectively reduces head rotations at mid-frequencies. Realistic head rotations at low frequencies are obtained by adding vestibular and visual feedback of head rotation based on the MSOM or SVC model or assuming perfect perception. The MSOM with full vision well captures all conditions, whereas the MSOM excluding vision well captures all conditions without vision. The SVC provides two estimates of verticality, with a vestibular estimate SVCvest, which is highly effective in controlling head verticality, and an integrated vestibular/visual estimate SVCint which can complement SVCvest in conditions with vision. As expected, in the sickening drive, SI models imprecisely estimate verticality, resulting in sensory conflict and postural instability. Conclusion: The results support the validity of SI models in postural stabilization, where both MSOM and SVC provide credible results. The results in the sickening drive show imprecise sensory integration to enlarge head motion. This uniquely links the sensory conflict theory and the postural instability theory in motion sickness causation.

Standards for passenger comfort in automated vehicles: Acceleration and jerk.

A prime concern for automated vehicles is motion comfort, as an uncomfortable ride may reduce acceptance of the technology amongst the general population. However, it is not clear how transient motions typical for travelling by car affect the experience of comfort. Here, we determine the relation between properties of vehicle motions (i.e., acceleration and jerk) and discomfort empirically, and we evaluate the ability of normative models to account for the data. 23 participants were placed in a moving-base driving simulator and presented sinusoidial and triangular motion pulses with various peak accelerations (Amax0.4 - 2 ms-2) and jerks (Jmax0.5 - 15 ms-3), designed to recreate typical vehicle accelerations. Participants provided discomfort judgments on absolute 'Verbal Qualifiers' and relative 'Magnitude Estimates' associated with these motions. The data show that discomfort increases with acceleration amplitude, and that the strength of this effect depends on the direction of motion. We furthermore find that higher jerks (shorter duration pulses) are considered more comfortable, and that triangular pulses are more comfortable than sinusoidal pulses. ME responses decrease (i.e., reduced discomfort) with increasing pulse duration. Evaluations of normative models of vibration and shock (ISO 2631), and perceived motion intensity provide mixed results. The vibration model could not account for the data well. Reasonable agreement between predictions and observations were found for the shock model and perceived intensity model, which emphasize the role of acceleration. We present novel statistical models that describe motion comfort as a function of acceleration, jerk, and direction. The present findings are essential to develop motion planning algorithms aimed at maximizing comfort.

Validation of a moving base driving simulator for motion sickness research.

Increasing levels of vehicle automation are envisioned to allow drivers to engage in other activities but are also likely to increase the incidence of Carsickness or Motion Sickness (MS). Ideally, MS is studied in a safe and controlled environment, such as a driving simulator. However, only few studies address the suitability of driving simulators to assess MS. In this study, we validate a moving base driving simulator for MS research by comparing the symptoms and time course of MS between a real-road driving scenario and a rendition of this scenario in a driving simulator, using a within-subjects design. 25 participants took part as passengers in an experiment with alternating sections (slaloming, stop-and-go) with normal and provocative driving styles. Participants performed Sudoku puzzles (eyes-off-road) during both scenarios and reported MIsery SCale (MISC) scores at 30 s intervals. Motion Sickness Assessment Questionnaire (MSAQ) scores were collected upon completion of either scenario. Overall, the results indicate that MS was more severe in the car than in the simulator. Nevertheless, significant correlations were found between individual MS in the car and simulator for 3 out of 4 MSAQ symptom categories (0.48 < r < 0.73, p < 0.02), with a strong overall correlation (r = 0.57, p = 0.004). MS onset times were similar between the car and the simulator, and sickness fluctuations as a result of driving style showed a similar pattern between scenarios, albeit more pronounced in the car. Based on observed similarities in MS, we conclude these simulator results to have relative validity. We attribute the observed reduction of MS severity in the simulator to the downscaling of the motion by the Motion Cueing Algorithm (MCA). These results suggest that, at least in eyes-off-road conditions, findings on MS from simulator studies may generalize to real vehicles after application of a conversion factor. This conversion factor is likely to depend on simulator and MCA characteristics.

The influence of a color themed HMI on trust and take-over performance in automated vehicles.

Introduction: SAE Level 3 is known as conditional driving automation. As long as certain conditions are met, there is no need to supervise the technology and the driver can engage in non-driving related tasks (NDRTs). However, a human driver must be present and alert to take over when the automation is facing its system limits. When such an emergency takes place, the automation uses the human machine interface (HMI) to send a take-over request (TOR) to the driver. Methods: We investigated the influence of a color themed HMI on the trust and take-over performance in automated vehicles. Using a driving simulator, we tested 45 participants divided in three groups with a baseline auditory HMI and two advanced color themed HMIs consisting of a display and ambient lighting with the colors red and blue. Trust in automation was assessed using questionnaires while take-over performance was assessed through response time and success rate. Results: Compared to the baseline HMI, the color themed HMI is more trustworthy, and participants understood their driving tasks better. Results show that the color themed HMI is perceived as more pleasant compared to the baseline HMI and leads to shorter reaction times. Red ambient lighting is seen as more urging than blue, but HMI color did not significantly affect the general HMI perception and TOR performance. Discussion: Further research can explore the use of color and other modalities to express varying urgency levels and validate findings in complex on road driving conditions.

(Mis-)use of standard Autopilot and Full Self-Driving (FSD) Beta: Results from interviews with users of Tesla's FSD Beta.

Tesla's Full Self-Driving Beta (FSD) program introduces technology that extends the operational design domain of standard Autopilot from highways to urban roads. This research conducted 103 in-depth semi-structured interviews with users of Tesla's FSD Beta and standard Autopilot to evaluate the impact on user behavior and perception. It was found that drivers became complacent over time with Autopilot engaged, failing to monitor the system, and engaging in safety-critical behaviors, such as hands-free driving, enabled by weights placed on the steering wheel, mind wandering, or sleeping behind the wheel. Drivers' movement of eyes, hands, and feet became more relaxed with experience with Autopilot engaged. FSD Beta required constant supervision as unfinished technology, which increased driver stress and mental and physical workload as drivers had to be constantly prepared for unsafe system behavior (doing the wrong thing at the worst time). The hands-on wheel check was not considered as being necessarily effective in driver monitoring and guaranteeing safe use. Drivers adapt to automation over time, engaging in potentially dangerous behaviors. Some behavior seems to be a knowing violation of intended use (e.g., weighting the steering wheel), and other behavior reflects a misunderstanding or lack of experience (e.g., using Autopilot on roads not designed for). As unfinished Beta technology, FSD Beta can introduce new forms of stress and can be inherently unsafe. We recommend future research to investigate to what extent these behavioral changes affect accident risk and can be alleviated through driver state monitoring and assistance.