Effects of Gesture-Based Interaction on Driving Behavior: A Driving Simulator Study Using the Projection-Based Vehicle-in-the-Loop.

OBJECTIVE: We observe the driving performance effects of gesture-based interaction (GBI) versus touch-based interaction (TBI) for in-vehicle information systems (IVISs). BACKGROUND: As a contributing factor to a number of traffic accidents, driver distraction is a significant problem for traffic safety. More specifically, visual distraction has a strong negative impact on driving performance and risk perception. Thus, the implementation of new interaction systems that use midair gestures to encourage glance-free interactions could reduce visual distraction among drivers. METHODS: In this experiment, participants drove a projection-based Vehicle-in-the-Loop. The projection-based technology combines a visual simulation with kinesthetic, vestibular, and auditory feedback from a car on a test track. While driving, participants used GBI or TBI to perform IVIS tasks. To investigate driving behavior related to critical driving situations and car-following maneuvers, vehicle data based upon longitudinal and lateral driving were collected. RESULTS: Participants reacted faster to critical driving situations when using GBI compared to TBI. For drivers using TBI, steering performance decreased and time headway to a preceding vehicle was higher. CONCLUSION: Gestures provide a safe alternative to in-vehicle interactions. Moreover, GBI has fewer effects on driver distraction than TBI. APPLICATION: Potential applications of this research include all in-vehicle interaction systems used by drivers.

Information stored in memory affects abductive reasoning.

Abductive reasoning describes the process of deriving an explanation from given observations. The theory of abductive reasoning (TAR; Johnson and Krems, Cognitive Science 25:903-939, 2001) assumes that when information is presented sequentially, new information is integrated into a mental representation, a situation model, the central data structure on which all reasoning processes are based. Because working memory capacity is limited, the question arises how reasoning might change with the amount of information that has to be processed in memory. Thus, we conducted an experiment (N = 34) in which we manipulated whether previous observation information and previously found explanations had to be retrieved from memory or were still visually present. Our results provide evidence that people experience differences in task difficulty when more information has to be retrieved from memory. This is also evident in changes in the mental representation as reflected by eye tracking measures. However, no differences are found between groups in the reasoning outcome. These findings suggest that individuals construct their situation model from both information in memory as well as external memory stores. The complexity of the model depends on the task: when memory demands are high, only relevant information is included. With this compensation strategy, people are able to achieve similar reasoning outcomes even when faced with tasks that are more difficult. This implies that people are able to adapt their strategy to the task in order to keep their reasoning successful.

Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction.

OBJECTIVE: We observe the effects of in-vehicle system gesture-based interaction versus touch-based interaction on driver distraction and user experience. BACKGROUND: Driver distraction is a major problem for traffic safety, as it is a contributing factor to a number of accidents. Visual distraction in particular has a highly negative impact on the driver. One possibility for reducing visual driver distraction is to use new forms of interaction in the vehicle, such as gesture-based interaction. METHOD: In this experiment, participants drove on a motorway or in a city scenario while using touch-based interaction or gesture-based interaction. Subjective data, such as acceptance and workload, and objective data, including glance behavior, were gathered. RESULTS: As a result, participants rated their subjective impressions of safe driving as higher when using gesture-based interaction. More specifically, acceptance and attractiveness were higher, and workload was lower. The participants performed significantly fewer glances to the display and the glances were much shorter. CONCLUSION: Gestures are a positive alternative for in-vehicle interaction since effects on driver distraction are less significant when compared to touch-based interaction. APPLICATION: Potential application of this research includes interaction design of typical in-vehicle information and entertainment functions.

Covert shifts of attention can account for the functional role of "eye movements to nothing".

When trying to remember verbal information from memory, people look at spatial locations that have been associated with visual stimuli during encoding, even when the visual stimuli are no longer present. It has been shown that such "eye movements to nothing" can influence retrieval performance for verbal information, but the mechanism underlying this functional relationship is unclear. More precisely, covert in comparison to overt shifts of attention could be sufficient to elicit the observed differences in retrieval performance. To test if covert shifts of attention explain the functional role of the looking-at-nothing phenomenon, we asked participants to remember verbal information that had been associated with a spatial location during an encoding phase. Additionally, during the retrieval phase, all participants solved an unrelated visual tracking task that appeared in either an associated (congruent) or an incongruent spatial location. Half the participants were instructed to look at the tracking task, half to shift their attention covertly (while keeping the eyes fixed). In two experiments, we found that memory retrieval depended on the location to which participants shifted their attention covertly. Thus, covert shifts of attention seem to be sufficient to cause differences in retrieval performance. The results extend the literature on the relationship between visuospatial attention, eye movements, and verbal memory retrieval and provide deep insights into the nature of the looking-at-nothing phenomenon.

Driving comfort, enjoyment and acceptance of automated driving - effects of drivers' age and driving style familiarity.

Automated driving has the potential to improve the safety and efficiency of future traffic and to extend elderly peoples' driving life, provided it is perceived as comfortable and joyful and is accepted by drivers. Driving comfort could be enhanced by familiar automated driving styles based on drivers' manual driving styles. In a two-stage driving simulator study, effects of driving automation and driving style familiarity on driving comfort, enjoyment and system acceptance were examined. Twenty younger and 20 older drivers performed a manual and four automated drives of different driving style familiarity. Acceptance, comfort and enjoyment were assessed after driving with standardised questionnaires, discomfort during driving via handset control. Automation increased both age groups' comfort, but decreased younger drivers' enjoyment. Younger drivers showed higher comfort, enjoyment and acceptance with familiar automated driving styles, whereas older drivers preferred unfamiliar, automated driving styles tending to be faster than their age-affected manual driving styles. Practitioner Summary: Automated driving needs to be comfortable and enjoyable to be accepted by drivers, which could be enhanced by driving style individualisation. This approach was evaluated in a two-stage driving simulator study for different age groups. Younger drivers preferred familiar driving styles, whereas older drivers preferred driving styles unaffected by age.

Prior Familiarization With Takeover Requests Affects Drivers' Takeover Performance and Automation Trust.

OBJECTIVE: The objective for this study was to investigate the effects of prior familiarization with takeover requests (TORs) during conditional automated driving on drivers' initial takeover performance and automation trust. BACKGROUND: System-initiated TORs are one of the biggest concerns for conditional automated driving and have been studied extensively in the past. Most, but not all, of these studies have included training sessions to familiarize participants with TORs. This makes them hard to compare and might obscure first-failure-like effects on takeover performance and automation trust formation. METHOD: A driving simulator study compared drivers' takeover performance in two takeover situations across four prior familiarization groups (no familiarization, description, experience, description and experience) and automation trust before and after experiencing the system. RESULTS: As hypothesized, prior familiarization with TORs had a more positive effect on takeover performance in the first than in a subsequent takeover situation. In all groups, automation trust increased after participants experienced the system. Participants who were given no prior familiarization with TORs reported highest automation trust both before and after experiencing the system. CONCLUSION: The current results extend earlier findings suggesting that prior familiarization with TORs during conditional automated driving will be most relevant for takeover performance in the first takeover situation and that it lowers drivers' automation trust. APPLICATION: Potential applications of this research include different approaches to familiarize users with automated driving systems, better integration of earlier findings, and sophistication of experimental designs.

Can We Study Autonomous Driving Comfort in Moving-Base Driving Simulators? A Validation Study.

OBJECTIVE: To lay the basis of studying autonomous driving comfort using driving simulators, we assessed the behavioral validity of two moving-base simulator configurations by contrasting them with a test-track setting. BACKGROUND: With increasing level of automation, driving comfort becomes increasingly important. Simulators provide a safe environment to study perceived comfort in autonomous driving. To date, however, no studies were conducted in relation to comfort in autonomous driving to determine the extent to which results from simulator studies can be transferred to on-road driving conditions. METHOD: Participants ( N = 72) experienced six differently parameterized lane-change and deceleration maneuvers and subsequently rated the comfort of each scenario. One group of participants experienced the maneuvers on a test-track setting, whereas two other groups experienced them in one of two moving-base simulator configurations. RESULTS: We could demonstrate relative and absolute validity for one of the two simulator configurations. Subsequent analyses revealed that the validity of the simulator highly depends on the parameterization of the motion system. CONCLUSION: Moving-base simulation can be a useful research tool to study driving comfort in autonomous vehicles. However, our results point at a preference for subunity scaling factors for both lateral and longitudinal motion cues, which might be explained by an underestimation of speed in virtual environments. APPLICATION: In line with previous studies, we recommend lateral- and longitudinal-motion scaling factors of approximately 50% to 60% in order to obtain valid results for both active and passive driving tasks.

Listen up, eye movements play a role in verbal memory retrieval.

People fixate on blank spaces if visual stimuli previously occupied these regions of space. This so-called "looking at nothing" (LAN) phenomenon is said to be a part of information retrieval from internal memory representations, but the exact nature of the relationship between LAN and memory retrieval is unclear. While evidence exists for an influence of LAN on memory retrieval for visuospatial stimuli, evidence for verbal information is mixed. Here, we tested the relationship between LAN behavior and memory retrieval in an episodic retrieval task where verbal information was presented auditorily during encoding. When participants were allowed to gaze freely during subsequent memory retrieval, LAN occurred, and it was stronger for correct than for incorrect responses. When eye movements were manipulated during memory retrieval, retrieval performance was higher when participants fixated on the area associated with to-be-retrieved information than when fixating on another area. Our results provide evidence for a functional relationship between LAN and memory retrieval that extends to verbal information.

The diversity effect in diagnostic reasoning.

Diagnostic reasoning draws on knowledge about effects and their potential causes. The causal-diversity effect in diagnostic reasoning normatively depends on the distribution of effects in causal structures, and thus, a psychological diversity effect could indicate whether causally structured knowledge is used in evaluating the probability of a diagnosis, if the effect were to covary with manipulations of causal structures. In four experiments, participants dealt with a quasi-medical scenario presenting symptom sets (effects) that consistently suggested a specified diagnosis (cause). The probability that the diagnosis was correct had to be rated for two opposed symptom sets that differed with regard to the symptoms' positions (proximal or diverse) in the causal structure that was initially acquired. The causal structure linking the diagnosis to the symptoms and the base rate of the diagnosis were manipulated to explore whether the diagnosis was rated as more probable for diverse than for proximal symptoms when alternative causations were more plausible (e.g., because of a lower base rate of the diagnosis in question). The results replicated the causal diversity effect in diagnostic reasoning across these conditions, but no consistent effects of structure and base rate variations were observed. Diversity effects computed in causal Bayesian networks are presented, illustrating the consequences of the structure manipulations and corroborating that a diversity effect across the different experimental manipulations is normatively justified. The observed diversity effects presumably resulted from shortcut reasoning about the possibilities of alternative causation.

Keep Your Scanners Peeled: Gaze Behavior as a Measure of Automation Trust During Highly Automated Driving.

OBJECTIVE: The feasibility of measuring drivers' automation trust via gaze behavior during highly automated driving was assessed with eye tracking and validated with self-reported automation trust in a driving simulator study. BACKGROUND: Earlier research from other domains indicates that drivers' automation trust might be inferred from gaze behavior, such as monitoring frequency. METHOD: The gaze behavior and self-reported automation trust of 35 participants attending to a visually demanding non-driving-related task (NDRT) during highly automated driving was evaluated. The relationship between dispositional, situational, and learned automation trust with gaze behavior was compared. RESULTS: Overall, there was a consistent relationship between drivers' automation trust and gaze behavior. Participants reporting higher automation trust tended to monitor the automation less frequently. Further analyses revealed that higher automation trust was associated with lower monitoring frequency of the automation during NDRTs, and an increase in trust over the experimental session was connected with a decrease in monitoring frequency. CONCLUSION: We suggest that (a) the current results indicate a negative relationship between drivers' self-reported automation trust and monitoring frequency, (b) gaze behavior provides a more direct measure of automation trust than other behavioral measures, and (c) with further refinement, drivers' automation trust during highly automated driving might be inferred from gaze behavior. APPLICATION: Potential applications of this research include the estimation of drivers' automation trust and reliance during highly automated driving.

Which Factors Can Protect Against Range Stress in Everyday Usage of Battery Electric Vehicles? Toward Enhancing Sustainability of Electric Mobility Systems.

OBJECTIVE: The objective of the present research was to advance understanding of factors that can protect against range anxiety, specifically range stress in everyday usage of battery electric vehicles (BEVs). BACKGROUND: Range anxiety is a major barrier to the broad adoption of sustainable electric mobility systems. To develop strategies aimed at overcoming range anxiety, a clear understanding of this phenomenon and influencing factors is needed. METHOD: We examined range anxiety in the form of everyday range stress (ERS) in a field study setting. Seventy-two customers leased a BEV for 3 months. The field study was specifically designed to enable examination of factors that can contribute to lower ERS. In particular, study design and sample recruitment were targeted at generating vehicle usage profiles that would lead to relatively frequent experience of situations requiring active management of range resources and thereby potentially leading to experienced range stress. RESULTS: Less frequent encounter with critical range situations, higher practical experience, subjective range competence, tolerance of low range, and experienced trustworthiness of the range estimation system were related to lower ERS. Moreover, range stress was found to be related to range satisfaction and BEV acceptance. CONCLUSION: The results underline the importance of the human factors perspective to overcome range anxiety and enhance sustainability of electric mobility systems. APPLICATION: Trustworthiness should be employed as a key benchmark variable in the design of range estimation systems, and assistance systems should target increasing drivers' adaptive capacity (i.e., resilience) to cope with critical range situations.

Battery electric vehicles - implications for the driver interface.

The current study examines the human-machine interface of a battery electric vehicle (BEV) from a user-perspective, focussing on the evaluation of BEV-specific displays, the relevance of provided information and challenges for drivers due to the concept of electricity in a road vehicle. A sample of 40 users drove a BEV for 6 months. Data were gathered at three points of data collection. Participants perceived the BEV-specific displays as only moderately reliable and helpful for estimating the displayed parameters. This was even less the case after driving the BEV for 3 months. A taxonomy of user requirements was compiled revealing the need for improved and additional information, especially regarding energy consumption and efficiency. Drivers had difficulty understanding electrical units and the energy consumption of the BEV. On the background of general principles for display design, results provide implications how to display relevant information and how to facilitate drivers' understanding of energy consumption in BEVs. Practitioner Summary: Battery electric vehicle (BEV) displays need to incorporate new information. A taxonomy of user requirements was compiled revealing the need for improved and additional information in the BEV interface. Furthermore, drivers had trouble understanding electrical units and energy consumption; therefore, appropriate assistance is required. Design principles which are specifically important in the BEV context are discussed.

Energy recapture through deceleration - regenerative braking in electric vehicles from a user perspective.

We report results from a 1-year field study (N = 80) on user interactions with regenerative braking in electric vehicles. Designed to recapture energy in vehicles with electric powertrains, regenerative braking has an important influence on both the task of driving and energy consumption. Results from user assessments and data from onboard data loggers indicate that most drivers quickly learned to interact with the system, which was triggered via accelerator. Further, conventional braking manoeuvres decreased significantly as the majority of deceleration episodes could only be executed through regenerative braking. Still, some drivers reported difficulties when adapting to the system. These difficulties could be addressed by offering different levels of regeneration so that the intensity of the deceleration could be individually modified. In general, the system is trusted and regarded as a valuable tool for prolonging range. PRACTITIONER SUMMARY: Regenerative braking in electric vehicles has direct implications for the driving task. We found that drivers quickly learn to use and accept a system, which is triggered via accelerator. For those reporting difficulties in the interaction, it appears reasonable to integrate options to customise or switch off the system.

Anticipatory information makes the difference: Behavioral effects and user assessments of a cyclist warning system to enhance cyclists' situation awareness.

PROBLEM: Increasing numbers of crashes involving pedelecs, and particularly older pedelec users, induce a need to enhance cycling safety. We evaluated a prototype cyclist warning system (CWS) that aims to increase situation awareness (SA) by alerting to safety critical events (SCE) with trimodal (auditory, visual, tactile). METHOD: To investigate the effects of CWS usage, we conducted a 2x2 mixed design bicycle simulator study with factors (1) CWS usage (within: rides WITH vs. WITHOUT CWS) and (2) age group (between: younger vs. older cyclists) on braking reaction time, gaze behavior, mental workload, and perceived safety. In sum, N = 64 participants (n = 32 younger, 18-40 years; n = 32 older, ≥ 55 years) took part in the study and experienced two balanced blocks of short rides including SCE of particular relevance for cycling safety. RESULTS: CWS usage resulted in earlier braking reactions to all investigated SCE and partly earlier fixation on the critical interaction partners (CIP) indicating increased cyclists' SA. Consistently to behavioral measures, participants' assessments regarding perceived safety further supported the safety improvements derived from CWS independently of age group. Moreover, CWS usage did not add to mental workload ratings. Age effects were selectively found for gaze data showing that across all SCE, older adults fixated longer and more frequently on street alignment, and less frequently on other road users. DISCUSSION: Taken together, the CWS evaluation showed promising results indicating the potential of the tested CWS to increase SA and enhance cyclists' safety both on a behavioral level and regarding subjective assessments. Further research should address the systems' safety potential under real-world conditions and for situations of higher complexity. PRACTICAL APPLICATIONS: Understanding the potential impact of road safety measures such as CWS is important to contribute effectively to reducing SCE.

Using event-related brain potentials to evaluate motor-auditory latencies in virtual reality.

Actions in the real world have immediate sensory consequences. Mimicking these in digital environments is within reach, but technical constraints usually impose a certain latency (delay) between user actions and system responses. It is important to assess the impact of this latency on the users, ideally with measurement techniques that do not interfere with their digital experience. One such unobtrusive technique is electroencephalography (EEG), which can capture the users' brain activity associated with motor responses and sensory events by extracting event-related potentials (ERPs) from the continuous EEG recording. Here we exploit the fact that the amplitude of sensory ERP components (specifically, N1 and P2) reflects the degree to which the sensory event was perceived as an expected consequence of an own action (self-generation effect). Participants (N = 24) elicit auditory events in a virtual-reality (VR) setting by entering codes on virtual keypads to open doors. In a within-participant design, the delay between user input and sound presentation is manipulated across blocks. Occasionally, the virtual keypad is operated by a simulated robot instead, yielding a control condition with externally generated sounds. Results show that N1 (but not P2) amplitude is reduced for self-generated relative to externally generated sounds, and P2 (but not N1) amplitude is modulated by delay of sound presentation in a graded manner. This dissociation between N1 and P2 effects maps back to basic research on self-generation of sounds. We suggest P2 amplitude as a candidate read-out to assess the quality and immersiveness of digital environments with respect to system latency.

Sometimes, often, and always: exploring the vague meanings of frequency expressions.

The article describes a general two-step procedure for the numerical translation of vague linguistic terms (LTs). The suggested procedure consists of empirical and model components, including (1) participants' estimates of numerical values corresponding to verbal terms and (2) modeling of the empirical data using fuzzy membership functions (MFs), respectively. The procedure is outlined in two studies for data from N = 89 and N = 109 participants, who were asked to estimate numbers corresponding to 11 verbal frequency expressions (e.g., sometimes). Positions and shapes of the resulting MFs varied considerably in symmetry, vagueness, and overlap and are indicative of the different meanings of the vague frequency expressions. Words were not distributed equidistantly across the numerical scale. This has important implications for the many questionnaires that use verbal rating scales, which consist of frequency expressions and operate on the premise of equidistance. These results are discussed for an exemplar questionnaire (COPSOQ). Furthermore, the variation of the number of prompted LTs (5 vs. 11) showed no influence on the words' interpretations.

Assessing mental workload with wearable devices - Reliability and applicability of heart rate and motion measurements.

Wearable devices are increasingly used for assessing physiological data. Industry 4.0 aims to achieve the real-time assessment of the workers' condition to adapt processes including the current mental workload. Mental workload can be assessed via physiological data. This paper researches the potential of wearable devices for mental workload assessment by utilizing heart rate and motion data collected with a smartwatch. A laboratory study was conducted with four levels of mental workload, ranging from none to high and during sitting and stepping activities. When sitting, a difference in the heart rate and motion data from the smartwatch was only found between no mental workload and any mental workload task. For the stepping condition, differences were found for the movement data. Based on these results, wearable devices could be useful in the future for detecting whether a mental demanding task is currently performed during low levels of physical activity.

The Effect of eHMI Malfunctions on Younger and Elderly Pedestrians' Trust and Acceptance of Automated Vehicle Communication Signals.

To ensure traffic flow and road safety in automated driving, external human-machine interfaces (eHMIs) could prospectively support the interaction between automated vehicles (AVs; SAE Level 3 or higher) and pedestrians if implicit communication is insufficient. Particularly elderly pedestrians (≥65 years) who are notably vulnerable in terms of traffic safety might benefit of the advantages of additional signals provided by eHMIs. Previous research showed that eHMIs were assessed as useful means of communication in AVs and were preferred over exclusively implicit communication signals. However, the attitudes of elderly users regarding technology usage and acceptance are ambiguous (i.e., less intention to use technology vs. a tendency toward overreliance on technology compared to younger users). Considering potential eHMI malfunctions, an appropriate level of trust in eHMIs is required to ensure traffic safety. So far, little research respected the impact of multiple eHMI malfunctions on participants' assessment of the system. Moreover, age effects were rarely investigated in eHMIs. In the current monitor-based study, N = 36 participants (19 younger, 17 elderly) repeatedly assessed an eHMI: During an initial measurement, when encountering a valid system and after experiencing eHMI malfunctions. Participants indicated their trust and acceptance in the eHMI, feeling of safety during the interaction and vigilance toward the eHMI. The results showed a positive effect of interacting with a valid system that acted consistently to the vehicle's movements compared to an initial assessment of the system. After experiencing eHMI malfunctions, participants' assessment of the system declined significantly. Moreover, elderly participants assessed the eHMI more positive across all conditions than younger participants did. The findings imply that participants considered the vehicle's movements as implicit communication cues in addition to the provided eHMI signals during the encounters. To support traffic safety and smooth interactions, eHMI signals are required to be in line with vehicle's movements as implicit communication cues. Moreover, the results underline the importance of calibrating an appropriate level of trust in eHMI signals. An adequate understanding of eHMI signals needs to be developed. Thereby, the requirements of different user groups should be specifically considered.

The box task - a method for assessing in-vehicle system demand.

The use of advanced in-vehicle information systems (IVIS) and other complex devices such as smartphones while driving can lead to driver distraction, which, in turn, increases safety-critical event risk. Therefore, using methods for measuring driver distraction caused by IVIS is crucial when developing new in-vehicle systems. In this paper, we present the setup and implementation of the Box Task combined with a Detection Response Task (BT+DRT) as a tool to assess visual-manual and cognitive distraction effects. The BT+DRT represents a low-cost and easy-to-use method which can be easily implemented by researchers in laboratory settings and which was validated in previous research. Moreover, at the end of this paper we describe the experimental procedure, the data analysis and discuss potential modifications of the method.•The setup and implementation of the Box Task combined with a Detection Response Task (BT+DRT) is described.•The method allows for measuring visual-manual and cognitive distraction of drivers.•The BT+DRT is a cost-effective and easy-to-use method that can be implemented in laboratory settings or driving simulators.

Tracing current explanations in memory: A process analysis based on eye-tracking.

Sequential abductive reasoning is the process of finding the best explanation for a set of observations. Explanations can be multicausal and require the retrieval of previously found ones from memory. The theory of abductive reasoning (TAR) allows detailed predictions on what information is stored and retrieved from memory during reasoning. In the research to date, however, these predictions have never been directly tested. In this study, we tested process assumptions such as the construction of a mental representation from TAR using memory indexing, an eye-tracking method that makes it possible to trace the retrieval of explanations currently held in working memory. Gaze analysis revealed that participants encode the presented evidence (i.e., observations) together with possible explanations into memory. When new observations are presented, the previously presented evidence and explanations are retrieved. Observations that are not explained immediately are encoded as abstractly explained. Abstract explanations enter a refinement process in which they become concrete before they enter the situation model. With the memory indexing method, we were able to assess the process of information retrieval in abductive reasoning, which was previously believed to be unobservable. We discuss the results in the light of TAR and other current theories on the diagnostic reasoning process.