On the road to comfort: Evaluating the influence of motion predictability on motion sickness in automated vehicles.

Automated vehicles could increase the risk of motion sickness because occupants are not involved in driving and do not watch the road. This paper aimed to investigate the influence of motion predictability on motion sickness in automated vehicles, as better motion anticipation is believed to mitigate motion sickness. In a simulator-based study, twenty participants experienced two driving conditions differing only in turn directions. The repetitive condition featured a repeating turn direction pattern. The non-repetitive condition contained pseudo-randomly ordered turn directions. To mimic an 'eyes-off-the-road' setting and prevent visual motion anticipation, road visuals were omitted. No significant differences in sickness or head motion, a metric for motion anticipation, were found between the conditions. No participant recognised the repeating turn pattern. This suggests no increased motion anticipation in the repetitive condition, possibly due to a reduced ability to recognise a repeating motion pattern in one degree of freedom within more complex motion.

Motion anticipation is believed to mitigate motion sickness. However, in this simulator-based study on automated vehicles, no significant differences in motion anticipation or sickness were observed between repetitive and non-repetitive turn directions. Recognition of a repeating motion pattern in one degree of freedom might be diminished when it is part of more complex motion.

Responses to Raven matrices: Governed by visual complexity and centrality.

Raven matrices are widely considered a pure test of cognitive abilities. Previous research has examined the extent to which cognitive strategies are predictive of the number of correct responses to Raven items. This study examined whether response times can be explained directly from the centrality and visual complexity of the matrix cells (edge density and perceived complexity). A total of 159 participants completed a 12-item version of the Raven Advanced Progressive Matrices. In addition to item number (an index of item difficulty), the findings demonstrated a positive correlation between the visual complexity of Raven items and both the mean response time and the number of fixations on the matrix (a strong correlate of response time). Moreover, more centrally placed cells as well as more complex cells received more fixations. It is concluded that response times on Raven matrices are impacted by low-level stimulus attributes, namely, visual complexity and eccentricity.

Expectancy or Salience?-Replicating Senders' Dial-Monitoring Experiments With a Gaze-Contingent Window.

INTRODUCTION: In the 1950s and 1960s, John Senders carried out a number of influential experiments on the monitoring of multidegree-of-freedom systems. In these experiments, participants were tasked with detecting events (threshold crossings) for multiple dials, each presenting a signal with different bandwidth. Senders' analyses showed a nearly linear relationship between signal bandwidth and the amount of attention paid to the dial, and he argued that humans sample according to bandwidth, in line with the Nyquist-Shannon sampling theorem. OBJECTIVE: The current study tested whether humans indeed sample the dials based on bandwidth alone or whether they also use salient peripheral cues. METHODS: A dial-monitoring task was performed by 33 participants. In half of the trials, a gaze-contingent window was used that blocked peripheral vision. RESULTS: The results showed that, without peripheral vision, humans do not effectively distribute their attention across the dials. The findings also suggest that, when given full view, humans can detect the speed of the dial using their peripheral vision. CONCLUSION: It is concluded that salience and bandwidth are both drivers of distributed visual attention in a dial-monitoring task. APPLICATION: The present findings indicate that salience plays a major role in guiding human attention. A subsequent recommendation for future human-machine interface design is that task-critical elements should be made salient.

The effect of an occlusion-induced delay on braking behavior in critical situations: A driving simulator study.

OBJECTIVE: To share results of an experiment that used visual occlusion for a new purpose: inducing a waiting time. BACKGROUND: Senders was a leading figure in human factors. In his research on the visual demands of driving, he used occlusion techniques. METHODS: In a simulator experiment, we examined how drivers brake for different levels of urgency and different visual conditions. In three blocks (1 = brake lights, 2 = no brake lights, 3 = occlusion), drivers followed a vehicle at 13.4 or 33.4 m distance. At certain moments, the lead vehicle decelerated moderately (1.7 m/s2) or strongly (6.5 m/s2). In the occlusion condition, the screens blanked for 0.4 s (if 6.5 m/s2) or 2.0 s (if 1.7 m/s2) when the lead vehicle started to decelerate. Participants were instructed to brake only after the occlusion ended. RESULTS: The lack of brake lights caused a delayed response. In the occlusion condition, drivers adapted to the instructed late braking by braking harder. However, adaptation was not always possible: In the most urgent condition, most participants collided with the lead vehicle because the ego-vehicle's deceleration limits were reached. In non-urgent conditions, some drivers braked unnecessarily hard. Furthermore, while waiting until the occlusion cleared, some drivers lightly touched the brake pedal. CONCLUSION: This experimental design demonstrates how drivers (sometimes fail to) adjust their braking behavior to the criticality of the situation. APPLICATION: The phenomena of biomechanical readiness and (inappropriate) dosing of the brake pedal may be relevant to safety, traffic flow, and ADAS design.

How do people distribute their attention while observing The Night Watch?

This study explored how people look at The Night Watch (1642), Rembrandt's masterpiece. Twenty-one participants each stood in front of the painting for 5 min, while their eyes were recorded with a mobile eye-tracker and their thoughts were verbalized with a think-aloud method. We computed a heatmap of the participants' attentional distribution using a novel markerless mapping method. The results showed that the participants' attention was mainly directed at the faces of the two central figures, the bright mascot girl in the painting, and detailed elements such as the apparel of the key figures. The eye-movement analysis and think-aloud data also showed that participants' attention shifted from the faces of the key figures to other elements of the scene over the course of the 5 min. Our analyses are consistent with the theory that Rembrandt used light and texture to capture the viewer's attention. Finally, the robustness of the eye-tracking method was demonstrated by replicating the study on a smaller replica.

Should Steering Settings be Changed by the Driver or by the Vehicle Itself?

INTRODUCTION: Cars are increasingly computerized, and vehicle settings such as steering gain (SG) can now be altered during driving. However, it is unknown whether transitions in SG should be adaptable (i.e., triggered by driver input) or adaptive (i.e., triggered automatically). We examined this question for road segments expected to require different SG. OBJECTIVE: This paper aimed to investigate whether SG mode changes should be made by the driver or automatically. METHODS: Twenty-four participants drove under four conditions in a simulator: fixed low gain (FL), fixed high gain (FH), a machine-initiated steering system, which switched between the two SG levels at predetermined locations (MI), and a driver-initiated steering system, in which the SG level could be changed by pressing a button on the steering wheel (DI). RESULTS: Participants showed poorer lane-keeping and reported higher effort for FH compared to FL on straights, while the opposite held true on curved roads. On curved roads, the MI condition yielded better lane-keeping and lower subjective effort than the DI condition. However, a substantial portion of the drivers gave low preference rankings to the MI system. CONCLUSION: Drivers prefer and benefit from a steering system with a variable rather than fixed gain. Furthermore, although automatic SG transitions reduce effort, some drivers reject this concept. APPLICATION: As the state of technology advances, MI transitions are becoming increasingly feasible, but whether drivers would want to delegate their decision-making authority to a machine remains a moot point.

Automated vehicles that communicate implicitly: examining the use of lateral position within the lane.

It may be necessary to introduce new modes of communication between automated vehicles (AVs) and pedestrians. This research proposes using the AV's lateral deviation within the lane to communicate if the AV will yield to the pedestrian. In an online experiment, animated video clips depicting an approaching AV were shown to participants. Each of 1104 participants viewed 28 videos twice in random order. The videos differed in deviation magnitude, deviation onset, turn indicator usage, and deviation-yielding mapping. Participants had to press and hold a key as long as they felt safe to cross, and report the perceived intuitiveness of the AV's behaviour after each trial. The results showed that the AV moving towards the pedestrian to indicate yielding and away to indicate continuing driving was more effective than the opposite combination. Furthermore, the turn indicator was regarded as intuitive for signalling that the AV will yield. Practitioner Summary: Future automated vehicles (AVs) may have to communicate with vulnerable road users. Many researchers have explored explicit communication via text messages and led strips on the outside of the AV. The present study examines the viability of implicit communication via the lateral movement of the AV.

How do pedestrians distribute their visual attention when walking through a parking garage? An eye-tracking study.

We examined what pedestrians look at when walking through a parking garage. Thirty-six participants walked a short route in a parking garage while their eye movements and head rotations were recorded with a Tobii Pro Glasses 2 eye-tracker. The participants' fixations were then classified into 14 areas of interest. The results showed that pedestrians often looked at the back (20.0%), side (7.5%), and front (4.2%) of parked cars, and at approaching cars (8.8%). Much attention was also paid to the ground (20.1%). The wheels of cars (6.8%) and the driver in approaching cars (3.2%) received attention as well. In conclusion, this study showed that eye movements are largely functional in the sense that they appear to assist in safe navigation through the parking garage. Pedestrians look at a variety of sides and features of the car, suggesting that displays on future automated cars should be omnidirectionally visible. Practitioner summary: This study measured where pedestrians look when walking through a parking garage. It was found that the back, side, and wheels of cars attract considerable attention. This knowledge may be important for the development of automated cars that feature so-called external human-machine interfaces (eHMIs).

Redesigning Today's Driving Automation Toward Adaptive Backup Control With Context-Based and Invisible Interfaces.

OBJECTIVE: We investigated a driver monitoring system (DMS) designed to adaptively back up distracted drivers with automated driving. BACKGROUND: Humans are likely inadequate for supervising today's on-road driving automation. Conversely, backup concepts can use eye-tracker DMS to retain the human as the primary driver and use computerized control only if needed. A distraction DMS where perceived false alarms are minimized and the status of the backup is unannounced might reduce problems of distrust and overreliance, respectively. Experimental research is needed to assess the viability of such designs. METHODS: In a driving simulator, 91 participants either supervised driving automation (auto-hand-on-wheel vs. auto-hands-off-wheel), drove with different forms of DMS-induced backup control (eyes-only-backup vs. eyes-plus-context-backup; visible-backup vs. invisible-backup), or drove without any automation. All participants performed a visual N-back task throughout. RESULTS: Supervised driving automation increased visual distraction and hazard non-responses compared to backup and conventional driving. Auto-hand-on-wheel improved response generation compared to auto-hands-off-wheel. Across entire driving trials, the backup improved lateral performance compared to conventional driving. Without negatively impacting safety, the eyes-plus-context-backup DMS reduced unnecessary automated control compared to the eyes-only-backup DMS conditions. Eyes-only-backup produced low satisfaction ratings, whereas eyes-plus-context-backup satisfaction was on par with automated driving. There were no appreciable negative consequences attributable to the invisible-backup driving automation. CONCLUSIONS: We have demonstrated preliminary feasibility of DMS designs that incorporate driving context information for distraction assessment and suppress their status indication. APPLICATION: An appropriately designed DMS can enable benefits for automated driving as a backup.

External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions.

OBJECTIVE: In this article, we investigated the effects of external human-machine interfaces (eHMIs) on pedestrians' crossing intentions. BACKGROUND: Literature suggests that the safety (i.e., not crossing when unsafe) and efficiency (i.e., crossing when safe) of pedestrians' interactions with automated vehicles could increase if automated vehicles display their intention via an eHMI. METHODS: Twenty-eight participants experienced an urban road environment from a pedestrian's perspective using a head-mounted display. The behavior of approaching vehicles (yielding, nonyielding), vehicle size (small, medium, large), eHMI type (1. baseline without eHMI, 2. front brake lights, 3. Knightrider animation, 4. smiley, 5. text [WALK]), and eHMI timing (early, intermediate, late) were varied. For yielding vehicles, the eHMI changed from a nonyielding to a yielding state, and for nonyielding vehicles, the eHMI remained in its nonyielding state. Participants continuously indicated whether they felt safe to cross using a handheld button, and "feel-safe" percentages were calculated. RESULTS: For yielding vehicles, the feel-safe percentages were higher for the front brake lights, Knightrider, smiley, and text, as compared with baseline. For nonyielding vehicles, the feel-safe percentages were equivalent regardless of the presence or type of eHMI, but larger vehicles yielded lower feel-safe percentages. The Text eHMI appeared to require no learning, contrary to the three other eHMIs. CONCLUSION: An eHMI increases the efficiency of pedestrian-AV interactions, and a textual display is regarded as the least ambiguous. APPLICATION: This research supports the development of automated vehicles that communicate with other road users.

What determines drivers' speed? A replication of three behavioural adaptation experiments in a single driving simulator study.

We conceptually replicated three highly cited experiments on speed adaptation, by measuring drivers' experienced risk (galvanic skin response; GSR), experienced task difficulty (self-reported task effort; SRTE) and safety margins (time-to-line-crossing; TLC) in a single experiment. The three measures were compared using a nonparametric index that captures the criteria of constancy during self-paced driving and sensitivity during forced-paced driving. In a driving simulator, 24 participants completed two forced-paced and one self-paced run. Each run held four different lane width conditions. Results showed that participants drove faster on wider lanes, thus confirming the expected speed adaptation. None of the three measures offered persuasive evidence for speed adaptation because they failed either the sensitivity criterion (GSR) or the constancy criterion (TLC, SRTE). An additional measure, steering reversal rate, outperformed the other three measures regarding sensitivity and constancy, prompting a further evaluation of the role of control activity in speed adaptation. Practitioner Summary: Results from a driving simulator experiment suggest that it is not experienced risk, experienced effort or safety margins that govern drivers' choice of speed. Rather, our findings suggest that steering reversal rate has an explanatory role in speed adaptation.

Robust Hand Motion Tracking through Data Fusion of 5DT Data Glove and Nimble VR Kinect Camera Measurements.

Vision based interfaces for human computer interaction have gained increasing attention over the past decade. This study presents a data fusion approach of the Nimble VR vision based system, using the Kinect camera, with the contact based 5DT Data Glove. Data fusion was achieved through a Kalman filter. The Nimble VR and filter output were compared using measurements performed on (1) a wooden hand model placed in various static postures and orientations; and (2) three differently sized human hands during active finger flexions. Precision and accuracy of joint angle estimates as a function of hand posture and orientation were determined. Moreover, in light of possible self-occlusions of the fingers in the Kinect camera images, data completeness was assessed. Results showed that the integration of the Data Glove through the Kalman filter provided for the proximal interphalangeal (PIP) joints of the fingers a substantial improvement of 79% in precision, from 2.2 deg to 0.9 deg. Moreover, a moderate improvement of 31% in accuracy (being the mean angular deviation from the true joint angle) was established, from 24 deg to 17 deg. The metacarpophalangeal (MCP) joint was relatively unaffected by the Kalman filter. Moreover, the Data Glove increased data completeness, thus providing a substantial advantage over the sole use of the Nimble VR system.

A quarter of a century of the DBQ: some supplementary notes on its validity with regard to accidents.

This article synthesises the latest information on the relationship between the Driver Behaviour Questionnaire (DBQ) and accidents. We show by means of computer simulation that correlations with accidents are necessarily small because accidents are rare events. An updated meta-analysis on the zero-order correlations between the DBQ and self-reported accidents yielded an overall r of .13 (fixed-effect and random-effects models) for violations (57,480 participants; 67 samples) and .09 (fixed-effect and random-effects models) for errors (66,028 participants; 56 samples). An analysis of a previously published DBQ dataset (975 participants) showed that by aggregating across four measurement occasions, the correlation coefficient with self-reported accidents increased from .14 to .24 for violations and from .11 to .19 for errors. Our meta-analysis also showed that DBQ violations (r = .24; 6353 participants; 20 samples) but not DBQ errors (r = - .08; 1086 participants; 16 samples) correlated with recorded vehicle speed. Practitioner Summary: The DBQ is probably the most widely used self-report questionnaire in driver behaviour research. This study shows that DBQ violations and errors correlate moderately with self-reported traffic accidents.

Effects of visual fidelity on curve negotiation, gaze behaviour and simulator discomfort.

Technological developments have led to increased visual fidelity of driving simulators. However, simplified visuals have potential advantages, such as improved experimental control, reduced simulator discomfort and increased generalisability of results. In this driving simulator study, we evaluated the effects of visual fidelity on driving performance, gaze behaviour and subjective discomfort ratings. Twenty-four participants drove a track with 90° corners in (1) a high fidelity, textured environment, (2) a medium fidelity, non-textured environment without scenery objects and (3) a low-fidelity monochrome environment that only showed lane markers. The high fidelity level resulted in higher steering activity on straight road segments, higher driving speeds and higher gaze variance than the lower fidelity levels. No differences were found between the two lower fidelity levels. In conclusion, textures and objects were found to affect steering activity and driving performance; however, gaze behaviour during curve negotiation and self-reported simulator discomfort were unaffected. PRACTITIONER SUMMARY: In a driving simulator study, three levels of visual fidelity were evaluated. The results indicate that the highest fidelity level, characterised by a textured environment, resulted in higher steering activity, higher driving speeds and higher variance of horizontal gaze than the two lower fidelity levels without textures.

Putting ChatGPT vision (GPT-4V) to the test: risk perception in traffic images.

Vision-language models are of interest in various domains, including automated driving, where computer vision techniques can accurately detect road users, but where the vehicle sometimes fails to understand context. This study examined the effectiveness of GPT-4V in predicting the level of 'risk' in traffic images as assessed by humans. We used 210 static images taken from a moving vehicle, each previously rated by approximately 650 people. Based on psychometric construct theory and using insights from the self-consistency prompting method, we formulated three hypotheses: (i) repeating the prompt under effectively identical conditions increases validity, (ii) varying the prompt text and extracting a total score increases validity compared to using a single prompt, and (iii) in a multiple regression analysis, the incorporation of object detection features, alongside the GPT-4V-based risk rating, significantly contributes to improving the model's validity. Validity was quantified by the correlation coefficient with human risk scores, across the 210 images. The results confirmed the three hypotheses. The eventual validity coefficient was r = 0.83, indicating that population-level human risk can be predicted using AI with a high degree of accuracy. The findings suggest that GPT-4V must be prompted in a way equivalent to how humans fill out a multi-item questionnaire.

Exploring the challenges faced by Dutch truck drivers in the era of technological advancement.

Introduction: Despite their important role in the economy, truck drivers face several challenges, including adapting to advancing technology. The current study investigated the occupational experiences of Dutch truck drivers to detect common patterns. Methods: A questionnaire was distributed to professional drivers in order to collect data on public image, traffic safety, work pressure, transport crime, driver shortage, and sector improvements. Results: The findings based on 3,708 respondents revealed a general dissatisfaction with the image of the industry and reluctance to recommend the profession. A factor analysis of the questionnaire items identified two primary factors: 'Work Pressure', more common among national drivers, and 'Safety & Security Concerns', more common among international drivers. A ChatGPT-assisted analysis of textbox comments indicated that vehicle technology received mixed feedback, with praise for safety and fuel-efficiency improvements, but concerns about reliability and intrusiveness. Discussion: In conclusion, Dutch professional truck drivers indicate a need for industry improvements. While the work pressure for truck drivers in general may not be high relative to certain other occupational groups, truck drivers appear to face a deficit of support and respect.

Once a driver, always a driver - Manual driving style persists in automated driving takeover.

As automated vehicles require human drivers to resume control in critical situations, predicting driver takeover behaviour could be beneficial for safe transitions of control. While previous research has explored predicting takeover behaviour in relation to driver state and traits, little work has examined the predictive value of manual driving style. We hypothesised that drivers' behaviour during manual driving is predictive of their takeover behaviour when resuming control from an automated vehicle. We assessed 38 drivers with varying experience in a high-fidelity driving simulator. After completing manual driving sessions to assess their driving style, participants performed an automated driving task, typically on a subsequent date. Measures of driving style from manual driving sessions, including headway and lane change speed, were found to be predictive of takeover behaviour. The level of driving experience was associated with the behavioural measures, but correlations between measures of manual driving style and takeover behaviour remained after controlling for driver experience. Our findings demonstrate that how drivers reclaim control from their automated vehicle is not an isolated phenomenon but is associated with manual driving behaviour and driving experience. Strategies to improve takeover safety and comfort could be based on driving style measures, for example by the automated vehicle adapting its behaviour to match a driver's driving style.

Augmented reality for supporting the interaction between pedestrians and automated vehicles: an experimental outdoor study.

Introduction: Communication from automated vehicles (AVs) to pedestrians using augmented reality (AR) could positively contribute to traffic safety. However, previous AR research for pedestrians was mainly conducted through online questionnaires or experiments in virtual environments instead of real ones. Methods: In this study, 28 participants conducted trials outdoors with an approaching AV and were supported by four different AR interfaces. The AR experience was created by having participants wear a Varjo XR-3 headset with see-through functionality, with the AV and AR elements virtually overlaid onto the real environment. The AR interfaces were vehicle-locked (Planes on vehicle), world-locked (Fixed pedestrian lights, Virtual fence), or head-locked (Pedestrian lights HUD). Participants had to hold down a button when they felt it was safe to cross, and their opinions were obtained through rating scales, interviews, and a questionnaire. Results: The results showed that participants had a subjective preference for AR interfaces over no AR interface. Furthermore, the Pedestrian lights HUD was more effective than no AR interface in a statistically significant manner, as it led to participants more frequently keeping the button pressed. The Fixed pedestrian lights scored lower than the other interfaces, presumably due to low saliency and the fact that participants had to visually identify both this AR interface and the AV. Discussion: In conclusion, while users favour AR in AV-pedestrian interactions over no AR, its effectiveness depends on design factors like location, visibility, and visual attention demands. In conclusion, this work provides important insights into the use of AR outdoors. The findings illustrate that, in these circumstances, a clear and easily interpretable AR interface is of key importance.

Replication studies in the Netherlands: Lessons learned and recommendations for funders, publishers and editors, and universities.

Drawing on our experiences conducting replications we describe the lessons we learned about replication studies and formulate recommendations for researchers, policy makers, and funders about the role of replication in science and how it should be supported and funded. We first identify a variety of benefits of doing replication studies. Next, we argue that it is often necessary to improve aspects of the original study, even if that means deviating from the original protocol. Thirdly, we argue that replication studies highlight the importance of and need for more transparency of the research process, but also make clear how difficult that is. Fourthly, we underline that it is worth trying out replication in the humanities. We finish by formulating recommendations regarding reproduction and replication research, aimed specifically at funders, editors and publishers, and universities and other research institutes.

Using ChatGPT for human-computer interaction research: a primer.

ChatGPT could serve as a tool for text analysis within the field of Human-Computer Interaction, though its validity requires investigation. This study applied ChatGPT to: (1) textbox questionnaire responses on nine augmented-reality interfaces, (2) interview data from participants who experienced these interfaces in a virtual simulator, and (3) transcribed think-aloud data of participants who viewed a real painting and its replica. Using a hierarchical approach, ChatGPT produced scores or summaries of text batches, which were then aggregated. Results showed that (1) ChatGPT generated sentiment scores of the interfaces that correlated extremely strongly (r > 0.99) with human rating scale outcomes and with a rule-based sentiment analysis method (criterion validity). Additionally, (2) by inputting automatically transcribed interviews to ChatGPT, it provided meaningful meta-summaries of the qualities of the interfaces (face validity). One meta-summary analysed in depth was found to have substantial but imperfect overlap with a content analysis conducted by an independent researcher (criterion validity). Finally, (3) ChatGPT's summary of the think-aloud data highlighted subtle differences between the real painting and the replica (face validity), a distinction corresponding with a keyword analysis (criterion validity). In conclusion, our research indicates that, with appropriate precautions, ChatGPT can be used as a valid tool for analysing text data.