Using Pre-stimulus EEG to Predict Driver Reaction Time To Road Events.

The ability to predict a driver's reaction time to road events could be used in driver safety assistance systems, allowing for autonomous control when a driver may be about to react with sup-optimal performance. In this paper, we evaluate a number of machine learning and feature engineering strategies that we use to predict the reaction time(s) of 24 drivers to road events using EEG (Electroencephalography) captured in an immersive driving simulator. Subject-independent models are trained and evaluated using EEG features extracted from time periods that precede the road events that we predict the reaction times for. Our paper has two contributions: 1) we predict the reaction times corresponding to individual road events using EEG spectral features from a time period before the onset of the road event, i.e. we take EEG data from 2 seconds before the event, and 2) we predict whether a subject will be a slow or fast responder compared to other drivers.

Real-time face & eye tracking and blink detection using event cameras.

Event cameras contain emerging, neuromorphic vision sensors that capture local-light​ intensity changes at each pixel, generating a stream of asynchronous events. This way of acquiring visual information constitutes a departure from traditional frame-based cameras and offers several significant advantages - low energy consumption, high temporal resolution, high dynamic range and low latency. Driver monitoring systems (DMS) are in-cabin safety systems designed to sense and understand a drivers physical and cognitive state. Event cameras are particularly suited to DMS due to their inherent advantages. This paper proposes a novel method to simultaneously detect and track faces and eyes for driver monitoring. A unique, fully convolutional recurrent neural network architecture is presented. To train this network, a synthetic event-based dataset is simulated with accurate bounding box annotations, called Neuromorphic-HELEN. Additionally, a method to detect and analyse drivers' eye blinks is proposed, exploiting the high temporal resolution of event cameras. Behaviour of blinking provides greater insights into a driver level of fatigue or drowsiness. We show that blinks have a unique temporal signature that can be better captured by event cameras.