Mental Effort in Elite and Nonelite Rowers.

Mental effort (intensity of attention) in elite sports has remained a debated topic and a challenging phenomenon to measure. Thus, a quasi-ecological laboratory study was conducted to investigate mental effort in elite rowers as compared with a group of nonelites. Findings suggest that eye-tracking measures-specifically, blink rates and pupil size-can serve as valid indicators of mental effort in physically demanding sport tasks. Furthermore, findings contradict the notion that elite athletes spend less cognitive effort than their lower-level peers. Specifically, elites displayed similar levels of self-reported effort and performance decrement with increasing mental load and significantly more mental effort overall as measured by pupil-size increase (relative to baseline) during rowing trials as compared with the nonelites in the sample. Future studies on eye tracking in sports may include investigations of mental effort in addition to selective attention during physically demanding tasks.

Deep learning models for webcam eye tracking in online experiments.

Eye tracking is prevalent in scientific and commercial applications. Recent computer vision and deep learning methods enable eye tracking with off-the-shelf webcams and reduce dependence on expensive, restrictive hardware. However, such deep learning methods have not yet been applied and evaluated for remote, online psychological experiments. In this study, we tackle critical challenges faced in remote eye tracking setups and systematically evaluate appearance-based deep learning methods of gaze tracking and blink detection. From their own homes and laptops, 65 participants performed a battery of eye tracking tasks including (i) fixation, (ii) zone classification, (iii) free viewing, (iv) smooth pursuit, and (v) blink detection. Webcam recordings of the participants performing these tasks were processed offline through appearance-based models of gaze and blink detection. The task battery required different eye movements that characterized gaze and blink prediction accuracy over a comprehensive list of measures. We find the best gaze accuracy to be 2.4° and precision of 0.47°, which outperforms previous online eye tracking studies and reduces the gap between laboratory-based and online eye tracking performance. We release the experiment template, recorded data, and analysis code with the motivation to escalate affordable, accessible, and scalable eye tracking that has the potential to accelerate research in the fields of psychological science, cognitive neuroscience, user experience design, and human-computer interfaces.

A stochastic mathematical model for coupling the cytosolic and sarcoplasmic calcium movements in diseased cardiac myocytes.

Several computational studies have been undertaken to explore the Ca2+-induced Ca2+ release (CICR) events in cardiac myocytes and along with experimental studies it has given us invaluable insight into the mechanism of CICR from spark/blink initiation to termination and regulation, and their interplay under normal and pathological conditions. The computational modelling of this mechanism has mainly been investigated using coupled differential equations (DEs). However, there is a lack of computational investigation into (1) how the different formulation of coupled DEs capture the Ca2+ movement in the cytosol and sarcoplasmic reticulum (SR), (2) the buffer and dye inclusion in both compartments, and (3) the effect of buffer and dye properties on the calcium behaviour. This work is set out to explore (1) the effect of different coupled formulation of DEs on spark/blink occurrence, (2) the inclusion of improved sarcoplasmic buffering properties, and (3) the effects of cytosolic and sarcoplasmic dye and buffer properties on Ca2+ movement. The simulation results show large discrepancies between different formulations of the governing equations. Additionally, extension of the model to include sarcoplasmic buffering properties show normalised fluorescent dye profiles to be in good agreement with experimental and amongst its one- and two-dimensional representations.

Looking at remembering: Eye movements, pupil size, and autobiographical memory.

To examine the relationship between visual imagery and autobiographical memory, eye position and pupil size were recorded while participants first searched for memories and then reconstructed the retrieved memories (Experiment 1), or only searched for memories (Experiment 2). In Experiment 1, we observed that, although recollective experience was not associated with the number of fixations per minute, memories that took longer to retrieve were linked to increased pupil size. In Experiment 2, we observed that directly retrieved memories were recalled more quickly and were accompanied by smaller pupils than generatively retrieved memories. After correcting for response time, retrieval mode also produced an effect, showing that decreased pupil size is not simply due to directly retrieved memories being recalled more quickly. These findings provide compelling evidence that objective measures, such as pupil size, can be used alongside subjective measures, such as self-reports, to distinguish between directly retrieved and generatively retrieved memories.

Humans quickly learn to blink strategically in response to environmental task demands.

Eye blinking is one of the most frequent human actions. The control of blinking is thought to reflect complex interactions between maintaining clear and healthy vision and influences tied to central dopaminergic functions including cognitive states, psychological factors, and medical conditions. The most imminent consequence of blinking is a temporary loss of vision. Minimizing this loss of information is a prominent explanation for changes in blink rates and temporarily suppressed blinks, but quantifying this loss is difficult, as environmental regularities are usually complex and unknown. Here we used a controlled detection experiment with parametrically generated event statistics to investigate human blinking control. Subjects were able to learn environmental regularities and adapted their blinking behavior strategically to better detect future events. Crucially, our design enabled us to develop a computational model that allows quantifying the consequence of blinking in terms of task performance. The model formalizes ideas from active perception by describing blinking in terms of optimal control in trading off intrinsic costs for blink suppression with task-related costs for missing an event under perceptual uncertainty. Remarkably, this model not only is sufficient to reproduce key characteristics of the observed blinking behavior such as blink suppression and blink compensation but also predicts without further assumptions the well-known and diverse distributions of time intervals between blinks, for which an explanation has long been elusive.

Controlling a Mouse Pointer with a Single-Channel EEG Sensor.

(1) Goals: The purpose of this study was to analyze the feasibility of using the information obtained from a one-channel electro-encephalography (EEG) signal to control a mouse pointer. We used a low-cost headset, with one dry sensor placed at the FP1 position, to steer a mouse pointer and make selections through a combination of the user's attention level with the detection of voluntary blinks. There are two types of cursor movements: spinning and linear displacement. A sequence of blinks allows for switching between these movement types, while the attention level modulates the cursor's speed. The influence of the attention level on performance was studied. Additionally, Fitts' model and the evolution of the emotional states of participants, among other trajectory indicators, were analyzed. (2) Methods: Twenty participants distributed into two groups (Attention and No-Attention) performed three runs, on different days, in which 40 targets had to be reached and selected. Target positions and distances from the cursor's initial position were chosen, providing eight different indices of difficulty (IDs). A self-assessment manikin (SAM) test and a final survey provided information about the system's usability and the emotions of participants during the experiment. (3) Results: The performance was similar to some brain-computer interface (BCI) solutions found in the literature, with an averaged information transfer rate (ITR) of 7 bits/min. Concerning the cursor navigation, some trajectory indicators showed our proposed approach to be as good as common pointing devices, such as joysticks, trackballs, and so on. Only one of the 20 participants reported difficulty in managing the cursor and, according to the tests, most of them assessed the experience positively. Movement times and hit rates were significantly better for participants belonging to the attention group. (4) Conclusions: The proposed approach is a feasible low-cost solution to manage a mouse pointer.

A Video-Based Technique for Heart Rate and Eye Blinks Rate Estimation: A Potential Solution for Telemonitoring and Remote Healthcare.

Current telemedicine and remote healthcare applications foresee different interactions between the doctor and the patient relying on the use of commercial and medical wearable sensors and internet-based video conferencing platforms. Nevertheless, the existing applications necessarily require a contact between the patient and sensors for an objective evaluation of the patient's state. The proposed study explored an innovative video-based solution for monitoring neurophysiological parameters of potential patients and assessing their mental state. In particular, we investigated the possibility to estimate the heart rate (HR) and eye blinks rate (EBR) of participants while performing laboratory tasks by mean of facial-video analysis. The objectives of the study were focused on: (i) assessing the effectiveness of the proposed technique in estimating the HR and EBR by comparing them with laboratory sensor-based measures and (ii) assessing the capability of the video-based technique in discriminating between the participant's resting state (Nominal condition) and their active state (Non-nominal condition). The results demonstrated that the HR and EBR estimated through the facial-video technique or the laboratory equipment did not statistically differ (p > 0.1), and that these neurophysiological parameters allowed to discriminate between the Nominal and Non-nominal states (p < 0.02).

Wearable Technologies for Mental Workload, Stress, and Emotional State Assessment during Working-Like Tasks: A Comparison with Laboratory Technologies.

The capability of monitoring user's performance represents a crucial aspect to improve safety and efficiency of several human-related activities. Human errors are indeed among the major causes of work-related accidents. Assessing human factors (HFs) could prevent these accidents through specific neurophysiological signals' evaluation but laboratory sensors require highly-specialized operators and imply a certain grade of invasiveness which could negatively interfere with the worker's activity. On the contrary, consumer wearables are characterized by their ease of use and their comfortability, other than being cheaper compared to laboratory technologies. Therefore, wearable sensors could represent an ideal substitute for laboratory technologies for a real-time assessment of human performances in ecological settings. The present study aimed at assessing the reliability and capability of consumer wearable devices (i.e., Empatica E4 and Muse 2) in discriminating specific mental states compared to laboratory equipment. The electrooculographic (EOG), electrodermal activity (EDA) and photoplethysmographic (PPG) signals were acquired from a group of 17 volunteers who took part to the experimental protocol in which different working scenarios were simulated to induce different levels of mental workload, stress, and emotional state. The results demonstrated that the parameters computed by the consumer wearable and laboratory sensors were positively and significantly correlated and exhibited the same evidences in terms of mental states discrimination.

A songbird inhibits blinking behaviour in flight.

Visual attention plays a fundamental role in avian flight but attention is likely limited whenever birds blink. Because blinks are necessary to maintaining proper vision, this study tested the hypothesis that birds strategically inhibit their blinks in flight. The blinks of captive great-tailed grackles (Quiscalus mexicanus) were recorded before, during and after they flew a short distance in an open environment. The grackles spent the least amount of time blinking in flight (take-off, during flight and landing) and the most amount of time blinking at impact. Their blinking behaviour was similar before and after flight. These results suggest that grackles strategically inhibit their blinking behaviour in flight, potentially because blinks impose costs to avian flight.

Assessing the validity of eyelid parameters to detect impairment due to benzodiazepines.

OBJECTIVE: Benzodiazepines impair driving ability and psychomotor function. Eyelid parameters accurately reflect drowsiness; however, the effects of benzodiazepines on these measures have not been extensively studied. The aim of this study was to investigate the effect of benzodiazepines on eyelid parameters and evaluate their accuracy for detecting psychomotor impairment. METHODS: Eyelid parameters were recorded during a psychomotor vigilance task (PVT) and driving simulation over 2 days, baseline, and after 20-mg oral temazepam. The utility of eyelid parameters for detecting PVT lapses was evaluated using receiver operating characteristic curves, and cut-off levels indicating impairment (≥1 and ≥2 PVT lapses per min) were identified. The accuracy of these cut-off levels for detecting driving simulator crashes was then examined. RESULTS: PVT and driving simulator performance was significantly impaired following benzodiazepine administration (p < .05). Average eyelid closure duration (inter-event duration) was a reliable indicator of PVT lapses (area under the curve [AUC] of 0.87-0.90). The cut-off value of eyelid closure duration derived from PVT AUC was able to predict driving simulator crashes with moderately high sensitivity and specificity (76.23% and 75.00%). CONCLUSIONS: Eyelid parameters were affected by benzodiazepines and accurately detected the psychomotor impairment. In particular, eyelid closure duration is a promising real-time indicator of benzodiazepine impairment.

Oculomotor inhibition reflects temporal expectations.

The accurate extraction of signals out of noisy environments is a major challenge of the perceptual system. Forming temporal expectations and continuously matching them with perceptual input can facilitate this process. In humans, temporal expectations are typically assessed using behavioral measures, which provide only retrospective but no real-time estimates during target anticipation, or by using electrophysiological measures, which require extensive preprocessing and are difficult to interpret. Here we show a new correlate of temporal expectations based on oculomotor behavior. Observers performed an orientation-discrimination task on a central grating target, while their gaze position and EEG were monitored. In each trial, a cue preceded the target by a varying interval ("foreperiod"). In separate blocks, the cue was either predictive or non-predictive regarding the timing of the target. Results showed that saccades and blinks were inhibited more prior to an anticipated regular target than a less-anticipated irregular one. This consistent oculomotor inhibition effect enabled a trial-by-trial classification according to interval-regularity. Additionally, in the regular condition the slope of saccade-rate and drift were shallower for longer than shorter foreperiods, indicating their adjustment according to temporal expectations. Comparing the sensitivity of this oculomotor marker with those of other common predictability markers (e.g. alpha-suppression) showed that it is a sensitive marker for cue-related anticipation. In contrast, temporal changes in conditional probabilities (hazard-rate) modulated alpha-suppression more than cue-related anticipation. We conclude that pre-target oculomotor inhibition is a correlate of temporal predictions induced by cue-target associations, whereas alpha-suppression is more sensitive to conditional probabilities across time.

Where Does Time Go When You Blink?

Retinal input is frequently lost because of eye blinks, yet humans rarely notice these gaps in visual input. Although previous studies focused on the perceptual and neural correlates of diminished awareness to blinks, the impact of these correlates on the perceived time of concurrent events is unknown. Here, we investigated whether the subjective sense of time is altered by spontaneous blinks. We found that participants (N = 22) significantly underestimated the duration of a visual stimulus when a spontaneous blink occurred during stimulus presentation and that this underestimation was correlated with the blink duration of individual participants. Importantly, the effect was not present when durations of an auditory stimulus were judged (N = 23). The results point to a link between spontaneous blinks, previously demonstrated to induce activity suppression in the visual cortex, and a compression of subjective time. They suggest that ongoing encoding within modality-specific sensory cortices, independent of conscious awareness, informs the subjective sense of time.

Ocular signatures of proactive versus reactive cognitive control in young adults.

During the execution of a cognitive task, the brain maintains contextual information to guide behavior and achieve desired goals. The AX-Continuous Performance Task is used to study proactive versus reactive cognitive control. Young adults tend to behave proactively in standard testing conditions. However, it remains unclear how interindividual variability (e.g., in cognitive and motivational factors) may drive people into more reactive or proactive control under the same task demands. We investigated the use of control strategies in a large population of healthy young adults. We computed the proactive behavioral index and consequently divided participants into proactive, reactive, and intermediate groups. We found that reactive participants were generally slower, presented lower context sensitivity, and larger response variability. Pupillary changes and blink rate index cognitive effort allocation. We measured, concomitantly to the task, the pupil size and frequency of blinks associated with the cue maintenance and response intervals. During the cue period, nonfrequent, nontarget cues led to increased pupil dilation and number of blinks in all participants. During the response interval, we found more errors and increased pupil dilation to the probe when all participants had to overcome a response bias generated by the frequent cue. Only reactive participants showed larger response-related pupil when they had to overcome a response bias related to the frequent probe. Contrary to expectations, groups did not differ in ocular measures in the cue period. In conclusion, interindividual differences in cognitive control between healthy adults can be mapped onto different patterns of effort allocation indexed by the pupil.

Blink rate and blink timing in children with ADHD and the influence of stimulant medication.

Spontaneous eye blink rate is modulated by task demands and internal state, and is demonstrated to reflect central dopamine activity. Also, spontaneous eye blinks are strategically timed around salient stimuli. This study investigates whether children with attention deficit hyperactivity disorder (ADHD) show reduced blink rates, blink modulation and blink timing, and whether this is influenced by stimulant medication. The electrooculogram was measured in 18 typically developing children, 16 children with ADHD off methylphenidate (Mph), and 16 children with ADHD on Mph during a rest period and during performance of a 60-min visual selective attention task. Blink rate and timing was extracted from the electrooculogram. No evidence was found for aberrant blink rate or blink modulation in children with ADHD off Mph. All groups increased blink rates from rest to task, and no group differences were found in blink rate during rest and task, or in the modulation of blink rate from rest to task. Time-on task resulted in a similar increase in blink rates in all three groups. Stimulant medication appeared not to influence blink rate and blink modulation, except that in the ADHD off Mph group the blink rate was enhanced only under conditions with performance feedback. All groups inhibited blinks before stimulus presentation and strategically timed their blinks after the stimulus. Children with ADHD off Mph showed reduced blink inhibition before the stimulus; however, given the low incidence (<1 % of the trials) and long latency this is not likely to impair their visual intake.

Genetically Identified Suppressed-by-Contrast Retinal Ganglion Cells Reliably Signal Self-Generated Visual Stimuli.

Spike trains of retinal ganglion cells (RGCs) are the sole source of visual information to the brain; and understanding how the ∼20 RGC types in mammalian retinae respond to diverse visual features and events is fundamental to understanding vision. Suppressed-by-contrast (SbC) RGCs stand apart from all other RGC types in that they reduce rather than increase firing rates in response to light increments (ON) and decrements (OFF). Here, we genetically identify and morphologically characterize SbC-RGCs in mice, and target them for patch-clamp recordings under two-photon guidance. We find that strong ON inhibition (glycine > GABA) outweighs weak ON excitation, and that inhibition (glycine > GABA) coincides with decreases in excitation at light OFF. These input patterns explain the suppressive spike responses of SbC-RGCs, which are observed in dim and bright light conditions. Inhibition to SbC-RGC is driven by rectified receptive field subunits, leading us to hypothesize that SbC-RGCs could signal pattern-independent changes in the retinal image. Indeed, we find that shifts of random textures matching saccade-like eye movements in mice elicit robust inhibitory inputs and suppress spiking of SbC-RGCs over a wide range of texture contrasts and spatial frequencies. Similarly, stimuli based on kinematic analyses of mouse blinking consistently suppress SbC-RGC spiking. Receiver operating characteristics show that SbC-RGCs are reliable indicators of self-generated visual stimuli that may contribute to central processing of blinks and saccades. SIGNIFICANCE STATEMENT: This study genetically identifies and morphologically characterizes suppressed-by-contrast retinal ganglion cells (SbC-RGCs) in mice. Targeted patch-clamp recordings from SbC-RGCs under two-photon guidance elucidate the synaptic mechanisms mediating spike suppression to contrast steps, and reveal that SbC-RGCs respond reliably to stimuli mimicking saccade-like eye movements and blinks. The similarity of responses to saccade-like eye movements and blinks suggests that SbC-RGCs may provide a unified signal for self-generated visual stimuli.

The effect of eye movements and blinks on afterimage appearance and duration.

The question of whether eye movements influence afterimage perception has been asked since the 18th century, and yet there is surprisingly little consensus on how robust these effects are and why they occur. The number of historical theories aiming to explain the effects are more numerous than clear experimental demonstrations of such effects. We provide a clearer characterization of when eye movements and blinks do or do not affect afterimages with the aim to distinguish between historical theories and integrate them with a modern understanding of perception. We found neither saccades nor pursuit reduced strong afterimage duration, and blinks actually increased afterimage duration when tested in the light. However, for weak afterimages, we found saccades reduced duration, and blinks and pursuit eye movements did not. One interpretation of these results is that saccades diminish afterimage perception because they cause the afterimage to move unlike a real object. Furthermore, because saccades affect weak afterimages but not strong ones, we suggest that their effect is modulated by the ambiguity of the afterimage signal.

Sleep-related eye symptoms and their potential for identifying driver sleepiness.

The majority of individuals appear to have insight into their own sleepiness, but there is some evidence that this does not hold true for all, for example treated patients with obstructive sleep apnoea. Identification of sleep-related symptoms may help drivers determine their sleepiness, eye symptoms in particular show promise. Sixteen participants completed four motorway drives on two separate occasions. Drives were completed during daytime and night-time in both a driving simulator and on the real road. Ten eye symptoms were rated at the end of each drive, and compared with driving performance and subjective and objective sleep metrics recorded during driving. 'Eye strain', 'difficulty focusing', 'heavy eyelids' and 'difficulty keeping the eyes open' were identified as the four key sleep-related eye symptoms. Drives resulting in these eye symptoms were more likely to have high subjective sleepiness and more line crossings than drives where similar eye discomfort was not reported. Furthermore, drivers having unintentional line crossings were likely to have 'heavy eyelids' and 'difficulty keeping the eyes open'. Results suggest that drivers struggling to identify sleepiness could be assisted with the advice 'stop driving if you feel sleepy and/or have heavy eyelids or difficulty keeping your eyes open'.

Short-term memory across eye blinks.

The effect of eye blinks on short-term memory was examined in two experiments. On each trial, participants viewed an initial display of coloured, oriented lines, then after a retention interval they viewed a test display that was either identical or different by one feature. Participants kept their eyes open throughout the retention interval on some blocks of trials, whereas on others they made a single eye blink. Accuracy was measured as a function of the number of items in the display to determine the capacity of short-term memory on blink and no-blink trials. In separate blocks of trials participants were instructed to remember colour only, orientation only, or both colour and orientation. Eye blinks reduced short-term memory capacity by approximately 0.6-0.8 items for both feature and conjunction stimuli. A third, control, experiment showed that a button press during the retention interval had no effect on short-term memory capacity, indicating that the effect of an eye blink was not due to general motoric dual-task interference. Eye blinks might instead reduce short-term memory capacity by interfering with attention-based rehearsal processes.

Blink-related arousal network surges are shaped by cortical vigilance states.

The vigilance state and the excitability of cortical networks impose wide-range effects on brain dynamics that arousal surges could promptly modify. We previously reported an association between spontaneous eye-blinks and BOLD activation in the brain arousal ascending network (AAN) and in thalamic nuclei based on 3T MR resting state brain images. Here we aimed to replicate our analyses using 7T MR images in a larger cohort of participants collected from the Human Connectome Project (HCP), which also contained simultaneous eye-tracking recordings, and to assess the interaction between the blink-associated arousal surges and the vigilance states. For this purpose, we compared blink associated BOLD activity under a vigilant versus a drowsy state, a classification made based on the pupillary data obtained during the fMRI scans. We conducted two main analyses: i) Cross-correlation analysis between the BOLD signal and blink events (eye blink time-series were convolved with the canonical and also with the temporal derivative of the Hemodynamic Response Function, HRF) within preselected regions of interests (ROIs) (i.e., brainstem AAN, thalamic and cerebellar nuclei) together with an exploratory voxel-wise analyses to assess the whole-brain, and ii) blink-event analysis of the BOLD signals to reveal the signal changes onset to the blinks in the preselected ROIs. Consistent with our prior findings on 3T MRI, we showed significant positive cross correlations between BOLD peaks in brainstem and thalamic nuclei that preceded or were overlapping with blink moments and that sharply decreased post-blink. Whole brain analysis revealed blink-related activation that was strongest in cerebellum, insula, lateral geniculate nucleus (LGN) and visual cortex. Drowsiness impacted HRF BOLD (enhancing it), time-to-peak (delaying it) and post-blink BOLD activity (accentuating decreases). Responses in the drowsy state could be related to the differences in the excitability of cortical, subcortical and cerebellar tissue, such that cerebellar and thalamic regions involved in visual attention processing were more responsive for the vigilant state, but AAN ROIs, as well as cerebellar and thalamic ROIs connected to pre-motor, frontal, temporal and DMN regions were less responsive. Such qualitative and quantitative differences in the blink related BOLD signal changes could reflect delayed cortical processing and the ineffectiveness of arousal surges during states of drowsiness. Future studies that manipulate arousal are needed to corroborate a mechanistic interaction of arousal surges with vigilance states and cortical excitability.

Insights from Eye Blinks into the Cognitive Processes Involved in Visual Word Recognition.

Behavioral differences in speed and accuracy between reading familiar and unfamiliar words are well-established in the empirical literature. However, these standard measures of skill proficiency are limited in their ability to capture the moment-to-moment processing involved in visual word recognition. In the present study, the effect of word familiarity was initially investigated using an eye blink rate among adults and children. The probability of eye blinking was higher for familiar (real) words than for unfamiliar (pseudo)words. This counterintuitive pattern of results suggests that the processing of unfamiliar (pseudo)words is more demanding and perhaps less rewarding than the processing of familiar (real) words, as previously observed in both behavioral and pupillometry data. Our findings suggest that the measurement of eye blinks might shed new light on the cognitive processes involved in visual word recognition and other domains of human cognition.