Toward the Use of Pupillary Responses for Pilot Selection.

OBJECTIVE: For selection practitioners, it seems important to assess the level of mental resources invested in order to perform a demanding task. In this study, we investigated the potential of pupil size measurement to discriminate the most proficient pilot students from the less proficient. BACKGROUND: Cognitive workload is known to influence learning outcome. More specifically, cognitive difficulties observed during pilot training are often related to a lack of efficient mental workload management. METHOD: Twenty pilot students performed a laboratory multitasking scenario, composed of several stages with increasing workload, while their pupil size was recorded. Two levels of pilot students were compared according to the outcome after 2 years of training: high success and medium success. RESULTS: Our findings suggested that task-evoked pupil size measurements could be a promising predictor of flight training difficulties during the 2-year training. Indeed, high-level pilot students showed greater pupil size changes from low-load to high-load stages of the multitasking scenario than medium-level pilot students. Moreover, average pupil diameters at the low-load stage were smallest for the high-level pilot students. CONCLUSION: Following the neural efficiency hypothesis framework, the most proficient pilot students supposedly used their mental resources more efficiently than the least proficient while performing the multitasking scenario. APPLICATION: These findings might introduce a new way of managing selection processes complemented with ocular measurements. More specifically, pupil size measurement could enable identification of applicants with greater chances of success during pilot training.

Differences in Multitask Resource Reallocation After Change in Task Values.

OBJECTIVE: The objective was to characterize multitask resource reallocation strategies when managing subtasks with various assigned values. BACKGROUND: When solving a resource conflict in multitasking, Salvucci and Taatgen predict a globally rational strategy will be followed that favors the most urgent subtask and optimizes global performance. However, Katidioti and Taatgen identified a locally rational strategy that optimizes only a subcomponent of the whole task, leading to detrimental consequences on global performance. Moreover, the question remains open whether expertise would have an impact on the choice of the strategy. METHOD: We adopted a multitask environment used for pilot selection with a change in emphasis on two out of four subtasks while all subtasks had to be maintained over a minimum performance. A laboratory eye-tracking study contrasted 20 recently selected pilot students considered as experienced with this task and 15 university students considered as novices. RESULTS: When two subtasks were emphasized, novices focused their resources particularly on one high-value subtask and failed to prevent both low-value subtasks falling below minimum performance. On the contrary, experienced people delayed the processing of one low-value subtask but managed to optimize global performance. CONCLUSION: In a multitasking environment where some subtasks are emphasized, novices follow a locally rational strategy whereas experienced participants follow a globally rational strategy. APPLICATION: During complex training, trainees are only able to adjust their resource allocation strategy to subtask emphasis changes once they are familiar with the multitasking environment.

Mental strategies and resting state EEG: Effect on high alpha amplitude modulation by neurofeedback in healthy young adults.

Neurofeedback (NFB) is a brain-computer interface which allows individuals to modulate their brain activity. Despite the self-regulatory nature of NFB, the effectiveness of strategies used during NFB training has been little investigated. In a single session of NFB training (6*3 min training blocks) with healthy young participants, we experimentally tested if providing a list of mental strategies (list group, N = 46), compared with a group receiving no strategies (no list group, N = 39), affected participants' neuromodulation ability of high alpha (10-12 Hz) amplitude. We additionally asked participants to verbally report the mental strategies used to enhance high alpha amplitude. The verbatim was then classified in pre-established categories in order to examine the effect of type of mental strategy on high alpha amplitude. First, we found that giving a list to the participants did not promote the ability to neuromodulate high alpha activity. However, our analysis of the specific strategies reported by learners during training blocks revealed that cognitive effort and recalling memories were associated with higher high alpha amplitude. Furthermore, the resting amplitude of trained high alpha frequency predicted an amplitude increase during training, a factor that may optimize inclusion in NFB protocols. The present results also corroborate the interrelation with other frequency bands during NFB training. Although these findings are based on a single NFB session, our study represents a further step towards developing effective protocols for high alpha neuromodulation by NFB.

EEG power spectral measures of cognitive workload: A meta-analysis.

Cognitive workload (CWL) is a fundamental concept in the assessment and monitoring of human performance during cognitive tasks. Numerous studies have attempted to objectively and continuously measure the CWL using neuroimaging techniques. Although the electroencephalogram (EEG) is a widely used technique, the impact of CWL on the spectral power of brain frequencies has shown inconsistent results. The present review aimed to synthesize the results of the literature and quantitatively assess which brain frequency is the most sensitive to CWL. A systematic literature search following PRISMA recommendations highlighted three main frequency bands used to measure CWL: theta (4-8 Hz), alpha (8-12 Hz), and beta (12-30 Hz). Three meta-analyses were conducted to quantitatively examine the effect of CWL on these frequencies. A total of 45 effect sizes from 24 studies involving 723 participants were computed. CWL was associated with significant effects on theta (g = 0.68, CI [0.41, 0.95]), alpha (g = -0.25, CI [-0.45, 0.04]), and beta (g = 0.50, CI [0.21, 0.79]) power. Our results suggests that theta, especially the frontal theta, is the best index of CWL. Alpha and beta power were also significantly impacted by CWL; however, their association seemed less straightforward. These results are critically analyzed considering the literature on cerebral oscillations. We conclude by emphasizing the need to investigate the interaction between CWL and other factors that may influence spectral power (e.g., emotional load), and to combine this measure with other methods of analysis of the central and peripheral nervous system (e.g., functional connectivity, heart rate).

Does hostile intent cause physiological changes? An airport security check simulation experiment.

The present research was aimed at investigating in a simulation experiment whether the initiation of a hostile project in an environment akin to airport security checkpoints would translate in variation of cardiac activity. Twenty-three participants (eight women) enrolled as mock passengers had to make several traverses of a security checkpoint while carrying luggage containing either a neutral or a falsely dangerous item. The traverses with the falsely dangerous item were associated with an elevation of heart rate and higher drops of heart rate variability than the traverses with the neutral item. These effects were more salient for the first traverses. Implication of results for security management and the role of arousal and mental workload in threat detection are discussed.

Global difficulty modulates the prioritization strategy in multitasking situations.

There has been a considerable amount of research to conceptualize how cognition handle multitasking situations. Despite these efforts, it is still not clear how task parameters shape attentionnal resources allocation. For instance, many research have suggested that difficulty levels could explain these conflicting observations and very few have considered other factors such as task importance. In the present study, twenty participants had to carry out two N-Back tasks simultaneously, each subtask having distinct difficulty (0,1 or 2-Back) and importance (1 or 3 points) levels. Participants's cumulative dwell time were collected to assess their attentional strategies. Results showed that depending on the global level of difficulty (combination of the two levels of difficulty), attentional resources of people were driven either by the subtask difficulty (under low-global-difficulty) or the subtask importance (under high-global-difficulty), in a non-compensatory way. We discussed these results in terms of decision-making heuristics and metacognition.

Learning flight procedures by enacting and receiving feedback.

Learning flight procedures is part of any pilot training. The conventional learning method consists in learning and practicing the procedure written on a sheet of paper along with printed images of the cockpit. The purpose of the present paper was to test the efficiency of a tactile interactive multimedia training tool designed to foster the self-regulated learning of flight procedures, especially through enacting relevant gestures and providing feedback. Results showed that learning with this tool did not lead to significant shorter learning times than with the conventional learning. However, on a delayed retention test in a real A320 cockpit simulator, learners of the experimental group performed the procedure more rapidly than those of the control group. Results suggested that a training tool that incites learners to perform similar gestures than those in the real environment and that provides feedback, helped learners to transform declarative into procedural knowledge.

Using theta and alpha band power to assess cognitive workload in multitasking environments.

Cognitive workload is of central importance in the fields of human factors and ergonomics. A reliable measurement of cognitive workload could allow for improvements in human machine interface designs and increase safety in several domains. At present, numerous studies have used electroencephalography (EEG) to assess cognitive workload, reporting the rise in cognitive workload to be associated with increases in theta band power and decreases in alpha band power. However, results have been inconsistent with some failing to reach the required level of significance. We hypothesized that the lack of consistency could be related to individual differences in task performance and/or to the small sample sizes in most EEG studies. In the present study we used EEG to assess the increase in cognitive workload occurring in a multitasking environment while taking into account differences in performance. Twenty participants completed a task commonly used in airline pilot recruitment, which included an increasing number of concurrent sub-tasks to be processed from one to four. Subjective ratings, performances scores, pupil size and EEG signals were recorded. Results showed that increases in EEG alpha and theta band power reflected increases in the involvement of cognitive resources for the completion of one to three subtasks in a multitasking environment. These values reached a ceiling when performances dropped. Consistent differences in levels of alpha and theta band power were associated to levels of task performance: highest performance was related to lowest band power.

Author Correction: Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS.

A correction to this article has been published and is linked from the HTML and PDF versions of this paper. The error has not been fixed in the paper.

Cardiovascular correlates of emotional state, cognitive workload and time-on-task effect during a realistic flight simulation.

In aviation, emotion and cognitive workload can considerably increase the probability of human error. An accurate online physiological monitoring of pilot's mental state could prevent accidents. The heart rate (HR) and heart rate variability (HRV) of 21 private pilots were analysed during two realistic flight simulator scenarios. Emotion was manipulated by a social stressor and cognitive workload with the difficulty of a secondary task. Our results confirmed the sensitivity of the HR to cognitive demand and training effects, with increased HR when the task was more difficult and decreased HR with training (time-on-task). Training was also associated with an increased HRV, with increased values along the flight scenario time course. Finally, the social stressor seemed to provoke an emotional reaction that enhanced motivation and performance on the secondary task. However, this was not reflected by the cardiovascular activity.

Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS.

An improved understanding of how the brain allocates mental resources as a function of task difficulty is critical for enhancing human performance. Functional near infrared spectroscopy (fNIRS) is a field-deployable optical brain monitoring technology that provides a direct measure of cerebral blood flow in response to cognitive activity. We found that fNIRS was sensitive to variations in task difficulty in both real-life (flight simulator) and laboratory settings (tests measuring executive functions), showing increased concentration of oxygenated hemoglobin (HbO2) and decreased concentration of deoxygenated hemoglobin (HHb) in the prefrontal cortex as the tasks became more complex. Intensity of prefrontal activation (HbO2 concentration) was not clearly correlated to task performance. Rather, activation intensity shed insight on the level of mental effort, i.e., how hard an individual was working to accomplish a task. When combined with performance, fNIRS provided an estimate of the participants' neural efficiency, and this efficiency was consistent across levels of difficulty of the same task. Overall, our data support the suitability of fNIRS to assess the mental effort related to human operations and represents a promising tool for the measurement of neural efficiency in other contexts such as training programs or the clinical setting.