Estimation of Subjectively Reported Trust, Mental Workload, and Situation Awareness Using Unobtrusive Measures.

OBJECTIVE: We use a set of unobtrusive measures to estimate subjectively reported trust, mental workload, and situation awareness (henceforth "TWSA"). BACKGROUND: Subjective questionnaires are commonly used to assess human cognitive states. However, they are obtrusive and usually impractical to administer during operations. Measures derived from actions operators take while working (which we call "embedded measures") have been proposed as an unobtrusive way to obtain TWSA estimates. Embedded measures have not been systematically investigated for each of TWSA, which prevents their operational utility. METHODS: Fifteen participants completed twelve trials of spaceflight-relevant tasks while using a simulated autonomous system. Embedded measures of TWSA were obtained during each trial and participants completed TWSA questionnaires after each trial. Statistical models incorporating our embedded measures were fit with various formulations, interaction effects, and levels of personalization to understand their benefits and improve model accuracy. RESULTS: The stepwise algorithm for building statistical models usually included embedded measures, which frequently corresponded to an intuitive increase or decrease in reported TWSA. Embedded measures alone could not accurately capture an operator's cognitive state, but combining the measures with readily observable task information or information about participants' backgrounds enabled the models to achieve good descriptive fit and accurate prediction of TWSA. CONCLUSION: Statistical models leveraging embedded measures of TWSA can be used to accurately estimate responses on subjective questionnaires that measure TWSA. APPLICATION: Our systematic approach to investigating embedded measures and fitting models allows for cognitive state estimation without disrupting tasks when administering questionnaires would be impractical.

Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions.

OBJECTIVE: Our primary aim was to investigate crew performance during medical emergencies with and without ground-support from a flight surgeon located at mission control. BACKGROUND: There are gaps in knowledge regarding the potential for unanticipated in-flight medical events to affect crew health and capacity, and potentially compromise mission success. Additionally, ground support may be impaired or periodically absent during long duration missions. METHOD: We reviewed video recordings of 16 three-person flight crews each managing four unique medical events in a fully immersive spacecraft simulator. Crews were randomized to two conditions: with and without telemedical flight surgeon (FS) support. We assessed differences in technical performance, behavioral skills, and cognitive load between groups. RESULTS: Crews with FS support performed better clinically, were rated higher on technical skills, and completed more clinical tasks from the medical checklists than crews without FS support. Crews with FS support also had better behavioral/non-technical skills (information exchange) and reported significantly lower cognitive demand during the medical event scenarios on the NASA-TLX scale, particularly in mental demand and temporal demand. There was no significant difference between groups in time to treat or in objective measures of cognitive demand derived from heart rate variability and electroencephalography. CONCLUSION: Medical checklists are necessary but not sufficient to support high levels of autonomous crew performance in the absence of real-time flight surgeon support. APPLICATION: Potential applications of this research include developing ground-based and in-flight training countermeasures; informing policy regarding autonomous spaceflight, and design of autonomous clinical decision support systems.

Responding to an Unexpected In-Flight Event: Physiological Arousal, Information Processing, and Performance.

OBJECTIVE: The study was designed to investigate whether a simulated unexpected abnormal flight event can lead to startle and explore differences in behavioral responses between expected and unexpected abnormal flight events. BACKGROUND: Recent research suggests startle (an autonomic response to an acute stimulus) following unexpected abnormal flight events can impact pilot performance and can increase the probability of a negative outcome following the event. METHOD: Information processing, physiological measures, and performance differences between responses to expected and unexpected flight events were compared. General aviation (GA) pilots flew a series of flights in a fixed-base flight simulator including two experimental flights which included an unexpected and an expected, engine failure. During the flights, heart rate, eye tracking, and flight data were recorded. RESULTS: During the unexpected engine failure, pilots showed greater increases in heart rate and pupil dilation. Significant differences in scanning were evident with fewer areas scanned following the unexpected event. During the unexpected engine failure, performance was impaired when compared to the expected events. However, poor performance was not associated with higher levels of arousal. CONCLUSION: The study provides an empirical demonstration of impaired pilot response to unexpected events with associated symptoms consistent with the induction of startle. The present research builds on Landman et al.'s conceptual model of startle and surprise. APPLICATION: Standardized training protocols may not adequately prepare pilots to deal with the unexpected effects of startle in real-world encounters. Introducing greater variety into training events may be useful. The effects of startle in disrupting well-trained responses may also occur in areas other than aviation where critical events may occur unexpectedly or present in an unfamiliar manner.

Effects of Intensive Crew Training on Individual and Collective Characteristics of Oar Movement in Rowing as a Coxless Pair.

This case study examined how two rowers adapted their rowing patterns following crew training as a newly formed coxless pair. The two participants were expert (double-oar) single scull-boat rowers. Performing as a crew in the coxless-pair's sweep-boat, where each rower operates a single oar, on-the-water data were collected before and after a 6-week intensive team-training program. Rowing patterns were characterized by the horizontal oar angle, oar angular velocity and linear oar-water velocity profiles during the catch (minimal oar angle) to finish (maximal oar angle) half-cycles of the propulsive water phase. After crew training, rowers demonstrated a tighter synchronization and a closer correspondence in oar angle at the moment of catch, together with a closer matching of the evolution over time of their subsequent oar movements. Most likely due to the inherent asymmetries involved in sweep-boat rowing, the stroke rower also developed a somewhat longer-duration larger-amplitude oar movement than the bow rower. Remarkably, both rowers revealed changes in the inter-cycle variability of their individual patterns of rowing. While the initially more variable stroke rower improved the consistency of his rowing pattern over practice, the initially highly consistent bow rower on the contrary relaxed his tendency to always perform in the same way. We discuss how the crew performance changed over training and to what extent it was associated with changes in individual behaviors. Along the way we demonstrate that the often-used measure of average continuous relative phase does not adequately capture the particularities of the coordination pattern observed. Overall, the results obtained at the individual level of analysis suggest that team benefits were obtained through distinct adaptations of the rowers' individual rowing patterns.