Fatigue Assessment from Facial Videos using Deep Neural Networks and Engineered Features Informed by Domain Knowledge.

Fatigue impairs cognitive and motor function, potentially leading to mishaps in high-pressure occupations such as aviation and emergency medical services. The current approach is primarily based on self-assessment, which is subjective and error-prone. An objective method is needed to detect severe and likely dangerous levels of fatigue quickly and accurately. Here, we present a quantitative evaluation tool that uses less than two minutes of facial video, captured using an iPad, to assess fatigue vs. alertness. The tool is fast, easy to use, and scalable since it uses cameras readily available on consumer-electronic devices. We compared the classification performance between a Long Short-Term Memory (LSTM) deep neural network and a Random Forest (RF) classifier applied to engineered features informed by domain knowledge. The preliminary results on an 11-subject dataset show that RF outperforms LSTM, with added interpretability on the features used. For the RF classifiers, the average areas under the receiver operating characteristic curve, based on the 11-fold and individualized 11-fold cross validations, are 0.72 ± 0.16 and 0.8 ± 0.12, respectively. Equal error rates are 0.34 and 0.26, respectively. This study presents a promising approach for rapid fatigue detection. Additional data will be collected to assess the generalizability across populations.

A multidimensional approach to pain assessment in critically ill infants during a painful procedure.

OBJECTIVES: Inferring the pain level of a critically ill infant is complex. The ability to accurately extract the appropriate pain cues from observations is often jeopardized when heavy sedation and muscular blocking agents are administered. Near-infrared spectroscopy is a noninvasive method that may provide the bridge between behavioral observational indicators and cortical pain processing. We aimed to describe regional cerebral and systemic hemodynamic changes, as well as behavioral reactions in critically ill infants with congenital heart defects during chest-drain removal after cardiac surgery. METHODS: Our sample included 20 critically ill infants with congenital heart defects, less than 12 months of age, admitted to the cardiac intensive care unit after surgery. RESULTS: Cerebral deoxygenated hemoglobin concentrations significantly differed across the epochs (i.e., baseline, tactile stimulus, noxious stimulus) (P=0.01). Physiological systemic responses and Face Leg Activity Cry Consolability (FLACC) pain scores differed significantly across the events (P<0.01). The 3 outcome measures were not found to be associated with each other. Mean FLACC pain scores during the painful procedure was 7/10 despite administration of morphine. Midazolam administration accounted for 36% of the variance in pain scores. DISCUSSION: We demonstrated with a multidimensional pain assessment approach that significant cerebral, physiological, and behavioral activity was present in response to a noxious procedure in critically ill infants despite the administration of analgesic treatment. Considering that the sedating agent significantly dampened pain behaviors, assessment of cerebral hemodynamic in the context of pain seems to be an important addition.