Automated Video Debriefing Using Computer Vision Techniques.

INTRODUCTION: Within any training event, debriefing is a vital component that highlights areas of proficiency and deficiency, enables reflection, and ultimately provides opportunity for remediation. Video-based debriefing is desirable to capture performance and replay events, but the reality is rife with challenges, principally lengthy video and occlusions that block line of sight from camera equipment to participants. METHODS: To address this issue, researchers automated the editing of a video debrief, using a system of person-worn cameras and computer vision techniques. The cameras record a simulation event, and the video is processed using computer vision. Researchers investigated a variety of computer vision techniques, ultimately focusing on the scale invariant feature transform detection method and a convolutional neural network. The system was trained to detect and tag medically relevant segments of video and assess a single exemplar medical intervention, in this case the application of a tourniquet. RESULTS: The system tagged medically relevant video segments with 92% recall and 66% precision, resulting in an F1 (harmonic mean of precision and recall) of 72% (N = 23). The exemplar medical intervention was successfully assessed in 39.5% of videos (N = 39). CONCLUSION: The system showed suitable accuracy tagging medically relevant video segments, but requires additional research to improve medical intervention assessment accuracy. Computer vision has the potential to automate video debrief creation to augment existing debriefing strategies.

Use of Computer Vision Tools to Identify Behavioral Markers of Pediatric Obsessive-Compulsive Disorder: A Pilot Study.

OBJECTIVES: The clinical presentation of pediatric obsessive-compulsive disorder (OCD) is heterogeneous, which is a stumbling block to understanding pathophysiology and to developing new treatments. A major shift in psychiatry, embodied in the Research Domain Criteria (RDoC) initiative of National Institute of Mental Health, recognizes the pitfalls of categorizing mental illnesses using diagnostic criteria. Instead, RDoC encourages researchers to use a dimensional approach, focusing on narrower domains of psychopathology to characterize brain-behavior relationships. Our aim in this multidisciplinary pilot study was to use computer vision tools to record OCD behaviors and to cross-validate these behavioral markers with standard clinical measures. METHODS: Eighteen youths with OCD and 21 healthy controls completed tasks in an innovation laboratory (free arrangement of objects, hand washing, arrangement of objects on contrasting carpets). Tasks were video-recorded. Videos were coded by blind raters for OCD-related behaviors. Children's Yale-Brown Obsessive Compulsive Scale (CY-BOCS) and other scales were administered. We compared video-recorded measures of behavior in OCD versus healthy controls and correlated video measures and clinical measures of OCD. RESULTS: Behavioral measures on the videos were significantly correlated with specific CY-BOCS dimension scores. During the free arrangement task, more time spent ordering objects and more moves of objects were both significantly associated with higher CY-BOCS ordering/repeating dimension scores. Longer duration of hand washing was significantly correlated with higher scores on CY-BOCS ordering/repeating and forbidden thoughts dimensions. During arrangement of objects on contrasting carpets, more moves and more adjustment of objects were significantly associated with higher CY-BOCS ordering/repeating dimension scores. CONCLUSION: Preliminary data suggest that measurement of behavior using video recording is a valid approach for quantifying OCD psychopathology. This methodology could serve as a new tool for investigating OCD using an RDoC approach. This objective, novel behavioral measurement technique may benefit both researchers and clinicians in assessing pediatric OCD and in identifying new behavioral markers of OCD. Clinical Trial Registry: Development of an Instrument That Monitors Behaviors Associated With OCD. NCT02866422. http://clinicaltrials.gov.