Evaluation of a decision support system using Bayesian network modeling in an applied Multi-INT surveillance environment.

Sensemaking and decision-making are fundamental components of applied Intelligence, Surveillance, and Reconnaissance (ISR). Analysts acquire information from multiple sources over a period of hours, days, or even over the scale of months or years, that must be interpreted and integrated to predict future adversarial events. Sensemaking is essential for developing an appropriate mental model that will lead to accurate predictions sooner. Decision Support Systems (DSS) are one proposed solution to improve analyst decision-making outcomes by leveraging computers to conduct calculations that may be difficult for human operators and provide recommendations. In this study, we tested two simulated DSS that were informed by a Bayesian Network Model as a potential prediction-assistive tool. Participants completed a simulated multi-day, multi-source intelligence task and were asked to make predictions regarding five potential outcomes on each day. Participants in both DSS conditions were able to converge on the correct solution significantly faster than the control group, and between 36-44% more of the sample was able to reach the correct conclusion. Furthermore, we found that a DSS representing projected outcome probabilities as numerical, rather than using verbal ordinal labels, were better able to differentiate which outcomes were extremely unlikely than the control group or verbal-probability DSS.

Evaluation of Simulated Recognition Aids for Human Sensemaking in Applied Surveillance Scenarios.

OBJECTIVE: We determined whether the human capability for sensemaking, or for identifying essential elements of information (EEIs), could be enhanced by a simulated recognition aid that directed attention to people and vehicles in scenes or by a simulated recognition aid that directed attention to EEIs. BACKGROUND: For intelligence analysts, sensemaking is challenging because it frequently involves making inferences about uncertain data. One way to enhance sensemaking may involve collaboration from a machine recognition aid such as Project Maven, an established algorithm that directs analysts' attention to people and vehicles in scenes. We simulated the directed attention of Project Maven as well as a machine recognition aid that directed attention to EEIs. METHOD: We created full-motion videos of simulated compounds viewed by an overhead camera. Sensemaking was assessed by measuring participants' ability to predict events and identify signs. Participants' attention was directed by placing small globe symbols above either all people and vehicles, or all EEIs. Novices and intelligence analysts participated. RESULTS: Simulated recognition aids directing participants' attention to EEIs improved EEI identification but directing attention to people and vehicles (emulating Project Maven) did not. Participants' sensemaking was not enhanced by either type of simulated recognition aid. CONCLUSION: Guiding attention to features in a scene improves their identification whereas indiscriminate steering of attention to entities in the scene does not improve understanding of the holistic meaning of events, unless attention is drawn to relevant signs of those events. APPLICATION: Results contribute to our goal of determining which human-machine systems improve the sensemaking capability of intelligence analysts in the field.

Effects of Stereoscopic Depth on Vigilance Performance and Cerebral Hemodynamics.

OBJECTIVE: We tested the possibility that monitoring a display wherein critical signals for detection were defined by a stereoscopic three-dimensional (3-D) image might be more resistant to the vigilance decrement, and to temporal declines in cerebral blood flow velocity (CBFV), than monitoring a display featuring a customary two-dimensional (2-D) image. BACKGROUND: Hancock has asserted that vigilance studies typically employ stimuli for detection that do not exemplify those that occur in the natural world. As a result, human performance is suboptimal. From this perspective, tasks that better approximate perception in natural environments should enhance performance efficiency. To test that possibility, we made use of stereopsis, an important means by which observers interact with their everyday surroundings. METHOD: Observers monitored a circular display in which a vertical line was embedded. Critical signals for detection in a 2-D condition were instances in which the line was rotated clockwise from vertical. In a 3-D condition, critical signals were cases in which the line appeared to move outward toward the observer. RESULTS: The overall level of signal detection and the stability of detection over time were greater when observers monitored for 3-D changes in target depth compared to 2-D changes in target orientation. However, the 3-D display did not retard the temporal decline in CBFV. CONCLUSION: These results provide the initial demonstration that 3-D displays can enhance performance in vigilance tasks. APPLICATION: The use of 3-D displays may be productive in augmenting system reliability when operator vigilance is vital.