TimeSets: Temporal Sensemaking in Intelligence Analysis.

TimeSets is a temporal data visualization technique designed to reveal insights into event sets, such as all the events linked to one person or organization. In this article, we describe two TimeSets-based visual analytics tools for intelligence analysis. In the first case, TimeSets is integrated with other visual analytics tools to support open-source intelligence analysis with Twitter data, particularly the challenge of finding the right questions to ask. The second case uses TimeSets in a participatory design process with analysts that aims to meet their requirements of uncertainty analysis involving fake news. Lessons learned are potentially beneficial to other application domains.

SensePath: Understanding the Sensemaking Process Through Analytic Provenance.

Sensemaking is described as the process of comprehension, finding meaning and gaining insight from information, producing new knowledge and informing further action. Understanding the sensemaking process allows building effective visual analytics tools to make sense of large and complex datasets. Currently, it is often a manual and time-consuming undertaking to comprehend this: researchers collect observation data, transcribe screen capture videos and think-aloud recordings, identify recurring patterns, and eventually abstract the sensemaking process into a general model. In this paper, we propose a general approach to facilitate such a qualitative analysis process, and introduce a prototype, SensePath, to demonstrate the application of this approach with a focus on browser-based online sensemaking. The approach is based on a study of a number of qualitative research sessions including observations of users performing sensemaking tasks and post hoc analyses to uncover their sensemaking processes. Based on the study results and a follow-up participatory design session with HCI researchers, we decided to focus on the transcription and coding stages of thematic analysis. SensePath automatically captures user's sensemaking actions, i.e., analytic provenance, and provides multi-linked views to support their further analysis. A number of other requirements elicited from the design session are also implemented in SensePath, such as easy integration with existing qualitative analysis workflow and non-intrusive for participants. The tool was used by an experienced HCI researcher to analyze two sensemaking sessions. The researcher found the tool intuitive and considerably reduced analysis time, allowing better understanding of the sensemaking process.

Relative position vectors: an alternative approach to conflict detection in air traffic control.

OBJECTIVE: We explore whether the visual presentation of relative position vectors (RPVs) improves conflict detection in conditions representing some aspects of future airspace concepts. BACKGROUND: To help air traffic controllers manage increasing traffic, new tools and systems can automate more cognitively demanding processes, such as conflict detection. However, some studies reveal adverse effects of such tools, such as reduced situation awareness and increased workload. New displays are needed that help air traffic controllers handle increasing traffic loads. METHOD: A new display tool based on the display of RPVs, the Multi-Conflict Display (MCD), is evaluated in a series of simulated conflict detection tasks. The conflict detection performance of air traffic controllers with the MCD plus a conventional plan-view radar display is compared with their performance with a conventional plan-view radar display alone. RESULTS: Performance with the MCD plus radar was better than with radar alone in complex scenarios requiring controllers to find all actual or potential conflicts, especially when the number of aircraft on the screen was large. However performance with radar alone was better for static scenarios in which conflicts for a target aircraft, or target pair of aircraft, were the focus. CONCLUSION: Complementing the conventional plan-view display with an RPV display may help controllers detect conflicts more accurately with extremely high aircraft counts. APPLICATIONS: We provide an initial proof of concept that RPVs may be useful for supporting conflict detection in situations that are partially representative of conditions in which controllers will be working in the future.

An extensible framework for provenance in human terrain visual analytics.

We describe and demonstrate an extensible framework that supports data exploration and provenance in the context of Human Terrain Analysis (HTA). Working closely with defence analysts we extract requirements and a list of features that characterise data analysed at the end of the HTA chain. From these, we select an appropriate non-classified data source with analogous features, and model it as a set of facets. We develop ProveML, an XML-based extension of the Open Provenance Model, using these facets and augment it with the structures necessary to record the provenance of data, analytical process and interpretations. Through an iterative process, we develop and refine a prototype system for Human Terrain Visual Analytics (HTVA), and demonstrate means of storing, browsing and recalling analytical provenance and process through analytic bookmarks in ProveML. We show how these bookmarks can be combined to form narratives that link back to the live data. Throughout the process, we demonstrate that through structured workshops, rapid prototyping and structured communication with intelligence analysts we are able to establish requirements, and design schema, techniques and tools that meet the requirements of the intelligence community. We use the needs and reactions of defence analysts in defining and steering the methods to validate the framework.

Using interactive visual reasoning to support sense-making: implications for design.

This research aims to develop design guidelines for systems that support investigators and analysts in the exploration and assembly of evidence and inferences. We focus here on the problem of identifying candidate 'influencers' within a community of practice. To better understand this problem and its related cognitive and interaction needs, we conducted a user study using a system called INVISQUE (INteractive Visual Search and QUery Environment) loaded with content from the ACM Digital Library. INVISQUE supports search and manipulation of results over a freeform infinite 'canvas'. The study focuses on the representations user create and their reasoning process. It also draws on some pre-established theories and frameworks related to sense-making and cognitive work in general, which we apply as a 'theoretical lenses' to consider findings and articulate solutions. Analysing the user-study data in the light of these provides some understanding of how the high-level problem of identifying key players within a domain can translate into lower-level questions and interactions. This, in turn, has informed our understanding of representation and functionality needs at a level of description which abstracts away from the specifics of the problem at hand to the class of problems of interest. We consider the study outcomes from the perspective of implications for design.