De-cluttering Scatterplots with Integral Images.

Scatterplots provide a visual representation of bivariate data (or 2D embeddings of multivariate data) that allows for effective analyses of data dependencies, clusters, trends, and outliers. Unfortunately, classical scatterplots suffer from scalability issues, since growing data sizes eventually lead to overplotting and visual clutter on a screen with a fixed resolution, which hinders the data analysis process. We propose an algorithm that compensates for irregular sample distributions by a smooth transformation of the scatterplot's visual domain. Our algorithm evaluates the scatterplot's density distribution to compute a regularization mapping based on integral images of the rasterized density function. The mapping preserves the samples' neighborhood relations. Few regularization iterations suffice to achieve a nearly uniform sample distribution that efficiently uses the available screen space. We further propose approaches to visually convey the transformation that was applied to the scatterplot and compare them in a user study. We present a novel parallel algorithm for fast GPU-based integral-image computation, which allows for integrating our de-cluttering approach into interactive visual data analysis systems.

2022 IEEE Scientific Visualization Contest Winner: Multifield Analysis of Vorticity-Driven Lateral Spread in Wildfire Ensembles.

We present an interactive visual analysis tool for analyzing the spread of wildfires and what influences their evolution. Multiple time-varying 3-D scalar and vector fields are investigated and related to each other to identify causes of atypical fire spread. We present a visual analysis approach that allows for a comparative analysis of multiple runs of a simulation ensemble on different levels of detail. Overview visualizations combined with volume renderings and flow visualizations provide an intuitive understanding of the fire spread.

Fingerprints of Element Concentrations in Infective Endocarditis Obtained by Mass Spectrometric Imaging and t-Distributed Stochastic Neighbor Embedding.

Staphylococcus aureus-induced infective endocarditis (IE) is a life-threatening disease. Differences in virulence between distinct S. aureus strains, which are partly based on the molecular mechanisms during bacterial adhesion, are not fully understood. Yet, distinct molecular or elemental patterns, occurring during specific steps in the adhesion process, may help to identify novel targets for accelerated diagnosis or improved treatment. Here, we use laser ablation inductively coupled plasma mass spectrometry (LA-ICP-MS) of post-mortem tissue slices of an established mouse model of IE to obtain fingerprints of element distributions in infected aortic valve tissue. Three S. aureus strains with different virulence due to deficiency in distinct adhesion molecules (fibronectin-binding protein A and staphylococcal protein A) were used to assess strain-specific patterns. Data analysis was performed by t-distributed stochastic neighbor embedding (t-SNE) of mass spectrometry imaging data, using manual reference tissue classification in histological specimens. This procedure allowed for obtaining distinct element patterns in infected tissue for all three bacterial strains and for comparing those to patterns observed in healthy mice or after sterile inflammation of the valve. In tissue from infected mice, increased concentrations of calcium, zinc, and magnesium were observed compared to noninfected mice. Between S. aureus strains, pronounced variations were observed for manganese. The presented approach is sensitive for detection of S. aureus infection. For strain-specific tissue characterization, however, further improvements such as establishing a database with elemental fingerprints may be required.

Multifaceted Visual Analysis of Oceanographic Simulation Ensemble Data.

The analysis of multirun oceanographic simulation data imposes various challenges ranging from visualizing multifield spatio-temporal data over properly identifying and depicting vortices to visually representing uncertainties. We present an integrated interactive visual analysis tool that enables us to overcome these challenges by employing multiple coordinated views of different facets of the data at different levels of aggregation.

Pulmonary Arteriovenous Pressure Gradient and Time-Averaged Mean Velocity of Small Pulmonary Arteries Can Serve as Sensitive Biomarkers in the Diagnosis of Pulmonary Arterial Hypertension: A Preclinical Study by 4D-Flow MRI.

(1) Background: Pulmonary arterial hypertension (PAH) is a serious condition that is associated with many cardiopulmonary diseases. Invasive right heart catheterization (RHC) is currently the only method for the definitive diagnosis and follow-up of PAH. In this study, we sought a non-invasive hemodynamic biomarker for the diagnosis of PAH. (2) Methods: We applied prospectively respiratory and cardiac gated 4D-flow MRI at a 9.4T preclinical scanner on three different groups of Sprague Dawley rats: baseline (n = 11), moderate PAH (n = 8), and severe PAH (n = 8). The pressure gradients as well as the velocity values were analyzed from 4D-flow data and correlated with lung histology. (3) Results: The pressure gradient between the pulmonary artery and vein on the unilateral side as well as the time-averaged mean velocity values of the small pulmonary arteries were capable of distinguishing not only between baseline and severe PAH, but also between the moderate and severe stages of the disease. (4) Conclusions: The current preclinical study suggests the pulmonary arteriovenous pressure gradient and the time-averaged mean velocity as potential biomarkers to diagnose PAH.

Aggregated Ensemble Views for Deep Water Asteroid Impact Simulations.

Simulation ensembles such as the ones simulating deep water asteroid impacts have many facets. Their analysis in terms of detecting spatiotemporal patterns, comparing multiple runs, and analyzing the influence of simulation parameters requires aggregation at multiple levels. We propose respective visual encodings embedded in an interactive visual analysis tool.

A Visual Analytics Approach for Comparing Cohorts in Single-Voxel Magnetic Resonance Spectroscopy Data.

Single-voxel proton magnetic resonance spectroscopy (1H-MRS) is a non-invasive in-vivo technology to measure metabolic concentrations in selected regions of interest in a tissue, e.g., the brain. 1H-MRS generates spectra of signals with different frequencies and specific intensities which can be assigned to respective metabolites in the investigated tissue and quantified. In studies designed to detect biomarkers of a specific disorder or dysfunction, the overall goal is not just to analyze a single 1H-MRS data set, but to compare patient cohorts against healthy controls. We propose a visual analytics tool for the comparative analyses of cohorts, i.e., sets of data sets. Each data set can be regarded as a multivariate data sample, in which each variable represents the concentration of a metabolite. While a standard workflow for comparative analyses of two cohorts is routinely deployed by analyzing metabolites individually, our tool allows for comparative cohort analysis in a multivariate setting. Our top-down analysis strategy uses multidimensional data visualization methods combined with statistical plots and statistical analyses. We document and evaluate the effectiveness of our approach for the interactive analysis of metabolite concentrations in three brain regions for a comparative study of an alcohol-dependent patient cohort and a healthy control group.

Uncertainty-aware asynchronous scattered motion interpolation using Gaussian process regression.

We address the problem of interpolating randomly non-uniformly spatiotemporally scattered uncertain motion measurements, which arises in the context of soft tissue motion estimation. Soft tissue motion estimation is of great interest in the field of image-guided soft-tissue intervention and surgery navigation, because it enables the registration of pre-interventional/pre-operative navigation information on deformable soft-tissue organs. To formally define the measurements as spatiotemporally scattered motion signal samples, we propose a novel motion field representation. To perform the interpolation of the motion measurements in an uncertainty-aware optimal unbiased fashion, we devise a novel Gaussian process (GP) regression model with a non-constant-mean prior and an anisotropic covariance function and show through an extensive evaluation that it outperforms the state-of-the-art GP models that have been deployed previously for similar tasks. The employment of GP regression enables the quantification of uncertainty in the interpolation result, which would allow the amount of uncertainty present in the registered navigation information governing the decisions of the surgeon or intervention specialist to be conveyed.

Shape-preserving Star Coordinates.

Dimensionality reduction is commonly applied to multidimensional data to reduce the complexity of their analysis. In visual analysis systems, projections embed multidimensional data into 2D or 3D spaces for graphical representation. To facilitate a robust and accurate analysis, essential characteristics of the multidimensional data shall be preserved when projecting. Orthographic star coordinates is a state-of-the-art linear projection method that avoids distortion of multidimensional clusters by restricting interactive exploration to orthographic projections. However, existing numerical methods for computing orthographic star coordinates have a number of limitations when putting them into practice. We overcome these limitations by proposing the novel concept of shapepreserving star coordinates where shape preservation is assured using a superset of orthographic projections. Our scheme is explicit, exact, simple, fast, parameter-free, and stable. To maintain a valid shape-preserving star-coordinates configuration during user interaction with one of the star-coordinates axes, we derive an algorithm that only requires us to modify the configuration of one additional compensatory axis. Different design goals can be targeted by using different strategies for selecting the compensatory axis. We propose and discuss four strategies including a strategy that approximates orthographic star coordinates very well and a data-driven strategy. We further present shape-preserving morphing strategies between two shape-preserving configurations, which can be adapted for the generation of data tours. We apply our concept to multiple data analysis scenarios to document its applicability and validate its desired properties.

Testing occlusal performance by using chewing simulation with virtually designed substrate.

Physically accurate deformable models based on the finite element method (FEM) are being used for a wide range of applications, from entertainment to medicine. This article describes how we applied this method in the CAD/CAM area that is concerned with reconstructing 3D models of teeth. We simulated the process of mastication by employing a deformable model that represented the substrate, and a rigid model that represented the teeth. We extended a recent approach for substrate deformation by also modelling the fracture of the substrate by the mastication process. Although including fracturing into the process allowed us to assess a mastication result, it posed new technical challenges such as defining the start of fracturing, propagating fracture through the substrate, detecting collisions between substrate pieces after fracturing, and resolving such collisions. We developed an approach that solved these challenges. The resulting simulation allowed us to compare the functionality of different occlusal designs in a mastication process. We are convinced that these simulations are an interesting tool that could be used to improve occlusal performance, especially in complete dentures, which are nowadays being more and more digitally designed.

Skeleton-Based Scagnostics.

Scatterplot matrices (SPLOMs) are widely used for exploring multidimensional data. Scatterplot diagnostics (scagnostics) approaches measure characteristics of scatterplots to automatically find potentially interesting plots, thereby making SPLOMs more scalable with the dimension count. While statistical measures such as regression lines can capture orientation, and graph-theoretic scagnostics measures can capture shape, there is no scatterplot characterization measure that uses both descriptors. Based on well-known results in shape analysis, we propose a scagnostics approach that captures both scatterplot shape and orientation using skeletons (or medial axes). Our representation can handle complex spatial distributions, helps discovery of principal trends in a multiscale way, scales visually well with the number of samples, is robust to noise, and is automatic and fast to compute. We define skeleton-based similarity metrics for the visual exploration and analysis of SPLOMs. We perform a user study to measure the human perception of scatterplot similarity and compare the outcome to our results as well as to graph-based scagnostics and other visual quality metrics. Our skeleton-based metrics outperform previously defined measures both in terms of closeness to perceptually-based similarity and computation time efficiency.

Automatic MRI segmentation of para-pharyngeal fat pads using interactive visual feature space analysis for classification.

BACKGROUND: Obstructive sleep apnea (OSA) is a public health problem. Detailed analysis of the para-pharyngeal fat pads can help us to understand the pathogenesis of OSA and may mediate the intervention of this sleeping disorder. A reliable and automatic para-pharyngeal fat pads segmentation technique plays a vital role in investigating larger data bases to identify the anatomic risk factors for the OSA. METHODS: Our research aims to develop a context-based automatic segmentation algorithm to delineate the fat pads from magnetic resonance images in a population-based study. Our segmentation pipeline involves texture analysis, connected component analysis, object-based image analysis, and supervised classification using an interactive visual analysis tool to segregate fat pads from other structures automatically. RESULTS: We developed a fully automatic segmentation technique that does not need any user interaction to extract fat pads. Our algorithm is fast enough that we can apply it to population-based epidemiological studies that provide a large amount of data. We evaluated our approach qualitatively on thirty datasets and quantitatively against the ground truths of ten datasets resulting in an average of approximately 78% detected volume fraction and a 79% Dice coefficient, which is within the range of the inter-observer variation of manual segmentation results. CONCLUSION: The suggested method produces sufficiently accurate results and has potential to be applied for the study of large data to understand the pathogenesis of the OSA syndrome.

Analyzing myocardial torsion based on tissue phase mapping cardiovascular magnetic resonance.

BACKGROUND: The purpose of this work is to analyze differences in left ventricular torsion between volunteers and patients with non-ischemic cardiomyopathy based on tissue phase mapping (TPM) cardiovascular magnetic resonance (CMR). METHODS: TPM was performed on 27 patients with non-ischemic cardiomyopathy and 14 normal volunteers. Patients underwent a standard CMR including late gadolinium enhancement (LGE) for the assessment of myocardial scar and ECG-gated cine CMR for global cardiac function. TPM was acquired in short-axis orientation at base, mid, and apex for all subjects. After evaluation by experienced observers, the patients were divided in subgroups according to the presence or absence of LGE (LGE+/LGE-), local wall motion abnormalities (WM+/WM-), and having a preserved (≥50%) or reduced (<50%) ejection fraction (EF+/EF-). TPM data was semi-automatically segmented and global LV torsion was computed for each cardiac time frame for endocardial and epicardial layers, and for the entire myocardium. RESULTS: Maximum myocardial torsion was significantly lower for patients with reduced EF compared to controls (0.21 ± 0.15°/mm vs. 0.36 ± 0.11°/mm, p = 0.018), but also for patients with wall motion abnormalities (0.21 ± 0.13°/mm vs. 0.36 ± 0.11°/mm, p = 0.004). Global myocardial torsion showed a positive correlation (r = 0.54, p < 0.001) with EF. Moreover, endocardial torsion was significantly higher than epicardial torsion for EF+ subjects (0.56 ± 0.33°/mm vs. 0.34 ± 0.18°/mm, p = 0.039) and for volunteers (0.46 ± 0.16°/mm vs. 0.30 ± 0.09°/mm, p = 0.004). The difference in maximum torsion between endo- and epicardial layers was positively correlated with EF (r = 0.47, p = 0.002) and age (r = 0.37, p = 0.016) for all subjects. CONCLUSIONS: TPM can be used to detect significant differences in LV torsion in patients with reduced EF and in the presence of local wall motion abnormalities. We were able to quantify torsion differences between the endocardium and epicardium, which vary between patient subgroups and are correlated to age and EF.

Visual Analysis of Multi-Run Spatio-Temporal Simulations Using Isocontour Similarity for Projected Views.

Multi-run simulations are widely used to investigate how simulated processes evolve depending on varying initial conditions. Frequently, such simulations model the change of spatial phenomena over time. Isocontours have proven to be effective for the visual representation and analysis of 2D and 3D spatial scalar fields. We propose a novel visualization approach for multi-run simulation data based on isocontours. By introducing a distance function for isocontours, we generate a distance matrix used for a multidimensional scaling projection. Multiple simulation runs are represented by polylines in the projected view displaying change over time. We propose a fast calculation of isocontour differences based on a quasi-Monte Carlo approach. For interactive visual analysis, we support filtering and selection mechanisms on the multi-run plot and on linked views to physical space visualizations. Our approach can be effectively used for the visual representation of ensembles, for pattern and outlier detection, for the investigation of the influence of simulation parameters, and for a detailed analysis of the features detected. The proposed method is applicable to data of any spatial dimensionality and any spatial representation (gridded or unstructured). We validate our approach by performing a user study on synthetic data and applying it to different types of multi-run spatio-temporal simulation data.

Perception-Based Evaluation of Projection Methods for Multidimensional Data Visualization.

Similarity-based layouts generated by multidimensional projections or other dimension reduction techniques are commonly used to visualize high-dimensional data. Many projection techniques have been recently proposed addressing different objectives and application domains. Nonetheless, very little is known about the effectiveness of the generated layouts from a user's perspective, how distinct layouts from the same data compare regarding the typical visualization tasks they support, or how domain-specific issues affect the outcome of the techniques. Learning more about projection usage is an important step towards both consolidating their role in high-dimensional data analysis and taking informed decisions when choosing techniques. This work provides a contribution towards this goal. We describe the results of an investigation on the performance of layouts generated by projection techniques as perceived by their users. We conducted a controlled user study to test against the following hypotheses: (1) projection performance is task-dependent; (2) certain projections perform better on certain types of tasks; (3) projection performance depends on the nature of the data; and (4) subjects prefer projections with good segregation capability. We generated layouts of high-dimensional data with five techniques representative of different projection approaches. As application domains we investigated image and document data. We identified eight typical tasks, three of them related to segregation capability of the projection, three related to projection precision, and two related to incurred visual cluttering. Answers to questions were compared for correctness against `ground truth' computed directly from the data. We also looked at subject confidence and task completion times. Statistical analysis of the collected data resulted in Hypotheses 1 and 3 being confirmed, Hypothesis 2 being confirmed partially and Hypotheses 4 could not be confirmed. We discuss our findings in comparison with some numerical measures of projection layout quality. Our results offer interesting insight on the use of projection layouts in data visualization tasks and provide a departing point for further systematic investigations.

Chewing simulation with a physically accurate deformable model.

Nowadays, CAD/CAM software is being used to compute the optimal shape and position of a new tooth model meant for a patient. With this possible future application in mind, we present in this article an independent and stand-alone interactive application that simulates the human chewing process and the deformation it produces in the food substrate. Chewing motion sensors are used to produce an accurate representation of the jaw movement. The substrate is represented by a deformable elastic model based on the finite linear elements method, which preserves physical accuracy. Collision detection based on spatial partitioning is used to calculate the forces that are acting on the deformable model. Based on the calculated information, geometry elements are added to the scene to enhance the information available for the user. The goal of the simulation is to present a complete scene to the dentist, highlighting the points where the teeth came into contact with the substrate and giving information about how much force acted at these points, which therefore makes it possible to indicate whether the tooth is being used incorrectly in the mastication process. Real-time interactivity is desired and achieved within limits, depending on the complexity of the employed geometric models. The presented simulation is a first step towards the overall project goal of interactively optimizing tooth position and shape under the investigation of a virtual chewing process using real patient data (Fig 1).

Projector-based surgeon-computer interaction on deformable surfaces.

PURPOSE: Providing intuitive and easy to operate interaction for medical augmented reality is essential for use in the operating room. Commonly, intra-operative navigation information is displayed on an installed monitor, requiring the operating surgeon to change focus from the monitor to the surgical site and vice versa during navigation. Projector-based augmented reality has the potential to alleviate this problem. The aim of our work is to use a projector for visualization and to provide intuitive means for direct interaction with the projected information. METHODS: A consumer-grade projector is used to visualize preoperatively defined surgical planning data. The projection of the virtual information is possible on any deformable surface, and the surgeon can interact with the presented virtual information. A Microsoft Kinect camera is used to capture both the surgeon interactions and the deformations of the surface over time. After calibration of projector and Kinect camera, the fingertips are localized automatically. A point cloud surface representation is used to determine the surgeon interaction with the projected virtual information. Interaction is detected by estimating the proximity of the surgeon's fingertips to the interaction zone and applying projector-Kinect calibration information. Interaction is performed using multi-touch gestures. RESULTS: In our experimental surgical scenario, the surgeon stands in front of the Microsoft Kinect camera, while relevant medical information is projected on the interaction zone. A hand wave gesture initiates the tracking of the hand. The user can then interact with the projected virtual information according to the defined multi-touch-based gestures. Thus, all information such as preoperative planning data is provided to the surgeon and his/her team intra-operatively in a familiar context. CONCLUSION: We enabled the projection of the virtual information on an arbitrarily shaped surface and used a Microsoft Kinect camera to capture the interaction zone and the surgeon's actions. The system eliminates the need for the surgeon to alternately view the surgical site and the monitor. The system eliminates unnecessary distractions and may enhance the surgeon's performance.

A fast and robust hepatocyte quantification algorithm including vein processing.

BACKGROUND: Quantification of different types of cells is often needed for analysis of histological images. In our project, we compute the relative number of proliferating hepatocytes for the evaluation of the regeneration process after partial hepatectomy in normal rat livers. RESULTS: Our presented automatic approach for hepatocyte (HC) quantification is suitable for the analysis of an entire digitized histological section given in form of a series of images. It is the main part of an automatic hepatocyte quantification tool that allows for the computation of the ratio between the number of proliferating HC-nuclei and the total number of all HC-nuclei for a series of images in one processing run. The processing pipeline allows us to obtain desired and valuable results for a wide range of images with different properties without additional parameter adjustment. Comparing the obtained segmentation results with a manually retrieved segmentation mask which is considered to be the ground truth, we achieve results with sensitivity above 90% and false positive fraction below 15%. CONCLUSIONS: The proposed automatic procedure gives results with high sensitivity and low false positive fraction and can be applied to process entire stained sections.

VANLO--interactive visual exploration of aligned biological networks.

BACKGROUND: Protein-protein interaction (PPI) is fundamental to many biological processes. In the course of evolution, biological networks such as protein-protein interaction networks have developed. Biological networks of different species can be aligned by finding instances (e.g. proteins) with the same common ancestor in the evolutionary process, so-called orthologs. For a better understanding of the evolution of biological networks, such aligned networks have to be explored. Visualization can play a key role in making the various relationships transparent. RESULTS: We present a novel visualization system for aligned biological networks in 3D space that naturally embeds existing 2D layouts. In addition to displaying the intra-network connectivities, we also provide insight into how the individual networks relate to each other by placing aligned entities on top of each other in separate layers. We optimize the layout of the entire alignment graph in a global fashion that takes into account inter- as well as intra-network relationships. The layout algorithm includes a step of merging aligned networks into one graph, laying out the graph with respect to application-specific requirements, splitting the merged graph again into individual networks, and displaying the network alignment in layers. In addition to representing the data in a static way, we also provide different interaction techniques to explore the data with respect to application-specific tasks. CONCLUSION: Our system provides an intuitive global understanding of aligned PPI networks and it allows the investigation of key biological questions. We evaluate our system by applying it to real-world examples documenting how our system can be used to investigate the data with respect to these key questions. Our tool VANLO (Visualization of Aligned Networks with Layout Optimization) can be accessed at http://www.math-inf.uni-greifswald.de/VANLO.