Exposure render: an interactive photo-realistic volume rendering framework.

The field of volume visualization has undergone rapid development during the past years, both due to advances in suitable computing hardware and due to the increasing availability of large volume datasets. Recent work has focused on increasing the visual realism in Direct Volume Rendering (DVR) by integrating a number of visually plausible but often effect-specific rendering techniques, for instance modeling of light occlusion and depth of field. Besides yielding more attractive renderings, especially the more realistic lighting has a positive effect on perceptual tasks. Although these new rendering techniques yield impressive results, they exhibit limitations in terms of their exibility and their performance. Monte Carlo ray tracing (MCRT), coupled with physically based light transport, is the de-facto standard for synthesizing highly realistic images in the graphics domain, although usually not from volumetric data. Due to the stochastic sampling of MCRT algorithms, numerous effects can be achieved in a relatively straight-forward fashion. For this reason, we have developed a practical framework that applies MCRT techniques also to direct volume rendering (DVR). With this work, we demonstrate that a host of realistic effects, including physically based lighting, can be simulated in a generic and flexible fashion, leading to interactive DVR with improved realism. In the hope that this improved approach to DVR will see more use in practice, we have made available our framework under a permissive open source license.

Articulated planar reformation for change visualization in small animal imaging.

The analysis of multi-timepoint whole-body small animal CT data is greatly complicated by the varying posture of the subject at different timepoints. Due to these variations, correctly relating and comparing corresponding regions of interest is challenging.In addition, occlusion may prevent effective visualization of these regions of interest. To address these problems, we have developed a method that fully automatically maps the data to a standardized layout of sub-volumes, based on an articulated atlas registration. We have dubbed this process articulated planar reformation, or APR. A sub-volume can be interactively selected for closer inspection and can be compared with the corresponding sub-volume at the other timepoints, employing a number of different comparative visualization approaches. We provide an additional tool that highlights possibly interesting areas based on the change of bone density between timepoints. Furthermore we allow visualization of the local registration error, to give an indication of the accuracy of the registration. We have evaluated our approach on a case that exhibits cancer-induced bone resorption.

Electronic cleansing for computed tomography (CT) colonography using a scale-invariant three-material model.

A well-known reading pitfall in computed tomography (CT) colonography is posed by artifacts at T-junctions, i.e., locations where air-fluid levels interface with the colon wall. This paper presents a scale-invariant method to determine material fractions in voxels near such T-junctions. The proposed electronic cleansing method particularly improves the segmentation at those locations. The algorithm takes a vector of Gaussian derivatives as input features. The measured features are made invariant to the orientation-dependent apparent scale of the data and normalized in a way to obtain equal noise variance. A so-called parachute model is introduced that maps Gaussian derivatives onto material fractions near T-junctions. Projection of the noisy derivatives onto the model yields improved estimates of the true, underlying feature values. The method is shown to render an accurate representation of the object boundary without artifacts near junctions. Therefore, it enhances the reading of CT colonography in a 3-D display mode.

Spatial navigation for context-aware video surveillance.

Interactive spatial navigation for video surveillance networks can be difficult. This is especially true for live tracking of complex events along many cameras, in which operators must make quick, accurate navigation decisions on the basis of the actual situation. The proposed spatial navigation interface facilitates such video surveillance tasks.

Combined surface and volume processing for fused joint segmentation.

PURPOSE: Segmentation of rheumatoid joints from CT images is a complicated task. The pathological state of the joint results in a non-uniform density of the bone tissue, with holes and irregularities complicating the segmentation process. For the specific case of the shoulder joint, existing segmentation techniques often fail and lead to poor results. This paper describes a novel method for the segmentation of these joints. METHODS: Given a rough surface model of the shoulder, a loop that encircles the joint is extracted by calculating the minimum curvature of the surface model. The intersection points of this loop with the separate CT-slices are connected by means of a path search algorithm. Inaccurate sections are corrected by iteratively applying a Hough transform to the segmentation result. RESULTS: As a qualitative measure we calculated the Dice coefficient and Hausdorff distances of the automatic segmentations and expert manual segmentations of CT-scans of ten severely deteriorated shoulder joints. For the humerus and scapula the median Dice coefficient was 98.9% with an interquartile range (IQR) of 95.8-99.4 and 98.5% (IQR 98.3-99.2%), respectively. The median Hausdorff distances were 3.06 mm (IQR 2.30-4.14) and 3.92 mm (IQR 1.96 -5.92 mm), respectively. CONCLUSION: The routine satisfies the criterion of our particular application to accurately segment the shoulder joint in under 2 min. We conclude that combining surface curvature, limited user interaction and iterative refinement via a Hough transform forms a satisfactory approach for the segmentation of severely damaged arthritic shoulder joints.

Smooth graphs for visual exploration of higher-order state transitions.

In this paper, we present a new visual way of exploring state sequences in large observational time-series. A key advantage of our method is that it can directly visualize higher-order state transitions. A standard first order state transition is a sequence of two states that are linked by a transition. A higher-order state transition is a sequence of three or more states where the sequence of participating states are linked together by consecutive first order state transitions. Our method extends the current state-graph exploration methods by employing a two dimensional graph, in which higher-order state transitions are visualized as curved lines. All transitions are bundled into thick splines, so that the thickness of an edge represents the frequency of instances. The bundling between two states takes into account the state transitions before and after the transition. This is done in such a way that it forms a continuous representation in which any subsequence of the time series is represented by a continuous smooth line. The edge bundles in these graphs can be explored interactively through our incremental selection algorithm.We demonstrate our method with an application in exploring labeled time-series data from a biological survey, where a clustering has assigned a single label to the data at each time-point. In these sequences, a large number of cyclic patterns occur, which in turn are linked to specific activities. We demonstrate how our method helps to find these cycles, and how the interactive selection process helps to find and investigate activities.

Extensions of parallel coordinates for interactive exploration of large multi-timepoint data sets.

Parallel coordinate plots (PCPs) are commonly used in information visualization to provide insight into multi-variate data. These plots help to spot correlations between variables. PCPs have been successfully applied to unstructured datasets up to a few millions of points. In this paper, we present techniques to enhance the usability of PCPs for the exploration of large, multi-timepoint volumetric data sets, containing tens of millions of points per timestep. The main difficulties that arise when applying PCPs to large numbers of data points are visual clutter and slow performance, making interactive exploration infeasible. Moreover, the spatial context of the volumetric data is usually lost. We describe techniques for preprocessing using data quantization and compression, and for fast GPU-based rendering of PCPs using joint density distributions for each pair of consecutive variables, resulting in a smooth, continuous visualization. Also, fast brushing techniques are proposed for interactive data selection in multiple linked views, including a 3D spatial volume view. These techniques have been successfully applied to three large data sets: Hurricane Isabel (Vis'04 contest), the ionization front instability data set (Vis'08 design contest), and data from a large-eddy simulation of cumulus clouds. With these data, we show how PCPs can be extended to successfully visualize and interactively explore multi-timepoint volumetric datasets with an order of magnitude more data points.

Classifying CT image data into material fractions by a scale and rotation invariant edge model.

A fully automated method is presented to classify 3-D CT data into material fractions. An analytical scale-invariant description relating the data value to derivatives around Gaussian blurred step edges--arch model--is applied to uniquely combine robustness to noise, global signal fluctuations, anisotropic scale, noncubic voxels, and ease of use via a straightforward segmentation of 3-D CT images through material fractions. Projection of noisy data value and derivatives onto the arch yields a robust alternative to the standard computed Gaussian derivatives. This results in a superior precision of the method. The arch-model parameters are derived from a small, but over-determined, set of measurements (data values and derivatives) along a path following the gradient uphill and downhill starting at an edge voxel. The model is first used to identify the expected values of the two pure materials (named L and H) and thereby classify the boundary. Second, the model is used to approximate the underlying noise-free material fractions for each noisy measurement. An iso-surface of constant material fraction accurately delineates the material boundary in the presence of noise and global signal fluctuations. This approach enables straightforward segmentation of 3-D CT images into objects of interest for computer-aided diagnosis and offers an easy tool for the design of otherwise complicated transfer functions in high-quality visualizations. The method is applied to segment a tooth volume for visualization and digital cleansing for virtual colonoscopy.

Lines of curvature for polyp detection in virtual colonoscopy.

Computer-aided diagnosis (CAD) is a helpful addition to laborious visual inspection for preselection of suspected colonic polyps in virtual colonoscopy. Most of the previous work on automatic polyp detection makes use of indicators based on the scalar curvature of the colon wall and can result in many false-positive detections. Our work tries to reduce the number of false-positive detections in the preselection of polyp candidates. Polyp surface shape can be characterized and visualized using lines of curvature. In this paper, we describe techniques for generating and rendering lines of curvature on surfaces and we show that these lines can be used as part of a polyp detection approach. We have adapted existing approaches on explicit triangular surface meshes, and developed a new algorithm on implicit surfaces embedded in 3D volume data. The visualization of shaded colonic surfaces can be enhanced by rendering the derived lines of curvature on these surfaces. Features strongly correlated with true-positive detections were calculated on lines of curvature and used for the polyp candidate selection. We studied the performance of these features on 5 data sets that included 331 pre-detected candidates, of which 50 sites were true polyps. The winding angle had a significant discriminating power for true-positive detections, which was demonstrated by a Wilcoxon rank sum test with p < 0.001. The median winding angle and inter-quartile range (IQR) for true polyps were 7.817 and 6.770 - 9.288 compared to 2.954 and 1.995 - 3.749 for false-positive detections.

Three-dimensional display modes for CT colonography: conventional 3D virtual colonoscopy versus unfolded cube projection.

The authors compared a conventional two-directional three-dimensional (3D) display for computed tomography (CT) colonography with an alternative method they developed on the basis of time efficiency and surface visibility. With the conventional technique, 3D ante- and retrograde cine loops were obtained (hereafter, conventional 3D). With the alternative method, six projections were obtained at 90 degrees viewing angles (unfolded cube display). Mean evaluation time per patient with the conventional 3D display was significantly longer than that with the unfolded cube display. With the conventional 3D method, 93.8% of the colon surface came into view; with the unfolded cube method, 99.5% of the colon surface came into view. Sensitivity and specificity were not significantly different between the two methods. Agreements between observers were kappa = 0.605 for conventional 3D display and kappa = 0.692 for unfolded cube display. Consequently, the latter method enhances the 3D endoluminal display with improved time efficiency and higher surface visibility.