Learning an Attention Model for Robust 2-D/3-D Registration Using Point-To-Plane Correspondences.

Minimally invasive procedures rely on image guidance for navigation at the operation site to avoid large surgical incisions. X-ray images are often used for guidance, but important structures may be not well visible. These structures can be overlaid from pre-operative 3-D images and accurate alignment can be established using 2-D/3-D registration. Registration based on the point-to-plane correspondence model was recently proposed and shown to achieve state-of-the-art performance. However, registration may still fail in challenging cases due to a large portion of outliers. In this paper, we describe a learning-based correspondence weighting scheme to improve the registration performance. By learning an attention model, inlier correspondences get higher attention in the motion estimation while the outlier correspondences are suppressed. Instead of using per-correspondence labels, our objective function allows to train the model directly by minimizing the registration error. We demonstrate a highly increased robustness, e.g. increasing the success rate from 84.9% to 97.0% for spine registration. In contrast to previously proposed learning-based methods, we also achieve a high accuracy of around 0.5mm mean re-projection distance. In addition, our method requires a relatively small amount of training data, is able to learn from simulated data, and generalizes to images with additional structures which are not present during training. Furthermore, a single model can be trained for both, different views and different anatomical structures.

Robust Multi-View 2-D/3-D Registration Using Point-To-Plane Correspondence Model.

In minimally invasive procedures, the clinician relies on image guidance to observe and navigate the operation site. In order to show structures which are not visible in the live X-ray images, such as vessels or planning annotations, X-ray images can be augmented with pre-operatively acquired images. Accurate image alignment is needed and can be provided by 2-D/3-D registration. In this paper, a multi-view registration method based on the point-to-plane correspondence model is proposed. The correspondence model is extended to be independent of the used camera coordinates and different multi-view registration schemes are introduced and compared. Evaluation is performed for a wide range of clinically relevant registration scenarios. We show for different applications that registration using correspondences from both views simultaneously provides accurate and robust registration, while the performance of the other schemes varies considerably. Our method also outperforms the state-of-the-art method for cerebral angiography registration, achieving a capture range of 18 mm and an accuracy of 0.22±0.07 mm. Furthermore, investigations on the minimum angle between the views are performed in order to provide accurate and robust registration, while minimizing the obstruction to the clinical workflow. We show that small angles around 30° are sufficient to provide reliable registration results.

Dynamic 2-D/3-D Rigid Registration Framework Using Point-To-Plane Correspondence Model.

In image-guided interventional procedures, live 2-D X-ray images can be augmented with preoperative 3-D computed tomography or MRI images to provide planning landmarks and enhanced spatial perception. An accurate alignment between the 3-D and 2-D images is a prerequisite for fusion applications. This paper presents a dynamic rigid 2-D/3-D registration framework, which measures the local 3-D-to-2-D misalignment and efficiently constrains the update of both planar and non-planar 3-D rigid transformations using a novel point-to-plane correspondence model. In the simulation evaluation, the proposed method achieved a mean 3-D accuracy of 0.07 mm for the head phantom and 0.05 mm for the thorax phantom using single-view X-ray images. In the evaluation on dynamic motion compensation, our method significantly increases the accuracy comparing with the baseline method. The proposed method is also evaluated on a publicly-available clinical angiogram data set with "gold-standard" registrations. The proposed method achieved a mean 3-D accuracy below 0.8 mm and a mean 2-D accuracy below 0.3 mm using single-view X-ray images. It outperformed the state-of-the-art methods in both accuracy and robustness in single-view registration. The proposed method is intuitive, generic, and suitable for both initial and dynamic registration scenarios.

Wavelet denoising of multiframe optical coherence tomography data.

We introduce a novel speckle noise reduction algorithm for OCT images. Contrary to present approaches, the algorithm does not rely on simple averaging of multiple image frames or denoising on the final averaged image. Instead it uses wavelet decompositions of the single frames for a local noise and structure estimation. Based on this analysis, the wavelet detail coefficients are weighted, averaged and reconstructed. At a signal-to-noise gain at about 100% we observe only a minor sharpness decrease, as measured by a full-width-half-maximum reduction of 10.5%. While a similar signal-to-noise gain would require averaging of 29 frames, we achieve this result using only 8 frames as input to the algorithm. A possible application of the proposed algorithm is preprocessing in retinal structure segmentation algorithms, to allow a better differentiation between real tissue information and unwanted speckle noise.

Wavelet based noise reduction in CT-images using correlation analysis.

The projection data measured in computed tomography (CT) and, consequently, the slices reconstructed from these data are noisy. We present a new wavelet based structure-preserving method for noise reduction in CT-images that can be used in combination with different reconstruction methods. The approach is based on the assumption that data can be decomposed into information and temporally uncorrelated noise. In CT two spatially identical images can be generated by reconstructions from disjoint subsets of projections: using the latest generation dual source CT-scanners one image can be reconstructed from the projections acquired at the first, the other image from the projections acquired at the second detector. For standard CT-scanners the two images can be generated by splitting up the set of projections into even and odd numbered projections. The resulting images show the same information but differ with respect to image noise. The analysis of correlations between the wavelet representations of the input images allows separating information from noise down to a certain signal-to-noise level. Wavelet coefficients with small correlation are suppressed, while those with high correlations are assumed to represent structures and are preserved. The final noise-suppressed image is reconstructed from the averaged and weighted wavelet coefficients of the input images. The proposed method is robust, of low complexity and adapts itself to the noise in the images. The quantitative and qualitative evaluation based on phantom as well as real clinical data showed, that high noise reduction rates of around 40% can be achieved without noticeable loss of image resolution.

Analytic noise-propagation in indirect fan-beam FBP reconstruction.

Precise knowledge of the local image noise is an essential ingredient to efficient application of post-processing methods such as wavelet or diffusion filtering to computed tomography (CT) images. The non-stationary, object dependent nature of noise in CT images is a direct result from the noise present in the projection data. Since quantum and electronics noise are the dominating noise sources, comparably simple models can be used for direct noise estimates in the individual projections. In this article, we describe the analytic propagation of these noise estimates through fan-beam filtered backprojection (FBP) reconstruction. Contrary to earlier publications in this field, we include the correlations within the parallel projections resulting from the rebinning, the convolution, and the backprojection processes. The method has been validated against Monte-Carlo results and good accuracy with an average relative error below 3.6% was achieved for arbitrary objects and over the full range of commonly used convolution kernels and field-of-view settings.