Electromagnetic servoing-a new tracking paradigm.

Electromagnetic (EM) tracking is highly relevant for many computer assisted interventions. This is in particular due to the fact that the scientific community has not yet developed a general solution for tracking of flexible instruments within the human body. Electromagnetic tracking solutions are highly attractive for minimally invasive procedures, since they do not require line of sight. However, a major problem with EM tracking solutions is that they do not provide uniform accuracy throughout the tracking volume and the desired, highest accuracy is often only achieved close to the center of tracking volume. In this paper, we present a solution to the tracking problem, by mounting an EM field generator onto a robot arm. Proposing a new tracking paradigm, we take advantage of the electromagnetic tracking to detect the sensor within a specific sub-volume, with known and optimal accuracy. We then use the more accurate and robust robot positioning for obtaining uniform accuracy throughout the tracking volume. Such an EM servoing methodology guarantees optimal and uniform accuracy, by allowing us to always keep the tracked sensor close to the center of the tracking volume. In this paper, both dynamic accuracy and accuracy distribution within the tracking volume are evaluated using optical tracking as ground truth. In repeated evaluations, the proposed method was able to reduce the overall error from 6.64±7.86 mm to a significantly improved accuracy of 3.83±6.43 mm. In addition, the combined system provides a larger tracking volume, which is only limited by the reach of the robot and not the much smaller tracking volume defined by the magnetic field generator.

Hybrid electromagnetic and image-based tracking of endoscopes with guaranteed smooth output.

PURPOSE: Flexible fiber-optic bronchoscopy is a widespread medical procedure for the diagnosis and treatment of lung diseases. Navigation systems are needed to track the flexible endoscope within the bronchial tree. Electromagnetic (EM) tracking is currently the only technology used clinically for this purpose. The registration between EM tracking and patient anatomy may become inaccurate due to breathing motion, so the addition of image-based tracking has been proposed as a hybrid EM-image-based system. METHODS: When EM tracking is used as an initialization for image registration, small changes in the initialization may lead to different local minima and noise is amplified by hybrid tracking. The tracking output is modeled as continuous and uses splines for interpolation, thus smoothness is greatly improved. The bronchoscope pose relative to computed tomography data is interpolated using Catmull-Rom splines for position and spherical linear interpolation (SLERP) for orientation. RESULTS: The hybrid method was evaluated using ground truth poses manually selected by experts, where mean inter-expert agreement was determined as 1.26 mm. Using four dynamic phantom data sets, the accuracy was 4.91 mm, which is equivalent to previous methods. Compared to state-of-art methods, inter-frame smoothness was improved from 2.77-3.72 to 1.24 mm. CONCLUSIONS: Hybrid image and electromagnetic endoscope guidance provides a more realistic and physically plausible solution with significantly less jitter. This quantitative result is confirmed by visual comparison of real and virtual video, where the virtual video output is much more consistent and robust, with fewer occasions of tracking loss or unexpected movement compared with previous methods.

Image-based tracking of the teeth for orthodontic augmented reality.

We present image-based methods for tracking teeth in a video image with respect to a CT scan of the jaw, in order to enable a novel light-weight augmented reality (AR) system in orthodontistry. Its purpose is guided bracket placement in orthodontic correction. In this context, our goal is to determine the position of the patient maxilla and mandible in a video image solely based on a CT scan. This is suitable for image guidance through an overlay of the video image with the planned position of brackets in a monocular AR system. Our tracking algorithm addresses the contradicting requirements of robustness, accuracy and performance in two problem-specific formulations. First, we exploit a distance-based modulation of two iso-surfaces from the CT image to approximate the appearance of the gum line. Second, back-projection of previous video frames to an iso-surface is used to account for recently placed brackets. In combination, this novel algorithm allowed us to track several sequences of three patient videos of real procedures, despite difficult lighting conditions. Paired with a systematic evaluation, we were able to show practical feasibility of such a system.

Optimization of acquisition geometry for intra-operative tomographic imaging.

Acquisition geometries for tomographic reconstruction are usually densely sampled in order to keep the underlying linear system used in iterative reconstruction as well-posed as possible. While this objective is easily enforced in imaging systems with gantries, this issue is more critical for intra-operative setups using freehand-guided data sensing. This paper investigates an incremental method to monitor the numerical condition of the system based on the singular value decomposition of the system matrix, and presents an approach to find optimal detector positions via a randomized optimization scheme. The feasibility of this approach is demonstrated using simulations of an intra-operative functional imaging setup and actual robot-controlled phantom experiments.

Deformable registration of bronchoscopic video sequences to CT volumes with guaranteed smooth output.

We present a novel approach to tracking of flexible bronchoscopes by modeling the output as spatially continuous over time. Bronchoscopy is a widespread clinical procedure for diagnosis and treatment of lung diseases and navigation systems are highly needed. Tracking of the bronchoscope can be regarded as a deformable registration problem. In our approach we use hybrid image-based and electromagnetic tracking, and the bronchoscope pose relative to CT data is interpolated using Catmull-Rom splines for position and SLERP for orientation. We evaluate the method using ground truth poses manually selected by experts, where mean inter-expert agreement was determined as 1.26 mm. For four dynamic phantom data sets, the accuracy of our method is between 4.13 and 5.93 mm and shown to be equivalent to previous methods. We significantly improve inter-frame smoothness from 2.35-3.08 mm to 1.08-1.51 mm. Our method provides a more realistic and physically plausible solution with significantly less jitter. This quantitative result is confirmed by video output, which is much more consistent and robust, with fewer occasions of tracking loss or unexpected movement.

Magneto-optical tracking of flexible laparoscopic ultrasound: model-based online detection and correction of magnetic tracking errors.

Electromagnetic tracking is currently one of the most promising means of localizing flexible endoscopic instruments such as flexible laparoscopic ultrasound transducers. However, electromagnetic tracking is also susceptible to interference from ferromagnetic material, which distorts the magnetic field and leads to tracking errors. This paper presents new methods for real-time online detection and reduction of dynamic electromagnetic tracking errors when localizing a flexible laparoscopic ultrasound transducer. We use a hybrid tracking setup to combine optical tracking of the transducer shaft and electromagnetic tracking of the flexible transducer tip. A novel approach of modeling the poses of the transducer tip in relation to the transducer shaft allows us to reliably detect and significantly reduce electromagnetic tracking errors. For detecting errors of more than 5 mm, we achieved a sensitivity and specificity of 91% and 93%, respectively. Initial 3-D rms error of 6.91 mm were reduced to 3.15 mm.

New approaches to online estimation of electromagnetic tracking errors for laparoscopic ultrasonography.

In abdominal surgery, a laparoscopic ultrasound transducer is commonly used to detect lesions such as metastases. The determination and visualization of the position and orientation of its flexible tip in relation to the patient or other surgical instruments can be a great support for surgeons using the transducer intraoperatively. This difficult subject has recently received attention from the scientific community. Electromagnetic tracking systems can be applied to track the flexible tip; however, current limitations of electromagnetic tracking include its accuracy and sensibility, i.e., the magnetic field can be distorted by ferromagnetic material. This paper presents two novel methods for estimation of electromagnetic tracking error. Based on optical tracking of the laparoscope, as well as on magneto-optic and visual tracking of the transducer, these methods automatically detect in 85% of all cases whether tracking is erroneous or not, and reduce tracking errors by up to 2.5 mm.

Magneto-optic tracking of a flexible laparoscopic ultrasound transducer for laparoscope augmentation.

In abdominal surgery, a laparoscopic ultrasound transducer is commonly used to detect lesions such as metastases. The determination and visualization of position and orientation of its flexible tip in relation to the patient or other surgical instruments can be of much help to (novice) surgeons utilizing the transducer intraoperatively. This difficult subject has recently been paid attention to by the scientific community . Electromagnetic tracking systems can be applied to track the flexible tip. However, the magnetic field can be distorted by ferromagnetic material. This paper presents a new method based on optical tracking of the laparoscope and magneto-optic tracking of the transducer, which is able to automatically detect field distortions. This is used for a smooth augmentation of the B-scan images of the transducer directly on the camera images in real time.