Performance of image guided navigation in laparoscopic liver surgery - A systematic review.

BACKGROUND: Compared to open surgery, minimally invasive liver resection has improved short term outcomes. It is however technically more challenging. Navigated image guidance systems (IGS) are being developed to overcome these challenges. The aim of this systematic review is to provide an overview of their current capabilities and limitations. METHODS: Medline, Embase and Cochrane databases were searched using free text terms and corresponding controlled vocabulary. Titles and abstracts of retrieved articles were screened for inclusion criteria. Due to the heterogeneity of the retrieved data it was not possible to conduct a meta-analysis. Therefore results are presented in tabulated and narrative format. RESULTS: Out of 2015 articles, 17 pre-clinical and 33 clinical papers met inclusion criteria. Data from 24 articles that reported on accuracy indicates that in recent years navigation accuracy has been in the range of 8-15 mm. Due to discrepancies in evaluation methods it is difficult to compare accuracy metrics between different systems. Surgeon feedback suggests that current state of the art IGS may be useful as a supplementary navigation tool, especially in small liver lesions that are difficult to locate. They are however not able to reliably localise all relevant anatomical structures. Only one article investigated IGS impact on clinical outcomes. CONCLUSIONS: Further improvements in navigation accuracy are needed to enable reliable visualisation of tumour margins with the precision required for oncological resections. To enhance comparability between different IGS it is crucial to find a consensus on the assessment of navigation accuracy as a minimum reporting standard.

Comparison of manual and semi-automatic registration in augmented reality image-guided liver surgery: a clinical feasibility study.

BACKGROUND: The laparoscopic approach to liver resection may reduce morbidity and hospital stay. However, uptake has been slow due to concerns about patient safety and oncological radicality. Image guidance systems may improve patient safety by enabling 3D visualisation of critical intra- and extrahepatic structures. Current systems suffer from non-intuitive visualisation and a complicated setup process. A novel image guidance system (SmartLiver), offering augmented reality visualisation and semi-automatic registration has been developed to address these issues. A clinical feasibility study evaluated the performance and usability of SmartLiver with either manual or semi-automatic registration. METHODS: Intraoperative image guidance data were recorded and analysed in patients undergoing laparoscopic liver resection or cancer staging. Stereoscopic surface reconstruction and iterative closest point matching facilitated semi-automatic registration. The primary endpoint was defined as successful registration as determined by the operating surgeon. Secondary endpoints were system usability as assessed by a surgeon questionnaire and comparison of manual vs. semi-automatic registration accuracy. Since SmartLiver is still in development no attempt was made to evaluate its impact on perioperative outcomes. RESULTS: The primary endpoint was achieved in 16 out of 18 patients. Initially semi-automatic registration failed because the IGS could not distinguish the liver surface from surrounding structures. Implementation of a deep learning algorithm enabled the IGS to overcome this issue and facilitate semi-automatic registration. Mean registration accuracy was 10.9 ± 4.2 mm (manual) vs. 13.9 ± 4.4 mm (semi-automatic) (Mean difference - 3 mm; p = 0.158). Surgeon feedback was positive about IGS handling and improved intraoperative orientation but also highlighted the need for a simpler setup process and better integration with laparoscopic ultrasound. CONCLUSION: The technical feasibility of using SmartLiver intraoperatively has been demonstrated. With further improvements semi-automatic registration may enhance user friendliness and workflow of SmartLiver. Manual and semi-automatic registration accuracy were comparable but evaluation on a larger patient cohort is required to confirm these findings.

3-D Pose Estimation of Articulated Instruments in Robotic Minimally Invasive Surgery.

Estimating the 3-D pose of instruments is an important part of robotic minimally invasive surgery for automation of basic procedures as well as providing safety features, such as virtual fixtures. Image-based methods of 3-D pose estimation provide a non-invasive low cost solution compared with methods that incorporate external tracking systems. In this paper, we extend our recent work in estimating rigid 3-D pose with silhouette and optical flow-based features to incorporate the articulated degrees-of-freedom (DOFs) of robotic instruments within a gradient-based optimization framework. Validation of the technique is provided with a calibrated ex-vivo study from the da Vinci Research Kit (DVRK) robotic system, where we perform quantitative analysis on the errors each DOF of our tracker. Additionally, we perform several detailed comparisons with recently published techniques that combine visual methods with kinematic data acquired from the joint encoders. Our experiments demonstrate that our method is competitively accurate while relying solely on image data.

Detection and modelling of contacts in explicit finite-element simulation of soft tissue biomechanics.

PURPOSE: Realistic modelling of soft tissue biomechanics and mechanical interactions between tissues is an important part of biomechanically-informed surgical image-guidance and surgical simulation. This submission details a contact-modelling pipeline suitable for implementation in explicit matrix-free FEM solvers. While these FEM algorithms have been shown to be very suitable for simulation of soft tissue biomechanics and successfully used in a number of image-guidance systems, contact modelling specifically for these solvers is rarely addressed, partly because the typically large number of time steps required with this class of FEM solvers has led to a perception of them being a poor choice for simulations requiring complex contact modelling. METHODS: The presented algorithm is capable of handling most scenarios typically encountered in image-guidance. The contact forces are computed with an evolution of the Lagrange-multiplier method first used by Taylor and Flanagan in PRONTO 3D extended with spatio-temporal smoothing heuristics for improved stability and edge-edge collision handling, and a new friction model. For contact search, a bounding-volume hierarchy (BVH) is employed, which is capable of identifying self-collisions by means of the surface-normal bounding cone of Volino and Magnenat-Thalmann, in turn computed with a novel formula. The BVH is further optimised for the small time steps by reducing the number of bounding-volume refittings between iterations through identification of regions with mostly rigid motion and negligible deformation. Further optimisation is achieved by integrating the self-collision criterion in the BVH creation and updating algorithms. RESULTS: The effectiveness of the algorithm is demonstrated on a number of artificial test cases and meshes derived from medical image data. It is shown that the proposed algorithm reduces the cost of BVH refitting to the point where it becomes a negligible part of the overall computation time of the simulation. It is also shown that the proposed surface-normal cone computation formula leads to about 40 % fewer BVH subtrees that must be checked for self-collisions compared with the widely used method of Provot. The proposed contact-force formulation and friction model are evaluated on artificial test cases that allow for a comparison with a ground truth. The quality of the proposed contact forces is assessed in terms of trajectories and energy conservation; a [Formula: see text]0.4 % drop off in total energy and highly plausible trajectories are found in the experiments. The friction model is evaluated through a benchmark problem with an analytical solution and a maximum displacement error of 8.2 %, and excellent agreement in terms of the stick/slip boundary is found. Finally, we show with realistic image-guidance examples that the entire contact-modelling pipeline can be executed within a timeframe that is of the same order of magnitude as that required for standard FEM computations.

Patient-specific respiratory models using dynamic 3D MRI: preliminary volunteer results.

Organ and tumour motion has a significant impact on the planning and delivery of radiotherapy treatment. At present imaging modality such as four-dimensional computer tomography (4DCT) cannot be used to measure the variability of motion between different respiratory cycles. To create reliable motion models, one needs to acquire volumetric data sets of the lungs with sufficient sampling of the breathing cycle. In this paper we investigate the use of highly parallel MRI to acquire such data. A 32 channel coil in conjunction with a balanced SSFP sequence and a SENSE factor of 6 were used to acquire volumetric data sets in five healthy volunteers. The acquisition was repeated for seven series of different breathing patterns. The data acquired was of sufficient spatial resolution (5 × 5 × 5 mm(3)) and image quality to carry out automated non-rigid registration. The acquisition rate (c.a. 2 volumes per second) allowed for a meaningful sampling of the different respiratory curves that were automatically obtained from the skin surface motion. This acquisition technique should provide images of high enough quality to create statistical respiratory models.

Respiratory motion models: a review.

The problem of respiratory motion has proved a serious obstacle in developing techniques to acquire images or guide interventions in abdominal and thoracic organs. Motion models offer a possible solution to these problems, and as a result the field of respiratory motion modelling has become an active one over the past 15 years. A motion model can be defined as a process that takes some surrogate data as input and produces a motion estimate as output. Many techniques have been proposed in the literature, differing in the data used to form the models, the type of model employed, how this model is computed, the type of surrogate data used as input to the model in order to make motion estimates and what form this output should take. In addition, a wide range of different application areas have been proposed. In this paper we summarise the state of the art in this important field and in the process highlight the key papers that have driven its advance. The intention is that this will serve as a timely review and comparison of the different techniques proposed to date and as a basis to inform future research in this area.

The effect of motion correction on pharmacokinetic parameter estimation in dynamic-contrast-enhanced MRI.

A dynamic-contrast-enhanced magnetic resonance imaging (DCE-MRI) dataset consists of many imaging frames, often acquired both before and after contrast injection. Due to the length of time spent acquiring images, patient motion is likely and image re-alignment or registration is required before further analysis such as pharmacokinetic model fitting. Non-rigid image registration procedures may be used to correct motion artefacts; however, a careful choice of registration strategy is required to reduce misregistration artefacts associated with enhancing features. This work investigates the effect of registration on the results of model-fitting algorithms for 52 DCE-MR mammography cases for 14 patients. Results are divided into two sections: a comparison of registration strategies in which a DCE-MRI-specific algorithm is preferred in 50% of cases, followed by an investigation of parameter changes with known applied deformations, inspecting the effect of magnitude and timing of motion artefacts. Increased motion magnitude correlates with increased model-fit residual and is seen to have a strong influence on the visibility of strongly enhancing features. Motion artefacts in images close to the contrast agent arrival have a disproportionate effect on discrepancies in parameter estimation. The choice of algorithm, magnitude of motion and timing of the motion are each shown to influence estimated pharmacokinetic parameters even when motion magnitude is small.

Inter-fraction variations in respiratory motion models.

Respiratory motion can vary dramatically between the planning stage and the different fractions of radiotherapy treatment. Motion predictions used when constructing the radiotherapy plan may be unsuitable for later fractions of treatment. This paper presents a methodology for constructing patient-specific respiratory motion models and uses these models to evaluate and analyse the inter-fraction variations in the respiratory motion. The internal respiratory motion is determined from the deformable registration of Cine CT data and related to a respiratory surrogate signal derived from 3D skin surface data. Three different models for relating the internal motion to the surrogate signal have been investigated in this work. Data were acquired from six lung cancer patients. Two full datasets were acquired for each patient, one before the course of radiotherapy treatment and one at the end (approximately 6 weeks later). Separate models were built for each dataset. All models could accurately predict the respiratory motion in the same dataset, but had large errors when predicting the motion in the other dataset. Analysis of the inter-fraction variations revealed that most variations were spatially varying base-line shifts, but changes to the anatomy and the motion trajectories were also observed.

Motion artifact correction in free-breathing abdominal MRI using overlapping partial samples to recover image deformations.

This article presents a method to reconstruct liver MRI data acquired continuously during free breathing, without any external sensor or navigator measurements. When the deformations associated with k-space data are known, generalized matrix inversion reconstruction has been shown to be effective in reducing the ghosting and blurring artifacts of motion. This article describes a novel method to obtain these nonrigid deformations. A breathing model is built from a fast dynamic series: low spatial resolution images are registered and their deformations parameterized by overall superior-inferior displacement. The correct deformation for each subset of the subsequent imaging data is then found by comparing a few lines of k-space with the equivalent lines from a deformed reference image while varying the deformation over the model parameter. This procedure is known as image deformation recovery using overlapping partial samples (iDROPS). Simulations using 10 rapid dynamic studies from volunteers showed the average error in iDROPS-derived deformations within the liver to be 1.43 mm. A further four volunteers were imaged at higher spatial resolution. The complete reconstruction process using data from throughout several breathing cycles was shown to reduce blurring and ghosting in the liver. Retrospective respiratory gating was also demonstrated using the iDROPS parameterization.

A subject-specific technique for respiratory motion correction in image-guided cardiac catheterisation procedures.

We describe a system for respiratory motion correction of MRI-derived roadmaps for use in X-ray guided cardiac catheterisation procedures. The technique uses a subject-specific affine motion model that is quickly constructed from a short pre-procedure MRI scan. We test a dynamic MRI sequence that acquires a small number of high resolution slices, rather than a single low resolution volume. Additionally, we use prior knowledge of the nature of cardiac respiratory motion by constraining the model to use only the dominant modes of motion. During the procedure the motion of the diaphragm is tracked in X-ray fluoroscopy images, allowing the roadmap to be updated using the motion model. X-ray image acquisition is cardiac gated. Validation is performed on four volunteer datasets and three patient datasets. The accuracy of the model in 3D was within 5mm in 97.6% of volunteer validations. For the patients, 2D accuracy was improved from 5 to 13mm before applying the model to 2-4mm afterwards. For the dynamic MRI sequence comparison, the highest errors were found when using the low resolution volume sequence with an unconstrained model.

On modelling of anisotropic viscoelasticity for soft tissue simulation: numerical solution and GPU execution.

Efficient and accurate techniques for simulation of soft tissue deformation are an increasingly valuable tool in many areas of medical image computing, such as biomechanically-driven image registration and interactive surgical simulation. For reasons of efficiency most analyses are based on simplified linear formulations, and previously almost all have ignored well established features of tissue mechanical response such as anisotropy and time-dependence. We address these latter issues by firstly presenting a generalised anisotropic viscoelastic constitutive framework for soft tissues, particular cases of which have previously been used to model a wide range of tissues. We then develop an efficient solution procedure for the accompanying viscoelastic hereditary integrals which allows use of such models in explicit dynamic finite element algorithms. We show that the procedure allows incorporation of both anisotropy and viscoelasticity for as little as 5.1% additional cost compared with the usual isotropic elastic models. Finally we describe the implementation of a new GPU-based finite element scheme for soft tissue simulation using the CUDA API. Even with the inclusion of more elaborate constitutive models as described the new implementation affords speed improvements compared with our recent graphics API-based implementation, and compared with CPU execution a speed up of 56.3 x is achieved. The validity of the viscoelastic solution procedure and performance of the GPU implementation are demonstrated with a series of numerical examples.

Quantification of blood flow from rotational angiography.

For assessment of cerebrovascular diseases, it is beneficial to obtain three-dimensional (3D) information on vessel morphology and hemodynamics. Rotational angiography is routinely used to determine the 3D geometry and we propose a method to exploit the same acquisition to determine the blood flow waveform and the mean volumetric flow rate. The method uses a model of contrast agent dispersion to determine the flow parameters from the spatial and temporal development of the contrast agent concentration, represented by a flow map. Furthermore, it also overcomes artifacts due to the rotation of the c-arm using a newly introduced reliability map. The method was validated on images from a computer simulation and from a phantom experiment. With a mean error of 11.0% for the mean volumetric flow rate and 15.3% for the blood flow waveform from the phantom experiments, we conclude that the method has the potential to give quantitative estimates of blood flow parameters during cerebrovascular interventions.

Tracking 'differential organ motion' with a 'breathing' multileaf collimator: magnitude of problem assessed using 4D CT data and a motion-compensation strategy.

Intrafraction tumour (e.g. lung) motion due to breathing can, in principle, be compensated for by applying identical breathing motions to the leaves of a multileaf collimator (MLC) as intensity-modulated radiation therapy is delivered by the dynamic MLC (DMLC) technique. A difficulty arising, however, is that irradiated voxels, which are in line with a bixel at one breathing phase (at which the treatment plan has been made), may move such that they cease to be in line with that breathing bixel at another phase. This is the phenomenon of differential voxel motion and existing tracking solutions have ignored this very real problem. There is absolutely no tracking solution to the problem of compensating for differential voxel motion. However, there is a strategy that can be applied in which the leaf breathing is determined to minimize the geometrical mismatch in a least-squares sense in irradiating differentially-moving voxels. A 1D formulation in very restricted circumstances is already in the literature and has been applied to some model breathing situations which can be studied analytically. These are, however, highly artificial. This paper presents the general 2D formulation of the problem including allowing different importance factors to be applied to planning target volume and organ at risk (or most generally) each voxel. The strategy also extends the literature strategy to the situation where the number of voxels connecting to a bixel is a variable. Additionally the phenomenon of 'cross-leaf-track/channel' voxel motion is formally addressed. The general equations are presented and analytic results are given for some 1D, artificially contrived, motions based on the Lujan equations of breathing motion. Further to this, 3D clinical voxel motion data have been extracted from 4D CT measurements to both assess the magnitude of the problem of 2D motion perpendicular to the beam-delivery axis in clinical practice and also to find the 2D optimum breathing-leaf strategy. Issues relating to the practical calculation of the strategy, including effects on leaf velocity and effects of different spatial-sampling frequencies, have been investigated, and unattenuated-fluence maps have been produced showing the effects of the differential motion and tracking. It was discovered that large distances between adjacent leaf-ends could cause the tracking to fail when there was tissue motion across the leaf channels. To overcome this problem the use of 'synchronized' leaf trajectories, which ensure that adjacent leaf-ends are always close enough to each other to facilitate tracking, has also been investigated.

MRI-based measurements of respiratory motion variability and assessment of imaging strategies for radiotherapy planning.

Respiratory organ motion has a significant impact on the planning and delivery of radiotherapy (RT) treatment for lung cancer. Currently widespread techniques, such as 4D-computed tomography (4DCT), cannot be used to measure variability of this motion from one cycle to the next. In this paper, we describe the use of fast magnetic resonance imaging (MRI) techniques to investigate the intra- and inter-cycle reproducibility of respiratory motion and also to estimate the level of errors that may be introduced into treatment delivery by using various breath-hold imaging strategies during lung RT planning. A reference model of respiratory motion is formed to enable comparison of different breathing cycles at any arbitrary position in the respiratory cycle. This is constructed by using free-breathing images from the inhale phase of a single breathing cycle, then co-registering the images, and thereby tracking landmarks. This reference model is then compared to alternative models constructed from images acquired during the exhale phase of the same cycle and the inhale phase of a subsequent cycle, to assess intra- and inter-cycle variability ('hysteresis' and 'reproducibility') of organ motion. The reference model is also compared to a series of models formed from breath-hold data at exhale and inhale. Evaluation of these models is carried out on data from ten healthy volunteers and five lung cancer patients. Free-breathing models show good levels of intra- and inter-cycle reproducibility across the tidal breathing range. Mean intra-cycle errors in the position of organ surface landmarks of 1.5(1.4)-3.5(3.3) mm for volunteers and 2.8(1.8)-5.2(5.2) mm for patients. Equivalent measures of inter-cycle variability across this range are 1.7(1.0)-3.9(3.3) mm for volunteers and 2.8(1.8)-3.3(2.2) mm for patients. As expected, models based on breath-hold sequences do not represent normal tidal motion as well as those based on free-breathing data, with mean errors of 4.4(2.2)-7.7(3.9) mm for volunteers and 10.1(6.1)-12.5(6.3) mm for patients. Errors are generally larger still when using a single breath-hold image at either exhale or inhale to represent the lung. This indicates that account should be taken of intra- and inter-cycle respiratory motion variability and that breath-hold-based methods of obtaining data for RT planning may potentially introduce large errors. This approach to analysis of motion and variability has potential to inform decisions about treatment margins and optimize RT planning.

Cadaver validation of intensity-based ultrasound to CT registration.

A method is presented for the rigid registration of tracked B-mode ultrasound images to a CT volume of a femur and pelvis. This registration can allow tracked surgical instruments to be aligned with the CT image or an associated preoperative plan. Our method is fully automatic and requires no manual segmentation of either the ultrasound images or the CT volume. The parameter which is directly related to the speed of sound through tissue has also been included in the registration optimisation process. Experiments have been carried out on six cadaveric femurs and three cadaveric pelves. Registration results were compared with a "gold standard" registration acquired using bone implanted fiducial markers. Results show the registration method to be accurate, on average, to 1.6 mm root-mean-square target registration error.

Anisotropic multi-scale fluid registration: evaluation in magnetic resonance breast imaging.

Registration using models of compressible viscous fluids has not found the general application of some other techniques (e.g., free-form-deformation (FFD)) despite its ability to model large diffeomorphic deformations. We report on a multi-resolution fluid registration algorithm which improves on previous work by (a) directly solving the Navier-Stokes equation at the resolution of the images, (b) accommodating image sampling anisotropy using semi-coarsening and implicit smoothing in a full multi-grid (FMG) solver and (c) exploiting the inherent multi-resolution nature of FMG to implement a multi-scale approach. Evaluation is on five magnetic resonance (MR) breast images subject to six biomechanical deformation fields over 11 multi-resolution schemes. Quantitative assessment is by tissue overlaps and target registration errors and by registering using the known correspondences rather than image features to validate the fluid model. Context is given by comparison with a validated FFD algorithm and by application to images of volunteers subjected to large applied deformation. The results show that fluid registration of 3D breast MR images to sub-voxel accuracy is possible in minutes on a 1.6 GHz Linux-based Athlon processor with coarse solutions obtainable in a few tens of seconds. Accuracy and computation time are comparable to FFD techniques validated for this application.

Tissue deformation and shape models in image-guided interventions: a discussion paper.

This paper promotes the concept of active models in image-guided interventions. We outline the limitations of the rigid body assumption in image-guided interventions and describe how intraoperative imaging provides a rich source of information on spatial location of anatomical structures and therapy devices, allowing a preoperative plan to be updated during an intervention. Soft tissue deformation and variation from an atlas to a particular individual can both be determined using non-rigid registration. Established methods using free-form deformations have a very large number of degrees of freedom. Three examples of deformable models--motion models, biomechanical models and statistical shape models--are used to illustrate how prior information can be used to restrict the number of degrees of freedom of the registration algorithm and thus provide active models for image-guided interventions. We provide preliminary results from applications for each type of model.

Assessment of a technique for 2D-3D registration of cerebral intra-arterial angiography.

This study assesses the ability of a computer algorithm to perform automated 2D-3D registrations of digitally subtracted cerebral angiograms. The technique was tested on clinical studies of five patients with intracranial aneurysms. The automated procedure was compared against a gold standard manual registration, and achieved a mean registration accuracy of 1.3 mm (SD 0.6 mm). Two registration strategies were tested using coarse (128 x 128 pixel) or fine (256 x 256 pixel) images. The mean registration errors proved similar but registration of the lower resolution images was 3 times quicker (mean registration times 33 s, SD 13 s for low and 150 s SD 48 s for high resolution images). The automated techniques were considerably faster than manual registrations but achieved similar accuracy. The technique has several potential uses but is particularly applicable to endovascular treatment techniques.

Registration of freehand 3D ultrasound and magnetic resonance liver images.

We present a method to register a preoperative MR volume to a sparse set of intraoperative ultrasound slices. Our aim is to allow the transfer of information from preoperative modalities to intraoperative ultrasound images to aid needle placement during thermal ablation of liver metastases. The spatial relationship between ultrasound slices is obtained by tracking the probe using a Polaris optical tracking system. Images are acquired at maximum exhalation and we assume the validity of the rigid body transformation. An initial registration is carried out by picking a single corresponding point in both modalities. Our strategy is to interpret both sets of images in an automated pre-processing step to produce evidence or probabilities of corresponding structure as a pixel or voxel map. The registration algorithm converts the intensity values of the MR and ultrasound images into vessel probability values. The registration is then carried out between the vessel probability images. Results are compared to a "bronze standard" registration which is calculated using a manual point/line picking algorithm and verified using visual inspection. Results show that our starting estimate is within a root mean square target registration error (calculated over the whole liver) of 15.4 mm to the "bronze standard" and this is improved to 3.6 mm after running the intensity-based algorithm.

Zen and the art of medical image registration: correspondence, homology, and quality.

Nonrigid registration (NRR) is routinely used in the study of neuroanatomy and function and is a standard component of analysis packages such as SPM. There remain many unresolved correspondence problems that arise from attempts to associate functional areas with specific neuroanatomy and to compare both function and anatomy across patient groups. Problems can result from ignorance of the underlying neurology which is then compounded by unjustified inferences drawn from the results of NRR. Usually the magnitude, distribution, and significance of errors in NRR are unknown so the errors in correspondences determined by NRR are also unknown and their effect on experimental results cannot easily be quantified. In this paper we review the principles by which the presumed correspondence and homology of structures is used to drive registration and identify the conceptual and algorithmic areas where current techniques are lacking. We suggest that for applications using NRR to be robust and achieve their potential, context-specific definitions of correspondence must be developed which properly characterise error. Prior knowledge of image content must be utilised to monitor and guide registration and gauge the degree of success. The use of NRR in voxel-based morphometry is examined from this context and found wanting. We conclude that a move away from increasingly sophisticated but context-free registration technology is required and that the veracity of studies that rely on NRR should be keenly questioned when the error distribution is unknown and the results are unsupported by other contextual information.