Stretched reconstruction based on 2D freehand ultrasound for peripheral artery imaging.

PURPOSE: Endovascular revascularization is becoming the established first-line treatment of peripheral artery disease (PAD). Ultrasound (US) imaging is used pre-operatively to make the first diagnosis and is often followed by a CT angiography (CTA). US provides a non-invasive and non-ionizing method for the visualization of arteries and lesion(s). This paper proposes to generate a 3D stretched reconstruction of the femoral artery from a sequence of 2D US B-mode frames. METHODS: The proposed method is solely image-based. A Mask-RCNN is used to segment the femoral artery on the 2D US frames. In-plane registration is achieved by aligning the artery segmentation masks. Subsequently, a convolutional neural network (CNN) predicts the out-of-plane translation. After processing all input frames and re-sampling the volume according to the vessel's centerline, the whole femoral artery can be visualized on a single slice of the resulting stretched view. RESULTS: 111 tracked US sequences of the left or right femoral arteries have been acquired on 18 healthy volunteers. fivefold cross-validation was used to validate our method and achieve an absolute mean error of 0.28 ± 0.28 mm and a median drift error of 8.98%. CONCLUSION: This study demonstrates the feasibility of freehand US stretched reconstruction following a deep learning strategy for imaging the femoral artery. Stretched views are generated and can give rich diagnosis information in the pre-operative planning of PAD procedures. This visualization could replace traditional 3D imaging in the pre-operative planning process, and during the pre-operative diagnosis phase, to identify, locate, and size stenosis/thrombosis lesions.

EndoNaut two-dimensional fusion imaging with a mobile C-arm for endovascular treatment of occlusive peripheral arterial disease.

BACKGROUND: Endovascular treatment has become the first-line strategy for peripheral arterial disease (PAD). Given the number of procedures required, any technology associated with a reduction in radiation exposure and contrast volume is highly relevant. In the present study, we evaluated whether two-dimensional (2D) fusion imaging could reduce the radiation exposure and contrast volume during endovascular treatment of occlusive PAD. METHODS: Our consecutive, retrospective, single-center, nonrandomized comparative trial included patients with PAD at the femoral, popliteal, and/or tibial level, at any clinical stage, if they were candidates for endovascular revascularization. Patients were treated with or without the EndoNaut 2D fusion imaging system (Therenva, Rennes, France) in a nonhybrid room with the same Cios Alpha mobile C-arm (Siemens, Munich, Germany). The indirect dose-area product and contrast medium volume were recorded. RESULTS: Between March 2018 and April 2020, 255 patients underwent endovascular femoropopliteal revascularization with (n = 124) or without (n = 131) 2D fusion imaging. The volume of injected contrast medium (34.7 ± 13.8 mL vs 51.3 ± 26.7 mL; P < .001) and dose-area product (8.9 ± 9.9 Gy/cm2 vs 13.5 ± 14.0 Gy/cm2; P = .003) were significantly lower for the 2D fusion imaging group than for the control group. A subgroup analysis of complex (TransAtlantic Inter-Society Consensus for the Management of Peripheral Arterial Disease C/D) lesions showed similar results. Stratification of the fusion imaging group into three subgroups, according to the procedure dates, showed no effect of a potential learning curve on the operative parameters. CONCLUSIONS: The results from the present study showed a significant reduction in the contrast volume and radiation dose for endovascular treatment of PAD when applying 2D fusion imaging technology. Overall, a reduction of >30% was observed for both operative parameters, without excessive training requirements, highlighting the potential benefits of using 2D fusion imaging when performing endovascular revascularization for PAD.

A new software tool for planning interventional procedures in liver cancer.

INTRODUCTION: Intra-arterial therapy is an effective way of performing chemotherapy or radiation therapy in patients with primary liver cancer (i.e. hepatocellular carcinoma). Although this minimally invasive approach is now an established treatment option, support tools for pre-operative planning and intra-operative assistance might be helpful. MATERIAL AND METHODS: We developed an approach for semi-automatic segmentation of computed tomography angiography images of the main arterial branches (required for access path to the treatment site), automatic segmentation of the liver, arterial and venous tree, and interactive segmentation of the tumors (required for procedure-specific planning). This approach was then integrated into a liver-specific workflow within EndoSize® solution, a planning software for endovascular procedures. The main branches extraction approach was qualitatively evaluated inside the software, while the automatic segmentation methods were quantitatively assessed. RESULTS: Main branches extraction provides a success rate of 85% (i.e. all arteries correctly extracted) in a dataset of 172 patients. On public databases, a mean DICE of 0.91, 0.47 and 0.92 was obtained for liver, venous and arterial trees segmentation, respectively. CONCLUSIONS: This pipeline is suitable for directly accessing the treatment site, giving anatomic measurements, and visualizing the hepatic trees, liver, and surrounding arteries during the pre-operative planning. ABBREVIATIONS: HCC: hepatocellular carcinoma; TACE: transarterial chemoembolization; SIRT: selective internal radiation therapy; CT: computed tomography; CTA: computed tomography angiography; AMS: superior mesenteric artery; LGA: left gastric artery; RHA: right hepatic artery; LHA: left hepatic artery; rbHA: right branch of the hepatic artery; lbHA: left branch of the hepatic artery; GDA: gastroduodenal artery; VOI: volume of interest; SD: standard deviation; MICCAI: medical image computing and computer assisted interventions; MR: magnetic resonance.

Fusion Imaging with a Mobile C-Arm for Peripheral Arterial Disease.

BACKGROUND: Fusion imaging makes it possible to improve endovascular procedures and is mainly used in hybrid rooms for aortic procedures. The objective of this study was to evaluate the feasibility of fusion imaging for femoropopliteal endovascular procedures with a mobile flat plane sensor and dedicated software to assist endovascular navigation. MATERIALS AND METHODS: Between May and December 2017, 41 patients requiring femoropopliteal endovascular revascularization were included. Interventions were carried out in a conventional surgical room equipped with a mobile plane sensor (Cios Alpha, Siemens). The numerical video stream was transmitted to an angionavigation station (EndoNaut (EN), Therenva). The software created an osseous and arterial panorama of the treated limb from the angiographies carried out at the beginning of procedure. After each displacement of the table, the software relocated the current image on the osseous panorama, with 2D-2D resetting, and amalgamated the mask of the arterial panorama. The success rates of creation of osseous and arterial panorama and the success of relocation were evaluated. The data concerning irradiation, the volume of contrast (VC) injected, and operative times were recorded. RESULTS: Osseous panoramas could be automatically generated for the 41 procedures, without manual adjustment in 33 cases (80.5%). About 35 relocations based on a 2D-2D resetting could be obtained in the 41 procedures, with a success rate of 85%. The causes of failure were a change in table height or arch angulation. The average duration of intervention was 74.5 min. The irradiation parameters were duration of fluoroscopy 17.8 ± 13.1 min, air kerma 80.5 ± 68.4 mGy, and dose area product 2140 ± 1599 µGy m2. The average VC was 24.5 ± 14 mL. CONCLUSIONS: This preliminary study showed that fusion imaging is possible in a nonhybrid room for peripheral procedures. Imagery of mobile C-arms can be improved for femoropopliteal endovascular procedures without heavy equipment. These imagery tools bring an operative comfort and could probably reduce irradiation and the injected VC. The clinical benefit must be evaluated in more patients in a randomized comparative study with a rigorous methodology.

Catheter navigation support for liver radioembolization guidance: feasibility of structure-driven intensity-based registration.

PURPOSE: The fusion of pre/intraoperative images may improve catheter manipulation during radioembolization (RE) interventions by adding relevant information. The objective of this work is to propose and evaluate the performance of a RE guidance strategy relying on structure-driven intensity-based registration between preoperative CTA and intraoperative X-ray images. METHODS: The navigation strategy is decomposed into three image fusion steps, supporting the catheter navigation from the femoral artery till reaching the injection site (IS). During the pretreatment assessment intervention, the aorta and the origins of its side branches are projected on the intraoperative 2D fluoroscopy following a 3D/2D bone-based registration process, to assist the celiac trunk access. Subsequently, a similar approach consisting in projecting the hepatic vasculature on intraoperative DSA through 3D/2D vessel-based registration is performed to assist the IS location. Lastly, the selected IS is reproduced during the treatment intervention by employing 2D/2D image-based registration between pretreatment and treatment fluoroscopic images. RESULTS: The three fusion steps were independently evaluated on subsets of 20, 19 and 5 patient cases, respectively. Best results were obtained with gradient difference as similarity measure and with a delimited preoperative vascular structure for vessel-based registration. The approach resulted in qualitatively appropriate anatomical correspondences when projecting the preoperative structures on intraoperative images. With the best configuration, the registration steps showed accuracy and feasibility in aligning data, with global mean landmarks errors of 1.59 mm, 2.32 mm and 2.17 mm, respectively, a computation time that never exceeded 5 s, 25 s and 11 s, respectively, and a user interaction limited to manual initialization of the 3D/2D registration. CONCLUSION: An image fusion-based approach has been specifically proposed for RE procedures guidance. The catheter manipulation strategy based on the fusion of pre- and intraoperative images has the potential to support different steps of the RE clinical workflow and to guide the overall procedure.

Use of Numerical Simulation to Predict Iliac Complications During Placement of An Aortic Stent Graft.

BACKGROUND: During endovascular aneurysm repair (EVAR), complex iliac anatomy is a source of complications such as unintentional coverage of the hypogastric artery. The aim of our study was to evaluate ability to predict coverage of the hypogastric artery using a biomechanical model simulating arterial deformations caused by the delivery system. METHODS: The biomechanical model of deformation has been validated by many publications. The simulations were performed on 38 patients included retrospectively, for a total of 75 iliac arteries used for the study. On the basis of objective measurements, two groups were formed: one with "complex" iliac anatomy (n = 38 iliac arteries) and the other with "simple" iliac anatomy (n = 37 iliac arteries). The simulation enabled measurement of the lengths of the aorta and the iliac arteries once deformed by the device. Coverage of the hypogastric artery was predicted if the deformed renal/iliac bifurcation length (Lpre) was less than the length of the implanted device (Lstent-measured on the postoperative computed tomography [CT]) and nondeformed Lpre was greater than Lstent. RESULTS: Nine (12%) internal iliac arteries were covered unintentionally. Of the coverage attributed to perioperative deformations, 1 case (1.3%) occurred with simple anatomy and 6 (8.0%) with complex anatomy (P = 0.25). All cases of unintentional coverage were predicted by the simulation. The simulation predicted hypogastric coverage in 35 cases (46.7%). There were therefore 26 (34.6%) false positives. The simulation had a sensitivity of 100% and a specificity of 60.6%. On multivariate analysis, the factors significantly predictive of coverage were the iliac tortuosity index (P = 0.02) and the predicted margin between the termination of the graft limb and the origin of the hypogastric artery in nondeformed (P = 0.009) and deformed (P = 0.001) anatomy. CONCLUSIONS: Numerical simulation is a sensitive tool for predicting the risk of hypogastric coverage during EVAR and allows more precise preoperative sizing. Its specificity is liable to be improved by using a larger cohort.

Fusion Imaging for EVAR with Mobile C-arm.

BACKGROUND: Fusion imaging is a technique that facilitates endovascular navigation but is only available in hybrid rooms. The goal of this study was to evaluate the feasibility of fusion imaging with a mobile C-arm in a conventional operating room through the use of an angionavigation station. METHODS: From May 2016 to June 2017, the study included all patients who underwent an aortic stent graft procedure in a conventional operating room with a mobile flat-panel detector (Cios Alpha, Siemens) connected to an angionavigation station (EndoNaut, Therenva). The intention was to perform preoperative 3D computerized tomography/perioperative 2D fluoroscopy fusion imaging using an automatic registration process. Registration was considered successful when the software was able to correctly overlay preoperative 3D vascular structures onto the fluoroscopy image. For EVAR, contrast dose, operation time, and fluoroscopy time (FT) were compared with those of a control group drawn from the department's database who underwent a procedure with a C-arm image intensifier. RESULTS: The study included 54 patients, and the procedures performed were 49 EVAR, 2 TEVAR, 2 IBD, and 1 FEVAR. Of the 178 registrations that were initialized, it was possible to use the fusion imaging in 170 cases, that is, a 95.5% success rate. In the EVAR comparison, there were no difference with the control group (n = 103) for FT (21.9 ± 12 vs. 19.5 ± 13 min; P = 0.27), but less contrast agent was used in the group undergoing a procedure with the angionavigation station (42.3 ± 22 mL vs. 81.2 ± 48 mL; P < 0.001), and operation time was shorter (114 ± 44 vs. 140.8 ± 38 min; P < 0.0001). CONCLUSIONS: Fusion imaging is feasible with a mobile C-arm in a conventional operating room and thus represents an alternative to hybrid rooms. Its clinical benefits should be evaluated in a randomized series, but our study already suggests that EVAR procedures might be facilitated with an angionavigation system.

A hybrid image fusion system for endovascular interventions of peripheral artery disease.

PURPOSE: Interventional endovascular treatment has become the first line of management in the treatment of peripheral artery disease (PAD). However, contrast and radiation exposure continue to limit the feasibility of these procedures. This paper presents a novel hybrid image fusion system for endovascular intervention of PAD. We present two different roadmapping methods from intra- and pre-interventional imaging that can be used either simultaneously or independently, constituting the navigation system. METHODS: The navigation system is decomposed into several steps that can be entirely integrated within the procedure workflow without modifying it to benefit from the roadmapping. First, a 2D panorama of the entire peripheral artery system is automatically created based on a sequence of stepping fluoroscopic images acquired during the intra-interventional diagnosis phase. During the interventional phase, the live image can be synchronized on the panorama to form the basis of the image fusion system. Two types of augmented information are then integrated. First, an angiography panorama is proposed to avoid contrast media re-injection. Information exploiting the pre-interventional computed tomography angiography (CTA) is also brought to the surgeon by means of semiautomatic 3D/2D registration on the 2D panorama. Each step of the workflow was independently validated. RESULTS: Experiments for both the 2D panorama creation and the synchronization processes showed very accurate results (errors of 1.24 and [Formula: see text] mm, respectively), similarly to the registration on the 3D CTA (errors of [Formula: see text] mm), with minimal user interaction and very low computation time. First results of an on-going clinical study highlighted its major clinical added value on intraoperative parameters. CONCLUSION: No image fusion system has been proposed yet for endovascular procedures of PAD in lower extremities. More globally, such a navigation system, combining image fusion from different 2D and 3D image sources, is novel in the field of endovascular procedures.

Generic thrombus segmentation from pre- and post-operative CTA.

PURPOSE: Abdominal aortic aneurysm (AAA) is a localized, permanent and irreversible enlargement of the artery, with the formation of thrombus into the inner wall of the aneurysm. A precise patient-specific segmentation of the thrombus is useful for both the pre-operative planning to estimate the rupture risk, and for post-operative assessment to monitor the disease evolution. This paper presents a generic approach for 3D segmentation of thrombus from patients suffering from AAA using computed tomography angiography (CTA) scans. METHODS: A fast and versatile thrombus segmentation approach has been developed. It is composed of initial centerline detection and aorta lumen segmentation, an optimized pre-processing stage and the use of a 3D deformable model. The approach has been designed to be very generic and requires minimal user interaction. The proposed method was tested on different datasets with 145 patients overall, including pre- and post-operative CTAs, abdominal aorta and iliac artery sections, different calcification degrees, aneurysm sizes and contrast enhancement qualities. RESULTS: The thrombus segmentation approach showed very accurate results with respect to manual delineations for all datasets ([Formula: see text] and [Formula: see text] for abdominal aorta sections on pre-operative CTA, iliac artery sections on pre-operative CTAs and aorta sections on post-operative CTA, respectively). Experiments on the different patient and image conditions showed that the method was highly versatile, with no significant differences in term of precision. Comparison with the level-set algorithm also demonstrated the superiority of the 3D deformable model. Average processing time was [Formula: see text]. CONCLUSION: We presented a near-automatic and generic thrombus segmentation algorithm applicable to a large variability of patient and imaging conditions. When integrated in an endovascular planning system, our segmentation algorithm shows its compatibility with clinical routine and could be used for pre-operative planning and post-operative assessment of endovascular procedures.

Influencing factors of sac shrinkage after endovascular aneurysm repair.

OBJECTIVE: Sac shrinkage is considered a reliable surrogate marker of success after endovascular aneurysm repair (EVAR). Whereas sac shrinkage is the best expected outcome, predictive factors of sac shrinkage remain unclear. The aim of this study was to identify the role of preoperative and postoperative influencing factors of sac reduction after EVAR. METHODS: Online searches across MEDLINE, Embase, and Cochrane Library medical databases were simultaneously performed. Study effects were pooled using a random-effects model, and forest plots were generated for every potential influencing factor. RESULTS: A total of 24 studies with 14,754 patients were included (mean age, 73.4 years; 76% male). At a mean follow-up of 24 months, the pooled shrinkage proportion was 47%. Random-effects meta-analysis revealed that renal impairment (odds ratio [OR], 0.74; 95% confidence interval [CI], 0.57-0.96), type I endoleaks (OR, 0.17; 95% CI, 0.08-0.39), type II endoleaks (OR, 0.21; 95% CI, 0.14-0.33), and combined type I and type II endoleaks (OR, 0.32; 95% CI, 0.22-0.47) were found to prevent sac shrinkage, whereas hypercholesterolemia (OR, 1.24; 95% CI, 1.02-1.51) and smoking (OR, 1.32; 95% CI, 1.17-1.49) have a significant positive impact on sac shrinkage. In addition, there was a trend toward the association between shrinkage and statin therapy (OR, 4.07; 95% CI, 1.02-16.32) and nearly significant negative impacts of coronary artery disease (OR, 0.84; 95% CI, 0.70-1.01), diabetes (OR, 0.79; 95% CI, 0.60-1.04), and sac thrombus (OR, 0.88; 95% CI, 0.77-1.01) on sac shrinkage. CONCLUSIONS: In this large meta-analysis of patients undergoing EVAR, we found that several comorbidity and postoperative factors were associated with postoperative sac shrinkage. These findings may contribute to a better understanding of the shrinkage process of patients undergoing EVAR.

Systematic Review and Meta-Analysis of Preoperative Risk Factors of Type II Endoleaks after Endovascular Aneurysm Repair.

BACKGROUND: Type II endoleaks (T2Es) remain the Achilles heel of endovascular aneurysm repair (EVAR), involving a close follow-up and sometimes leading to reintervention. Identifying risk factors impacting T2Es is of concern to improve decision making and optimize follow-up. However, it has led to contradictory results, with supporting evidence for the majority of factors being weak. METHODS: A systematic review and meta-analysis was conducted to study risk factors of T2Es following EVAR to identify risk factors and measure their dedicated strength of association. Using a literature search of MEDLINE, EMBASE, and the Cochrane Library, 31 retrospective studies including a total of 15,793 patients were identified and fulfilled the strict specified inclusion criteria. Random-effects meta-analysis was conducted for each factor to combine effect estimate across studies. A total of 21 factors related to demography, preoperative treatment, comorbidity, and morphology were statistically pooled. RESULTS: On the basis of the pooled odds ratios and their 95% confidence intervals, patency of aortic side branches, represented by the patency of the inferior mesenteric artery, lumbar arteries, or total number of aortic side branches, were found to be significant harmful risk factors of T2Es. Women were also found to have nearly significant higher risk of developing T2Es than men. On the contrary, the following were found to have a significant protective role: smoking, peripheral artery disease, and thrombus load, represented by the maximum thickness at the maximum aneurysm diameter, the presence of circumferential thrombus, or the presence of thrombus at the level of inferior mesenteric artery. CONCLUSION: Identifying significant risk factors of development of T2Es is mandatory to improve decision making and optimize surveillance planning in EVAR.

Predictive Models of Complications after Endovascular Aortic Aneurysm Repair.

BACKGROUND: The risk of long-term complications after endovascular aneurysm repair (EVAR) is still higher than open surgery and is a critical issue. This study aims to make available reliable statistical predictive models of complications after EVAR. METHODS: Two hundred and thirteen patients who underwent EVAR between 2002 and 2012 were included in this study. The preoperative computed tomography scans were analyzed with a dedicated workstation to provide spatially correct 3-dimensional data. Age, gender, operation-related factors, and 21 morphologic variables were measured and included in the analyses. Five postoperative outcomes were studied. After an initial selection of predictors based on univariate analysis, binomial logistic regression models were proposed for each outcome. The ability to predict each outcome was assessed with receiver operating characteristic curves considering that an area under the curve (AUC) > 0.70 is generally considered sufficiently accurate. RESULTS: The mean age was 74.8 ± 8.6 years with a mean follow-up of 43.8 ± 22.1 months. Respectively, rates and risk factors of each outcome were 25.3% (n = 51) for abdominal aortic aneurysm (AAA) enlargement (age, number of patent sac branches, iliac calcifications and tortuosity, aneurysmal thrombus), 7% (n = 15) for type IA endoleak (neck calcification and AAA diameter), 3.7% (n = 8) for type IB endoleak (iliac tortuosity, AAA diameter, neck thrombus), 19.8% (n = 40) for type II endoleak (female, number of patent sac branches), and 25.9% (n = 55) for reintervention from any cause (neck calcification). The risk associated to each outcome can be calculated with a combination of these different preoperative variables. AUC for each outcome were 79.6% for AAA enlargement, 70.4% for reintervention, 81.3% for type IA endoleak, 92.3% for type IB endoleak, 70.6% for type II endoleak. CONCLUSIONS: This study shows that an exhaustive description of the preoperative anatomy before EVAR is a powerful and reliable tool to predict the risk of developing the most common complications after EVAR.

PyDBS: an automated image processing workflow for deep brain stimulation surgery.

PURPOSE: Deep brain stimulation (DBS) is a surgical procedure for treating motor-related neurological disorders. DBS clinical efficacy hinges on precise surgical planning and accurate electrode placement, which in turn call upon several image processing and visualization tasks, such as image registration, image segmentation, image fusion, and 3D visualization. These tasks are often performed by a heterogeneous set of software tools, which adopt differing formats and geometrical conventions and require patient-specific parameterization or interactive tuning. To overcome these issues, we introduce in this article PyDBS, a fully integrated and automated image processing workflow for DBS surgery. METHODS: PyDBS consists of three image processing pipelines and three visualization modules assisting clinicians through the entire DBS surgical workflow, from the preoperative planning of electrode trajectories to the postoperative assessment of electrode placement. The system's robustness, speed, and accuracy were assessed by means of a retrospective validation, based on 92 clinical cases. RESULTS: The complete PyDBS workflow achieved satisfactory results in 92 % of tested cases, with a median processing time of 28 min per patient. CONCLUSION: The results obtained are compatible with the adoption of PyDBS in clinical practice.

Analysis of electrode deformations in deep brain stimulation surgery.

PURPOSE: Deep brain stimulation (DBS) surgery is used to reduce motor symptoms when movement disorders are refractory to medical treatment. Post-operative brain morphology can induce electrode deformations as the brain recovers from an intervention. The inverse brain shift has a direct impact on accuracy of the targeting stage, so analysis of electrode deformations is needed to predict final positions. METHODS: DBS electrode curvature was evaluated in 76 adults with movement disorders who underwent bilateral stimulation, and the key variables that affect electrode deformations were identified. Non-linear modelling of the electrode axis was performed using post-operative computed tomography (CT) images. A mean curvature index was estimated for each patient electrode. Multivariate analysis was performed using a regression decision tree to create a hierarchy of predictive variables. The identification and classification of key variables that determine electrode curvature were validated with statistical analysis. RESULTS: The principal variables affecting electrode deformations were found to be the date of the post-operative CT scan and the stimulation target location. The main pathology, patient's gender, and disease duration had a smaller although important impact on brain shift. CONCLUSIONS: The principal determinants of electrode location accuracy during DBS procedures were identified and validated. These results may be useful for improved electrode targeting with the help of mathematical models.

Surgical process modelling: a review.

PURPOSE: Surgery is continuously subject to technological and medical innovations that are transforming daily surgical routines. In order to gain a better understanding and description of surgeries, the field of surgical process modelling (SPM) has recently emerged. The challenge is to support surgery through the quantitative analysis and understanding of operating room activities. Related surgical process models can then be introduced into a new generation of computer-assisted surgery systems. METHODS: In this paper, we present a review of the literature dealing with SPM. This methodological review was obtained from a search using Google Scholar on the specific keywords: "surgical process analysis", "surgical process model" and "surgical workflow analysis". RESULTS: This paper gives an overview of current approaches in the field that study the procedural aspects of surgery. We propose a classification of the domain that helps to summarise and describe the most important components of each paper we have reviewed, i.e., acquisition, modelling, analysis, application and validation/evaluation. These five aspects are presented independently along with an exhaustive list of their possible instantiations taken from the studied publications. CONCLUSION: This review allows a greater understanding of the SPM field to be gained and introduces future related prospects.

Multi-site study of surgical practice in neurosurgery based on surgical process models.

Surgical Process Modelling (SPM) was introduced to improve understanding the different parameters that influence the performance of a Surgical Process (SP). Data acquired from SPM methodology is enormous and complex. Several analysis methods based on comparison or classification of Surgical Process Models (SPMs) have previously been proposed. Such methods compare a set of SPMs to highlight specific parameters explaining differences between populations of patients, surgeons or systems. In this study, procedures performed at three different international University hospitals were compared using SPM methodology based on a similarity metric focusing on the sequence of activities occurring during surgery. The proposed approach is based on Dynamic Time Warping (DTW) algorithm combined with a clustering algorithm. SPMs of 41 Anterior Cervical Discectomy (ACD) surgeries were acquired at three Neurosurgical departments; in France, Germany, and Canada. The proposed approach distinguished the different surgical behaviors according to the location where surgery was performed as well as between the categorized surgical experience of individual surgeons. We also propose the use of Multidimensional Scaling to induce a new space of representation of the sequences of activities. The approach was compared to a time-based approach (e.g. duration of surgeries) and has been shown to be more precise. We also discuss the integration of other criteria in order to better understand what influences the way the surgeries are performed. This first multi-site study represents an important step towards the creation of robust analysis tools for processing SPMs. It opens new perspectives for the assessment of surgical approaches, tools or systems as well as objective assessment and comparison of surgeon's expertise.

Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures.

PURPOSE: Surgical process models (SPMs) have recently been created for situation-aware computer-assisted systems in the operating room. One important challenge in this area is the automatic acquisition of SPMs. The purpose of this study is to present a new method for the automatic detection of low-level surgical tasks, that is, the sequence of activities in a surgical procedure, from microscope video images only. The level of granularity that we addressed in this work is symbolized by activities formalized by triplets  . METHODS: Using the results of our latest work on the recognition of surgical phases in cataract surgeries, and based on the hypothesis that most activities occur in one or two phases only, we created a light-weight ontology, formalized as a hierarchical decomposition into phases and activities. Information concerning the surgical tools, the areas where tools are used and three other visual cues were detected through an image-based approach and combined with the information of the current surgical phase within a knowledge-based recognition system. Knowing the surgical phases before the activity, recognition allows supervised classification to be adapted to the phase. Multiclass Support Vector Machines were chosen as a classification algorithm. RESULTS: Using a dataset of 20 cataract surgeries, and identifying 25 possible pairs of activities, a frame-by-frame recognition rate of 64.5 % was achieved with the proposed system. CONCLUSIONS: The addition of human knowledge to traditional bottom-up approaches based on image analysis appears to be promising for low-level task detection. The results of this work could be used for the automatic indexation of post-operative videos.

Anatomo-clinical atlases correlate clinical data and electrode contact coordinates: application to subthalamic deep brain stimulation.

For patients suffering from Parkinson's disease with severe movement disorders, functional surgery may be required when medical therapy is not effective. In Deep Brain Stimulation (DBS), electrodes are implanted within the brain to stimulate deep structures such as SubThalamic Nucleus (STN). The quality of patient surgical outcome is generally related to the accuracy of nucleus targeting during surgery. In this paper, we focused on identifying optimum sites for STN DBS by studying symptomatic motor improvement along with neuropsychological side effects. We described successive steps for constructing digital atlases gathering patient's location of electrode contacts automatically segmented from postoperative images, and clinical scores. Three motor and five neuropsychological scores were included in the study. Correlations with active contact locations were carried out using an adapted hierarchical ascendant classification. Such analysis enabled the extraction of representative clusters to determine the optimum site for therapeutic STN DBS. For each clinical score, we built an anatomo-clinical atlas representing its improvement or deterioration in relation with the anatomical location of electrodes and from a population of implanted patients. To the best of our knowledge, we reported for the first time a discrepancy between a very good motor improvement by targeting the postero-superior region of the STN and an inevitable deterioration of the categorical and phonemic fluency in the same region. Such atlases and associated analysis may help better understanding of functional mapping in deep structures and may help pre-operative decision-making process and especially targeting.

Surgical tools recognition and pupil segmentation for cataract surgical process modeling.

In image-guided surgery, a new generation of Computer-Assisted-Surgical (CAS) systems based on information from the Operating Room (OR) has recently been developed to improve situation awareness in the OR. Our main project is to develop an application-dependant framework able to extract high-level tasks (surgical phases) using microscope videos data only. In this paper, we present two methods: one method to segment the pupil and one to extract and recognize surgical tools. We show how both methods improve the accuracy of the framework for analysis of cataract surgery videos, to detect eight surgical phases.

Automatic computation of electrode trajectories for Deep Brain Stimulation: a hybrid symbolic and numerical approach.

PURPOSE: The optimal electrode trajectory is needed to assist surgeons in planning Deep Brain Stimulation (DBS). A method for image-based trajectory planning was developed and tested. METHODS: Rules governing the DBS surgical procedure were defined with geometric constraints. A formal geometric solver using multimodal brain images and a template built from 15 brain MRI scans were used to identify a space of possible solutions and select the optimal one. For validation, a retrospective study of 30 DBS electrode implantations from 18 patients was performed. A trajectory was computed in each case and compared with the trajectories of the electrodes that were actually implanted. RESULTS: Computed trajectories had an average difference of 6.45° compared with reference trajectories and achieved a better overall score based on satisfaction of geometric constraints. Trajectories were computed in 2 min for each case. CONCLUSION: A rule-based solver using pre-operative MR brain images can automatically compute relevant and accurate patient-specific DBS electrode trajectories.