User Interaction in Semi-Automatic Segmentation of Organs at Risk: a Case Study in Radiotherapy.

Accurate segmentation of organs at risk is an important step in radiotherapy planning. Manual segmentation being a tedious procedure and prone to inter- and intra-observer variability, there is a growing interest in automated segmentation methods. However, automatic methods frequently fail to provide satisfactory result, and post-processing corrections are often needed. Semi-automatic segmentation methods are designed to overcome these problems by combining physicians' expertise and computers' potential. This study evaluates two semi-automatic segmentation methods with different types of user interactions, named the "strokes" and the "contour", to provide insights into the role and impact of human-computer interaction. Two physicians participated in the experiment. In total, 42 case studies were carried out on five different types of organs at risk. For each case study, both the human-computer interaction process and quality of the segmentation results were measured subjectively and objectively. Furthermore, different measures of the process and the results were correlated. A total of 36 quantifiable and ten non-quantifiable correlations were identified for each type of interaction. Among those pairs of measures, 20 of the contour method and 22 of the strokes method were strongly or moderately correlated, either directly or inversely. Based on those correlated measures, it is concluded that: (1) in the design of semi-automatic segmentation methods, user interactions need to be less cognitively challenging; (2) based on the observed workflows and preferences of physicians, there is a need for flexibility in the interface design; (3) the correlated measures provide insights that can be used in improving user interaction design.

Segmentation of multiple heart cavities in 3-D transesophageal ultrasound images.

Three-dimensional transesophageal echocardiography (TEE) is an excellent modality for real-time visualization of the heart and monitoring of interventions. To improve the usability of 3-D TEE for intervention monitoring and catheter guidance, automated segmentation is desired. However, 3-D TEE segmentation is still a challenging task due to the complex anatomy with multiple cavities, the limited TEE field of view, and typical ultrasound artifacts. We propose to segment all cavities within the TEE view with a multi-cavity active shape model (ASM) in conjunction with a tissue/blood classification based on a gamma mixture model (GMM). 3-D TEE image data of twenty patients were acquired with a Philips X7-2t matrix TEE probe. Tissue probability maps were estimated by a two-class (blood/tissue) GMM. A statistical shape model containing the left ventricle, right ventricle, left atrium, right atrium, and aorta was derived from computed tomography angiography (CTA) segmentations by principal component analysis. ASMs of the whole heart and individual cavities were generated and consecutively fitted to tissue probability maps. First, an average whole-heart model was aligned with the 3-D TEE based on three manually indicated anatomical landmarks. Second, pose and shape of the whole-heart ASM were fitted by a weighted update scheme excluding parts outside of the image sector. Third, pose and shape of ASM for individual heart cavities were initialized by the previous whole heart ASM and updated in a regularized manner to fit the tissue probability maps. The ASM segmentations were validated against manual outlines by two observers and CTA derived segmentations. Dice coefficients and point-to-surface distances were used to determine segmentation accuracy. ASM segmentations were successful in 19 of 20 cases. The median Dice coefficient for all successful segmentations versus the average observer ranged from 90% to 71% compared with an inter-observer range of 95% to 84%. The agreement against the CTA segmentations was slightly lower with a median Dice coefficient between 85% and 57%. In this work, we successfully showed the accuracy and robustness of the proposed multi-cavity segmentation scheme. This is a promising development for intraoperative procedure guidance, e.g., in cardiac electrophysiology.

Additional diagnostic value of integrated analysis of cardiac CTA and SPECT MPI using the SMARTVis system in patients with suspected coronary artery disease.

UNLABELLED: CT angiography (CTA) and SPECT myocardial perfusion imaging (MPI) are complementary imaging techniques to assess coronary artery disease (CAD). Spatial integration and combined visualization of SPECT MPI and CTA data may facilitate correlation of myocardial perfusion defects and subtending coronary arteries and thus offer additional diagnostic value over either stand-alone or side-by-side interpretation of the respective datasets from the 2 modalities. In this study, we investigated the additional diagnostic value of a software-based CTA/SPECT MPI image fusion system over conventional side-by-side analysis in patients with suspected CAD. METHODS: Seventeen symptomatic patients who underwent both CTA and SPECT MPI within a 90-d period were included in our study; 7 of them also underwent invasive coronary angiography (ICA). The potential benefits of the synchronized multimodal heart visualization (SMARTVis) system in assessing CAD were investigated through a case study involving 4 experts from 2 medical centers, in which we performed, first, a side-by-side analysis using structured CTA and SPECT reports and, second, an integrated analysis using the SMARTVis system in addition to the reports. RESULTS: The fused interpretation led to a more accurate diagnosis, reflected in an increase in the individual observers' sensitivity and specificity to correctly refer for invasive angiography eventually followed by revascularization. For the first, second, third, and fourth observers, the respective sensitivities improved from 50%, 60%, 80%, and 80% to 70%, 80%, 100%, and 90% and the respective specificities from 100%, 94%, 83%, and 83% to 100%, 100%, 94%, and 83%. Additionally, the interobserver diagnosis agreement increased from 74% to 84%. The improvement was primarily found in patients presenting with CAD in more vessels than the number of reported perfusion defects. CONCLUSION: Integrated analysis of cardiac CTA and SPECT MPI using the SMARTVis system results in an improved diagnostic performance.

Cardiac MR perfusion image processing techniques: a survey.

First-pass cardiac MR perfusion (CMRP) imaging has undergone rapid technical advancements in recent years. Although the efficacy of CMRP imaging in the assessment of coronary artery diseases (CAD) has been proven, its clinical use is still limited. This limitation stems, in part, from manual interaction required to quantitatively analyze the large amount of data. This process is tedious, time-consuming, and prone to operator bias. Furthermore, acquisition and patient related image artifacts reduce the accuracy of quantitative perfusion assessment. With the advent of semi- and fully automatic image processing methods, not only the challenges posed by these artifacts have been overcome to a large extent, but a significant reduction has also been achieved in analysis time and operator bias. Despite an extensive literature on such image processing methods, to date, no survey has been performed to discuss this dynamic field. The purpose of this article is to provide an overview of the current state of the field with a categorical study, along with a future perspective on the clinical acceptance of image processing methods in the diagnosis of CAD.

Comprehensive visualization of multimodal cardiac imaging data for assessment of coronary artery disease: first clinical results of the SMARTVis tool.

PURPOSE: In clinical practice, both coronary anatomy and myocardial perfusion information are needed to assess coronary artery disease (CAD). The extent and severity of coronary stenoses can be determined using computed tomography coronary angiography (CTCA); the presence and amount of ischemia can be identified using myocardial perfusion imaging, such as perfusion magnetic resonance imaging (PMR). To determine which specific stenosis is associated with which ischemic region, experts use assumptions on coronary perfusion territories. Due to the high variability between patient's coronary artery anatomies, as well as the uncertain relation between perfusion territories and supplying coronary arteries, patient-specific systems are needed. MATERIAL AND METHODS: We present a patient-specific visualization system, called Synchronized Multimodal heART Visualization (SMARTVis), for relating coronary stenoses and perfusion deficits derived from CTCA and PMR, respectively. The system consists of the following comprehensive components: (1) two or three-dimensional fusion of anatomical and functional information, (2) automatic detection and ranking of coronary stenoses, (3) estimation of patient-specific coronary perfusion territories. RESULTS: The potential benefits of the SMARTVis tool in assessing CAD were investigated through a case-study evaluation (conventional vs. SMARTVis tool): two experts analyzed four cases of patients with suspected multivessel coronary artery disease. When using the SMARTVis tool, a more reliable estimation of the relation between perfusion deficits and stenoses led to a more accurate diagnosis, as well as a better interobserver diagnosis agreement. CONCLUSION: The SMARTVis comprehensive visualization system can be effectively used to assess disease status in multivessel CAD patients, offering valuable new options for the diagnosis and management of these patients.