A preliminary exploration into top-down and bottom-up deep-learning approaches to localising neuro-interventional point targets in volumetric MRI.

PURPOSE: Point localisation is a critical aspect of many interventional planning procedures, specifically representing anatomical regions of interest or landmarks as individual points. This could be seen as analogous to the problem of visual search in cognitive psychology, in which this search is performed either: bottom-up, constructing increasingly abstract and coarse-resolution features over the entire image; or top-down, using contextual cues from the entire image to refine the scope of the region being investigated. Traditional convolutional neural networks use the former, but it is not clear if this is optimal. This article is a preliminary investigation as to how this motivation affects 3D point localisation in neuro-interventional planning. METHODS: Two neuro-imaging datasets were collected: one for cortical point localisation for repetitive transcranial magnetic stimulation and the other for sub-cortical anatomy localisation for deep brain stimulation. Four different frameworks were developed using top-down versus bottom-up paradigms as well as representing points as co-ordinates or heatmaps. These networks were applied to point localisation for transcranial magnetic stimulation and subcortical anatomy localisation. These networks were evaluated using cross-validation and a varying number of training datasets to analyse their sensitivity to quantity of training data. RESULTS: Each network shows increasing performance as the amount of available training data increases, with the co-ordinate-based top-down network consistently outperforming the others. Specifically, the top-down architectures tend to outperform the bottom-up ones. An analysis of their memory consumption also encourages the top-down co-ordinate based architecture as it requires significantly less memory than either bottom-up architectures or those representing their predictions via heatmaps. CONCLUSION: This paper is a preliminary foray into a fundamental aspect of machine learning architectural design: that of the top-down/bottom-up divide from cognitive psychology. Although there are additional considerations within the particular architectures investigated that could affect these results and the number of architectures investigated is limited, our results do indicate that the less commonly used top-down paradigm could lead to more efficient and effective architectures in the future.

Physical environment of the operating room during cesarean section: A systematic review.

INTRODUCTION: Environmental factors in the operating room during cesarean sections are likely important for both women/birthing people and their babies but there is currently a lack of rigorous literature about their evaluation. The principal aim of this study was to systematically examine studies published on the physical environment in the obstetrical operating room during c-sections and its impact on mother and neonate outcomes. The secondary objective was to identify the sensors used to investigate the operating room environment during cesarean sections. METHODS: In this literature review, we searched MEDLINE a database using the following keywords: Cesarean section AND (operating room environment OR Noise OR Music OR Video recording OR Light level OR Gentle OR Temperature OR Motion Data). Eligible studies had to be published in English or French within the past 10 years and had to investigate the operating room environment during cesarean sections in women. For each study we reported which aspects of the physical environment were investigated in the OR (i.e., noise, music, movement, light or temperature) and the involved sensors. RESULTS: Of a total of 105 studies screened, we selected 8 articles from title and abstract in PubMed. This small number shows that the field is poorly investigated. The most evaluated environment factors to date are operating room noise and temperature, and the presence of music. Few studies used advanced sensors in the operating room to evaluate environmental factors in a more nuanced and complete way. Two studies concern the sound level, four concern music, one concerns temperature and one analyzed the number of entrances/exits into the OR. No study analyzed light level or more fine-grained movement data. CONCLUSIONS: Main findings include increase of noise and motion at specific time-points, for example during delivery or anaesthesia; the positive impact of music on parents and staff alike; and that a warmer theatre is better for babies but more uncomfortable for surgeons.

Reference-free Bayesian model for pointing errors of typein neurosurgical planning.

PURPOSE: Many neurosurgical planning tasks rely on identifying points of interest in volumetric images. Often, these points require significant expertise to identify correctly as, in some cases, they are not visible but instead inferred by the clinician. This leads to a high degree of variability between annotators selecting these points. In particular, errors of type are when the experts fundamentally select different points rather than the same point with some inaccuracy. This complicates research as their mean may not reflect any of the experts' intentions nor the ground truth. METHODS: We present a regularised Bayesian model for measuring errors of type in pointing tasks. This model is reference-free; in that it does not require a priori knowledge of the ground truth point but instead works on the basis of the level of consensus between multiple annotators. We apply this model to simulated data and clinical data from transcranial magnetic stimulation for chronic pain. RESULTS: Our model estimates the probabilities of selecting the correct point in the range of 82.6[Formula: see text]88.6% with uncertainties in the range of 2.8[Formula: see text]4.0%. This agrees with the literature where ground truth points are known. The uncertainty has not previously been explored in the literature and gives an indication of the dataset's strength. CONCLUSIONS: Our reference-free Bayesian framework easily models errors of type in pointing tasks. It allows for clinical studies to be performed with a limited number of annotators where the ground truth is not immediately known, which can be applied widely for better understanding human errors in neurosurgical planning.

Combining simple interactivity and machine learning: a separable deep learning approach to subthalamic nucleus localization and segmentation in MRI for deep brain stimulation surgical planning.

Purpose: Deep brain stimulation (DBS) is an interventional treatment for some neurological and neurodegenerative diseases. For example, in Parkinson's disease, DBS electrodes are positioned at particular locations within the basal ganglia to alleviate the patient's motor symptoms. These interventions depend greatly on a preoperative planning stage in which potential targets and electrode trajectories are identified in a preoperative MRI. Due to the small size and low contrast of targets such as the subthalamic nucleus (STN), their segmentation is a difficult task. Machine learning provides a potential avenue for development, but it has difficulty in segmenting such small structures in volumetric images due to additional problems such as segmentation class imbalance. Approach: We present a two-stage separable learning workflow for STN segmentation consisting of a localization step that detects the STN and crops the image to a small region and a segmentation step that delineates the structure within that region. The goal of this decoupling is to improve accuracy and efficiency and to provide an intermediate representation that can be easily corrected by a clinical user. This correction capability was then studied through a human-computer interaction experiment with seven novice participants and one expert neurosurgeon. Results: Our two-step segmentation significantly outperforms the comparative registration-based method currently used in clinic and approaches the fundamental limit on variability due to the image resolution. In addition, the human-computer interaction experiment shows that the additional interaction mechanism allowed by separating STN segmentation into two steps significantly improves the users' ability to correct errors and further improves performance. Conclusions: Our method shows that separable learning not only is feasible for fully automatic STN segmentation but also leads to improved interactivity that can ease its translation into clinical use.

Voxel-based diktiometry: Combining convolutional neural networks with voxel-based analysis and its application in diffusion tensor imaging for Parkinson's disease.

Extracting population-wise information from medical images, specifically in the neurological domain, is crucial to better understanding disease processes and progression. This is frequently done in a whole-brain voxel-wise manner, in which a population of patients and healthy controls are registered to a common co-ordinate space and a statistical test is performed on the distribution of image intensities for each location. Although this method has yielded a number of scientific insights, it is further from clinical applicability as the differences are often small and altogether do not permit for a high-performing classifier. In this article, we take the opposite approach of using a high-performing classifier, specifically a traditional convolutional neural network, and then extracting insights from it which can be applied in a population-wise manner, a method we call voxel-based diktiometry. We have applied this method to diffusion tensor imaging (DTI) analysis for Parkinson's disease (PD), using the Parkinson's Progression Markers Initiative database. By using the network sensitivity information, we can decompose what elements of the DTI contribute the most to the network's performance, drawing conclusions about diffusion biomarkers for PD that are based on metrics which are not readily expressed in the voxel-wise approach.

An ecological approach to identify distinct neural correlates of disinhibition in frontotemporal dementia.

Disinhibition is a core symptom of many neurodegenerative diseases, particularly frontotemporal dementia, and is a major cause of stress for caregivers. While a distinction between behavioural and cognitive disinhibition is common, an operational definition of behavioural disinhibition is still missing. Furthermore, conventional assessment of behavioural disinhibition, based on questionnaires completed by the caregivers, often lacks ecological validity. Therefore, their neuroanatomical correlates are non-univocal. In the present work, we used an original behavioural approach in a semi-ecological situation to assess two specific dimensions of behavioural disinhibition: compulsivity and social disinhibition. First, we investigated disinhibition profile in patients compared to controls. Then, to validate our approach, compulsivity and social disinhibition scores were correlated with classic cognitive tests measuring disinhibition (Hayling Test) and social cognition (mini-Social cognition & Emotional Assessment). Finally, we disentangled the anatomical networks underlying these two subtypes of behavioural disinhibition, taking in account the grey (voxel-based morphometry) and white matter (diffusion tensor imaging tractography). We included 17 behavioural variant frontotemporal dementia patients and 18 healthy controls. We identified patients as more compulsive and socially disinhibited than controls. We found that behavioural metrics in the semi-ecological task were related to cognitive performance: compulsivity correlated with the Hayling test and both compulsivity and social disinhibition were associated with the emotion recognition test. Based on voxel-based morphometry and tractography, compulsivity correlated with atrophy in the bilateral orbitofrontal cortex, the right temporal region and subcortical structures, as well as with alterations of the bilateral cingulum and uncinate fasciculus, the right inferior longitudinal fasciculus and the right arcuate fasciculus. Thus, the network of regions related to compulsivity matched the "semantic appraisal" network. Social disinhibition was associated with bilateral frontal atrophy and impairments in the forceps minor, the bilateral cingulum and the left uncinate fasciculus, regions corresponding to the frontal component of the "salience" network. Summarizing, this study validates our semi-ecological approach, through the identification of two subtypes of behavioural disinhibition, and highlights different neural networks underlying compulsivity and social disinhibition. Taken together, these findings are promising for clinical practice by providing a better characterisation of inhibition disorders, promoting their detection and consequently a more adapted management of patients.

Machine learning in deep brain stimulation: A systematic review.

Deep Brain Stimulation (DBS) is an increasingly common therapy for a large range of neurological disorders, such as abnormal movement disorders. The effectiveness of DBS in terms of controlling patient symptomatology has made this procedure increasingly used over the past few decades. Concurrently, the popularity of Machine Learning (ML), a subfield of artificial intelligence, has skyrocketed and its influence has more recently extended to medical domains such as neurosurgery. Despite its growing research interest, there has yet to be a literature review specifically on the use of ML in DBS. We have followed a fully systematic methodology to obtain a corpus of 73 papers. In each paper, we identified the clinical application, the type/amount of data used, the method employed, and the validation strategy, further decomposed into 12 different sub-categories. The papers overall illustrated some existing trends in how ML is used in the context of DBS, including the breath of the problem domain and evolving techniques, as well as common frameworks and limitations. This systematic review analyzes at a broad level how ML have been recently used to address clinical problems on DBS, giving insight into how these new computational methods are helping to push the state-of-the-art of functional neurosurgery. DBS clinical workflow is complex, involves many specialists, and raises several clinical issues which have partly been addressed with artificial intelligence. However, several areas remain and those that have been recently addressed with ML are by no means considered "solved" by the community nor are they closed to new and evolving methods.

PassFlow: a multimodal workflow for predicting deep brain stimulation outcomes.

PURPOSE: Deep Brain Stimulation (DBS) is a proven therapy for Parkinson's Disease (PD), frequently resulting in an enhancement of motor function. Nonetheless, several undesirable side effects can occur after DBS, which can worsen the quality of life of the patient. Thus, the clinical team has to carefully select patients on whom to perform DBS. Over the past decade, there have been some attempts to relate pre-operative data and DBS clinical outcomes, with most focused on the motor symptomatology. In this paper, we propose a machine learning-based method able to predict a large number of DBS clinical outcomes for PD. METHODS: We propose a multimodal pipeline, referred to as PassFlow, which predicts 84 clinical post-operative clinical scores. PassFlow is composed of an artificial neural network to compress clinical information, an image processing method from the state-of-the-art to extract morphological biomarkers our of T1 imaging, and an SVM to perform the regressions. We validated PassFlow on 196 PD patients who undergone a DBS. RESULTS: PassFlow showed correlation coefficients as high as 0.71 and were able to significantly predict 63 out of the 84 scores, outperforming a comparative linear method. The number of metrics that are predicted with this pre-operative information was also found to be correlated with the number of patients with this information available, indicating that the PassFlow method is still actively learning. CONCLUSION: We presented a novel, machine learning-based pipeline to predict a variety of post-operative clinical outcomes of DBS for PD patients. PassFlow took into account various bio-markers, arising from different data modalities, showing high correlation coefficients for some scores from pre-operative data only. It indicates that many clinical outcomes of DBS can be predicted agnostic to the specific simulation parameters, as PassFlow has been validated without such stimulation-related information.

Automatic cortical target point localisation in MRI for transcranial magnetic stimulation via a multi-resolution convolutional neural network.

PURPOSE: Transcranial magnetic stimulation (TMS) is a growing therapy for a variety of psychiatric and neurological disorders that arise from or are modulated by cortical regions of the brain represented by singular 3D target points. These target points are often determined manually with assistance from a pre-operative T1-weighted MRI, although there is growing interest in automatic target point localisation using an atlas. However, both approaches can be time-consuming which has an effect on the clinical workflow, and the latter does not take into account patient variability such as the varying number of cortical gyri where these targets are located. METHODS: This paper proposes a multi-resolution convolutional neural network for point localisation in MR images for a priori defined points in increasingly finely resolved versions of the input image. This approach is both fast and highly memory efficient, allowing it to run in high-throughput centres, and has the capability of distinguishing between patients with high levels of anatomical variability. RESULTS: Preliminary experiments have found the accuracy of this network to be [Formula: see text] mm, compared to [Formula: see text] mm for deformable registration and [Formula: see text] mm for a human expert. For most treatment points, the human expert and proposed CNN statistically significantly outperform registration, but neither statistically significantly outperforms the other, suggesting that the proposed network has human-level performance. CONCLUSIONS: The human-level performance of this network indicates that it can improve TMS planning by automatically localising target points in seconds, avoiding more time-consuming registration or manual point localisation processes. This is particularly beneficial for out-of-hospital centres with limited computational resources where TMS is increasingly being administered.

Adapting the listening time for micro-electrode recordings in deep brain stimulation interventions.

PURPOSE: Deep brain stimulation (DBS) is a common treatment for a variety of neurological disorders which involves the precise placement of electrodes at particular subcortical locations such as the subthalamic nucleus. This placement is often guided by auditory analysis of micro-electrode recordings (MERs) which informs the clinical team as to the anatomic region in which the electrode is currently positioned. Recent automation attempts have lacked flexibility in terms of the amount of signal recorded, not allowing them to collect more signal when higher certainty is needed or less when the anatomy is unambiguous. METHODS: We have addressed this problem by evaluating a simple algorithm that allows for MER signal collection to terminate once the underlying model has sufficient confidence. We have parameterized this approach and explored its performance using three underlying models composed of one neural network and two Bayesian extensions of said network. RESULTS: We have shown that one particular configuration, a Bayesian model of the underlying network's certainty, outperforms the others and is relatively insensitive to parameterization. Further investigation shows that this model also allows for signals to be classified earlier without increasing the error rate. CONCLUSION: We have presented a simple algorithm that records the confidence of an underlying neural network, thus allowing for MER data collection to be terminated early when sufficient confidence is reached. This has the potential to improve the efficiency of DBS electrode implantation by reducing the time required to identify anatomical structures using MERs.

Data imputation and compression for Parkinson's disease clinical questionnaires.

Medical questionnaires are a valuable source of information but are often difficult to analyse due to both their size and the high possibility of them having missing values. This is a problematic issue in biomedical data science as it may complicate how individual questionnaire data is represented for statistical or machine learning analysis. In this paper, we propose a deeply-learnt residual autoencoder to simultaneously perform non-linear data imputation and dimensionality reduction. We present an extensive analysis of the dynamics of the performance of this autoencoder regarding the compression rate and the proportion of missing values. This method is evaluated on motor and non-motor clinical questionnaires of the Parkinson's Progression Markers Initiative (PPMI) database and consistently outperforms linear coupled imputation and reduction approaches.

SepaConvNet for Localizing the Subthalamic Nucleus Using One Second Micro-electrode Recordings.

Micro-electrode recording (MER) is a powerful way of localizing target structures during neurosurgical procedures such as the implantation of deep brain stimulation electrodes, which is a common treatment for Parkinson's disease and other neurological disorders. While Micro-electrode Recording (MER) provides adjunctive information to guidance assisted by pre-operative imaging, it is not unanimously used in the operating room. The lack of standard use of MER may be in part due to its long duration, which can lead to complications during the operation, or due to high degree of expertise required for their interpretation. Over the past decade, various approaches addressing automating MER analysis for target localization have been proposed, which have mainly focused on feature engineering. While the accuracies obtained are acceptable in certain configurations, one issue with handcrafted MER features is that they do not necessarily capture more subtle differences in MER that could be detected auditorily by an expert neurophysiologist. In this paper, we propose and validate a deep learning-based pipeline for subthalamic nucleus (STN) localization with micro-electrode recordings motivated by the human auditory system. Our proposed Convolutional Neural Network (CNN), referred as SepaConvNet, shows improved accuracy over two comparative networks for locating the STN from one second MER samples.

Striatal shape alteration as a staging biomarker for Parkinson's Disease.

Parkinson's Disease provokes alterations of subcortical deep gray matter, leading to subtle changes in the shape of several subcortical structures even before the manifestation of motor and non-motor clinical symptoms. We used an automated registration and segmentation pipeline to measure this structural alteration in one early and one advanced Parkinson's Disease (PD) cohorts, one prodromal stage cohort and one healthy control cohort. These structural alterations are then passed to a machine learning pipeline to classify these populations. Our workflow is able to distinguish different stages of PD based solely on shape analysis of the bilateral caudate nucleus and putamen, with balanced accuracies in the range of 59% to 85%. Furthermore, we compared the significance of each of these subcortical structure, compared the performances of different classifiers on this task, thus quantifying the informativeness of striatal shape alteration as a staging bio-marker for PD.

The Effects of Positioning on the Volume/Location of the Internal Jugular Vein Using 2-Dimensional Tracked Ultrasound.

OBJECTIVE: To investigate the effects of different positioning on the volume/location of the internal jugular vein (IJV) using 2-dimensional (2D) tracked ultrasound. DESIGN: This was a prospective, observational study. SETTING: Local research institute. PARTICIPANTS: Healthy volunteers. INTERVENTIONS: Twenty healthy volunteers were scanned in the following 6 positions: (1) supine with head neutral, rotated 15 and 30 degrees to the left and (2) 5-, 10-, and 15-degree Trendelenburg position with head neutral. In each position the volunteer's neck was scanned using a 2D ultrasound probe tracked with a magnetic tracker. These spatially tracked 2D images were collected and reconstructed into a 3D volume of the IJV and carotid artery. This 3D ultrasound volume then was segmented to obtain a 3D surface on which measurements and calculations were performed. MEASUREMENTS AND MAIN RESULTS: The measurements included average cross-section area (CSA), CSA along the length of IJV, and average overlap rate. CSA (mm2) in the supine and 5-, 10-, and 15-degree Trendelenburg positions were as follows: 86.7 ± 44.8, 104.3 ± 54.5, 119.1 ± 58.6, and 133.7 ± 53.3 (p < 0.0001). CSA enlarged with the increase of Trendelenburg degree. Neither Trendelenburg position nor head rotation showed a correlation with overlap rate. CONCLUSIONS: Trendelenburg position significantly increased the CSA of the IJV, thus facilitating IJV cannulation. This new 3D reconstruction method permits the creation of a 3D volume through a tracked 2D ultrasound scanning system with image acquisition and integration and may prove useful in providing the user with a "road map" of the vascular anatomy of a patient's neck or other anatomic structures.

Development and Evaluation of an Augmented Reality Ultrasound Guidance System for Spinal Anesthesia: Preliminary Results.

Applications of ultrasound guidance for epidural injections are hindered by poor needle and epidural space visualization. This work presents an augmented reality (AR) ultrasound guidance system that addresses challenges in both needle visualization during navigation and epidural space identification for needle positioning. In this system, (i) B-mode ultrasound and the needle are visualized in a 3-D AR environment for improved navigation, and (ii) A-mode ultrasound, obtained from a custom-made single-element transducer housed at the needle tip, is used to identify the epidural space for improved needle positioning. Performance of the system was evaluated against ultrasound-only guidance in a phantom study with novice operators and an expert anesthesiologist. The procedure success rate was higher with the AR system (100%) than ultrasound-only guidance (57%). The AR system has the potential to improve procedure outcomes in terms of success rate, time, needle path-length and usability.

Prostate cancer detection using residual networks.

PURPOSE: To automatically identify regions where prostate cancer is suspected on multi-parametric magnetic resonance images (mp-MRI). METHODS: A residual network was implemented based on segmentations from an expert radiologist on T2-weighted, apparent diffusion coefficient map, and high b-value diffusion-weighted images. Mp-MRIs from 346 patients were used in this study. RESULTS: The residual network achieved a hit or miss accuracy of 93% for lesion detection, with an average Jaccard score of 71% that compared the agreement between network and radiologist segmentations. CONCLUSION: This paper demonstrated the ability for residual networks to learn features for prostate lesion segmentation.

Cyclic Continuous Max-Flow: A Third Paradigm in Generating Local Phase Shift Maps in MRI.

Sensitivity to phase deviations in MRI forms the basis of a variety of techniques, including magnetic susceptibility weighted imaging and chemical shift imaging. Current phase processing techniques fall into two families: those which process the complex image data with magnitude and phase coupled, and phase unwrapping-based techniques that first linearize the phase topology across the image. However, issues, such as low signal and the existence of phase poles, can lead both methods to experience error. Cyclic continuous max-flow (CCMF) phase processing uses primal-dual-variational optimization over a cylindrical manifold, which represent the inherent topology of phase images, increasing its robustness to these issues. CCMF represents a third distinct paradigm in phase processing, being the only technique equipped with the inherent topology of phase. CCMF is robust and efficient with at least comparable accuracy as the prior paradigms.

Free-breathing Pulmonary MR Imaging to Quantify Regional Ventilation.

Purpose To measure regional specific ventilation with free-breathing hydrogen 1 (1H) magnetic resonance (MR) imaging without exogenous contrast material and to investigate correlations with hyperpolarized helium 3 (3He) MR imaging and pulmonary function test measurements in healthy volunteers and patients with asthma. Materials and Methods Subjects underwent free-breathing 1H and static breath-hold hyperpolarized 3He MR imaging as well as spirometry and plethysmography; participants were consecutively recruited between January and June 2017. Free-breathing 1H MR imaging was performed with an optimized balanced steady-state free-precession sequence; images were retrospectively grouped into tidal inspiration or tidal expiration volumes with exponentially weighted phase interpolation. MR imaging volumes were coregistered by using optical flow deformable registration to generate 1H MR imaging-derived specific ventilation maps. Hyperpolarized 3He MR imaging- and 1H MR imaging-derived specific ventilation maps were coregistered to quantify regional specific ventilation within hyperpolarized 3He MR imaging ventilation masks. Differences between groups were determined with the Mann-Whitney test and relationships were determined with Spearman (ρ) correlation coefficients. Statistical analyses were performed with software. Results Thirty subjects (median age: 50 years; interquartile range [IQR]: 30 years), including 23 with asthma and seven healthy volunteers, were evaluated. Both 1H MR imaging-derived specific ventilation and hyperpolarized 3He MR imaging-derived ventilation percentage were significantly greater in healthy volunteers than in patients with asthma (specific ventilation: 0.14 [IQR: 0.05] vs 0.08 [IQR: 0.06], respectively, P < .0001; ventilation percentage: 99% [IQR: 1%] vs 94% [IQR: 5%], P < .0001). For all subjects, 1H MR imaging-derived specific ventilation correlated with plethysmography-derived specific ventilation (ρ = 0.54, P = .002) and hyperpolarized 3He MR imaging-derived ventilation percentage (ρ = 0.67, P < .0001) as well as with forced expiratory volume in 1 second (FEV1) (ρ = 0.65, P = .0001), ratio of FEV1 to forced vital capacity (ρ = 0.75, P < .0001), ratio of residual volume to total lung capacity (ρ = -0.68, P < .0001), and airway resistance (ρ = -0.51, P = .004). 1H MR imaging-derived specific ventilation was significantly greater in the gravitational-dependent versus nondependent lung in healthy subjects (P = .02) but not in patients with asthma (P = .1). In patients with asthma, coregistered 1H MR imaging specific ventilation and hyperpolarized 3He MR imaging maps showed that specific ventilation was diminished in corresponding 3He MR imaging ventilation defects (0.05 ± 0.04) compared with well-ventilated regions (0.09 ± 0.05) (P < .0001). Conclusion 1H MR imaging-derived specific ventilation correlated with plethysmography-derived specific ventilation and ventilation defects seen by using hyperpolarized 3He MR imaging. © RSNA, 2018 Online supplemental material is available for this article.

The semiotics of medical image Segmentation.

As the interaction between clinicians and computational processes increases in complexity, more nuanced mechanisms are required to describe how their communication is mediated. Medical image segmentation in particular affords a large number of distinct loci for interaction which can act on a deep, knowledge-driven level which complicates the naive interpretation of the computer as a symbol processing machine. Using the perspective of the computer as dialogue partner, we can motivate the semiotic understanding of medical image segmentation. Taking advantage of Peircean semiotic traditions and new philosophical inquiry into the structure and quality of metaphors, we can construct a unified framework for the interpretation of medical image segmentation as a sign exchange in which each sign acts as an interface metaphor. This allows for a notion of finite semiosis, described through a schematic medium, that can rigorously describe how clinicians and computers interpret the signs mediating their interaction. Altogether, this framework provides a unified approach to the understanding and development of medical image segmentation interfaces.