RESUMO
Auto-segmentation is one of the critical and foundational steps for medical image analysis. The quality of auto-segmentation techniques influences the efficiency of precision radiology and radiation oncology since high- quality auto-segmentations usually require limited manual correction. Segmentation metrics are necessary and important to evaluate auto-segmentation results and guide the development of auto-segmentation techniques. Currently widely applied segmentation metrics usually compare the auto-segmentation with the ground truth in terms of the overlapping area (e.g., Dice Coefficient (DC)) or the distance between boundaries (e.g., Hausdorff Distance (HD)). However, these metrics may not well indicate the manual mending effort required when observing the auto-segmentation results in clinical practice. In this article, we study different segmentation metrics to explore the appropriate way of evaluating auto-segmentations with clinical demands. The mending time for correcting auto-segmentations by experts is recorded to indicate the required mending effort. Five well-defined metrics, the overlapping area-based metric DC, the segmentation boundary distance-based metric HD, the segmentation boundary length-based metrics surface DC (surDC) and added path length (APL), and a newly proposed hybrid metric Mendability Index (MI) are discussed in the correlation analysis experiment and regression experiment. In addition to these explicitly defined metrics, we also preliminarily explore the feasibility of using deep learning models to predict the mending effort, which takes segmentation masks and the original images as the input. Experiments are conducted using datasets of 7 objects from three different institutions, which contain the original computed tomography (CT) images, the ground truth segmentations, the auto-segmentations, the corrected segmentations, and the recorded mending time. According to the correlation analysis and regression experiments for the five well-defined metrics, the variety of MI shows the best performance to indicate the mending effort for sparse objects, while the variety of HD works best when assessing the mending effort for non-sparse objects. Moreover, the deep learning models could well predict efforts required to mend auto-segmentations, even without the need of ground truth segmentations, demonstrating the potential of a novel and easy way to evaluate and boost auto-segmentation techniques.
RESUMO
Organ segmentation is a fundamental requirement in medical image analysis. Many methods have been proposed over the past 6 decades for segmentation. A unique feature of medical images is the anatomical information hidden within the image itself. To bring natural intelligence (NI) in the form of anatomical information accumulated over centuries into deep learning (DL) AI methods effectively, we have recently introduced the idea of hybrid intelligence (HI) that combines NI and AI and a system based on HI to perform medical image segmentation. This HI system has shown remarkable robustness to image artifacts, pathology, deformations, etc. in segmenting organs in the Thorax body region in a multicenter clinical study. The HI system utilizes an anatomy modeling strategy to encode NI and to identify a rough container region in the shape of each object via a non-DL-based approach so that DL training and execution are applied only to the fuzzy container region. In this paper, we introduce several advances related to modeling of the NI component so that it becomes substantially more efficient computationally, and at the same time, is well integrated with the DL portion (AI component) of the system. We demonstrate a 9-40 fold computational improvement in the auto-segmentation task for radiation therapy (RT) planning via clinical studies obtained from 4 different RT centers, while retaining state-of-the-art accuracy of the previous system in segmenting 11 objects in the Thorax body region.
RESUMO
Medical image auto-segmentation techniques are basic and critical for numerous image-based analysis applications that play an important role in developing advanced and personalized medicine. Compared with manual segmentations, auto-segmentations are expected to contribute to a more efficient clinical routine and workflow by requiring fewer human interventions or revisions to auto-segmentations. However, current auto-segmentation methods are usually developed with the help of some popular segmentation metrics that do not directly consider human correction behavior. Dice Coefficient (DC) focuses on the truly-segmented areas, while Hausdorff Distance (HD) only measures the maximal distance between the auto-segmentation boundary with the ground truth boundary. Boundary length-based metrics such as surface DC (surDC) and Added Path Length (APL) try to distinguish truly-predicted boundary pixels and wrong ones. It is uncertain if these metrics can reliably indicate the required manual mending effort for application in segmentation research. Therefore, in this paper, the potential use of the above four metrics, as well as a novel metric called Mendability Index (MI), to predict the human correction effort is studied with linear and support vector regression models. 265 3D computed tomography (CT) samples for 3 objects of interest from 3 institutions with corresponding auto-segmentations and ground truth segmentations are utilized to train and test the prediction models. The five-fold cross-validation experiments demonstrate that meaningful human effort prediction can be achieved using segmentation metrics with varying prediction errors for different objects. The improved variant of MI, called MIhd, generally shows the best prediction performance, suggesting its potential to indicate reliably the clinical value of auto-segmentations.
RESUMO
Purpose To investigate free-breathing thoracic bright-blood four-dimensional (4D) dynamic MRI (dMRI) to characterize aeration of parenchymal lung tissue in healthy children and patients with thoracic insufficiency syndrome (TIS). Materials and Methods All dMR images in patients with TIS were collected from July 2009 to June 2017. Standardized signal intensity (sSI) was investigated, first using a lung aeration phantom to establish feasibility and sensitivity and then in a retrospective research study of 40 healthy children (16 male, 24 female; mean age, 9.6 years ± 2.1 [SD]), 20 patients with TIS before and after surgery (11 male, nine female; mean age, 6.2 years ± 4.2), and another 10 healthy children who underwent repeated dMRI examinations (seven male, three female; mean age, 9 years ± 3.6). Individual lungs in 4D dMR images were segmented, and sSI was assessed for each lung at end expiration (EE), at end inspiration (EI), preoperatively, postoperatively, in comparison to normal lungs, and in repeated scans. Results Air content changes of approximately 6% were detectable in phantoms via sSI. sSI within phantoms significantly correlated with air occupation (Pearson correlation coefficient = -0.96 [P < .001]). For healthy children, right lung sSI was significantly lower than that of left lung sSI (at EE: 41 ± 6 vs 47 ± 6 and at EI: 39 ± 6 vs 43 ± 7, respectively; P < .001), lung sSI at EI was significantly lower than that at EE (P < .001), and left lung sSI at EE linearly decreased with age (r = -0.82). Lung sSI at EE and EI decreased after surgery for patients (although not statistically significantly, with P values of sSI before surgery vs sSI after surgery, left and right lung separately, in the range of 0.13-0.51). sSI varied within 1.6%-4.7% between repeated scans. Conclusion This study demonstrates the feasibility of detecting change in sSI in phantoms via bright-blood dMRI when air occupancy changes. The observed reduction in average lung sSI after surgery in pediatric patients with TIS may indicate postoperative improvement in parenchymal aeration. Keywords: MR Imaging, Thorax, Lung, Pediatrics, Thoracic Surgery, Lung Parenchymal Aeration, Free-breathing Dynamic MRI, MRI Intensity Standardization, Thoracic Insufficiency Syndrome Supplemental material is available for this article. © RSNA, 2024.
Assuntos
Pulmão , Imageamento por Ressonância Magnética , Imagens de Fantasmas , Humanos , Masculino , Feminino , Criança , Imageamento por Ressonância Magnética/métodos , Pulmão/diagnóstico por imagem , Estudos Retrospectivos , Insuficiência Respiratória/diagnóstico por imagem , Respiração , Síndrome , Pré-Escolar , Imageamento Tridimensional/métodosRESUMO
BACKGROUND: The International Prostate Symptom Score (IPSS) is a patient-reported measurement to assess the lower urinary tract symptoms of bladder outlet obstruction. Bladder outlet obstruction induces molecular and morphological alterations in the urothelium, suburothelium, detrusor smooth muscle cells, detrusor extracellular matrix, and nerves. We sought to analyze MRI-based radiomics features of the urinary bladder wall and their association with IPSS. METHOD: In this retrospective study, 87 patients who had pelvic MRI scans were identified. A biomarker discovery approach based on the optimal biomarker (OBM) method was used to extract features of the bladder wall from MR images, including morphological, intensity-based, and texture-based features, along with clinical variables. Mathematical models were created using subsets of features and evaluated based on their ability to discriminate between low and moderate-to-severe IPSS (less than 8 vs. equal to or greater than 8). RESULTS: Of the 7,666 features per patient, four highest-ranking optimal features were derived (all texture-based features), which provided a classification accuracy of 0.80 with a sensitivity, specificity, and area under the receiver operating characteristic curve of 0.81, 0.81, and 0.87, respectively. CONCLUSION: A highly independent set of urinary bladder wall features derived from MRI scans were able to discriminate between patients with low vs. moderate-to-severe IPSS with accuracy of 80%. Such differences in MRI-based properties of the bladder wall in patients with varying IPSS's might reflect differences in underlying molecular and morphological alterations that occur in the setting of chronic bladder outlet obstruction.
Assuntos
Imageamento por Ressonância Magnética , Índice de Gravidade de Doença , Obstrução do Colo da Bexiga Urinária , Bexiga Urinária , Humanos , Estudos Retrospectivos , Bexiga Urinária/diagnóstico por imagem , Bexiga Urinária/patologia , Masculino , Obstrução do Colo da Bexiga Urinária/diagnóstico por imagem , Pessoa de Meia-Idade , Idoso , Sintomas do Trato Urinário Inferior/diagnóstico por imagem , Sintomas do Trato Urinário Inferior/etiologia , Avaliação de Sintomas , RadiômicaRESUMO
Background: The diaphragm is a critical structure in respiratory function, yet in-vivo quantitative description of its motion available in the literature is limited. Research Question: How to quantitatively describe regional hemi-diaphragmatic motion and curvature via free-breathing dynamic magnetic resonance imaging (dMRI)? Study Design and Methods: In this prospective cohort study we gathered dMRI images of 177 normal children and segmented hemi-diaphragm domes in end-inspiration and end-expiration phases of the constructed 4D image. We selected 25 points uniformly located on each 3D hemi-diaphragm surface. Based on the motion and local shape of hemi-diaphragm at these points, we computed the velocities and sagittal and coronal curvatures in 13 regions on each hemi-diaphragm surface and analyzed the change in these properties with age and gender. Results: Our cohort consisted of 94 Females, 6-20 years (12.09 + 3.73), and 83 Males, 6-20 years (11.88 + 3.57). We observed velocity range: â¼2mm/s to â¼13mm/s; Curvature range -Sagittal: â¼3m -1 to â¼27m -1 ; Coronal: â¼6m -1 to â¼20m -1 . There was no significant difference in velocity between genders, although the pattern of change in velocity with age was different for the two groups. Strong correlations in velocity were observed between homologous regions of right and left hemi-diaphragms. There was no significant difference in curvatures between genders or change in curvatures with age. Interpretation: Regional motion/curvature of the 3D diaphragmatic surface can be estimated using free-breathing dynamic MRI. Our analysis sheds light on here-to-fore unknown matters such as how the pediatric 3D hemi-diaphragm motion/shape varies regionally, between right and left hemi-diaphragms, between genders, and with age.
RESUMO
Purpose: There is a concern in pediatric surgery practice that rib-based fixation may limit chest wall motion in early onset scoliosis (EOS). The purpose of this study is to address the above concern by assessing the contribution of chest wall excursion to respiration before and after surgery. Methods: Quantitative dynamic magnetic resonance imaging (QdMRI) is performed on EOS patients (before and after surgery) and normal children in this retrospective study. QdMRI is purely an image-based approach and allows free breathing image acquisition. Tidal volume parameters for chest walls (CWtv) and hemi-diaphragms (Dtv) were analyzed on concave and convex sides of the spinal curve. EOS patients (1-14 years) and normal children (5-18 years) were enrolled, with an average interval of two years for dMRI acquisition before and after surgery. Results: CWtv significantly increased after surgery in the global comparison including all EOS patients (p < 0.05). For main thoracic curve (MTC) EOS patients, CWtv significantly improved by 50.24% (concave side) and 35.17% (convex side) after age correction (p < 0.05) after surgery. The average ratio of Dtv to CWtv on the convex side in MTC EOS patients was not significantly different from that in normal children (p=0.78), although the concave side showed the difference to be significant. Conclusion: Chest wall component tidal volumes in EOS patients measured via QdMRI did not decrease after rib-based surgery, suggesting that rib-based fixation does not impair chest wall motion in pediatric patients with EOS.
RESUMO
Background: A normative database of regional respiratory structure and function in healthy children does not exist. Methods: VGC provides a database with four categories of regional respiratory measurement parameters including morphological, architectural, dynamic, and developmental. The database has 3,820 3D segmentations (around 100,000 2D slices with segmentations). Age and gender group analysis and comparisons for healthy children were performed using those parameters via two-sided t-testing to compare mean measurements, for left and right sides at end-inspiration (EI) and end-expiration (EE), for different age and gender specific groups. We also apply VGC measurements for comparison with TIS patients via an extrapolation approach to estimate the association between measurement and age via a linear model and to predict measurements for TIS patients. Furthermore, we check the Mahalanobis distance between TIS patients and healthy children of corresponding age. Findings: The difference between male and female groups (10-12 years) behave differently from that in other age groups which is consistent with physiology/natural growth behavior related to adolescence with higher right lung and right diaphragm tidal volumes for females(p<0.05). The comparison of TIS patients before and after surgery show that the right and left components are not symmetrical, and the left side diaphragm height and tidal volume has been significantly improved after surgery (p <0.05). The left lung volume at EE, and left diaphragm height at EI of TIS patients after surgery are closer to the normal children with a significant smaller Mahalanobis distance (MD) after surgery (p<0.05). Interpretation: The VGC system can serve as a reference standard to quantify regional respiratory abnormalities on dMRI in young patients with various respiratory conditions and facilitate treatment planning and response assessment. Funding: The grant R01HL150147 from the National Institutes of Health (PI Udupa).
RESUMO
Purpose: Lung tissue and lung excursion segmentation in thoracic dynamic magnetic resonance imaging (dMRI) is a critical step for quantitative analysis of thoracic structure and function in patients with respiratory disorders such as Thoracic Insufficiency Syndrome (TIS). However, the complex variability of intensity and shape of anatomical structures and the low contrast between the lung and surrounding tissue in MR images seriously hamper the accuracy and robustness of automatic segmentation methods. In this paper, we develop an interactive deep-learning based segmentation system to solve this problem. Material & Methods: Considering the significant difference in lung morphological characteristics between normal subjects and TIS subjects, we utilized two independent data sets of normal subjects and TIS subjects to train and test our model. 202 dMRI scans from 101 normal pediatric subjects and 92 dMRI scans from 46 TIS pediatric subjects were acquired for this study and were randomly divided into training, validation, and test sets by an approximate ratio of 5:1:4. First, we designed an interactive region of interest (ROI) strategy to detect the lung ROI in dMRI for accelerating the training speed and reducing the negative influence of tissue located far away from the lung on lung segmentation. Second, we utilized a modified 2D U-Net to segment the lung tissue in lung ROIs, in which the adjacent slices are utilized as the input data to take advantage of the spatial information of the lungs. Third, we extracted the lung shell from the lung segmentation results as the shape feature and inputted the lung ROIs with shape feature into another modified 2D U-Net to segment the lung excursion in dMRI. To evaluate the performance of our approach, we computed the Dice coefficient (DC) and max-mean Hausdorff distance (MM-HD) between manual and automatic segmentations. In addition, we utilized Coefficient of Variation (CV) to assess the variability of our method on repeated dMRI scans and the differences of lung tidal volumes computed from the manual and automatic segmentation results. Results: The proposed system yielded mean Dice coefficients of 0.96±0.02 and 0.89±0.05 for lung segmentation in dMRI of normal subjects and TIS subjects, respectively, demonstrating excellent agreement with manual delineation results. The Coefficient of Variation and p-values show that the estimated lung tidal volumes of our approach are statistically indistinguishable from those derived by manual segmentations. Conclusions: The proposed approach can be applied to lung tissue and lung excursion segmentation from dynamic MR images with high accuracy and efficiency. The proposed approach has the potential to be utilized in the assessment of patients with TIS via dMRI routinely.
RESUMO
Purpose: To develop an anthropomorphic diagnosis system of pulmonary nodules (PN) based on Deep learning (DL) that is trained by weak annotation data and has comparable performance to full-annotation based diagnosis systems. Methods: The proposed system uses deep learning (DL) models to classify PNs (benign vs. malignant) with weak annotations, which eliminates the need for time-consuming and labor-intensive manual annotations of PNs. Moreover, the PN classification networks, augmented with handcrafted shape features acquired through the ball-scale transform technique, demonstrate capability to differentiate PNs with diverse labels, including pure ground-glass opacities, part-solid nodules, and solid nodules. Results: The experiments were conducted on two lung CT datasets: (1) public LIDC-IDRI dataset with 1,018 subjects, (2) In-house dataset with 2740 subjects. Through 5-fold cross-validation on two datasets, the system achieved the following results: (1) an Area Under Curve (AUC) of 0.938 for PN localization and an AUC of 0.912 for PN differential diagnosis on the LIDC-IDRI dataset of 814 testing cases, (2) an AUC of 0.943 for PN localization and an AUC of 0.815 for PN differential diagnosis on the in-house dataset of 822 testing cases. These results demonstrate comparable performance to full annotation-based diagnosis systems. Conclusions: Our system can efficiently localize and differentially diagnose PNs even in resource-limited environments with good robustness across different grade and morphology sub-groups in the presence of deviations due to the size, shape, and texture of the nodule, indicating its potential for future clinical translation. Summary: An anthropomorphic diagnosis system of pulmonary nodules (PN) based on deep learning and weak annotation was found to achieve comparable performance to full-annotation dataset-based diagnosis systems, significantly reducing the time and the cost associated with the annotation. Key Points: A fully automatic system for the diagnosis of PN in CT scans using a suitable deep learning model and weak annotations was developed to achieve comparable performance (AUC = 0.938 for PN localization, AUC = 0.912 for PN differential diagnosis) with the full-annotation based deep learning models, reducing around 30%â¼80% of annotation time for the experts.The integration of the hand-crafted feature acquired from human experts (natural intelligence) into the deep learning networks and the fusion of the classification results of multi-scale networks can efficiently improve the PN classification performance across different diameters and sub-groups of the nodule.
RESUMO
Purpose: Thoracic insufficiency syndrome (TIS) affects ventilatory function due to spinal and thoracic deformities limiting lung space and diaphragmatic motion. Corrective orthopedic surgery can be used to help normalize skeletal anatomy, restoring lung space and diaphragmatic motion. This study employs free-breathing dynamic MRI (dMRI) and quantifies the 3D motion of each hemi-diaphragm surface in normal and TIS patients, and evaluates effects of surgical intervention. Materials and Methods: In a retrospective study of 149 pediatric patients with TIS and 190 healthy children, we constructed 4D images from free-breathing dMRI and manually delineated the diaphragm at end-expiration (EE) and end-inspiration (EI) time points. We automatically selected 25 points uniformly on each hemi-diaphragm surface, calculated their relative velocities between EE and EI, and derived mean velocities in 13 homologous regions for each hemi-diaphragm to provide measures of regional 3D hemi-diaphragm motion. T-testing was used to compare velocity changes before and after surgery, and to velocities in healthy controls. Results: The posterior-central region of the right hemi-diaphragm exhibited the highest average velocity post-operatively. Posterior regions showed greater velocity changes after surgery in both right and left hemi-diaphragms. Surgical reduction of thoracic Cobb angle displayed a stronger correlation with changes in diaphragm velocity than reduction in lumbar Cobb angle. Following surgery, the anterior regions of the left hemi-diaphragm tended to approach a more normal state. Conclusion: Quantification of regional motion of the 3D diaphragm surface in normal subjects and TIS patients via free-breathing dMRI is feasible. Derived measurements can be assessed in comparison to normal subjects to study TIS and the effects of surgery.
RESUMO
Purpose: Analysis of the abnormal motion of thoraco-abdominal organs in respiratory disorders such as the Thoracic Insufficiency Syndrome (TIS) and scoliosis such as adolescent idiopathic scoliosis (AIS) or early onset scoliosis (EOS) can lead to better surgical plans. We can use healthy subjects to find out the normal architecture and motion of a rib cage and associated organs and attempt to modify the patient's deformed anatomy to match to it. Dynamic magnetic resonance imaging (dMRI) is a practical and preferred imaging modality for capturing dynamic images of healthy pediatric subjects. In this paper, we propose an auto-segmentation set-up for the lungs, kidneys, liver, spleen, and thoraco-abdominal skin in these dMRI images which have their own challenges such as poor contrast, image non-standardness, and similarity in texture amongst gas, bone, and connective tissue at several inter-object interfaces. Methods: The segmentation set-up has been implemented in two steps: recognition and delineation using two deep neural network (DL) architectures (say DL-R and DL-D) for the recognition step and delineation step, respectively. The encoder-decoder framework in DL-D utilizes features at four different resolution levels to counter the challenges involved in the segmentation. We have evaluated on dMRI sagittal acquisitions of 189 (near-)normal subjects. The spatial resolution in all dMRI acquisitions is 1.46 mm in a sagittal slice and 6.00 mm between sagittal slices. We utilized images of 89 (10) subjects at end inspiration for training (validation). For testing we experimented with three scenarios: utilizing (1) the images of 90 (=189-89-10) different (remaining) subjects at end inspiration for testing, (2) the images of the aforementioned 90 subjects at end expiration for testing, and (3) the images of the aforesaid 99 (=89+10) subjects but at end expiration for testing. In some situations, we can take advantage of already available ground truth (GT) of a subject at a particular respiratory phase to automatically segment the object in the image of the same subject at a different respiratory phase and then refining the segmentation to create the final GT. We anticipate that this process of creating GT would require minimal post hoc correction. In this spirit, we conducted separate experiments where we assume to have the ground truth of the test subjects at end expiration for scenario (1), end inspiration for (2), and end inspiration for (3). Results: Amongst these three scenarios of testing, for the DL-R, we achieve a best average location error (LE) of about 1 voxel for the lungs, kidneys, and spleen and 1.5 voxels for the liver and the thoraco- abdominal skin. The standard deviation (SD) of LE is about 1 or 2 voxels. For the delineation approach, we achieve an average Dice coefficient (DC) of about 0.92 to 0.94 for the lungs, 0.82 for the kidneys, 0.90 for the liver, 0.81 for the spleen, and 0.93 for the thoraco-abdominal skin. The SD of DC is lower for the lungs, liver, and the thoraco-abdominal skin, and slightly higher for the spleen and kidneys. Conclusions: Motivated by applications in surgical planning for disorders such as TIS, AIS, and EOS, we have shown an auto-segmentation system for thoraco-abdominal organs in dMRI acquisitions. This proposed setup copes with the challenges posed by low resolution, motion blur, inadequate contrast, and image intensity non-standardness quite well. We are in the process of testing its effectiveness on TIS patient dMRI data.
RESUMO
PURPOSE: Body composition analysis (BCA) of the body torso plays a vital role in the study of physical health and pathology and provides biomarkers that facilitate the diagnosis and treatment of many diseases, such as type 2 diabetes mellitus, cardiovascular disease, obstructive sleep apnea, and osteoarthritis. In this work, we propose a body composition tissue segmentation method that can automatically delineate those key tissues, including subcutaneous adipose tissue, skeleton, skeletal muscle tissue, and visceral adipose tissue, on positron emission tomography/computed tomography scans of the body torso. METHODS: To provide appropriate and precise semantic and spatial information that is strongly related to body composition tissues for the deep neural network, first we introduce a new concept of the body area and integrate it into our proposed segmentation network called Geographical Attention Network (GA-Net). The body areas are defined following anatomical principles such that the whole body torso region is partitioned into three non-overlapping body areas. Each body composition tissue of interest is fully contained in exactly one specific minimal body area. Secondly, the proposed GA-Net has a novel dual-decoder schema that is composed of a tissue decoder and an area decoder. The tissue decoder segments the body composition tissues, while the area decoder segments the body areas as an auxiliary task. The features of body areas and body composition tissues are fused through a soft attention mechanism to gain geographical attention relevant to the body tissues. Thirdly, we propose a body composition tissue annotation approach that takes the body area labels as the region of interest, which significantly improves the reproducibility, precision, and efficiency of delineating body composition tissues. RESULTS: Our evaluations on 50 low-dose unenhanced CT images indicate that GA-Net outperforms other architectures statistically significantly based on the Dice metric. GA-Net also shows improvements for the 95% Hausdorff Distance metric in most comparisons. Notably, GA-Net exhibits more sensitivity to subtle boundary information and produces more reliable and robust predictions for such structures, which are the most challenging parts to manually mend in practice, with potentially significant time-savings in the post hoc correction of these subtle boundary placement errors. Due to the prior knowledge provided from body areas, GA-Net achieves competitive performance with less training data. Our extension of the dual-decoder schema to TransUNet and 3D U-Net demonstrates that the new schema significantly improves the performance of these classical neural networks as well. Heatmaps obtained from attention gate layers further illustrate the geographical guidance function of body areas for identifying body tissues. CONCLUSIONS: (i) Prior anatomic knowledge supplied in the form of appropriately designed anatomic container objects significantly improves the segmentation of bodily tissues. (ii) Of particular note are the improvements achieved in the delineation of subtle boundary features which otherwise would take much effort for manual correction. (iii) The method can be easily extended to existing networks to improve their accuracy for this application.
Assuntos
Diabetes Mellitus Tipo 2 , Processamento de Imagem Assistida por Computador , Humanos , Processamento de Imagem Assistida por Computador/métodos , Reprodutibilidade dos Testes , Redes Neurais de Computação , Composição Corporal , Tronco/diagnóstico por imagemRESUMO
Quantitative analysis of the dynamic properties of thoraco-abdominal organs such as lungs during respiration could lead to more accurate surgical planning for disorders such as Thoracic Insufficiency Syndrome (TIS). This analysis can be done from semi-automatic delineations of the aforesaid organs in scans of the thoraco-abdominal body region. Dynamic magnetic resonance imaging (dMRI) is a practical and preferred imaging modality for this application, although automatic segmentation of the organs in these images is very challenging. In this paper, we describe an auto-segmentation system we built and evaluated based on dMRI acquisitions from 95 healthy subjects. For the three recognition approaches, the system achieves a best average location error (LE) of about 1 voxel for the lungs. The standard deviation (SD) of LE is about 1-2 voxels. For the delineation approach, the average Dice coefficient (DC) is about 0.95 for the lungs. The standard deviation of DC is about 0.01 to 0.02 for the lungs. The system seems to be able to cope with the challenges posed by low resolution, motion blur, inadequate contrast, and image intensity non-standardness quite well. We are in the process of testing its effectiveness on TIS patient dMRI data and on other thoraco-abdominal organs including liver, kidneys, and spleen.
RESUMO
Purpose: Tissue radiotracer activity measured from positron emission tomography (PET) images is an important biomarker that is clinically utilized for diagnosis, staging, prognostication, and treatment response assessment in patients with cancer and other clinical disorders. Using PET image values to define a normal range of metabolic activity for quantification purposes is challenging due to variations in patient-related factors and technical factors. Although the formulation of standardized uptake value (SUV) has compensated for some of these variabilities, significant non-standardness still persists. We propose an image processing method to substantially mitigate these variabilities. Methods: The standardization method is similar for activity concentration (AC) PET and SUV PET images with some differences and consists of two steps. The calibration step is performed only once for each of AC PET or SUV PET, employs a set of images of normal subjects, and requires a reference object, while the transformation step is executed for each patient image to be standardized. In the calibration step, a standardized scale is determined along with 3 key image intensity landmarks defined on it including the minimum percentile intensity s min , median intensity s m , and high percentile intensity s max . s min and s m are estimated based on image intensities within the body region in the normal calibration image set. The optimal value of the maximum percentile ß corresponding to the intensity s max is estimated via an optimization process by using the reference object to optimally separate the highly variable high uptake values from the normal uptake intensities. In the transformation step, the first two landmarks-the minimum percentile intensity p α ( I ) , and the median intensity p m ( I ) -are found for the given image I for the body region, and the high percentile intensity p ß ( I ) is determined corresponding to the optimally estimated high percentile value ß . Subsequently, intensities of I are mapped to the standard scale piecewise linearly for different segments. We employ three strategies for evaluation and comparison with other standardization methods: (i) comparing coefficient of variation C V O of mean intensity within test objects O across different normal test subjects before and after standardization; (ii) comparing mean absolute difference ( MD O ) of mean intensity within test objects O across different subjects in repeat scans before and after standardization; (iii) comparing C V O of mean intensity across different normal subjects before and after standardization where the scans came from different brands of scanners. Results: Our data set consisted of 84 FDG-PET/CT scans of the body torso including 38 normal subjects and two repeat-scans of 23 patients. We utilized one of two objects-liver and spleen-as a reference object and the other for testing. The proposed standardization method reduced C V O and MD O by a factor of 3-8 in comparison to other standardization methods and no standardization. Upon standardization by our method, the image intensities (both for AC and SUV) from two different brands of scanners become statistically indistinguishable, while without standardization, they differ significantly and by a factor of 3-9. Conclusions: The proposed method is automatic, outperforms current standardization methods, and effectively overcomes the residual variation left over in SUV and inter-scanner variations.
RESUMO
Organ localization is a common and essential preprocessing operation for many medical image analysis tasks. We propose a novel multi-organ localization method based on an end-to-end 3D convolutional neural network. The proposed algorithm employs a regression network to learn the position relationship between any patch and target organs in a medical computed tomography (CT) image. With this framework, it can iteratively localize the target organs in a coarse-to-fine manner. The main idea behind this method is to embed the anatomy of structures in a deep learning-based approach. For implementation, the proposed network outputs an 8-dimensional vector that contains information about the position, scale, and presence of each target organ. A piecewise loss function and a multi-density sampling strategy help to optimize this network to learn anatomy layout characteristics over the entire CT image. Starting from a random position, this network can accurately locate the target organ with a few iterations. Moreover, a dual-resolution strategy is employed to improve the accuracy affected by varying organ scales, further enhancing the localizing performance for all organs. We evaluate our method on a public data set (LiTS) to locate 11 organs in the thoraco-abdomino-pelvic region. The proposed method outperforms state-of-the-art methods with a mean intersection over union (IOU) of 80.84%, mean wall distance of 3.63 mm, and mean centroid distance of 4.93 mm, constituting excellent accuracy. The improvements on relatively small-size and medium-size organs are noteworthy.