Semi-supervised learning towards automated segmentation of PET images with limited annotations: application to lymphoma patients.

Manual segmentation poses a time-consuming challenge for disease quantification, therapy evaluation, treatment planning, and outcome prediction. Convolutional neural networks (CNNs) hold promise in accurately identifying tumor locations and boundaries in PET scans. However, a major hurdle is the extensive amount of supervised and annotated data necessary for training. To overcome this limitation, this study explores semi-supervised approaches utilizing unlabeled data, specifically focusing on PET images of diffuse large B-cell lymphoma (DLBCL) and primary mediastinal large B-cell lymphoma (PMBCL) obtained from two centers. We considered 2-[18F]FDG PET images of 292 patients PMBCL (n = 104) and DLBCL (n = 188) (n = 232 for training and validation, and n = 60 for external testing). We harnessed classical wisdom embedded in traditional segmentation methods, such as the fuzzy clustering loss function (FCM), to tailor the training strategy for a 3D U-Net model, incorporating both supervised and unsupervised learning approaches. Various supervision levels were explored, including fully supervised methods with labeled FCM and unified focal/Dice loss, unsupervised methods with robust FCM (RFCM) and Mumford-Shah (MS) loss, and semi-supervised methods combining FCM with supervised Dice loss (MS + Dice) or labeled FCM (RFCM + FCM). The unified loss function yielded higher Dice scores (0.73 ± 0.11; 95% CI 0.67-0.8) than Dice loss (p value < 0.01). Among the semi-supervised approaches, RFCM + αFCM (α = 0.3) showed the best performance, with Dice score of 0.68 ± 0.10 (95% CI 0.45-0.77), outperforming MS + αDice for any supervision level (any α) (p < 0.01). Another semi-supervised approach with MS + αDice (α = 0.2) achieved Dice score of 0.59 ± 0.09 (95% CI 0.44-0.76) surpassing other supervision levels (p < 0.01). Given the time-consuming nature of manual delineations and the inconsistencies they may introduce, semi-supervised approaches hold promise for automating medical imaging segmentation workflows.

PSMA-Hornet: Fully-automated, multi-target segmentation of healthy organs in PSMA PET/CT images.

BACKGROUND: Prostate-specific membrane antigen (PSMA) PET imaging represents a valuable source of information reflecting disease stage, response rate, and treatment optimization options, particularly with PSMA radioligand therapy. Quantification of radiopharmaceutical uptake in healthy organs from PSMA images has the potential to minimize toxicity by extrapolation of the radiation dose delivery towards personalization of therapy. However, segmentation and quantification of uptake in organs requires labor-intensive organ delineations that are often not feasible in the clinic nor scalable for large clinical trials. PURPOSE: In this work we develop and test the PSMA Healthy organ segmentation network (PSMA-Hornet), a fully-automated deep neural net for simultaneous segmentation of 14 healthy organs representing the normal biodistribution of [18 F]DCFPyL on PET/CT images. We also propose a modified U-net architecture, a self-supervised pre-training method for PET/CT images, a multi-target Dice loss, and multi-target batch balancing to effectively train PSMA-Hornet and similar networks. METHODS: The study used manually-segmented [18 F]DCFPyL PET/CT images from 100 subjects, and 526 similar images without segmentations. The unsegmented images were used for self-supervised model pretraining. For supervised training, Monte-Carlo cross-validation was used to evaluate the network performance, with 85 subjects in each trial reserved for model training, 5 for validation, and 10 for testing. Image segmentation and quantification metrics were evaluated on the test folds with respect to manual segmentations by a nuclear medicine physician, and compared to inter-rater agreement. The model's segmentation performance was also evaluated on a separate set of 19 images with high tumor load. RESULTS: With our best model, the lowest mean Dice coefficient on the test set was 0.826 for the sublingual gland, and the highest was 0.964 for liver. The highest mean error in tracer uptake quantification was 13.9% in the sublingual gland. Self-supervised pretraining improved training convergence, train-to-test generalization, and segmentation quality. In addition, we found that a multi-target network produced significantly higher segmentation accuracy than single-organ networks. CONCLUSIONS: The developed network can be used to automatically obtain high-quality organ segmentations for PSMA image analysis tasks. It can be used to reproducibly extract imaging data, and holds promise for clinical applications such as personalized radiation dosimetry and improved radioligand therapy.

Development of scalable lymphatic system in the 4D XCAT phantom: Application to quantitative evaluation of lymphoma PET segmentations.

BACKGROUND: Digital anthropomorphic phantoms, such as the 4D extended cardiac-torso (XCAT) phantom, are actively used to develop, optimize, and evaluate a variety of imaging applications, allowing for realistic patient modeling and knowledge of ground truth. The XCAT phantom defines the activity and attenuation for a simulated patient, which includes a complete set of organs, muscle, bone, and soft tissue, while also accounting for cardiac and respiratory motion. However, the XCAT phantom does not currently include the lymphatic system, critical for evaluating medical imaging tasks such as sentinel node detection, node density measurement, and radiation dosimetry. PURPOSE: In this study, we aimed to develop a scalable lymphatic system in the XCAT phantom, to facilitate improved research of the lymphatic system in medical imaging. Using this scalable lymphatic system, we modeled the lymph node conglomerate pathology that is characteristically observed in primary mediastinal B-cell lymphoma (PMBCL). As an extended application, we evaluated positron emission tomography (PET) image quantification of metabolic tumor volume (MTV) and total lesion glycolysis (TLG) of these simulated lymphomas, though the phantoms may be applied to other imaging modalities and study design paradigms (e.g., image quality, detection). METHODS: A template model for the lymphatic system was developed based on anatomical data from the Visible Human Project of the National Library of Medicine. The segmented nodes and vessels were fit with non-uniform rational basis spline surfaces, and multichannel large deformation diffeomorphic metric mapping was used to propagate the template to different XCAT anatomies. To model conglomerates observed in PMBCL, lymph nodes were enlarged, converged within the mediastinum, and tracer concentration was increased. We used the phantoms as inputs to a PET simulation tool, which generated images using ordered subsets expectation maximization reconstruction with 2-8 mm Gaussian filters. Fixed thresholding (FT) and gradient segmentation were used to determine MTV and TLG. Percent bias (%Bias) and coefficient of variation (COV) were computed as measures of accuracy and precision, respectively, for each MTV and TLG measurement. RESULTS: Using the methodology described above, we introduced a scalable lymphatic system in the XCAT phantom, which allows for the radioactivity and attenuation ground truth to be generated in 116 ± 2.5 s using a 2.3 GHz processor. Within the Rhinoceros interface, lymph node anatomy and function were modified to create a cohort of 10 phantoms with lymph node conglomerates. Using the lymphoma phantoms to evaluate PET quantification of MTV, mean %Bias values were -9.3%, -41.3%, and 20.9%, while COV values were 4.08%, 7.6%, and 3.4% using 25% FT, 40% FT, and gradient segmentations, respectively. Comparatively for TLG, mean %Bias values were -27.4%, -45.8%, and -16.0%, while COV values were 1.9%, 5.7%, and 1.4%, for the 25% FT, 40% FT, and gradient segmentations, respectively. CONCLUSIONS: In this work, we upgraded the XCAT phantom to include a lymphatic system, comprised of a network of 276 scalable lymph nodes and corresponding vessels. As an application, we created a cohort of phantoms with lymph node conglomerates to evaluate lymphoma quantification in PET imaging, which highlights an important application of this work.

Metastatic Adamantinoma of the Femur on FDG PET/CT: Atypical Presentation of a Rare Disease.

ABSTRACT: Adamantinomas are rare malignant primary bone tumors, which typically arise in young patients, are generally low-grade tumors, and classically arise from the anterior tibial diaphysis. We present the case of a 70-year-old woman who underwent repeat imaging with FDG PET for a pathologically proven case of femoral adamantinoma who experienced a relatively rapid development of metastatic disease with an atypical distribution of lesions.