Deep learning generation of preclinical positron emission tomography (PET) images from low-count PET with task-based performance assessment.

BACKGROUND: Preclinical low-count positron emission tomography (LC-PET) imaging offers numerous advantages such as facilitating imaging logistics, enabling longitudinal studies of long- and short-lived isotopes as well as increasing scanner throughput. However, LC-PET is characterized by reduced photon-count levels resulting in low signal-to-noise ratio (SNR), segmentation difficulties, and quantification uncertainties. PURPOSE: We developed and evaluated a novel deep-learning (DL) architecture-Attention based Residual-Dilated Net (ARD-Net)-to generate standard-count PET (SC-PET) images from LC-PET images. The performance of the ARD-Net framework was evaluated for numerous low count realizations using fidelity-based qualitative metrics, task-based segmentation, and quantitative metrics. METHOD: Patient Derived tumor Xenograft (PDX) with tumors implanted in the mammary fat-pad were subjected to preclinical [18F]-Fluorodeoxyglucose (FDG)-PET/CT imaging. SC-PET images were derived from a 10 min static FDG-PET acquisition, 50 min post administration of FDG, and were resampled to generate four distinct LC-PET realizations corresponding to 10%, 5%, 1.6%, and 0.8% of SC-PET count-level. ARD-Net was trained and optimized using 48 preclinical FDG-PET datasets, while 16 datasets were utilized to assess performance. Further, the performance of ARD-Net was benchmarked against two leading DL-based methods (Residual UNet, RU-Net; and Dilated Network, D-Net) and non-DL methods (Non-Local Means, NLM; and Block Matching 3D Filtering, BM3D). The performance of the framework was evaluated using traditional fidelity-based image quality metrics such as Structural Similarity Index Metric (SSIM) and Normalized Root Mean Square Error (NRMSE), as well as human observer-based tumor segmentation performance (Dice Score and volume bias) and quantitative analysis of Standardized Uptake Value (SUV) measurements. Additionally, radiomics-derived features were utilized as a measure of quality assurance (QA) in comparison to true SC-PET. Finally, a performance ensemble score (EPS) was developed by integrating fidelity-based and task-based metrics. Concordance Correlation Coefficient (CCC) was utilized to determine concordance between measures. The non-parametric Friedman Test with Bonferroni correction was used to compare the performance of ARD-Net against benchmarked methods with significance at adjusted p-value ≤0.01. RESULTS: ARD-Net-generated SC-PET images exhibited significantly better (p ≤ 0.01 post Bonferroni correction) overall image fidelity scores in terms of SSIM and NRMSE at majority of photon-count levels compared to benchmarked DL and non-DL methods. In terms of task-based quantitative accuracy evaluated by SUVMean and SUVPeak, ARD-Net exhibited less than 5% median absolute bias for SUVMean compared to true SC-PET and lower degree of variability compared to benchmarked DL and non-DL based methods in generating SC-PET. Additionally, ARD-Net-generated SC-PET images displayed higher degree of concordance to SC-PET images in terms of radiomics features compared to non-DL and other DL approaches. Finally, the ensemble score suggested that ARD-Net exhibited significantly superior performance compared to benchmarked algorithms (p ≤ 0.01 post Bonferroni correction). CONCLUSION: ARD-Net provides a robust framework to generate SC-PET from LC-PET images. ARD-Net generated SC-PET images exhibited superior performance compared other DL and non-DL approaches in terms of image-fidelity based metrics, task-based segmentation metrics, and minimal bias in terms of task-based quantification performance for preclinical PET imaging.

How accurately can quantitative imaging methods be ranked without ground truth: An upper bound on no-gold-standard evaluation.

Objective evaluation of quantitative imaging (QI) methods with patient data, while important, is typically hindered by the lack of gold standards. To address this challenge, no-gold-standard evaluation (NGSE) techniques have been proposed. These techniques have demonstrated efficacy in accurately ranking QI methods without access to gold standards. The development of NGSE methods has raised an important question: how accurately can QI methods be ranked without ground truth. To answer this question, we propose a Cramer-Rao bound (CRB)-based framework that quantifies the upper bound in ranking QI methods without any ground truth. We present the application of this framework in guiding the use of a well-known NGSE technique, namely the regression-without-truth (RWT) technique. Our results show the utility of this framework in quantifying the performance of this NGSE technique for different patient numbers. These results provide motivation towards studying other applications of this upper bound.

Can patient-specific acquisition protocol improve performance on defect detection task in myocardial perfusion SPECT?

Myocardial perfusion imaging using single-photon emission computed tomography (SPECT), or myocardial perfusion SPECT (MPS) is a widely used clinical imaging modality for the diagnosis of coronary artery disease. Current clinical protocols for acquiring and reconstructing MPS images are similar for most patients. However, for patients with outlier anatomical characteristics, such as large breasts, images acquired using conventional protocols are often sub-optimal in quality, leading to degraded diagnostic accuracy. Solutions to improve image quality for these patients outside of increased dose or total acquisition time remain challenging. Thus, there is an important need for new methodologies to improve image quality for such patients. One approach to improving this performance is adapting the image acquisition protocol specific to each patient. For this study, we first designed and implemented a personalized patient-specific protocol-optimization strategy, which we term precision SPECT (PRESPECT). This strategy integrates ideal observer theory with the constraints of tomographic reconstruction to optimize the acquisition time for each projection view, such that MPS defect detection performance is maximized. We performed a clinically realistic simulation study on patients with outlier anatomies on the task of detecting perfusion defects on various realizations of low-dose scans by an anthropomorphic channelized Hotelling observer. Our results show that using PRESPECT led to improved performance on the defect detection task for the considered patients. These results provide evidence that personalization of MPS acquisition protocol has the potential to improve defect detection performance, motivating further research to design optimal patient-specific acquisition and reconstruction protocols for MPS, as well as developing similar approaches for other medical imaging modalities.

WIN-PDQ: A Wiener-estimator-based projection-domain quantitative SPECT method that accounts for intra-regional uptake heterogeneity.

SPECT can enable the quantification of activity uptake in lesions and at-risk organs in {\alpha}-particle-emitting radiopharmaceutical therapies ({\alpha}-RPTs). But this quantification is challenged by the low photon counts, complicated isotope physics, and the image-degrading effects in {\alpha}-RPT SPECT. Thus, strategies to optimize the SPECT system and protocol designs for the task of regional uptake quantification are needed. Objectively performing this task-based optimization requires a reliable (accurate and precise) regional uptake quantification method. Conventional reconstruction-based quantification (RBQ) methods have been observed to be erroneous for {\alpha}-RPT SPECT. Projection-domain quantification methods, which estimate regional uptake directly from SPECT projections, have demonstrated potential in providing reliable regional uptake estimates, but these methods assume constant uptake within the regions, an assumption that may not hold. To address these challenges, we propose WIN-PDQ, a Wiener-estimator-based projection-domain quantitative SPECT method. The method accounts for the heterogeneity within the regions of interest while estimating mean uptake. An early-stage evaluation of the method was conducted using 3D Monte Carlo-simulated SPECT of anthropomorphic phantoms with radium-223 uptake and lumpy-model-based intra-regional uptake heterogeneity. In this evaluation with phantoms of varying mean regional uptake and intra-regional uptake heterogeneity, the WIN-PDQ method yielded ensemble unbiased estimates and significantly outperformed both reconstruction-based and previously proposed projection-domain quantification methods. In conclusion, based on these preliminary findings, the proposed method is showing potential for estimating mean regional uptake in {\alpha}-RPTs and towards enabling the objective task-based optimization of SPECT system and protocol designs.

ISIT-QA: In Silico Imaging Trial to Evaluate a Low-Count Quantitative SPECT Method Across Multiple Scanner-Collimator Configurations for 223Ra-Based Radiopharmaceutical Therapies.

Personalized dose-based treatment planning requires accurate and reproducible noninvasive measurements to ensure safety and effectiveness. Dose estimation using SPECT is possible but challenging for alpha (α)-particle-emitting radiopharmaceutical therapy (α-RPT) because of complex γ-emission spectra, extremely low counts, and various image-degrading artifacts across a plethora of scanner-collimator configurations. Through the incorporation of physics-based considerations and skipping of the potentially lossy voxel-based reconstruction step, a recently developed projection-domain low-count quantitative SPECT (LC-QSPECT) method has the potential to provide reproducible, accurate, and precise activity concentration and dose measures across multiple scanners, as is typically the case in multicenter settings. To assess this potential, we conducted an in silico imaging trial to evaluate the LC-QSPECT method for a 223Ra-based α-RPT, with the trial recapitulating patient and imaging system variabilities. Methods: A virtual imaging trial titled In Silico Imaging Trial for Quantitation Accuracy (ISIT-QA) was designed with the objectives of evaluating the performance of the LC-QSPECT method across multiple scanner-collimator configurations and comparing performance with a conventional reconstruction-based quantification method. In this trial, we simulated 280 realistic virtual patients with bone-metastatic castration-resistant prostate cancer treated with 223Ra-based α-RPT. The trial was conducted with 9 simulated SPECT scanner-collimator configurations. The primary objective of this trial was to evaluate the reproducibility of dose estimates across multiple scanner-collimator configurations using LC-QSPECT by calculating the intraclass correlation coefficient. Additionally, we compared the reproducibility and evaluated the accuracy of both considered quantification methods across multiple scanner-collimator configurations. Finally, the repeatability of the methods was evaluated in a test-retest study. Results: In this trial, data from 268 223RaCl2 treated virtual prostate cancer patients, with a total of 2,903 lesions, were used to evaluate LC-QSPECT. LC-QSPECT provided dose estimates with good reproducibility across the 9 scanner-collimator configurations (intraclass correlation coefficient > 0.75) and high accuracy (ensemble average values of recovery coefficients ranged from 1.00 to 1.02). Compared with conventional reconstruction-based quantification, LC-QSPECT yielded significantly improved reproducibility across scanner-collimator configurations, accuracy, and test-retest repeatability ([Formula: see text] Conclusion: LC-QSPECT provides reproducible, accurate, and repeatable dose estimations in 223Ra-based α-RPT as evaluated in ISIT-QA. These findings provide a strong impetus for multicenter clinical evaluations of LC-QSPECT in dose quantification for α-RPTs.

Need for Objective Task-Based Evaluation of Image Segmentation Algorithms for Quantitative PET: A Study with ACRIN 6668/RTOG 0235 Multicenter Clinical Trial Data.

Reliable performance of PET segmentation algorithms on clinically relevant tasks is required for their clinical translation. However, these algorithms are typically evaluated using figures of merit (FoMs) that are not explicitly designed to correlate with clinical task performance. Such FoMs include the Dice similarity coefficient (DSC), the Jaccard similarity coefficient (JSC), and the Hausdorff distance (HD). The objective of this study was to investigate whether evaluating PET segmentation algorithms using these task-agnostic FoMs yields interpretations consistent with evaluation on clinically relevant quantitative tasks. Methods: We conducted a retrospective study to assess the concordance in the evaluation of segmentation algorithms using the DSC, JSC, and HD and on the tasks of estimating the metabolic tumor volume (MTV) and total lesion glycolysis (TLG) of primary tumors from PET images of patients with non-small cell lung cancer. The PET images were collected from the American College of Radiology Imaging Network 6668/Radiation Therapy Oncology Group 0235 multicenter clinical trial data. The study was conducted in 2 contexts: (1) evaluating conventional segmentation algorithms, namely those based on thresholding (SUVmax40% and SUVmax50%), boundary detection (Snakes), and stochastic modeling (Markov random field-Gaussian mixture model); (2) evaluating the impact of network depth and loss function on the performance of a state-of-the-art U-net-based segmentation algorithm. Results: Evaluation of conventional segmentation algorithms based on the DSC, JSC, and HD showed that SUVmax40% significantly outperformed SUVmax50%. However, SUVmax40% yielded lower accuracy on the tasks of estimating MTV and TLG, with a 51% and 54% increase, respectively, in the ensemble normalized bias. Similarly, the Markov random field-Gaussian mixture model significantly outperformed Snakes on the basis of the task-agnostic FoMs but yielded a 24% increased bias in estimated MTV. For the U-net-based algorithm, our evaluation showed that although the network depth did not significantly alter the DSC, JSC, and HD values, a deeper network yielded substantially higher accuracy in the estimated MTV and TLG, with a decreased bias of 91% and 87%, respectively. Additionally, whereas there was no significant difference in the DSC, JSC, and HD values for different loss functions, up to a 73% and 58% difference in the bias of the estimated MTV and TLG, respectively, existed. Conclusion: Evaluation of PET segmentation algorithms using task-agnostic FoMs could yield findings discordant with evaluation on clinically relevant quantitative tasks. This study emphasizes the need for objective task-based evaluation of image segmentation algorithms for quantitative PET.

Joint regional uptake quantification of Thorium-227 and Radium-223 using a multiple-energy-window projection-domain quantitative SPECT method.

Thorium-227-based alpha-particle radiopharmaceutical therapies ({\alpha}-RPTs) are being investigated in several clinical and pre-clinical studies. After administration, Thorium-227 decays to Radium-223, another alpha-particle-emitting isotope, which redistributes within the patient. Reliable dose quantification of both Thorium-227 and Radium-223 is clinically important, and SPECT may perform this quantification as these isotopes also emit X- and gamma-ray photons. However, reliable quantification is challenged by the orders-of-magnitude lower activity compared to conventional SPECT, resulting in a very low number of detected counts, the presence of multiple photopeaks, substantial overlap in the emission spectra of these isotopes, and the image-degrading effects in SPECT. To address these issues, we propose a multiple-energy-window projection-domain quantification (MEW-PDQ) method that jointly estimates the regional activity uptake of both Thorium-227 and Radium-223 directly using the SPECT projection from multiple energy windows. We evaluated the method with realistic simulation studies using anthropomorphic digital phantoms, in the context of imaging patients with bone metastases of prostate cancer and treated with Thorium-227-based {\alpha}-RPTs. The proposed method yielded reliable (accurate and precise) regional uptake estimates of both isotopes and outperformed state-of-the-art methods across different lesion sizes and contrasts, in a virtual imaging trial, as well as with moderate levels of intra-regional heterogeneous uptake and with moderate inaccuracies in the definitions of the support of various regions. Additionally, we demonstrated the effectiveness of using multiple energy windows and the variance of the estimated uptake using the proposed method approached the Cram\'er-Rao-lower-bound-defined theoretical limit.

A quality assurance framework for routine monitoring of deep learning cardiac substructure computed tomography segmentation models in radiotherapy.

BACKGROUND: For autosegmentation models, the data used to train the model (e.g., public datasets and/or vendor-collected data) and the data on which the model is deployed in the clinic are typically not the same, potentially impacting the performance of these models by a process called domain shift. Tools to routinely monitor and predict segmentation performance are needed for quality assurance. Here, we develop an approach to perform such monitoring and performance prediction for cardiac substructure segmentation. PURPOSE: To develop a quality assurance (QA) framework for routine or continuous monitoring of domain shift and the performance of cardiac substructure autosegmentation algorithms. METHODS: A benchmark dataset consisting of computed tomography (CT) images along with manual cardiac substructure delineations of 241 breast cancer radiotherapy patients were collected, including one "normal" image domain of clean images and five "abnormal" domains containing images with artifact (metal, contrast), pathology, or quality variations due to scanner protocol differences (field of view, noise, reconstruction kernel, and slice thickness). The QA framework consisted of an image domain shift detector which operated on the input CT images and a shape quality detector on the output of an autosegmentation model, and a regression model for predicting autosegmentation model performance. The image domain shift detector was composed of a trained denoising autoencoder (DAE) and two hand-engineered image quality features to detect normal versus abnormal domains in the input CT images. The shape quality detector was a variational autoencoder (VAE) trained to estimate the shape quality of the auto-segmentation results. The output from the image domain shift and shape quality detectors was used to train a regression model to predict the per-patient segmentation accuracy, measured by Dice coefficient similarity (DSC) to physician contours. Different regression techniques were investigated including linear regression, Bagging, Gaussian process regression, random forest, and gradient boost regression. Of the 241 patients, 60 were used to train the autosegmentation models, 120 for training the QA framework, and the remaining 61 for testing the QA framework. A total of 19 autosegmentation models were used to evaluate QA framework performance, including 18 convolutional neural network (CNN)-based and one transformer-based model. RESULTS: When tested on the benchmark dataset, all abnormal domains resulted in a significant DSC decrease relative to the normal domain for CNN models ( p < 0.001 $p < 0.001$ ), but only for some domains for the transformer model. No significant relationship was found between the performance of an autosegmentation model and scanner protocol parameters ( p = 0.42 $p = 0.42$ ) except noise ( p = 0.01 $p = 0.01$ ). CNN-based autosegmentation models demonstrated a decreased DSC ranging from 0.07 to 0.41 with added noise, while the transformer-based model was not significantly affected (ANOVA, p = 0.99 $p=0.99$ ). For the QA framework, linear regression models with bootstrap aggregation resulted in the highest mean absolute error (MAE) of 0.041 ± 0.002 $0.041 \pm 0.002$ , in predicted DSC (relative to true DSC between autosegmentation and physician). MAE was lowest when combining both input (image) detectors and output (shape) detectors compared to output detectors alone. CONCLUSIONS: A QA framework was able to predict cardiac substructure autosegmentation model performance for clinically anticipated "abnormal" domain shifts.

Beyond Average: α-Particle Distribution and Dose Heterogeneity in Bone Metastatic Prostate Cancer.

α-particle emitters are emerging as a potent modality for disseminated cancer therapy because of their high linear energy transfer and localized absorbed dose profile. Despite great interest and pharmaceutical development, there is scant information on the distribution of these agents at the scale of the α-particle pathlength. We sought to determine the distribution of clinically approved [223Ra]RaCl2 in bone metastatic castration-resistant prostate cancer at this resolution, for the first time to our knowledge, to inform activity distribution and dose at the near-cell scale. Methods: Biopsy specimens and blood were collected from 7 patients 24 h after administration. 223Ra activity in each sample was recorded, and the microstructure of biopsy specimens was analyzed by micro-CT. Quantitative autoradiography and histopathology were segmented and registered with an automated procedure. Activity distributions by tissue compartment and dosimetry calculations based on the MIRD formalism were performed. Results: We revealed the activity distribution differences across and within patient samples at the macro- and microscopic scales. Microdistribution analysis confirmed localized high-activity regions in a background of low-activity tissue. We evaluated heterogeneous α-particle emission distribution concentrated at bone-tissue interfaces and calculated spatially nonuniform absorbed-dose profiles. Conclusion: Primary patient data of radiopharmaceutical therapy distribution at the small scale revealed that 223Ra uptake is nonuniform. Dose estimates present both opportunities and challenges to enhance patient outcomes and are a first step toward personalized treatment approaches and improved understanding of α-particle radiopharmaceutical therapies.

A task-specific deep-learning-based denoising approach for myocardial perfusion SPECT.

Deep-learning (DL)-based methods have shown significant promise in denoising myocardial perfusion SPECT images acquired at low dose. For clinical application of these methods, evaluation on clinical tasks is crucial. Typically, these methods are designed to minimize some fidelity-based criterion between the predicted denoised image and some reference normal-dose image. However, while promising, studies have shown that these methods may have limited impact on the performance of clinical tasks in SPECT. To address this issue, we use concepts from the literature on model observers and our understanding of the human visual system to propose a DL-based denoising approach designed to preserve observer-related information for detection tasks. The proposed method was objectively evaluated on the task of detecting perfusion defect in myocardial perfusion SPECT images using a retrospective study with anonymized clinical data. Our results demonstrate that the proposed method yields improved performance on this detection task compared to using low-dose images. The results show that by preserving task-specific information, DL may provide a mechanism to improve observer performance in low-dose myocardial perfusion SPECT.

Need for objective task-based evaluation of AI-based segmentation methods for quantitative PET.

Artificial intelligence (AI)-based methods are showing substantial promise in segmenting oncologic positron emission tomography (PET) images. For clinical translation of these methods, assessing their performance on clinically relevant tasks is important. However, these methods are typically evaluated using metrics that may not correlate with the task performance. One such widely used metric is the Dice score, a figure of merit that measures the spatial overlap between the estimated segmentation and a reference standard (e.g., manual segmentation). In this work, we investigated whether evaluating AI-based segmentation methods using Dice scores yields a similar interpretation as evaluation on the clinical tasks of quantifying metabolic tumor volume (MTV) and total lesion glycolysis (TLG) of primary tumor from PET images of patients with non-small cell lung cancer. The investigation was conducted via a retrospective analysis with the ECOG-ACRIN 6668/RTOG 0235 multi-center clinical trial data. Specifically, we evaluated different structures of a commonly used AI-based segmentation method using both Dice scores and the accuracy in quantifying MTV/TLG. Our results show that evaluation using Dice scores can lead to findings that are inconsistent with evaluation using the task-based figure of merit. Thus, our study motivates the need for objective task-based evaluation of AI-based segmentation methods for quantitative PET.

Ethical Considerations for Artificial Intelligence in Medical Imaging: Data Collection, Development, and Evaluation.

The development of artificial intelligence (AI) within nuclear imaging involves several ethically fraught components at different stages of the machine learning pipeline, including during data collection, model training and validation, and clinical use. Drawing on the traditional principles of medical and research ethics, and highlighting the need to ensure health justice, the AI task force of the Society of Nuclear Medicine and Molecular Imaging has identified 4 major ethical risks: privacy of data subjects, data quality and model efficacy, fairness toward marginalized populations, and transparency of clinical performance. We provide preliminary recommendations to developers of AI-driven medical devices for mitigating the impact of these risks on patients and populations.

Ethical Considerations for Artificial Intelligence in Medical Imaging: Deployment and Governance.

The deployment of artificial intelligence (AI) has the potential to make nuclear medicine and medical imaging faster, cheaper, and both more effective and more accessible. This is possible, however, only if clinicians and patients feel that these AI medical devices (AIMDs) are trustworthy. Highlighting the need to ensure health justice by fairly distributing benefits and burdens while respecting individual patients' rights, the AI Task Force of the Society of Nuclear Medicine and Molecular Imaging has identified 4 major ethical risks that arise during the deployment of AIMD: autonomy of patients and clinicians, transparency of clinical performance and limitations, fairness toward marginalized populations, and accountability of physicians and developers. We provide preliminary recommendations for governing these ethical risks to realize the promise of AIMD for patients and populations.

A list-mode multi-energy window low-count SPECT reconstruction method for isotopes with multiple emission peaks.

SPECT provides a mechanism to perform absorbed-dose quantification tasks for $\alpha$-particle radiopharmaceutical therapies ($\alpha$-RPTs). However, quantitative SPECT for $\alpha$-RPT is challenging due to the low number of detected counts, the complex emission spectrum, and other image-degrading artifacts. Towards addressing these challenges, we propose a low-count quantitative SPECT reconstruction method for isotopes with multiple emission peaks. Given the low-count setting, it is important that the reconstruction method extract the maximal possible information from each detected photon. Processing data over multiple energy windows and in list-mode (LM) format provide mechanisms to achieve that objective. Towards this goal, we propose a list-mode multi-energy window (LM-MEW) OSEM-based SPECT reconstruction method that uses data from multiple energy windows in LM format, and includes the energy attribute of each detected photon. For computational efficiency, we developed a multi-GPU-based implementation of this method. The method was evaluated using 2-D SPECT simulation studies in a single-scatter setting conducted in the context of imaging [$^{223}$Ra]RaCl${_2}$. The proposed method yielded improved performance on the task of estimating activity uptake within known regions of interest in comparison to approaches that use a single energy window or use binned data. The improved performance was observed in terms of both accuracy and precision and for different sizes of the region of interest. Results of our studies show that the use of multiple energy windows and processing data in LM format with the proposed LM-MEW method led to improved quantification performance in low-count SPECT of isotopes with multiple emission peaks. These results motivate further development and validation of the LM-MEW method for such imaging applications, including for $\alpha$-RPT SPECT.

Carotid atherosclerotic plaque segmentation in multi-weighted MRI using a two-stage neural network: advantages of training with high-resolution imaging and histology.

Introduction: A reliable and automated method to segment and classify carotid artery atherosclerotic plaque components is needed to efficiently analyze multi-weighted magnetic resonance (MR) images to allow their integration into patient risk assessment for ischemic stroke. Certain plaque components such as lipid-rich necrotic core (LRNC) with hemorrhage suggest a greater likelihood of plaque rupture and stroke event. Assessment for presence and extent of LRNC could assist in directing treatment with impact upon patient outcomes. Methods: To address the need to accurately determine the presence and extent of plaque components on carotid plaque MRI, we proposed a two-staged deep-learning-based approach that consists of a convolutional neural network (CNN), followed by a Bayesian neural network (BNN). The rationale for the two-stage network approach is to account for the class imbalance of vessel wall and background by providing an attention mask to the BNN. A unique feature of the network training was to use ground truth defined by both high-resolution ex vivo MRI data and histopathology. More specifically, standard resolution 1.5 T in vivo MR image sets with corresponding high resolution 3.0 T ex vivo MR image sets and histopathology image sets were used to define ground-truth segmentations. Of these, data from 7 patients was used for training and from the remaining two was used for testing the proposed method. Next, to evaluate the generalizability of the method, we tested the method with an additional standard resolution 3.0 T in vivo data set of 23 patients obtained from a different scanner. Results: Our results show that the proposed method yielded accurate segmentation of carotid atherosclerotic plaque and outperforms not only manual segmentation by trained readers, who did not have access to the ex vivo or histopathology data, but also three state-of-the-art deep-learning-based segmentation methods. Further, the proposed approach outperformed a strategy where the ground truth was generated without access to the high resolution ex vivo MRI and histopathology. The accurate performance of this method was also observed in the additional 23-patient dataset from a different scanner. Conclusion: In conclusion, the proposed method provides a mechanism to perform accurate segmentation of the carotid atherosclerotic plaque in multi-weighted MRI. Further, our study shows the advantages of using high-resolution imaging and histology to define ground truth for training deep-learning-based segmentation methods.

DEMIST: A deep-learning-based task-specific denoising approach for myocardial perfusion SPECT.

There is an important need for methods to process myocardial perfusion imaging (MPI) SPECT images acquired at lower radiation dose and/or acquisition time such that the processed images improve observer performance on the clinical task of detecting perfusion defects. To address this need, we build upon concepts from model-observer theory and our understanding of the human visual system to propose a Detection task-specific deep-learning-based approach for denoising MPI SPECT images (DEMIST). The approach, while performing denoising, is designed to preserve features that influence observer performance on detection tasks. We objectively evaluated DEMIST on the task of detecting perfusion defects using a retrospective study with anonymized clinical data in patients who underwent MPI studies across two scanners (N = 338). The evaluation was performed at low-dose levels of 6.25%, 12.5% and 25% and using an anthropomorphic channelized Hotelling observer. Performance was quantified using area under the receiver operating characteristics curve (AUC). Images denoised with DEMIST yielded significantly higher AUC compared to corresponding low-dose images and images denoised with a commonly used task-agnostic DL-based denoising method. Similar results were observed with stratified analysis based on patient sex and defect type. Additionally, DEMIST improved visual fidelity of the low-dose images as quantified using root mean squared error and structural similarity index metric. A mathematical analysis revealed that DEMIST preserved features that assist in detection tasks while improving the noise properties, resulting in improved observer performance. The results provide strong evidence for further clinical evaluation of DEMIST to denoise low-count images in MPI SPECT.

Development and task-based evaluation of a scatter-window projection and deep learning-based transmission-less attenuation compensation method for myocardial perfusion SPECT.

Attenuation compensation (AC) is beneficial for visual interpretation tasks in single-photon emission computed tomography (SPECT) myocardial perfusion imaging (MPI). However, traditional AC methods require the availability of a transmission scan, most often a CT scan. This approach has the disadvantage of increased radiation dose, increased scanner costs, and the possibility of inaccurate diagnosis in cases of misregistration between the SPECT and CT images. Further, many SPECT systems do not include a CT component. To address these issues, we developed a Scatter-window projection and deep Learning-based AC (SLAC) method to perform AC without a separate transmission scan. To investigate the clinical efficacy of this method, we then objectively evaluated the performance of this method on the clinical task of detecting perfusion defects on MPI in a retrospective study with anonymized clinical SPECT/CT stress MPI images. The proposed method was compared with CT-based AC (CTAC) and no-AC (NAC) methods. Our results showed that the SLAC method yielded an almost overlapping receiver operating characteristic (ROC) plot and a similar area under the ROC (AUC) to the CTAC method on this task. These results demonstrate the capability of the SLAC method for transmission-less AC in SPECT and motivate further clinical evaluation.

A list-mode multi-energy window low-count SPECT reconstruction method for isotopes with multiple emission peaks.

BACKGROUND: Single-photon emission computed tomography (SPECT) provides a mechanism to perform absorbed-dose quantification tasks for [Formula: see text]-particle radiopharmaceutical therapies ([Formula: see text]-RPTs). However, quantitative SPECT for [Formula: see text]-RPT is challenging due to the low number of detected counts, the complex emission spectrum, and other image-degrading artifacts. Towards addressing these challenges, we propose a low-count quantitative SPECT reconstruction method for isotopes with multiple emission peaks. METHODS: Given the low-count setting, it is important that the reconstruction method extracts the maximal possible information from each detected photon. Processing data over multiple energy windows and in list-mode (LM) format provide mechanisms to achieve that objective. Towards this goal, we propose a list-mode multi energy window (LM-MEW) ordered-subsets expectation-maximization-based SPECT reconstruction method that uses data from multiple energy windows in LM format and include the energy attribute of each detected photon. For computational efficiency, we developed a multi-GPU-based implementation of this method. The method was evaluated using 2-D SPECT simulation studies in a single-scatter setting conducted in the context of imaging [[Formula: see text]Ra]RaCl[Formula: see text], an FDA-approved RPT for metastatic prostate cancer. RESULTS: The proposed method yielded improved performance on the task of estimating activity uptake within known regions of interest in comparison to approaches that use a single energy window or use binned data. The improved performance was observed in terms of both accuracy and precision and for different sizes of the region of interest. CONCLUSIONS: Results of our studies show that the use of multiple energy windows and processing data in LM format with the proposed LM-MEW method led to improved quantification performance in low-count SPECT of isotopes with multiple emission peaks. These results motivate further development and validation of the LM-MEW method for such imaging applications, including for [Formula: see text]-RPT SPECT.

A Projection-Domain Low-Count Quantitative SPECT Method for α-Particle-Emitting Radiopharmaceutical Therapy.

Single-photon emission-computed tomography (SPECT) provides a mechanism to estimate regional isotope uptake in lesions and at-risk organs after administration of α-particle-emitting radiopharmaceutical therapies (α-RPTs). However, this estimation task is challenging due to the complex emission spectra, the very low number of detected counts (~20 times lower than in conventional SPECT), the impact of stray-radiation-related noise at these low counts, and the multiple image-degrading processes in SPECT. The conventional reconstruction-based quantification methods are observed to be erroneous for α-RPT SPECT. To address these challenges, we developed a low-count quantitative SPECT (LC-QSPECT) method that directly estimates the regional activity uptake from the projection data (obviating the reconstruction step), compensates for stray-radiation-related noise, and accounts for the radioisotope and SPECT physics, including the isotope spectra, scatter, attenuation, and collimator-detector response, using a Monte Carlo-based approach. The method was validated in the context of 3-D SPECT with 223Ra, a commonly used radionuclide for α-RPT. Validation was performed using both realistic simulation studies, including a virtual clinical trial, and synthetic and 3-D-printed anthropomorphic physical-phantom studies. Across all studies, the LC-QSPECT method yielded reliable regional-uptake estimates and outperformed the conventional ordered subset expectation-maximization (OSEM)-based reconstruction and geometric transfer matrix (GTM)-based post-reconstruction partial-volume compensation methods. Furthermore, the method yielded reliable uptake across different lesion sizes, contrasts, and different levels of intralesion heterogeneity. Additionally, the variance of the estimated uptake approached the Cramér-Rao bound-defined theoretical limit. In conclusion, the proposed LC-QSPECT method demonstrated the ability to perform reliable quantification for α-RPT SPECT.

Need for objective task-based evaluation of deep learning-based denoising methods: A study in the context of myocardial perfusion SPECT.

BACKGROUND: Artificial intelligence-based methods have generated substantial interest in nuclear medicine. An area of significant interest has been the use of deep-learning (DL)-based approaches for denoising images acquired with lower doses, shorter acquisition times, or both. Objective evaluation of these approaches is essential for clinical application. PURPOSE: DL-based approaches for denoising nuclear-medicine images have typically been evaluated using fidelity-based figures of merit (FoMs) such as root mean squared error (RMSE) and structural similarity index measure (SSIM). However, these images are acquired for clinical tasks and thus should be evaluated based on their performance in these tasks. Our objectives were to: (1) investigate whether evaluation with these FoMs is consistent with objective clinical-task-based evaluation; (2) provide a theoretical analysis for determining the impact of denoising on signal-detection tasks; and (3) demonstrate the utility of virtual imaging trials (VITs) to evaluate DL-based methods. METHODS: A VIT to evaluate a DL-based method for denoising myocardial perfusion SPECT (MPS) images was conducted. To conduct this evaluation study, we followed the recently published best practices for the evaluation of AI algorithms for nuclear medicine (the RELAINCE guidelines). An anthropomorphic patient population modeling clinically relevant variability was simulated. Projection data for this patient population at normal and low-dose count levels (20%, 15%, 10%, 5%) were generated using well-validated Monte Carlo-based simulations. The images were reconstructed using a 3-D ordered-subsets expectation maximization-based approach. Next, the low-dose images were denoised using a commonly used convolutional neural network-based approach. The impact of DL-based denoising was evaluated using both fidelity-based FoMs and area under the receiver operating characteristic curve (AUC), which quantified performance on the clinical task of detecting perfusion defects in MPS images as obtained using a model observer with anthropomorphic channels. We then provide a mathematical treatment to probe the impact of post-processing operations on signal-detection tasks and use this treatment to analyze the findings of this study. RESULTS: Based on fidelity-based FoMs, denoising using the considered DL-based method led to significantly superior performance. However, based on ROC analysis, denoising did not improve, and in fact, often degraded detection-task performance. This discordance between fidelity-based FoMs and task-based evaluation was observed at all the low-dose levels and for different cardiac-defect types. Our theoretical analysis revealed that the major reason for this degraded performance was that the denoising method reduced the difference in the means of the reconstructed images and of the channel operator-extracted feature vectors between the defect-absent and defect-present cases. CONCLUSIONS: The results show the discrepancy between the evaluation of DL-based methods with fidelity-based metrics versus the evaluation on clinical tasks. This motivates the need for objective task-based evaluation of DL-based denoising approaches. Further, this study shows how VITs provide a mechanism to conduct such evaluations computationally, in a time and resource-efficient setting, and avoid risks such as radiation dose to the patient. Finally, our theoretical treatment reveals insights into the reasons for the limited performance of the denoising approach and may be used to probe the effect of other post-processing operations on signal-detection tasks.